Chapter 1. Obtaining and Cleaning Data

In this chapter, we will cover the following recipes:

• Retrieving all file names from hierarchical directories using Java
• Retrieving all file names from hierarchical directories using Apache Commons IO
• Reading contents from text files all at once using Java 8
• Reading contents from text files all at once using Apache Commons IO
• Extracting PDF text using Apache Tika
• Cleaning ASCII text files using Regular Expressions
• Parsing Comma Separated Value files using Univocity
• Parsing Tab Separated Value files using Univocity
• Parsing XML files using JDOM
• Writing JSON files using JSON.simple
• Reading JSON files using JSON.simple
• Extracting web data from a URL using JSoup
• Extracting web data from a website using Selenium Webdriver
• Reading table data from MySQL database