Defining and using custom data sources in Spark

You can define your own data sources and combine the data from such sources with data from other more standard data sources (for example, relational databases, Parquet files, and so on). In Chapter 5, Using Spark SQL in Streaming Applications, we define a custom data source for streaming data from public APIs available from Transport for London (TfL) site.