Creating a process

Over the course of this book and your own explorations, you will gather sample data, build models, and try various applications. Establishing a process early on to keep these elements organized will make things easier in the long run. Here are a few suggestions to keep in mind:

• Always use source control for all of your code.
• Ensure that test and training sets are named properly in their own folders (versioned if possible).
• Versioning models with both naming and source control.
• Retain evaluation metrics in a spreadsheet along with the parameters used.

As you develop your skillset and create more complex problems, additional tooling such as Apache Spark or other clustering platforms will more than likely be required. We will discuss this in Chapter 11, Training and Building Production Models, along with other suggestions on training at scale.