Conventions used

There are a number of text conventions used throughout this book.

CodeInText: Indicates code words in text, database table names, folder names, filenames, file extensions, pathnames, dummy URLs, user input, and Twitter handles. Here is an example: "This is an assignment where we are setting the value of Q[state, action]."

A block of code is set as follows:

import gym
import numpy as np
env = gym.make('Taxi-v2')
state = env.reset()

When we wish to draw your attention to a particular part of a code block, the relevant lines or items are set in bold:

import gym
import numpy as np
env = gym.make('Taxi-v2')
state = env.reset()

Any command-line input or output is written as follows:

pip install gym 

Bold: Indicates a new term, an important word, or words that you see on screen. For example: "The two major model-free RL algorithms are called Q-learning and State-Action-Reward-State-Action (SARSA)."