Questions

1. Is a replay buffer required for on-policy or off-policy RL algorithms?
2. Why do we discount rewards?
3. What will happen if the discount factor is γ > 1?
4. Will a model-based RL agent always perform better than a model-free RL agent, since we have a model of the environment states?
5. What is the difference between RL and deep RL?