Question 1
[10 marks]
- [5 marks] When we considered robot control, we specified a controller in terms of a command function and a state transition
function. Explain what the control function and the state transition function are for a Q-learning agent.
8cm
- [5 marks]
Explain how the communication between layers and communication between
time steps is handled in the logical implementation of a hierarchical
controller.