Package
Class
Tree
Deprecated
Index
Help
PREV NEXT
FRAMES
NO FRAMES
All Classes
A
C
D
E
F
G
I
L
M
N
P
Q
R
S
T
V
X
Y
Z
A
ACTION_SIZE
- Variable in class
SGameModelController
ACTION_SIZE
- Variable in class
SGameQController
alpha
- Variable in class
SarsaController
alphaFixed
- Variable in class
Q10_Controller
alphaFixed
- Variable in class
Q_Controller
C
crashReward
- Variable in class
SGameEnv
currX
- Variable in class
Q_Env
currX
- Variable in class
SGameEnv
currX
- Variable in class
TGameEnv
currY
- Variable in class
Q_Env
currY
- Variable in class
SGameEnv
currY
- Variable in class
TGameEnv
D
DAMAGE_SIZE
- Variable in class
SGameModelController
DAMAGE_SIZE
- Variable in class
SGameQController
damaged
- Variable in class
SGameEnv
discount
- Variable in class
Q10_Controller
discount
- Variable in class
Q_Controller
discount
- Variable in class
SarsaController
doreset(double)
- Method in class
Q10_Controller
resets the Q-values sets all of the Q-values to initVal, and all of the visit counts to 0
doreset()
- Method in class
Q10_GUI
doreset(double)
- Method in class
Q_Controller
resets the Q-values sets all of the Q-values to initVal, and all of the visit counts to 0
doreset()
- Method in class
Q_Env
resets the steps and the reward.
doreset()
- Method in class
Q_GUI
doreset(double)
- Method in class
SarsaController
resets the Q-values sets all of the Q-values to initVal, and the eligibility to 0
doreset()
- Method in class
SarsaGUI
doreset(double)
- Method in class
SGameController
resets the parameters this is overridden by learning controllers
doreset()
- Method in class
SGameEnv
resets the number of steps and the reward.
doreset(double)
- Method in class
SGameFAController
resets the weights.
doreset()
- Method in class
SGameGUI
doreset(double)
- Method in class
SGameModelController
resets the Q-values, and all of the transitions.
doreset(double)
- Method in class
SGameQController
resets the Q-values.
doreset(double)
- Method in class
TGameController
resets the Q-values.
doreset()
- Method in class
TGameEnv
resets the number of steps and the reward.
doreset()
- Method in class
TGameEnvRand
doreset()
- Method in class
TGameGUI
doreset(double)
- Method in class
TGameQController
resets the Q-values.
dostep(int, double, double)
- Method in class
Q10_Controller
does one step carries out the action, and sets the discount and the alpha value
dostep(int)
- Method in class
Q10_Controller
does one step carries out the action
dostep(int)
- Method in class
Q10_GUI
dostep(int, double, double)
- Method in class
Q_Controller
does one step carries out the action, and sets the discount and the alpha value
dostep(int)
- Method in class
Q_Controller
does one step carries out the action
dostep(int)
- Method in class
Q_Env
does one step carries out the action
dostep(int)
- Method in class
Q_GUI
dostep(int, double, double, double)
- Method in class
SarsaController
does one step carries out the action, and sets the discount and the alpha value
dostep(int)
- Method in class
SarsaController
does one step carries out the action
dostep(int)
- Method in class
SarsaGUI
dostep(int)
- Method in class
SGameAdvController
does one step.
dostep(int, int)
- Method in class
SGameAdvEnv
does one step.
dostep(int)
- Method in class
SGameController
does one step.
dostep(int)
- Method in class
SGameEnv
does one step.
dostep(int)
- Method in class
SGameFAController
does one step.
dostep(int)
- Method in class
SGameGUI
dostep(int)
- Method in class
SGameModelController
does one step.
dostep(int)
- Method in class
SGameQController
does one step.
dostep(int)
- Method in class
TGameController
does one step.
dostep(int)
- Method in class
TGameEnv
does one step.
dostep(int)
- Method in class
TGameEnvRand
does one step.
dostep(int)
- Method in class
TGameGUI
dostep(int)
- Method in class
TGameQController
does one step.
doSteps(int, double, double, double)
- Method in class
Q10_Controller
does count number of steps whether each step is greedy or random is determine by greedyProb
doSteps(int, double, double, double)
- Method in class
Q_Controller
does count number of steps whether each step is greedy or random is determine by greedyProb
doSteps(int, double, double, double, double)
- Method in class
SarsaController
does count number of steps whether each step is greedy or random is determine by greedyProb
doSteps(int, double)
- Method in class
SGameController
does count number of steps This is where you would put your controller
doSteps(int, double)
- Method in class
SGameFAController
does count number of steps This is where you would put your controller
doSteps(int, double)
- Method in class
SGameModelController
do numsteps number of steps This is where you would put your controller
doSteps(int, double)
- Method in class
SGameQController
do count number of steps This is where you would put your controller
doSteps(int, double)
- Method in class
TGameController
does count number of steps This is where you would put your controller
doSteps(int, double)
- Method in class
TGameQController
does count number of steps This is where you would put your controller
E
e
- Variable in class
SarsaController
The the eligibility trace for state (xpos,ypos) and action
F
featureValues(int, int, int, boolean, int)
- Method in class
SGameFeatureSet
Returns the feature values for a state action pair.
G
getAlpha()
- Method in class
SGameController
getAlpha()
- Method in class
TGameController
getAlphaFixed()
- Method in class
SGameController
getAlphaFixed()
- Method in class
TGameController
getCounts(int, int, int)
- Method in class
SGameController
This is not used in this controller, but is overridden by learning controllers.
getCounts(int, int, int)
- Method in class
SGameModelController
The GUI uses getCounts(x,y,a) to display counts.
getCounts(int, int, int)
- Method in class
SGameQController
The GUI uses getCounts(x,y,a) to display counts.
getDiscount()
- Method in class
SGameController
getDiscount()
- Method in class
TGameController
getEnvironment()
- Method in class
SGameController
getEnvironment()
- Method in class
TGameController
getTitle()
- Method in class
SGameController
getTitle()
- Method in class
TGameController
greedyProb
- Variable in class
SarsaController
I
init()
- Method in class
Q10_GUI
init()
- Method in class
Q_GUI
init()
- Method in class
SarsaGUI
init()
- Method in class
SGameGUI
init()
- Method in class
TGameGUI
L
lambda
- Variable in class
SarsaController
M
m03
- Variable in class
SGameEnv
m13
- Variable in class
SGameEnv
m21
- Variable in class
SGameEnv
m33
- Variable in class
SGameEnv
m42
- Variable in class
SGameEnv
minReward
- Variable in class
SGameEnv
minReward
- Variable in class
TGameEnv
minStep
- Variable in class
SGameEnv
minStep
- Variable in class
TGameEnv
N
num_updates()
- Method in class
SGameModelController
numberOfSteps
- Variable in class
Q_Env
numberOfSteps
- Variable in class
SGameEnv
numberOfSteps
- Variable in class
TGameEnv
NumFeatures
- Variable in class
SGameFeatureSet
The number of features.
P
prevAction
- Variable in class
SarsaController
prevX
- Variable in class
SarsaController
prevY
- Variable in class
SarsaController
prize
- Variable in class
SGameEnv
Prize Location.
PRIZE_SIZE
- Variable in class
SGameModelController
PRIZE_SIZE
- Variable in class
SGameQController
Q
Q10_Controller
- Class in
<Unnamed>
This applet demonstrates Q-learning for a particular grid world problem.
Q10_GUI
- Class in
<Unnamed>
This applet demonstrates Q-learning for a particular grid world problem.
Q10_GUI()
- Constructor for class
Q10_GUI
Q_Controller
- Class in
<Unnamed>
This applet demonstrates Q-learning for a particular grid world problem.
Q_Env
- Class in
<Unnamed>
This applet demonstrates Q-learning for a particular grid world problem.
Q_Env()
- Constructor for class
Q_Env
Q_GUI
- Class in
<Unnamed>
This applet demonstrates Q-learning for a particular grid world problem.
Q_GUI()
- Constructor for class
Q_GUI
qvalue(int, int, int)
- Method in class
SGameController
This is not used in this controller, but is overridden by learning controllers.
qvalue(int, int, int)
- Method in class
SGameFAController
This is gives the q-values to be drawn by the GUI.
qvalue(int, int, int)
- Method in class
SGameModelController
The GUI uses qvalue(x,y,a) to display values and arrows.
qvalue(int, int, int)
- Method in class
SGameQController
The GUI uses qvalue(x,y,a) to display values and arrows.
qvalue(int, int, int)
- Method in class
TGameController
This is not used in this controller, but is overridden by learning controllers.
qvalue(int, int, int)
- Method in class
TGameQController
The GUI uses qvalue(x,y,a) to display values and for the arrows.
qvalues
- Variable in class
Q10_Controller
The Q values: Q[xpos,ypos,action]
qvalues
- Variable in class
Q_Controller
The Q values: Q[xpos,ypos,action]
qvalues
- Variable in class
SarsaController
The Q values: Q[xpos,ypos,action]
R
replacingTrace
- Variable in class
SarsaController
reward
- Variable in class
SarsaController
reward
- Variable in class
TGameEnv
S
sarsa
- Variable in class
TGameController
SarsaController
- Class in
<Unnamed>
This applet demonstrates SARSA(lambda)-learning for a particular grid world problem.
SarsaGUI
- Class in
<Unnamed>
This applet demonstrates SARSA(lambda)-learning for a particular grid world problem.
SarsaGUI()
- Constructor for class
SarsaGUI
setAlpha(double)
- Method in class
SGameController
setAlpha(double)
- Method in class
TGameController
setAlphaFixed(boolean)
- Method in class
SGameController
setAlphaFixed(boolean)
- Method in class
TGameController
setDiscount(double)
- Method in class
SGameController
setDiscount(double)
- Method in class
TGameController
SGameAdvController
- Class in
<Unnamed>
This applet demonstrates a simple game.
SGameAdvEnv
- Class in
<Unnamed>
This applet demonstrates a simple game.
SGameAdvEnv()
- Constructor for class
SGameAdvEnv
SGameController
- Class in
<Unnamed>
This applet demonstrates a simple game.
SGameEnv
- Class in
<Unnamed>
This applet demonstrates a simple game.
SGameEnv()
- Constructor for class
SGameEnv
SGameFAController
- Class in
<Unnamed>
This applet demonstrates a simple game.
SGameFeatureSet
- Class in
<Unnamed>
This applet demonstrates a simple game.
SGameFeatureSet()
- Constructor for class
SGameFeatureSet
SGameGUI
- Class in
<Unnamed>
This applet demonstrates a simple grid-world game.
SGameGUI()
- Constructor for class
SGameGUI
SGameModelController
- Class in
<Unnamed>
This applet demonstrates a simple game.
SGameQController
- Class in
<Unnamed>
This applet demonstrates a simple game.
state(int, int, int, boolean)
- Method in class
SGameModelController
gets the state from the xpos, ypos, prize, damage
state(int, int, int, boolean)
- Method in class
SGameQController
gets the state from the xpos, ypos, prize, damage
STATE_SIZE
- Variable in class
SGameModelController
STATE_SIZE
- Variable in class
SGameQController
T
TGameController
- Class in
<Unnamed>
This applet demonstrates a simple game.
TGameEnv
- Class in
<Unnamed>
This applet demonstrates a simple game.
TGameEnv()
- Constructor for class
TGameEnv
TGameEnvRand
- Class in
<Unnamed>
TGameEnvRand(TGameEnv, int)
- Constructor for class
TGameEnvRand
TGameGUI
- Class in
<Unnamed>
This applet demonstrates a simple grid-world game.
TGameGUI()
- Constructor for class
TGameGUI
TGameQController
- Class in
<Unnamed>
This applet demonstrates a simple game.
toDisplay()
- Method in class
SGameController
This can optionally return a set of real values to dosplay.
toDisplay()
- Method in class
SGameFAController
toDisplay()
- Method in class
TGameController
This can optionally return a set of real values to dosplay.
totalReward
- Variable in class
Q_Env
totalReward
- Variable in class
SGameEnv
totalReward
- Variable in class
TGameEnv
tracing
- Variable in class
Q10_Controller
tracing
- Variable in class
Q_Controller
tracing
- Variable in class
Q_Env
tracing
- Variable in class
SarsaController
tracing
- Variable in class
SGameController
tracing
- Variable in class
SGameEnv
tracing
- Variable in class
TGameController
tracing
- Variable in class
TGameEnv
V
value(int, int)
- Method in class
Q10_Controller
determines the value of a location the value is the maximum, for all actions, of the q-value
value(int, int)
- Method in class
Q_Controller
determines the value of a location the value is the maximum, for all actions, of the q-value
value(int, int)
- Method in class
SarsaController
determines the value of a location the value is the maximum, for all actions, of the q-value
value(int, int, int, boolean)
- Method in class
SGameFAController
determines the value of a state the value is the maximum, for all actions, of the q-value
value(int)
- Method in class
SGameModelController
determines the value of a state the value is the maximum, for all actions, of the q-value
value(int)
- Method in class
SGameQController
determines the value of a state the value is the maximum, for all actions, of the q-value
value(int, int)
- Method in class
TGameQController
determines the value of a state the value is the maximum, for all actions, of the q-value
visits
- Variable in class
Q10_Controller
The number of times the agent has been at (xpos,ypos) and done action
visits
- Variable in class
Q_Controller
The number of times the agent has been at (xpos,ypos) and done action
X
X_SIZE
- Variable in class
SGameModelController
X_SIZE
- Variable in class
SGameQController
xDim
- Variable in class
SGameEnv
xDim
- Variable in class
TGameEnv
Y
Y_SIZE
- Variable in class
SGameModelController
Y_SIZE
- Variable in class
SGameQController
yDim
- Variable in class
SGameEnv
yDim
- Variable in class
TGameEnv
Z
zeroCrossing
- Variable in class
SGameEnv
zeroCrossing
- Variable in class
TGameEnv
A
C
D
E
F
G
I
L
M
N
P
Q
R
S
T
V
X
Y
Z
Package
Class
Tree
Deprecated
Index
Help
PREV NEXT
FRAMES
NO FRAMES
All Classes