Markov Decision Processes (MDPs) in R


[Package List] [Top]

Documentation for package ‘MDP’ version 1.0

User Guides and Package Vignettes

Read overview or browse directory.

Help Pages

MDP-package Markov Decision Processes (MDPs) in R
actionCostMat Info matrices or data frames of the state and action space.
actionIdxDf Info matrices or data frames of the state and action space.
actionIdxMat Info matrices or data frames of the state and action space.
binaryMDPWriter Function for writing an HMDP model to binary files.
calcRPO Calculate the rentention payoff (RPO) for some states.
calcWeights Calculate weights based on current policy.
convertBinary2HMP Convert a HMDP model stored in binary format to a hmp (xml) file.
convertHMP2Binary Convert a HMDP model stored in a hmp (xml) file to binary file format.
fixAction Fix the action of a state.
getPolicy Get parts of the optimal policy.
getPolicyW Get parts of the optimal policy weights.
hmpMDPWriter Function for writing an HMDP model to a hmp file (XML).
loadMDP Create the HMDP defined in the binary files.
MDP Markov Decision Processes (MDPs) in R
policyIteAve Perform policy iteration (average criterion) on the MDP.
policyIteDiscount Perform policy iteration (discount criterion) on the MDP.
removeAction Remove the action of a state from the HMDP.
resetActions Reset the actions of a state.
setActionWeight Set the weight of an action.
setPolicy Set the current policy.
setPolicyAction Set the action of a state to be in the current policy.
setStateWeight Set the weight of a state.
stateIdxDf Info matrices or data frames of the state and action space.
stateIdxMat Info matrices or data frames of the state and action space.
transProbMat Info matrices or data frames of the state and action space.
valueIte Perform value iteration on the MDP.
weightNames Names of weights used in actions.