Reinforcement Learning Toolbox 2.0 last updated:

General Documentation Manual Tutorial Class Reference Master Thesis Examples Related Papers Downloads Links News mailto:webmaster Main Page     Class Hierarchy   Compound List   File List   Compound Members   File Members CAbstractFeatureStochasticModel Class Reference Interface for all model classes. More... #include <ctheoreticalmodel.h> Inheritance diagram for CAbstractFeatureStochasticModel: List of all members. Public Member Functions   CAbstractFeatureStochasticModel (CActionSet *actions, int numStates)   To create the model you have to provide the Models actions and the number of different states.   CAbstractFeatureStochasticModel (CActionSet *actions, CStateModifier *discretizer)   CAbstractFeatureStochasticModel (int numActions, int numFeatures) virtual  ~CAbstractFeatureStochasticModel () virtual double  getPropability (int oldFeature, CAction *action, int newFeature)   Calls the getPropability function with the action index as argument. virtual double  getPropability (int oldFeature, int action, int newFeature)=0   Interface function. virtual double  getPropability (int oldFeature, int action, int duration, int newFeature)=0   Interface function. virtual double  getPropability (CFeatureList *oldList, CAction *action, CFeatureList *newList)   Calculates the propabilities for a list of features. virtual double  getPropability (CStateCollection *oldState, CAction *action, CStateCollection *newState) virtual double  getPropability (CState *oldState, CAction *action, CState *newState) virtual CTransitionList *  getForwardTransitions (int action, int state)=0   Interface Function. virtual CTransitionList *  getForwardTransitions (CAction *action, CState *state) virtual CTransitionList *  getForwardTransitions (CAction *action, CStateCollection *state) virtual CTransitionList *  getBackwardTransitions (int action, int state)=0   Interface Function. virtual unsigned int  getNumFeatures () Protected Attributes unsigned int  numFeatures CStateModifier *  discretizer bool  createdActions Detailed Description Interface for all model classes. The models are only designed for feature and discrete states (i.e. discretized states). The class defines the functions for getting the Probabilities of a specific state transition (so a state-action-state, resp. feature-action-feature tuple is given). In Addition you can retrieve the forward and the backward transitions for a specific state action pair. The interface provides 4 Functions, which the subclasses have to implement: getPropability(int oldFeature, int action, int newFeature) has to return the propability P(s'|s,a) getPropability(int oldFeature, int action, int duration, int newFeature) has to return the propability for the semi MDP case, i.e. P(s',N|s,a) CTransitionList* getForwardTransitions(int action, int state) has to return a list of all Transitions containing the states which can be reach from the state executing the action. CTransitionList* getBackwardTransitions(int action, int state) has to return a list of all Transitions containing the states which can reach the state given state executing the action. Constructor & Destructor Documentation CAbstractFeatureStochasticModel::CAbstractFeatureStochasticModel (  CActionSet *  actions, int  numStates )    To create the model you have to provide the Models actions and the number of different states. CAbstractFeatureStochasticModel::CAbstractFeatureStochasticModel (  CActionSet *  actions, CStateModifier *  discretizer )  CAbstractFeatureStochasticModel::CAbstractFeatureStochasticModel (  int  numActions, int  numFeatures )  virtual CAbstractFeatureStochasticModel::~CAbstractFeatureStochasticModel (   )  [virtual] Member Function Documentation virtual CTransitionList* CAbstractFeatureStochasticModel::getBackwardTransitions (  int  action, int  state )  [pure virtual]   Interface Function. has to return a list of all Transitions containing the states which can reach the state given state executing the action. Implemented in CFeatureStochasticModel. virtual CTransitionList* CAbstractFeatureStochasticModel::getForwardTransitions (  CAction *  action, CStateCollection *  state )  [virtual] virtual CTransitionList* CAbstractFeatureStochasticModel::getForwardTransitions (  CAction *  action, CState *  state )  [virtual] virtual CTransitionList* CAbstractFeatureStochasticModel::getForwardTransitions (  int  action, int  state )  [pure virtual]   Interface Function. has to return a list of all Transitions containing the states which can be reach from the state executing the action. Implemented in CFeatureStochasticModel. virtual unsigned int CAbstractFeatureStochasticModel::getNumFeatures (   )  [virtual] virtual double CAbstractFeatureStochasticModel::getPropability (  CState *  oldState, CAction *  action, CState *  newState )  [virtual] virtual double CAbstractFeatureStochasticModel::getPropability (  CStateCollection *  oldState, CAction *  action, CStateCollection *  newState )  [virtual] virtual double CAbstractFeatureStochasticModel::getPropability (  CFeatureList *  oldList, CAction *  action, CFeatureList *  newList )  [virtual]   Calculates the propabilities for a list of features. virtual double CAbstractFeatureStochasticModel::getPropability (  int  oldFeature, int  action, int  duration, int  newFeature )  [pure virtual]   Interface function. has to return the propability for the semi MDP case, i.e. P(s',N|s,a) Implemented in CFeatureStochasticModel. virtual double CAbstractFeatureStochasticModel::getPropability (  int  oldFeature, int  action, int  newFeature )  [pure virtual]   Interface function. has to return the propability P(s'|s,a) Implemented in CFeatureStochasticModel. virtual double CAbstractFeatureStochasticModel::getPropability (  int  oldFeature, CAction *  action, int  newFeature )  [virtual]   Calls the getPropability function with the action index as argument. Member Data Documentation bool CAbstractFeatureStochasticModel::createdActions [protected] CStateModifier* CAbstractFeatureStochasticModel::discretizer [protected]   Reimplemented in CDiscreteStochasticEstimatedModel. unsigned int CAbstractFeatureStochasticModel::numFeatures [protected] The documentation for this class was generated from the following file: ctheoreticalmodel.h