Reinforcement Learning Toolbox 2.0
last updated:
General
Documentation
Manual
Tutorial
Class Reference
Master Thesis
Examples
Related Papers
Downloads
Links
News
mailto:webmaster
Main Page     Class Hierarchy   Compound List   File List   Compound Members   File Members

CDiscreteStochasticEstimatedModel Class Reference

Estimated Model for Discrete States. More...

#include <ctheoreticalmodel.h>

Inheritance diagram for CDiscreteStochasticEstimatedModel:

CAbstractFeatureStochasticEstimatedModel CFeatureStochasticModel CSemiMDPListener CStateObject CLearnDataObject CAbstractFeatureStochasticModel CParameterObject CParameterObject CActionObject CParameters CParameters List of all members.


Public Member Functions

  CDiscreteStochasticEstimatedModel (CAbstractStateDiscretizer *discState, CFeatureQFunction *stateActionVisits, CActionSet *actions)
virtual  ~CDiscreteStochasticEstimatedModel ()
virtual void  nextStep (CStateCollection *oldState, CAction *action, CStateCollection *nextState)
  Updates the discrete state transition.

int  getStateActionVisits (int Feature, int action)
  Returns the State Action Visits.

int  getStateVisits (int Feature)
  Returns how often the agent visited the given state.



Protected Attributes

CAbstractStateDiscretizer discretizer

Detailed Description

Estimated Model for Discrete States.

Implements the fuction nextStep for updating. CDiscreteStochasticEstimatedModel updates the transitions of the specified discrete state number with visit factor 1.0. To retrieve the state from the statecollection the in the constructor given discretizer is used.

See also:
CAbstractFeatureStochasticEstimatedModel

Constructor & Destructor Documentation

CDiscreteStochasticEstimatedModel::CDiscreteStochasticEstimatedModel CAbstractStateDiscretizer discState,
CFeatureQFunction stateActionVisits,
CActionSet actions
 
virtual CDiscreteStochasticEstimatedModel::~CDiscreteStochasticEstimatedModel  )  [inline, virtual]
 

Member Function Documentation

int CDiscreteStochasticEstimatedModel::getStateActionVisits int  Feature,
int  action
 

Returns the State Action Visits.

Returns how often the given action was choosen in the given state. The State Action visits are stored in saVisits.

Reimplemented from CAbstractFeatureStochasticEstimatedModel.

int CDiscreteStochasticEstimatedModel::getStateVisits int  Feature  ) 
 

Returns how often the agent visited the given state.

This is calculated by summing up the state action visits.

Reimplemented from CAbstractFeatureStochasticEstimatedModel.

virtual void CDiscreteStochasticEstimatedModel::nextStep CStateCollection oldState,
CAction action,
CStateCollection nextState
[virtual]
 

Updates the discrete state transition.

Implements CAbstractFeatureStochasticEstimatedModel.


Member Data Documentation

CAbstractStateDiscretizer* CDiscreteStochasticEstimatedModel::discretizer [protected]
 

Reimplemented from CAbstractFeatureStochasticModel.


The documentation for this class was generated from the following file: