Reinforcement Learning Toolbox 2.0 last updated:

General Documentation Manual Tutorial Class Reference Master Thesis Examples Related Papers Downloads Links News mailto:webmaster Main Page     Class Hierarchy   Compound List   File List   Compound Members   File Members CStateVETraces Class Reference State ETraces stores the state object itself. More... #include <cvetraces.h> Inheritance diagram for CStateVETraces: List of all members. Public Member Functions   CStateVETraces (CAbstractVFunction *vFunction, CStateProperties *modelState, std::list< CStateModifier * > *modifiers=NULL) virtual  ~CStateVETraces () virtual void  resetETraces ()   Interface for clearing the Etraces. virtual void  addETrace (CStateCollection *State, double factor=1.0)   Interface for adding a Etrace. virtual void  updateETraces (int duration=1)   Interfeace for updating the ETraces. virtual void  updateVFunction (double td)   Update the V-Function. Protected Attributes CStateCollectionList *  eTraceStates int  eTraceLength CStateCollectionImpl *  bufState std::list< double > *  eTraces Detailed Description State ETraces stores the state object itself. Stores states of the kind the V-Function uses. For each state there is an Etrace factor stored in a double list, which are updated when an ETrace is added (every factor gets multiplied by lambda^N * gamma^N), the active state is intialised with the given factor (standard value is 1.0). State VETraces can be used for non-parametric Value Functions, when they also don't depend on a feature state. But they are very slow and its not recommended to use state etraces Constructor & Destructor Documentation CStateVETraces::CStateVETraces (  CAbstractVFunction *  vFunction, CStateProperties *  modelState, std::list< CStateModifier * > *  modifiers = NULL )  virtual CStateVETraces::~CStateVETraces (   )  [virtual] Member Function Documentation virtual void CStateVETraces::addETrace (  CStateCollection *  State, double  factor = 1.0 )  [virtual]   Interface for adding a Etrace. Implements CAbstractVETraces. virtual void CStateVETraces::resetETraces (   )  [virtual]   Interface for clearing the Etraces. Implements CAbstractVETraces. virtual void CStateVETraces::updateETraces (  int  duration = 1  )  [virtual]   Interfeace for updating the ETraces. All ETraces factors get multplied by lambda * gamma. For an multistep action the update has to be lambda * gamma^N, so the duration can be given as parameter. Implements CAbstractVETraces. virtual void CStateVETraces::updateVFunction (  double  td  )  [virtual]   Update the V-Function. For all States in the Etraces the "td" value is multiplied with the E-Trace factor (e.g. lambda^N*gamma^N$ for replacing E-Traces), N is the time past since the state was active is calculated ,the Value of the state is updated. Implements CAbstractVETraces. Member Data Documentation CStateCollectionImpl* CStateVETraces::bufState [protected] int CStateVETraces::eTraceLength [protected] std::list<double>* CStateVETraces::eTraces [protected] CStateCollectionList* CStateVETraces::eTraceStates [protected] The documentation for this class was generated from the following file: cvetraces.h