Reinforcement Learning Toolbox 2.0
last updated:
General
Documentation
Manual
Tutorial
Class Reference
Master Thesis
Examples
Related Papers
Downloads
Links
News
mailto:webmaster
Main Page     Class Hierarchy   Compound List   File List   Compound Members   File Members

CComposedQETraces Class Reference

This is the E-Trace class for the CComposedQFunction class. More...

#include <cqetraces.h>

Inheritance diagram for CComposedQETraces:

CAbstractQETraces CParameterObject CParameters List of all members.


Public Member Functions

  CComposedQETraces (CComposedQFunction *qfunction)
virtual  ~CComposedQETraces ()
virtual void  resetETraces ()
  Interface function for reseting the ETraces.

virtual void  addETrace (CStateCollection *State, CAction *action, double factor=1.0, CActionData *data=NULL)
  Interface function for adding a State-Action pair with the given factor to the ETraces.

virtual void  updateETraces (CAction *action, CActionData *data=NULL)
  Interface function for updating the ETraces.

virtual void  updateQFunction (double td)
  Interface function for updating the Q-Values of all State-Action Pairs in the ETraces.

void  setQETrace (CAbstractQETraces *qEtrace, int index, bool bDeleteOld=true)
CAbstractQETraces getQETrace (int index)
  Returns the index th VETraces object.

virtual void  setReplacingETraces (bool bReplace)
  sets the internal replacing ETraces flag and the flag of the Q-ETraces



Protected Attributes

std::list< CAbstractQETraces * > *  qETraces
  The list of Q-ETraces.

CComposedQFunction qCompFunction
  the assigned composed Q-Function


Detailed Description

This is the E-Trace class for the CComposedQFunction class.

This class represents the ETrace object for the composed Q-Functions. Composed Q-Functions consists of several Q-Functions, so you can use different kind of Q-Functions for different actions (For example combine a NeuralNetwork Q-Function with a Feature Q-Function). The class works similar to CQETraces, but instead of CVETrace objects, it handles CQETrace objects.


Constructor & Destructor Documentation

CComposedQETraces::CComposedQETraces CComposedQFunction qfunction  ) 
 
virtual CComposedQETraces::~CComposedQETraces  )  [virtual]
 

Member Function Documentation

virtual void CComposedQETraces::addETrace CStateCollection State,
CAction action,
double  factor = 1.0,
CActionData data = NULL
[virtual]
 

Interface function for adding a State-Action pair with the given factor to the ETraces.

Implements CAbstractQETraces.

CAbstractQETraces* CComposedQETraces::getQETrace int  index  ) 
 

Returns the index th VETraces object.

virtual void CComposedQETraces::resetETraces  )  [virtual]
 

Interface function for reseting the ETraces.

Implements CAbstractQETraces.

void CComposedQETraces::setQETrace CAbstractQETraces qEtrace,
int  index,
bool  bDeleteOld = true
 
virtual void CComposedQETraces::setReplacingETraces bool  bReplace  )  [virtual]
 

sets the internal replacing ETraces flag and the flag of the Q-ETraces

Reimplemented from CAbstractQETraces.

virtual void CComposedQETraces::updateETraces CAction action,
CActionData data = NULL
[virtual]
 

Interface function for updating the ETraces.

I.e. all stored ETraces-factors get multiplied by lambda * gamma, gamma is taken from the Q-Function. If the action is a multistep action, the factor lambda * gamma is exponentiated with the duration.

Implements CAbstractQETraces.

virtual void CComposedQETraces::updateQFunction double  td  )  [virtual]
 

Interface function for updating the Q-Values of all State-Action Pairs in the ETraces.

Implements CAbstractQETraces.


Member Data Documentation

CComposedQFunction* CComposedQETraces::qCompFunction [protected]
 

the assigned composed Q-Function

std::list<CAbstractQETraces *>* CComposedQETraces::qETraces [protected]
 

The list of Q-ETraces.


The documentation for this class was generated from the following file: