Reinforcement Learning Toolbox 2.0
last updated:
General
Documentation
Manual
Tutorial
Class Reference
Master Thesis
Examples
Related Papers
Downloads
Links
News
mailto:webmaster
Main Page     Class Hierarchy   Compound List   File List   Compound Members   File Members

CBatchEpisodeUpdate Class Reference

Class for doing batch updates during the learning trial. More...

#include <cepisodehistory.h>

Inheritance diagram for CBatchEpisodeUpdate:

CSemiMDPListener CParameterObject CParameters List of all members.


Public Member Functions

  CBatchEpisodeUpdate (CSemiMDPListener *listener, CEpisodeHistory *logger, int numEpisodes, std::list< CStateModifier * > *modifiers)
  Creates a batch update object for the specified listener with the specified episode history.

  ~CBatchEpisodeUpdate ()
virtual void  newEpisode ()
  Simulates all epsiodes from the history to the listener.

virtual void  simulateEpisode (int episode, CSemiMDPListener *listener)
  simulates the requested Episode to the listener

virtual void  simulateAllEpisodes (CSemiMDPListener *listener)
  simulates all episodes to the listener

void  simulateNRandomEpisodes (int numEpisodes, CSemiMDPListener *listener)
  simulates numEpisodes randomly choosen Episodes to the listener.



Protected Attributes

CSemiMDPListener listener
  listener to show the episodes

CEpisodeHistory logger
  episode history containing all episodes

int  numEpisodes
std::list< int > *  episodeIndex
CActionDataSet dataSet
CStep step

Detailed Description

Class for doing batch updates during the learning trial.

After each episode all the episodes from the past (which are in the given episode history) are be showed to the listener object again. This can improve learning specially for TD-Learning algorithms.

Each time a newEpisode event occurs the episodes in the history are shown to the given listener, so te batch update object must be added to the agents listener. This is used in connection with an agent logger which logs the current learning trial.


Constructor & Destructor Documentation

CBatchEpisodeUpdate::CBatchEpisodeUpdate CSemiMDPListener listener,
CEpisodeHistory logger,
int  numEpisodes,
std::list< CStateModifier * > *  modifiers
 

Creates a batch update object for the specified listener with the specified episode history.

CBatchEpisodeUpdate::~CBatchEpisodeUpdate  ) 
 

Member Function Documentation

virtual void CBatchEpisodeUpdate::newEpisode  )  [virtual]
 

Simulates all epsiodes from the history to the listener.

Just calls the simulate all episodes method of the interface CEpisodeHistory.

Reimplemented from CSemiMDPListener.

virtual void CBatchEpisodeUpdate::simulateAllEpisodes CSemiMDPListener listener  )  [virtual]
 

simulates all episodes to the listener

virtual void CBatchEpisodeUpdate::simulateEpisode int  episode,
CSemiMDPListener listener
[virtual]
 

simulates the requested Episode to the listener

void CBatchEpisodeUpdate::simulateNRandomEpisodes int  numEpisodes,
CSemiMDPListener listener
 

simulates numEpisodes randomly choosen Episodes to the listener.


Member Data Documentation

CActionDataSet* CBatchEpisodeUpdate::dataSet [protected]
 
std::list<int>* CBatchEpisodeUpdate::episodeIndex [protected]
 
CSemiMDPListener* CBatchEpisodeUpdate::listener [protected]
 

listener to show the episodes

CEpisodeHistory* CBatchEpisodeUpdate::logger [protected]
 

episode history containing all episodes

int CBatchEpisodeUpdate::numEpisodes [protected]
 
CStep* CBatchEpisodeUpdate::step [protected]
 

The documentation for this class was generated from the following file: