Reinforcement Learning Toolbox 2.0
last updated:
General
Documentation
Manual
Tutorial
Class Reference
Master Thesis
Examples
Related Papers
Downloads
Links
News
mailto:webmaster
Main Page     Class Hierarchy   Compound List   File List   Compound Members   File Members

CSemiMDPTransition Class Reference

Transition for the semiMDP case. More...

#include <ctheoreticalmodel.h>

Inheritance diagram for CSemiMDPTransition:

CTransition List of all members.


Public Member Functions
  CSemiMDPTransition (int startState, int endState, double prop)
virtual  ~CSemiMDPTransition ()
std::map< int, double > *  getDurations ()
void  addDuration (int duration, double factor)
  adds the given factor the duration's factor

void  setDuration (int duration, double factor)
  adds the duration's factor to the given factor

double  getDurationFaktor (int duration)
double  getDurationPropability (int duration)
  returns the propability of transition with the specified duration

virtual void  loadASCII (FILE *stream, int fixedState, bool forward)
virtual void  saveASCII (FILE *stream, bool forward)
double  getSemiMDPFaktor (double gamma)


Protected Attributes
std::map< int, double > *  durations
  the list of the durations

Detailed Description

Transition for the semiMDP case.

CSemiMDPTranstion stores a Transition for the Semi-Markov case. Additionally has an list of possible durations and the probabilities of the duration, so the probability of the duration multiplied with the transition probability is the probability of coming from state A to state B in "duration" steps, executing the given action. The type field of CSemiMDP transition is set to SEMIMDPTRANSITION. When adding a duration with a specific factor, all other duration factors get multiplied by 1 - factor, and then the given duration's factor is added or a nes duration is added to the list if the duration wasn't member. When setting a duration all other durations factors are multiplied by 1 - (factor - factor_{old}).

Constructor & Destructor Documentation

CSemiMDPTransition::CSemiMDPTransition (  int  startState,
int  endState,
double  prop
) 
 
virtual CSemiMDPTransition::~CSemiMDPTransition (   )  [virtual]
 

Member Function Documentation

void CSemiMDPTransition::addDuration (  int  duration,
double  factor
) 
 

adds the given factor the duration's factor

When adding a duration with a specific factor, all other duration factors get multiplied by 1 - factor, and then the given duration's factor is added or a nes duration is added to the list if the duration wasn't member.

double CSemiMDPTransition::getDurationFaktor (  int  duration  ) 
 
double CSemiMDPTransition::getDurationPropability (  int  duration  ) 
 

returns the propability of transition with the specified duration

The propability is getPropability() * getDurationFaktor(duration)

std::map<int, double>* CSemiMDPTransition::getDurations (   ) 
 
double CSemiMDPTransition::getSemiMDPFaktor (  double  gamma  ) 
 

Returns the Faktor sum_N gamma^N
virtual void CSemiMDPTransition::loadASCII (  FILE *  stream,
int  fixedState,
bool  forward
)  [virtual]
 

Reimplemented from CTransition.

virtual void CSemiMDPTransition::saveASCII (  FILE *  stream,
bool  forward
)  [virtual]
 

Reimplemented from CTransition.

void CSemiMDPTransition::setDuration (  int  duration,
double  factor
) 
 

adds the duration's factor to the given factor

Member Data Documentation

std::map<int, double>* CSemiMDPTransition::durations [protected]
 

the list of the durations
The documentation for this class was generated from the following file: