Reinforcement Learning Toolbox 2.0
last updated:
General
Documentation
Manual
Tutorial
Class Reference
Master Thesis
Examples
Related Papers
Downloads
Links
News
mailto:webmaster
Main Page     Class Hierarchy   Compound List   File List   Compound Members   File Members

CTorchGradientFunction Class Reference

Class for learning with Torch-Gradient machines. More...

#include <ctorchvfunction.h>

Inheritance diagram for CTorchGradientFunction:

CTorchFunction CGradientFunction CGradientUpdateFunction CParameterObject CLearnDataObject CParameters CParameterObject CParameters List of all members.


Public Member Functions

  CTorchGradientFunction (int numInputs, int numOutputs)
  Creates a new value function learning with a torch gradient machine.

  CTorchGradientFunction (GradientMachine *machine)
virtual  ~CTorchGradientFunction ()
virtual void  resetData ()
  Resets the parameters of the gradient machine.

virtual void  updateWeights (CFeatureList *gradientFeatures)
  Interface for updating the weights.

virtual int  getNumWeights ()
  Returns the number of weights.

virtual void  getInputDerivationPre (ColumnVector *input, Matrix *targetVector)
  Interface function for calculating the input gradient, only optional and not implemented by all classes.

virtual void  getFunctionValuePre (ColumnVector *input, ColumnVector *output)
  Interface for calculating the output value.

virtual void  getWeights (double *parameters)
  Function for getting all weights.

virtual void  setWeights (double *parameters)
  Function for setting all weights.

virtual void  getGradientPre (ColumnVector *input, ColumnVector *outputErrors, CFeatureList *gradientFeatures)
  Interface for calculating the gradient given the input and the outputerror.

void  setGradientMachine (GradientMachine *gradientMachine)
GradientMachine *  getGradientMachine ()


Protected Attributes

Sequence *  alpha
GradientMachine *  gradientMachine
  Pointer to the gradient Machine.

CAdaptiveEtaCalculator localEtaCalc

Detailed Description

Class for learning with Torch-Gradient machines.

Extends the ability from CTorchVFunction, to learn with a torch gradient machine. The parameters of the machine are updated by adding the current gradient of the parameters multplied with the difference given by updateValue.


Constructor & Destructor Documentation

CTorchGradientFunction::CTorchGradientFunction int  numInputs,
int  numOutputs
 

Creates a new value function learning with a torch gradient machine.

CTorchGradientFunction::CTorchGradientFunction GradientMachine *  machine  ) 
 
virtual CTorchGradientFunction::~CTorchGradientFunction  )  [virtual]
 

Member Function Documentation

virtual void CTorchGradientFunction::getFunctionValuePre ColumnVector *  input,
ColumnVector *  output
[virtual]
 

Interface for calculating the output value.

Implements CGradientFunction.

GradientMachine* CTorchGradientFunction::getGradientMachine  ) 
 
virtual void CTorchGradientFunction::getGradientPre ColumnVector *  input,
ColumnVector *  outputErrors,
CFeatureList gradientFeatures
[virtual]
 

Interface for calculating the gradient given the input and the outputerror.

Implements CGradientFunction.

virtual void CTorchGradientFunction::getInputDerivationPre ColumnVector *  input,
Matrix *  targetVector
[virtual]
 

Interface function for calculating the input gradient, only optional and not implemented by all classes.

Reimplemented from CGradientFunction.

virtual int CTorchGradientFunction::getNumWeights  )  [virtual]
 

Returns the number of weights.

Implements CGradientUpdateFunction.

virtual void CTorchGradientFunction::getWeights double *  parameters  )  [virtual]
 

Function for getting all weights.

The double array is assumed to be large enough. This isn't checked!

Implements CGradientUpdateFunction.

virtual void CTorchGradientFunction::resetData  )  [virtual]
 

Resets the parameters of the gradient machine.

Implements CGradientUpdateFunction.

void CTorchGradientFunction::setGradientMachine GradientMachine *  gradientMachine  ) 
 
virtual void CTorchGradientFunction::setWeights double *  parameters  )  [virtual]
 

Function for setting all weights.

The double array is assumed to be large enough. This isn't checked!

Implements CGradientUpdateFunction.

virtual void CTorchGradientFunction::updateWeights CFeatureList gradientFeatures  )  [virtual]
 

Interface for updating the weights.

Implements CGradientUpdateFunction.


Member Data Documentation

Sequence* CTorchGradientFunction::alpha [protected]
 
GradientMachine* CTorchGradientFunction::gradientMachine [protected]
 

Pointer to the gradient Machine.

CAdaptiveEtaCalculator* CTorchGradientFunction::localEtaCalc [protected]
 

The documentation for this class was generated from the following file: