Click or drag to resize
Accord.NET (logo)

BoltzmannExploration Class

Boltzmann distribution exploration policy.
Inheritance Hierarchy
SystemObject
  Accord.MachineLearningBoltzmannExploration

Namespace:  Accord.MachineLearning
Assembly:  Accord.MachineLearning (in Accord.MachineLearning.dll) Version: 3.8.0
Syntax
public class BoltzmannExploration : IExplorationPolicy
Request Example View Source

The BoltzmannExploration type exposes the following members.

Constructors
  NameDescription
Public methodBoltzmannExploration
Initializes a new instance of the BoltzmannExploration class.
Top
Properties
  NameDescription
Public propertyTemperature
Temperature parameter of Boltzmann distribution. Should be greater than 0.
Top
Methods
  NameDescription
Public methodChooseAction
Choose an action.
Public methodEquals
Determines whether the specified object is equal to the current object.
(Inherited from Object.)
Protected methodFinalize
Allows an object to try to free resources and perform other cleanup operations before it is reclaimed by garbage collection.
(Inherited from Object.)
Public methodGetHashCode
Serves as the default hash function.
(Inherited from Object.)
Public methodGetType
Gets the Type of the current instance.
(Inherited from Object.)
Protected methodMemberwiseClone
Creates a shallow copy of the current Object.
(Inherited from Object.)
Public methodToString
Returns a string that represents the current object.
(Inherited from Object.)
Top
Extension Methods
  NameDescription
Public Extension MethodHasMethod
Checks whether an object implements a method with the given name.
(Defined by ExtensionMethods.)
Public Extension MethodIsEqual
Compares two objects for equality, performing an elementwise comparison if the elements are vectors or matrices.
(Defined by Matrix.)
Public Extension MethodTo(Type)Overloaded.
Converts an object into another type, irrespective of whether the conversion can be done at compile time or not. This can be used to convert generic types to numeric types during runtime.
(Defined by ExtensionMethods.)
Public Extension MethodToTOverloaded.
Converts an object into another type, irrespective of whether the conversion can be done at compile time or not. This can be used to convert generic types to numeric types during runtime.
(Defined by ExtensionMethods.)
Top
Remarks

The class implements exploration policy base on Boltzmann distribution. Acording to the policy, action a at state s is selected with the next probability:

                  exp( Q( s, a ) / t )
p( s, a ) = -----------------------------
             SUM( exp( Q( s, b ) / t ) )
              b

where Q(s, a) is action's a estimation (usefulness) at state s and t is Temperature.

See Also