B C D E F G H M P R S T U V

B

BootstrapExplorer<T> - Class in com.mwt.explorers

The Bootstrap explorer randomizes over the actions chosen by a set of default policies.

BootstrapExplorer(List<Policy<T>>, int) - Constructor for class com.mwt.explorers.BootstrapExplorer

C

chooseAction(long, T) - Method in class com.mwt.explorers.BootstrapExplorer

chooseAction(long, T) - Method in class com.mwt.explorers.EpsilonGreedyExplorer

chooseAction(long, T) - Method in interface com.mwt.explorers.Explorer

Determines the action to take and the probability with which it was chosen, for a given context.

chooseAction(long, T) - Method in class com.mwt.explorers.GenericExplorer

chooseAction(Explorer<T>, String, T) - Method in class com.mwt.explorers.MwtExplorer

Chooses an action by invoking an underlying exploration algorithm.

chooseAction(long, T) - Method in class com.mwt.explorers.SoftmaxExplorer

chooseAction(long, T) - Method in class com.mwt.explorers.TauFirstExplorer

chooseAction(T) - Method in interface com.mwt.policies.Policy

Determines the action to take for a given context.

com.mwt.consumers - package com.mwt.consumers

com.mwt.contexts - package com.mwt.contexts

com.mwt.explorers - package com.mwt.explorers

com.mwt.misc - package com.mwt.misc

com.mwt.policies - package com.mwt.policies

com.mwt.recorders - package com.mwt.recorders

com.mwt.sample - package com.mwt.sample

com.mwt.scorers - package com.mwt.scorers

com.mwt.utilities - package com.mwt.utilities

computeIdHash(String) - Static method in class com.mwt.utilities.MurMurHash3

ConsumePolicies<T> - Interface in com.mwt.consumers

ConsumePolicy<T> - Interface in com.mwt.consumers

ConsumeScorer<T> - Interface in com.mwt.consumers

D

DecisionTuple - Class in com.mwt.misc

A ChosenAction consists of an action to take, the probability it was chosen, and a flag indicating whether to record this decision

DecisionTuple(int, float, boolean) - Constructor for class com.mwt.misc.DecisionTuple

E

enableExplore(boolean) - Method in class com.mwt.explorers.BootstrapExplorer

enableExplore(boolean) - Method in class com.mwt.explorers.EpsilonGreedyExplorer

enableExplore(boolean) - Method in interface com.mwt.explorers.Explorer

enableExplore(boolean) - Method in class com.mwt.explorers.GenericExplorer

enableExplore(boolean) - Method in class com.mwt.explorers.SoftmaxExplorer

enableExplore(boolean) - Method in class com.mwt.explorers.TauFirstExplorer

EpsilonGreedyExplorer<T> - Class in com.mwt.explorers

The epsilon greedy exploration algorithm.

EpsilonGreedyExplorer(Policy<T>, float, int) - Constructor for class com.mwt.explorers.EpsilonGreedyExplorer

The constructor

equals(Object) - Method in class com.mwt.misc.Feature

ExploreOnlySample - Class in com.mwt.sample

ExploreOnlySample() - Constructor for class com.mwt.sample.ExploreOnlySample

Explorer<T> - Interface in com.mwt.explorers

Exposes a method to choose an action given a generic context, and obtain the relevant exploration bits.

F

Feature - Class in com.mwt.misc

Represents a feature in a sparse array.

Feature(int, float) - Constructor for class com.mwt.misc.Feature

G

GenericExplorer<T> - Class in com.mwt.explorers

GenericExplorer provides complete flexibility.

GenericExplorer(Scorer<T>, int) - Constructor for class com.mwt.explorers.GenericExplorer

Constructor

getAction() - Method in class com.mwt.misc.DecisionTuple

getFeatures() - Method in class com.mwt.contexts.SimpleContext

getId() - Method in class com.mwt.misc.Feature

getNumActions(T) - Method in class com.mwt.explorers.BootstrapExplorer

getNumActions(T) - Method in class com.mwt.explorers.EpsilonGreedyExplorer

getNumActions(T) - Method in class com.mwt.explorers.GenericExplorer

getNumActions(T) - Method in class com.mwt.explorers.SoftmaxExplorer

getNumActions(T) - Method in class com.mwt.explorers.TauFirstExplorer

getNumActions(T) - Method in class com.mwt.explorers.VariableActionBootstrapExplorer

getNumActions(T) - Method in class com.mwt.explorers.VariableActionEpsilonGreedyExplorer

getNumActions(T) - Method in class com.mwt.explorers.VariableActionGenericExplorer

getNumActions(T) - Method in class com.mwt.explorers.VariableActionSoftmaxExplorer

getNumActions(T) - Method in class com.mwt.explorers.VariableActionTauFirstExplorer

getNumberOfActions() - Method in interface com.mwt.contexts.VariableActionContext

getProbability() - Method in class com.mwt.misc.DecisionTuple

getRecording() - Method in class com.mwt.recorders.StringRecorder

getRecording(boolean) - Method in class com.mwt.recorders.StringRecorder

getValue() - Method in class com.mwt.misc.Feature

H

hashCode() - Method in class com.mwt.misc.Feature

M

main(String[]) - Static method in class com.mwt.sample.ExploreOnlySample

MurMurHash3 - Class in com.mwt.utilities

This produces exactly the same hash values as the final C+ version of MurmurHash3 and is thus suitable for producing the same hash values across platforms.

murmurhash3x8632(byte[], int, int, int) - Static method in class com.mwt.utilities.MurMurHash3

Returns the MurmurHash3_x86_32 hash.

MwtExplorer<T> - Class in com.mwt.explorers

The top-level MwtExplorer class.

MwtExplorer(String, Recorder<T>) - Constructor for class com.mwt.explorers.MwtExplorer

MwtExplorer constructor

P

Policy<T> - Interface in com.mwt.policies

Exposes a method to choose an action given a generic context.

PRG - Class in com.mwt.utilities

PRG() - Constructor for class com.mwt.utilities.PRG

PRG(long) - Constructor for class com.mwt.utilities.PRG

R

record(T, int, float, String) - Method in interface com.mwt.recorders.Recorder

Records the exploration data associated with a given decision.

record(T, int, float, String) - Method in class com.mwt.recorders.StringRecorder

Recorder<T> - Interface in com.mwt.recorders

Exposes a method to record exploration data based on generic contexts.

S

scoreActions(T) - Method in interface com.mwt.scorers.Scorer

Determines the score of each action for a given context.

Scorer<T> - Interface in com.mwt.scorers

Exposes a method for specifying a score (weight) for each action given a generic context.

shouldRecord() - Method in class com.mwt.misc.DecisionTuple

SimpleContext - Class in com.mwt.contexts

A sample context class that stores a vector of Features.

SimpleContext(ArrayList<Feature>) - Constructor for class com.mwt.contexts.SimpleContext

SoftmaxExplorer<T> - Class in com.mwt.explorers

In some cases, different actions have a different scores, and you would prefer to choose actions with large scores.

SoftmaxExplorer(Scorer<T>, float, int) - Constructor for class com.mwt.explorers.SoftmaxExplorer

Constructor

StringRecorder<T> - Class in com.mwt.recorders

A sample recorder class that converts the exploration tuple into string format.

StringRecorder() - Constructor for class com.mwt.recorders.StringRecorder

T

TauFirstExplorer<T> - Class in com.mwt.explorers

The tau-first explorer collects exactly tau uniform random exploration events, and then uses the default policy thereafter.

TauFirstExplorer(Policy<T>, int, int) - Constructor for class com.mwt.explorers.TauFirstExplorer

The constructor

toString() - Method in class com.mwt.contexts.SimpleContext

U

uniformInt(int, int) - Method in class com.mwt.utilities.PRG

uniformUnitInterval() - Method in class com.mwt.utilities.PRG

updatePolicy(List<Policy<T>>) - Method in interface com.mwt.consumers.ConsumePolicies

updatePolicy(Policy<T>) - Method in interface com.mwt.consumers.ConsumePolicy

updatePolicy(List<Policy<T>>) - Method in class com.mwt.explorers.BootstrapExplorer

updatePolicy(Policy<T>) - Method in class com.mwt.explorers.EpsilonGreedyExplorer

updatePolicy(Policy<T>) - Method in class com.mwt.explorers.TauFirstExplorer

updateScorer(Scorer<T>) - Method in interface com.mwt.consumers.ConsumeScorer

updateScorer(Scorer<T>) - Method in class com.mwt.explorers.GenericExplorer

updateScorer(Scorer<T>) - Method in class com.mwt.explorers.SoftmaxExplorer

V

VariableActionBootstrapExplorer<T extends VariableActionContext> - Class in com.mwt.explorers

The Bootstrap explorer randomizes over the actions chosen by a set of default policies.

VariableActionBootstrapExplorer(List<Policy<T>>) - Constructor for class com.mwt.explorers.VariableActionBootstrapExplorer

VariableActionContext - Interface in com.mwt.contexts

Represents a context interface with variable number of actions which is enforced if exploration algorithm is initialized in variable number of actions mode.

VariableActionEpsilonGreedyExplorer<T extends VariableActionContext> - Class in com.mwt.explorers

The epsilon greedy exploration algorithm.

VariableActionEpsilonGreedyExplorer(Policy<T>, float) - Constructor for class com.mwt.explorers.VariableActionEpsilonGreedyExplorer

The constructor

VariableActionGenericExplorer<T extends VariableActionContext> - Class in com.mwt.explorers

GenericExplorer provides complete flexibility.

VariableActionGenericExplorer(Scorer<T>) - Constructor for class com.mwt.explorers.VariableActionGenericExplorer

Constructor

VariableActionSoftmaxExplorer<T extends VariableActionContext> - Class in com.mwt.explorers

In some cases, different actions have a different scores, and you would prefer to choose actions with large scores.

VariableActionSoftmaxExplorer(Scorer<T>, float) - Constructor for class com.mwt.explorers.VariableActionSoftmaxExplorer

Constructor

VariableActionTauFirstExplorer<T extends VariableActionContext> - Class in com.mwt.explorers

The tau-first explorer collects exactly tau uniform random exploration events, and then uses the default policy thereafter.

VariableActionTauFirstExplorer(Policy<T>, int) - Constructor for class com.mwt.explorers.VariableActionTauFirstExplorer

The constructor

B C D E F G H M P R S T U V