Documentation
A QuickStart for Matlab and a documentation are provided with the toolbox. Each function is described in a Matlab style.
The functions description may be adressed:
Notation used in the documentation
- states: set {1, 2, ..., S}
- actions: set {1, 2, ..., A}
- transitions: P(s,s',a) is the probability to reach state s' when the system is in state s and action a is performed by the decision maker
- rewards: R(s,s',a) is the reward obtained when the system is in state s on decision epoch t and is in state s' at decision epoch t+1, with action a performed
R(s,a): reward when the system is in state s at decision epoch t and action a is performed by the decision maker
An Ecological Modeling Example
Some toy examples (rand and forest examples) are provided with the toolbox.
A more realistic example in ecology is also provided on the Project Forge Files page in the section MDPtoolbox.
The codage in all the considered environments: MATLAB/GNU Octave, Scilab and R can be downloaded (files ReserveDesign*.zip).
For a description of this example, see:
- Costello, C. & Polasky, S. (2004) Dynamic reserve site selection. Resource and Energy Economics, 26, 157-174.
- Sabbadin, R., Spring, D. & Rabier, C.E. (2007) Dynamic reserve site selection under contagion risk of deforestation. Ecological Modelling, 201, 75-81.