Format

Send to

Choose Destination
Neural Comput. 2005 May;17(5):1084-108.

Stochastic optimal control and estimation methods adapted to the noise characteristics of the sensorimotor system.

Author information

1
Department of Cognitive Science, University of California San Diego, La Jolla CA 92093-0515, USA. todorov@cogsci.ucsd.edu

Abstract

Optimality principles of biological movement are conceptually appealing and straightforward to formulate. Testing them empirically, however, requires the solution to stochastic optimal control and estimation problems for reasonably realistic models of the motor task and the sensorimotor periphery. Recent studies have highlighted the importance of incorporating biologically plausible noise into such models. Here we extend the linear-quadratic-gaussian framework--currently the only framework where such problems can be solved efficiently--to include control-dependent, state-dependent, and internal noise. Under this extended noise model, we derive a coordinate-descent algorithm guaranteed to converge to a feedback control law and a nonadaptive linear estimator optimal with respect to each other. Numerical simulations indicate that convergence is exponential, local minima do not exist, and the restriction to nonadaptive linear estimators has negligible effects in the control problems of interest. The application of the algorithm is illustrated in the context of reaching movements. A Matlab implementation is available at www.cogsci.ucsd.edu/~todorov.

PMID:
15829101
PMCID:
PMC1550971
DOI:
10.1162/0899766053491887
[Indexed for MEDLINE]
Free PMC Article

Supplemental Content

Full text links

Icon for Atypon Icon for PubMed Central
Loading ...
Support Center