Skip to main content
Presentation
Markov decision processes for train run curve optimization
Electrical Systems for Aircraft, Railway and Ship Propulsion (ESARS), 2012 (2012)
  • Daniel Nikovski, Mitsubishi Electric Research Labs
  • Bernard Lidicky, Mitsubishi Electric Research Labs
  • Weihong Zhang, Mitsubishi Electric Research Labs
  • Kenji Kataoka, Mitsubishi Electric Research Labs
  • Koki Yoshimoto, Mitsubishi Electric Corporation
Abstract
We propose three computationally efficient methods for finding optimal run curves of electrical trains, all based on the idea of approximating the continuous dynamics of a moving train by a Markov Decision Process (MDP) model. Deterministic continuous train dynamics are converted to stochastic transitions on a discrete model by observing the similarity between the properties of convex combinations and those of probability mass functions. The resulting MDP uses barycentric coordinates to effectively represent the cost-to-go of the approximated optimal control problem. One of the three solution methods uses equal-distance steps, as opposed to the usual equal-time steps, to avoid self transitions of the MDP, which allows very fast computation of the cost-to-go in one pass only.
Keywords
  • Optimization,
  • Programming
Publication Date
October, 2012
Location
Bologna, Italy
DOI
10.1109/ESARS.2012.6387473
Comments
Permission to post granted by Mitsubishi Electric Research Laboratories, Inc.
Citation Information
Daniel Nikovski, Bernard Lidicky, Weihong Zhang, Kenji Kataoka, et al.. "Markov decision processes for train run curve optimization" Electrical Systems for Aircraft, Railway and Ship Propulsion (ESARS), 2012 (2012)
Available at: http://works.bepress.com/bernard-lidicky/25/