During the this semester I am teaching the course “Markov decision theory” at the Department of Mathematics. The course presents the algorithmic aspects of Markov decision theory and illustrates the wide applicability of this theory to a variety of realistic problems. First, the course consider the Poisson process followed by Renewal/Reward Processes. Next we study the theory of Markov chains. Then follows a thorough presentation of the theory of Markov Decision Processes, including some applications. Finally, further applications are discussed based on reports made by the students. A course plan is given here.
You may also like
I recent released a small package gMOIP which can make 2D plots of linear and integer programming models (LP/IP). With the package […]
The last days I have been playing a bit with LocalSolver and tried to model various vehicle routing problems (VRP). LocalSolver is […]
The 16th of October I gave a presentation to a group of students at KU Life about optimal replacement policies for dairy […]
Yesterday I participated in a short course about how to teach large classes. Focus was on how to align teaching for constructive […]