Proto-transfer Learning in Markov Decision Processes Using Spectral Methods
This paper was harvested from CiteSeer
In this paper we introduce proto-transfer leaning, a new framework for transfer learning. We explore solutions to transfer learning within reinforcement learning through the use of spectral methods. Proto-value functions (PVFs) are basis functions computed from a spectral analysis of random walks on the state space graph. They naturally lead to the ability to transfer knowledge and representation between related tasks or domains. We investigate task transfer by using the same PVFs in Markov decision processes (MDPs) with different rewards functions. Additionally, our experiments in domain transfer explore applying the Nyström method for interpolation of PVFs between MDPs of different sizes.
Kimberly Ferguson and Sridhar Mahadevan. "Proto-transfer Learning in Markov Decision Processes Using Spectral Methods" 2006
Available at: http://works.bepress.com/sridhar_mahadevan/6