Uncertainty in Artificial Intelligence
First Name   Last Name   Password   Forgot Password   Log in!
    Proceedings   Proceeding details   Article details         Authors         Search    
Fractional Moments on Bandit Problems
Ananda Narayanan B, Balaraman Ravindran
Abstract:
Reinforcement learning addresses the dilemma between exploration to find profitable actions and exploitation to act according to the best observations already made. Bandit problems are one such class of problems in stateless environments that represent this explore/exploit situation. We propose a learning algorithm for bandit problems based on fractional expectation of rewards acquired. The algorithm is theoretically shown to converge on an eta-optimal arm and achieve O(n) sample complexity. Experimental results show the algorithm incurs substantially lower regrets than parameter-optimized eta-greedy and SoftMax approaches and other low sample complexity state-of-the-art techniques.
Keywords:
Pages: 531-538
PS Link:
PDF Link: /papers/11/p531-narayanan_b.pdf
BibTex:
@INPROCEEDINGS{Narayanan B11,
AUTHOR = "Ananda Narayanan B and Balaraman Ravindran",
TITLE = "Fractional Moments on Bandit Problems",
BOOKTITLE = "Proceedings of the Twenty-Seventh Conference Annual Conference on Uncertainty in Artificial Intelligence (UAI-11)",
PUBLISHER = "AUAI Press",
ADDRESS = "Corvallis, Oregon",
YEAR = "2011",
PAGES = "531--538"
}


hosted by DSL   •   site info   •   help