Edit post Follow this blog Administration + Create my blog
February 28 2013 5 28 /02 /February /2013 19:30

Odalric-Ambrym Maillard, Phuong Nguyen, Ronald Ortner, Daniil Ryabko.
In Proceedings of the 30th international conference on machine learning, ICML 2013, 2013.


We consider an agent interacting with an environment in a single stream of actions, observations, and rewards, with no reset. This process is not assumed to be a Markov Decision Process (MDP). Rather, the agent has several representations (mapping histories of past interactions to a discrete state space) of the environment with unknown dynamics, only some of which result in an MDP. The goal is to minimize the average regret criterion against an agent who knows an MDP representation giving the highest optimal reward, and acts optimally in it. Recent regret bounds for this setting are of order O(T^{2/3}) with an additive term constant yet exponential in some characteristics of the optimal MDP. We propose an algorithm whose regret after T time steps is O(\sqrt{T}), with all constants reasonably small. This is optimal in T since O(\sqrt{T}) is the optimal regret in the setting of learning in a (single discrete) MDP.


You can dowload the paper from the ICML website (here), and a corrected version from the HAL online open depository* (here), or from arXiv (here) (the correction is minor and changes only a constant 2 into 2\sqrt{2}). See also a talk presenting this work here.


  author = "Maillard, O. and Nguyen, P. and Ortner, R. and Ryabko, D.",
  title = "Optimal Regret Bounds for Selecting the State Representation in Reinforcement Learning",
  booktitle = "International conference on Machine Learning",
  series = {JMLR W\&CP 28(1)},
  address = "Atlanta, USA",
  year = "2013",
  pages = " 543-551"



Related publications:
Selecting the State-Representation in Reinforcement Learning.
Odalric-Ambrym Maillard, Daniil Ryabko, Rémi Munos.
In Proceedings of the 24th conference on advances in Neural Information Processing Systems, NIPS '11, pages 2627–2635, 2011.



* The HAL open-access online archive system seeks to make research results available to the widest audience, independently of the major publisher, and cooperates with other large international archives like arXiv.

Share this post



HOW I GOT MY LOAN FROM THIS GREAT COMPANY<br /> <br /> Hello my dear people, I am Linda McDonald, currently living in Austin Texas, USA. I am a widow at the moment with three kids and i was stuck in a financial situation in April 2018 and i needed to refinance and pay my bills. I tried seeking loans from various loan firms both private and corporate but never with success, and most banks declined my credit ,do not full prey to those hoodlums at there that call them self-money lender they are all scam , all they want is your money and you well not hear from them again they have done it to me twice before I met Mr. David Wilson the most interesting part of it is that my loan was transfer to me within 74hours so I will advise you to contact Mr. David if you are interested in getting loan and you are sure you can pay him back on time you can contact him via email……… (davidwilsonloancompany4@gmail.com) No credit check, no cosigner with just 2% interest rate and better repayment plans and schedule if you must contact any firm with reference to securing a loan without collateral then contact Mr. David Wilson today for your loan <br /> <br /> They offer all kind of categories of loan they<br /> <br /> Short term loan (5_10years) <br /> Long term loan (20_40) <br /> Media term loan (10_20) <br /> They offer loan like <br /> Home loan............., Business loan........ Debt loan.......<br /> Student loan.........., Business startup loan<br /> Business loan......., Company loan.............. etc<br /> Email..........( davidwilsonloancompany4@gmail.com)<br /> When it comes to financial crisis and loan then David Wilson loan financial is the place to go please just tell him I Mrs. Linda McDonald direct you Good Luck.......................
Call Intuit QuickBooks Online Customer Services Helpline Phone Number USA 1-888-867-9209 to fix your Accounting Issues. QuickBooks Technical Support Contact Team Will fixes your issue Enterprises, Payroll, Pro, Premier, Vat, Bank Errors etc