Csaba Szepesvari
451 followers
451 followers
Posts
Post has shared content
Good stuff!
Post has shared content
Catching up with our backlog we explore sparse linear stochastic bandits. Elimination on the hypercube, online regression to bandits and more.

In the last two posts we considered stochastic linear bandits, when the actions are vectors in the $d$-dimensional Euclidean space. According to our previous calculations, under the condition that the expected reward of all the actions are in a fixed…
Post has shared content
Catching up with our backlog we explore sparse linear stochastic bandits. Elimination on the hypercube, online regression to bandits and more.

In the last two posts we considered stochastic linear bandits, when the actions are vectors in the $d$-dimensional Euclidean space. According to our previous calculations, under the condition that the expected reward of all the actions are in a fixed…
Post has shared content
Ellipsoidal Confidence Sets for Least-Squares Estimators using Laplace's method and other beauties.

Continuing the previous post, here we give a construction for confidence bounds based on ellipsoidal confidence sets. We also put things together and show bound on the regret of the UCB strategy that uses the constructed confidence bounds. Constructing…
Post has shared content
In the post on adversarial bandits we proved two high probability upper bounds on the regret of Exp-IX. Specifically, we showed: Theorem: There exists a policy $\pi$ such that for all $\delta \in (0,1)$ for any adversarial environment $\nu\in [0,1]^{nK}$,…
Post has shared content
Bandits: A new beginning Finite-armed stochastic bandits: Warming up First steps: Explore-then-Commit The Upper Confidence Bound (UCB) Algorithm Optimality concepts and information theory
banditalgs.com
Post has shared content
Vitaly took photos for me, too:) Thanks Vitaly!!
Singapore has some impressive modern architecture hiding in between the food courts.
A short visit to Singapore
34 Photos - View album
Post has shared content
Help support the U of Waterloo final art show and get a beautiful piece of art in the process!
You can receive beautiful prints of original artwork from the UW Fine Arts Graduating class by donating a minimum of $15 or$25!! :)
Post has attachment
A new course that I am teaching:
http://itsuofacs2014.wordpress.com/
I guess our paper with Tor and  Koby was accepted at UAI. I just got the following email:
----
Dear Authors,
We are happy to inform you that your paper:
Paper 207: Finite-time Analysis for Stochastic Linear Resource Allocation
has been selected to receive the Best Paper Runner-up Award at UAI 2014. A certificate will be presented to you at the conference.
Congratulations!
Ann Nicholson
UAI 2014 General Chair
Jin Tian and Nevin L. Zhang
UAI 2014 program chairs
---
Yay!