From Bandits to Monte-Carlo Tree Search - Rémi Munos - Bog

Covers several aspects of the "optimism in the face of uncertainty" principle for large scale optimization problems under finite numerical budget. The book lays out the theoretical foundations of the field by characterizing the complexity of the optimization problems and designing efficient algorithms with performance guarantees.