Online Learning Methods for Networking - Mingyan Liu - Bog

Provides a tutorial on a family of sequential learning and decision problems known as the multi-armed bandit problems. In such problems, any decision serves the purpose of exploring or exploiting or both. This balancing act between exploration and exploitation is characteristic of this type of "learning-on-the-go" problem.