Scaling RL with Approximate Solution Methods
Tabular RL breaks the moment the state space grows past a toy grid. Approximate Solution Methods swap the lookup table for a weight vector and semi-gradient updates, so one state teaches you about every state like it. Includes where linear models still beat a neural net.