Deep Q-learning for Connect Four: replay buffers and masking
Notes from moving a Connect Four agent off tabular Q-learning and onto a DQN: why correlated updates destabilize the network, how action masking handles full columns, where the GIL caps throughput, and why the agent learned attack before defense.