Inception score evaluation: what a high GAN score hides
The Inception score compares two probability distributions to judge GAN output, so a high number can still hide mode collapse or an ImageNet mismatch. Here is how the KL divergence works and why the score belongs next to FID and human review.