Fourier features and the spectral bias problem in MLPs
A neural network trained on the Mandelbrot set comes out blurry because of spectral bias. Multi-scale Gaussian Fourier Features fix that by putting the high frequencies into the input instead of asking the model to find them.