Production ML failures usually start in the data, not the model
Perfect offline metrics mostly prove the model fits your assumptions. Point-in-time joins, zero-filled features the model reads as a signal, and cohorts that change while the histograms hold still.