We propose the Nonlinear Zernike wavefront sensor (NLZWFS) for out-of-band differential wavefront sensing to augment primary mirror stability on LUVOIR and similar mission concepts during exoplanet coronagraphy. This new data analysis paradigm involving a full polychromatic scalar physical optics model for the phase-shifting Zernike wavefront sensor removes the linearity assumptions which would otherwise prevent accurate sensing. We show Monte-Carlo simulations of NLZWFS and focus-diverse phase retrieval to understand the exposure times necessary to achieve picometer-level stability in the telescope wavefront.