Skip to main content

Chebyshev Approximation and the Global Geometry of Model Predictions

Cornell Affiliated Author(s)

Author

K.N. Quinn
H. Wilber
A. Townsend
J.P. Sethna

Abstract

Complex nonlinear models are typically ill conditioned or sloppy; their predictions are significantly affected by only a small subset of parameter combinations, and parameters are difficult to reconstruct from model behavior. Despite forming an important universality class and arising frequently in practice when performing a nonlinear fit to data, formal and systematic explanations of sloppiness are lacking. By unifying geometric interpretations of sloppiness with Chebyshev approximation theory, we rigorously explain sloppiness as a consequence of model smoothness. Our approach results in universal bounds on model predictions for classes of smooth models, capturing global geometric features that are intrinsic to their model manifolds, and characterizing a universality class of models. We illustrate this universality using three models from disparate fields (physics, chemistry, biology): exponential curves, reaction rates from an enzyme-catalyzed chemical reaction, and an epidemiology model of an infected population. © 2019 American Physical Society.

Date Published

Journal

Physical Review Letters

Volume

122

Issue

15

URL

https://www.scopus.com/inward/record.uri?eid=2-s2.0-85064826421&doi=10.1103%2fPhysRevLett.122.158302&partnerID=40&md5=5a8d2e4f4d9169fe4f723e74f8eaf91a

DOI

10.1103/PhysRevLett.122.158302

Group (Lab)

James Sethna Group

Funding Source

1719490
1818757

Download citation