Skip to main content
Fast Function-on-Scalar Regression with Penalized Basis Expansions
International Journal of Biostatistics (2010)
  • Philip T. Reiss, New York University
  • Lei Huang, New York University
  • Maarten Mennes, New York University

Regression models for functional responses and scalar predictors are often fitted by means of basis functions, with quadratic roughness penalties applied to avoid overfitting. The fitting approach described by Ramsay and Silverman in the 1990s amounts to a penalized ordinary least squares (P-OLS) estimator of the coefficient functions. We recast this estimator as a generalized ridge regression estimator, and present a penalized generalized least squares (P-GLS) alternative. We describe algorithms by which both estimators can be implemented, with automatic selection of optimal smoothing parameters, in a more computationally efficient manner than has heretofore been available. We discuss pointwise confidence intervals for the coefficient functions, simultaneous inference by permutation tests, and model selection, including a novel notion of pointwise model selection. P-OLS and P-GLS are compared in a simulation study. Our methods are illustrated with with an analysis of age effects in a functional magnetic resonance imaging data set, as well as a reanalysis of a now-classic Canadian weather data set. An R package implementing the methods is publicly available.

  • Cross-validation,
  • Functional analysis of variance,
  • Functional connectivity,
  • Functional linear model,
  • Simultaneous test,
  • Smoothing parameters,
  • Varying-coefficient model
Publication Date
Citation Information
Philip T. Reiss, Lei Huang, and Maarten Mennes (2010). Fast Function-on-Scalar Regression with Penalized Basis Expansions. International Journal of Biostatistics 6(1), article 28. Available at