國立臺北大學統計學系

專題演講

 

講題：Last-Layer Adaptive Scoring-rule Tuning for Pre-Trained Regression Networks

主講人：楊鈞澔 教授（國立臺灣大學統計與數據科學研究所）

時間：115年06月03日 (星期三，13：10~15：00)

地點：三峽校區商學院3F13教室

Abstract

We study post-hoc predictive intervals for pre-trained regression networks under three operational constraints: no retraining, fixed architecture, no ensembling. We propose LAST (Last-layer Adaptive Scoring-rule Tuning): a Bayesian linear regression on the trained features with a single predictive-variance scale τ selected by leave-one-out CRPS, paired with optional split-conformal calibration. Our technical contributions are (i) a closed-form Sherman–Morrison evaluation of the leave-one-out CRPS objective that extends the classical ridge-LOO identity from MSE cross-validation to scoring-rule cross-validation, reducing the τ-selection cost to O(nd² + Kn) for a K-point grid (no retraining, no nested CV); and (ii) uniform consistency of τ̂ₙ at the parametric rate. Empirically, LAST is competitive with last-layer Laplace with conformal calibration on standard tabular regression but decisively wins on density-quality deliverables under heavy-tailed noise; LAST also delivers better far-OOD conditional coverage than constant-width MAP with conformal calibration on gap data and heteroscedastic data. Keywords: post-hoc uncertainty quantification; last-layer Bayesian inference; leave-one-out cross-validation; strictly proper scoring rules; continuous ranked probability score (CRPS).

~歡迎參加~

國立臺北大學統計學系  敬邀

115.05.26

附件：演講摘要