Master-LGBM without ETF — Robustness Check
DoneMaster-LGBM without ETF — Robustness Check
2026-05-19 · status: done · 34.0s
Hypothesis: If ETF flow carries no causal forward information (B4 finding: residual IC +0.075, CI includes 0), Master-LGBM without the
etf_flowfeature delivers a nearly identical R² lift over HAR-RV. A drop > 1 pp would be an alarm signal that the feature does carry lookahead after all.Verdict: MASTER-LGBM ROBUST — Removing etf_flow changes the R² lift by only -0.14 pp (10.60 → 10.74). Both versions are well above the 3 pp promote gate. The Master-LGBM result is NOT driven by an ETF lookahead. Top features remain: log_rv_7d_ann, iv_ann, stablecoin_d7.
Key metrics
| metric | value |
|---|---|
| R2_HAR_RV | +0.5541 |
| R2_LGBM_with_ETF | +0.6601 |
| R2_LGBM_no_ETF | +0.6615 |
| lift_pp_with_ETF | +10.6018 |
| lift_pp_no_ETF | +10.7397 |
| etf_marginal_contribution_pp | -0.1379 |
| top_3_features_no_etf | ['log_rv_7d_ann', 'iv_ann', 'stablecoin_d7'] |
| n_windows | 13 |
Approach
Replicate of the Master-LGBM setup (Exp #22) with a single change: feature etf_flow removed from the all-features set. Compares the OOS R² against the HAR-RV baseline and against the original LGBM-with-ETF. If the robustness check passes, the R² lift without ETF should be similarly high.
Pooled OOS comparison
| model | R2_log | IC | Lift_vs_HAR_pp | n_oos |
|---|---|---|---|---|
| HAR-RV (baseline) | 0.5541 | 0.7258 | 0 | 28,464 |
| LGBM with ETF | 0.6601 | 0.8114 | 10.6 | 28,464 |
| LGBM WITHOUT ETF | 0.6615 | 0.8123 | 10.74 | 28,464 |
Marginal contribution of the ETF feature
-
LGBM-with-ETF lift: +10.60 pp over HAR-RV
-
LGBM-without-ETF lift: +10.74 pp over HAR-RV
-
Loss from removing ETF: -0.14 pp
Per-window R² (13 windows)
| window | n | har_r2 | lgbm_etf_r2 | lgbm_no_etf_r2 | delta_r2_pp |
|---|---|---|---|---|---|
| 2023-01-02 → 2023-04-02 | 2160 | 0.5331 | 0.6229 | 0.6229 | 0 |
| 2023-04-02 → 2023-07-02 | 2184 | 0.2852 | 0.3959 | 0.3959 | 0 |
| 2023-07-02 → 2023-10-02 | 2208 | 0.4665 | 0.5605 | 0.5605 | 0 |
| 2023-10-02 → 2024-01-02 | 2208 | 0.4091 | 0.5426 | 0.5426 | 0 |
| 2024-01-02 → 2024-04-02 | 2184 | 0.5275 | 0.6247 | 0.6247 | 0 |
| 2024-04-02 → 2024-07-02 | 2184 | 0.55 | 0.6357 | 0.6377 | 0.1938 |
| 2024-07-02 → 2024-10-02 | 2208 | 0.4311 | 0.5627 | 0.5665 | 0.3801 |
| 2024-10-02 → 2025-01-02 | 2208 | 0.4802 | 0.6849 | 0.6916 | 0.6759 |
| 2025-01-02 → 2025-04-02 | 2160 | 0.5895 | 0.7009 | 0.7107 | 0.9832 |
| 2025-04-02 → 2025-07-02 | 2184 | 0.5167 | 0.6349 | 0.6332 | -0.172 |
| 2025-07-02 → 2025-10-02 | 2208 | 0.4577 | 0.6366 | 0.6385 | 0.1894 |
| 2025-10-02 → 2026-01-02 | 2208 | 0.482 | 0.6484 | 0.6482 | -0.0161 |
| 2026-01-02 → 2026-04-02 | 2160 | 0.5446 | 0.7112 | 0.7118 | 0.0593 |
Top-10 features in the ETF-free LGBM (mean gain)
| feature | mean_gain |
|---|---|
| log_rv_7d_ann | 473.5 |
| iv_ann | 407.5 |
| stablecoin_d7 | 373.5 |
| hour_cos | 365.2 |
| ret_7d | 361.9 |
| log_rv_1d_ann | 355.8 |
| dow | 333.1 |
| ret_24h | 299.5 |
| hour_sin | 272.6 |
| funding_cum_1d | 234.9 |
