Pith. sign in

REVIEW 5 cited by

Warm-starting Contextual Bandits: Robustly Combining Supervised and Bandit Feedback

Not yet reviewed by Pith; the record is open.

Re-run · record.json Download PDF Read on arXiv ↗

This paper has not been read by Pith yet. Machine review is queued; the pith claim, tier, and objections will appear here once it completes.

SPECIMEN: schema-true, not a live event

T0 review · schema-true

One-sentence machine reading of the paper's core claim.

pith:XXXXXXXX · record.json · timestamp

arxiv 1901.00301 v2 pith:NP7BL44B submitted 2019-01-02 cs.LG stat.ML

Chicheng Zhang , Alekh Agarwal , Hal Daumé III , John Langford , Sahand N Negahban This is my paper · ORCID
classification cs.LGstat.ML
keywords datalearningalgorithmsbanditcontextualsourcessupervisedapproach
verification ladder T0 review T1 audit T2 compute T3 formal
0 comments
read the original abstract

We investigate the feasibility of learning from a mix of both fully-labeled supervised data and contextual bandit data. We specifically consider settings in which the underlying learning signal may be different between these two data sources. Theoretically, we state and prove no-regret algorithms for learning that is robust to misaligned cost distributions between the two sources. Empirically, we evaluate some of these algorithms on a large selection of datasets, showing that our approach is both feasible and helpful in practice.

Discussion (0). Continue with ORCID to comment.

Forward citations

Cited by 5 Pith papers

Reviewed papers in the Pith corpus that reference this work. Sorted by Pith novelty score. Full citation record

  1. Contextual Online Pricing with (Biased) Offline Data

    cs.LG 2025-07 conditional novelty 7.0 of 10

    Contextual online pricing can safely incorporate biased offline data, achieving the standard square-root-of-T worst-case regret and better rates when the offline bias is small.

  2. Multi-Armed Bandits With Machine Learning-Generated Surrogate Rewards

    math.ST 2025-06 unverdicted novelty 7.0 of 10

    The MLA-UCB algorithm uses ML-generated surrogate rewards from auxiliary data to provably lower cumulative regret in multi-armed bandits, achieving asymptotic optimality under joint Gaussian assumptions without requir...

  3. Best Arm Identification with Possibly Biased Offline Data

    cs.LG 2025-05 conditional novelty 6.0 of 10

    LUCB-H adaptively combines offline and online data for best arm identification, matching or beating standard LUCB depending on whether the historical data is helpful or misleading.

  4. Identifiable Latent Bandits: Leveraging observational data for personalized decision-making

    cs.LG 2024-07 unverdicted novelty 6.0 of 10

    Identifiable latent bandits apply nonlinear ICA to observational data to recover representations sufficient for inferring optimal actions in new instances, shortening exploration time.

  5. Deconfounded Warm-Start Thompson Sampling with Applications to Precision Medicine

    stat.ML 2025-05 conditional novelty 4.0 of 10

    DWTS debiases and selects features from observational data, then warm-starts Thompson sampling with those estimates, achieving lower cumulative regret than LinTS in simulations.

Pith tools