Pith. sign in

REVIEW 1 cited by

Monitoring and explainability of models in production

Not yet reviewed by Pith; the record is open.

This paper has not been read by Pith yet. Machine review is queued; the pith claim, tier, and objections will appear here once it completes.

SPECIMEN: schema-true, not a live event

T0 review · schema-true

One-sentence machine reading of the paper's core claim.

pith:XXXXXXXX · record.json · timestamp

arxiv 2007.06299 v1 pith:YWOWWG3Z submitted 2020-07-13 stat.ML cs.LG

classification stat.MLcs.LG
keywords monitoringareasdatalearningmachinemodelsproductionsolutions
verification ladder T0 review T1 audit T2 compute T3 formal

Signed reviews

No signed human review yet.

0 comments
read the original abstract

The machine learning lifecycle extends beyond the deployment stage. Monitoring deployed models is crucial for continued provision of high quality machine learning enabled services. Key areas include model performance and data monitoring, detecting outliers and data drift using statistical techniques, and providing explanations of historic predictions. We discuss the challenges to successful implementation of solutions in each of these areas with some recent examples of production ready solutions using open source tools.

Discussion (0). Continue with ORCID to comment.

Forward citations

Cited by 1 Pith paper

Reviewed papers in the Pith corpus that reference this work. Sorted by Pith novelty score. Full citation record

  1. Variability-Aware Machine Learning Model Selection: Feature Modeling, Instantiation, and Experimental Case Study

    cs.SE 2024-12 conditional novelty 5.0 of 10

    The paper represents scikit-learn's model selection heuristics as feature diagrams with constraints and shows the recommended classifier beats prior literature results on a heart failure dataset.

Pith tools