Loading
Lab 5 of 6
Compare a reference log with a drifted one. Retrain only when the data says so.
Drift is the input data changing under a model that has not. A drift check compares a reference sample with recent traffic. The alert DataDrift fires when the drift share is above 0.3. The retrain drill proves both sides: a drifted log says RETRAIN, a clean log says KEEP.
make data
make drift-drill
make retrain-drillDefined in the Makefile; threshold from monitoring/alerts.yml. Not verified on this page: drift scores are not captured here.
The drill compares the reference log with itself. What does the retrain decision say?
KEEP. A drill that cannot say "no" is not a drill, which is why the target runs both directions.