‹ All AI-300 questions

AI-300 Practice Question 45: Monitor Event Grid Retraining Trigger

Microsoft Machine Learning Operations Engineer Associate (AI-300) · Test 5 · question 5 of 10

Implement machine learning model lifecycle and operationsmedium

A model monitor in Azure Machine Learning tracks prediction accuracy against collected ground truth with a threshold (the model performance signal, currently in preview). The team wants a retraining job to start automatically when a monitoring run detects that accuracy fell below the threshold, without anyone polling the results. Which solution meets this requirement?

Select one answer
Show answer and explanation

Answer:

  • B. Use Azure Event Grid to react to events from the monitoring runs, with a handler that submits the retraining job

Model monitoring supports threshold-based alerts, and the documentation says that by using events generated by Azure Machine Learning model monitoring runs you can set up event-driven applications or CI/CD workflows with Azure Event Grid. When a monitor detects drift, data quality problems or model performance degradation, you can track these events with Event Grid and take action programmatically. The documentation's own example matches: if the accuracy of a classification model in production dips below a certain threshold, you can use Event Grid to begin a retraining job that uses collected ground truth data (option B).

- A is wrong because polling is the manual, delayed approach that the team wants to avoid, and it needs a scheduler and code to keep running. - C is wrong because an email only notifies people. It does not start anything, so retraining still depends on someone reading it. - D is wrong because a nightly schedule retrains regardless of the model's condition, wasting compute when nothing has changed and reacting too slowly when accuracy drops right after a run.

Reference: Model monitoring in production - Azure Machine Learning

Practice Test 5 ›

Study guides for AI-300