Claude Certified Architect – Foundations Practice Question 73: Environment Ground Truth
Claude Certified Architect, Foundations · Test 8 · question 3 of 10
A coding agent fixes failing unit tests in a repository. In production it often ends with "All tests now pass" while the CI run on its branch still fails. The team wants a design change that addresses the root cause. Which change is best?
Show answer and explanation
Answer:
Anthropic's guidance on building agents is that during execution the agent should gain ground truth from the environment at each step, such as tool call results or code execution, rather than relying on its own account of progress. Real test output both lets the agent correct course and gives the harness an objective completion condition. A stopping condition such as a maximum number of iterations keeps the loop bounded.
- B is wrong: a self-reported confidence score is still the model's own opinion, not evidence, and it is poorly calibrated. - C is wrong: prompt wording and a larger model may reduce false claims but do not add any verification of the outcome. - D is wrong: a reviewer that only reads the summary judges the same unverified claim; it does not observe the environment.
Reference: Building effective agents