GCP Generative AI Leader Practice Question 9: Measuring Gen AI Value
Google Cloud Generative AI Leader · Test 1 · question 9 of 10
A logistics company plans to roll out a gen AI assistant that drafts responses for its customer support team. The CFO says she will fund a wider rollout only if the pilot proves real business value. The program sponsor must decide how to measure success before the pilot starts.
Which measurement plan gives the CFO the evidence she is asking for?
Show answer and explanation
Answer:
Two things decide this question. The first is plain measurement logic: an improvement can only be proven against a baseline, so the "before" numbers have to be captured before the pilot starts. The second is Google Cloud's guidance on gen AI KPIs, which recommends measuring at more than one level: model quality, system quality, business operations (such as handle time and resolution), adoption, and business value (cost savings, productivity, revenue). Option A covers the whole chain. It shows the assistant is used, that it moves an operational metric, and what that is worth in money, which is the language a CFO funds.
Option B measures adoption only. Usage is necessary, since an unused tool delivers nothing, but heavy usage does not prove that support got faster or cheaper. Google warns against mistaking activity for end-state business value.
Option C measures model quality only. Groundedness and fluency matter for trustworthy answers, but they are technical indicators. The link to lower costs is assumed rather than shown.
Option D relies on one subjective measure collected only at the end. Without a baseline or any operational or financial data, it cannot establish return on investment.
Reference: KPIs for gen AI: Measuring your AI success