GCP Generative AI Leader Practice Question 51: Next Token Prediction

Google Cloud Generative AI Leader · Test 6 · question 1 of 10

Fundamentals of Gen AIeasy

A marketing director reads a confident, well-written paragraph produced by a large language model and assumes it must be accurate because it reads so smoothly. A data scientist on her team explains that fluency and factual correctness are not the same thing for this kind of model.

What is the most fundamental reason a large language model can produce text that reads fluently but is factually wrong?

Select one answer
Show answer and explanation

Answer:

  • A. The model generates text by repeatedly predicting the most statistically likely next token given the preceding text, not by checking facts against a database

A large language model is trained to predict the next token in a sequence based on patterns learned from massive amounts of text. It builds a response one token at a time by choosing tokens that are statistically probable given everything generated so far. That objective rewards fluent, coherent-sounding language, but it has no built-in mechanism to verify that a generated claim is true. The result is that a model can produce text that is grammatically smooth and confident while being factually wrong, a failure mode commonly called hallucination. Understanding this mechanism is why leaders are taught to pair gen AI output with grounding, review, or human-in-the-loop checks rather than trusting fluency as a proxy for accuracy.

- B is wrong because the model has no intent or awareness; it does not "test" anyone. It is a statistical text generator, not an adversarial agent. - C is wrong because vocabulary size is not the cause. Even a model with an enormous vocabulary can hallucinate, because the issue is how tokens are selected, not how many words exist to choose from. - D is wrong because most foundation models are trained on a broad mix of text, not exclusively fiction, and training scope alone does not explain why fluent output can still be factually wrong.

Reference: Responsible AI

Practice Test 6 ›

Study guides for Google Cloud Generative AI Leader

Free AI certifications in 2026: what's really $0Which free AI certifications are real exams, which are badges, and which are course certificates: Oracle, Microsoft, Google, AWS, Claude and more.
Google Cloud roadmap: GCP zero to hero in 10 stagesA Google Cloud roadmap from zero to hero: 10 stages, 84 topics in learning order, free-tier labs, exam traps and which certification fits each stage.
Google Cloud Digital Leader exam: what's on it, who it's forGoogle Cloud Digital Leader: August 2026 exam update, six sections, US$99 price as of November 2026, renewal, study plan and ACE comparison.
Agentic AI certification: Oracle, Google, GitHub, NVIDIAAgentic AI certifications in 2026: Oracle's free exam, GitHub GH-600, Google, NVIDIA and Claude, compared by status, price and role.
Google Cloud Generative AI Leader vs AWS AI PractitionerGoogle Cloud Generative AI Leader vs AWS AI Practitioner: format, cost, topics, free preparation and which certification to take first.
Best AI certifications 2026: AWS, Google, Microsoft, ClaudeThe best AI certifications in 2026 from AWS, Google, Microsoft, Claude and Databricks, by level, with price, status and which one to take first.
Google Cloud certification path: is ACE worth it?Is Google's Associate Cloud Engineer certification worth it? The Google Cloud certification path in 2026, with cost, format and which exam to take first.
Google Professional Agentic Architect: what it isGoogle's Professional Agentic Architect certification explained - beta status, the two-part exam, the five domains, price, validity and how to prepare.
What Is RAG? How Retrieval-Augmented Generation WorksWhat RAG is and how it works: chunking, embeddings, vector search, hybrid search, reranking, GraphRAG and agentic RAG on AWS, Google and Azure.
Google Cloud's generative AI offerings, mappedGemini app, Gemini for Workspace, Gemini Enterprise, Agent Search, the contact center suite and Agent Platform: which one a business should pick, and why.
Prompt engineering vs RAG vs fine-tuningWhen to use prompt engineering, retrieval-augmented generation, fine-tuning or continued pre-training, compared on cost, freshness, hallucination and privacy.