AIF-C01 Practice Question 94: Streaming Responses Perceived Latency
AWS Certified AI Practitioner (AIF-C01) · Test 10 · question 4 of 10
A chat interface calls an Amazon Bedrock model and waits for the complete answer before showing anything. Long answers of about 500 tokens take roughly 15 seconds to generate, and users think the application has frozen. The team wants the interface to feel responsive without changing the model, the prompt or the answer quality. What should they do?
Show answer and explanation
Answer:
ConverseStream *"sends messages to the specified Amazon Bedrock model and returns the response in a stream"*, and InvokeModelWithResponseStream does the same for the Invoke API. The model takes the same total time to generate the full answer, but the first tokens reach the user within moments, so the wait is perceived as much shorter and the interface no longer looks frozen (option B).
- A is wrong because Provisioned Throughput reserves capacity for consistent throughput. It does not turn a 500-token generation into a sub-second one. - C is wrong because temperature controls how random the token choices are. It does not change how quickly tokens are produced. - D is wrong because truncating output changes the answers, which the team wanted to avoid, and it does not fix the blank waiting time.
Reference: ConverseStream