AIF-C01 Practice Question 34: Provisioned Throughput
AWS Certified AI Practitioner (AIF-C01) · Test 4 · question 4 of 10
A company's document-processing application sends a high, steady volume of requests to one foundation model in Amazon Bedrock around the clock. The team needs a guaranteed level of throughput for that model at a fixed hourly cost, and it is willing to commit for six months in exchange for a lower price. Which Amazon Bedrock option fits these requirements?
Show answer and explanation
Answer:
Provisioned Throughput gives a model a higher, provisioned level of throughput at a fixed cost. You buy model units (MUs), each delivering a set number of input and output tokens per minute, and you're billed hourly. You can choose no commitment, a one-month term or a six-month term, and longer commitments get a more discounted hourly price. That matches a steady, high-volume workload with a guaranteed capacity requirement (option C).
- A is wrong because on-demand pricing is pay-per-token with no reserved capacity. That suits variable traffic, but it doesn't guarantee throughput or give a fixed hourly price. - B is wrong because batch inference processes large sets of prompts asynchronously. It isn't built for continuous, around-the-clock requests from a running application that needs a guaranteed rate. - D is wrong because prompt caching lowers latency and input-token cost for repeated prompt prefixes. It is an optimization, not a way to reserve capacity at a fixed price.
Reference: Increase model invocation capacity with Provisioned Throughput in Amazon Bedrock