AWS puts observability inside its new managed Bedrock retrieval walkthrough

The CDK example combines multiple knowledge bases, iterative retrieval and continuous evaluation in a single infrastructure application.

AWS has published an infrastructure walkthrough for an AI agent that can choose between knowledge bases, retrieve repeatedly and return cited answers. The October 26 guide uses Managed Amazon Bedrock Knowledge Bases, Bedrock AgentCore and the AWS Cloud Development Kit to provision the application and its operating controls.

The example gives retrieval a planning loop. Instead of searching once and immediately drafting an answer, the agent can choose a relevant knowledge base and return for more information. AWS's managed service handles ingestion, storage, indexing and retrieval, while the example includes CloudWatch dashboards and both on-demand and continuous evaluation.

The design addresses a practical weakness in one-pass question answering. A question may need information from two different collections, or its first search result may reveal that the original question was underspecified. Allowing another retrieval step can help, but it also makes the path to an answer less predictable.

That is why observability belongs in the application design. An operator needs to see which collection was consulted, how much work the system performed and whether the answer remained grounded in the material it found. A completed request alone cannot establish those properties.

The walkthrough is an implementation reference, not evidence that every workload needs an agentic design. Straightforward queries may be adequately served by a simpler retrieval pipeline. For more demanding questions, its useful contribution is to package the retrieval process, deployment dependencies and quality measurement together so that teams can evaluate the complete service rather than only its final text.

Sources

- [Build agentic retrieval on a Managed Amazon Bedrock Knowledge Base with CDK](https://aws.amazon.com/blogs/machine-learning/build-agentic-retrieval-on-a-managed-amazon-bedrock-knowledge-base-with-cdk/) — Amazon Web Services