Problem Statement
Currently the retrieve and memory tools search type depends on the underlying data store:
- OpenSearch Serverless with a filterable text field configured → Bedrock can pick HYBRID automatically (or you can override).
- Any other vector store (e.g. plain OpenSearch Serverless without that config, Aurora PostgreSQL, Pinecone, Redis) → SEMANTIC only — hybrid isn't even available regardless of override.
I'd want to enforce HYBRID search for best retrieval results.
Similarly, I'd also want to leverage a reranking: AWS KB already has the native capability to support that, we just need to specify the reranker model ARN we want to use.
Proposed Solution
Besides the knowledge base ID provide two more configurations:
- search type: if empty then it can default to the current "auto" mode. If hybrid does not apply to a specific KB store then it can be ignored, or error can be thrown.
- reranking model ARN: if specified (Bedrock has at least Cohere and Titan embedding, and a multi model embedder too, I expect the latest Nemotron embedder to show up as well) then reranking would be configured for the KB with the respective settings.
Use Case
Any RAG or memory which goes beyond hello world demos could benefit from these low hanging fruits.
Alternatives Solutions
Creating a custom tool with an AWS KB where I control these, but this would be more plumbing code, it'd be great if it's out of the box.
Additional Context
No response
Problem Statement
Currently the retrieve and memory tools search type depends on the underlying data store:
I'd want to enforce HYBRID search for best retrieval results.
Similarly, I'd also want to leverage a reranking: AWS KB already has the native capability to support that, we just need to specify the reranker model ARN we want to use.
Proposed Solution
Besides the knowledge base ID provide two more configurations:
Use Case
Any RAG or memory which goes beyond hello world demos could benefit from these low hanging fruits.
Alternatives Solutions
Creating a custom tool with an AWS KB where I control these, but this would be more plumbing code, it'd be great if it's out of the box.
Additional Context
No response