Roo Code: Bedrock custom ARN caching (#11983)

SkillAI & models

Roo Code's Bedrock provider silently disables caching for custom ARNs. Populate cachableFields to fix.

Available today. Use it from your connected AI after setup.

Connect ahel once, and every AI you use reads what you have installed.

Then ask your AI: use the Roo Code: Bedrock custom ARN caching (#11983) skill

What this skill tells your AI

The instructions your AI receives, as published by onlyterp/prompt-cache-skills in skills/roo-bedrock-custom-arn/SKILL.md and read by ahel’s review.

Target

src/api/providers/bedrock.tsguessModelInfoFromId() in RooCodeInc/Roo-Code.

Tracked upstream as issue #11983; PR #11984 proposes a fix but status uncertain at audit time.

Symptom

When a user configures Bedrock with a custom ARN instead of one of Roo's hardcoded model IDs, guessModelInfoFromId() returns { supportsPromptCache: true } but omits cachableFields. Downstream the Bedrock provider checks for cachableFields and skips caching entirely when empty. Net effect: silent 0% cache hit on custom ARNs.

Users hit this when:

  • Routing through a Bedrock-hosted Claude model with non-standard ARN
  • Using cross-region inference profiles
  • Provisioned throughput ARNs

Fix

--- a/src/api/providers/bedrock.ts
+++ b/src/api/providers/bedrock.ts
@@ guessModelInfoFromId(modelId: string)
   if (/* claude pattern match */) {
-    return { supportsPromptCache: true }
+    return {
+      supportsPromptCache: true,
+      cachableFields: ["system", "messages", "tools"],
+    }
   }

Apply this to every branch in guessModelInfoFromId() that returns supportsPromptCache: true without populating cachableFields.

If PR #11984 is already merged at apply time, verify the fix matches this shape and skip the diff.

Verify

  1. Configure Roo with a custom Claude ARN (any ARN not in the declared model list).
  2. Enable prompt caching in Roo settings.
  3. Capture wire via mitmproxy.
  4. Inspect outbound Bedrock Converse API request body:
    • Before fix: no cachePoint markers anywhere in the request
    • After fix: cachePoint: { type: "default" } blocks on system and last stable message
  5. Inspect response usage:
    • cacheWriteInputTokenCount > 0 on cold turn
    • cacheReadInputTokenCount > 0 on warm turn

Background

Bedrock's Converse API uses a different field name (cachePoint) than direct Anthropic (cache_control). Roo handles the translation correctly for declared models but the custom-ARN detection path is incomplete.

See docs/concepts/bedrock.md. Full audit: audits/roo-code.md.

Signals

GitHub stars
114
Forks
9
Last commit
Aug 2026
Advanced
Catalog kind
skill
Gateway key
roo-bedrock-custom-arn
Source
github.com/onlyterp/prompt-cache-skills