Add prompt-caching examples for Effect AI #44

subtleGradient · 2025-11-11T23:52:27Z

Add prompt-caching examples for Effect AI

Add typescript/effect-ai/src/prompt-caching/user-message-cache.ts
Demonstrates cache_control using options.openrouter.cacheControl in Prompt
Shows Effect.gen pattern with Layer-based dependency injection
Critical configuration: stream_options.include_usage in model config layer
Evidence-based verification via response.usage.cachedInputTokens

Run biome format

Simplify Effect AI prompt-caching README to link to main docs

Rename prompt caching examples with anthropic prefix

subtleGradient · 2025-11-11T23:52:40Z

Add FileParserPlugin example for Effect AI #52 : 4 dependent PRs (#45 , #47 , #48 and 1 other)
Add prompt-caching examples for Effect AI #44 👈 (View in Graphite)
Add prompt-caching examples for AI SDK v5 #43 : 1 other dependent PR (#51 )
Add FileParserPlugin example for fetch API #50
Add prompt-caching examples for fetch API #42
Clean slate: Remove all content except LICENSE.md and .env.sample #41
main

This stack of pull requests is managed by Graphite. Learn more about stacking.

socket-security · 2025-11-11T23:52:54Z

Review the following changes in direct dependencies. Learn more about Socket for GitHub.

Diff	Package	Supply Chain Security	Vulnerability	Quality	Maintenance	License
	@effect/platform-bun@0.83.0
	@effect/ai-openrouter@0.6.0
	@effect/ai@0.32.1
	effect@3.19.4
	@effect/platform@0.93.3

View full report

Copilot

Pull Request Overview

This PR adds Effect AI prompt-caching examples demonstrating Anthropic's prompt caching feature using @effect/ai and @effect/ai-openrouter. The examples showcase Effect-TS patterns including Effect.gen composition, layer-based dependency injection, and type-safe error handling. However, the PR contains multiple documentation inconsistencies where filename references are missing the "anthropic-" prefix that was added during the renaming process.

Key Changes:

Added three Anthropic prompt-caching examples for Effect AI with idiomatic Effect patterns
Integrated effect-ai workspace into the monorepo
Updated main documentation to include Effect AI examples

Reviewed Changes

Copilot reviewed 9 out of 9 changed files in this pull request and generated 8 comments.

Show a summary per file

File	Description
typescript/package.json	Adds effect-ai workspace to monorepo
typescript/effect-ai/tsconfig.json	TypeScript configuration for Effect AI workspace with Bun types
typescript/effect-ai/package.json	Package configuration with Effect AI dependencies and example scripts (scripts reference incorrect filenames)
typescript/effect-ai/README.md	Main workspace README documenting Effect patterns (contains broken link to non-existent file)
typescript/effect-ai/src/prompt-caching/README.md	Prompt caching examples documentation (multiple filename references missing "anthropic-" prefix, inaccurate description)
typescript/effect-ai/src/prompt-caching/anthropic-user-message-cache.ts	Example demonstrating cache_control on user message content (run command references old filename)
typescript/effect-ai/src/prompt-caching/anthropic-no-cache-control.ts	Control scenario validating caching behavior (run command references old filename)
typescript/effect-ai/src/prompt-caching/anthropic-multi-message-cache.ts	Multi-turn conversation caching example (run command references old filename)
docs/prompt-caching.md	Updated with link to Effect AI examples

💡 Add Copilot custom instructions for smarter, more guided reviews. Learn how to get started.

typescript/effect-ai/src/prompt-caching/README.md

typescript/effect-ai/package.json

typescript/effect-ai/src/prompt-caching/README.md

typescript/effect-ai/README.md

typescript/effect-ai/src/prompt-caching/anthropic-no-cache-control.ts

typescript/effect-ai/src/prompt-caching/anthropic-user-message-cache.ts

typescript/effect-ai/src/prompt-caching/anthropic-multi-message-cache.ts

louisgv · 2025-11-13T10:16:18Z

typescript/effect-ai/package.json

+    "@effect/ai": "^0.32.1",
+    "@effect/ai-openrouter": "^0.6.0",
+    "@effect/platform": "^0.93.0",
+    "@effect/platform-bun": "^0.83.0",
+    "effect": "^3.19.3"


freeze them deps

louisgv · 2025-11-13T10:16:45Z

typescript/effect-ai/src/prompt-caching/anthropic-no-cache-control.ts

+  const makePrompt = () =>
+    Prompt.make([
+      {
+        role: 'user' as const,
+        content: [
+          {
+            type: 'text' as const,
+            text: largeContext,
+            // NO cache_control - this is the control
+          },
+          {
+            type: 'text' as const,
+            text: 'What are the key principles?',
+          },
+        ],
+      },
+    ]);


Would pull this into a separate function

louisgv

read better than I thought -- pre-emptively approved

subtleGradient · 2025-11-19T16:42:41Z

Merge activity

Nov 19, 4:42 PM UTC: A user started a stack merge that includes this pull request via Graphite.
Nov 19, 4:45 PM UTC: Graphite couldn't merge this pull request because a downstack PR Add FileParserPlugin example for fetch API #50 failed to merge.
Nov 19, 5:41 PM UTC: A user started a stack merge that includes this pull request via Graphite.
Nov 19, 5:45 PM UTC: Graphite rebased this pull request as part of a merge.
Nov 19, 5:45 PM UTC: @subtleGradient merged this pull request with Graphite.

- Add typescript/effect-ai/src/prompt-caching/user-message-cache.ts - Demonstrates cache_control using options.openrouter.cacheControl in Prompt - Shows Effect.gen pattern with Layer-based dependency injection - Critical configuration: stream_options.include_usage in model config layer - Evidence-based verification via response.usage.cachedInputTokens

Replace hardcoded filename list with run-examples.ts that auto-discovers all .ts files in src/ Benefits: - Add new example → automatically included in 'bun examples' - Rename example → no package.json update needed - Impossible for package.json to reference non-existent files Also fixes stale filenames (user-message-cache.ts → anthropic-user-message-cache.ts)

- Replace local docs link with https://openrouter.ai/docs/features/prompt-caching - Remove duplicated Effect AI usage examples and notes - Keep README minimal to avoid content going stale - Code examples are in the actual .ts files

This was referenced Nov 11, 2025

Clean slate: Remove all content except LICENSE.md and .env.sample #41

Merged

Add prompt-caching examples for fetch API #42

Merged

This was referenced Nov 11, 2025

Add prompt-caching examples for AI SDK v5 #43

Merged

Add prompt-caching placeholder for OpenRouter SDK #45

Open

Add basic OpenRouter SDK example extracted from wrapper repo #46

Open

subtleGradient marked this pull request as ready for review November 11, 2025 23:53

Copilot AI review requested due to automatic review settings November 11, 2025 23:53

Copilot started reviewing on behalf of subtleGradient November 11, 2025 23:54 View session

Copilot finished reviewing on behalf of subtleGradient November 11, 2025 23:58

subtleGradient mentioned this pull request Nov 11, 2025

Add basic AI SDK example extracted from wrapper repo #48

Open

Copilot AI reviewed Nov 11, 2025

View reviewed changes

subtleGradient mentioned this pull request Nov 11, 2025

Add basic Effect example extracted from wrapper repo #49

Open

subtleGradient changed the base branch from 03-prompt-caching-aisdk to graphite-base/44 November 12, 2025 21:36

This was referenced Nov 12, 2025

Add FileParserPlugin example for fetch API #50

Merged

Add FileParserPlugin example for AI SDK v5 #51

Merged

subtleGradient force-pushed the 04-prompt-caching-effect branch from 189d80e to 9795a98 Compare November 12, 2025 22:23

subtleGradient force-pushed the graphite-base/44 branch from 998a95f to 6a73a21 Compare November 12, 2025 22:23

subtleGradient changed the base branch from graphite-base/44 to 03-prompt-caching-aisdk November 12, 2025 22:23

subtleGradient mentioned this pull request Nov 12, 2025

Add FileParserPlugin example for Effect AI #52

Merged

subtleGradient force-pushed the 04-prompt-caching-effect branch from e069c8d to 25cbe98 Compare November 12, 2025 23:18

subtleGradient force-pushed the 03-prompt-caching-aisdk branch from 6a73a21 to 0147fbe Compare November 12, 2025 23:18

subtleGradient mentioned this pull request Nov 12, 2025

Add basic fetch example extracted from wrapper repo #47

Merged

louisgv reviewed Nov 13, 2025

View reviewed changes

louisgv approved these changes Nov 13, 2025

View reviewed changes

subtleGradient force-pushed the 04-prompt-caching-effect branch from 25cbe98 to ec6d0fd Compare November 19, 2025 11:13

subtleGradient force-pushed the 03-prompt-caching-aisdk branch from 0147fbe to bfdfeeb Compare November 19, 2025 11:13

subtleGradient changed the base branch from 03-prompt-caching-aisdk to graphite-base/44 November 19, 2025 17:42

subtleGradient changed the base branch from graphite-base/44 to main November 19, 2025 17:43

subtleGradient added 7 commits November 19, 2025 17:44

Run biome format

d53c86d

Simplify Effect AI prompt-caching README to link to main docs

5219b44

Rename prompt caching examples with anthropic prefix

cabf912

Remove filename references from docs to prevent sync issues

af2da62

subtleGradient force-pushed the 04-prompt-caching-effect branch from ec6d0fd to a168119 Compare November 19, 2025 17:44

subtleGradient merged commit 3c8c04b into main Nov 19, 2025
3 checks passed

Provide feedback

Saved searches

Use saved searches to filter your results more quickly

Uh oh!

Add prompt-caching examples for Effect AI #44

Add prompt-caching examples for Effect AI #44

Uh oh!

subtleGradient commented Nov 11, 2025

Uh oh!

subtleGradient commented Nov 11, 2025 •

edited

Loading

Uh oh!

socket-security bot commented Nov 11, 2025 •

edited

Loading

Uh oh!

Copilot AI left a comment

Uh oh!

Uh oh!

Uh oh!

Uh oh!

Uh oh!

Uh oh!

Uh oh!

Uh oh!

Uh oh!

louisgv Nov 13, 2025

Uh oh!

louisgv Nov 13, 2025

Uh oh!

louisgv left a comment

Uh oh!

subtleGradient commented Nov 19, 2025 •

edited

Loading

Uh oh!

Uh oh!

Reviewers

Assignees

Labels

Projects

Milestone

Development

Uh oh!

3 participants

Add prompt-caching examples for Effect AI #44

Add prompt-caching examples for Effect AI #44

Uh oh!

Conversation

subtleGradient commented Nov 11, 2025

Uh oh!

subtleGradient commented Nov 11, 2025 • edited Loading Uh oh! There was an error while loading. Please reload this page.

Uh oh!

Uh oh!

socket-security bot commented Nov 11, 2025 • edited Loading Uh oh! There was an error while loading. Please reload this page.

Uh oh!

Uh oh!

Copilot AI left a comment

Choose a reason for hiding this comment

Pull Request Overview

Reviewed Changes

Uh oh!

Uh oh!

Uh oh!

Uh oh!

Uh oh!

Uh oh!

Uh oh!

Uh oh!

Uh oh!

louisgv Nov 13, 2025

Choose a reason for hiding this comment

Uh oh!

louisgv Nov 13, 2025

Choose a reason for hiding this comment

Uh oh!

louisgv left a comment

Choose a reason for hiding this comment

Uh oh!

subtleGradient commented Nov 19, 2025 • edited Loading Uh oh! There was an error while loading. Please reload this page.

Uh oh!

Merge activity

Uh oh!

Uh oh!

Reviewers

Assignees

Labels

Projects

Milestone

Development

Uh oh!

3 participants

subtleGradient commented Nov 11, 2025 •

edited

Loading

socket-security bot commented Nov 11, 2025 •

edited

Loading

subtleGradient commented Nov 19, 2025 •

edited

Loading