Your AI Portfolio Is a Black Box
You can see how much you spend on AI. You can see who is calling which model. But you cannot see the work itself — the recurring patterns hiding inside hundreds of thousands of prompts, or whether the capabilities and agents you have approved are actually being used.
What You Can See Today
- Spend — Token costs by model and team
- Latency — Provider response times, error rates
- Adoption — Active users, request volume
What You Cannot
What recurring jobs your teams ask AI to do, which of those have an approved capability or agent behind them, and which are still running ad hoc.
Questions your CTO and AI Program Manager cannot answer today
Without portfolio visibility, every AI investment is a leap of faith.
A Curation Engine for Enterprise AI
Skills Trace turns raw gateway traffic into a curated portfolio of capabilities and agents. Built for the Digital CTO and AI Program Manager who own standardization, governance, and adoption.
Five layers, one workflow — from raw traffic to portfolio decisions
For low-maturity orgs with zero approved assets
Find recurring work, generate a standardization backlog, draft specs that humans review before anything ships. Mode is inferred automatically — no flags, no settings table.
For orgs with an existing capability and agent catalog
Match traffic against approved assets, surface bypass and overlap, route end users to the right capability, and rank what to standardize next.
Work Patterns
Recurring AI tasks inferred across teams — the demand side of your portfolio
Coverage
Percent of top work patterns served by an approved capability or agent — the headline executive metric
Standardization Queue
Prioritized opportunities with recommended action — build, extend, merge, retire — and confidence-bounded upside ranges
Bypass & Overlap
Approved assets being skipped for ad-hoc prompts, and approved assets quietly covering the same work
From Prompt Traffic to Portfolio Decisions
Skills Trace runs as a thin middleware inside your existing AI gateway. Prompts are never modified. Capture once at the gateway, curate everywhere.
Your AI Gateway
Capture Middleware
Skills Trace
Portfolio Surface
ClickHouse Telemetry Store
Multi-tenant, columnar, partitioned by tenant
<5ms
p99 capture latency
Zero
prompt content stored
Human
in every decision loop
The Curation PipelineFive steps, humans always in the loop
Capture
<5ms p99Gateway middleware ingests prompts and emits redacted, length-bounded telemetry
Cluster
batchedGroup similar prompts into Work Patterns with cluster signatures and representative examples
Match
with confidenceExact and near-neighbor matching against your approved capability and agent registry
Score
snapshot-versionedRank standardization opportunities; classify bypass and overlap; estimate upside as ranges with confidence
Decide & Draft
admin-gatedHumans record portfolio decisions and review draft capability or agent specs — never autonomous
Captured event
// Telemetry event written at the gateway
{
"tenant_id": "acme",
"user_id": "u_2yK...",
"team": "support",
"business_unit": "ops",
"prompt_excerpt": "[redacted, length-bounded]",
"model": "claude-sonnet-4-6",
"ts": "2026-04-27T18:42:11Z"
}Prompt content is redacted and length-bounded before storage. Only attribution metadata, model, timestamps, and a representative excerpt are kept — never raw user content.
One Surface for the Whole Portfolio
From the executive coverage chart down to a single work pattern’s org spread — every view is built for weekly triage and monthly portfolio review.
Portfolio Coverage
Executive67%
of top work patterns covered
+8 pts vs last quarter
Headline executive metric: percent of top work patterns served by an approved capability or agent. Trended for the board.
Standardization Queue
Queue23
opportunities ranked this week
Top item: weekly-update
Prioritized opportunities with recommended action — build, extend, merge, retire — and confidence-bounded upside.
Portfolio Decisions
Governance47
decisions logged this quarter
12 awaiting follow-up
Recorded human decisions with action, alternatives, owner, and outcome — your audit trail and adoption story.
Bypass & Overlap
Risk9
active findings
customer-response: heavy bypass
Approved assets being skipped for ad-hoc prompts, plus quiet duplication where two assets cover the same work.
Capture Where You Already Run
One Capture Layer. Every gateway. No agent changes.
LiteLLM
PythonPython callback that captures redacted telemetry from the LiteLLM proxy
Vercel AI SDK
TypeScriptLanguageModelMiddleware that captures gateway traffic from Vercel-powered AI apps
Express
Node.jsDrop-in capture middleware for Express-based AI proxy servers
Cloudflare Workers
EdgeEdge-native capture adapter for Cloudflare AI Gateway Workers
Deployment typically requires one configuration change. No agent instrumentation required.
Built for Enterprise AI Governance
Three pillars under the Digital CTO and AI Program Manager — standardize what repeats, govern the rest, and quantify the upside with ranges, not promises.
Standardize
Turn recurring work into curated capabilities and agents
- Cluster prompts into Work Patterns
- Exact + near-neighbor matching
- Action tree: build, extend, merge, retire
- Heuristic draft specs (LLM generators ready to plug in)
Govern
See what is bypassed, what overlaps, and who decided what
- Bypass detection with severity classification
- Overlap detection across approved assets
- Portfolio Decisions with full audit trail
- Admin-only governance writes (Clerk + RBAC)
Quantify
Confidence-bounded upside and an executive coverage metric
- Coverage = % of top patterns with approved match
- Upside ranges (never single-point ROI promises)
- Org spread by user, team, business unit
- Snapshot-versioned opportunity reads
Security & Privacy by Design
One Operating Loop for AI Curation
Weekly triage, monthly portfolio review. Skills Trace runs the loop from raw gateway traffic to executive coverage — and keeps a human in every decision.
Discover
Skills TraceCluster prompts into Work Patterns; attribute to org spread
Match
Skills TraceCompare patterns against approved capabilities and agents (exact + near)
Decide
AI Program ManagerHumans rank opportunities and record portfolio decisions with audit trail
Draft
Skills TraceGenerate capability or agent specs (heuristic v1, LLM generators next)
Enable
Digital CTOCoach end users toward the approved path; surface coverage to executives
One Capture Layer. Everything Else Follows.
Drop the middleware into your existing AI gateway. Within a week, you have a real picture of recurring work — and a backlog of standardization opportunities ready for review.
Lightweight gateway middleware
Adapters for Express, Vercel AI SDK, Cloudflare Workers, and LiteLLM. Telemetry lands in ClickHouse multi-tenant by design — every query scoped by tenant, every read snapshot-versioned.
- No agent instrumentation required
- No prompt content stored — redacted excerpts only
- Multi-tenant from request one (tenant-scoped queries)
import express from "express";
import { createCaptureMiddleware } from "@skills-trace/express";
const app = express();
// One configuration. Capture redacted telemetry from every prompt.
app.use(
"/v1/chat/completions",
createCaptureMiddleware({
tenantId: process.env.TENANT_ID,
emitter: "https://telemetry.skillstrace.dev/api/telemetry",
apiKey: process.env.SKILLS_TRACE_API_KEY,
})
);