Prompts, Evals & LLM Observability Market

Prompts, Evals & LLM Observability · Product form: CLI Tool

240 products
Products and research metrics
ProductVisits · OctActions
EvaliphyOSSSimplify End-to-End AI Testing<5K
LexiMetricsObservability for the words your LLM ships.<5K
CostKeyOSSYour agents work all night.Someone should keep watch.<5K
SigmaShakeMCPGenerative AI Agent Guardrails<5K
AgentReplayMCPOSSKnow What Your AI Agents Actually Do<5K
BuildermarkOSSHow much of your code is written by agents?<5K
PromptArchMCPContext engineering for AI agents. Architect every file they read.<5K
CortexOpsOSSShip Reliable AI Agents. Every Time.<5K
VaultakOSSYour AI agents can act. Vaultak decides what they are allowed to do.<5K
Claw LensOSSIntroduction<5K
AgenticLensMake agent runs legible.<5K
TextCompressorCut your LLM token bill by 17–46% — no model changes, no code rewrite<5K
falsifyOSSProve what the evaluation was supposed to pass before you show the result.<5K
PandaProbeOSSThe Stack for Self-Repairing Agents<5K
CodebookOSSGit for your AI prompts<5K
LimitrumMCPOSSThe Policy Kernel for Autonomous AI Agents<5K
PrismoOSSControl coding-agent spend.<5K
VindicaraOSSOpen source SDK for AI agent governance and audit<5K
Halton MeterOSSKnow exactly whereyour AI spend goes.<5K
baar-coreOSSStop LLM API calls before they happen. Not after.<5K
OpenInterpretabilityMCPKnow what an action will do before your agent runs it.<5K
SteelSpineMCPWhat did your AI do?<5K
MarrowMCPOSSLet AI do the work. Keep control.<5K
MemgarOSSruntime defense for LLM agent memory.<5K
TokenWatchKnow exactly what Claude Code costs you in real time<5K
ORKAMCPVeja tudo que seu agente faz. Solte com confiança.<5K
MCPSpendMCPOSSKnow what every MCP call costs you.<5K
Token Saving AnalyzerOSSWhat's wasting your Claude Code, Claude Desktop, Codex, GitHub Copilot, OpenCode, Cursor, Kiro, or Antigravity tokens?<5K
Cli ModelariumOSSCompare LLMs with real statistics, right from your terminal<5K
BackplanesSee what every AI agent in your org is doing.<5K
SpanlensOSSEvery model call, on the record.<5K
RegtraceOSSTrace Evaluate Enforce<5K
AladeenSee exactly where your coding agents get stuck. Local observability for Claude Code, Codex, Gemini, and opencode. 100% local.<5K
ClauxOSSThe interface Claude should have shipped with.<5K
RepoSpendOSSSee which repos are using your AI coding tokens.<5K
Krysta WingSECURE YOUR AI AGENTS. BEFORE THEY BREAK THINGS.<5K
ccglassMCPOSSSee exactly what your coding agent sends to the model<5K
BindfortMCPSecure every AI agent's MCP tool call before it runs<5K
RoleplayCan your AI agent be socially engineered?<5K
CarbonThe Analytics Layer of AI<5K
MCP Context BudgetMCPOSSMeasure and cap MCP context bloat before agents run<5K
CapsuleRewind any agent. Replay every decision.<5K
AegisureOSSOne constitution. Every agent. Safer commits.<5K
ZentropyLabs.aiOSSZain Dana Harper's work as one world: a road through ink and water, then places for light, type, mosaic, sound, data, film and the tools.<5K
TokenBoardThe AI coding token usage leaderboard.<5K
TokenHungerMCPOSSFind the cheapest model that actually passes your tests.<5K
RubrkitMCPGrade, rewrite, and test your AI instructions<5K
TryAgentMCPYour agents act. You stay in control.<5K
RetraceMCPOSSReplay any agent run. Fork the step that broke.<5K
WRUDOSSWhat your AI vendor won't tell you.<5K
Page 3 of 5 · Showing 101–150 of 240 products