Prompts, Evals & LLM Observability Market

Prompts, Evals & LLM Observability · Product form: CLI Tool

Product formWeb App607API174CLI Tool106SDK104MCP Server67Chrome Extension50macOS App30Windows App22
106 products
Products and research metrics
ProductVisits · OctActions
LangfuseMCPOSSOpen Source Agent Evals &Observability722.9K
MLflowOSSDeliver High-Quality AI, Fast196.6K
TERMINAL-BENCHOSSTERMINAL-BENCH 5 4 3 . 1 0162.2K
PromptfooOSSShip agents, not vulnerabilities136.2K
HarborOSSharbor: evaluate agents in sandboxed environments132K
Prompt GenieStop burning tokens on bad prompts100.1K
ccusageOSSccusage Coding (Agent) CLI Usage Analysis92.1K
Orq.aiMCPControl AI. Ship software.70K
OpenlayerOSSEvery AI system in your company.51.7K
Extra HeadroomOSSHeadroom cuts your Claude Code & ChatGPT Codex token costs ~50%45.2K
ArcjetMCPOSSAgents can act. Arcjet decides whether they should.39K
LangWatchOSSTrace, test, route and govern every LLM call in your company, from your own agents to the coding assistants your engineers use.30.1K
Hashgraph OnlineMCPOSSSecurity for AI agents, built in the open.24.1K
Constellation Gate AIOSSGet your under control.8.5K
TokenMaxxerSee where all your tokens actually go5.8K
ClawMetryOSSEvery agent. Every machine. Under control.<5K
PipeLabMCPOSSOpen-source agent firewall for MCP and AI agent egress<5K
PromptOwlMCPEvery AI your team uses should already know your business — and you should be able to prove what it knows.<5K
FrontierHarness EvalOSSComprehensive harness evaluation<5K
CalcisOSSStop your agent before it spends what you can't afford.<5K
CordumMCPOSSStop AI agents before they take risky actions.<5K
RampartOSSLet agents move fast. Keep the final say.<5K
APortAuthorize AI agents before they act.<5K
Agentic Control PlaneMCPPermissions, approvals, and cost for the coding agents you run.<5K
AgentLintOSSThe linter for your agent harness.<5K
AI Daily CheckOSSHow is AI actually performing today?<5K
RigourOSSAI Agent Governance. One command.<5K
NavilOSSProduction governance for the agents calling your tools.<5K
WeightslabOSSSee what your model learns from. Fix it while it trains.<5K
GuardrlyMCPOSSAI Agent API Monitoring for Shopify and Meta Ads<5K
ArcKitMCPOSSThe AI harness and enterprise architecture kit for traceable governance artifacts, UK Government workflows, and compliance overlays.<5K
TenureOSSThe model does the thinking. Tenure does the policing.<5K
MarkdownLMMCPOSSBuilt to make AI-written code trustworthy.<5K
modelmapMCPOSSPaste a Hugging Face model id. See the whole network, watch a forward pass, and find out whether it fits on your GPU — no weights downloaded.<5K
ModelBoundMCPOSSKnow how your AI skills perform.<5K
RemyxOSSKnow your next move.<5K
clawdboardThe #1 vibe coder spent $7.0k this week. Where do you rank?<5K
gjallaYour agents hit their limits. You have no idea how.<5K
RAG DoctorOSSDeterministic diagnostics for RAG systems<5K
enclawedOSSReach compliance with your AI agents. Finally.<5K
OutputOSSAI development at the speed of conversation.<5K
CamelLayerOSSSpend less tokens, get better results<5K
LlmOSSBenchmark Local LLM Performance<5K
OriginMCPOSSSource Code Managementfor the agent era<5K
BenchLLMOSSThe best way to evaluate LLM-powered apps<5K
SHIMOSSYour AI traffic,Masked.<5K
ARAEvery part of the business has a system of record. Decisions don't. Until now.<5K
TokenFenceTokenFence — Cost Circuit Breaker for AI Agents<5K
MarrowMCPOSSLet AI do the work. Keep control.<5K
ooboMCPOSSContext beyond the diff.<5K
Page 1 of 3 · Showing 1–50 of 106 products