Prompts, Evals & LLM Observability Market

Prompts, Evals & LLM Observability · Target audience: Developers & Engineering Teams

828 products
Products and research metrics
ProductVisits · OctActions
HumanloopOSSHumanloop joins Anthropic15.4K
PrefactorEvaluate your AI agents all the time.14.3K
PinchBenchOSSThe best models for your OpenClaw agent.13.3K
BenchgenOSSThe Benchmarking Infrastructure for AI Agents11.6K
KastraMCPAuthorization for AI systems.10.6K
Free LLM PlaygroundFree instant access to 50+ models from top LLM providers. No signup, no API keys. Side-by-side compare, share links, transparent daily limits.9.4K
HoneyHiveMCPOSSProduction AI starts with observability.8.8K
neptune.aiThe most lightweight experiment tracking tool. @neptuneai7.7K
BotGaugeStop agent failures before they ship.7.6K
TokenCostCount tokens for GPT-5, Claude, Gemini, Llama & 147+ models. Compare API costs instantly.7.3K
AgentmemoryleaderboardOSSMeasure what your agents remember. Compare what truly matters.7.3K
SpanTurn eng time and tokens into better outcomes7.1K
Athina AIMonitor LLMs and automatically detect hallucinations in prod6.9K
OpenlitOSSOpen source Agent Harness Engineering Platform6K
TracklyFind what's wrong with your AI — and fix it.5.6K
TokenomyMCPThe Economic Runtime for AI — make every AI dollar accountable.5.3K
OmniShieldStop leaking secrets into AI chat5.2K
PromptToolsFree AI prompt tools + 21 dev utilities. No signup, ever.5K
TokonomicsStop Guessing Your AI API Costs5K
ClawMetryOSSEvery agent. Every machine. Under control.<5K
znMCPOSSYour coding agent works with your code, not your secrets.<5K
Overseer AIMaking AI safer.<5K
ClyroOSSDeploy Autonomous AI with Confidence.<5K
LangtailOSSPrompt management for product teams<5K
Prediction GuardScale your fleet of agents. Never lose control.<5K
CalcisOSSStop your agent before it spends what you can't afford.<5K
CordumMCPOSSStop AI agents before they take risky actions.<5K
KeletDebugging your agent in prod shouldn't require a crystal ball.<5K
WaxellNo AI in your company acts until Waxell says yes.<5K
APortAuthorize AI agents before they act.<5K
PromnestMCPYour prompt library with version control<5K
Agentic Control PlaneMCPPermissions, approvals, and cost for the coding agents you run.<5K
OpenPipeOSSThe OpenPipe platform has migrated to Weights & Biases and CoreWeave. Browse migration details and the OpenPipe technical archive.<5K
AgentLintOSSThe linter for your agent harness.<5K
RelyableBulletproof AI voice agents.<5K
SenroShip reliable WebMCP tools<5K
FreeplayShip great products with LLMs, now in public beta<5K
LMQLOSSProgramming language for LLMs.<5K
VokerMake sure your AI agents are helping, not just responding.<5K
SuperPromptsYour ideas, perfectly phrased.<5K
CodeTogetherScale AI without losing control.<5K
Langtrace AIImprove your LLM apps with open-source observability tool<5K
PromptWise.aiAI prompt enhancer for ChatGPT<5K
Prompt01Manage every prompt with more clarity, speed, and trust<5K
Parea AIDeveloper tools for evaluating, testing and monitoring LLM-powered apps.<5K
ComposoMCPOSSTeaching machines the human definition of quality.<5K
Pro Prompt BuilderAI Prompt Generator for Better Results<5K
TrainlyFind the AI failures your monitoring misses.<5K
NoPIIOSSSensitive data is reaching your AI. That stops now.<5K
drftMCPTurn requirement driaft into shipped software.<5K
Page 2 of 17 · Showing 51–100 of 828 products