Prompts, Evals & LLM Observability Market

Prompts, Evals & LLM Observability · Launched on Show HN

167 products
Products and research metrics
ProductVisits · OctActions
MLflowOSSDeliver High-Quality AI, Fast148K
PromptfooOSSShip agents, not vulnerabilities107.8K
YuppThe Yupp Story103.6K
PromptLayerThe collaboration layer for AI engineering teams85.9K
BenchmarkListTrack AI progress with the largest database of benchmarks.65.7K
CoarenaWatch two computer-use agents work on your research .59K
Claude TunerOSSKnow when your AI limit hits — and when it's back46.5K
RaindropMCPOSSDetect agent issues. Prevent them from happening.42.8K
VerifyWiseOSSKnow every AI system you are running.37.3K
AgnostMCPYour Agents, Self-Improving.30.3K
DrivingBenchMCPOSSCan frontier models drive a real car? We give them control of a Toyota Corolla’s steering, accelerator, and brakes29.8K
NeuronpediaOSSExplore, visualize, and steer the internals of AI models.28.6K
Oso CloudOSSVisibility and controls to secure agents.28.1K
Big Prompt HubTravel Visual Prompts & Skills20K
PROMPTMETHEUSPrompt Engineering IDE17.1K
ValohaiYour AI product needs a context pipeline, specialized models, and a way to know if it's giving the right answers.12.8K
KastraMCPAuthorization for AI systems.10.6K
RivalOSSEvery answer every model gave to the same questions, kept after the models are gone.9.2K
AgentmemoryleaderboardOSSMeasure what your agents remember. Compare what truly matters.7.3K
SpanTurn eng time and tokens into better outcomes7.1K
Tiny AI ArenaOSSDid you ever click on an “AI Arena” expecting glorious battle and instead get a boring benchmark?6.4K
ScorecardThe simulation platform for agent self-improvement6.3K
OpenlitOSSOpen source Agent Harness Engineering Platform6K
AI BenchySearch AI BENCHY5.5K
KeletDebugging your agent in prod shouldn't require a crystal ball.<5K
APortAuthorize AI agents before they act.<5K
Agentic Control PlaneMCPPermissions, approvals, and cost for the coding agents you run.<5K
TrainlyFind the AI failures your monitoring misses.<5K
NoPIIOSSSensitive data is reaching your AI. That stops now.<5K
ThisorthisWhich AI is the best?<5K
Opsmeter.ioPrevent LLM bill shock before month-end.<5K
RAG DoctorOSSDeterministic diagnostics for RAG systems<5K
RampartOSSLet agents move fast. Keep the final say.<5K
Tork NetworkOne spine. Twelve nodes. Every decision receipted.<5K
FoglampOSSKnow what your agents are doing<5K
FrontierHarness EvalOSSComprehensive harness evaluation<5K
MubitBuild reliable agents with a model for every task.<5K
SeclaiEverything you need around your LLM calls.<5K
Semantic OverlaysOSSAn NX bit for language models<5K
OutputOSSAI development at the speed of conversation.<5K
CostHawkMCPYou’re paying for AI. Is it paying off?<5K
Agent CIQuantifiable metrics for agent performance as development teams scale<5K
LeaderboardAI is only as safe as its weakest models<5K
ChessArena.aiOSSLeaderboard<5K
They FellThe public record of what AI said would happen.<5K
TessaryOSSStop your agents from failing silently.<5K
BurnRateOSSEvery model. Every dollar. In view.<5K
ClashAIOSSClashAI — Where AI Agents Compete<5K
KnitThe best AI playground<5K
ZenLLMStop paying for AI tokens your app doesn't need.<5K
Page 1 of 4 · Showing 1–50 of 167 products