language models
Your eval judge doesn't know what you mean
Does the solution follow best practices? Your LLM judge answers without hesitation and explains its verdict convincingly. So which best practices did it check?
What's your minimal viable model?
A better AI model appears, so you switch. But how would you know whether its extra intelligence makes any difference to your work?
Benchmark models using OpenAI-compatible APIs
Learn to benchmark language models with OpenAI-compatible APIs using our updated Jupyter Notebook for optimal performance evaluation.
Language model benchmarks only tell half a story
When it comes to language models, we tend to look at benchmarks to decide which model is the best to use in our application. But benchmarks only tell half a story. Unless you're building an all-purpose chat application, what you should be actually looking at is how well a model works for your application.