Innovation Matters
Essays on AI, developer tools, and thoughtful software.
ProxyStat v1.2.1 - Quick access to system proxy settings
ProxyStat v1.2.1 adds quick access to system proxy settings and is now notarized for easier setup on macOS
Benchmark models using OpenAI-compatible APIs
Learn to benchmark language models with OpenAI-compatible APIs using our updated Jupyter Notebook for optimal performance evaluation.
Language model benchmarks only tell half a story
When it comes to language models, we tend to look at benchmarks to decide which model is the best to use in our application. But benchmarks only tell half a story. Unless you're building an all-purpose chat application, what you should be actually looking at is how well a model works for your application.
API request encoding matters
When you submit data to an API, the character encoding is crucial to ensure that the data is processed properly, especially if you're working with UTF characters.
Use Prompty with Foundry Local
Here's how you can use Prompty with Foundry Local