Use the vitals package with ellmer to evaluate and compare the accuracy of LLMs, including writing evals to test local models.

Try shopping for a USB-C cable and you’ll no doubt be struck by the confusing disparities in cable pricing and performance claims. These are just cables, right? Can they really be that different? At ...