Use the vitals package with ellmer to evaluate and compare the accuracy of LLMs, including writing evals to test local models.

There's a lot you can automate.

This example shows how to create a markup annotation that highlights a selected text on a page. To create this annotation for a selected text, call one of the PdfViewerControl.HighlightSelectedText ...