Use the vitals package with ellmer to evaluate and compare the accuracy of LLMs, including writing evals to test local models.

A University of Glasgow-led research project is releasing a free tool to help organizations, policymakers, and the public maximize the benefits of AI applications while identifying their potential ...

Jonathan Kwan is an Assistant Professor of Philosophy at New York University Abu Dhabi and was previously the Markkula Center’s Inclusive Excellence Postdoctoral Fellow in Immigration Ethics. Views ...