Use the vitals package with ellmer to evaluate and compare the accuracy of LLMs, including writing evals to test local models.
XDA Developers on MSN
I served a 200 billion parameter LLM from a Lenovo workstation the size of a Mac Mini
This mini PC is small and ridiculously powerful.
Some results have been hidden because they may be inaccessible to you
Show inaccessible results