About Graphometer
Measured studies of AI models, one-page field cards on single models, and the instruments we built to measure them, all run on our own hardware.
A graphometer is a surveyor's instrument for measuring angles. We took the name seriously. The tagline is "Seeing AI from the right angle."
How we work
Show the receipts. Every measured number on this site comes from a recorded run against a pinned version, and a number we did not measure carries a label saying whose it is. If a number cannot be traced to a file, it does not get said.
No partial credit. A result that almost passed is a failure with details, never a success with an asterisk.
Pointed at ourselves first. Our instruments test our own work the same way they test the models and tools we write about. When they catch our mistakes, the fix and the story publish together.
Another angle. We pick up promising AI that got less attention and measure what it does.
The rules behind these, and the labels every number carries, are on the method page.
How pages are built
Graphometer is stewarded by Grant Williams. Everything here is built by a human steward with heavy AI assistance, and every public claim is checked against recorded runs before it ships. Before a page is published, AI models from other families read it as strangers and attack it as sceptics, and the findings and the fixes are recorded.
Pages are drafted and reviewed with AI models from Anthropic, OpenAI, xAI, Moonshot AI, and Mistral AI. Not affiliated with, endorsed by, or connected to any of them or their affiliates.
What is on the site today
The instruments: the Graphometer Droplet compatibility kit for Liquid AI's LFM language models, the Graphometer Workbench for Grok Build, and Routecheck for OpenAI-compatible endpoints.
Independent work. Not affiliated with, endorsed by, or connected to Liquid AI, xAI, or OpenAI.
The Workbench was released on 14 August 2026 and is not under further development. The page and the launch film stay up, and the repository stays archived and readable.
The records: field cards for individual models, and studies and reports that measure, verify, or guide. The newer pages ship their evidence as a downloadable data package, and the method page lists which.
The hardware is one desktop with a single NVIDIA GeForce RTX 5090 graphics card and, since September 2026, a second machine with 128 GB of unified memory beside it, used in some studies. Every page says which of the two it ran on.
Contact
Graphometer is Grant Williams's project. His own site is grantwilliams.ai.
You can reach the steward at hello@graphometer.ai or on GitHub.