Privacy policy

Last updated: September 2026

The short version

DeviceBench runs AI models on your own device and shows you what they cost to run. Your prompts, the model output, and the load measurements never leave your machine. There is no DeviceBench server that receives them, so we could not read them even if we wanted to.

What runs where

Models that run inside your browser (Chrome's built-in Gemini Nano, WebGPU models) execute in the page on your hardware. The optional local companion is a small program you run yourself; it listens only on your computer's loopback address (127.0.0.1), talks to model runtimes on that same computer (Ollama, LM Studio, Apple's on-device model), and writes run history to a file in the folder where you installed it. This website only connects to that companion when you click Connect in the lab, and only from your own browser to your own machine.

Analytics

We use Plausible Analytics, a privacy-first service, to count page views in aggregate. Plausible is cookieless, collects no personal data, does not track you across sites, and is hosted in the EU. Because it sets no cookies and stores nothing on your device, no consent banner is required. We see counts of pages and referrers, never who you are or what you typed.

Third-party downloads

The first time you run a model that is not already on your device, your browser or your local runtime fetches it from its publisher: Chrome downloads Gemini Nano from Google, WebGPU models are fetched from Hugging Face, Ollama pulls from Ollama's registry. Those requests transfer the model to you; they do not transfer anything of yours to them. The Network chart in the lab shows that traffic so you can see it happen.

Local storage

The lab remembers one preference in your browser's local storage: whether you have connected the companion before, so it can reconnect without asking. Browser-run models are cached by your browser so they do not download twice. You can clear both from your browser settings.

Provided as-is

DeviceBench is a free tool provided as-is, without warranty. Measurements depend on your hardware, what else is running, and the model runtimes you have installed, and can differ from run to run.

Contact

DeviceBench is a product name of, and is operated by, Elowin Labs LLC. Questions about this policy: hello@elowinlabs.com.