Privacy policy

The short version

DeviceBench runs AI models on your own device and shows you what they cost to run. Your prompts, the model output, and the load measurements never leave your machine. There is no DeviceBench server that receives them, so we could not read them even if we wanted to.

What runs where

Models that run inside your browser (Chrome's built-in Gemini Nano, WebGPU models) execute in the page on your hardware. The optional local companion is a small program you run yourself; it listens only on your computer's loopback address (127.0.0.1), talks to model runtimes on that same computer (Ollama, LM Studio, Apple's on-device model), and writes run history to a file in the folder where you installed it. This website only connects to that companion when you click Connect in the lab, and only from your own browser to your own machine.

Analytics

We use Plausible Analytics and Google Analytics 4 to understand how the site is used: pages visited, the referring site, country, device and browser type, and a few coarse events (a click on the support link). Neither sees what you typed or what a model answered. Plausible is cookieless and keeps no personal data. Google Analytics is provided by Google, which processes this data on our behalf under its data processing terms; it sets the cookies listed in our Cookie Policy and does not store IP addresses. We keep Google Analytics data for 14 months. See Google's Privacy Policy and how Google uses information from sites that use its services. Turn Analytics off in the cookie preferences and neither tool counts your visits.

Third-party downloads

The first time you run a model that is not already on your device, your browser or your local runtime fetches it from its publisher: Chrome downloads Gemini Nano from Google, WebGPU models are fetched from Hugging Face, Ollama pulls from Ollama's registry. Those requests transfer the model to you; they do not transfer anything of yours to them. The Network chart in the lab shows that traffic so you can see it happen.

Cookies and local storage

The site sets one cookie of its own, db_consent, which records your choice in the cookie notice for 180 days and is mirrored in local storage under db-consent; Your privacy choices in the footer of every page reopens the preferences. While Analytics is on, Google Analytics sets two cookies of its own (_ga and _ga_T3JB8E76J2); in the EEA, the United Kingdom and Switzerland it stays cookieless until you accept Analytics. It also keeps two preferences in your browser's local storage, both set only by your own action: the theme you chose with the light/dark toggle, and whether you have connected the companion before, so the lab can reconnect without asking. Browser-run models are cached by your browser so they do not download twice. Neither preference identifies you or leaves your browser, and you can clear all of it from your browser settings. The cookie policy lists every item in detail.

Support payments

Optional support payments are handled by Ko-fi and Stripe on their own websites. We do not see your card details. Ko-fi sends us your display name, email address, message and amount so we can thank you and keep accounting records.

Provided as-is

DeviceBench is a free tool provided as-is, without warranty. Measurements depend on your hardware, what else is running, and the model runtimes you have installed, and can differ from run to run. The terms of use set this out in full.

Contact

DeviceBench is a product name of, and is operated by, Elowin Labs LLC. Questions about this policy: hello@devicebench.io.