Buried in the Chrome developer documentation this week - and trending on Hacker News this morning with 123 upvotes - is something that could quietly change how small business software works over the next 12 months.
Google has released the Chrome Prompt API. It lets any website or browser extension run an AI model directly inside your browser. No separate API subscription. No per-query charges. No data leaving your machine to reach a cloud server. The model runs on your own hardware.
The model in question is Gemini Nano - Google's smallest and fastest AI model, designed specifically for on-device use. It's not as capable as GPT-4 or full Gemini. But it's not supposed to be. It's supposed to be fast, private, and free to run.
Let me explain why this matters more than it might look.
What the Prompt API Actually Does
Most AI tools you use work the same way: you type something, it goes to a server, a model processes it, a result comes back. That round trip costs money (the AI company's API costs, passed to you through subscription fees), takes time (network latency), and involves your data leaving your machine.
The Prompt API breaks that model. The AI lives inside Chrome. When a website uses it, the processing happens on your computer. The query never leaves your browser.
Here's what developers can build with it:
- AI-powered search within a webpage - Ask questions about the content of any page you're reading, answered by AI without a server call
- Real-time content filtering - A Chrome extension that automatically blurs or hides content matching topics you define
- Auto-fill calendar events - Browser extension that reads a webpage and extracts event details to add to your calendar in one click
- Contact extraction - Pulls contact information from websites automatically
- Personalized article categorization - Classify and filter content as you browse, based on your own defined categories
For users, most of these applications are invisible. You use a website or extension that's faster, smarter, and doesn't require you to have an AI subscription. For business owners, the implications show up in the tools you'll start using without realizing they've changed.
The Hardware Catch
This is important. Gemini Nano does not run on every computer.
To use the Chrome Prompt API, your machine needs:
- Windows 10 or 11, macOS 13 (Ventura) or later, or ChromeOS on a Chromebook Plus
- At least 22 GB of free storage
- More than 4 GB of VRAM on your GPU - or 16 GB of RAM and 4+ CPU cores
- A stable, unmetered internet connection for the initial model download
Chrome for Android and iOS are not yet supported.
What this means in plain terms: if you're running a modern Mac or a Windows machine built in the last two years with decent specs, you probably qualify. If you're on an older machine with limited RAM, you won't be able to run the on-device features. You'll still use the website normally - you just won't get the AI capabilities.
Why "Free to Run" Changes the Economics
Most AI tools for small business work on a subscription model. You pay $20/month for ChatGPT, $30/month for Claude Pro, $12/month for some workflow automation tool. Each subscription is a small cost that adds up.
The Chrome Prompt API doesn't change that directly. What it does is make it possible for developers to build AI features into tools at no ongoing cost per user. That changes the incentive structure for how tools get priced.
A small accounting tool that wants to add AI-assisted document summarization currently has two choices: pay for API calls and pass the cost to users (higher subscription price), or skip the feature. With the Prompt API, there's a third option: run it in the user's browser for free.
Over the next year, you'll start seeing this show up in Chrome extensions, web apps, and business tools. The feature will exist. It won't add to your bill. You may not even notice where the intelligence is coming from.
The Privacy Angle
For businesses handling sensitive data - financial records, client information, medical notes - the on-device processing model matters beyond cost.
When you use a cloud AI tool, your data goes to a server. That server may be governed by terms of service you've agreed to but never read. The data may be used to train future models. It may be stored in ways that affect your compliance posture if you're under HIPAA, SOC 2, or other frameworks.
Gemini Nano running in your browser doesn't leave your machine. There's no server receiving your input. The privacy posture is fundamentally different.
This won't replace cloud AI for complex tasks - Gemini Nano is a small model and its capabilities reflect that. But for text summarization, classification, basic drafting, and extraction tasks, it's capable enough. And for businesses that need those capabilities but can't or won't send data to cloud servers, it opens a door that wasn't there before.
What to Do With This Right Now
If you're not a developer, there's nothing to configure today. The Prompt API is in origin trial - meaning developers are testing it and building with it, but it's not universally deployed yet. Chrome 138 is the current launch version for the core API.
What you should watch for:
Chrome extensions getting smarter. If you use browser extensions for productivity, email, or workflow - pay attention over the next six months. Extensions built on the Prompt API will have AI features that don't require you to connect your own API key or pay a separate subscription.
Business tools adding free AI tiers. Web-based tools that want to offer AI capabilities without raising subscription prices now have a viable path. Expect to see "AI powered by your device" language appearing in product updates.
The privacy conversation shifting. "Does this AI tool send my data to the cloud?" is becoming a standard question for businesses in regulated industries. The answer for Prompt API-based tools will be no.
The Honest Limitation
Gemini Nano is not ChatGPT. It's a small model built for speed and on-device deployment. It will handle summarization, extraction, classification, and basic drafting competently. It will not handle complex reasoning, multi-step analysis, or creative tasks at the level you'd expect from a frontier model.
Think of it less as a replacement for AI subscriptions you have and more as a free layer of intelligence that starts showing up in tools you already use.
The Prompt API is documented at developer.chrome.com/docs/ai/prompt-api. If you're a developer building tools for small businesses, this is worth an afternoon of investigation.
Sources: Chrome Prompt API Documentation - Google for Developers | Hacker News - The Prompt API thread, April 27, 2026 | Gemini Nano on Chrome - Chrome Status
Danny Kowalski covers tools and software for small business at The Useful Daily. Published at theusefuldaily.com.