|
| 1 | +--- |
| 2 | +title: "Overview" |
| 3 | +description: "Run screenshot-driven computer use agents on Kernel cloud browsers" |
| 4 | +--- |
| 5 | + |
| 6 | +Computer use models are vision-language models (VLMs) that operate a browser the way a person does: they look at a screenshot, decide what to do next, and emit a concrete action—move the mouse, click, type, scroll, or drag. Kernel runs these agents on cloud browsers, so you don't install or maintain anything locally, and gives the model the low-level [Computer Controls API](/browsers/computer-controls) it needs to see the screen and act on it. |
| 7 | + |
| 8 | +## How computer use works on Kernel |
| 9 | + |
| 10 | +Every computer use integration runs the same action-observation loop: |
| 11 | + |
| 12 | +1. **Capture** a screenshot of the current browser state with the [Computer Controls API](/browsers/computer-controls). |
| 13 | +2. **Predict** the next action by sending that screenshot to your model. |
| 14 | +3. **Execute** the returned action—click, type, scroll, drag, or key press—through Computer Controls. |
| 15 | +4. **Repeat** until the task is complete. |
| 16 | + |
| 17 | +Computer Controls emulates native keyboard and mouse input at the OS level—with human-like [Bézier curves](/browsers/computer-controls#move-the-mouse) by default—instead of driving the page over the Chrome DevTools Protocol (CDP). This keeps the loop close to real user input and reduces the automation signals that [bot detection](/browsers/bot-detection/overview) systems look for. |
| 18 | + |
| 19 | +The loop works with any VLM that predicts actions from pixels. The models below are the ones we maintain ready-to-deploy templates and guides for. |
| 20 | + |
| 21 | +## Supported models |
| 22 | + |
| 23 | +<CardGroup cols={2}> |
| 24 | + <Card title="Anthropic" icon="robot" href="/integrations/computer-use/anthropic"> |
| 25 | + Claude's computer use tool |
| 26 | + </Card> |
| 27 | + <Card title="Gemini" icon="google" href="/integrations/computer-use/gemini"> |
| 28 | + Google's Gemini 2.5 Computer Use model |
| 29 | + </Card> |
| 30 | + <Card title="OpenAGI" icon="wand-magic-sparkles" href="/integrations/computer-use/openagi"> |
| 31 | + OpenAGI's Lux model |
| 32 | + </Card> |
| 33 | + <Card title="OpenAI" icon="circle-nodes" href="/integrations/computer-use/openai"> |
| 34 | + OpenAI's computer-using agent (CUA) |
| 35 | + </Card> |
| 36 | + <Card title="Tzafon" icon="bolt" href="/integrations/computer-use/tzafon"> |
| 37 | + Tzafon's Northstar CUA Fast model |
| 38 | + </Card> |
| 39 | + <Card title="Yutori" icon="location-arrow" href="/integrations/computer-use/yutori"> |
| 40 | + Yutori's Navigator n1.5 pixels-to-actions model |
| 41 | + </Card> |
| 42 | +</CardGroup> |
| 43 | + |
| 44 | +Using a model that isn't listed here? Any VLM works—wire its predicted actions straight to the [Computer Controls API](/browsers/computer-controls) and run the same loop. |
| 45 | + |
| 46 | +## Get started |
| 47 | + |
| 48 | +Each model page includes a one-command template so you can deploy a working agent in minutes. For example, to scaffold the Anthropic integration: |
| 49 | + |
| 50 | +```bash |
| 51 | +kernel create --name my-computer-use-app --template computer-use |
| 52 | +``` |
| 53 | + |
| 54 | +Pick a model above to get its template, then follow the [deploy](/apps/deploy) and [invoke](/apps/invoke) guides to run your agent on Kernel. |
| 55 | + |
| 56 | +## Benefits of using Kernel for computer use |
| 57 | + |
| 58 | +- **No local browser management**: Run computer use automations without installing or maintaining browsers locally |
| 59 | +- **Scalability**: Launch multiple browser sessions in parallel for concurrent AI agents |
| 60 | +- **Stealth mode**: Built-in anti-detection features for reliable web interactions |
| 61 | +- **Session state**: Maintain browser state across runs via [Profiles](/auth/profiles) |
| 62 | +- **Live view**: Debug your agents with real-time browser viewing |
| 63 | +- **Cloud infrastructure**: Run computationally intensive AI agents without local resource constraints |
| 64 | + |
| 65 | +## Next steps |
| 66 | + |
| 67 | +- Read the [Computer Controls API](/browsers/computer-controls) reference for the full set of mouse, keyboard, and screenshot actions |
| 68 | +- Check out [live view](/browsers/live-view) for debugging your automations |
| 69 | +- Learn about [stealth mode](/browsers/bot-detection/stealth) for avoiding detection |
| 70 | +- Learn how to properly [terminate browser sessions](/browsers/termination) |
| 71 | +- Learn how to [deploy](/apps/deploy) your computer use app to Kernel |
0 commit comments