On-device action model
An on-device action model is an action model small enough to run on the device's own chip, so tasks can run with less waiting and without sending screen content to a server. AGI, Inc. builds AGI-ACT, a family of action models that run on the device through AGI-RUN, its inference engine, or in a hybrid setup.
Last updated
Related terms
Action model
An action model is an AI model that returns the next action in an app or on a screen instead of a written answer.
On-device inference
On-device inference means running a trained AI model on the device itself, such as a phone or PC, instead of on a server.
Small action model (SAM)
A small action model (SAM) is an action model compact enough to run on a phone, PC or other edge device.
NPU (neural processing unit)
An NPU (neural processing unit) is the part of a chip built to run AI models quickly and at low power.
Model | AGI-ACT, from 2B to 20B+ parameters |
|---|---|
Runs on | The device through AGI-RUN, or hybrid with cloud or on-prem components |
Silicon | Snapdragon platforms, with Qualcomm Technologies since March 2026 |
Shown live | A task completed on a phone with no connection, Snapdragon Summit 2026 |
Why run an action model on the device?
An agent works with what is on the screen, which often includes messages and account details. When the model runs on the device, that content stays on the phone for those tasks. The agent also skips the round trip to a server and can keep working with no connection.
When does a hybrid setup make sense?
When a task needs more than the device can hold, a hybrid setup sends those steps to the cloud or to on-prem servers. Device makers can launch on the phones people own today and move more work onto the chip as hardware improves.
What hardware does AGI-ACT run on?
AGI, Inc. is optimizing AGI-ACT and its agent stack for Snapdragon platforms, under a collaboration with Qualcomm Technologies announced in March 2026. AGI-ACT can run on the device's NPU through AGI-RUN. At Snapdragon Summit 2026, AGI's action model completed a task on a phone with no connection, running on the Snapdragon NPU.
FAQ
Does an on-device action model work without a connection?
The model can, for the steps it runs on the device, since those steps do not wait on a server. Many tasks still need a connection because the apps themselves do, such as ordering food for delivery.
How big is AGI-ACT?
AGI-ACT is a family of models from 2B to 20B+ parameters, so a device maker can match the model to the memory and chip of each device.
Is an on-device action model the same as an on-device language model?
No. An on-device language model returns text, such as a summary or a suggested reply. An on-device action model returns the next step in an app and completes the task there.
