Video AgentsAll tags
Data Centers

Why the edge box is winning the argument over the cloud

The cloud was supposed to eat everything. For video agents it lost on arithmetic: a facility with 64 cameras produces 30 terabytes a month, and a lock has to fire in under a second.

By Daniel Reyes · 2 min read
On-site video recorder hardware
Spot AI describes its architecture as "edge-first, cloud-native": detection on site, reporting across sites in the cloud. Image: Spot AI

For a decade the pitch was that everything would move to the cloud, cameras included. Ship the pixels up, run the models in a data center, send the answer back. For dashboards and search, that worked. For agents that have to act, it ran into two numbers.

The first number is 30 terabytes

Spot AI's engineering team put it plainly in a technical post: a facility with 64 cameras generates over 30 terabytes of video a month. Multiply by a few hundred sites and you are no longer discussing software. You are discussing a bandwidth bill and a storage bill that scale with every camera you add, before a single model has run.

The edge box turns that around. Video stays on site. What leaves the building is metadata: an event, a clip, a count. Spot AI's VP of engineering, Amrish Kapoor, describes the company's design as "edge-first, cloud-native," with on-site devices that "detect events on site and surface metadata for cross-site reporting." When the company launched its agents in 2024, it said the edge hardware carried three times the compute of a traditional AI camera, specifically so newer foundation models could run there.

The second number is one second

An agent that locks a door or stops a conveyor cannot wait for a round trip to a region a thousand miles away. The useful way to think about it is a latency budget: the time from capture to encode to inference to decision to actuation to network. For a robot arm, that budget is tens of milliseconds. For most security and safety work it is one to two seconds, still far tighter than a person watching forty screens.

Those budgets decide where code lives. Low-latency control belongs on the edge. Long-horizon reasoning, the part that weighs a scene against a policy or summarises a shift, can tolerate seconds and belongs in the cloud, where the large models are.

This closely aligns with Qualcomm's vision of implementing AI on edge to solve real-world challenges.

That was Tushar Gupta of Qualcomm Ventures explaining the chip company's investment in Spot AI. Chipmakers do not bet on architectures by accident. Edge inference is where their next decade of silicon goes.

Hybrid, not either

None of this means the cloud loses. It means the job splits. Kapoor's post argues for exactly this hybrid at industrial sites, and the pattern is now common across the category: a small model on the box for fast, cheap, always-on detection, and a large model upstream for the questions that need context. The edge answers "is a person in the forklift lane right now." The cloud answers "how did lane incidents trend across nineteen plants this quarter."

The interesting consequence is for the people who install cameras for a living. If the value is in the box and the model, not the cable, the integrator's job shifts from running wire to tuning agents. That is a bigger change to the industry than any single product, and it is happening because of arithmetic, not ideology.