Video security benchmark report, issue 01
Leaderboard status
No vendor run has been performed. Eight products carry an assigned task; zero rows hold a measured result. The brackets below spell out what an operator must collect before a cell can be replaced. Read a row across before setting up the camera. The first Coram cell needs the amount of moving video recovered; the next needs the length of the longest hole — and an export with the right filename and duration can still leave both questions unanswered. Product order carries no rank.
| System | Documented task and reason for inclusion | First primary measure | Companion evidence |
|---|---|---|---|
| Sightline (app labeled Argus) | Audit an installed camera's monitored hours. Icarian includes coverage gaps in its PDF. A01 · App · A06 · Reports · A01 · Sightline | [TEST: monitored/scheduled seconds on the gate shift] | [TEST: PDF gap duration minus sender-log gap duration, seconds] |
| Spot AI | Find a vehicle across the installed fleet. Spot combines local recording and dashboard investigation. V01/V02 · Product | [TEST: correct target clips found/assigned searches] | [TEST: seconds from prompt to correct playback per search] |
| Coram | Recover a local recording from a Point after a WAN interruption at one site. V03 · Point | [TEST: recovered moving-video seconds/requested outage seconds] | [TEST: longest missing interval in exported clip, seconds] |
| Lumana | Bring a compatible IP camera onto Core and into VMS+. This is a recorder-replacement exercise. V06 · Deployment FAQ | [TEST: working feeds/attempted feeds on the proposed Core] | [TEST: minutes from connection to first playable archive per feed] |
| Verkada | Find a known interval from a compatible third-party camera on Command Connector. Connector supports people and vehicle searches. V09 · Connector | [TEST: correct target clips found/assigned searches] | [TEST: seconds from prompt to correct playback per search] |
| Eagle Eye Networks | Search for a marker eight days after capture. The edition sets the searchable window. V10 · Editions | [TEST: retrieved markers/retained eligible markers by edition] | [TEST: directly playable markers/all seeded markers] |
| Pano AI | Follow smoke confirmation over a region. Analysts review detections before a confirmed message goes to response partners. V12 · Rapid Detect | [TEST: confirmed exercise notifications/eligible authorized smoke exercises] | [TEST: seconds from analyst confirmation to receipt with clock evidence] |
| LVT Essentials | Verify the visible mobile camera at an unpowered post. The solar unit includes recording and strobes; this package omits agentic AI. V14 · Essentials | [TEST: playable seconds/scheduled post seconds] | [TEST: observed strobe activations/authorized activation attempts] |
Reading across a row
A smoke-confirmation exercise needs a partner and a designated receiver. Gate drawings cannot stand in for the exercise. Icarian describes people and vehicles as its current classes, with smoke still in development. Pano's documented analyst-reviewed workflow is the stronger fit for the regional smoke desk. A station yard watching its back entrance wants something else entirely. A02/P06 · Station use · V12 · Pano workflow
Spot and Verkada are the nearest pair in this issue's table, and even those two results need the same source session, eligible target, prompt, operator start and playback stop condition. Give both operators 180 seconds. If only one system can search back to the target date, enter the edition and window on that row. The experiment then shows a difference in searchable history, not which operator interface retrieves the same clip faster. Code a task as outside scope when the tested edition cannot perform it. Zero is reserved for an attempted, eligible measurement with a real denominator.
Evidence packet
The operator runbook gives the procedure for each open cell. For later matched alert trials, keep TP, FP, FN, monitored time, negative windows and receipt clocks as the measurement protocol specifies. A first successful replay establishes a working ingest path. It cannot populate an accuracy table.
Record identifiers · A01 · A02 · A06 · V01 · V02 · V03 · V06 · V09 · V10 · V12 · V14 · P06 · L01 · L02