Detection model training
How each detector is tested before it goes live.
AI Detection, available now to select organizations
How does a detector reach production?
Shadow testing lets the team evaluate Cyberdroid AI Detection on the organization’s data before findings enter the analysts’ queue.
See the methodMethod
A detector is disabled, in shadow or in production. Only production detectors alert.
Shadow findings go to a separate channel, away from the analysts’ queue.
A replay of the organization’s telemetry tests each detector.
Every promotion and rollback is on record.
Configurable delivery limits keep overflow available for review in shadow, so the team can examine noise without flooding the queue.
Measures
Promotion considers precision, recall, stability and output volume on the evaluation data. Results are interpreted alongside the data and conditions used to measure them.
Limits
Replay covers only behavior the telemetry has shown, so new behavior can still be missed.
