This site is a work in progress and has not been widely shared. Content may contain errors. Feedback is welcome.
This site is undergoing review. Some annotations were human-generated, some AI-generated — all are being verified.
Back to datasets

Bono Security Copilot IT Admins

Randomized Controlled Trials for Security Copilot for IT Administrators

AI-focusedPublicWorker-side
Visit Dataset
Specific Type
Experimental AI usage evidence
Dataset Type
Cross-sectional
Institution
Microsoft
Institution Type
Industry
Level of Focus
Individual
Most Granular Level
Individual IT administrator level
Perspective
Worker-side
Time Coverage
2024
Frequency
One-time experiment
Sample Size
149 IT administrators
Geographic Detail
Not specified
Occupational Classification
IT administrators
Industrial Classification
Technology/Software
Other Classification
Task complexity; scenario type
Key Variables
Task accuracy; completion time; user satisfaction; relevant facts identified
AI/Tech Tracking
Microsoft Security Copilot usage in Entra and Intune
Access Details
Available from authors
Notes
34.53% improvement in accuracy; 29.79% reduction in completion time; 146% more relevant facts in complex tasks

Key Papers

Bono, Edelman, Peng, Rodriguez & Ho (2024)