Hack The Box AI Range Enterprise: Can Your AI Agents Actually Do the Job?

The Problem: Agents Pass Benchmarks but Fail at Real WorkHack The Box says an agent may be put into production after a strong benchmark result or vendor test without ever being checked against the work it will handle day to day. Human staff in the same role usually are. An agent's performance can also drift after deployment as the model underneath it gets updated.This is a structural problem. Benchmarks measure capability in controlled conditions. They do not measure competence in the messiness of real operational environments. On October 6, 2026, Hack The Box Ltd., the cybersecurity readiness platform, introduced AI Range Enterprise Edition to close that gap.The platform lets security teams connect an AI agent, assign it a role, and let it work through realistic environments. The agent is then scored on its competence in that role, with a pass-or-fail mark in each environment it navigates.## How Agentic Worker Competence Scoring WorksHack The Box's Chief Product Officer Gerasimos Marketos described the process in three words: "connect the agent, assign it a role and let it work." The platform logs how the agent copes with each task on its own, and security leaders use those results to decide what work an agent is ready for.| Feature | What It Measures ||---------|-------------------|| Role-based scoring | Each agent gets a competence score for its assigned role || Per-environment pass/fail | Pass-or-fail mark in each scenario the agent works through || Tracked over time | Results tracked across runs to detect performance drift || Regular updates | New environments added as fresh vulnerabilities and attack patterns appear || Rerun on change | Customers can rerun the appraisal whenever an agent, its model, or its data changes |## Two Roles at Launch: Penetration Tester and SOC AnalystAI Range Enterprise Edition launches with two cybersecurity roles, both with AI-augmented versions:### Penetration TesterThe agent is tested on its ability to identify vulnerabilities and execute attack strategies in realistic environments. New environments are added regularly as fresh vulnerabilities and attack patterns appear in the wild.### Security Operations Center (SOC) AnalystIn the analyst version, practitioners lean on AI to review alerts in realistic scenarios. Whatever the AI recommends doing next is theirs to evaluate. The grading tests whether a practitioner catches errors in an agent's reasoning and knows when to step in. Holding back is scored as well, based on whether someone lets AI-driven work run when it does not need correcting.This dual scoring, called Agentic Operator Competence, is what makes the platform distinctive. It does not just test the agent. It tests the human who oversees the agent.## The Human Side: Agentic Operator CompetenceFounder and CEO Haris Pylarinos framed the platform around a simple principle. Leaders need "confidence in both sides of the workforce" as AI takes on more cybersecurity tasks.This is an important recognition. The AI agent workforce is not replacing human staff. It is augmenting them, and the quality of that augmentation depends on the human's ability to supervise. An operator who blindly trusts an agent's output is as dangerous as an agent that makes errors. The Agentic Operator Competence scoring catches both failure modes.## From Original AI Range to Enterprise EditionHack The Box launched the original AI Range in December 2025. Since then, AI labs, government customers, and hyperscalers have been testing agents on it, according to the company. The enterprise edition brings the same testing capability to corporate security teams, with each agent appraised against the specific role it has been given.The company is venture capital-backed, having raised $55 million in a Series B round led by The Carlyle Group Inc. in 2023, with Paladin Capital Group and Marathon Venture Capital also participating. Hack The Box reports more than 800 enterprise customers and a community of more than 4 million cybersecurity professionals.AI Range Enterprise Edition and the two AI-augmented roles are available now, with more cybersecurity roles planned for the coming months.## What This Means for Organizations Deploying AI AgentsThe principle behind AI Range Enterprise Edition extends beyond cybersecurity. Any organization deploying AI agents in operational roles should consider:1. Test against real work, not just benchmarks. A benchmark score tells you an agent is capable. It does not tell you the agent is competent in your specific environment.2. Retest when anything changes. When the model, the data, or the agent's configuration changes, competence can drift. Continuous testing catches this.3. Evaluate the human side too. An agent's competence is only half the equation. The human who oversees it needs to know when to trust the agent and when to step in.4. Track over time. A single test is a snapshot. Tracking results across runs reveals whether performance is stable, improving, or degrading.## The Broader Context: Agent Competence as a New Enterprise RequirementThe Hack The Box launch fits a broader pattern in October 2026. As agentic AI moves from experimentation to production, the industry is shifting from building agents to evaluating them. Gartner's 2026 Hype Cycle for Artificial Intelligence, published October 1, says the AI challenge has shifted from building to accountability. ServiceNow argues that AI agents demand a new security model. Palo Alto Networks published guidance on MCP server sprawl and governance. Incognia launched AI Agent Detection to secure autonomous financial transactions on October 6.The common thread: deployment without evaluation is a risk. Hack The Box's contribution is to make that evaluation concrete, role-specific, and repeatable.## Read Next- GEO-VIS: The Six-Dimension Framework That Finally Makes AI Search Visibility Measurable- Cisco WebexOne Dialog: Agentic AI Turns Customer Interactions Into Continuous Relationships- Backbase Conversational Banking: Agentic AI Goes Live at 10+ Banks With Governance Built In- AI Is Giving Attackers a Head Start: What Microsoft's 2026 Digital Defense Report Means for Your Business---Deploying AI agents and need a testing framework? Get in touch and we will help you build a competence evaluation process that fits your business.