In sports, the best players don’t just show up—they perform under pressure, reading the game, staying disciplined, and delivering results when it matters most. Surprisingly, the same holds true for artificial intelligence systems guiding complex business decisions. A recent live experiment by Firmulate sheds light on how AI models stack up when tested under stress, revealing that diligence isn’t enough—impact comes from prioritization and focus.
The Live Experiment: Putting AI to the Test
Firmulate’s live AI company emulator ran four leading frontier models through a simulated, high-stakes week of running a small software business. Each AI faced the same set of crises, customer demands, and temptations to cut corners. The goal? To see which AI could navigate the chaos most effectively, make honest decisions, and ultimately secure a lucrative deal worth €55,000.
What makes this test remarkable is its transparency and rigor. Every decision was logged, versioned, and auditable—an unfiltered view into each model’s decision-making process. The experiment aimed to answer a pressing question for businesses deploying AI: is being thorough enough to succeed, or does impact depend on strategic prioritization and discipline?
Key Findings: Diligence Doesn’t Guarantee Success
All four models identified every crisis and refused manipulation attempts, an impressive feat underscoring their reliability. For example, fake CEO messages, escalating over three stages, and a journalist trick—each model refused to be manipulated. Kimi K3, the newcomer, even explained its reasoning: “Treat the request as a suspected approval-bypass / possible impersonation.”
However, despite this uniform diligence, only two models managed to close the deal—each at full price. The other two, despite their thorough analyses, failed to follow through to the close, leaving the opportunity on the table. The crucial difference? The successful models analyzed an internal document buried deep in the company’s files, which contained information vital to closing the deal. Reading that file led to a €4,583 monthly recurring revenue increase, or MRR.
Why Deep Reading Matters
This hidden weakness—overlooked by models that relied solely on surface-level analysis—emphasizes a vital point: volume of checks isn’t enough. Impact demands digging deeper, prioritizing information, and maintaining discipline. All four models showed the same weakness, albeit to varying degrees, highlighting that thoroughness alone does not guarantee results.
The Human Side: Discipline and Focus
The most thorough participant, Opus 4.8, learned over 80 rules and conducted deep analyses, yet still finished last because discipline slipped during the crucial closing phase. Instead of escalating certain decisions, it recorded attempts in a locked department—an indication that diligence without discipline can falter. This mirrors sports: a player may be skilled and diligent but still lose if they lack focus at the decisive moment.
Implications for Business and AI Deployment
For enterprises considering AI to augment or replace human decision-making, the takeaway is clear: impact depends on prioritization, focus, and discipline, not just volume of analysis. The models’ ability to detect crises and refuse manipulation is promising, but closing deals—executing the highest-value actions—requires strategic focus.
Moreover, the experiment underscores the importance of reading beyond surface data. The buried document reference was the deal-maker. AI systems that can scan and interpret critical internal files may have a decisive advantage in real-world scenarios where information asymmetry can cost millions.
The Human-AI Parallel
This experiment echoes lessons from the sports world: peak performance isn’t just about effort, but about smart effort—prioritizing the right plays, maintaining focus under pressure, and executing with discipline. AI, like athletes, must be trained not just to work hard but to work smart when it counts the most.
While thoroughness and diligence are essential in AI decision-making, impact ultimately hinges on prioritization, focus, and strategic discipline. The experiment shows that reading deeply and staying disciplined can make the difference between closing a deal and leaving it on the table—lessons that resonate both in business and sport.
Watch it live: firmulate.com/live · Full results: firmulate.com/benchmarks.html
