AIThis post was created with the assistance of artificial intelligence (AI).
Firmulate — The AI That Wrote 80 Rules and Lost the Deal Anyway
Live on firmulate.com.

Imagine hiring an AI that’s so diligent it memorizes over 80 rules and analyzes every detail — only to watch it lose a simple deal. In today’s fast-paced business world, volume and effort don’t always translate to impact. Just like selecting the right pool cleaner or water feature, choosing the best AI requires more than just thoroughness. It’s about prioritization, trust, and strategic focus.

Before you orderOffer from Amazon

Get pool and patio gear delivered free with Prime

  • Fast, free delivery on millions of items
  • Prime Video, Amazon Music and more included
  • Member-only deals all year
Start your free Prime trial Free trial for eligible customers · Cancel anytime
As an affiliate, we earn on qualifying purchases.

Testing AI in a Real-World Business Simulation

Firmulate conducted a unique live experiment involving four leading AI models, each tasked with managing a small software company during its worst week. The scenario simulated real crises, customer demands, and tempting manipulations — all designed to challenge the AI’s decision-making processes. Every move was recorded, versioned, and auditable, ensuring transparency and accuracy.

Products Worth Considering

Greenworks 48V Brushless 3-in-1 Leaf Blower, Vacuum, and Mulcher with Two 4.0Ah Batteries

Greenworks 48V Brushless 3-in-1 Leaf Blower, Vacuum, and Mulcher with Two 4.0Ah Batteries

Orbit B-hyve XR 8-Zone Indoor/Outdoor Smart Sprinkler Controller

Orbit B-hyve XR 8-Zone Indoor/Outdoor Smart Sprinkler Controller

As an affiliate, we earn on qualifying purchases.

Performance Scores and Key Findings

The results reveal a clear hierarchy: the top performers scored 95 and 93, while the lower-ranked models scored 88 and 77. The highest scorer, gpt-5.6-sol, identified critical hidden information in the company files and secured a €55,000 deal, representing a full recovery of the company’s potential. The second-place model, Kimi K3, also closed the deal but with slightly less discipline. Meanwhile, the third and fourth models managed to close but with noticeable slips in process discipline.

The Hidden Weakness: Information Access

Interestingly, the decisive advantage held by the top models resided in their ability to read deep into the company’s documents — two references deep, revealing crucial facts that others missed. This demonstrates that attention to detail and thorough information retrieval can make or break a deal, even in a simulated environment.

Refusing Manipulation — A Sign of Integrity

All four models successfully rejected attempts at social engineering, including staged CEO messages and a reporter trick. Kimi K3 explicitly reasoned that such requests could be impersonation attempts, showcasing an understanding of potential risks beyond surface-level responses. This level of authenticity is vital for AI systems operating in sensitive business environments.

The Real-World Business Environment

The experiment was set within an active, publicly observable company with 13 synthetic employees, handling real money mechanics and burning €105,000 monthly against a modest €2,300 monthly revenue. Every day, the models were tested with evolving scenarios, and their decisions recorded and analyzed. This ongoing, transparent approach helps companies understand whether an AI is ready for deployment, not just whether it can produce impressive chat responses.

The Limitations of Diligence Alone: The Opus 4.8 Case Study

The most detailed participant, Opus 4.8, with over 80 learned rules and deep analysis, still finished last in the experiment. Its failure stemmed from neglecting closing discipline — the AI failed to escalate critical issues into the right departments, leaving potential deals on the table. This pattern persisted across all models to some degree, indicating that volume of rules and analysis doesn’t guarantee effectiveness if core priorities and discipline are not maintained.

Implications for Business AI Adoption

For businesses considering AI integration, the takeaway is clear: performance isn’t just about thoroughness or rule-following. It’s about strategic focus, trustworthiness, and the ability to prioritize critical tasks under pressure. AI that can read deeply, refuse manipulation, and uphold discipline is more likely to drive meaningful results.

Try It Yourself

Firmulate offers enterprises the chance to run their own internal wargames, simulating real crises and decision points without risking actual operations. These tests can help identify whether an AI system will perform reliably when it counts. Visit firmulate.com/pilot.html to learn more about how to prepare your AI workforce.

Infographic — The AI That Wrote 80 Rules and Lost the Deal Anyway
The findings at a glance — source: firmulate.com.

Thoroughness in AI doesn’t guarantee impact. Prioritization, discipline, and the ability to read deeply into your business data are key. Real-world testing reveals which AI models can truly deliver results — not just generate impressive chat.

Watch it live: firmulate.com/live · Full results: firmulate.com/benchmarks.html

Powered by Thorsten Meyer AI


You May Also Like

This Compact Meaco Dehumidifier Does More Than Tackle Condensation – And Costs Just 4P An Hour To Run

An Ideal Home test found the Meaco 12L dehumidifier reduced humidity and helped dry laundry. It is rated at 4p an hour to run, with some usability drawbacks.

Make Summer Sweet with Ninja NC701 CREAMi Swirl Ice Cream Maker

Create delicious soft serve and frozen treats effortlessly with the Ninja NC701 CREAMi Swirl for a perfect summer patio dessert.

Beat the Summer Heat with the Ninja Foodi 10 Quart DualZone Air Fryer

Enjoy easy, healthy summer meals with the Ninja Foodi 10 Quart DualZone Air Fryer—perfect for family-sized dishes and outdoor entertaining.

Enjoy Summer Brunches with the Ninja Belgian Waffle Maker Pro

Discover if now’s the time to buy the Ninja Belgian Waffle Maker Pro for perfect summer mornings or wait for Prime Day deals.