Stop Using AI for Everything

In this episode of "Full Tech Ahead," host Amanda Razani interviews Federico Ramallo, Founder and CEO of Density Labs. They examine the realities of AI engineering, focusing on business outcomes and managing total cost of ownership (TCO) as token consumption surges.

Ramallo addresses why roughly 95% of enterprise AI pilots fail to reach production, citing over-reliance on idealized demo scenarios, uncontrolled complexity, and treating AI purely as a software purchase rather than an organizational transformation.

To deploy non-deterministic AI agents reliably, Density Labs utilizes Eval LLMs, employing an independent secondary model to evaluate the primary model's execution decisions as a "second opinion."

Paradoxically, Ramallo advocates using as little AI as possible: writing deterministic, traditional code for rule-based workflows and reserving costly LLM calls only as a fallback for subjective, intuitive tasks.

Finally, he outlines new cybersecurity threats, including prompt-based phishing designed specifically to deceive AI agents.

Key Quotes

"Roughly ninety-five percent of enterprise AI pilots never reach production... The main reason is that they test the demo with the best case scenario, and then they don't consider all the use cases."

"Even though I am advocating for the use of AI, I believe that using as little AI as possible is the best approach."

"Think of AI as a new hire that doesn't have accountability... no agent, no model can be accountable for anything. Only humans can."

Takeaways

Code the Deterministic, Model the Intuitive: Do not use AI agents to automate entire business workflows blindly. Build standard, deterministic software code for rule-based mathematical steps (which are cheaper, faster, and easier to test), and restrict non-deterministic AI models to subjective tasks like sentiment analysis as a fallback to optimize token costs.

Implement "Eval LLMs" for Second Opinions: AI models executing operational actions produce non-deterministic outputs. To prevent autonomous errors from propagating, companies should deploy a separate evaluation model to audit decisions before execution, avoiding the echo-chamber risk of a single model evaluating its own work.

Code Craftsmanship vs. Disposable Software: AI models struggle with complex architectural abstractions, often generating lower-quality code than senior human engineers. However, software development is shifting: long-term code craftsmanship is becoming less critical as agentic tooling makes regenerating and replacing code faster and cheaper, provided specifications are hyper-detailed.

Defend Against "Agent Phishing": Threat actors now use autonomous agents capable of bypassing traditional CAPTCHAs and behavioral heuristics. Furthermore, attack vectors have evolved from human-targeted phishing to malicious payloads, links, and emails engineered specifically to trick autonomous AI agents into executing unauthorized actions.