Ep #7: Enterprise AI Field Notes: Live cohort for Evals Careers, AI Trust, Governance + Spicy News!

Ep #8: Enterprise AI Field Notes: Agents at Work, Live Demo, Guardrails + Responsible Innovation

Hosts: Srini Annamaraju [https://www.linkedin.com/in/sriniuk/] & David Royle [https://www.linkedin.com/in/davidroyle/]. Guest: Ravi Ramchandran. [https://www.linkedin.com/in/raviramchandran/] Welcome to episode 8. AI agents are getting easier to build. That’s the exciting bit. The risky bit is that organisations can now create weak, badly governed automations before leadership has worked out what “good” actually looks like. In this episode, Ravi joins Srini and David to pull the conversation out of buzzword-land and into real work. He walks through a practical example of building an agent that turns meeting transcripts into status reports, then digs into what matters underneath: prompt discipline, guardrails, safe experimentation, risk metrics, and why handing people tools without changing operating practice is asking for trouble. The conversation moves from macro AI noise to enterprise reality. How should leaders think about the 70-20-10 split of routine, experimental, and visionary work? Where does human friction still belong? And how do you encourage innovation without creating a quiet flood of low-quality AI output across the firm? What we cover * Macro AI reality check - Why the sensible middle matters more than the hype-or-panic cycle. * Productivity is starting to show up - Early signs of measurable uplift are emerging, even if the landing is still messy. * The 70-20-10 work model - How to cut routine work and create more room for experimentation and higher-order thinking. * Innovation becomes everybody’s job - The barrier to building has dropped so far that innovation can’t stay in a corporate side room. * A live agent example - Ravi demonstrates how meeting transcripts can be turned into weekly status reporting. * Why prompts are not enough - One decent output is not the same as a repeatable capability. * Risk metrics for the AI era - Traditional productivity measures are no longer enough. * A seven-day build plan - Ravi shares a practical way to identify, scope, and build useful agents. Chapters 1. AI noise vs real enterprise adoption 2. Why productivity gains are starting to matter 3. The 70-20-10 model for redesigning work 4. Innovation becomes everybody’s business 5. Live demo: agent for weekly status reports 6. Prompting, grounding, and hallucination risk 7. Guardrails, policy, and engineering practice 8. Risk metrics and trust in production 9. A seven-day framework for useful agents Top-5 Takeaways * Tools alone do not transform organisations * Agents need boundaries, not vibes * AI risk is now operational risk * Safe experimentation needs leadership air cover * Frameworks beat random enthusiasm Who it’s for Enterprise Leaders in all functions inerested in AI adoption. Help Spread the Word Enjoyed the episode? Follow us! Template Takeaways Ravi has kindly shared these two templates he walked us through for general open access. Please feel free to download them from this Google Drive folder. https://drive.google.com/drive/folders/1yKGryaEQ4lM8hLSf1il3jrqbZj4XgHrt?usp=sharing [https://drive.google.com/drive/folders/1yKGryaEQ4lM8hLSf1il3jrqbZj4XgHrt?usp=sharing]

Ep #7: Enterprise AI Field Notes: Live cohort for Evals Careers, AI Trust, Governance + Spicy News!

Hosts: Srini Annamaraju [https://www.linkedin.com/in/sriniuk/] & David Royle [https://www.linkedin.com/in/davidroyle/] “Evals are the weak link in enterprise AI adoption.” And we say it like it is in our Maven cohort Lightning Lesson. Enrol here or see the recording - or join the waitlist for the paid 4-part course (tba): https://shorturl.at/lA9ig [https://shorturl.at/lA9ig] This episode is a proper grilling on AI Evals: what they are, why boards should care, and why “ship it now, eval it later” is how you end up with a quiet disaster. We also do a quick sweep on vendors going more “enterprise-native” (less benchmark theatre, more workflow reality). What we cover * Enterprise AI news: vendors shifting from benchmarks to enterprise workflows * OpenAI’s Enterprise report highlights * UiPath as the “plug-in hybrid” of automation: deterministic RPA meets GenAI via connectors (and why that blend might win) * What evals actually are: accuracy, citations, groundedness, hallucinations * Vendor reality: some push AI first and worry about evals later, others oversell eval tooling. Error analysis still matters * Evals as the connective tissue between value, risk, and operations. Proactive, not post-mortem-after-the-horses-bolted * The EDSO “four hats” operating model (Echo, Delta, Sigma, Omega) and why boards need the Omega translation layer * Maturity and scaling: small firms can fuse hats, even one-person pods for bounded scopes * Agentic future: “checker agents”, Delta agents writing eval harnesses, humans steering fleets of agents * Why SMEs lag, and how eval expectations will percolate through supply chains Chapters * 00:02 Intro: Episode 7, cold UK afternoon, messy middle of enterprise AI * 00:56 AI news: enterprise context is the new battleground * 02:45 OpenAI Enterprise report headlines * 10:16 UiPath, hybrid automation, and the “plug-in hybrid” analogy * 12:53 The grilling starts: what are evals? * 17:02 Is AI risk being exaggerated to sell governance tools? * 19:45 Evals as connective tissue, and why proactive matters * 21:55 The EDSO roles and what “good” looks like * 25:21 Maturity levels and how smaller firms scope it * 26:58 Checker agents and agentic operating models * 28:58 Business case problem: cost vs avoided disaster * 32:14 Evals in SMEs and supply-chain pressure * 33:26 Close: “survived the grilling” Takeaways * Evals are not paperwork. They’re how you keep the value chain connected to operations without risk blowing up later. * Don’t let vendors sell you “tooling-as-a-substitute-for-thinking.” You still need human error analysis and clear accountability. * Treat EDSO as hats, not headcount. Start bounded, prove value, then scale. * Evals is becoming a career lane (think “AI eval controller” the way finance has controllers). * The agentic world will add “checker agents” and automated harness-writing, but humans still steer the system. Who it’s for CIOs, CDOs, CAIOs, Heads of Risk, and anyone trying to ship enterprise AI without quietly lighting their control environment on fire. Also, anyone building a real career edge around AI trust and operational quality.

Ep #6: Enterprise AI Field Notes: Shadow AI, Fwd Deployed Eval Engrs, AI Drift, Board Governance

Hosts: Srini Annamaraju [https://www.linkedin.com/in/sriniuk/] & David Royle [https://www.linkedin.com/in/davidroyle/]. “The AI bubble is the wrong fear.” The real threat sits inside your own walls: shadow AI you don’t see, boards that confuse risk aversion with risk management, and leaders trying to govern a technology they don’t actually understand. We unpack why mid-market boards are exposed, how shadow AI reveals the truth about how your org really works, and what an actually realistic 12-month AI plan looks like. And yes—why people, not models, are now the biggest AI risk vector. The conversation revolves around a recent paper that David authored, a link to the post that has the details is here [https://www.linkedin.com/posts/davidroyle_guiding-ai-strategy-the-boards-imperative-activity-7391871577631608832-_3IA?utm_source=share&utm_medium=member_desktop&rcm=ACoAAAFdNaABIvmIsUfUKUvr8ukvjoIDAxHQRVc]. What we cover 1. Bubble noise vs fundamentals - Valuations swing wildly, but enterprise AI maturity rises daily. We explain why it has nothing to do with the technology reshaping your org. 2. Shadow AI as diagnosis - It’s not a tooling problem but a symptom of mismatched expectations. 3. Boards: from passive listeners to owners - Why literacy is step zero, and why chairs need to move fast. 4. Risk aversion trap - The boards that “get it” flip from “should we?” to “how quickly, safely, and visibly can we?” 5. 90-day governance playbook - Inventory → Validate → Govern. 6. Top-down vs bottom-up AI - How grassroots use cases and board-led operating models collide. 7. 12-month reality check - You won’t be AI-first in a year. But you can be an AI-literate, AI-safe, AI-enabled organisation in 12 months. 8. Explainability anxiety - Why boards demand transparency from AI they never asked of spreadsheets or humans. 9. The uncomfortable truth - The biggest AI risk isn’t the model. It’s your people. 10. Evals preview - Why audits, trust contracts, drift checks, and forward-deployed evaluators will soon be board-level concerns. Chapters * AI bubble vs enterprise fundamentals * Shadow AI as a symptom * Boards falling behind * Risk aversion vs risk management * 90-day governance plan * A realistic 12-month AI horizon * The real AI risk: people * Intro to enterprise evals Takeaways * Shadow AI is a mirror - reveals gaps in culture, process, and leadership direction, not tooling. * Boards must lead, not observe - Active literacy and ownership are key. * Governance is the stabiliser. Inventories, validations, guardrails, and oversight reduce drift & exposure. * Explainability is contextual. Set boundaries, not magic expectations. * People are the attack surface. Don't miss non-malicious misuse. * 12 months = foundations. Literacy, safety, and one high-value use case per function. That’s the win. Who it’s for Board members, CEOs, COOs, CIOs, CROs, and mid-market operators needing a grounded, real-world view of AI risk, governance, and organisational maturity. Help Spread the Word - Enjoyed the episode? Follow the show, leave a review, and share with a colleague grappling with shadow AI, governance gaps, or board-level AI decisions. Want to join as a guest or sponsor a future episode? Get in touch!

Ep #5: Enterprise AI Field Notes: AI Job Shifts, Micro-Creds, Brave New Orgs, AI in SMEs, AgentOps

Hosts: Srini Annamaraju [https://www.linkedin.com/in/sriniuk/] & David Royle [https://www.linkedin.com/in/davidroyle/] “AI kills jobs” is the wrong headline. The real story is structural: org pyramids flatten into diamonds, managers run fleets of agents, SMEs unlock backlogs without hiring sprees, and skills go modular with micro-credentials. We break down what changes now—and how to lead it without face-planting. What we cover * Jobs vs. roles: Why the entry-level layer thins, the manager layer thickens, and how to redesign spans of control when agents do the doing. * Agents on a spectrum: Start with human-in-the-loop, graduate to AgentOps. Where to set autonomy today, what to monitor, and how to keep audits, drift checks, and safety rails sane. * Backlog > headcount: Use AI to attack the work you never had people for—deterministic, high-volume tasks that finally move the needle. * Operational resilience: Outages and dependency chains aren’t hypotheticals. We outline layered BCP/DR for an agentic stack so one failure doesn’t cascade. * Early-career paradox: Apprenticeships still matter—how to select, coach, and rotate juniors in a world with fewer traditional entry roles. * Skills that rise: Cognitive prompting, judgment, people leadership—and why short, role-tied micro-credentials beat semester-long generalities. * SME timing & tactics: Where mid-market buyers actually are on the curve, what to build vs. buy, and how to avoid “pilot purgatory.” Chapters 1. Jobs headline vs ground truth 2. From pyramid to diamond orgs 3. Agents, autonomy, and HITL → AgentOps 4. Managing hybrid teams (humans + agents) 5. Resilience playbook for outages and dependencies 6. Early-career design: apprenticeships, reverse mentoring 7. Micro-credentials and fast upskilling 8. What SMEs should do this quarter Takeaways * Jobs aren’t vanishing; roles are morphing. Plan for fewer juniors, more AI-enabled managers, explicit oversight of agent fleets. * Governance is the unlock. Treat agents like teammates with performance records, audits, and clear escalation paths. * Resilience is strategy. Design for failure before agents touch critical workflows. * Upskill in sprints. Tie micro-credentials to roles, not buzzwords. Who it’s for Operators, CTOs/CIOs, and line leaders who need practical steps to re-shape teams, govern agentic workflows, and build real resilience—especially in SMEs. Help Spread the Word: Enjoyed the episode? Follow the show, leave a quick review, and share with a colleague wrestling with agent governance or workforce design. Interested in joining as a guest or sponsoring a future episode? Get in touch.

Ep #4: Enterprise AI Field Notes: The Big Scaffold, Pilot to Prod, ROI and TCO, Tradeoffs & Payoffs

In this new Enterprise AI Field Notes deep dive, Srini Annamaraju [https://www.linkedin.com/in/sriniuk/] (aka, 'the tech guy') and David Royle [https://www.linkedin.com/in/davidroyle/] (who's 'the business guy') take the story past design into delivery — from the Target Operating Model (TOM) to the everyday reality of running AI inside the enterprise. Through the lens of a real Bank's AI copilot rollout, name changed to "Albion Bank", they map how real transformation happens inside the Enterprise AI Honeycomb — a connected system of data, models, patterns, platforms, and guardrails that must all work in harmony. 💡 What we cover: * Why do most AI “pilots” stall before production — and how to stop the fade? * How data decisions shape every downstream fork in the journey? * What “brains, behaviour, and nervous system” really mean in AI design? * How to build hybrid platforms that stay compliant and fast? * What does it take to shift from ad-hoc prompting to disciplined LLMOps? * Why security, governance, and economics are the body’s immune system and heartbeat? Srini breaks down the technical scaffold — how the ten cells of the honeycomb connect to deliver measurable ROI. David probes rigorously from the business side — questioning trade-offs, accountability, and real-world friction. Together they turn AI from a keynote fantasy into a hard-nosed operating reality.