EP8: Training Models at Scale | AWS for AI Podcast

EP11: BAYZAT Scaling enterprise AI for the workplace | AWS for AI Podcast

Join us for a fascinating deep dive with Ahmed Abdelrahman, Chief Technology Officer at Bayzat, as we explore how AI is revolutionizing human resources and workforce management for over 500,000 employees across the Middle East. Ahmed brings over 20 years of expertise in software development and AI, sharing candid insights on how AI is transforming HR from administrative burden to strategic enabler—and what it means for the future of work. Discover how Bayzat's AI-powered platform is changing the employee experience through instant multilingual support, intelligent policy assistance, and self-service capabilities that free HR professionals to focus on what matters most: people. Learn about the real impact on HR teams—from those worried about job security to technical recruiters who say "this is heaven for me"—and how the shift from 90% administrative work to strategic relationship building is reshaping the profession. Get insider insights on implementing enterprise AI with proper security, achieving 54% accuracy in AI reporting versus 36% for off-the-shelf solutions, and building custom applications in days instead of months. Ahmed shares practical lessons on cost optimization, multi-provider resilience, and the three pillars of AI-enabled organizations: autonomy, psychological safety, and growth mindset. Don't miss this exploration of AI's real-world impact on HR, where we uncover how technology is enhancing—not replacing—the human elements that make great workplaces thrive. Learn more about Bayzat: http://bayzat.com/ Connect with Ahmed : https://www.linkedin.com/in/aabdelrahmanm/ 00:00:00 [https://www.youtube.com/watch?v=69c2DyVK99w&list=PLhr1KZpdzukcfLYNSvftpxp9yn_PC5zP1&index=1] : Episode Introduction 00:02:05 [https://www.youtube.com/watch?v=69c2DyVK99w&list=PLhr1KZpdzukcfLYNSvftpxp9yn_PC5zP1&index=1&t=125s] : Ahmed's Journey into AI: From Egypt to CTO 00:07:19 [https://www.youtube.com/watch?v=69c2DyVK99w&list=PLhr1KZpdzukcfLYNSvftpxp9yn_PC5zP1&index=1&t=439s] : Bayzat's Mission: World-Class Work-Life Platform 00:11:53 [https://www.youtube.com/watch?v=69c2DyVK99w&list=PLhr1KZpdzukcfLYNSvftpxp9yn_PC5zP1&index=1&t=713s] : Inception story to market fit. 00:13:41 [https://www.youtube.com/watch?v=69c2DyVK99w&list=PLhr1KZpdzukcfLYNSvftpxp9yn_PC5zP1&index=1&t=821s] : Early AI Experiments : LLM Context Provider 00:17:46 [https://www.youtube.com/watch?v=69c2DyVK99w&list=PLhr1KZpdzukcfLYNSvftpxp9yn_PC5zP1&index=1&t=1066s] : From PoC to Customer-Facing AI Products 00:19:58 [https://www.youtube.com/watch?v=69c2DyVK99w&list=PLhr1KZpdzukcfLYNSvftpxp9yn_PC5zP1&index=1&t=1198s] : AI Reporting: Text-to-SQL for Enterprise Insights 00:24:08 [https://www.youtube.com/watch?v=69c2DyVK99w&list=PLhr1KZpdzukcfLYNSvftpxp9yn_PC5zP1&index=1&t=1448s] : Bayzat Microapps: AI-Generated Custom Applications 00:30:56 [https://www.youtube.com/watch?v=69c2DyVK99w&list=PLhr1KZpdzukcfLYNSvftpxp9yn_PC5zP1&index=1&t=1856s] : Personalized Agents Marketplace 00:32:35 [https://www.youtube.com/watch?v=69c2DyVK99w&list=PLhr1KZpdzukcfLYNSvftpxp9yn_PC5zP1&index=1&t=1955s] : Managing Agents at Scale. 00:36:43 [https://www.youtube.com/watch?v=69c2DyVK99w&list=PLhr1KZpdzukcfLYNSvftpxp9yn_PC5zP1&index=1&t=2203s] : Building AI Resiliency: Multi-Vendor Strategy 00:38:32 [https://www.youtube.com/watch?v=69c2DyVK99w&list=PLhr1KZpdzukcfLYNSvftpxp9yn_PC5zP1&index=1&t=2312s] : Models lifecycle managment 00:39:46 [https://www.youtube.com/watch?v=69c2DyVK99w&list=PLhr1KZpdzukcfLYNSvftpxp9yn_PC5zP1&index=1&t=2386s] : Evaluation Strategies: LLM-as-Judge 00:42:50 [https://www.youtube.com/watch?v=69c2DyVK99w&list=PLhr1KZpdzukcfLYNSvftpxp9yn_PC5zP1&index=1&t=2570s] : Selecting The Right Model 00:45:32 [https://www.youtube.com/watch?v=69c2DyVK99w&list=PLhr1KZpdzukcfLYNSvftpxp9yn_PC5zP1&index=1&t=2732s] : How to Build AI Ready Organizations 00:49:11 [https://www.youtube.com/watch?v=69c2DyVK99w&list=PLhr1KZpdzukcfLYNSvftpxp9yn_PC5zP1&index=1&t=2951s] : Team Autonomy 00:51:34 [https://www.youtube.com/watch?v=69c2DyVK99w&list=PLhr1KZpdzukcfLYNSvftpxp9yn_PC5zP1&index=1&t=3094s] : HR Professionals and AI 00:54:05 [https://www.youtube.com/watch?v=69c2DyVK99w&list=PLhr1KZpdzukcfLYNSvftpxp9yn_PC5zP1&index=1&t=3245s] : AI impact on the workplace 00:56:05 [https://www.youtube.com/watch?v=69c2DyVK99w&list=PLhr1KZpdzukcfLYNSvftpxp9yn_PC5zP1&index=1&t=3365s] : The Value of Building an AWS Partnership 00:58:29 [https://www.youtube.com/watch?v=69c2DyVK99w&list=PLhr1KZpdzukcfLYNSvftpxp9yn_PC5zP1&index=1&t=3509s] : The future of AI is Agentic 01:02:32 [https://www.youtube.com/watch?v=69c2DyVK99w&list=PLhr1KZpdzukcfLYNSvftpxp9yn_PC5zP1&index=1&t=3752s] : Closing Remarks and Resources

EP10: Agentic Twins and The Foundations of Physical AI | AWS for AI Podcast

Join us for a fascinating deep dive with Ali Benfattoum, AWS Principal Product Manager and Physical AI expert, as we explore the revolutionary world of agentic twins and the foundations of physical AI. Ali brings over 15 years of expertise in IoT, Applied AI, and Digital Twins, including his groundbreaking work as creator of the open-source Garnet Framework. Discover how AI is evolving beyond digital realms into physical applications, transforming everything from smart cities to industrial systems. Learn about the intersection of IoT and AI, the power of knowledge graphs in creating context-aware solutions, and how digital twins are enabling intelligent, responsive environments across major cities and global enterprises. Get insider insights on semantic data modeling, context management strategies, and the practical implementation of living digital twins. Ali shares his unique perspective bridging mathematics, physics, and cutting-edge AI technology, offering a comprehensive view of where Physical AI is heading and how it's reshaping our interaction with the physical world. Don't miss this technical exploration where we uncover real-world applications of agentic systems and the infrastructure powering the next generation of intelligent physical environments. Garnet Framework: https://garnet-framework.tech/ [https://garnet-framework.tech/] Learn more: https://aws.amazon.com/iot/ [https://aws.amazon.com/iot/] Chapters: 0:00:00 : Episode Introduction 0:02:37 : Ali's Journey to Physical AI and IoT 0:05:35 : From smart territory framework to physical AI 0:08:00 : The Garnet Framework : From data silos to insights 0:12:02 : Building with the garnet framework 0:14:58 : AI Agents as Data Consumers 0:18:02 : Knowledge graphs for true context aware AI 0:22:12 : NGSI-LD specification 0:24:20 : Sustainable AI foundations for the future 0:26:57 : Physical AI : perceive reason act in real world 0:29:35 : Use Cases with the most impact 0:32:48 : Maximizing ROI of using physical AI. 0:39:09 : Next generation of automated industry 0:40:08 : Panama Success Stories 0:42:30 : City of Madrid Success Story 0:43:43 : From digital twins to agentic twins 0:47:06 : Training world models , nvidia omniverse 0:50:47 : Build today for tomorrow’s innovations on AWS 0:55:15 : Future Trends in Agentic Systems 0:58:46 : Final Thoughts 1:00:02 : Closing Remarks

EP9: Lucidya : AI For Enhanced Customer Experience and Social Listening | AWS for AI Podcast

Join us for an in-depth conversation with Dr. Zuhair Khayat, CTO and co-founder of Lucidya, a groundbreaking AI company revolutionizing customer experience in the Middle East. From his journey through academia at KAUST to pioneering Arabic language AI solutions, Dr. Khayat shares invaluable insights on building technology for Arabic markets. Discover how Lucidya is tackling unique challenges in Arabic language processing, managing customer experience across dialects, and leveraging AI for brand management in the MENA region. Learn how Lucidya is transforming social listening and customer intelligence through advanced AI. From sophisticated sentiment analysis to real-time brand monitoring across multiple dialects, discover the future of customer experience management. Learn more: http://go.aws/47yubYq [https://www.youtube.com/redirect?event=video_description&redir_token=QUFFLUhqbFNCalRoeVRTdWROLW80LVA4MzMyYktfbjJPd3xBQ3Jtc0tsLXg3cW9oQ2JES1ltV0JScThlRDlLVGVIel9GSWJkRXpqM1NVaHRmbUl0TVFhU0ZKcWRQQTFXeFkyU1I1SHNaMEdPbmhxbzlFYWpDMTdDcUh2WGEwMENYcUpES2JQUGhYUnRWT0dodDNRQW54T295Zw&q=http%3A%2F%2Fgo.aws%2F47yubYq&v=-f6ylJ9R7sc] Lucidya Website: http://go.aws/4846zeH [https://www.youtube.com/redirect?event=video_description&redir_token=QUFFLUhqbWJmWDcxY1JWampOd2NyaHdHOVpQSGZIUS12d3xBQ3Jtc0tuTXJWQ0QyOWJ0WUZybmIxUzJUeXNNazFseU11NzZya2R6dkFCcEdyNjNaWGcxU0h4X2VpQURsUnRJdUxoYTVlWHJFMnUwQzRPREo1NmF3NXpwVUlmbjhQdkxmVUhDaWcxNnZ5S01qVU1RWDAwd2RUdw&q=http%3A%2F%2Fgo.aws%2F4846zeH&v=-f6ylJ9R7sc] Dr. Khayat's Research: https://scholar.google.com/citations?... [https://www.youtube.com/redirect?event=video_description&redir_token=QUFFLUhqbEpWMWlVMlExM19XSHJQMXpvWmZNaGRvRDNXZ3xBQ3Jtc0tsVHdIRzJIbkR0Q2hiMHFWMklsendVMjNJLWRXYmx5OFBCVXY0bW1IcVEtSU4weGJZSFJ0aDVCYjl2V0xvSm5jdGQ5Ym5welRNT19jWW5rX1daZDFHYU10cVJNZy14S1I4bk9yUHJLd0gwTUs4NUFZdw&q=https%3A%2F%2Fscholar.google.com%2Fcitations%3Fuser%3Dv4RoDV0AAAAJ%26hl%3Den&v=-f6ylJ9R7sc] Chapters: 00:00 [https://www.youtube.com/watch?v=-f6ylJ9R7sc&list=PLhr1KZpdzukcfLYNSvftpxp9yn_PC5zP1&index=1] - Introduction 02:27 [https://www.youtube.com/watch?v=-f6ylJ9R7sc&list=PLhr1KZpdzukcfLYNSvftpxp9yn_PC5zP1&index=1&t=147s] - Lucidya's Origin Story 05:20 [https://www.youtube.com/watch?v=-f6ylJ9R7sc&list=PLhr1KZpdzukcfLYNSvftpxp9yn_PC5zP1&index=1&t=320s] - AI startup vision before GenAI 07:30 [https://www.youtube.com/watch?v=-f6ylJ9R7sc&list=PLhr1KZpdzukcfLYNSvftpxp9yn_PC5zP1&index=1&t=450s] - From Saudi Arabia to the world. 08:11 [https://www.youtube.com/watch?v=-f6ylJ9R7sc&list=PLhr1KZpdzukcfLYNSvftpxp9yn_PC5zP1&index=1&t=491s] - Lucidya’s Long Term Mission 08:59 [https://www.youtube.com/watch?v=-f6ylJ9R7sc&list=PLhr1KZpdzukcfLYNSvftpxp9yn_PC5zP1&index=1&t=539s] - What is Customer Experience ? 10:55 [https://www.youtube.com/watch?v=-f6ylJ9R7sc&list=PLhr1KZpdzukcfLYNSvftpxp9yn_PC5zP1&index=1&t=655s] - Lucidya’s Value Proposition 12:18 [https://www.youtube.com/watch?v=-f6ylJ9R7sc&list=PLhr1KZpdzukcfLYNSvftpxp9yn_PC5zP1&index=1&t=738s] - Use Cases : Brand Managment 17:20 [https://www.youtube.com/watch?v=-f6ylJ9R7sc&list=PLhr1KZpdzukcfLYNSvftpxp9yn_PC5zP1&index=1&t=1040s] - Use Cases : Customer Support 19:14 [https://www.youtube.com/watch?v=-f6ylJ9R7sc&list=PLhr1KZpdzukcfLYNSvftpxp9yn_PC5zP1&index=1&t=1154s] - Use Cases : Market Research 20:43 [https://www.youtube.com/watch?v=-f6ylJ9R7sc&list=PLhr1KZpdzukcfLYNSvftpxp9yn_PC5zP1&index=1&t=1243s] - Use Cases : Marketing Optimization 21:52 [https://www.youtube.com/watch?v=-f6ylJ9R7sc&list=PLhr1KZpdzukcfLYNSvftpxp9yn_PC5zP1&index=1&t=1312s] - Building Products in GenAI Era 25:58 [https://www.youtube.com/watch?v=-f6ylJ9R7sc&list=PLhr1KZpdzukcfLYNSvftpxp9yn_PC5zP1&index=1&t=1558s] - Keeping up with the AI innovations 26:45 [https://www.youtube.com/watch?v=-f6ylJ9R7sc&list=PLhr1KZpdzukcfLYNSvftpxp9yn_PC5zP1&index=1&t=1605s] - Product bundles from Research to Support 28:50 [https://www.youtube.com/watch?v=-f6ylJ9R7sc&list=PLhr1KZpdzukcfLYNSvftpxp9yn_PC5zP1&index=1&t=1730s] - Evolution of Challenges for Building AI Models 30:18 [https://www.youtube.com/watch?v=-f6ylJ9R7sc&list=PLhr1KZpdzukcfLYNSvftpxp9yn_PC5zP1&index=1&t=1818s] - ASAD - Arabic Sentiment Analysis Data 31:22 [https://www.youtube.com/watch?v=-f6ylJ9R7sc&list=PLhr1KZpdzukcfLYNSvftpxp9yn_PC5zP1&index=1&t=1882s] - Navigating Ambiguity in Human Communications 33:40 [https://www.youtube.com/watch?v=-f6ylJ9R7sc&list=PLhr1KZpdzukcfLYNSvftpxp9yn_PC5zP1&index=1&t=2020s] - Managing Biases in Data with agents 38:02 [https://www.youtube.com/watch?v=-f6ylJ9R7sc&list=PLhr1KZpdzukcfLYNSvftpxp9yn_PC5zP1&index=1&t=2282s] - Arabic Dialects Support 40:41 [https://www.youtube.com/watch?v=-f6ylJ9R7sc&list=PLhr1KZpdzukcfLYNSvftpxp9yn_PC5zP1&index=1&t=2441s] - Split Learning, Collaborative Training on Private Data on the Cloud. 47:10 [https://www.youtube.com/watch?v=-f6ylJ9R7sc&list=PLhr1KZpdzukcfLYNSvftpxp9yn_PC5zP1&index=1&t=2830s] - Opportunities for Split Learning in Regulated Industries 49:35 [https://www.youtube.com/watch?v=-f6ylJ9R7sc&list=PLhr1KZpdzukcfLYNSvftpxp9yn_PC5zP1&index=1&t=2975s] - U shape Learning as a Collaborative Framework for Privacy 50:12 [https://www.youtube.com/watch?v=-f6ylJ9R7sc&list=PLhr1KZpdzukcfLYNSvftpxp9yn_PC5zP1&index=1&t=3012s] - a CTO’s advise for AI startups 53:20 [https://www.youtube.com/watch?v=-f6ylJ9R7sc&list=PLhr1KZpdzukcfLYNSvftpxp9yn_PC5zP1&index=1&t=3200s] - Choosing the right architecture on AWS for your team 55:45 [https://www.youtube.com/watch?v=-f6ylJ9R7sc&list=PLhr1KZpdzukcfLYNSvftpxp9yn_PC5zP1&index=1&t=3345s] - The Future of AI. 58:06 [https://www.youtube.com/watch?v=-f6ylJ9R7sc&list=PLhr1KZpdzukcfLYNSvftpxp9yn_PC5zP1&index=1&t=3486s] - Closing Remarks

EP8: Training Models at Scale | AWS for AI Podcast

Join us for an enlightening conversation with Anton Alexander, AWS's Senior Specialist for Worldwide Foundation Models, as we delve into the complexities of training and scaling large foundation models. Anton brings his unique expertise from working with the world's top model builders, along with his fascinating journey from Trinidad and Tobago to becoming a leading AI infrastructure expert. Discover practical insights on managing massive GPU clusters, optimizing distributed training, and handling the critical challenges of model development at scale. Learn about cutting-edge solutions in GPU failure detection, checkpointing strategies, and the evolution of inference workloads. Get an insider's perspective on emerging trends like GRPO, visual LLMs, and the future of AI model development. Don't miss this technical deep dive where we explore real-world solutions for building and deploying foundational AI models, featuring discussions on everything from low-level infrastructure optimization to high-level AI development strategies. Learn more: http://go.aws/47yubYq [http://go.aws/47yubYq] Amazon SageMaker HyperPod : https://aws.amazon.com/fr/sagemaker/ai/hyperpod/ [https://aws.amazon.com/fr/sagemaker/ai/hyperpod/] The Llama 3 Herd of Models paper : https://arxiv.org/abs/2407.21783 [https://arxiv.org/abs/2407.21783] Chapters: 00:00:00 : Introduction and Guest Background 00:01:18 : Anton Journey from Caribbean to AI 00:05:52 : Mathematics in AI 00:07:20 : Large Model Training Challenges 00:09:54 : GPU failures : Lama Herd of models 00:13:40 : Grey failures 00:15:05 : Model training trends 00:17:40 : Managing Mixture of Experts Models 00:21:50 : Estimate how many GPUs you need. 00:25:12 : Monitoring loss function 00:27:08 : Crashing trainings 00:28:10 : SageMaker Hyperpod story 00:32:15 : How we automate managing grey failures 00:37:28 : which metrics to optimize for 00:40:23 : Checkpointing Strategies 00:44:48 : USE Utilization, Saturation, Errors 00:50:11 : SageMaker Hyperpod for Inferencing 00:54:58 : Resiliency in Training vs Inferencing workloads 00:56:44 : NVIDIA NeMo Ecosystem and Agents 00:59:49 : Future Trends in AI 01:03:17 : Closing Thoughts

EP7: Next Generation Developers | AWS for AI Podcast

Join us as we sit down with AWS Solutions Architect Mirabela Dan for a journey into the world of generative AI for developers. Whether you're a seasoned developer or just getting started, this episode is your gateway to staying ahead in the AI revolution. Discover: the game-changing shift from "vibe coding" to spec-driven development and learn about the latest AWS AI tools that can supercharge your productivity. Get real-world insights on how AI is reshaping the developer landscape and plan essential strategies to future-proof your development career Don't miss this power-packed episode where we demystify the intersection of AI and modern development practices. Get ready to transform the way you build with AWS's innovative AI solutions! Learn more: https://aws.amazon.com/ai/ [https://aws.amazon.com/ai/] and https://kiro.dev/ [https://kiro.dev/] Connect with Mirabela: https://www.linkedin.com/in/carmenmirabeladan/ [https://www.linkedin.com/in/carmenmirabeladan/] Chapters 0:00:00 : Introduction and Guest Background 0:02:48 : Mirabela's Journey at AWS 0:05:38 : Working with Different Customer Types 0:08:52 : Shift from Infrastructure to AI 0:09:35 : Evolution of Developer Role with AI 0:15:49 : Challenges in Developing with AI 0:20:06 : AI for Code Generation vs Maintenance 0:28:33 : Spec-Driven Development Approach 0:39:30 : Balancing Planning vs Rapid Delivery 0:42:23 : Kiro - AWS AI-Powered IDE 0:44:46 : MCP Integration 0:46:10 : Agent Steering and Hooks 0:54:43 : Code Transformation with AI 0:55:57 : Future of Developer Role 0:59:55 : Consuming AI/Tech Updates 1:00:17 : Personal Learning Methods 1:01:30 : Optimism for Future of Development 1:02:34 : Closing Remarks