How Speech & Visual Cues Are Transforming Human-Robot Teaming

How Speech & Visual Cues Are Transforming Human-Robot Teaming

EXPLORING HUMAN-ROBOT EMOTIONAL INTERACTION WITH OMAR SERGHINI In this episode, Filippo Sanfilippo hosts Omar Serghini, a PhD researcher specializing in speech emotion recognition, spectrum sensing, and neuromorphic cameras, to discuss the future of human-robot teaming. They delve into how emotional awareness through speech and visual cues can transform collaborative AI systems, especially in healthcare and social contexts. KEY TOPICS: * The role of speech-emotional recognition in enhancing human-robot interaction * How prosody and vocal cues inform a robot’s understanding of human emotions * Spectrum sensing as a parallel for decision-making under uncertainty in robotics * The emergence of neuromorphic (event-based) cameras for dynamic scene perception * Moving from static to dynamic interaction through high-temporal-resolution sensors * Building multi-channel emotion recognition integrating speech, vision, and context * Challenges and ethical considerations in developing empathetic machines * Future prospects of AI in healthcare, elderly care, and emergency rescue scenarios * The importance of interdisciplinary collaboration for advancing emotional AI TIMESTAMPS: 00:45 - Introduction to Omar Serghini and his research background 01:31 - The importance of emotional detection in human-robot teaming 02:58 - Speech emotion recognition: what it is and why it matters 05:15 - Using vocal cues like tone and rhythm to gauge confidence and hesitation 06:39 - How emotion detection helps robots adapt behavior and ensure safety 08:07 - The evolution of human-robot interaction from command-based to peer-like relationships 10:09 - Spectrum sensing as a metaphor for decision-making in robotics under uncertainty 12:15 - Robustness in noisy environments: lessons from spectrum sensing applied to robotics 16:11 - The role of neuromorphic (event-based) cameras in real-time emotion perception 17:39 - How event-based vision captures fast, subtle changes for dynamic interaction 22:53 - Integrating multiple sensory channels for a richer understanding of human emotions 25:21 - The potential and limitations of robotic empathy in social and care settings 27:22 - Ethical and cultural considerations in emotion recognition technology 28:47 - Challenges and future directions for emotion-aware AI in healthcare and safety 35:23 - Final thoughts on multidisciplinary collaboration and the future of emotional AI RESOURCES & LINKS: * Serghini, O., Serrano, S., Semlali, H., & Maali, A. (2024, September). Robust DNN-Enabled Cooperative Spectrum Sensing. In 2024 International Conference on Software, Telecommunications and Computer Networks (SoftCOM) (pp. 1-6). IEEE.@ CONNECT WITH OMAR SERGHINI: * LinkedIn [https://www.linkedin.com/in/omar-serghini01/] NOTE: This episode emphasizes the importance of integrating multiple sensory modalities for emotionally intelligent human-robot interactions and highlights ongoing interdisciplinary efforts to bring empathetic AI closer to human behavior.

Human Activity Recognition for Human-Robot Teaming

Insights from Professor Florenc Demrozi. Explore how sensors, AI, and wearable technology are transforming human-robot collaboration, healthcare, and assisted living. Discover the vision of lifelong learning machines and their potential to evolve with us, aiding independence and safety. Key Topics: * Evolution of human-robot interaction from isolation to collaboration * The role of sensors, wearables, and environmental context in human activity recognition * Challenges in data quality, AI modeling, and system safety for healthcare applications * The concept of robots as lifelong companions and lifelong learners * Future scenarios: robots as learning partners, safety enforcers, and co-evolving entities Timestamps: 00:00 - Introduction to human-robot teaming and interview guest Professor Florenc Demrozi 01:16 - The historical transition from isolated robots to collaborative human-robot interaction 02:13 - The progression towards physical collaboration and shared space in human-robot teaming 02:43 - Recognizing human activity and intent through sensing and AI 03:12 - The importance of understanding human status within physical and environmental contexts 04:08 - How ubiquitous sensors and multi-modal data fusion advance healthcare robotics 05:10 - Applications in healthcare: Parkinson’s, Alzheimer’s, disabilities, and aging population challenges 09:17 - Robots in assisted living: coaching, teaching, and digital therapeutics 11:10 - Empowering the elderly: training and maintaining independence with robots 12:40 - Robots as lifelong companions, physical helpers, and co-learners 14:08 - Challenges of trust, reliability, safety, and real-time collaboration in human-robot teaming 15:02 - Controlling and ensuring safety of robots via constraints and innovative actuators 16:00 - Developing intrinsically safe and elastic actuators like human muscles 17:25 - Data quality, sensor noise, and AI model generalization challenges 20:50 - Regulatory hurdles and the necessity of validation for medical applications 21:51 - Generalization across different environments, sensors, and users 23:21 - Envisioning the future: robots as lifelong learning partners and companions 24:25 - The concept of the lifelong learning digital companion evolving with users 26:25 - Knowledge exchange between humans and machines, and eventual AI surpassing human knowledge in specific tasks 27:24 - Digital coaching systems: recognizing and blocking risky behaviors 28:22 - The vision of humans and robots as equal, continuously evolving partners 29:07 - The role of curiosity and ongoing research in advancing human-robot teaming 29:44 - Closing thoughts and a special message for the next generation of researchers Resources & Links: * Florenc Demrozi - University of Stavanger [https://www.uis.no/nb/profile/florenc-demrozi] Connect with Professor Florenc Demrozi: * LinkedIn [https://www.linkedin.com/in/florenc-demrozi-69409493/]

How Snake Robots Could Revolutionize Human-Robot Teaming

In this episode, we delve into innovative research on bio-inspired snake robots and their transformative potential in disaster scenarios. Syed Kumayl Raza Moosavi, a PhD researcher, shares insights on how these modular, adaptable robots can navigate complex terrains, assist first responders, and enhance safety through autonomous aid delivery. KEY TOPICS: 1. The bio-inspired design and modular structure of snake robots 2. Applications in space exploration, search and rescue, and disaster environments 3. How snake robots use terrain-aided locomotion and obstacle-aware navigation (POLl framework) 4. Multi-robot systems integrating UAVs and snake robots for efficient aid delivery 5. Future challenges: terrain adaptability, sensor integration, and real-world deployment 6. Techniques for simulating and optimizing locomotion across varied friction surfaces 7. Vision for human-robot teaming and autonomous decision-making in critical scenarios TIMESTAMPS: 1. (00:46) - Introduction to among us: human-robot teaming in disaster scenarios 2. (01:25) - Why bio-inspired snake robots? Flexibility and navigability benefits 3. (02:24) - Biological traits inspiring robotic design; multi-environment adaptability 4. (03:17) - Unique capabilities of snake robots in space exploration 5. (04:16) - Snake robots in search and rescue: navigating debris and collapsed structures 6. (08:03) - Modular design and skin imitation for terrain adaptability 7. (09:29) - Using snake robots across disaster phases: preparedness, response, recovery 8. (12:27) - Autonomous assessment and aid delivery with heterogeneous robot teams 9. (16:16) - Combining grasping, navigation, and aid dispatch in rescue operations 10. (20:37) - Prototype development challenges: skin mimicking and multi-terrain locomotion 11. (25:45) - Transfer from simulation to real-life deployment: friction and terrain transitions 12. (29:28) - Future of snake robotics in planetary exploration and low-light environments 13. (31:50) - The POLL framework and perception-driven obstacle-aided locomotion 14. (33:17) - Advancing sensory and planning capabilities for complex tasks 15. (34:14) - Collaborative opportunities and upcoming discussions on snake robotics 16. (35:01) - Final reminder and closing remarks RESOURCES & LINKS: 1. Filippo Sanfilippo, Jon Azpiazu, Giancarlo Marafioti, Aksel A. Transeth, Øyvind Stavdahl, and Pål Liljebäck. 2017. "Perception-Driven Obstacle-Aided Locomotion for Snake Robots: The State of the Art, Challenges and Possibilities" Applied Sciences 7, no. 4: 336. https://doi.org/10.3390/app7040336 [https://doi.org/10.3390/app7040336]. 2. Filippo Sanfilippo, Erlend Helgerud, Per Anders Stadheim, and Sondre Lieblein Aronsen. 2019. "Serpens: A Highly Compliant Low-Cost ROS-Based Snake Robot with Series Elastic Actuators, Stereoscopic Vision and a Screw-Less Assembly Mechanism" Applied Sciences 9, no. 3: 396. https://doi.org/10.3390/app9030396 [https://doi.org/10.3390/app9030396]. 3. Filippo Sanfilippo. "Combining grasping with adaptive path following and locomotion for modular snake robots." International Journal of Mechanical Engineering and Robotics Research 11, no. 2 (2022): 59-65. 4. Filippo Sanfilippo, Øyvind Stavdahl, and Pål Liljebäck. "SnakeSIM: A ROS-based rapid-prototyping framework for perception-driven obstacle-aided locomotion of snake robots." In 2017 IEEE International Conference on Robotics and Biomimetics (ROBIO), pp. 1226-1231. IEEE, 2017. 5. Syed Kumayl Raza Moosavi, Muhammad Hamza Zafar, and Filippo Sanfilippo. "Collaborative robots (cobots) for disaster risk resilience: a framework for swarm of snake robots in delivering first aid in emergency situations." Frontiers in Robotics and AI 11 (2024): 1362294. doi: 10.3389/frobt.2024.1362294 [https//10.3389/frobt.2024.1362294]. 6. Askan Duivon, Pino Kirsch, Boris Mauboussin, Gabriel Mougard, Jakub Woszczyk, and Filippo Sanfilippo. "The redesigned serpens, a low-cost, highly compliant snake robot." Robotics 11, no. 2 (2022): 42. 7. Inaki Rañó, A. Gómez Eguíluz, and Filippo Sanfilippo. "Bridging the gap between bio-inspired steering and locomotion: A braitenberg 3a snake robot." In 2018 15th International Conference on Control, Automation, Robotics and Vision (ICARCV), pp. 1394-1399. IEEE, 2018. CONNECT WITH KUMAIL RAZA: 1. LinkedIn [https://www.linkedin.com/in/syed-kumayl-raza-moosavi-38b224125/?originalSubdomain=no] NOTE: For more detailed research papers and collaboration inquiries, visit the research group's official site here [https://filipposanfilippo.inspitivity.com/].

How Passion Will Inspire Advances in Human-Robot Teaming

JOIN US IN THIS INSPIRING EPISODE FEATURING PROFESSOR BRUNO SICILIANO, A PIONEER IN ROBOTICS AND A HIGHLY ESTEEMED IEEE FELLOW. WE EXPLORE HIS INCREDIBLE JOURNEY, THE ROLE OF PASSION IN RESEARCH, AND THE FUTURE OF HUMAN-ROBOT COLLABORATION. DISCOVER HOW SOCCER, CULTURE, AND SCIENTIFIC INNOVATION INTERTWINE TO SHAPE THE NEXT ERA OF ROBOTICS. MAIN TOPICS DISCUSSED: 1. The influence of passion, especially football and culture, on robotics innovation 2. The concept of human-robot teaming and shared autonomy 3. Barriers, standards, and the global landscape of robotics development 4. The ethical and societal implications of technological progress 5. Inspirational advice for future generations of researchers IN THIS EPISODE: 1. Professor Siciliano recounts his lifelong passion for Napoli football and its influence on his creativity 2. Insight into the potential of collaborative autonomy and the balance between control and compliance 3. Examples of unexpected applications of robotics, from fashion industry to surgical tools 4. The importance of cultural, societal, and international perspectives in shaping robotics standards 5. Personal stories of mentorship, international cooperation, and the responsibility of future innovators 6. The vision of a seamless, human-centered future powered by physical AI and hyper-connectivity TIMESTAMPS: 00:00 - Welcome and introduction to Professor Siciliano's impact in robotics 01:13 - The significance of his research and cultural background 02:33 - Passion for football and its influence on engineering creativity 03:43 - The role of adrenaline and emotional engagement in research and teaching 05:03 - The social and cultural insights from stadium visits across Europe 06:44 - Creativity inspired by local city culture and its impact on innovations 09:14 - The story behind the ERC grant and the pizza robot demonstrator 11:44 - Robotics as a societally inspired pursuit rooted in cultural identity 12:45 - The sociological dimension of human-robot interaction in urban environments 13:14 - Gesticulation, cultural behaviors, and AI training datasets 14:43 - The importance of sensory development and education in human evolution 15:42 - Interdisciplinary approaches and cross-fertilization between robotics and other fields 16:09 - Teaching beyond textbooks: inspiring the next generation 18:11 - Student assessments, ethics in education, and the value of understanding concepts 20:14 - The role of AI and accessible knowledge in democratizing robotics 22:29 - The founding of the "Technology Humanism" initiative and societal responsibilities 23:51 - Creativity as a driver for research and the symbolic link to soccer 24:37 - Imagining robots playing soccer and rethinking human-robot interaction 25:14 - Supporting and connecting people across disciplines for innovative collaborations 33:42 - The potential of joint human-robot creative endeavors and storytelling 34:00 - The importance of shared control and the blending roles in human-robot teaming 50:53 - The balance between control, safety, and social acceptability in robots 54:43 - The emerging era of diverse robotic systems beyond humanoids 59:34 - The future of design, control, and integration in robotics 60:00 - The establishment of Stanford’s new Robotics Center and the pillars of modern robotics 61:10 - The four pillars: Knowledge, Design, Interaction, Impact 65:21 - Shared emotions, the human side of robotics, and the euphoria of technological progress 66:15 - Barriers to human-robot teaming and strategies to overcome them 70:38 - Unexpected applications of robotics (surgical, industrial, assistive) 75:29 - Enabling new applications, from virtual guides to assistive devices 79:31 - Rethinking the human-robot relationship and the evolution of “robots” into collaborative partners 82:29 - Standards, regulations, and international differences in robotics development 90:22 - The potential of robotics to bridge cultural and societal gaps 94:08 - The importance of interdisciplinary and international cooperation for future progress 99:50 - Visions of the future: technological, emotional, and societal changes in the next decades 104:37 - The responsibility of today’s scientists and engineers to preserve emotional and cultural legacies 115:41 - Final reflections: inspiring the next generation to dream bigger and collaborate globally RESOURCES & LINKS: 1. Even Falkenberg Langås, Muhammad Hamza Zafar, and Filippo Sanfilippo. "Exploring the synergy of human-robot teaming, digital twins, and machine learning in Industry 5.0: a step towards sustainable manufacturing." Journal of Intelligent Manufacturing 37, no. 3 (2026): 999-1022. https://doi.org/10.1007/s10845-025-02580-x [https://doi.org/10.1007/s10845-025-02580-x]. 2. Filippo Sanfilippo, Timothy Wiley, and Rebekah Rousi. "Robocup soccer autonomy uprising: How crowds, referees, and humanoid robots are redefining the future of human-robot interaction." In 2025 20th ACM/IEEE International Conference on Human-Robot Interaction (HRI), pp. 1131-1139. IEEE, 2025. doi: https://10.1109/HRI61500.2025.10974154 [10.1109/HRI61500.2025.10974154]. 3. Filippo Sanfilippo, Muhammad Hamza Zafar, Timothy Wiley, and Fabio Zambetta. "From caged robots to high-fives in robotics: Exploring the paradigm shift from human–robot interaction to human–robot teaming in human–machine interfaces." Journal of Manufacturing Systems 78 (2025): 1-25. https://doi.org/10.1016/j.jmsy.2024.10.015 [https://doi.org/10.1016/j.jmsy.2024.10.015]. CONNECT WITH PROFESSOR SICILIANO: 1. LinkedIn [https://www.linkedin.com/in/bruno-siciliano-6270832/?originalSubdomain=it] This episode encapsulates the synergy between passion, culture, and scientific curiosity, demonstrating that the future of robotics is fundamentally human-centered and inspired by shared dreams and responsibilities.

Special Episode: European Robotics Forum (ERF) 2026

Recorded live at the European Robotics Forum 2026 in Stavanger, this special episode of Among Us: Human–Robot Teaming takes you inside one of Europe’s most important robotics gatherings—through conversations, demos, and cutting-edge research. This is not theory. This is what robotics actually looks like today. 🎤 WHO YOU’LL HEAR IN THIS EPISODE 🔹 OPENING PERSPECTIVE: THE VISION BEHIND ERF We start with Nabil Belbachir, organizer of ERF, discussing: 1. The strategic direction of robotics in Europe 2. Where industry and research are actually converging 3. Why events like ERF matter beyond networking 🔹 BIO-INSPIRED FLIGHT & FLAPPING DRONES Next, a fascinating discussion with Matěj Karásek from Flapper Drones: 1. How flapping-wing drones differ from traditional UAVs 2. The role of bio-inspired design in robotics 3. Real-world applications where conventional drones fail 🔹 PRECISION HAPTICS & HUMAN INTERACTION We then speak with Marco Aggravi, Project Manager and R&D Engineer at Haption: 1. High-fidelity force feedback systems 2. The role of haptics in teleoperation and training 3. Why touch is still the missing piece in many robotic systems 🔹 LIVE DEMO: IMMERSIVE INTERACTION WITH SENSEGLOVE A hands-on demo with SenseGlove showcases: 1. Real-time haptic feedback in virtual and robotic environments 2. Applications in training, simulation, and remote manipulation 3. The transition from demo tech → deployable systems 🔹 RESEARCH SPOTLIGHT: HUMAN TRAJECTORY PREDICTION The episode concludes with a presentation of the paper: “Transformer-Based Human Trajectory Prediction in Manufacturing Settings” Authored by: 1. Even Langås 2. Atle Aalerud 3. Daniel Hagen 4. Filippo Sanfilippo Key ideas explored: 1. Predicting human motion in industrial environments 2. Using transformer architectures for temporal modeling 3. Improving safety and fluency in human–robot collaboration 🧠 WHAT CONNECTS ALL OF THIS? At first glance, these look like separate topics: 1. Event organization 2. Bio-inspired drones 3. Haptics 4. Wearable interfaces 5. AI-based trajectory prediction They’re not. They all point toward one thing: 👉 Robots that understand, adapt, and physically interact with humans in real environments ⚙️ THE REAL INSIGHT (NO SUGARCOATING) Most robotics systems today: 1. Perceive poorly 2. Predict weakly 3. Interact unnaturally This episode shows what it takes to fix that: 1. Better sensing (event cameras, multimodal systems) 2. Better prediction (transformers, temporal models) 3. Better interaction (haptics, wearable feedback) 🎯 WHO THIS EPISODE IS FOR 1. Robotics researchers and PhD students 2. Engineers working on HRI/HRC systems 3. Anyone serious about moving from demos → deployable systems 🚀 FINAL TAKEAWAY If you want real human–robot teaming, you need to combine: 1. Perception + Prediction + Physical Interaction Miss one—and your system breaks in the real world.