Spoken language interaction with robots: Recommendations for future research
Matthew Marge,Carol Espy-Wilson,Nigel G. Ward,Abeer Alwan,Yoav Artzi,Mohit Bansal,Gil Blankenship,Joyce Chai,Hal Daumé,Debadeepta Dey,Mary Harper,Thomas Howard,Casey Kennington,Ivana Kruijff-Korbayová,Dinesh Manocha,Cynthia Matuszek,Ross Mead,Raymond Mooney,Roger K. Moore,Mari Ostendorf,Heather Pon-Barry,Alexander I. Rudnicky,Matthias Scheutz,Robert St. Amant,Tong Sun,Stefanie Tellex,David Traum,Zhou Yu
DOI: https://doi.org/10.1016/j.csl.2021.101255
2022-01-01
Abstract:<p>With robotics rapidly advancing, more effective human–robot interaction is increasingly needed to realize the full potential of robots for society. While spoken language must be part of the solution, our ability to provide spoken language interaction capabilities is still very limited. In this article, based on the report of an interdisciplinary workshop convened by the National Science Foundation, we identify key scientific and engineering advances needed to enable effective spoken language interaction with robotics. We make 25 recommendations, involving eight general themes: putting human needs first, better modeling the social and interactive aspects of language, improving robustness, creating new methods for rapid adaptation, better integrating speech and language with other communication modalities, giving speech and language components access to rich representations of the robot's current knowledge and state, making all components operate in real time, and improving research infrastructure and resources. Research and development that prioritizes these topics will, we believe, provide a solid foundation for the creation of speech-capable robots that are easy and effective for humans to work with.</p>
computer science, artificial intelligence