Towards explanations of plan execution for human-robot teaming

Jiyoun Moon, Daniele Magazzeni, Michael Cashmore, Dorian Buksz, Beom-Hee Lee, Yong-Seon Moon, Sang-Hyun Roh

Research output: Chapter in Book/Report/Conference proceedingConference contribution book

1 Downloads (Pure)

Abstract

Human-robot teaming is inevitable in various applications ranging from manufacturing to field robotics because of the advantages of adaptability and high flexibility. To become an effective team, knowledge regarding plan execution needs to be shared by verbalization. In this respect, semantic scene understanding in natural language is one of the most fundamental components for information sharing between humans and heterogeneous robots, as robots can perceive the surrounding environment in a form that both humans and other robots can understand. In this paper, we introduce semantic scene understanding methods for verbalization of plan execution. We generate sentences and scene graphs, which is a natural language grounded graph over the detected objects and their relationships, with the graph map generated using a robot mapping algorithm. Experiments were performed to verify the effectiveness of the proposed methods.
Original languageEnglish
Title of host publicationSDMM19 : 1st International Workshop on the Semantic Descriptor, Semantic Modeling and Mapping for Humanlike Perception and Navigation of Mobile Robots toward Large Scale Long-Term Autonomy
Place of PublicationGermany
Pages58-64
Number of pages7
Volume2487
Publication statusPublished - 8 Nov 2019
EventInternational Workshop on the Semantic Descriptor, Semantic Modeling and Mapping for Humanlike Perception and Navigation of Mobile Robots toward Large Scale Long-Term Autonomy - Macau, China
Duration: 8 Nov 2019 → …
http://ceur-ws.org/Vol-2487/

Workshop

WorkshopInternational Workshop on the Semantic Descriptor, Semantic Modeling and Mapping for Humanlike Perception and Navigation of Mobile Robots toward Large Scale Long-Term Autonomy
Abbreviated titleSDMM
Country/TerritoryChina
CityMacau
Period8/11/19 → …
Internet address

Keywords

  • human-robot teaming
  • robotics
  • Artificial Intelligence (AI)
  • plan execution

Fingerprint

Dive into the research topics of 'Towards explanations of plan execution for human-robot teaming'. Together they form a unique fingerprint.

Cite this