Smart sensing and adaptive reasoning for enabling industrial robots with interactive human-robot capabilities in dynamic environments - a case study

Research output: Contribution to journalArticle

Abstract

Traditional industry is seeing an increasing demand for more autonomous and flexible manufacturing in unstructured settings, a shift away from the fixed, isolated workspaces where robots perform predefined actions repetitively. This work presents a case study in which a robotic manipulator, namely a KUKA KR90 R3100, is provided with smart sensing capabilities such as vision and adaptive reasoning for real-time collision avoidance and online path planning in dynamically-changing environments. A machine vision module based on low-cost cameras and color detection in the hue, saturation, value (HSV) space is developed to make the robot aware of its changing environment. Therefore, this vision allows the detection and localization of a randomly moving obstacle. Path correction to avoid collision avoidance for such obstacles with robotic manipulator is achieved by exploiting an adaptive path planning module along with a dedicated robot control module, where the three modules run simultaneously. These sensing/smart capabilities allow the smooth interactions between the robot and its dynamic environment, where the robot needs to react to dynamic changes through autonomous thinking and reasoning with the reaction times below the average human reaction time. The experimental results demonstrate that effective human-robot and robot-robot interactions can be realized through the innovative integration of emerging sensing techniques, efficient planning algorithms and systematic designs.
LanguageEnglish
Article number1354
Number of pages23
JournalSensors
Volume19
Issue number6
DOIs
Publication statusPublished - 18 Mar 2019

Fingerprint

Industrial robots
Robotics
robots
Reaction Time
Planning Techniques
Robots
modules
collision avoidance
trajectory planning
Industry
Color
robotics
Costs and Cost Analysis
reaction time
human reactions
manipulators
Collision avoidance
Motion planning
robot dynamics
robot control

Keywords

  • adaptive reasoning
  • dynamic environments
  • human-robot interaction
  • path planning
  • Robot control
  • smart sensing

Cite this

@article{96fcb486d0d547939f41825bfe312289,
title = "Smart sensing and adaptive reasoning for enabling industrial robots with interactive human-robot capabilities in dynamic environments - a case study",
abstract = "Traditional industry is seeing an increasing demand for more autonomous and flexible manufacturing in unstructured settings, a shift away from the fixed, isolated workspaces where robots perform predefined actions repetitively. This work presents a case study in which a robotic manipulator, namely a KUKA KR90 R3100, is provided with smart sensing capabilities such as vision and adaptive reasoning for real-time collision avoidance and online path planning in dynamically-changing environments. A machine vision module based on low-cost cameras and color detection in the hue, saturation, value (HSV) space is developed to make the robot aware of its changing environment. Therefore, this vision allows the detection and localization of a randomly moving obstacle. Path correction to avoid collision avoidance for such obstacles with robotic manipulator is achieved by exploiting an adaptive path planning module along with a dedicated robot control module, where the three modules run simultaneously. These sensing/smart capabilities allow the smooth interactions between the robot and its dynamic environment, where the robot needs to react to dynamic changes through autonomous thinking and reasoning with the reaction times below the average human reaction time. The experimental results demonstrate that effective human-robot and robot-robot interactions can be realized through the innovative integration of emerging sensing techniques, efficient planning algorithms and systematic designs.",
keywords = "adaptive reasoning, dynamic environments, human-robot interaction, path planning, Robot control, smart sensing",
author = "Jaime Zabalza and Zixiang Fei and Cuebong Wong and Yijun Yan and Carmelo Mineo and Erfu Yang and Tony Rodden and Jorn Mehnen and Pham, {Quang Cuong} and Jinchang Ren",
year = "2019",
month = "3",
day = "18",
doi = "10.3390/s19061354",
language = "English",
volume = "19",
journal = "Sensors",
issn = "1424-8220",
number = "6",

}

TY - JOUR

T1 - Smart sensing and adaptive reasoning for enabling industrial robots with interactive human-robot capabilities in dynamic environments - a case study

AU - Zabalza, Jaime

AU - Fei, Zixiang

AU - Wong, Cuebong

AU - Yan, Yijun

AU - Mineo, Carmelo

AU - Yang, Erfu

AU - Rodden, Tony

AU - Mehnen, Jorn

AU - Pham, Quang Cuong

AU - Ren, Jinchang

PY - 2019/3/18

Y1 - 2019/3/18

N2 - Traditional industry is seeing an increasing demand for more autonomous and flexible manufacturing in unstructured settings, a shift away from the fixed, isolated workspaces where robots perform predefined actions repetitively. This work presents a case study in which a robotic manipulator, namely a KUKA KR90 R3100, is provided with smart sensing capabilities such as vision and adaptive reasoning for real-time collision avoidance and online path planning in dynamically-changing environments. A machine vision module based on low-cost cameras and color detection in the hue, saturation, value (HSV) space is developed to make the robot aware of its changing environment. Therefore, this vision allows the detection and localization of a randomly moving obstacle. Path correction to avoid collision avoidance for such obstacles with robotic manipulator is achieved by exploiting an adaptive path planning module along with a dedicated robot control module, where the three modules run simultaneously. These sensing/smart capabilities allow the smooth interactions between the robot and its dynamic environment, where the robot needs to react to dynamic changes through autonomous thinking and reasoning with the reaction times below the average human reaction time. The experimental results demonstrate that effective human-robot and robot-robot interactions can be realized through the innovative integration of emerging sensing techniques, efficient planning algorithms and systematic designs.

AB - Traditional industry is seeing an increasing demand for more autonomous and flexible manufacturing in unstructured settings, a shift away from the fixed, isolated workspaces where robots perform predefined actions repetitively. This work presents a case study in which a robotic manipulator, namely a KUKA KR90 R3100, is provided with smart sensing capabilities such as vision and adaptive reasoning for real-time collision avoidance and online path planning in dynamically-changing environments. A machine vision module based on low-cost cameras and color detection in the hue, saturation, value (HSV) space is developed to make the robot aware of its changing environment. Therefore, this vision allows the detection and localization of a randomly moving obstacle. Path correction to avoid collision avoidance for such obstacles with robotic manipulator is achieved by exploiting an adaptive path planning module along with a dedicated robot control module, where the three modules run simultaneously. These sensing/smart capabilities allow the smooth interactions between the robot and its dynamic environment, where the robot needs to react to dynamic changes through autonomous thinking and reasoning with the reaction times below the average human reaction time. The experimental results demonstrate that effective human-robot and robot-robot interactions can be realized through the innovative integration of emerging sensing techniques, efficient planning algorithms and systematic designs.

KW - adaptive reasoning

KW - dynamic environments

KW - human-robot interaction

KW - path planning

KW - Robot control

KW - smart sensing

UR - https://www.mdpi.com/journal/sensors

U2 - 10.3390/s19061354

DO - 10.3390/s19061354

M3 - Article

VL - 19

JO - Sensors

T2 - Sensors

JF - Sensors

SN - 1424-8220

IS - 6

M1 - 1354

ER -