Research Physical Human–Robot Interaction

Mechatronics 2022pHRI · Subtask recognition

An adaptive admittance controller for collaborative drilling with a robot based on subtask classification via deep learning

Berk Guler, Pouya P. Niaz, Alireza Madani, Yusuf Aydin, Cagatay Basdogan

Mechatronics, vol. 86, p. 102851, 2022

Rendering of the setup with a KUKA cobot, a drill with handle and two force sensors, a human operator, and a workpiece
Setup with the cobot, drill, handle, human and interaction force sensors, and workpiece.

In this paper, we propose a supervised learning approach based on an Artificial Neural Network (ANN) model for real-time classification of subtasks in a physical human-robot interaction (pHRI) task involving contact with a stiff environment. In this regard, we consider three subtasks for a given pHRI task: Idle, Driving, and Contact. Based on this classification, the parameters of an admittance controller that regulates the interaction between human and robot are adjusted adaptively in real time to make the robot more transparent to the operator (i.e. less resistant) during the Driving phase and more stable during the Contact phase. The Idle phase is primarily used to detect the initiation of task. Experimental results have shown that the ANN model can learn to detect the subtasks under different admittance controller conditions with an accuracy of 98% for 12 participants. Finally, we show that the admittance adaptation based on the proposed subtask classifier leads to 20% lower human effort (i.e. higher transparency) in the Driving phase and 25% lower oscillation amplitude (i.e. higher stability) during drilling in the Contact phase compared to an admittance controller with fixed parameters.

Block diagram of the closed-loop system: admittance controller, robot, human operator, environment, neural network, subtask processor and adaptation mechanism
Closed-loop control: the network's subtask label drives the adaptation of the admittance parameters.

My contributions

  • Developed the control architecture that regulates human-robot physical interaction through an admittance controller on the KUKA iiwa cobot.
  • Performed a linear time-varying stability analysis of the pHRI system.
  • Developed the deep-learning subtask classifier in Python with TensorFlow.
  • Developed the methods that adapt the admittance parameters from the classifier's output.
  • Built a C# GUI to read and record data from ATI force/torque sensors.
  • Designed the pHRI experiments, collected the data, and performed the statistical analysis.
Force/torque sensor application showing live readings from two ATI sensors
The sensor application I wrote for live reading and recording of two ATI force/torque sensors.