| Author: | Ma, Wanyu |
| Title: | Reactive task planning for robotic sequential manipulation of rigid/soft objects |
| Advisors: | Navarro-Alarcon, David (ME) |
| Degree: | Ph.D. |
| Year: | 2024 |
| Subject: | Human-robot interaction Robots -- Control systems Hong Kong Polytechnic University -- Dissertations |
| Department: | Department of Mechanical Engineering |
| Pages: | xx, 144 pages : color illustrations |
| Language: | English |
| Abstract: | The recent emergence of Industry 5.0 demands increased efforts towards intelligent, human-machine collaborative, sustainable, resilient production, requiring the system to implement varying levels of autonomy in all forms of human-robot interaction (HRI). Motivated by this manufacturing demand, the development of sequential manipulation tasks under both fully automatic mode and human-aware mode is an important research problem. To develop efficient solutions to automate complex robotic tasks, this work takes the packing of long linear elastic objects into common-size boxes as a case of study, where a new action planning approach for sequential manipulation is proposed. To achieve this, a hybrid geometric model is developed to handle large-scale occlusions combining an online vision-based method and an offline reference template. Then, an optimal packing strategy is designed to properly select a shape-box pair from a library of prior knowledge. Next, a reference point generator is introduced to automatically plan the target poses for the pre-designed action primitives. Finally, an action planner integrates these components enabling the execution of high-level behaviors and the accomplishment of complex packing manipulation tasks. To validate the proposed approach, a detailed experimental study is conducted with multiple types and lengths of objects and packing boxes. To develop effective solutions to switch between fixed automated processes and human-aware modes, this work introduces a novel strategy that enables humans and robots to share spaces while collaboratively performing a manufacturing process. The proposed method seamlessly transitions between temporary HRI (i.e., human-aware mode) and long-horizon automated tasks (i.e., fully automatic mode) to establish resilient and energy-efficient production systems. To achieve this, a task progress monitor is developed that enables the decomposition of a complex manipulation task into several robot-centric action sequences, which are then further divided into a series of three-phase subtasks. A trigger signal switches modes based on the detected human action and its contribution to the task. A human agent coefficient matrix is computed using selected environmental features to provide an appropriate cut-point for each robot to reactively execute the manipulation actions. To evaluate the performance of the proposed method, an extensive experimental study is conducted with robotic manipulators performing representative manufacturing tasks in both automatic mode and collaboration with humans. The reported body of work in this thesis contributes to the field of HRI with the potential to enhance sustainability in the context of Industry 5.0, which paves the way for intelligent manufacturing processes of future societies. |
| Rights: | All rights reserved |
| Access: | open access |
Copyright Undertaking
As a bona fide Library user, I declare that:
- I will abide by the rules and legal ordinances governing copyright regarding the use of the Database.
- I will use the Database for the purpose of my research or private study only and not for circulation or further reproduction or any other purpose.
- I agree to indemnify and hold the University harmless from and against any loss, damage, cost, liability or expenses arising from copyright infringement or unauthorized usage.
By downloading any item(s) listed above, you acknowledge that you have read and understood the copyright undertaking as stated above, and agree to be bound by all of its terms.
Please use this identifier to cite or link to this item:
https://theses.lib.polyu.edu.hk/handle/200/12876