Inicio  /  Applied Sciences  /  Vol: 12 Par: 12 (2022)  /  Artículo
ARTÍCULO
TITULO

Texture-Less Shiny Objects Grasping in a Single RGB Image Using Synthetic Training Data

Chen Chen    
Xin Jiang    
Shu Miao    
Weiguo Zhou and Yunhui Liu    

Resumen

In the industrial domain, estimating the pose of texture-less shiny parts is challenging but worthwhile. In this study, it is impractical to utilize texture information to obtain the pose because the features are likely to be affected by the surrounding objects. In addition, the colors of the metal parts are similar, making object segmentation challenging. This study proposes dividing the entire process into three steps: object detection, feature extraction, and pose estimation. We use the Mask-RCNN to detect objects and HRNet to extract the corresponding features. For metal parts of different shapes, different keypoints were chosen accordingly. Conventional contour-based methods are inapplicable to parts containing planar surfaces because the objects occlude each other in clustered environments. In this case, we used dense discrete points along the edges as semantic keypoints for metal parts containing planar elements. We chose skeleton points as semantic keypoints for parts containing cylindrical components. Subsequently, we combined the localization of semantic keypoints and the corresponding CAD model information to estimate the 6D pose of an individual object in sight. The implementation of deep learning approaches requires massive training datasets and intensive labeling. Thus, we propose a method to generate training datasets and automatically label them. Experiments show that the algorithm based on synthetic data performs well in a natural environment, despite not utilizing real scenario images for training.

 Artículos similares

       
 
Guozhi Li, Shuizhong Zou, Shuxue Din and Bin Qi    
This paper presents a modified model for hand?eye calibration based on dual quaternion algebra. By using dual quaternions to represent the rotations and translations of a rigid body simultaneously in the task space, the formulation is elegant for the ana... ver más
Revista: Applied Sciences

 
Shengyang Chen, Weifeng Zhou, An-Shik Yang, Han Chen, Boyang Li and Chih-Yung Wen    
Visual simultaneous localization and mapping (v-SLAM) and navigation of unmanned aerial vehicles (UAVs) are receiving increasing attention in both research and education. However, extensive physical testing can be expensive and time-consuming due to safe... ver más
Revista: Aerospace

 
Tee Connie, Timilehin B. Aderinola, Thian Song Ong, Michael Kah Ong Goh, Bayu Erfianto and Bedy Purnama    
Parkinson?s disease (PD) is a neurodegenerative disorder that is more common in elderly people and affects motor control, flexibility, and how easily patients adapt to their walking environments. PD is progressive in nature, and if undetected and untreat... ver más
Revista: Algorithms

 
Jindrich Adolf, Jaromir Dolezal, Patrik Kutilek, Jan Hejda and Lenka Lhotska    
In recent years, several systems have been developed to capture human motion in real-time using common RGB cameras. This approach has great potential to become widespread among the general public as it allows the remote evaluation of exercise at no addit... ver más
Revista: Applied Sciences

 
Mazeda Islam, Marc Van Camp, Delwar Hossain, Md. Mizanur Rahman Sarker, Shahina Khatun and Kristine Walraevens    
Dhaka city has emerged as the fastest-growing megacity, having more than 20 million inhabitants, with a growth rate of 3.62%. Unplanned and rapid urbanization, coupled with exponential population growth, has significantly altered the groundwater dynamics... ver más
Revista: Water