Research work on cloth recognition and manipulation in the Autonomous Intelligence and Systems (AIS) laboratory at Shinshu University
Techniques such as deep neural networks and point cloud imaging have been applied in other experiments. To enable a dual-arm robot to translate a known cloth state to a different required shape or state, the robot was trained to associate different manipulations with an expected cloth state. By using machine learning on this scale, the robot was able to determine the manipulation or series of manipulations most likely to achieve the desired cloth state. Yamazaki explains: 'By closely coupling each manipulation with an expected cloth shape in the learning architecture and training the robot on repeated operations, the computer can predict the likely outcome of manipulations and quickly determine the fastest and most effective operations to achieve a desired cloth shape.'
The team focused on identifying a range of different features including wrinkles, cuffs and cloth overlaps. The way in which wrinkles and cloth overlaps form is often dependent on the type of fabric, which helps determine the type of garment. Only a greyscale image of the heap of clothing is required. Complex image processing is undertaken to characterise the visible features and identify the type of garments present.
A 3D range image sensor mounted in the robot's head looking down onto the cloth can distinguish colour and shadow. Despite this, mistakes are common. The nature of cloth means it can fall into many different shapes and states, such that folds and wrinkles might easily be mistaken for a corner. AIS has developed imaging processing methods that can minimise uncertainty, as well as inline checking to ensure each manipulation results in the required shape. Simple intermediate actions have been derived by repeating different manipulations many times over and selecting those that most often result in a useful cloth arrangement.
Keywords: 3D RANGE IMAGE SENSOR; AUTONOMOUS INTELLIGENCE AND SYSTEMS; AUTONOMOUS MACHINES; CHARACTERISE VISIBLE FEATURES; CLOTH MANIPULATION; CLOTH RECOGNITION; COMPLEX IMAGE PROCESSING; DEEP NEURAL NETWORKS; DUAL-ARM ROBOT; GREYSCALE IMAGE; IMAGING PROCESSING METHODS; LEARNING ARCHITECTURE; MACHINE LEARNING; POINT CLOUD IMAGING
Document Type: Research Article
Publication date: December 1, 2018
Impact is a series of high-quality, open access and free to access science reports designed to enable the dissemination of research impact to key stakeholders. Communicating the impact and relevance of research projects across a large number of subjects in a content format that is easily accessible by an academic and stakeholder audience. The publication features content from the world's leading research councils, policy groups, universities and research projects. Impact is published under a CC-BY Creative Commons licence.
- Subscribe to this Title
- Terms & Conditions
- Disseminating research in Impact
- Information about Impact
- Ingenta Connect is not responsible for the content or availability of external websites
- Access Key
- Free content
- Partial Free content
- New content
- Open access content
- Partial Open access content
- Subscribed content
- Partial Subscribed content
- Free trial content