Abstract
Hand measurement is vital for hand-centric applications such as glove design, immobilization design, protective gear design, to name a few. Vision-based methods have been previously proposed but are limited in their ability to only extract hand dimensions in a static and standardized posture (open-palm hand). However, dynamic hand measurements should be considered when designing these wearable products since the interaction between hands and products cannot be ignored. Unfortunately, none of the existing methods are designed for measuring dynamic hands. To address this problem, we propose a user-friendly and fast method dubbed Measure4DHand, which automatically extracts dynamic hand measurements from a sequence of depth images captured by a single depth camera. Firstly, the ten dimensions of the hand are defined. Secondly, a deep neural network is developed to predict landmark sequences for the ten dimensions from partial point cloud sequences. Finally, a method is designed to calculate dimension values from landmark sequences. A novel synthetic dataset consisting of 234K hands in various shapes and poses, along with their corresponding ground truth landmarks, is proposed for training the proposed methods. The experiment based on real-world data captured by a Kinect illustrates the evolution of the ten dimensions during hand movement, while the mean ranges of variation are also reported, providing valuable information for the hand wearable product design.
Original language | English |
---|---|
Title of host publication | 2023 IEEE International Conference on Image Processing |
Publisher | IEEE |
Pages | 3543-3547 |
Number of pages | 5 |
ISBN (Electronic) | 9781728198354 |
ISBN (Print) | 9781728198361 |
DOIs | |
Publication status | Published - 2023 |
Event | 2023 IEEE International Conference on Image Processing - Kuala Lumpur Duration: 8 Oct 2023 → 11 Oct 2023 https://signalprocessingsociety.org/blog/icip-2023-2023-ieee-international-conference-image-processing |
Publication series
Name | Proceedings - International Conference on Image Processing, ICIP |
---|---|
ISSN (Print) | 1522-4880 |
Conference
Conference | 2023 IEEE International Conference on Image Processing |
---|---|
Abbreviated title | ICIP 2003 |
City | Kuala Lumpur |
Period | 8/10/23 → 11/10/23 |
Internet address |
Bibliographical note
© 2023 IEEE. Personal use of this material is permitted. Permission from IEEE must be obtained for all other uses, in any current or future media, including reprinting/republishing this material for advertising or promotional purposes, creating new collective works, for resale or redistribution to servers or lists, or reuse of any copyrighted component of this work in other works.Copyright © and Moral Rights are retained by the author(s) and/ or other copyright owners. A copy can be downloaded for personal non-commercial research or study, without prior permission or charge. This item cannot be reproduced or quoted extensively from without first obtaining permission in writing from the copyright holder(s). The content must not be changed in any way or sold commercially in any format or medium without the formal permission of the copyright holders.
This document is the author’s post-print version, incorporating any revisions agreed during the peer-review process. Some differences between the published version and this version may remain and you are advised to consult the published version if you wish to cite from it.
Keywords
- hand measurement
- point cloud processing
- dynamic hand
- landmark
- partial scan