Measure4DHand: Dynamic Hand Measurement Extraction From 4D Scans

Xinxin Dai, Ran Zhao, Pengpeng Hu, Vasile Palade, Adrian Munteanu

Research output: Chapter in Book/Report/Conference proceedingConference proceedingpeer-review

61 Downloads (Pure)

Abstract

Hand measurement is vital for hand-centric applications such as glove design, immobilization design, protective gear design, to name a few. Vision-based methods have been previously proposed but are limited in their ability to only extract hand dimensions in a static and standardized posture (open-palm hand). However, dynamic hand measurements should be considered when designing these wearable products since the interaction between hands and products cannot be ignored. Unfortunately, none of the existing methods are designed for measuring dynamic hands. To address this problem, we propose a user-friendly and fast method dubbed Measure4DHand, which automatically extracts dynamic hand measurements from a sequence of depth images captured by a single depth camera. Firstly, the ten dimensions of the hand are defined. Secondly, a deep neural network is developed to predict landmark sequences for the ten dimensions from partial point cloud sequences. Finally, a method is designed to calculate dimension values from landmark sequences. A novel synthetic dataset consisting of 234K hands in various shapes and poses, along with their corresponding ground truth landmarks, is proposed for training the proposed methods. The experiment based on real-world data captured by a Kinect illustrates the evolution of the ten dimensions during hand movement, while the mean ranges of variation are also reported, providing valuable information for the hand wearable product design.
Original languageEnglish
Title of host publication2023 IEEE International Conference on Image Processing
PublisherIEEE
Pages3543-3547
Number of pages5
ISBN (Electronic)9781728198354
ISBN (Print)9781728198361
DOIs
Publication statusPublished - 2023
Event2023 IEEE International Conference on Image Processing - Kuala Lumpur
Duration: 8 Oct 202311 Oct 2023
https://signalprocessingsociety.org/blog/icip-2023-2023-ieee-international-conference-image-processing

Publication series

NameProceedings - International Conference on Image Processing, ICIP
ISSN (Print)1522-4880

Conference

Conference2023 IEEE International Conference on Image Processing
Abbreviated titleICIP 2003
CityKuala Lumpur
Period8/10/2311/10/23
Internet address

Bibliographical note

© 2023 IEEE. Personal use of this material is permitted. Permission from IEEE must be obtained for all other uses, in any current or future media, including reprinting/republishing this material for advertising or promotional purposes, creating new collective works, for resale or redistribution to servers or lists, or reuse of any copyrighted component of this work in other works.

Copyright © and Moral Rights are retained by the author(s) and/ or other copyright owners. A copy can be downloaded for personal non-commercial research or study, without prior permission or charge. This item cannot be reproduced or quoted extensively from without first obtaining permission in writing from the copyright holder(s). The content must not be changed in any way or sold commercially in any format or medium without the formal permission of the copyright holders.

This document is the author’s post-print version, incorporating any revisions agreed during the peer-review process. Some differences between the published version and this version may remain and you are advised to consult the published version if you wish to cite from it.

Keywords

  • hand measurement
  • point cloud processing
  • dynamic hand
  • landmark
  • partial scan

Fingerprint

Dive into the research topics of 'Measure4DHand: Dynamic Hand Measurement Extraction From 4D Scans'. Together they form a unique fingerprint.

Cite this