The 3D-LEX Dataset
Published:
 | 3D-LEX v1.0: 3D Lexicons for American Sign Language and Sign Language of the Netherlands was published at the LREC-COLING 2024 Sign Language Workshop, Torino, Italy. |
Abstract: In this work, we introduce the 3D-LEX dataset, featuring high-resolution, three-dimensional lexicons of prevalent signs in American Sign Language and Sign Language of the Netherlands. The collection includes 1,000 signs from each language, encompassing handshapes, body poses, and facial features captured using three distinct motion capture techniques. Our data acquisition method demonstrates high efficiency, with the capacity to capture approximately one sign every 10 seconds. 3D-LEX supports in-depth analysis of sign features and facilitates the generation of 2D projections from any viewpoint. Additionally, the collection has been aligned with existing sign language benchmarks and resources. We showcase the utility of 3D-LEX in the task of semi-automatic annotation of phonetic properties. Downstream evaluations in an isolated sign recognition task using the WLASL benchmark demonstrate that the novel labels enhance recognition accuracy by 5% compared to the absence of phonetic labels, and by 1% over annotations provided by expert linguists.
Published: LREC-COLING 2024 · Sign Language Workshop · pp. 290–301