We are working to improve Indian Sign Language (ISL) processing by creating datasets and models that bridge the communication gap for the hard-of-hearing community. ISL, used by millions, lacks the resources needed for tasks like machine translation and recognition, leaving it behind languages such as American Sign Language. To address this, we developed CISLR, a dataset with 4700 ISL words and a model that learns from American Sign Language for better recognition; ISLTranslate, a dataset of 31,000 ISL-English sentence pairs for translation; and iSign, a benchmark with multiple tasks like video-to-text translation to aid ISL research. Our work aims to break communication barriers and promote inclusivity, with future efforts focused on expanding datasets, refining translation models, and supporting applications in areas like education and healthcare.
Abhinav Joshi , Ashwani Bhat , Pradeep S , Priya Gole , Shreyansh Agarwal , Shashwat Gupta , Ashutosh Modi
Proceedings of the 2022 Conference on Empirical Methods in Natural Language Processing
Abhinav Joshi, Susmit Agrawal, Ashutosh Modi
Findings of the Association for Computational Linguistics: ACL 2023
Abhinav Joshi, Romit Mohanty, Mounika Kanakanti, Andesha Mangla, Sudeep Choudhary, Monali Barbate ,Ashutosh Modi
Findings of the Association for Computational Linguistics: ACL 2024