📢 Call for Shared Tasks
JUST-NLP 2025: Workshop on NLP for Empowering Justice
Co-located with the premier conference IJCNLP-AACL 2025
Date: 24th December 2025
Venue: Victor Menezes Convention Centre (VMCC), IIT Bombay, Mumbai, Maharashtra 400076, India
We are pleased to invite participation in the shared tasks organized as part of the JUST-NLP Workshop. This workshop aims to foster research and innovation in Natural Language Processing (NLP) for the legal domain, with a particular focus on practical and impactful applications in the large, multilingual legal system of India.
Legal systems in highly populous countries such as India are currently facing a crisis of judicial pendency. As per the National Judicial Data Grid (NJDG), India alone has over 44 million pending cases across courts. This backlog, primarily stemming from manual and inefficient processes, leads to the denial of timely justice, undermining the rights the legal system is meant to protect. AI-enabled automated systems can offer scalable solutions to assist legal professionals, reduce repetitive work, and improve access to justice. Despite significant progress in NLP for general domains in India, the legal domain remains under-explored due to its complexity, domain-specific language, and limited annotated datasets.
This JUST-NLP 2025 workshop aims to bring together AI researchers, legal professionals, and technologists to advance this area of applied NLP research. As part of this effort, we are launching 2 shared tasks, designed to address high-impact problems in legal document processing.
🧠 Details of Shared Tasks
📝 Task 1. Legal Summarization (L-SUMM)
- Objective: Generate abstractive summaries of case judgments from Indian courts.
- Challenges: Requires legal domain-specific knowledge, understanding of legal reasoning, and coherent abstraction.
- Use Cases: Assisting legal professionals with document triaging; improving public access to case outcomes.
- Language covered: English (EN)
- Evaluation Metrics: ROUGE-2, ROUGE-L and BLEU
- Reading materials: Please refer to the following research papers for more details about legal summarization:
- Dataset and Evaluation: Please refer to our SharedTask CodaBench Link.
🌐 Task 2. Legal Machine Translation (L-MT)
-
Objective: Translate legal content from English to Hindi (the most spoken language in India).
-
Challenges: Legal domain-specific terms, syntax preservation, and maintaining semantic and legal equivalence.
-
Use Cases: Bilingual accessibility in courts; comprehension of legal information in India
-
Languages: English (EN) and Hindi (HI)
-
Evaluation Metrics: BLEU, ROUGE-L and chrF++
-
Reading Materials: Please refer to the following research papers for more details about legal machine translation:
-
Dataset and Evaluation: Please refer to our SharedTask CodaBench Link.
🗓 Important Dates
All deadlines are 11:59 PM AOE
| Event | Date |
|---|---|
| Shared Task Dataset Release | August 25, 2025 |
| Shared Task Registration Start | August 25, 2025 |
| First Call Shared Task | August 25, 2025 |
| Shared Task Registration End | September 30, 2025 |
| Testing Phase | October 14 to 18, 2025 |
| Results & Leaderboard Announcement | October 25, 2025 |
| Shared Task Paper Submission Deadline | 03-Nov-2025 |
| Camera-ready Shared Task Papers Due | November 30, 2025 |
| Shared Task reviews notification | 22-Nov-2025 |
| Main paper reviews notification | 22-Nov-2025 |
| Camera-ready (final) version of accepted papers due | 30-Nov-2025 |
🏁 Shared Task Results (October 25, 2025)
We are pleased to announce the official results and leaderboards for the JUST-NLP 2025 shared tasks. You can download the detailed result summaries and rankings below:
- L-SUMM (Legal Summarization) — Results PDF
- L-MT (Legal Machine Translation) — Results PDF
👥 Call for Participation
Participants are free to take part in both tasks. We encourage participation from:
- Academic research groups in NLP, AI, and LegalTech
- Legal professionals and practitioners with interests in AI solutions
- Industry practitioners working on language technologies or AI for law
- Multilingual NLP researchers and developers
💡 Registration Guidelines
- Participant(s) / Team must register here: https://forms.gle/FyLaubvrkMGSdmkBA
🏆 Awards and Prizes
To recognize and encourage excellence in Legal NLP research, we are pleased to announce awards and certificates for top-performing teams:
These awards will be granted to the teams ranking at the top of the official leaderboard, based on objective evaluation metrics.
Contact
For any questions, feel free to reach out to the organizers at legalaieval@gmail.com OR Join our Discord server to stay updated and engage in discussions related to the shared tasks.
📄 Shared Task — Paper Submission Instructions
All invited teams and participants who wish to submit a short paper for the shared task should follow the ACL 2025 formatting guidelines. Below are the policies and timeline specific to Shared Task paper submissions (please read carefully):
- Submission portal: Please submit your shared task system-description paper via OpenReview at the JUST-NLP workshop page: JUST-NLP OpenReview group.
- Invitation & Scope
- Based on the final published results, all 9 top-performing teams (in L-SUMM) and all 7 top-performing teams (in L-MT) are invited to submit a short paper describing their systems and findings. Invited papers should follow the ACL template. The main content must be a maximum of 4 pages; references and appendices may extend beyond this limit.
- Accepted papers will receive one additional main page for final camera-ready revisions. Accepted papers will be included in the JUST-NLP workshop proceedings at IJCNLP-AACL 2025.
- Double-blind Review Policy
- The shared-task review process is double-blind and follows the ACL Two-Way Anonymized Review process. Submitted papers must NOT include authors’ names or affiliations. Authors should avoid self-references that reveal identities (e.g., “In our prior work [Anonymous, 2025]”).
- Timeline & Decisions
- Shared Task Paper Submission Deadline: 03-Nov-2025 (11:59 PM AOE)
- Review Submission Deadline: 05-Nov-2025 (11:59 PM AOE)
- Final acceptance decisions announced by: 07-Nov-2025
- Shared Task reviews notification: 22-Nov-2025
- Main paper reviews notification: 22-Nov-2025
- Camera-ready (final) version of accepted papers due: 30-Nov-2025
📣 Author confirmations & registration
- Registration policy: For shared task system-description papers, workshop registration is not mandatory; however, registration is mandatory for presentation at the workshop.
All submitted reviews will be verified by the workshop committee. If you have questions about the submission process or review assignments, contact the organizers at legalaieval@gmail.com.
🤝 Sponsors
We gratefully acknowledge the support of our sponsors, who are committed to advancing Legal NLP research.
TBD
We are currently welcoming additional sponsors. If your organization is interested in supporting this initiative through funding or providing resources, please reach out at: ashutoshm@cse.iitk.ac.in (Dr. Ashutosh Modi, IIT Kanpur)
📬 Organizing Team
- Dr. Ashutosh Modi, IIT Kanpur (ashutoshm@cse.iitk.ac.in)
- Dr. Saptarshi Ghosh, IIT Kharagpur (saptarshi@cse.iitkgp.ac.in)
- Dr. Asif Ekbal, IIT Jodhpur (asif@iitj.ac.in)
- Dr. Pawan Goyal, IIT Kharagpur (pawang@cse.iitkgp.ac.in)
- Dr. Sarika Jain, NIT Kurukshetra (jasarika@nitkkr.ac.in)
- Mr. Abhinav Joshi, IIT Kanpur (ajoshi@cse.iitk.ac.in)
- Ms. Shivani Mishra, IIT Kanpur (shivanim@cse.iitk.ac.in)
- Mr. Debtanu Datta, IIT Kharagpur (debtanumathcs@kgpian.iitkgp.ac.in)
- Mr. Shounak Paul, IIT Kharagpur (shounakpaul95@kgpian.iitkgp.ac.in)
- Mr. Kshetrimayum Boynao Singh, IIT Patna (boynfrancis@gmail.com)
- Mr. Sandeep Kumar, IIT Patna (sandeep.kumar82945@gmail.com)