Publications
PARIKSHA : A Large-Scale Investigation of Human-LLM Evaluator Agreement on Multilingual and Multi-Cultural Data
Ishaan Watts, , Aditya Yadavalli, Vivek Seshadri, Manohar Swaminathan, Sunayana Sitaram
arXiv | e-Print Archive
PDF
abstract
cite
🏆 Best Paper
Akal Badi ya
Bias: An Exploratory Study of Gender Bias in Hindi
Language Technology
Rishav Hada, Safiya Husain, , Harshita Diddee, Aditya
Yadavalli, Agrima Seth, Nidhi Kulkarni, Ujwal Gadiraju, Aditya Vashistha, Vivek Seshadri, Kalika
Bali
ACM FAccT '24 | 7th Annual ACM Conference on
Fairness, Accountability, and Transparency
PDF
abstract
cite
METAL: Towards Multilingual Meta-Evaluation
Rishav Hada*, *, Maxamed
Axmed, Kalika Bali, Sunayana Sitaram (* = Equal
Contribution)
NAACL '24 | Findings of the Association for
Computational Linguistics
PDF
abstract
cite
MEGAVERSE: Benchmarking Large Language Models Across Languages,
Modalities, Models and Tasks
Sanchit Ahuja, Divyanshu Aggarwal, , Ishaan Watts, Ashutosh
Sathe, Millicent Ochieng, Rishav
Hada, Prachi Jain, Maxamed Axmed, Kalika Bali, Sunayana Sitaram
NAACL '24 | 2024 Annual Conference of the
North
American Chapter of the Association for Computational Linguistics - Human Language Technologies
(NAACL-HLT)
PDF
abstract
cite
MunTTS: A Text-to-Speech System for Mundari
, Rishav Hada, Aditya Yadavalli, Pamir Gogoi,
Ishani Mondal, Vivek Seshadri, Kalika Bali
ComputEL '24 |
7th
Workshop on Computational Methods for Endangered Languages
PDF
abstract
cite
Are Large Language Model-based Evaluators the Solution
to Scaling Up Multilingual Evaluation?
Rishav Hada, , Adrian de Wynter, Harshita Diddee, Maxamed
Axmed, Monojit Choudhury, Kalika Bali, Sunayana Sitaram
EACL '24 | Findings of the Association for
Computational Linguistics
PDF
abstract
cite
MAFIA: Multi-Adapter Fused Inclusive LanguAge Models
Prachi Jain*, Ashutosh Sathe*, , Kabir Ahuja, Sunayana
Sitaram
(* = Equal Contribution)
EACL '24 | 18th Conference of the
European
Chapter
of the Association for Computational Linguistics
PDF
abstract
cite
IndicTrans2: Towards High-Quality and Accessible Machine
Translation Models for all 22 Scheduled Indian Languages
Jay Gala*, Pranjal A. Chitale*, Raghavan AK, ,
Sumanth Doddapaneni, Aswanth Kumar, Janki Nawale, Anupama Sujatha,
Ratish Puduppully, Vivek Raghavan, Pratyush Kumar,
Mitesh M. Khapra, Raj Dabre, Anoop Kunchukuttan
(* = Equal Contribution)
TMLR '23 | Transactions of Machine Learning
Research
PDF
abstract
cite
An Empirical Study of Leveraging Knowledge Distillation for
Compressing Multilingual Neural Machine Translation Models
, Raj Dabre, Pratyush Kumar
EAMT '23 | 24th
Conference of the European Association for Machine Translation
PDF
abstract
cite
PAMMELA: Policy Administration Methodology using Machine
Learning
, Barsha Mitra, Soumyadeep Dey, Pratik Shashikantbhai Patel*,
Sourabh Suman*, Saptarshi Das, Jaideep Vaidya
(* = Equal Contribution)
SECRYPT
'22 | 19th International Conference on Security and Cryptography
PDF
abstract
cite
News