Ongoing Technical Research Evaluation of LLMs & AI Applications

Expanding AILuminate: Researching Multilingual, Multicultural, and Multimodal Benchmarking

Overview

Partnership with MLCommons and Google to build an India-specific AI safety benchmark (starting English, Hindi, Tamil; expanding to Bengali, Urdu, Marathi, Telugu, Gujarati), part of a larger Asia-Pacific AI safety standardisation effort.

Related projects

LLM-based Fine Tuning of Restless Multi-armed Bandits for Public Health – Fairness in Multilingual Settings
LLM-based Fine Tuning of Restless Multi-armed Bandits for Public Health – Fairness in Multilingual Settings
healthcare ai-and-society
Evaluating Small Language Models for Detecting Media Bias through Fine-tuning
Evaluating Small Language Models for Detecting Media Bias through Fine-tuning
ai-and-society lm
A Causal Approach for Unfair Edge Prioritization and Discrimination Removal
A Causal Approach for Unfair Edge Prioritization and Discrimination Removal
ai-and-society