OpenAI launched IndQA, a benchmark to evaluate AI systems on Indian languages, culture, and communication patterns.
Languages covered include Bengali, English, Hindi, Kannada, Marathi, Odia, Telugu, Gujarati, Malayalam, Punjabi, Tamil, and Hinglish.
IndQA focuses on topics such as Architecture & Design, Arts & Culture, Everyday Life, Food & Cuisine, History, Law & Ethics, Literature & Linguistics, Media & Entertainment, Religion & Spirituality, and Sports & Recreation.
OpenAI uses IndQA to track AI performance on Indian languages and cultural topics, noting improvement over time but recognizing room for growth.