NusaWrites: Constructing High-Quality Corpora for Underrepresented and Extremely Low-Resource Languages
Origin paper
NusaWrites: Constructing High-Quality Corpora for Underrepresented and Extremely Low-Resource Languages
InstructAlign: High-and-Low Resource Language Alignment via Continual Crosslingual Instruction Tuning
NusaX: Multilingual Parallel Sentiment Dataset for 10 Indonesian Local Languages
Cendol: Open Instruction-tuned Generative Large Language Models for Indonesian Languages
Instruct-Align: Teaching Novel Languages with to LLMs through Alignment-based Cross-Lingual Instruction
LLMs Are Few-Shot In-Context Low-Resource Language Learners
Large Language Models Only Pass Primary School Exams in Indonesia: A Comprehensive Test on IndoMMLU
One Country, 700+ Languages: NLP Challenges for Underrepresented Languages and Dialects in Indonesia
NusaCrowd: Open Source Initiative for Indonesian NLP Resources
BUFFET: Benchmarking Large Language Models for Few-shot Cross-lingual Transfer
Multilingual Large Language Models Are Not (Yet) Code-Switchers
Many-to-Many Multilingual Translation Model for Languages of Indonesia
SEACrowd: A Multilingual Multimodal Data Hub and Benchmark Suite for Southeast Asian Languages
NusaBERT: Teaching IndoBERT to be Multilingual and Multicultural
Bactrian-X : A Multilingual Replicable Instruction-Following Model with Low-Rank Adaptation
IndoNLG: Benchmark and Resources for Evaluating Indonesian Natural Language Generation
Okapi: Instruction-tuned Large Language Models in Multiple Languages with Reinforcement Learning from Human Feedback
ArabicMMLU: Assessing Massive Multitask Language Understanding in Arabic
MEGA: Multilingual Evaluation of Generative AI
Cross-lingual Few-Shot Learning on Unseen Languages
IndoCulture: Exploring Geographically Influenced Cultural Commonsense Reasoning Across Eleven Indonesian Provinces
Prompting Multilingual Large Language Models to Generate Code-Mixed Texts: The Case of South East Asian Languages
Transfer Learning-Based Neural Machine Translation for Low-Resource Languages
CMMLU: Measuring massive multitask language understanding in Chinese
IdSarcasm: Benchmarking and Evaluating Language Models for Indonesian Sarcasm Detection
Location-based Twitter Filtering for the Creation of Low-Resource Language Datasets in Indonesian Local Languages
Cheetah: Natural Language Generation for 517 African Languages
Not All Languages Are Created Equal in LLMs: Improving Multilingual Capability by Cross-Lingual-Thought Prompting
Improving Bi-LSTM Performance for Indonesian Sentiment Analysis Using Paragraph Vector
Findings of the 1st Shared Task on Multi-lingual Multi-task Information Retrieval at MRL 2023
IndoNLU: Benchmark and Resources for Evaluating Indonesian Natural Language Understanding
COPAL-ID: Indonesian Language Reasoning with Local Culture and Nuances
Towards Computational Linguistics in Minangkabau Language: Studies on Sentiment Analysis and Machine Translation
Extending the Pre-Training of BLOOM for Improved Support of Traditional Chinese: Models, Methods and Results
Can the capability of Large Language Models be described by human ability? A Meta Study
C-Eval: A Multi-Level Multi-Discipline Chinese Evaluation Suite for Foundation Models
Quality at a Glance: An Audit of Web-Crawled Multilingual Datasets
Bilingual Evaluation of Language Models on General Knowledge in University Entrance Exams with Minimal Contamination
Scaling Up Multilingual Evaluation
Zero-shot Sentiment Analysis in Low-Resource Languages Using a Multilingual Sentiment Lexicon
Large-scale Lifelong Learning of In-context Instructions and How to Tackle It
Log in to saveSave
Democratizing access to natural language processing (NLP) technology is crucial, especially for underrepresented and extremely low-resource languages. Previous research has focused on developing labeled and unlabeled corpora for these languages through online scraping and document translation. While these methods have proven effective and cost-efficient, we have identified limitations in the resulting corpora, including a lack of lexical diversity and cultural relevance to local communities. To address this gap, we conduct a case study on Indonesian local languages. We compare the effectiveness of online scraping, human translation, and paragraph writing by native speakers in constructing datasets. Our findings demonstrate that datasets generated through paragraph writing by native speakers exhibit superior quality in terms of lexical diversity and cultural content. In addition, we present the \datasetname{} benchmark, encompassing 12 underrepresented and extremely low-resource languages spoken by millions of individuals in Indonesia. Our empirical experiment results using existing multilingual large language models conclude the need to extend these models to more underrepresented languages. We release the NusaWrites dataset at https://github.com/IndoNLP/nusa-writes.