[–] jaberjaber23 10mo ago ↗ I built one of the largest Arabic LLM datasets:- 743K articles- 244M words- 1.5M unique words- Cleaned, deduplicated, JSONL format, LLM-readyIt’s ready for GPT, BERT, LLaMA, or any Arabic NLP research.For too long, Arabic AI lagged behind. Most LLMs ignored our language, and high-quality datasets didn’t exist. That changes today.
1 comment
[ 2.7 ms ] story [ 12.5 ms ] thread- 743K articles
- 244M words
- 1.5M unique words
- Cleaned, deduplicated, JSONL format, LLM-ready
It’s ready for GPT, BERT, LLaMA, or any Arabic NLP research.
For too long, Arabic AI lagged behind. Most LLMs ignored our language, and high-quality datasets didn’t exist. That changes today.