allenai/c4
Viewer • Updated • 10.4B • 764k • 582
Edit Datasets filters
English
French
Chinese
French
Spanish
Russian
German
Japanese
Arabic
Korean
Portuguese
English
Italian
Vietnamese
Turkish
Hindi
Indonesian
Dutch
Polish
Bengali
Thai
Persian
Czech
Tamil
Swedish
Romanian
Ukrainian
Danish
Greek
Finnish
Catalan
Telugu
Hungarian
Spanish
Urdu
German
Swahili
Bulgarian
Marathi
Hebrew
Estonian
Malayalam
Basque
Slovak
Slovenian
Gujarati
Lithuanian
Kannada
Croatian
Malay
Latvian
Serbian
code
Panjabi
Italian
Amharic
Kazakh
Nepali
Norwegian
Burmese
Uzbek
Indonesian
Portuguese
Azerbaijani
Oriya
Yoruba
Hausa
Sinhala
Afrikaans
Icelandic
Galician
multilingual
Russian
Assamese
Irish
Khmer
Breton
Latin
Maltese
Tagalog
Georgian
Welsh
Vietnamese
Macedonian
Dutch
Armenian
Igbo
Belarusian
Albanian
Polish
Active filters: si
openlanguagedata/flores_plus
Viewer • Updated • 883k • 14.5k • 141
Helsinki-NLP/OpenSubtitles2024
Viewer • Updated • 570M • 832 • 12
CohereLabs/Global-MMLU
Viewer • Updated • 602k • 37.2k • 158
omarkamali/wikipedia-monthly
Viewer • Updated • 195M • 11.7k • 69
wikimedia/wikipedia
Viewer • Updated • 61.6M • 244k • 1.23k
Helsinki-NLP/opus-100
Viewer • Updated • 55.1M • 30.4k • 236
wikimedia/wit_base
Viewer • Updated • 108k • 3.45k • 68
NLPC-UOM/Sinhala-English-Code-Mixed-Code-Switched-Dataset
Preview • Updated • 231 • 4
facebook/flores
Viewer • Updated • 1.23M • 15.9k • 102
MBZUAI/Bactrian-X
Viewer • Updated • 3.48M • 1.03k • 125
CohereLabs/xP3x
Viewer • Updated • 434M • 293k • 94
ServiceNow-AI/M2Lingual
Viewer • Updated • 290k • 361 • 43
stanford-oval/ccnews
Viewer • Updated • 893M • 6.45k • 36
google/smol
Viewer • Updated • 842k • 4.37k • 110
YuRiVeRTi/V1Q
Viewer • Updated • 186k • 1.26k • 4
facebook/omnilingual-asr-corpus
Viewer • Updated • 548k • 6.26k • 202
akahana/wikipedia-full
Viewer • Updated • 61.6M • 65 • 1
disco-eth/WorldSpeech
Updated • 90.2k • 17
liva-ai/yapdo-convo
Viewer • Updated • 226 • 74 • 1
uonlp/CulturaX
Viewer • Updated • 7.18B • 26.1k • 628
facebook/bouquet
Updated • 2.19k • 39
Chat2Find/Chat2Find-Corpus
Viewer • Updated • 279k • 99 • 2
statmt/cc100
Updated • 2.32k • 106
ahelk/ccaligned_multilingual
Updated • 369 • 8
facebook-llama/flores
Updated • 500 • 4
Helsinki-NLP/kde4
Updated • 1.55k • 25
legacy-datasets/mc4
Updated • 1.71k • 153
microsoft/ms_terms
Updated • 211 • 5
Helsinki-NLP/multi_para_crawl
Updated • 169 • 1