Self-published books used to train early models such as BERT and GPT.
Its licence doesn't allow Rubynox to redistribute it, so we never deliver it. Get it directly from Zhu et al. (University of Toronto and MIT); we list it so you can see all your options in one place.
The original authors no longer distribute it; copies online raise copyright questions.
More in Language and AI benchmarks
Language and AI benchmarks · Stanford NLP
Questions about Wikipedia passages with answers marked in the text; v2 adds unanswerable questions.
Language and AI benchmarks · LMSYS
Real user conversations with chatbots, with pairwise human votes from the Arena.
Language and AI benchmarks · Tsinghua University (THUNLP)
Multi-turn synthetic dialogues used to fine-tune chat models.
Language and AI benchmarks · Google Research
Real Google search questions answered from Wikipedia pages.
Language and AI benchmarks · NYU, University of Washington and DeepMind
The general language understanding benchmark that shaped BERT-era models.
Language and AI benchmarks · NYU, Facebook AI, University of Washington and DeepMind
A harder successor to GLUE for reading comprehension and reasoning.