|
Download README.md from Fraser/wiki_sentences: direct link, hf CLI and curl.
- Browser
- Download file 358 Bytes
-
https://huggingface.co/datasets/Fraser/wiki_sentences/resolve/main/README.md
- Command line
-
hf download hf://datasets/Fraser/wiki_sentences/README.md
-
curl -L -o README.md https://huggingface.co/datasets/Fraser/wiki_sentences/resolve/main/README.md
358 Bytes
Wiki Sentences
A dataset of all english sentences in Wikipedia.
Taken from the OPTIMUS project. https://github.com/ChunyuanLI/Optimus/blob/master/download_datasets.md
The dataset is 11.8GB so best to load it using streaming:
from datasets import load_dataset
dataset = load_dataset("Fraser/wiki_sentences", split='train', streaming=True)