huggingface下载的.arrow数据集读取与使用说明

huggingface下载的.arrow数据集读取与使用说明

from datasets import load_from_disk
from datasets import load_dataset

dataset_cnn = load_dataset("ccdv/cnn_dailymail",
                               '3.0.0',
                               cache_dir="./data")

print("dataset['test']: ", dataset_cnn["test"][0])

https://blog.csdn.net/qq_42589613/article/details/130357215