Post #1665

Hugging Face (Twitter) RT @lhoestq: Just released today ! Full support for dataset streaming in large scale distributed training With datasets==4.4.1 and huggingface_hub==1.1.0, better than 4.4 and 1.0 These include all the features explained in the blog post https://huggingface.co/blog/streaming-datasets Advanced examples in replies: