piwheels

supernova

Stream massive datasets, embed at scale, store as parquet in S3.

Installation

In a virtualenv (see these instructions if you need to create one):

pip3 install supernova

Dependencies

• pyyaml
• huggingface-hub
• tqdm
• click
• numpy
• boto3
• pyarrow

Releases

Version	Released	Bookworm Python 3.11	Trixie Python 3.13	Files
0.1.5	2026-06-17
supernova-0.1.5-py3-none-any.whl (136 KB)
0.1.4	2026-06-08
supernova-0.1.4-py3-none-any.whl (134 KB)
0.1.3	2026-06-05
supernova-0.1.3-py3-none-any.whl (130 KB)
0.1.2	2026-06-03
supernova-0.1.2-py3-none-any.whl (121 KB)
0.1.1	2026-06-03
supernova-0.1.1-py3-none-any.whl (113 KB)
0.1.0	2026-06-02
supernova-0.1.0-py3-none-any.whl (108 KB)

Issues with this package?

• Search issues for this package
• Package or version missing? Open a new issue
• Something else? Open a new issue