py-data-juicer
Data Processing for and with Foundation Models.
Installation
In a virtualenv (see these instructions if you need to create one):
pip3 install py-data-juicer
Dependencies
- tabulate
- fastapi
- tqdm
- matplotlib
- wordcloud
- emoji
- jsonlines
- python-docx
- mcp
- tomli-w
- datasets
- tomli
- fsspec
- jsonargparse
- pillow
- plotly
- av
- librosa
- bs4
- multiprocess
- wget
- samplerate
- numpy
- uv
- httpx
- lz4
- pydantic
- regex
- mwparserfromhell
- requests
- pdfplumber
- psutil
- loguru
- pylance
- streamlit
- seaborn
- gitpython
- spacy
- dill
- pandas
- resampy
- zstandard
Releases
Issues with this package?
- Search issues for this package
- Package or version missing? Open a new issue
- Something else? Open a new issue