sagemaker-huggingface-inference-toolkit

Open source library for running inference workload with Hugging Face Deep Learning Containers on Amazon SageMaker.

Installation

In a virtualenv (see these instructions if you need to create one):

pip3 install sagemaker-huggingface-inference-toolkit

Releases

Version Released Bullseye
Python 3.9
Bookworm
Python 3.11
Files
2.6.0 2025-04-23
2.5.0 2025-04-01    
2.4.1 2024-10-18
2.4.0 2024-05-08
2.3.0 2023-11-17    
2.2.0 2023-08-15
2.1.2 2023-06-22  
2.1.1 2022-12-12  
2.1.0 2022-10-25  
2.0.0 2022-03-25  
1.3.1 2022-02-10  
1.3.0 2021-12-16  
1.1.2 2021-09-01  
1.1.1 2021-08-23  
1.0.0 2021-06-25
0.1.0 2021-06-18
0.0.1.dev0 pre-release 2021-06-02  

Issues with this package?

Page last updated 2025-06-27 16:16:39 UTC