piwheels

code-tokenize

Fast program tokenization and structural analysis in Python

Installation

In a virtualenv (see these instructions if you need to create one):

pip3 install code-tokenize

Dependencies

• tree-sitter
• gitpython
• code-ast
• requests

Releases

Version	Released	Bookworm Python 3.11	Trixie Python 3.13	Files
0.2.1	2025-01-14
code_tokenize-0.2.1-py3-none-any.whl (14 KB)
0.2.0	2022-06-28
code_tokenize-0.2.0-py3-none-any.whl (16 KB)
0.1.0	2022-01-19
code_tokenize-0.1.0-py3-none-any.whl (14 KB)
0.0.1.post1	2021-11-01
code_tokenize-0.0.1.post1-py3-none-any.whl (9 KB)

Issues with this package?

• Search issues for this package
• Package or version missing? Open a new issue
• Something else? Open a new issue