piwheels

mtxai

A web scraping library based on LangChain which uses LLM and direct graph logic to create scraping pipelines.

Installation

In a virtualenv (see these instructions if you need to create one):

pip3 install mtxai

Dependencies

• alembic
• html2text
• nest-asyncio
• colorama
• opentelemetry-exporter-otlp
• langgraph
• passlib
• pydantic-settings
• markdownify
• tiktoken
• pydantic
• lxml-html-clean
• edge-tts
• nltk
• tqdm
• async-timeout
• typer
• snowballstemmer
• browser-use
• lazify
• undetected-playwright
• asyncio-atexit
• opentelemetry-instrumentation-openai
• langgraph-checkpoint-postgres
• langchain-google-genai
• mcp-server-fetch
• aiohttp-retry
• opentelemetry-exporter-otlp-proto-http
• chromadb
• websockets-proxy
• mammoth
• rebrowser-playwright
• boto3
• lxml
• selenium
• playwright-stealth
• numpy
• xxhash
• scrapegraph-py
• puremagic
• pdfplumber
• markitdown
• humanize
• python-pptx
• speechrecognition
• helium
• langchain-anthropic
• pyperclip
• fastapi
• m3u8
• cssselect
• psutil
• huggingface-hub
• grpcio
• langchain-nvidia-ai-endpoints
• pyotp
• transformers
• sqlmodel
• faust-cchardet
• openai
• smolagents
• rich
• aiostream
• sqlalchemy
• xlrd
• httpx
• semchunk
• langchain
• connecpy
• pyopenssl
• json-schema-to-pydantic
• docker
• minify-html
• pypdf
• browser-cookie3
• yfinance
• langchain-ollama
• psycopg2-binary
• absl-py
• tenacity
• fastmcp
• click
• rank-bm25
• pycryptodomex
• grpcio-tools
• loguru
• aiosqlite
• email-validator
• litellm
• azure-identity
• exa-py
• beautifulsoup4
• playwright
• fastapi-mcp
• free-proxy
• python-dateutil
• azure-core
• quantstats
• anthropic
• google-adk
• pathvalidate
• cel-python
• langchain-core
• nanoid
• pdfminer-six
• fake-useragent
• googlesearch-python
• google-search-results
• python-dotenv
• tiktokapi
• langchain-openai
• pyyaml
• redis
• simpleeval
• slugify
• py-mini-racer
• pgvector
• jsonpath-ng
• g4f
• langchain-community
• pandas
• structlog
• orjson
• serpapi
• json-repair
• diff-match-patch
• youtube-transcript-api
• aiohttp

Releases

Version	Released	Bullseye Python 3.9	Bookworm Python 3.11	Trixie Python 3.13	Files
0.7.0	2025-05-05
mtxai-0.7.0-py3-none-any.whl (19 MB)
0.0.270	2025-02-27
0.0.269	2025-02-27
0.0.268	2025-02-27
0.0.267	2025-02-26
0.0.266	2025-02-26
mtxai-0.0.266-py3-none-any.whl (9 MB)
0.0.265	2025-02-26
0.0.264	2025-02-26
0.0.263	2025-02-22
0.0.262	2025-02-22
mtxai-0.0.262-py3-none-any.whl (9 MB)
0.0.261	2025-02-22
0.0.260	2025-02-22
0.0.259	2025-02-22
0.0.258	2025-02-22
0.0.257	2025-02-22
0.0.256	2025-02-22
mtxai-0.0.256-py3-none-any.whl (9 MB)
0.0.255	2025-02-22
0.0.254	2025-02-21
0.0.253	2025-02-21
mtxai-0.0.253-py3-none-any.whl (9 MB)
0.0.252	2025-02-21
0.0.251	2025-02-21
mtxai-0.0.251-py3-none-any.whl (9 MB)
0.0.250	2025-02-21
0.0.249	2025-02-21
0.0.248	2025-02-21
mtxai-0.0.248-py3-none-any.whl (9 MB)
0.0.247	2025-02-20
0.0.246	2025-02-20
0.0.245	2025-02-20
0.0.244	2025-02-20
0.0.243	2025-02-20
0.0.242	2025-02-20
mtxai-0.0.242-py3-none-any.whl (9 MB)
0.0.241	2025-02-19
mtxai-0.0.241-py3-none-any.whl (9 MB)
0.0.240	2025-02-19
0.0.239	2025-02-19
0.0.238	2025-02-18
mtxai-0.0.238-py3-none-any.whl (9 MB)
0.0.237	2025-02-18
mtxai-0.0.237-py3-none-any.whl (9 MB)
0.0.236	2025-02-18
mtxai-0.0.236-py3-none-any.whl (9 MB)
0.0.235	2025-02-18
0.0.234	2025-02-18
mtxai-0.0.234-py3-none-any.whl (9 MB)
0.0.233	2025-02-18
0.0.232	2025-02-18
mtxai-0.0.232-py3-none-any.whl (9 MB)
0.0.231	2025-02-18
mtxai-0.0.231-py3-none-any.whl (9 MB)
0.0.230	2025-02-17
0.0.229	2025-02-17
mtxai-0.0.229-py3-none-any.whl (9 MB)
0.0.228	2025-02-17
0.0.227	2025-02-17
mtxai-0.0.227-py3-none-any.whl (9 MB)
0.0.226	2025-02-17
0.0.225	2025-02-17
mtxai-0.0.225-py3-none-any.whl (9 MB)
0.0.224	2025-02-17
0.0.223	2025-02-17
mtxai-0.0.223-py3-none-any.whl (9 MB)
0.0.222	2025-02-16
0.0.221	2025-02-16
0.0.220	2025-02-16
0.0.219	2025-02-16
mtxai-0.0.219-py3-none-any.whl (9 MB)
0.0.218	2025-02-16
0.0.217	2025-02-16
mtxai-0.0.217-py3-none-any.whl (9 MB)
0.0.216	2025-02-16
mtxai-0.0.216-py3-none-any.whl (9 MB)
0.0.215	2025-02-16
0.0.214	2025-02-16
mtxai-0.0.214-py3-none-any.whl (9 MB)
0.0.213	2025-02-16
0.0.212	2025-02-16
0.0.211	2025-02-16
0.0.210	2025-02-16
mtxai-0.0.210-py3-none-any.whl (9 MB)
0.0.209	2025-02-16
mtxai-0.0.209-py3-none-any.whl (9 MB)
0.0.208	2025-02-16
0.0.207	2025-02-16
mtxai-0.0.207-py3-none-any.whl (9 MB)
0.0.206	2025-02-16
mtxai-0.0.206-py3-none-any.whl (9 MB)
0.0.205	2025-02-16
0.0.204	2025-02-16
0.0.203	2025-02-16
mtxai-0.0.203-py3-none-any.whl (9 MB)
0.0.202	2025-02-15
0.0.201	2025-02-15
0.0.200	2025-02-15
mtxai-0.0.200-py3-none-any.whl (9 MB)
0.0.199	2025-02-15
0.0.198	2025-02-15
0.0.197	2025-02-15
0.0.196	2025-02-15
0.0.195	2025-02-15
0.0.194	2025-02-15
0.0.193	2025-02-15
0.0.192	2025-02-15
0.0.191	2025-02-15
0.0.190	2025-02-15
0.0.189	2025-02-14
0.0.188	2025-02-14
0.0.187	2025-02-14
mtxai-0.0.187-py3-none-any.whl (9 MB)
0.0.186	2025-02-14
mtxai-0.0.186-py3-none-any.whl (9 MB)
0.0.185	2025-02-14
mtxai-0.0.185-py3-none-any.whl (9 MB)
0.0.184	2025-02-14
mtxai-0.0.184-py3-none-any.whl (9 MB)
0.0.183	2025-02-14
mtxai-0.0.183-py3-none-any.whl (9 MB)
0.0.182	2025-02-14
0.0.181	2025-02-14
0.0.180	2025-02-14
mtxai-0.0.180-py3-none-any.whl (9 MB)
0.0.179	2025-02-13
0.0.178	2025-02-13
mtxai-0.0.178-py3-none-any.whl (9 MB)
0.0.177	2025-02-13
mtxai-0.0.177-py3-none-any.whl (9 MB)
0.0.176	2025-02-13
0.0.175	2025-02-13
0.0.174	2025-02-13
0.0.173	2025-02-13
0.0.172	2025-02-13
mtxai-0.0.172-py3-none-any.whl (8 MB)
0.0.171	2025-02-13
0.0.170	2025-02-13
0.0.169	2025-02-13
0.0.168	2025-02-13
0.0.167	2025-02-13
0.0.166	2025-02-13
0.0.165	2025-02-13
mtxai-0.0.165-py3-none-any.whl (8 MB)
0.0.164	2025-02-13
mtxai-0.0.164-py3-none-any.whl (8 MB)
0.0.163	2025-02-13
0.0.162	2025-02-13
0.0.161	2025-02-13
0.0.160	2025-02-12
mtxai-0.0.160-py3-none-any.whl (8 MB)
0.0.159	2025-02-12
0.0.158	2025-02-12
mtxai-0.0.158-py3-none-any.whl (8 MB)
0.0.157	2025-02-12
0.0.156	2025-02-12
0.0.155	2025-02-12
mtxai-0.0.155-py3-none-any.whl (8 MB)
0.0.154	2025-02-12
0.0.153	2025-02-12
mtxai-0.0.153-py3-none-any.whl (8 MB)
0.0.152	2025-02-12
mtxai-0.0.152-py3-none-any.whl (8 MB)
0.0.151	2025-02-12
mtxai-0.0.151-py3-none-any.whl (8 MB)
0.0.150	2025-02-12
0.0.149	2025-02-12
0.0.148	2025-02-12
0.0.147	2025-02-11
mtxai-0.0.147-py3-none-any.whl (8 MB)
0.0.146	2025-02-11
0.0.145	2025-02-11
mtxai-0.0.145-py3-none-any.whl (8 MB)
0.0.144	2025-02-11
0.0.143	2025-02-11
mtxai-0.0.143-py3-none-any.whl (8 MB)
0.0.142	2025-02-11
mtxai-0.0.142-py3-none-any.whl (8 MB)
0.0.141	2025-02-11
0.0.140	2025-02-11
mtxai-0.0.140-py3-none-any.whl (8 MB)
0.0.139	2025-02-11
0.0.138	2025-02-11
0.0.137	2025-02-11
mtxai-0.0.137-py3-none-any.whl (8 MB)
0.0.136	2025-02-11
0.0.135	2025-02-11
0.0.134	2025-02-11
mtxai-0.0.134-py3-none-any.whl (8 MB)
0.0.133	2025-02-11
mtxai-0.0.133-py3-none-any.whl (8 MB)
0.0.132	2025-02-11
0.0.131	2025-02-11
0.0.130	2025-02-11
0.0.129	2025-02-11
mtxai-0.0.129-py3-none-any.whl (8 MB)
0.0.128	2025-02-10
0.0.127	2025-02-10
0.0.126	2025-02-10
0.0.125	2025-02-10
mtxai-0.0.125-py3-none-any.whl (8 MB)
0.0.124	2025-02-10
0.0.123	2025-02-10
mtxai-0.0.123-py3-none-any.whl (8 MB)
0.0.122	2025-02-10
0.0.121	2025-02-10
0.0.120	2025-02-09
0.0.119	2025-02-09
0.0.118	2025-02-09
mtxai-0.0.118-py3-none-any.whl (8 MB)
0.0.117	2025-02-09
0.0.116	2025-02-09
0.0.115	2025-02-09
mtxai-0.0.115-py3-none-any.whl (8 MB)
0.0.114	2025-02-09
0.0.113	2025-02-09
mtxai-0.0.113-py3-none-any.whl (9 MB)
0.0.112	2025-02-09
0.0.111	2025-02-09
mtxai-0.0.111-py3-none-any.whl (9 MB)
0.0.110	2025-02-09
mtxai-0.0.110-py3-none-any.whl (9 MB)
0.0.109	2025-02-08
mtxai-0.0.109-py3-none-any.whl (9 MB)
0.0.108	2025-02-08
0.0.107	2025-02-08
0.0.106	2025-02-08
mtxai-0.0.106-py3-none-any.whl (9 MB)
0.0.105	2025-02-08
mtxai-0.0.105-py3-none-any.whl (9 MB)
0.0.104	2025-02-07
0.0.103	2025-02-07
mtxai-0.0.103-py3-none-any.whl (9 MB)
0.0.102	2025-02-07
mtxai-0.0.102-py3-none-any.whl (9 MB)
0.0.101	2025-02-07
0.0.100	2025-02-07
mtxai-0.0.100-py3-none-any.whl (9 MB)
0.0.99	2025-02-07
0.0.98	2025-02-07
0.0.97	2025-02-07
0.0.96	2025-02-07
0.0.95	2025-02-07
0.0.94	2025-02-06
0.0.93	2025-02-06
0.0.92	2025-02-06
0.0.91	2025-02-06
0.0.90	2025-02-06
mtxai-0.0.90-py3-none-any.whl (9 MB)
0.0.89	2025-02-06
0.0.88	2025-02-06
0.0.87	2025-02-06
0.0.86	2025-02-06
0.0.84	2025-02-06
0.0.82	2025-02-05
0.0.81	2025-02-05
0.0.80	2025-02-05
0.0.79	2025-02-05
0.0.78	2025-02-05
mtxai-0.0.78-py3-none-any.whl (9 MB)
0.0.77	2025-02-05
0.0.76	2025-02-05
0.0.75	2025-02-04
0.0.74	2025-02-04
mtxai-0.0.74-py3-none-any.whl (9 MB)
0.0.73	2025-02-04
0.0.72	2025-02-04
0.0.71	2025-02-04
0.0.70	2025-02-04
0.0.69	2025-02-04
0.0.68	2025-02-04
mtxai-0.0.68-py3-none-any.whl (9 MB)
0.0.67	2025-02-04
0.0.66	2025-02-04
0.0.65	2025-02-04
0.0.64	2025-02-04
mtxai-0.0.64-py3-none-any.whl (9 MB)
0.0.63	2025-02-04
mtxai-0.0.63-py3-none-any.whl (9 MB)
0.0.62	2025-02-03
0.0.61	2025-02-03
mtxai-0.0.61-py3-none-any.whl (9 MB)
0.0.60	2025-02-03
mtxai-0.0.60-py3-none-any.whl (9 MB)
0.0.59	2025-02-03
mtxai-0.0.59-py3-none-any.whl (9 MB)
0.0.58	2025-02-03
0.0.57	2025-02-02
mtxai-0.0.57-py3-none-any.whl (9 MB)
0.0.56	2025-02-02
mtxai-0.0.56-py3-none-any.whl (9 MB)
0.0.55	2025-02-02
mtxai-0.0.55-py3-none-any.whl (9 MB)
0.0.54	2025-02-02
0.0.53	2025-02-02
mtxai-0.0.53-py3-none-any.whl (9 MB)
0.0.52	2025-02-02
mtxai-0.0.52-py3-none-any.whl (9 MB)
0.0.51	2025-02-02
0.0.50	2025-02-02
0.0.49	2025-02-02
0.0.48	2025-02-02
mtxai-0.0.48-py3-none-any.whl (9 MB)
0.0.47	2025-02-02
0.0.46	2025-02-02
0.0.45	2025-02-02
0.0.44	2025-02-02
0.0.43	2025-02-01
0.0.42	2025-02-01
0.0.41	2025-01-31
0.0.40	2025-01-31
0.0.39	2025-01-31
0.0.38	2025-01-31
0.0.37	2025-01-31
0.0.36	2025-01-31
0.0.35	2025-01-31
mtxai-0.0.35-py3-none-any.whl (11 MB)
0.0.34	2025-01-30
0.0.33	2025-01-30
0.0.32	2025-01-30
mtxai-0.0.32-py3-none-any.whl (9 MB)
0.0.31	2025-01-30
mtxai-0.0.31-py3-none-any.whl (9 MB)
0.0.30	2025-01-29
0.0.29	2025-01-29
mtxai-0.0.29-py3-none-any.whl (9 MB)
0.0.28	2025-01-29
mtxai-0.0.28-py3-none-any.whl (9 MB)
0.0.27	2025-01-29
mtxai-0.0.27-py3-none-any.whl (9 MB)
0.0.26	2025-01-29
mtxai-0.0.26-py3-none-any.whl (9 MB)
0.0.25	2025-01-29
mtxai-0.0.25-py3-none-any.whl (9 MB)
0.0.24	2025-01-28
0.0.23	2025-01-28
0.0.22	2025-01-28
mtxai-0.0.22-py3-none-any.whl (9 MB)
0.0.21	2025-01-28
0.0.20	2025-01-28
0.0.19	2025-01-27
0.0.18	2025-01-27
0.0.17	2025-01-27
0.0.16	2025-01-27
0.0.15	2025-01-25
0.0.14	2025-01-25
0.0.12	2025-01-25
0.0.11	2025-01-25
0.0.10	2025-01-25
mtxai-0.0.10-py3-none-any.whl (9 MB)
0.0.9	2025-01-25
0.0.7	2025-01-25
0.0.6	2025-01-24
0.0.3	2025-01-24
mtxai-0.0.3-py3-none-any.whl (9 MB)
0.0.2	2025-01-24
mtxai-0.0.2-py3-none-any.whl (9 MB)
0.0.1	2025-01-24

Issues with this package?

• Search issues for this package
• Package or version missing? Open a new issue
• Something else? Open a new issue