2023-12-15T15:43:54,286 Created temporary directory: /tmp/pip-build-tracker-i_jec78q 2023-12-15T15:43:54,287 Initialized build tracking at /tmp/pip-build-tracker-i_jec78q 2023-12-15T15:43:54,288 Created build tracker: /tmp/pip-build-tracker-i_jec78q 2023-12-15T15:43:54,288 Entered build tracker: /tmp/pip-build-tracker-i_jec78q 2023-12-15T15:43:54,289 Created temporary directory: /tmp/pip-wheel-0trjtap3 2023-12-15T15:43:54,292 Created temporary directory: /tmp/pip-ephem-wheel-cache-hovvani1 2023-12-15T15:43:54,315 Looking in indexes: https://pypi.org/simple, https://www.piwheels.org/simple 2023-12-15T15:43:54,318 2 location(s) to search for versions of lm-datasets: 2023-12-15T15:43:54,318 * https://pypi.org/simple/lm-datasets/ 2023-12-15T15:43:54,318 * https://www.piwheels.org/simple/lm-datasets/ 2023-12-15T15:43:54,319 Fetching project page and analyzing links: https://pypi.org/simple/lm-datasets/ 2023-12-15T15:43:54,320 Getting page https://pypi.org/simple/lm-datasets/ 2023-12-15T15:43:54,321 Found index url https://pypi.org/simple/ 2023-12-15T15:43:54,535 Fetched page https://pypi.org/simple/lm-datasets/ as application/vnd.pypi.simple.v1+json 2023-12-15T15:43:54,538 Found link https://files.pythonhosted.org/packages/9b/0d/5770990521350ba5b53917d16dccdc5013fd63672f42fd27f67174c60db9/lm-datasets-0.0.1.tar.gz (from https://pypi.org/simple/lm-datasets/) (requires-python:>=3.9), version: 0.0.1 2023-12-15T15:43:54,538 Skipping link: No binaries permitted for lm-datasets: https://files.pythonhosted.org/packages/6b/85/6cb257967b761b8dd78d943a85febadc8b36d32b910c687ba55f8376a6b6/lm_datasets-0.0.1-py3-none-any.whl (from https://pypi.org/simple/lm-datasets/) (requires-python:>=3.9) 2023-12-15T15:43:54,539 Found link https://files.pythonhosted.org/packages/1d/9b/9b44fd4136d0c3a15d6a7d2f8b04fabf0820d7f67dd35e1536df4bd2d650/lm-datasets-0.0.2.tar.gz (from https://pypi.org/simple/lm-datasets/) (requires-python:>=3.9), version: 0.0.2 2023-12-15T15:43:54,540 Skipping link: No binaries permitted for lm-datasets: https://files.pythonhosted.org/packages/22/f5/4c7259f2d2bb09de19e300998118364ea0a37db23edb4f3ec11b14f34b0e/lm_datasets-0.0.2-py3-none-any.whl (from https://pypi.org/simple/lm-datasets/) (requires-python:>=3.9) 2023-12-15T15:43:54,540 Fetching project page and analyzing links: https://www.piwheels.org/simple/lm-datasets/ 2023-12-15T15:43:54,541 Getting page https://www.piwheels.org/simple/lm-datasets/ 2023-12-15T15:43:54,543 Found index url https://www.piwheels.org/simple/ 2023-12-15T15:43:54,709 Fetched page https://www.piwheels.org/simple/lm-datasets/ as text/html 2023-12-15T15:43:54,711 Skipping link: No binaries permitted for lm-datasets: https://www.piwheels.org/simple/lm-datasets/lm_datasets-0.0.1-py3-none-any.whl#sha256=6ef316726a52cd29802427b1fab885a56cb5ef03b5f191a198dcba5ec34f6ea0 (from https://www.piwheels.org/simple/lm-datasets/) (requires-python:>=3.9) 2023-12-15T15:43:54,712 Skipping link: not a file: https://www.piwheels.org/simple/lm-datasets/ 2023-12-15T15:43:54,712 Skipping link: not a file: https://pypi.org/simple/lm-datasets/ 2023-12-15T15:43:54,731 Given no hashes to check 1 links for project 'lm-datasets': discarding no candidates 2023-12-15T15:43:54,748 Collecting lm-datasets==0.0.2 2023-12-15T15:43:54,751 Created temporary directory: /tmp/pip-unpack-33n8soc8 2023-12-15T15:43:54,964 Downloading lm-datasets-0.0.2.tar.gz (142 kB) 2023-12-15T15:43:55,332 Added lm-datasets==0.0.2 from https://files.pythonhosted.org/packages/1d/9b/9b44fd4136d0c3a15d6a7d2f8b04fabf0820d7f67dd35e1536df4bd2d650/lm-datasets-0.0.2.tar.gz to build tracker '/tmp/pip-build-tracker-i_jec78q' 2023-12-15T15:43:55,341 Created temporary directory: /tmp/pip-build-env-8uutgmlj 2023-12-15T15:43:55,346 Installing build dependencies: started 2023-12-15T15:43:55,347 Running command pip subprocess to install build dependencies 2023-12-15T15:43:56,480 Using pip 23.3.1 from /usr/local/lib/python3.11/dist-packages/pip (python 3.11) 2023-12-15T15:43:57,003 Looking in indexes: https://pypi.org/simple, https://www.piwheels.org/simple 2023-12-15T15:43:58,404 Collecting setuptools>=61.0 2023-12-15T15:43:58,419 Using cached https://www.piwheels.org/simple/setuptools/setuptools-69.0.2-py3-none-any.whl (819 kB) 2023-12-15T15:44:01,014 Installing collected packages: setuptools 2023-12-15T15:44:03,333 Successfully installed setuptools-69.0.2 2023-12-15T15:44:03,874 Installing build dependencies: finished with status 'done' 2023-12-15T15:44:03,877 Getting requirements to build wheel: started 2023-12-15T15:44:03,879 Running command Getting requirements to build wheel 2023-12-15T15:44:04,651 running egg_info 2023-12-15T15:44:04,654 writing src/lm_datasets.egg-info/PKG-INFO 2023-12-15T15:44:04,669 writing dependency_links to src/lm_datasets.egg-info/dependency_links.txt 2023-12-15T15:44:04,670 writing entry points to src/lm_datasets.egg-info/entry_points.txt 2023-12-15T15:44:04,677 writing requirements to src/lm_datasets.egg-info/requires.txt 2023-12-15T15:44:04,679 writing top-level names to src/lm_datasets.egg-info/top_level.txt 2023-12-15T15:44:04,730 reading manifest file 'src/lm_datasets.egg-info/SOURCES.txt' 2023-12-15T15:44:04,736 adding license file 'LICENSE' 2023-12-15T15:44:04,744 writing manifest file 'src/lm_datasets.egg-info/SOURCES.txt' 2023-12-15T15:44:04,855 Getting requirements to build wheel: finished with status 'done' 2023-12-15T15:44:04,863 Installing backend dependencies: started 2023-12-15T15:44:04,864 Running command pip subprocess to install backend dependencies 2023-12-15T15:44:05,997 Using pip 23.3.1 from /usr/local/lib/python3.11/dist-packages/pip (python 3.11) 2023-12-15T15:44:06,524 Looking in indexes: https://pypi.org/simple, https://www.piwheels.org/simple 2023-12-15T15:44:07,000 Collecting wheel 2023-12-15T15:44:07,015 Using cached https://www.piwheels.org/simple/wheel/wheel-0.42.0-py3-none-any.whl (65 kB) 2023-12-15T15:44:09,258 Installing collected packages: wheel 2023-12-15T15:44:09,478 Creating /tmp/pip-build-env-8uutgmlj/normal/local/bin 2023-12-15T15:44:09,481 changing mode of /tmp/pip-build-env-8uutgmlj/normal/local/bin/wheel to 755 2023-12-15T15:44:09,492 Successfully installed wheel-0.42.0 2023-12-15T15:44:09,994 Installing backend dependencies: finished with status 'done' 2023-12-15T15:44:09,996 Created temporary directory: /tmp/pip-modern-metadata-ybylqvzn 2023-12-15T15:44:09,998 Preparing metadata (pyproject.toml): started 2023-12-15T15:44:09,999 Running command Preparing metadata (pyproject.toml) 2023-12-15T15:44:10,805 running dist_info 2023-12-15T15:44:10,810 creating /tmp/pip-modern-metadata-ybylqvzn/lm_datasets.egg-info 2023-12-15T15:44:10,814 writing /tmp/pip-modern-metadata-ybylqvzn/lm_datasets.egg-info/PKG-INFO 2023-12-15T15:44:10,828 writing dependency_links to /tmp/pip-modern-metadata-ybylqvzn/lm_datasets.egg-info/dependency_links.txt 2023-12-15T15:44:10,830 writing entry points to /tmp/pip-modern-metadata-ybylqvzn/lm_datasets.egg-info/entry_points.txt 2023-12-15T15:44:10,837 writing requirements to /tmp/pip-modern-metadata-ybylqvzn/lm_datasets.egg-info/requires.txt 2023-12-15T15:44:10,839 writing top-level names to /tmp/pip-modern-metadata-ybylqvzn/lm_datasets.egg-info/top_level.txt 2023-12-15T15:44:10,840 writing manifest file '/tmp/pip-modern-metadata-ybylqvzn/lm_datasets.egg-info/SOURCES.txt' 2023-12-15T15:44:10,899 reading manifest file '/tmp/pip-modern-metadata-ybylqvzn/lm_datasets.egg-info/SOURCES.txt' 2023-12-15T15:44:10,901 adding license file 'LICENSE' 2023-12-15T15:44:10,907 writing manifest file '/tmp/pip-modern-metadata-ybylqvzn/lm_datasets.egg-info/SOURCES.txt' 2023-12-15T15:44:10,909 creating '/tmp/pip-modern-metadata-ybylqvzn/lm_datasets-0.0.2.dist-info' 2023-12-15T15:44:11,067 Preparing metadata (pyproject.toml): finished with status 'done' 2023-12-15T15:44:11,073 Source in /tmp/pip-wheel-0trjtap3/lm-datasets_2a4d9461d86041a7adf7a764997e9d73 has version 0.0.2, which satisfies requirement lm-datasets==0.0.2 from https://files.pythonhosted.org/packages/1d/9b/9b44fd4136d0c3a15d6a7d2f8b04fabf0820d7f67dd35e1536df4bd2d650/lm-datasets-0.0.2.tar.gz 2023-12-15T15:44:11,074 Removed lm-datasets==0.0.2 from https://files.pythonhosted.org/packages/1d/9b/9b44fd4136d0c3a15d6a7d2f8b04fabf0820d7f67dd35e1536df4bd2d650/lm-datasets-0.0.2.tar.gz from build tracker '/tmp/pip-build-tracker-i_jec78q' 2023-12-15T15:44:11,081 Created temporary directory: /tmp/pip-unpack-zoprfmi0 2023-12-15T15:44:11,081 Created temporary directory: /tmp/pip-unpack-ip_dnml4 2023-12-15T15:44:11,181 Building wheels for collected packages: lm-datasets 2023-12-15T15:44:11,185 Created temporary directory: /tmp/pip-wheel-ie2g9ozb 2023-12-15T15:44:11,186 Destination directory: /tmp/pip-wheel-ie2g9ozb 2023-12-15T15:44:11,188 Building wheel for lm-datasets (pyproject.toml): started 2023-12-15T15:44:11,189 Running command Building wheel for lm-datasets (pyproject.toml) 2023-12-15T15:44:11,951 running bdist_wheel 2023-12-15T15:44:11,967 running build 2023-12-15T15:44:11,967 running build_py 2023-12-15T15:44:11,972 creating build 2023-12-15T15:44:11,972 creating build/lib 2023-12-15T15:44:11,973 creating build/lib/lm_datasets 2023-12-15T15:44:11,974 copying src/lm_datasets/train_sp_tokenizer.py -> build/lib/lm_datasets 2023-12-15T15:44:11,976 copying src/lm_datasets/chunkify_datasets.py -> build/lib/lm_datasets 2023-12-15T15:44:11,979 copying src/lm_datasets/extract_text.py -> build/lib/lm_datasets 2023-12-15T15:44:11,980 copying src/lm_datasets/compose_dataset.py -> build/lib/lm_datasets 2023-12-15T15:44:11,982 copying src/lm_datasets/collect_metrics.py -> build/lib/lm_datasets 2023-12-15T15:44:11,984 copying src/lm_datasets/convert_parquet_to_jsonl.py -> build/lib/lm_datasets 2023-12-15T15:44:11,986 copying src/lm_datasets/__init__.py -> build/lib/lm_datasets 2023-12-15T15:44:11,987 copying src/lm_datasets/print_stats.py -> build/lib/lm_datasets 2023-12-15T15:44:11,989 copying src/lm_datasets/hf_tokenize_parquet_dataset.py -> build/lib/lm_datasets 2023-12-15T15:44:11,991 copying src/lm_datasets/shuffle_datasets.py -> build/lib/lm_datasets 2023-12-15T15:44:11,994 creating build/lib/lm_datasets/viewer 2023-12-15T15:44:11,995 copying src/lm_datasets/viewer/viewer_utils.py -> build/lib/lm_datasets/viewer 2023-12-15T15:44:11,997 copying src/lm_datasets/viewer/ngrok-app.py -> build/lib/lm_datasets/viewer 2023-12-15T15:44:11,998 copying src/lm_datasets/viewer/app.py -> build/lib/lm_datasets/viewer 2023-12-15T15:44:12,001 creating build/lib/lm_datasets/utils 2023-12-15T15:44:12,002 copying src/lm_datasets/utils/settings.py -> build/lib/lm_datasets/utils 2023-12-15T15:44:12,004 copying src/lm_datasets/utils/dataset_generator.py -> build/lib/lm_datasets/utils 2023-12-15T15:44:12,007 copying src/lm_datasets/utils/wikimedia.py -> build/lib/lm_datasets/utils 2023-12-15T15:44:12,009 copying src/lm_datasets/utils/shuffle_big_file.py -> build/lib/lm_datasets/utils 2023-12-15T15:44:12,012 copying src/lm_datasets/utils/__init__.py -> build/lib/lm_datasets/utils 2023-12-15T15:44:12,014 copying src/lm_datasets/utils/systems.py -> build/lib/lm_datasets/utils 2023-12-15T15:44:12,016 copying src/lm_datasets/utils/languages.py -> build/lib/lm_datasets/utils 2023-12-15T15:44:12,018 copying src/lm_datasets/utils/config.py -> build/lib/lm_datasets/utils 2023-12-15T15:44:12,020 copying src/lm_datasets/utils/dataframe.py -> build/lib/lm_datasets/utils 2023-12-15T15:44:12,022 creating build/lib/lm_datasets/io 2023-12-15T15:44:12,023 copying src/lm_datasets/io/conllu_file.py -> build/lib/lm_datasets/io 2023-12-15T15:44:12,025 copying src/lm_datasets/io/prevert_file.py -> build/lib/lm_datasets/io 2023-12-15T15:44:12,027 copying src/lm_datasets/io/__init__.py -> build/lib/lm_datasets/io 2023-12-15T15:44:12,028 copying src/lm_datasets/io/parquet.py -> build/lib/lm_datasets/io 2023-12-15T15:44:12,031 creating build/lib/lm_datasets/datasets 2023-12-15T15:44:12,032 copying src/lm_datasets/datasets/base.py -> build/lib/lm_datasets/datasets 2023-12-15T15:44:12,035 copying src/lm_datasets/datasets/dataset_registry.py -> build/lib/lm_datasets/datasets 2023-12-15T15:44:12,038 copying src/lm_datasets/datasets/jsonl_dataset.py -> build/lib/lm_datasets/datasets 2023-12-15T15:44:12,039 copying src/lm_datasets/datasets/__init__.py -> build/lib/lm_datasets/datasets 2023-12-15T15:44:12,041 copying src/lm_datasets/datasets/parquet_dataset.py -> build/lib/lm_datasets/datasets 2023-12-15T15:44:12,042 copying src/lm_datasets/datasets/hf_dataset.py -> build/lib/lm_datasets/datasets 2023-12-15T15:44:12,045 creating build/lib/lm_datasets/commands 2023-12-15T15:44:12,046 copying src/lm_datasets/commands/print_stats_command.py -> build/lib/lm_datasets/commands 2023-12-15T15:44:12,048 copying src/lm_datasets/commands/compose_command.py -> build/lib/lm_datasets/commands 2023-12-15T15:44:12,049 copying src/lm_datasets/commands/shuffle_command.py -> build/lib/lm_datasets/commands 2023-12-15T15:44:12,051 copying src/lm_datasets/commands/collect_metrics_command.py -> build/lib/lm_datasets/commands 2023-12-15T15:44:12,053 copying src/lm_datasets/commands/extract_text_command.py -> build/lib/lm_datasets/commands 2023-12-15T15:44:12,055 copying src/lm_datasets/commands/train_tokenizer_command.py -> build/lib/lm_datasets/commands 2023-12-15T15:44:12,057 copying src/lm_datasets/commands/lm_datasets_cli.py -> build/lib/lm_datasets/commands 2023-12-15T15:44:12,059 copying src/lm_datasets/commands/__init__.py -> build/lib/lm_datasets/commands 2023-12-15T15:44:12,060 copying src/lm_datasets/commands/hf_upload_command.py -> build/lib/lm_datasets/commands 2023-12-15T15:44:12,062 copying src/lm_datasets/commands/convert_parquet_to_jsonl_command.py -> build/lib/lm_datasets/commands 2023-12-15T15:44:12,064 copying src/lm_datasets/commands/chunkify_command.py -> build/lib/lm_datasets/commands 2023-12-15T15:44:12,066 creating build/lib/lm_datasets/datasets/no 2023-12-15T15:44:12,067 copying src/lm_datasets/datasets/no/nak.py -> build/lib/lm_datasets/datasets/no 2023-12-15T15:44:12,069 copying src/lm_datasets/datasets/no/parliamentary_proceedings.py -> build/lib/lm_datasets/datasets/no 2023-12-15T15:44:12,070 copying src/lm_datasets/datasets/no/norwegian_cc.py -> build/lib/lm_datasets/datasets/no 2023-12-15T15:44:12,072 copying src/lm_datasets/datasets/no/parlamint.py -> build/lib/lm_datasets/datasets/no 2023-12-15T15:44:12,074 copying src/lm_datasets/datasets/no/__init__.py -> build/lib/lm_datasets/datasets/no 2023-12-15T15:44:12,075 copying src/lm_datasets/datasets/no/sakspapir_nno.py -> build/lib/lm_datasets/datasets/no 2023-12-15T15:44:12,077 copying src/lm_datasets/datasets/no/maalfrid_2021.py -> build/lib/lm_datasets/datasets/no 2023-12-15T15:44:12,079 copying src/lm_datasets/datasets/no/nbdigital.py -> build/lib/lm_datasets/datasets/no 2023-12-15T15:44:12,081 creating build/lib/lm_datasets/datasets/fr 2023-12-15T15:44:12,082 copying src/lm_datasets/datasets/fr/cabernet.py -> build/lib/lm_datasets/datasets/fr 2023-12-15T15:44:12,084 copying src/lm_datasets/datasets/fr/__init__.py -> build/lib/lm_datasets/datasets/fr 2023-12-15T15:44:12,086 creating build/lib/lm_datasets/datasets/ro 2023-12-15T15:44:12,086 copying src/lm_datasets/datasets/ro/marcell_legislative_subcorpus_v2.py -> build/lib/lm_datasets/datasets/ro 2023-12-15T15:44:12,088 copying src/lm_datasets/datasets/ro/__init__.py -> build/lib/lm_datasets/datasets/ro 2023-12-15T15:44:12,090 creating build/lib/lm_datasets/datasets/et 2023-12-15T15:44:12,091 copying src/lm_datasets/datasets/et/enc.py -> build/lib/lm_datasets/datasets/et 2023-12-15T15:44:12,093 copying src/lm_datasets/datasets/et/ekspress.py -> build/lib/lm_datasets/datasets/et 2023-12-15T15:44:12,095 copying src/lm_datasets/datasets/et/__init__.py -> build/lib/lm_datasets/datasets/et 2023-12-15T15:44:12,096 copying src/lm_datasets/datasets/et/estonian_reference_corpus.py -> build/lib/lm_datasets/datasets/et 2023-12-15T15:44:12,099 creating build/lib/lm_datasets/datasets/sl 2023-12-15T15:44:12,100 copying src/lm_datasets/datasets/sl/cc_gigafida.py -> build/lib/lm_datasets/datasets/sl 2023-12-15T15:44:12,102 copying src/lm_datasets/datasets/sl/__init__.py -> build/lib/lm_datasets/datasets/sl 2023-12-15T15:44:12,103 copying src/lm_datasets/datasets/sl/academic_slovene_kas.py -> build/lib/lm_datasets/datasets/sl 2023-12-15T15:44:12,105 copying src/lm_datasets/datasets/sl/slwac_web.py -> build/lib/lm_datasets/datasets/sl 2023-12-15T15:44:12,107 creating build/lib/lm_datasets/datasets/bg 2023-12-15T15:44:12,108 copying src/lm_datasets/datasets/bg/bulgarian_news.py -> build/lib/lm_datasets/datasets/bg 2023-12-15T15:44:12,110 copying src/lm_datasets/datasets/bg/bgnc_news_corpus.py -> build/lib/lm_datasets/datasets/bg 2023-12-15T15:44:12,112 copying src/lm_datasets/datasets/bg/bulnc.py -> build/lib/lm_datasets/datasets/bg 2023-12-15T15:44:12,113 copying src/lm_datasets/datasets/bg/__init__.py -> build/lib/lm_datasets/datasets/bg 2023-12-15T15:44:12,114 copying src/lm_datasets/datasets/bg/bgnc_admin_eur.py -> build/lib/lm_datasets/datasets/bg 2023-12-15T15:44:12,117 creating build/lib/lm_datasets/datasets/multilingual 2023-12-15T15:44:12,117 copying src/lm_datasets/datasets/multilingual/macocu.py -> build/lib/lm_datasets/datasets/multilingual 2023-12-15T15:44:12,120 copying src/lm_datasets/datasets/multilingual/legal_mc4.py -> build/lib/lm_datasets/datasets/multilingual 2023-12-15T15:44:12,121 copying src/lm_datasets/datasets/multilingual/wikimedia.py -> build/lib/lm_datasets/datasets/multilingual 2023-12-15T15:44:12,123 copying src/lm_datasets/datasets/multilingual/redpajama.py -> build/lib/lm_datasets/datasets/multilingual 2023-12-15T15:44:12,125 copying src/lm_datasets/datasets/multilingual/__init__.py -> build/lib/lm_datasets/datasets/multilingual 2023-12-15T15:44:12,126 copying src/lm_datasets/datasets/multilingual/colossal_oscar.py -> build/lib/lm_datasets/datasets/multilingual 2023-12-15T15:44:12,129 copying src/lm_datasets/datasets/multilingual/curlicat.py -> build/lib/lm_datasets/datasets/multilingual 2023-12-15T15:44:12,131 copying src/lm_datasets/datasets/multilingual/eurlex.py -> build/lib/lm_datasets/datasets/multilingual 2023-12-15T15:44:12,133 creating build/lib/lm_datasets/datasets/mt 2023-12-15T15:44:12,134 copying src/lm_datasets/datasets/mt/korpus_malti.py -> build/lib/lm_datasets/datasets/mt 2023-12-15T15:44:12,136 copying src/lm_datasets/datasets/mt/__init__.py -> build/lib/lm_datasets/datasets/mt 2023-12-15T15:44:12,138 creating build/lib/lm_datasets/datasets/lt 2023-12-15T15:44:12,139 copying src/lm_datasets/datasets/lt/seimas_lt_en.py -> build/lib/lm_datasets/datasets/lt 2023-12-15T15:44:12,141 creating build/lib/lm_datasets/datasets/sk 2023-12-15T15:44:12,142 copying src/lm_datasets/datasets/sk/sk_court_decisions.py -> build/lib/lm_datasets/datasets/sk 2023-12-15T15:44:12,144 copying src/lm_datasets/datasets/sk/sk_laws.py -> build/lib/lm_datasets/datasets/sk 2023-12-15T15:44:12,146 copying src/lm_datasets/datasets/sk/__init__.py -> build/lib/lm_datasets/datasets/sk 2023-12-15T15:44:12,148 creating build/lib/lm_datasets/datasets/nl 2023-12-15T15:44:12,149 copying src/lm_datasets/datasets/nl/__init__.py -> build/lib/lm_datasets/datasets/nl 2023-12-15T15:44:12,150 copying src/lm_datasets/datasets/nl/sonar_new_media.py -> build/lib/lm_datasets/datasets/nl 2023-12-15T15:44:12,152 copying src/lm_datasets/datasets/nl/sonar.py -> build/lib/lm_datasets/datasets/nl 2023-12-15T15:44:12,154 creating build/lib/lm_datasets/datasets/el 2023-12-15T15:44:12,155 copying src/lm_datasets/datasets/el/__init__.py -> build/lib/lm_datasets/datasets/el 2023-12-15T15:44:12,157 copying src/lm_datasets/datasets/el/greek_legal_code.py -> build/lib/lm_datasets/datasets/el 2023-12-15T15:44:12,159 copying src/lm_datasets/datasets/el/greek_web_corpus.py -> build/lib/lm_datasets/datasets/el 2023-12-15T15:44:12,161 creating build/lib/lm_datasets/datasets/sv 2023-12-15T15:44:12,162 copying src/lm_datasets/datasets/sv/__init__.py -> build/lib/lm_datasets/datasets/sv 2023-12-15T15:44:12,163 copying src/lm_datasets/datasets/sv/sv_gigaword.py -> build/lib/lm_datasets/datasets/sv 2023-12-15T15:44:12,165 creating build/lib/lm_datasets/datasets/lv 2023-12-15T15:44:12,167 copying src/lm_datasets/datasets/lv/state_related_latvian_web.py -> build/lib/lm_datasets/datasets/lv 2023-12-15T15:44:12,168 copying src/lm_datasets/datasets/lv/__init__.py -> build/lib/lm_datasets/datasets/lv 2023-12-15T15:44:12,170 creating build/lib/lm_datasets/datasets/es 2023-12-15T15:44:12,171 copying src/lm_datasets/datasets/es/escorpius.py -> build/lib/lm_datasets/datasets/es 2023-12-15T15:44:12,172 copying src/lm_datasets/datasets/es/spanish_legal.py -> build/lib/lm_datasets/datasets/es 2023-12-15T15:44:12,174 copying src/lm_datasets/datasets/es/__init__.py -> build/lib/lm_datasets/datasets/es 2023-12-15T15:44:12,176 creating build/lib/lm_datasets/datasets/fi 2023-12-15T15:44:12,177 copying src/lm_datasets/datasets/fi/ylenews.py -> build/lib/lm_datasets/datasets/fi 2023-12-15T15:44:12,179 copying src/lm_datasets/datasets/fi/__init__.py -> build/lib/lm_datasets/datasets/fi 2023-12-15T15:44:12,180 creating build/lib/lm_datasets/datasets/code 2023-12-15T15:44:12,181 copying src/lm_datasets/datasets/code/__init__.py -> build/lib/lm_datasets/datasets/code 2023-12-15T15:44:12,183 copying src/lm_datasets/datasets/code/starcoder.py -> build/lib/lm_datasets/datasets/code 2023-12-15T15:44:12,185 creating build/lib/lm_datasets/datasets/pl 2023-12-15T15:44:12,186 copying src/lm_datasets/datasets/pl/pl_nkjp.py -> build/lib/lm_datasets/datasets/pl 2023-12-15T15:44:12,188 copying src/lm_datasets/datasets/pl/luna_pl.py -> build/lib/lm_datasets/datasets/pl 2023-12-15T15:44:12,189 copying src/lm_datasets/datasets/pl/pl_parliamentary_corpus.py -> build/lib/lm_datasets/datasets/pl 2023-12-15T15:44:12,192 creating build/lib/lm_datasets/datasets/it 2023-12-15T15:44:12,193 copying src/lm_datasets/datasets/it/__init__.py -> build/lib/lm_datasets/datasets/it 2023-12-15T15:44:12,194 copying src/lm_datasets/datasets/it/itwac.py -> build/lib/lm_datasets/datasets/it 2023-12-15T15:44:12,196 creating build/lib/lm_datasets/datasets/pt 2023-12-15T15:44:12,197 copying src/lm_datasets/datasets/pt/parlamento_pt.py -> build/lib/lm_datasets/datasets/pt 2023-12-15T15:44:12,199 copying src/lm_datasets/datasets/pt/brwac.py -> build/lib/lm_datasets/datasets/pt 2023-12-15T15:44:12,201 creating build/lib/lm_datasets/datasets/da 2023-12-15T15:44:12,202 copying src/lm_datasets/datasets/da/danish_parliament_corpus.py -> build/lib/lm_datasets/datasets/da 2023-12-15T15:44:12,204 copying src/lm_datasets/datasets/da/__init__.py -> build/lib/lm_datasets/datasets/da 2023-12-15T15:44:12,205 copying src/lm_datasets/datasets/da/dk_clarin.py -> build/lib/lm_datasets/datasets/da 2023-12-15T15:44:12,207 copying src/lm_datasets/datasets/da/danewsroom.py -> build/lib/lm_datasets/datasets/da 2023-12-15T15:44:12,209 copying src/lm_datasets/datasets/da/danish_gigaword.py -> build/lib/lm_datasets/datasets/da 2023-12-15T15:44:12,211 creating build/lib/lm_datasets/datasets/cs 2023-12-15T15:44:12,212 copying src/lm_datasets/datasets/cs/__init__.py -> build/lib/lm_datasets/datasets/cs 2023-12-15T15:44:12,214 copying src/lm_datasets/datasets/cs/syn_v9.py -> build/lib/lm_datasets/datasets/cs 2023-12-15T15:44:12,215 copying src/lm_datasets/datasets/cs/cs_en_parallel.py -> build/lib/lm_datasets/datasets/cs 2023-12-15T15:44:12,218 creating build/lib/lm_datasets/datasets/uk 2023-12-15T15:44:12,219 copying src/lm_datasets/datasets/uk/__init__.py -> build/lib/lm_datasets/datasets/uk 2023-12-15T15:44:12,220 copying src/lm_datasets/datasets/uk/uk_laws.py -> build/lib/lm_datasets/datasets/uk 2023-12-15T15:44:12,222 creating build/lib/lm_datasets/datasets/ga 2023-12-15T15:44:12,225 copying src/lm_datasets/datasets/ga/__init__.py -> build/lib/lm_datasets/datasets/ga 2023-12-15T15:44:12,227 copying src/lm_datasets/datasets/ga/ga_universal_dependencies.py -> build/lib/lm_datasets/datasets/ga 2023-12-15T15:44:12,228 copying src/lm_datasets/datasets/ga/ga_bilingual_legistation.py -> build/lib/lm_datasets/datasets/ga 2023-12-15T15:44:12,231 creating build/lib/lm_datasets/datasets/sr 2023-12-15T15:44:12,232 copying src/lm_datasets/datasets/sr/srpkor.py -> build/lib/lm_datasets/datasets/sr 2023-12-15T15:44:12,233 copying src/lm_datasets/datasets/sr/__init__.py -> build/lib/lm_datasets/datasets/sr 2023-12-15T15:44:12,235 creating build/lib/lm_datasets/datasets/en 2023-12-15T15:44:12,236 copying src/lm_datasets/datasets/en/wikihow.py -> build/lib/lm_datasets/datasets/en 2023-12-15T15:44:12,237 copying src/lm_datasets/datasets/en/pes2o.py -> build/lib/lm_datasets/datasets/en 2023-12-15T15:44:12,239 copying src/lm_datasets/datasets/en/__init__.py -> build/lib/lm_datasets/datasets/en 2023-12-15T15:44:12,240 copying src/lm_datasets/datasets/en/pile_of_law.py -> build/lib/lm_datasets/datasets/en 2023-12-15T15:44:12,242 copying src/lm_datasets/datasets/en/proof_pile.py -> build/lib/lm_datasets/datasets/en 2023-12-15T15:44:12,244 copying src/lm_datasets/datasets/en/dialogstudio.py -> build/lib/lm_datasets/datasets/en 2023-12-15T15:44:12,245 copying src/lm_datasets/datasets/en/math_amps.py -> build/lib/lm_datasets/datasets/en 2023-12-15T15:44:12,247 creating build/lib/lm_datasets/datasets/de 2023-12-15T15:44:12,248 copying src/lm_datasets/datasets/de/dewac.py -> build/lib/lm_datasets/datasets/de 2023-12-15T15:44:12,250 copying src/lm_datasets/datasets/de/openlegaldata.py -> build/lib/lm_datasets/datasets/de 2023-12-15T15:44:12,252 copying src/lm_datasets/datasets/de/__init__.py -> build/lib/lm_datasets/datasets/de 2023-12-15T15:44:12,253 creating build/lib/lm_datasets/datasets/eu 2023-12-15T15:44:12,254 copying src/lm_datasets/datasets/eu/euscrawl.py -> build/lib/lm_datasets/datasets/eu 2023-12-15T15:44:12,256 copying src/lm_datasets/datasets/eu/__init__.py -> build/lib/lm_datasets/datasets/eu 2023-12-15T15:44:12,258 creating build/lib/lm_datasets/datasets/hr 2023-12-15T15:44:12,259 copying src/lm_datasets/datasets/hr/styria_news.py -> build/lib/lm_datasets/datasets/hr 2023-12-15T15:44:12,261 copying src/lm_datasets/datasets/hr/__init__.py -> build/lib/lm_datasets/datasets/hr 2023-12-15T15:44:12,262 copying src/lm_datasets/datasets/hr/hrwac.py -> build/lib/lm_datasets/datasets/hr 2023-12-15T15:44:12,264 copying src/lm_datasets/datasets/hr/croatian_news_engri.py -> build/lib/lm_datasets/datasets/hr 2023-12-15T15:44:12,266 running egg_info 2023-12-15T15:44:12,269 writing src/lm_datasets.egg-info/PKG-INFO 2023-12-15T15:44:12,284 writing dependency_links to src/lm_datasets.egg-info/dependency_links.txt 2023-12-15T15:44:12,285 writing entry points to src/lm_datasets.egg-info/entry_points.txt 2023-12-15T15:44:12,292 writing requirements to src/lm_datasets.egg-info/requires.txt 2023-12-15T15:44:12,293 writing top-level names to src/lm_datasets.egg-info/top_level.txt 2023-12-15T15:44:12,328 reading manifest file 'src/lm_datasets.egg-info/SOURCES.txt' 2023-12-15T15:44:12,334 adding license file 'LICENSE' 2023-12-15T15:44:12,342 writing manifest file 'src/lm_datasets.egg-info/SOURCES.txt' 2023-12-15T15:44:12,380 installing to build/bdist.linux-armv7l/wheel 2023-12-15T15:44:12,381 running install 2023-12-15T15:44:12,406 running install_lib 2023-12-15T15:44:12,411 creating build/bdist.linux-armv7l 2023-12-15T15:44:12,411 creating build/bdist.linux-armv7l/wheel 2023-12-15T15:44:12,413 creating build/bdist.linux-armv7l/wheel/lm_datasets 2023-12-15T15:44:12,414 copying build/lib/lm_datasets/train_sp_tokenizer.py -> build/bdist.linux-armv7l/wheel/lm_datasets 2023-12-15T15:44:12,417 copying build/lib/lm_datasets/chunkify_datasets.py -> build/bdist.linux-armv7l/wheel/lm_datasets 2023-12-15T15:44:12,419 copying build/lib/lm_datasets/extract_text.py -> build/bdist.linux-armv7l/wheel/lm_datasets 2023-12-15T15:44:12,421 copying build/lib/lm_datasets/compose_dataset.py -> build/bdist.linux-armv7l/wheel/lm_datasets 2023-12-15T15:44:12,423 creating build/bdist.linux-armv7l/wheel/lm_datasets/viewer 2023-12-15T15:44:12,424 copying build/lib/lm_datasets/viewer/viewer_utils.py -> build/bdist.linux-armv7l/wheel/lm_datasets/viewer 2023-12-15T15:44:12,426 copying build/lib/lm_datasets/viewer/ngrok-app.py -> build/bdist.linux-armv7l/wheel/lm_datasets/viewer 2023-12-15T15:44:12,428 copying build/lib/lm_datasets/viewer/app.py -> build/bdist.linux-armv7l/wheel/lm_datasets/viewer 2023-12-15T15:44:12,430 copying build/lib/lm_datasets/collect_metrics.py -> build/bdist.linux-armv7l/wheel/lm_datasets 2023-12-15T15:44:12,432 copying build/lib/lm_datasets/convert_parquet_to_jsonl.py -> build/bdist.linux-armv7l/wheel/lm_datasets 2023-12-15T15:44:12,434 creating build/bdist.linux-armv7l/wheel/lm_datasets/utils 2023-12-15T15:44:12,435 copying build/lib/lm_datasets/utils/settings.py -> build/bdist.linux-armv7l/wheel/lm_datasets/utils 2023-12-15T15:44:12,437 copying build/lib/lm_datasets/utils/dataset_generator.py -> build/bdist.linux-armv7l/wheel/lm_datasets/utils 2023-12-15T15:44:12,439 copying build/lib/lm_datasets/utils/wikimedia.py -> build/bdist.linux-armv7l/wheel/lm_datasets/utils 2023-12-15T15:44:12,442 copying build/lib/lm_datasets/utils/shuffle_big_file.py -> build/bdist.linux-armv7l/wheel/lm_datasets/utils 2023-12-15T15:44:12,444 copying build/lib/lm_datasets/utils/__init__.py -> build/bdist.linux-armv7l/wheel/lm_datasets/utils 2023-12-15T15:44:12,446 copying build/lib/lm_datasets/utils/systems.py -> build/bdist.linux-armv7l/wheel/lm_datasets/utils 2023-12-15T15:44:12,448 copying build/lib/lm_datasets/utils/languages.py -> build/bdist.linux-armv7l/wheel/lm_datasets/utils 2023-12-15T15:44:12,450 copying build/lib/lm_datasets/utils/config.py -> build/bdist.linux-armv7l/wheel/lm_datasets/utils 2023-12-15T15:44:12,453 copying build/lib/lm_datasets/utils/dataframe.py -> build/bdist.linux-armv7l/wheel/lm_datasets/utils 2023-12-15T15:44:12,455 copying build/lib/lm_datasets/__init__.py -> build/bdist.linux-armv7l/wheel/lm_datasets 2023-12-15T15:44:12,457 creating build/bdist.linux-armv7l/wheel/lm_datasets/io 2023-12-15T15:44:12,458 copying build/lib/lm_datasets/io/conllu_file.py -> build/bdist.linux-armv7l/wheel/lm_datasets/io 2023-12-15T15:44:12,460 copying build/lib/lm_datasets/io/prevert_file.py -> build/bdist.linux-armv7l/wheel/lm_datasets/io 2023-12-15T15:44:12,462 copying build/lib/lm_datasets/io/__init__.py -> build/bdist.linux-armv7l/wheel/lm_datasets/io 2023-12-15T15:44:12,464 copying build/lib/lm_datasets/io/parquet.py -> build/bdist.linux-armv7l/wheel/lm_datasets/io 2023-12-15T15:44:12,467 creating build/bdist.linux-armv7l/wheel/lm_datasets/datasets 2023-12-15T15:44:12,468 creating build/bdist.linux-armv7l/wheel/lm_datasets/datasets/no 2023-12-15T15:44:12,469 copying build/lib/lm_datasets/datasets/no/nak.py -> build/bdist.linux-armv7l/wheel/lm_datasets/datasets/no 2023-12-15T15:44:12,471 copying build/lib/lm_datasets/datasets/no/parliamentary_proceedings.py -> build/bdist.linux-armv7l/wheel/lm_datasets/datasets/no 2023-12-15T15:44:12,473 copying build/lib/lm_datasets/datasets/no/norwegian_cc.py -> build/bdist.linux-armv7l/wheel/lm_datasets/datasets/no 2023-12-15T15:44:12,475 copying build/lib/lm_datasets/datasets/no/parlamint.py -> build/bdist.linux-armv7l/wheel/lm_datasets/datasets/no 2023-12-15T15:44:12,477 copying build/lib/lm_datasets/datasets/no/__init__.py -> build/bdist.linux-armv7l/wheel/lm_datasets/datasets/no 2023-12-15T15:44:12,478 copying build/lib/lm_datasets/datasets/no/sakspapir_nno.py -> build/bdist.linux-armv7l/wheel/lm_datasets/datasets/no 2023-12-15T15:44:12,480 copying build/lib/lm_datasets/datasets/no/maalfrid_2021.py -> build/bdist.linux-armv7l/wheel/lm_datasets/datasets/no 2023-12-15T15:44:12,482 copying build/lib/lm_datasets/datasets/no/nbdigital.py -> build/bdist.linux-armv7l/wheel/lm_datasets/datasets/no 2023-12-15T15:44:12,484 creating build/bdist.linux-armv7l/wheel/lm_datasets/datasets/fr 2023-12-15T15:44:12,485 copying build/lib/lm_datasets/datasets/fr/cabernet.py -> build/bdist.linux-armv7l/wheel/lm_datasets/datasets/fr 2023-12-15T15:44:12,487 copying build/lib/lm_datasets/datasets/fr/__init__.py -> build/bdist.linux-armv7l/wheel/lm_datasets/datasets/fr 2023-12-15T15:44:12,489 creating build/bdist.linux-armv7l/wheel/lm_datasets/datasets/ro 2023-12-15T15:44:12,490 copying build/lib/lm_datasets/datasets/ro/marcell_legislative_subcorpus_v2.py -> build/bdist.linux-armv7l/wheel/lm_datasets/datasets/ro 2023-12-15T15:44:12,492 copying build/lib/lm_datasets/datasets/ro/__init__.py -> build/bdist.linux-armv7l/wheel/lm_datasets/datasets/ro 2023-12-15T15:44:12,494 creating build/bdist.linux-armv7l/wheel/lm_datasets/datasets/et 2023-12-15T15:44:12,495 copying build/lib/lm_datasets/datasets/et/enc.py -> build/bdist.linux-armv7l/wheel/lm_datasets/datasets/et 2023-12-15T15:44:12,496 copying build/lib/lm_datasets/datasets/et/ekspress.py -> build/bdist.linux-armv7l/wheel/lm_datasets/datasets/et 2023-12-15T15:44:12,498 copying build/lib/lm_datasets/datasets/et/__init__.py -> build/bdist.linux-armv7l/wheel/lm_datasets/datasets/et 2023-12-15T15:44:12,500 copying build/lib/lm_datasets/datasets/et/estonian_reference_corpus.py -> build/bdist.linux-armv7l/wheel/lm_datasets/datasets/et 2023-12-15T15:44:12,502 creating build/bdist.linux-armv7l/wheel/lm_datasets/datasets/sl 2023-12-15T15:44:12,503 copying build/lib/lm_datasets/datasets/sl/cc_gigafida.py -> build/bdist.linux-armv7l/wheel/lm_datasets/datasets/sl 2023-12-15T15:44:12,505 copying build/lib/lm_datasets/datasets/sl/__init__.py -> build/bdist.linux-armv7l/wheel/lm_datasets/datasets/sl 2023-12-15T15:44:12,506 copying build/lib/lm_datasets/datasets/sl/academic_slovene_kas.py -> build/bdist.linux-armv7l/wheel/lm_datasets/datasets/sl 2023-12-15T15:44:12,508 copying build/lib/lm_datasets/datasets/sl/slwac_web.py -> build/bdist.linux-armv7l/wheel/lm_datasets/datasets/sl 2023-12-15T15:44:12,510 copying build/lib/lm_datasets/datasets/base.py -> build/bdist.linux-armv7l/wheel/lm_datasets/datasets 2023-12-15T15:44:12,512 copying build/lib/lm_datasets/datasets/dataset_registry.py -> build/bdist.linux-armv7l/wheel/lm_datasets/datasets 2023-12-15T15:44:12,515 creating build/bdist.linux-armv7l/wheel/lm_datasets/datasets/bg 2023-12-15T15:44:12,516 copying build/lib/lm_datasets/datasets/bg/bulgarian_news.py -> build/bdist.linux-armv7l/wheel/lm_datasets/datasets/bg 2023-12-15T15:44:12,518 copying build/lib/lm_datasets/datasets/bg/bgnc_news_corpus.py -> build/bdist.linux-armv7l/wheel/lm_datasets/datasets/bg 2023-12-15T15:44:12,520 copying build/lib/lm_datasets/datasets/bg/bulnc.py -> build/bdist.linux-armv7l/wheel/lm_datasets/datasets/bg 2023-12-15T15:44:12,522 copying build/lib/lm_datasets/datasets/bg/__init__.py -> build/bdist.linux-armv7l/wheel/lm_datasets/datasets/bg 2023-12-15T15:44:12,523 copying build/lib/lm_datasets/datasets/bg/bgnc_admin_eur.py -> build/bdist.linux-armv7l/wheel/lm_datasets/datasets/bg 2023-12-15T15:44:12,525 creating build/bdist.linux-armv7l/wheel/lm_datasets/datasets/multilingual 2023-12-15T15:44:12,526 copying build/lib/lm_datasets/datasets/multilingual/macocu.py -> build/bdist.linux-armv7l/wheel/lm_datasets/datasets/multilingual 2023-12-15T15:44:12,529 copying build/lib/lm_datasets/datasets/multilingual/legal_mc4.py -> build/bdist.linux-armv7l/wheel/lm_datasets/datasets/multilingual 2023-12-15T15:44:12,531 copying build/lib/lm_datasets/datasets/multilingual/wikimedia.py -> build/bdist.linux-armv7l/wheel/lm_datasets/datasets/multilingual 2023-12-15T15:44:12,533 copying build/lib/lm_datasets/datasets/multilingual/redpajama.py -> build/bdist.linux-armv7l/wheel/lm_datasets/datasets/multilingual 2023-12-15T15:44:12,535 copying build/lib/lm_datasets/datasets/multilingual/__init__.py -> build/bdist.linux-armv7l/wheel/lm_datasets/datasets/multilingual 2023-12-15T15:44:12,536 copying build/lib/lm_datasets/datasets/multilingual/colossal_oscar.py -> build/bdist.linux-armv7l/wheel/lm_datasets/datasets/multilingual 2023-12-15T15:44:12,538 copying build/lib/lm_datasets/datasets/multilingual/curlicat.py -> build/bdist.linux-armv7l/wheel/lm_datasets/datasets/multilingual 2023-12-15T15:44:12,540 copying build/lib/lm_datasets/datasets/multilingual/eurlex.py -> build/bdist.linux-armv7l/wheel/lm_datasets/datasets/multilingual 2023-12-15T15:44:12,542 creating build/bdist.linux-armv7l/wheel/lm_datasets/datasets/mt 2023-12-15T15:44:12,547 copying build/lib/lm_datasets/datasets/mt/korpus_malti.py -> build/bdist.linux-armv7l/wheel/lm_datasets/datasets/mt 2023-12-15T15:44:12,549 copying build/lib/lm_datasets/datasets/mt/__init__.py -> build/bdist.linux-armv7l/wheel/lm_datasets/datasets/mt 2023-12-15T15:44:12,551 creating build/bdist.linux-armv7l/wheel/lm_datasets/datasets/lt 2023-12-15T15:44:12,552 copying build/lib/lm_datasets/datasets/lt/seimas_lt_en.py -> build/bdist.linux-armv7l/wheel/lm_datasets/datasets/lt 2023-12-15T15:44:12,554 copying build/lib/lm_datasets/datasets/jsonl_dataset.py -> build/bdist.linux-armv7l/wheel/lm_datasets/datasets 2023-12-15T15:44:12,556 creating build/bdist.linux-armv7l/wheel/lm_datasets/datasets/sk 2023-12-15T15:44:12,557 copying build/lib/lm_datasets/datasets/sk/sk_court_decisions.py -> build/bdist.linux-armv7l/wheel/lm_datasets/datasets/sk 2023-12-15T15:44:12,559 copying build/lib/lm_datasets/datasets/sk/sk_laws.py -> build/bdist.linux-armv7l/wheel/lm_datasets/datasets/sk 2023-12-15T15:44:12,560 copying build/lib/lm_datasets/datasets/sk/__init__.py -> build/bdist.linux-armv7l/wheel/lm_datasets/datasets/sk 2023-12-15T15:44:12,562 creating build/bdist.linux-armv7l/wheel/lm_datasets/datasets/nl 2023-12-15T15:44:12,563 copying build/lib/lm_datasets/datasets/nl/__init__.py -> build/bdist.linux-armv7l/wheel/lm_datasets/datasets/nl 2023-12-15T15:44:12,565 copying build/lib/lm_datasets/datasets/nl/sonar_new_media.py -> build/bdist.linux-armv7l/wheel/lm_datasets/datasets/nl 2023-12-15T15:44:12,566 copying build/lib/lm_datasets/datasets/nl/sonar.py -> build/bdist.linux-armv7l/wheel/lm_datasets/datasets/nl 2023-12-15T15:44:12,568 copying build/lib/lm_datasets/datasets/__init__.py -> build/bdist.linux-armv7l/wheel/lm_datasets/datasets 2023-12-15T15:44:12,570 creating build/bdist.linux-armv7l/wheel/lm_datasets/datasets/el 2023-12-15T15:44:12,571 copying build/lib/lm_datasets/datasets/el/__init__.py -> build/bdist.linux-armv7l/wheel/lm_datasets/datasets/el 2023-12-15T15:44:12,573 copying build/lib/lm_datasets/datasets/el/greek_legal_code.py -> build/bdist.linux-armv7l/wheel/lm_datasets/datasets/el 2023-12-15T15:44:12,575 copying build/lib/lm_datasets/datasets/el/greek_web_corpus.py -> build/bdist.linux-armv7l/wheel/lm_datasets/datasets/el 2023-12-15T15:44:12,577 creating build/bdist.linux-armv7l/wheel/lm_datasets/datasets/sv 2023-12-15T15:44:12,577 copying build/lib/lm_datasets/datasets/sv/__init__.py -> build/bdist.linux-armv7l/wheel/lm_datasets/datasets/sv 2023-12-15T15:44:12,579 copying build/lib/lm_datasets/datasets/sv/sv_gigaword.py -> build/bdist.linux-armv7l/wheel/lm_datasets/datasets/sv 2023-12-15T15:44:12,581 creating build/bdist.linux-armv7l/wheel/lm_datasets/datasets/lv 2023-12-15T15:44:12,582 copying build/lib/lm_datasets/datasets/lv/state_related_latvian_web.py -> build/bdist.linux-armv7l/wheel/lm_datasets/datasets/lv 2023-12-15T15:44:12,584 copying build/lib/lm_datasets/datasets/lv/__init__.py -> build/bdist.linux-armv7l/wheel/lm_datasets/datasets/lv 2023-12-15T15:44:12,586 creating build/bdist.linux-armv7l/wheel/lm_datasets/datasets/es 2023-12-15T15:44:12,587 copying build/lib/lm_datasets/datasets/es/escorpius.py -> build/bdist.linux-armv7l/wheel/lm_datasets/datasets/es 2023-12-15T15:44:12,589 copying build/lib/lm_datasets/datasets/es/spanish_legal.py -> build/bdist.linux-armv7l/wheel/lm_datasets/datasets/es 2023-12-15T15:44:12,591 copying build/lib/lm_datasets/datasets/es/__init__.py -> build/bdist.linux-armv7l/wheel/lm_datasets/datasets/es 2023-12-15T15:44:12,593 creating build/bdist.linux-armv7l/wheel/lm_datasets/datasets/fi 2023-12-15T15:44:12,593 copying build/lib/lm_datasets/datasets/fi/ylenews.py -> build/bdist.linux-armv7l/wheel/lm_datasets/datasets/fi 2023-12-15T15:44:12,596 copying build/lib/lm_datasets/datasets/fi/__init__.py -> build/bdist.linux-armv7l/wheel/lm_datasets/datasets/fi 2023-12-15T15:44:12,598 creating build/bdist.linux-armv7l/wheel/lm_datasets/datasets/code 2023-12-15T15:44:12,599 copying build/lib/lm_datasets/datasets/code/__init__.py -> build/bdist.linux-armv7l/wheel/lm_datasets/datasets/code 2023-12-15T15:44:12,600 copying build/lib/lm_datasets/datasets/code/starcoder.py -> build/bdist.linux-armv7l/wheel/lm_datasets/datasets/code 2023-12-15T15:44:12,602 creating build/bdist.linux-armv7l/wheel/lm_datasets/datasets/pl 2023-12-15T15:44:12,603 copying build/lib/lm_datasets/datasets/pl/pl_nkjp.py -> build/bdist.linux-armv7l/wheel/lm_datasets/datasets/pl 2023-12-15T15:44:12,605 copying build/lib/lm_datasets/datasets/pl/luna_pl.py -> build/bdist.linux-armv7l/wheel/lm_datasets/datasets/pl 2023-12-15T15:44:12,607 copying build/lib/lm_datasets/datasets/pl/pl_parliamentary_corpus.py -> build/bdist.linux-armv7l/wheel/lm_datasets/datasets/pl 2023-12-15T15:44:12,609 creating build/bdist.linux-armv7l/wheel/lm_datasets/datasets/it 2023-12-15T15:44:12,609 copying build/lib/lm_datasets/datasets/it/__init__.py -> build/bdist.linux-armv7l/wheel/lm_datasets/datasets/it 2023-12-15T15:44:12,611 copying build/lib/lm_datasets/datasets/it/itwac.py -> build/bdist.linux-armv7l/wheel/lm_datasets/datasets/it 2023-12-15T15:44:12,613 creating build/bdist.linux-armv7l/wheel/lm_datasets/datasets/pt 2023-12-15T15:44:12,614 copying build/lib/lm_datasets/datasets/pt/parlamento_pt.py -> build/bdist.linux-armv7l/wheel/lm_datasets/datasets/pt 2023-12-15T15:44:12,616 copying build/lib/lm_datasets/datasets/pt/brwac.py -> build/bdist.linux-armv7l/wheel/lm_datasets/datasets/pt 2023-12-15T15:44:12,618 creating build/bdist.linux-armv7l/wheel/lm_datasets/datasets/da 2023-12-15T15:44:12,619 copying build/lib/lm_datasets/datasets/da/danish_parliament_corpus.py -> build/bdist.linux-armv7l/wheel/lm_datasets/datasets/da 2023-12-15T15:44:12,620 copying build/lib/lm_datasets/datasets/da/__init__.py -> build/bdist.linux-armv7l/wheel/lm_datasets/datasets/da 2023-12-15T15:44:12,622 copying build/lib/lm_datasets/datasets/da/dk_clarin.py -> build/bdist.linux-armv7l/wheel/lm_datasets/datasets/da 2023-12-15T15:44:12,624 copying build/lib/lm_datasets/datasets/da/danewsroom.py -> build/bdist.linux-armv7l/wheel/lm_datasets/datasets/da 2023-12-15T15:44:12,625 copying build/lib/lm_datasets/datasets/da/danish_gigaword.py -> build/bdist.linux-armv7l/wheel/lm_datasets/datasets/da 2023-12-15T15:44:12,628 creating build/bdist.linux-armv7l/wheel/lm_datasets/datasets/cs 2023-12-15T15:44:12,628 copying build/lib/lm_datasets/datasets/cs/__init__.py -> build/bdist.linux-armv7l/wheel/lm_datasets/datasets/cs 2023-12-15T15:44:12,630 copying build/lib/lm_datasets/datasets/cs/syn_v9.py -> build/bdist.linux-armv7l/wheel/lm_datasets/datasets/cs 2023-12-15T15:44:12,632 copying build/lib/lm_datasets/datasets/cs/cs_en_parallel.py -> build/bdist.linux-armv7l/wheel/lm_datasets/datasets/cs 2023-12-15T15:44:12,634 creating build/bdist.linux-armv7l/wheel/lm_datasets/datasets/uk 2023-12-15T15:44:12,635 copying build/lib/lm_datasets/datasets/uk/__init__.py -> build/bdist.linux-armv7l/wheel/lm_datasets/datasets/uk 2023-12-15T15:44:12,636 copying build/lib/lm_datasets/datasets/uk/uk_laws.py -> build/bdist.linux-armv7l/wheel/lm_datasets/datasets/uk 2023-12-15T15:44:12,638 copying build/lib/lm_datasets/datasets/parquet_dataset.py -> build/bdist.linux-armv7l/wheel/lm_datasets/datasets 2023-12-15T15:44:12,640 creating build/bdist.linux-armv7l/wheel/lm_datasets/datasets/ga 2023-12-15T15:44:12,641 copying build/lib/lm_datasets/datasets/ga/__init__.py -> build/bdist.linux-armv7l/wheel/lm_datasets/datasets/ga 2023-12-15T15:44:12,643 copying build/lib/lm_datasets/datasets/ga/ga_universal_dependencies.py -> build/bdist.linux-armv7l/wheel/lm_datasets/datasets/ga 2023-12-15T15:44:12,644 copying build/lib/lm_datasets/datasets/ga/ga_bilingual_legistation.py -> build/bdist.linux-armv7l/wheel/lm_datasets/datasets/ga 2023-12-15T15:44:12,647 creating build/bdist.linux-armv7l/wheel/lm_datasets/datasets/sr 2023-12-15T15:44:12,648 copying build/lib/lm_datasets/datasets/sr/srpkor.py -> build/bdist.linux-armv7l/wheel/lm_datasets/datasets/sr 2023-12-15T15:44:12,649 copying build/lib/lm_datasets/datasets/sr/__init__.py -> build/bdist.linux-armv7l/wheel/lm_datasets/datasets/sr 2023-12-15T15:44:12,651 creating build/bdist.linux-armv7l/wheel/lm_datasets/datasets/en 2023-12-15T15:44:12,652 copying build/lib/lm_datasets/datasets/en/wikihow.py -> build/bdist.linux-armv7l/wheel/lm_datasets/datasets/en 2023-12-15T15:44:12,654 copying build/lib/lm_datasets/datasets/en/pes2o.py -> build/bdist.linux-armv7l/wheel/lm_datasets/datasets/en 2023-12-15T15:44:12,656 copying build/lib/lm_datasets/datasets/en/__init__.py -> build/bdist.linux-armv7l/wheel/lm_datasets/datasets/en 2023-12-15T15:44:12,657 copying build/lib/lm_datasets/datasets/en/pile_of_law.py -> build/bdist.linux-armv7l/wheel/lm_datasets/datasets/en 2023-12-15T15:44:12,659 copying build/lib/lm_datasets/datasets/en/proof_pile.py -> build/bdist.linux-armv7l/wheel/lm_datasets/datasets/en 2023-12-15T15:44:12,661 copying build/lib/lm_datasets/datasets/en/dialogstudio.py -> build/bdist.linux-armv7l/wheel/lm_datasets/datasets/en 2023-12-15T15:44:12,662 copying build/lib/lm_datasets/datasets/en/math_amps.py -> build/bdist.linux-armv7l/wheel/lm_datasets/datasets/en 2023-12-15T15:44:12,665 creating build/bdist.linux-armv7l/wheel/lm_datasets/datasets/de 2023-12-15T15:44:12,665 copying build/lib/lm_datasets/datasets/de/dewac.py -> build/bdist.linux-armv7l/wheel/lm_datasets/datasets/de 2023-12-15T15:44:12,667 copying build/lib/lm_datasets/datasets/de/openlegaldata.py -> build/bdist.linux-armv7l/wheel/lm_datasets/datasets/de 2023-12-15T15:44:12,669 copying build/lib/lm_datasets/datasets/de/__init__.py -> build/bdist.linux-armv7l/wheel/lm_datasets/datasets/de 2023-12-15T15:44:12,670 copying build/lib/lm_datasets/datasets/hf_dataset.py -> build/bdist.linux-armv7l/wheel/lm_datasets/datasets 2023-12-15T15:44:12,673 creating build/bdist.linux-armv7l/wheel/lm_datasets/datasets/eu 2023-12-15T15:44:12,674 copying build/lib/lm_datasets/datasets/eu/euscrawl.py -> build/bdist.linux-armv7l/wheel/lm_datasets/datasets/eu 2023-12-15T15:44:12,676 copying build/lib/lm_datasets/datasets/eu/__init__.py -> build/bdist.linux-armv7l/wheel/lm_datasets/datasets/eu 2023-12-15T15:44:12,678 creating build/bdist.linux-armv7l/wheel/lm_datasets/datasets/hr 2023-12-15T15:44:12,679 copying build/lib/lm_datasets/datasets/hr/styria_news.py -> build/bdist.linux-armv7l/wheel/lm_datasets/datasets/hr 2023-12-15T15:44:12,680 copying build/lib/lm_datasets/datasets/hr/__init__.py -> build/bdist.linux-armv7l/wheel/lm_datasets/datasets/hr 2023-12-15T15:44:12,682 copying build/lib/lm_datasets/datasets/hr/hrwac.py -> build/bdist.linux-armv7l/wheel/lm_datasets/datasets/hr 2023-12-15T15:44:12,684 copying build/lib/lm_datasets/datasets/hr/croatian_news_engri.py -> build/bdist.linux-armv7l/wheel/lm_datasets/datasets/hr 2023-12-15T15:44:12,686 copying build/lib/lm_datasets/print_stats.py -> build/bdist.linux-armv7l/wheel/lm_datasets 2023-12-15T15:44:12,688 copying build/lib/lm_datasets/hf_tokenize_parquet_dataset.py -> build/bdist.linux-armv7l/wheel/lm_datasets 2023-12-15T15:44:12,690 copying build/lib/lm_datasets/shuffle_datasets.py -> build/bdist.linux-armv7l/wheel/lm_datasets 2023-12-15T15:44:12,693 creating build/bdist.linux-armv7l/wheel/lm_datasets/commands 2023-12-15T15:44:12,694 copying build/lib/lm_datasets/commands/print_stats_command.py -> build/bdist.linux-armv7l/wheel/lm_datasets/commands 2023-12-15T15:44:12,696 copying build/lib/lm_datasets/commands/compose_command.py -> build/bdist.linux-armv7l/wheel/lm_datasets/commands 2023-12-15T15:44:12,697 copying build/lib/lm_datasets/commands/shuffle_command.py -> build/bdist.linux-armv7l/wheel/lm_datasets/commands 2023-12-15T15:44:12,699 copying build/lib/lm_datasets/commands/collect_metrics_command.py -> build/bdist.linux-armv7l/wheel/lm_datasets/commands 2023-12-15T15:44:12,701 copying build/lib/lm_datasets/commands/extract_text_command.py -> build/bdist.linux-armv7l/wheel/lm_datasets/commands 2023-12-15T15:44:12,703 copying build/lib/lm_datasets/commands/train_tokenizer_command.py -> build/bdist.linux-armv7l/wheel/lm_datasets/commands 2023-12-15T15:44:12,705 copying build/lib/lm_datasets/commands/lm_datasets_cli.py -> build/bdist.linux-armv7l/wheel/lm_datasets/commands 2023-12-15T15:44:12,707 copying build/lib/lm_datasets/commands/__init__.py -> build/bdist.linux-armv7l/wheel/lm_datasets/commands 2023-12-15T15:44:12,708 copying build/lib/lm_datasets/commands/hf_upload_command.py -> build/bdist.linux-armv7l/wheel/lm_datasets/commands 2023-12-15T15:44:12,710 copying build/lib/lm_datasets/commands/convert_parquet_to_jsonl_command.py -> build/bdist.linux-armv7l/wheel/lm_datasets/commands 2023-12-15T15:44:12,712 copying build/lib/lm_datasets/commands/chunkify_command.py -> build/bdist.linux-armv7l/wheel/lm_datasets/commands 2023-12-15T15:44:12,713 running install_egg_info 2023-12-15T15:44:12,717 Copying src/lm_datasets.egg-info to build/bdist.linux-armv7l/wheel/lm_datasets-0.0.2-py3.11.egg-info 2023-12-15T15:44:12,729 running install_scripts 2023-12-15T15:44:12,754 creating build/bdist.linux-armv7l/wheel/lm_datasets-0.0.2.dist-info/WHEEL 2023-12-15T15:44:12,756 creating '/tmp/pip-wheel-ie2g9ozb/.tmp-yb3pkvlj/lm_datasets-0.0.2-py3-none-any.whl' and adding 'build/bdist.linux-armv7l/wheel' to it 2023-12-15T15:44:12,758 adding 'lm_datasets/__init__.py' 2023-12-15T15:44:12,760 adding 'lm_datasets/chunkify_datasets.py' 2023-12-15T15:44:12,762 adding 'lm_datasets/collect_metrics.py' 2023-12-15T15:44:12,763 adding 'lm_datasets/compose_dataset.py' 2023-12-15T15:44:12,764 adding 'lm_datasets/convert_parquet_to_jsonl.py' 2023-12-15T15:44:12,766 adding 'lm_datasets/extract_text.py' 2023-12-15T15:44:12,768 adding 'lm_datasets/hf_tokenize_parquet_dataset.py' 2023-12-15T15:44:12,770 adding 'lm_datasets/print_stats.py' 2023-12-15T15:44:12,771 adding 'lm_datasets/shuffle_datasets.py' 2023-12-15T15:44:12,773 adding 'lm_datasets/train_sp_tokenizer.py' 2023-12-15T15:44:12,775 adding 'lm_datasets/commands/__init__.py' 2023-12-15T15:44:12,776 adding 'lm_datasets/commands/chunkify_command.py' 2023-12-15T15:44:12,778 adding 'lm_datasets/commands/collect_metrics_command.py' 2023-12-15T15:44:12,779 adding 'lm_datasets/commands/compose_command.py' 2023-12-15T15:44:12,780 adding 'lm_datasets/commands/convert_parquet_to_jsonl_command.py' 2023-12-15T15:44:12,782 adding 'lm_datasets/commands/extract_text_command.py' 2023-12-15T15:44:12,783 adding 'lm_datasets/commands/hf_upload_command.py' 2023-12-15T15:44:12,784 adding 'lm_datasets/commands/lm_datasets_cli.py' 2023-12-15T15:44:12,786 adding 'lm_datasets/commands/print_stats_command.py' 2023-12-15T15:44:12,787 adding 'lm_datasets/commands/shuffle_command.py' 2023-12-15T15:44:12,788 adding 'lm_datasets/commands/train_tokenizer_command.py' 2023-12-15T15:44:12,790 adding 'lm_datasets/datasets/__init__.py' 2023-12-15T15:44:12,795 adding 'lm_datasets/datasets/base.py' 2023-12-15T15:44:12,797 adding 'lm_datasets/datasets/dataset_registry.py' 2023-12-15T15:44:12,798 adding 'lm_datasets/datasets/hf_dataset.py' 2023-12-15T15:44:12,800 adding 'lm_datasets/datasets/jsonl_dataset.py' 2023-12-15T15:44:12,801 adding 'lm_datasets/datasets/parquet_dataset.py' 2023-12-15T15:44:12,803 adding 'lm_datasets/datasets/bg/__init__.py' 2023-12-15T15:44:12,804 adding 'lm_datasets/datasets/bg/bgnc_admin_eur.py' 2023-12-15T15:44:12,805 adding 'lm_datasets/datasets/bg/bgnc_news_corpus.py' 2023-12-15T15:44:12,806 adding 'lm_datasets/datasets/bg/bulgarian_news.py' 2023-12-15T15:44:12,808 adding 'lm_datasets/datasets/bg/bulnc.py' 2023-12-15T15:44:12,809 adding 'lm_datasets/datasets/code/__init__.py' 2023-12-15T15:44:12,811 adding 'lm_datasets/datasets/code/starcoder.py' 2023-12-15T15:44:12,813 adding 'lm_datasets/datasets/cs/__init__.py' 2023-12-15T15:44:12,814 adding 'lm_datasets/datasets/cs/cs_en_parallel.py' 2023-12-15T15:44:12,816 adding 'lm_datasets/datasets/cs/syn_v9.py' 2023-12-15T15:44:12,817 adding 'lm_datasets/datasets/da/__init__.py' 2023-12-15T15:44:12,819 adding 'lm_datasets/datasets/da/danewsroom.py' 2023-12-15T15:44:12,820 adding 'lm_datasets/datasets/da/danish_gigaword.py' 2023-12-15T15:44:12,821 adding 'lm_datasets/datasets/da/danish_parliament_corpus.py' 2023-12-15T15:44:12,823 adding 'lm_datasets/datasets/da/dk_clarin.py' 2023-12-15T15:44:12,824 adding 'lm_datasets/datasets/de/__init__.py' 2023-12-15T15:44:12,825 adding 'lm_datasets/datasets/de/dewac.py' 2023-12-15T15:44:12,827 adding 'lm_datasets/datasets/de/openlegaldata.py' 2023-12-15T15:44:12,828 adding 'lm_datasets/datasets/el/__init__.py' 2023-12-15T15:44:12,829 adding 'lm_datasets/datasets/el/greek_legal_code.py' 2023-12-15T15:44:12,830 adding 'lm_datasets/datasets/el/greek_web_corpus.py' 2023-12-15T15:44:12,832 adding 'lm_datasets/datasets/en/__init__.py' 2023-12-15T15:44:12,833 adding 'lm_datasets/datasets/en/dialogstudio.py' 2023-12-15T15:44:12,835 adding 'lm_datasets/datasets/en/math_amps.py' 2023-12-15T15:44:12,836 adding 'lm_datasets/datasets/en/pes2o.py' 2023-12-15T15:44:12,838 adding 'lm_datasets/datasets/en/pile_of_law.py' 2023-12-15T15:44:12,839 adding 'lm_datasets/datasets/en/proof_pile.py' 2023-12-15T15:44:12,840 adding 'lm_datasets/datasets/en/wikihow.py' 2023-12-15T15:44:12,842 adding 'lm_datasets/datasets/es/__init__.py' 2023-12-15T15:44:12,843 adding 'lm_datasets/datasets/es/escorpius.py' 2023-12-15T15:44:12,844 adding 'lm_datasets/datasets/es/spanish_legal.py' 2023-12-15T15:44:12,846 adding 'lm_datasets/datasets/et/__init__.py' 2023-12-15T15:44:12,847 adding 'lm_datasets/datasets/et/ekspress.py' 2023-12-15T15:44:12,848 adding 'lm_datasets/datasets/et/enc.py' 2023-12-15T15:44:12,850 adding 'lm_datasets/datasets/et/estonian_reference_corpus.py' 2023-12-15T15:44:12,851 adding 'lm_datasets/datasets/eu/__init__.py' 2023-12-15T15:44:12,853 adding 'lm_datasets/datasets/eu/euscrawl.py' 2023-12-15T15:44:12,854 adding 'lm_datasets/datasets/fi/__init__.py' 2023-12-15T15:44:12,856 adding 'lm_datasets/datasets/fi/ylenews.py' 2023-12-15T15:44:12,857 adding 'lm_datasets/datasets/fr/__init__.py' 2023-12-15T15:44:12,859 adding 'lm_datasets/datasets/fr/cabernet.py' 2023-12-15T15:44:12,860 adding 'lm_datasets/datasets/ga/__init__.py' 2023-12-15T15:44:12,862 adding 'lm_datasets/datasets/ga/ga_bilingual_legistation.py' 2023-12-15T15:44:12,863 adding 'lm_datasets/datasets/ga/ga_universal_dependencies.py' 2023-12-15T15:44:12,865 adding 'lm_datasets/datasets/hr/__init__.py' 2023-12-15T15:44:12,866 adding 'lm_datasets/datasets/hr/croatian_news_engri.py' 2023-12-15T15:44:12,867 adding 'lm_datasets/datasets/hr/hrwac.py' 2023-12-15T15:44:12,869 adding 'lm_datasets/datasets/hr/styria_news.py' 2023-12-15T15:44:12,870 adding 'lm_datasets/datasets/it/__init__.py' 2023-12-15T15:44:12,872 adding 'lm_datasets/datasets/it/itwac.py' 2023-12-15T15:44:12,873 adding 'lm_datasets/datasets/lt/seimas_lt_en.py' 2023-12-15T15:44:12,875 adding 'lm_datasets/datasets/lv/__init__.py' 2023-12-15T15:44:12,876 adding 'lm_datasets/datasets/lv/state_related_latvian_web.py' 2023-12-15T15:44:12,878 adding 'lm_datasets/datasets/mt/__init__.py' 2023-12-15T15:44:12,879 adding 'lm_datasets/datasets/mt/korpus_malti.py' 2023-12-15T15:44:12,881 adding 'lm_datasets/datasets/multilingual/__init__.py' 2023-12-15T15:44:12,882 adding 'lm_datasets/datasets/multilingual/colossal_oscar.py' 2023-12-15T15:44:12,884 adding 'lm_datasets/datasets/multilingual/curlicat.py' 2023-12-15T15:44:12,886 adding 'lm_datasets/datasets/multilingual/eurlex.py' 2023-12-15T15:44:12,887 adding 'lm_datasets/datasets/multilingual/legal_mc4.py' 2023-12-15T15:44:12,888 adding 'lm_datasets/datasets/multilingual/macocu.py' 2023-12-15T15:44:12,890 adding 'lm_datasets/datasets/multilingual/redpajama.py' 2023-12-15T15:44:12,892 adding 'lm_datasets/datasets/multilingual/wikimedia.py' 2023-12-15T15:44:12,893 adding 'lm_datasets/datasets/nl/__init__.py' 2023-12-15T15:44:12,895 adding 'lm_datasets/datasets/nl/sonar.py' 2023-12-15T15:44:12,896 adding 'lm_datasets/datasets/nl/sonar_new_media.py' 2023-12-15T15:44:12,898 adding 'lm_datasets/datasets/no/__init__.py' 2023-12-15T15:44:12,899 adding 'lm_datasets/datasets/no/maalfrid_2021.py' 2023-12-15T15:44:12,900 adding 'lm_datasets/datasets/no/nak.py' 2023-12-15T15:44:12,901 adding 'lm_datasets/datasets/no/nbdigital.py' 2023-12-15T15:44:12,903 adding 'lm_datasets/datasets/no/norwegian_cc.py' 2023-12-15T15:44:12,904 adding 'lm_datasets/datasets/no/parlamint.py' 2023-12-15T15:44:12,905 adding 'lm_datasets/datasets/no/parliamentary_proceedings.py' 2023-12-15T15:44:12,906 adding 'lm_datasets/datasets/no/sakspapir_nno.py' 2023-12-15T15:44:12,908 adding 'lm_datasets/datasets/pl/luna_pl.py' 2023-12-15T15:44:12,909 adding 'lm_datasets/datasets/pl/pl_nkjp.py' 2023-12-15T15:44:12,910 adding 'lm_datasets/datasets/pl/pl_parliamentary_corpus.py' 2023-12-15T15:44:12,912 adding 'lm_datasets/datasets/pt/brwac.py' 2023-12-15T15:44:12,913 adding 'lm_datasets/datasets/pt/parlamento_pt.py' 2023-12-15T15:44:12,915 adding 'lm_datasets/datasets/ro/__init__.py' 2023-12-15T15:44:12,916 adding 'lm_datasets/datasets/ro/marcell_legislative_subcorpus_v2.py' 2023-12-15T15:44:12,918 adding 'lm_datasets/datasets/sk/__init__.py' 2023-12-15T15:44:12,919 adding 'lm_datasets/datasets/sk/sk_court_decisions.py' 2023-12-15T15:44:12,920 adding 'lm_datasets/datasets/sk/sk_laws.py' 2023-12-15T15:44:12,922 adding 'lm_datasets/datasets/sl/__init__.py' 2023-12-15T15:44:12,923 adding 'lm_datasets/datasets/sl/academic_slovene_kas.py' 2023-12-15T15:44:12,924 adding 'lm_datasets/datasets/sl/cc_gigafida.py' 2023-12-15T15:44:12,926 adding 'lm_datasets/datasets/sl/slwac_web.py' 2023-12-15T15:44:12,927 adding 'lm_datasets/datasets/sr/__init__.py' 2023-12-15T15:44:12,928 adding 'lm_datasets/datasets/sr/srpkor.py' 2023-12-15T15:44:12,930 adding 'lm_datasets/datasets/sv/__init__.py' 2023-12-15T15:44:12,931 adding 'lm_datasets/datasets/sv/sv_gigaword.py' 2023-12-15T15:44:12,933 adding 'lm_datasets/datasets/uk/__init__.py' 2023-12-15T15:44:12,934 adding 'lm_datasets/datasets/uk/uk_laws.py' 2023-12-15T15:44:12,936 adding 'lm_datasets/io/__init__.py' 2023-12-15T15:44:12,937 adding 'lm_datasets/io/conllu_file.py' 2023-12-15T15:44:12,939 adding 'lm_datasets/io/parquet.py' 2023-12-15T15:44:12,940 adding 'lm_datasets/io/prevert_file.py' 2023-12-15T15:44:12,942 adding 'lm_datasets/utils/__init__.py' 2023-12-15T15:44:12,944 adding 'lm_datasets/utils/config.py' 2023-12-15T15:44:12,945 adding 'lm_datasets/utils/dataframe.py' 2023-12-15T15:44:12,948 adding 'lm_datasets/utils/dataset_generator.py' 2023-12-15T15:44:12,949 adding 'lm_datasets/utils/languages.py' 2023-12-15T15:44:12,951 adding 'lm_datasets/utils/settings.py' 2023-12-15T15:44:12,952 adding 'lm_datasets/utils/shuffle_big_file.py' 2023-12-15T15:44:12,954 adding 'lm_datasets/utils/systems.py' 2023-12-15T15:44:12,957 adding 'lm_datasets/utils/wikimedia.py' 2023-12-15T15:44:12,960 adding 'lm_datasets/viewer/app.py' 2023-12-15T15:44:12,962 adding 'lm_datasets/viewer/ngrok-app.py' 2023-12-15T15:44:12,963 adding 'lm_datasets/viewer/viewer_utils.py' 2023-12-15T15:44:12,966 adding 'lm_datasets-0.0.2.dist-info/LICENSE' 2023-12-15T15:44:12,968 adding 'lm_datasets-0.0.2.dist-info/METADATA' 2023-12-15T15:44:12,969 adding 'lm_datasets-0.0.2.dist-info/WHEEL' 2023-12-15T15:44:12,970 adding 'lm_datasets-0.0.2.dist-info/entry_points.txt' 2023-12-15T15:44:12,971 adding 'lm_datasets-0.0.2.dist-info/top_level.txt' 2023-12-15T15:44:12,973 adding 'lm_datasets-0.0.2.dist-info/RECORD' 2023-12-15T15:44:12,978 removing build/bdist.linux-armv7l/wheel 2023-12-15T15:44:13,137 Building wheel for lm-datasets (pyproject.toml): finished with status 'done' 2023-12-15T15:44:13,146 Created wheel for lm-datasets: filename=lm_datasets-0.0.2-py3-none-any.whl size=181417 sha256=ccb05bd19f88bd548f6bffc2924712e86c9c40318eb6e516f34625cb036a185c 2023-12-15T15:44:13,147 Stored in directory: /tmp/pip-ephem-wheel-cache-hovvani1/wheels/67/01/8a/4eddd81af307fb25e6611bf78b49e39477576004bccbbc09b9 2023-12-15T15:44:13,164 Successfully built lm-datasets 2023-12-15T15:44:13,173 Removed build tracker: '/tmp/pip-build-tracker-i_jec78q'