2026-01-06T13:29:33,629 Created temporary directory: /tmp/pip-ephem-wheel-cache-az27cf1i 2026-01-06T13:29:33,631 Created temporary directory: /tmp/pip-build-tracker-_kpo56qn 2026-01-06T13:29:33,631 Initialized build tracking at /tmp/pip-build-tracker-_kpo56qn 2026-01-06T13:29:33,632 Created build tracker: /tmp/pip-build-tracker-_kpo56qn 2026-01-06T13:29:33,632 Entered build tracker: /tmp/pip-build-tracker-_kpo56qn 2026-01-06T13:29:33,633 Created temporary directory: /tmp/pip-wheel-w9aiuin0 2026-01-06T13:29:33,636 DEPRECATION: --no-binary currently disables reading from the cache of locally built wheels. In the future --no-binary will not influence the wheel cache. pip 23.1 will enforce this behaviour change. A possible replacement is to use the --no-cache-dir option. You can use the flag --use-feature=no-binary-enable-wheel-cache to test the upcoming behaviour. Discussion can be found at https://github.com/pypa/pip/issues/11453 2026-01-06T13:29:33,638 Created temporary directory: /tmp/pip-ephem-wheel-cache-ctv2sb2w 2026-01-06T13:29:33,660 Looking in indexes: https://pypi.org/simple, https://www.piwheels.org/simple 2026-01-06T13:29:33,663 2 location(s) to search for versions of unitxt: 2026-01-06T13:29:33,663 * https://pypi.org/simple/unitxt/ 2026-01-06T13:29:33,663 * https://www.piwheels.org/simple/unitxt/ 2026-01-06T13:29:33,664 Fetching project page and analyzing links: https://pypi.org/simple/unitxt/ 2026-01-06T13:29:33,665 Getting page https://pypi.org/simple/unitxt/ 2026-01-06T13:29:33,666 Found index url https://pypi.org/simple 2026-01-06T13:29:33,887 Fetched page https://pypi.org/simple/unitxt/ as application/vnd.pypi.simple.v1+json 2026-01-06T13:29:33,925 Skipping link: No binaries permitted for unitxt: https://files.pythonhosted.org/packages/b1/60/14353836d07d1f605e224223440d78bdf0845cafcf6cf7ab18f3240f467f/unitxt-0.0.1-py3-none-any.whl (from https://pypi.org/simple/unitxt/) 2026-01-06T13:29:33,926 Found link https://files.pythonhosted.org/packages/58/3a/c92912f61ff66cbcc9341759a2135bae9f5006f7b0e43a12839f6bfd6558/unitxt-0.0.1.tar.gz (from https://pypi.org/simple/unitxt/), version: 0.0.1 2026-01-06T13:29:33,926 Skipping link: No binaries permitted for unitxt: https://files.pythonhosted.org/packages/f8/a1/bff27d252e99f95ccffc0ed3fd42bb3d5adca047f6be92150f1c12aec0d3/unitxt-1.0.0-py3-none-any.whl (from https://pypi.org/simple/unitxt/) (requires-python:>=3.8) 2026-01-06T13:29:33,927 Found link https://files.pythonhosted.org/packages/80/e9/b54fdcc623c84d7298dc1bd073e5c84bfbbaf62aa2ac92bd4db2c98d7389/unitxt-1.0.0.tar.gz (from https://pypi.org/simple/unitxt/) (requires-python:>=3.8), version: 1.0.0 2026-01-06T13:29:33,928 Skipping link: No binaries permitted for unitxt: https://files.pythonhosted.org/packages/22/94/185e566601e713c8e35d15be46b80c4723acc01b70c36144d97129b8df4a/unitxt-1.0.2-py3-none-any.whl (from https://pypi.org/simple/unitxt/) (requires-python:>=3.8) 2026-01-06T13:29:33,929 Found link https://files.pythonhosted.org/packages/3c/cc/f7fdd45973958bfdfaf685714a5d1b64b40aefa2c43fce9614af53c9aabc/unitxt-1.0.2.tar.gz (from https://pypi.org/simple/unitxt/) (requires-python:>=3.8), version: 1.0.2 2026-01-06T13:29:33,930 Skipping link: No binaries permitted for unitxt: https://files.pythonhosted.org/packages/0e/ec/47b4c890389c9146714ccbf60c6c1895402885047cc56a09efee064d88cd/unitxt-1.0.3-py3-none-any.whl (from https://pypi.org/simple/unitxt/) (requires-python:>=3.8) 2026-01-06T13:29:33,931 Found link https://files.pythonhosted.org/packages/4f/ff/c37d78e0e45fb81dd94704314c9523413bdd6b65e9ed2f2ac77d869ea9ec/unitxt-1.0.3.tar.gz (from https://pypi.org/simple/unitxt/) (requires-python:>=3.8), version: 1.0.3 2026-01-06T13:29:33,932 Skipping link: No binaries permitted for unitxt: https://files.pythonhosted.org/packages/c4/e9/8a362c68a5ee3fc5ca8a4d8555154aedef518bfc658ba58f5dbd57ce4118/unitxt-1.0.7-py3-none-any.whl (from https://pypi.org/simple/unitxt/) (requires-python:>=3.8) 2026-01-06T13:29:33,933 Found link https://files.pythonhosted.org/packages/11/d1/d3b62f8baf803050688a5209b7a249f450e3b915906be3b8636049f44de2/unitxt-1.0.7.tar.gz (from https://pypi.org/simple/unitxt/) (requires-python:>=3.8), version: 1.0.7 2026-01-06T13:29:33,934 Skipping link: No binaries permitted for unitxt: https://files.pythonhosted.org/packages/54/31/e55bb57ce60745be009f8562e320edc214555002f6ad801355acfa04befb/unitxt-1.0.9-py3-none-any.whl (from https://pypi.org/simple/unitxt/) (requires-python:>=3.8) 2026-01-06T13:29:33,935 Found link https://files.pythonhosted.org/packages/0e/ad/4d0c5d55831a7fd66fbaca1667f8f31321026e46d5f9444cb997646d2fe7/unitxt-1.0.9.tar.gz (from https://pypi.org/simple/unitxt/) (requires-python:>=3.8), version: 1.0.9 2026-01-06T13:29:33,936 Skipping link: No binaries permitted for unitxt: https://files.pythonhosted.org/packages/46/9b/479b42629f534961d580476c9e0584b9d7f3847b874edffaeacd177f9751/unitxt-1.0.10-py3-none-any.whl (from https://pypi.org/simple/unitxt/) (requires-python:>=3.8) 2026-01-06T13:29:33,936 Found link https://files.pythonhosted.org/packages/ce/c3/d13d529a093821f4f9aac0aacfbda93a31a3c0fb5e4e764434826ded2674/unitxt-1.0.10.tar.gz (from https://pypi.org/simple/unitxt/) (requires-python:>=3.8), version: 1.0.10 2026-01-06T13:29:33,937 Skipping link: No binaries permitted for unitxt: https://files.pythonhosted.org/packages/b5/ad/7d55a38344db877cd52f6fe417f3b1245297083ce61536f3f864d53f1fd1/unitxt-1.0.11-py3-none-any.whl (from https://pypi.org/simple/unitxt/) (requires-python:>=3.8) 2026-01-06T13:29:33,938 Found link https://files.pythonhosted.org/packages/02/50/85cf98c6c362866a7226f69eff6fbfab7827314b2b7151756f27537c8c5f/unitxt-1.0.11.tar.gz (from https://pypi.org/simple/unitxt/) (requires-python:>=3.8), version: 1.0.11 2026-01-06T13:29:33,938 Skipping link: No binaries permitted for unitxt: https://files.pythonhosted.org/packages/93/39/d0b0e6376073122dd4eb91f68979b954fd1286f0e5e8561619cc4a57f3ca/unitxt-1.0.12-py3-none-any.whl (from https://pypi.org/simple/unitxt/) (requires-python:>=3.8) 2026-01-06T13:29:33,939 Found link https://files.pythonhosted.org/packages/be/1d/a00bb5629d15c115a5d71104e1bf9d051123f26eb698bf87337b36215270/unitxt-1.0.12.tar.gz (from https://pypi.org/simple/unitxt/) (requires-python:>=3.8), version: 1.0.12 2026-01-06T13:29:33,940 Skipping link: No binaries permitted for unitxt: https://files.pythonhosted.org/packages/b8/ac/5b7fc2277dd86b4468bca84dd52586084c857b5cacb78924f2c9764c4f95/unitxt-1.0.13-py3-none-any.whl (from https://pypi.org/simple/unitxt/) (requires-python:>=3.8) 2026-01-06T13:29:33,941 Found link https://files.pythonhosted.org/packages/dc/a2/6f56a775b858fac1b24abb26b289609df00ce2c23401f9e457d239707032/unitxt-1.0.13.tar.gz (from https://pypi.org/simple/unitxt/) (requires-python:>=3.8), version: 1.0.13 2026-01-06T13:29:33,942 Skipping link: No binaries permitted for unitxt: https://files.pythonhosted.org/packages/86/55/a190f86d68179b80a837e85fea21a2f0fb29f42efab6f800b18fe9386292/unitxt-1.0.14-py3-none-any.whl (from https://pypi.org/simple/unitxt/) (requires-python:>=3.8) 2026-01-06T13:29:33,943 Found link https://files.pythonhosted.org/packages/46/67/d0446e57188ad1d91e6bfa95052fe5106212978fcba1049d9ab36ebe46a9/unitxt-1.0.14.tar.gz (from https://pypi.org/simple/unitxt/) (requires-python:>=3.8), version: 1.0.14 2026-01-06T13:29:33,944 Skipping link: No binaries permitted for unitxt: https://files.pythonhosted.org/packages/51/69/866ccefee1433cc9376c9288bc207222fd81277b2ea305e749144b840b0d/unitxt-1.0.15-py3-none-any.whl (from https://pypi.org/simple/unitxt/) (requires-python:>=3.8) 2026-01-06T13:29:33,944 Found link https://files.pythonhosted.org/packages/90/6c/e54f7ce50e4fc8981f7e4989de137e0100acdfe9f03b6582aeefe7d52709/unitxt-1.0.15.tar.gz (from https://pypi.org/simple/unitxt/) (requires-python:>=3.8), version: 1.0.15 2026-01-06T13:29:33,945 Skipping link: No binaries permitted for unitxt: https://files.pythonhosted.org/packages/61/d9/f56c6ed3470dc8b74dd02b7466ae594ba283fd460f5f7c8fe70383971270/unitxt-1.0.16-py3-none-any.whl (from https://pypi.org/simple/unitxt/) (requires-python:>=3.8) 2026-01-06T13:29:33,946 Found link https://files.pythonhosted.org/packages/58/f5/c3f7db40d92686e6b7e6e111c080f8a4ef9184adb95b2c2accaf9d7bdddd/unitxt-1.0.16.tar.gz (from https://pypi.org/simple/unitxt/) (requires-python:>=3.8), version: 1.0.16 2026-01-06T13:29:33,947 Skipping link: No binaries permitted for unitxt: https://files.pythonhosted.org/packages/a1/a1/e9e5020dd816fe50263594e47f4cbb806e2ad7b6bd8dd8c63bcdc6bf947d/unitxt-1.0.17-py3-none-any.whl (from https://pypi.org/simple/unitxt/) (requires-python:>=3.8) 2026-01-06T13:29:33,948 Found link https://files.pythonhosted.org/packages/2b/d1/e1ec41ce037e829604b1ac777dd3156546b08cf98c9745a26637406db4f5/unitxt-1.0.17.tar.gz (from https://pypi.org/simple/unitxt/) (requires-python:>=3.8), version: 1.0.17 2026-01-06T13:29:33,949 Skipping link: No binaries permitted for unitxt: https://files.pythonhosted.org/packages/96/f5/c71d8308182f8ac306a93f26b457de8b45ceacd5a65cda26687bbfdc6dab/unitxt-1.0.18-py3-none-any.whl (from https://pypi.org/simple/unitxt/) (requires-python:>=3.8) 2026-01-06T13:29:33,949 Found link https://files.pythonhosted.org/packages/8c/6b/fcb61b4b108d949b8754ccafd1cc4d604383e4cbbcc35086a353130adc7c/unitxt-1.0.18.tar.gz (from https://pypi.org/simple/unitxt/) (requires-python:>=3.8), version: 1.0.18 2026-01-06T13:29:33,950 Skipping link: No binaries permitted for unitxt: https://files.pythonhosted.org/packages/56/b4/da7cec834fce00d5ad095e51738429d5cb07194c1a7bf4bf31a47ae49528/unitxt-1.0.19-py3-none-any.whl (from https://pypi.org/simple/unitxt/) (requires-python:>=3.8) 2026-01-06T13:29:33,951 Found link https://files.pythonhosted.org/packages/11/e0/13e4f60aff6d6bf5aa67eea1b341a826d6bec316a3c02bfa713b2e2fc818/unitxt-1.0.19.tar.gz (from https://pypi.org/simple/unitxt/) (requires-python:>=3.8), version: 1.0.19 2026-01-06T13:29:33,951 Skipping link: No binaries permitted for unitxt: https://files.pythonhosted.org/packages/fc/a3/11450554e4ff01ac93a6eb342d4e57c6795051e1450c96eebf19e4b590ab/unitxt-1.0.20-py3-none-any.whl (from https://pypi.org/simple/unitxt/) (requires-python:>=3.8) 2026-01-06T13:29:33,952 Found link https://files.pythonhosted.org/packages/50/a3/a7bb75377e16d1f94c7dcabfb9b31744a05a52b12aada20576e76ab85e5e/unitxt-1.0.20.tar.gz (from https://pypi.org/simple/unitxt/) (requires-python:>=3.8), version: 1.0.20 2026-01-06T13:29:33,953 Skipping link: No binaries permitted for unitxt: https://files.pythonhosted.org/packages/01/49/cc9f2c575f95fa5be4b14a2d361fffad4acfa80ff3d67cd27fac37236f33/unitxt-1.0.31-py3-none-any.whl (from https://pypi.org/simple/unitxt/) (requires-python:>=3.8) 2026-01-06T13:29:33,954 Found link https://files.pythonhosted.org/packages/f3/42/772959850a2c96ae29dd9c910d7fb58a66183b445350cfe6d5ea0c29a328/unitxt-1.0.31.tar.gz (from https://pypi.org/simple/unitxt/) (requires-python:>=3.8), version: 1.0.31 2026-01-06T13:29:33,955 Skipping link: No binaries permitted for unitxt: https://files.pythonhosted.org/packages/bf/5e/203dd2dd6c3288a8fd53519380a526730510bcc1d6c4aa1889265866b379/unitxt-1.0.34-py3-none-any.whl (from https://pypi.org/simple/unitxt/) (requires-python:>=3.8) 2026-01-06T13:29:33,956 Found link https://files.pythonhosted.org/packages/dc/22/4a766be66b6ef9c208ab2458587b8a870b4ad87fa1817319b25b6c8b4517/unitxt-1.0.34.tar.gz (from https://pypi.org/simple/unitxt/) (requires-python:>=3.8), version: 1.0.34 2026-01-06T13:29:33,957 Skipping link: No binaries permitted for unitxt: https://files.pythonhosted.org/packages/b1/91/36ffd960eedbd4e9f5eeb2cdba190f76964fb08f030f0d2bdace209db64f/unitxt-1.0.35-py3-none-any.whl (from https://pypi.org/simple/unitxt/) (requires-python:>=3.8) 2026-01-06T13:29:33,957 Found link https://files.pythonhosted.org/packages/8f/bf/522102de1b48ac6a2db4830c21771a131add76b01ccc974046f5070c6b7e/unitxt-1.0.35.tar.gz (from https://pypi.org/simple/unitxt/) (requires-python:>=3.8), version: 1.0.35 2026-01-06T13:29:33,958 Skipping link: No binaries permitted for unitxt: https://files.pythonhosted.org/packages/b9/ad/e1fcdc69839eddf8e616a528ff6c60231c5b0d615f67bdb78a49e372df38/unitxt-1.0.38-py3-none-any.whl (from https://pypi.org/simple/unitxt/) (requires-python:>=3.8) 2026-01-06T13:29:33,959 Found link https://files.pythonhosted.org/packages/84/66/0077b202a4de4e41b550914a7eb35c436be1c8a3e3fa9e1ba3b6df23df26/unitxt-1.0.38.tar.gz (from https://pypi.org/simple/unitxt/) (requires-python:>=3.8), version: 1.0.38 2026-01-06T13:29:33,960 Skipping link: No binaries permitted for unitxt: https://files.pythonhosted.org/packages/34/0f/59863844b834fec261bf6532057da64f88ac2a04c7c4759f67dabdd4069b/unitxt-1.0.42-py3-none-any.whl (from https://pypi.org/simple/unitxt/) (requires-python:>=3.8) 2026-01-06T13:29:33,961 Found link https://files.pythonhosted.org/packages/03/3b/c4aed7e4b23a65097439256a03eb0a756fca50de458082a4b9e8a0945189/unitxt-1.0.42.tar.gz (from https://pypi.org/simple/unitxt/) (requires-python:>=3.8), version: 1.0.42 2026-01-06T13:29:33,961 Skipping link: No binaries permitted for unitxt: https://files.pythonhosted.org/packages/cb/d5/321ba31c9b7fa9da776051a5b5b1fb8373ab0323fbafcc534a3d52933cb5/unitxt-1.0.43-py3-none-any.whl (from https://pypi.org/simple/unitxt/) (requires-python:>=3.8) 2026-01-06T13:29:33,962 Found link https://files.pythonhosted.org/packages/cb/3c/4b43d8ffb77f6b87cdd3accb0c24cd27c73394100ceede652de3efd4e0e7/unitxt-1.0.43.tar.gz (from https://pypi.org/simple/unitxt/) (requires-python:>=3.8), version: 1.0.43 2026-01-06T13:29:33,963 Skipping link: No binaries permitted for unitxt: https://files.pythonhosted.org/packages/20/9a/03d23b55637ee7f2a12fe0773f9d63c297b954ba08bd1d61a678bde7c698/unitxt-1.0.45-py3-none-any.whl (from https://pypi.org/simple/unitxt/) (requires-python:>=3.8) 2026-01-06T13:29:33,964 Found link https://files.pythonhosted.org/packages/19/b1/3fc705d8ebf98b8067f9e86b83f9a36792faeb87499ca17348fe73fb85ca/unitxt-1.0.45.tar.gz (from https://pypi.org/simple/unitxt/) (requires-python:>=3.8), version: 1.0.45 2026-01-06T13:29:33,964 Skipping link: No binaries permitted for unitxt: https://files.pythonhosted.org/packages/89/49/a27337aeac942ee84c446172dc06f034a5eda441038c37c9843dab1f0712/unitxt-1.0.47-py3-none-any.whl (from https://pypi.org/simple/unitxt/) (requires-python:>=3.8) 2026-01-06T13:29:33,965 Found link https://files.pythonhosted.org/packages/a8/d9/9cf334e39b78b62817263483602ca67544b470cd58db04aefdfd3c2e3f5f/unitxt-1.0.47.tar.gz (from https://pypi.org/simple/unitxt/) (requires-python:>=3.8), version: 1.0.47 2026-01-06T13:29:33,966 Skipping link: No binaries permitted for unitxt: https://files.pythonhosted.org/packages/ba/32/31bb58c1b7aff52305232cfcc87c6f7495035ada82c39b27402873807eff/unitxt-1.1.1-py3-none-any.whl (from https://pypi.org/simple/unitxt/) (requires-python:>=3.8) 2026-01-06T13:29:33,967 Found link https://files.pythonhosted.org/packages/93/d5/54d6fe9b9a249ee722e5c504d88d802658eee941975b1c06b234a69b6569/unitxt-1.1.1.tar.gz (from https://pypi.org/simple/unitxt/) (requires-python:>=3.8), version: 1.1.1 2026-01-06T13:29:33,968 Skipping link: No binaries permitted for unitxt: https://files.pythonhosted.org/packages/90/1c/73066e4afcf84c60e783b5bd113c4990368af34e9a19a8c11a848f7d038a/unitxt-1.1.3-py3-none-any.whl (from https://pypi.org/simple/unitxt/) (requires-python:>=3.8) 2026-01-06T13:29:33,969 Found link https://files.pythonhosted.org/packages/69/33/9c606d674b66aad293649180045deb0522c4f0a35fb4b80b722d2eb43c13/unitxt-1.1.3.tar.gz (from https://pypi.org/simple/unitxt/) (requires-python:>=3.8), version: 1.1.3 2026-01-06T13:29:33,969 Skipping link: No binaries permitted for unitxt: https://files.pythonhosted.org/packages/6f/0d/d23cc17a47ebb2f9469d5db65bf6ee39d742c50302fd7bad40747f4f76ba/unitxt-1.1.4-py3-none-any.whl (from https://pypi.org/simple/unitxt/) (requires-python:>=3.8) 2026-01-06T13:29:33,970 Found link https://files.pythonhosted.org/packages/91/d7/5c1dc940d3555c20c052ad6fc05f4d7851639db8f57aa27e05403701310f/unitxt-1.1.4.tar.gz (from https://pypi.org/simple/unitxt/) (requires-python:>=3.8), version: 1.1.4 2026-01-06T13:29:33,971 Skipping link: No binaries permitted for unitxt: https://files.pythonhosted.org/packages/74/1f/f302733369b7becec09481ee735fe516634a56065f29da0d52b6bb398fcf/unitxt-1.2.0-py3-none-any.whl (from https://pypi.org/simple/unitxt/) (requires-python:>=3.8) 2026-01-06T13:29:33,972 Found link https://files.pythonhosted.org/packages/09/cd/3803e5f96e21e54924cf1b13e0743902c3969f5be622c25b4c9343cfb037/unitxt-1.2.0.tar.gz (from https://pypi.org/simple/unitxt/) (requires-python:>=3.8), version: 1.2.0 2026-01-06T13:29:33,973 Skipping link: No binaries permitted for unitxt: https://files.pythonhosted.org/packages/ad/d4/6c3082daa56aafffb35420df69ffd4a94105ffe44be30a61d34f8897e0a7/unitxt-1.3.0-py3-none-any.whl (from https://pypi.org/simple/unitxt/) (requires-python:>=3.8) 2026-01-06T13:29:33,974 Found link https://files.pythonhosted.org/packages/73/65/62cbb295c17a2f6d1dbaab82687cd8c74094e40aa9a9576a7050d26e9755/unitxt-1.3.0.tar.gz (from https://pypi.org/simple/unitxt/) (requires-python:>=3.8), version: 1.3.0 2026-01-06T13:29:33,974 Skipping link: No binaries permitted for unitxt: https://files.pythonhosted.org/packages/3f/4c/f7709ad6c10c3644b8edcbf00f3e9cc74a8f49b80bf303dd3e2b349f3e7c/unitxt-1.3.1-py3-none-any.whl (from https://pypi.org/simple/unitxt/) (requires-python:>=3.8) 2026-01-06T13:29:33,975 Found link https://files.pythonhosted.org/packages/32/53/645acf4c60882182d6df8de987bf00fa5e5a76ce60c253d6e87681d47751/unitxt-1.3.1.tar.gz (from https://pypi.org/simple/unitxt/) (requires-python:>=3.8), version: 1.3.1 2026-01-06T13:29:33,976 Skipping link: No binaries permitted for unitxt: https://files.pythonhosted.org/packages/22/39/16447931efc16cdd889a0ef9ef842e4cbcb87cecb1cffa62a0d6ab9b8908/unitxt-1.3.2-py3-none-any.whl (from https://pypi.org/simple/unitxt/) (requires-python:>=3.8) 2026-01-06T13:29:33,976 Found link https://files.pythonhosted.org/packages/cb/76/d8c5fb8205f44581208752c91c553c2992bac7bfd817f44d48b107b9ef6a/unitxt-1.3.2.tar.gz (from https://pypi.org/simple/unitxt/) (requires-python:>=3.8), version: 1.3.2 2026-01-06T13:29:33,977 Skipping link: No binaries permitted for unitxt: https://files.pythonhosted.org/packages/98/4b/d28bec99cab3081a7c93db04ab16db69fb3e19ff1dbced22fd944313f3d4/unitxt-1.4.0-py3-none-any.whl (from https://pypi.org/simple/unitxt/) (requires-python:>=3.8) 2026-01-06T13:29:33,978 Found link https://files.pythonhosted.org/packages/64/1a/9f84ced25db7db742586c1c84767a1b8c8ea8121a3329d2e7111fe5841fc/unitxt-1.4.0.tar.gz (from https://pypi.org/simple/unitxt/) (requires-python:>=3.8), version: 1.4.0 2026-01-06T13:29:33,979 Skipping link: No binaries permitted for unitxt: https://files.pythonhosted.org/packages/f6/ab/a0ab8ad956c9935d2f6fdd01cf85268bf1e3112fef1d937c6596bb687c43/unitxt-1.4.1-py3-none-any.whl (from https://pypi.org/simple/unitxt/) (requires-python:>=3.8) 2026-01-06T13:29:33,980 Found link https://files.pythonhosted.org/packages/37/5a/c8a4e5aa2f19fe163817b4aa2dea50c025dc51963f7d1acb384eebd6ab63/unitxt-1.4.1.tar.gz (from https://pypi.org/simple/unitxt/) (requires-python:>=3.8), version: 1.4.1 2026-01-06T13:29:33,980 Skipping link: No binaries permitted for unitxt: https://files.pythonhosted.org/packages/2a/0c/3d5833c1b0f22bf42fcb0d19942602602568f9b3ae2d3e71ddea929b4dde/unitxt-1.4.2-py3-none-any.whl (from https://pypi.org/simple/unitxt/) (requires-python:>=3.8) 2026-01-06T13:29:33,981 Found link https://files.pythonhosted.org/packages/9b/18/ae9a17a4e7be0d7dbd8fcc84f494b67ccad88118f518faf3c040cf692127/unitxt-1.4.2.tar.gz (from https://pypi.org/simple/unitxt/) (requires-python:>=3.8), version: 1.4.2 2026-01-06T13:29:33,982 Skipping link: No binaries permitted for unitxt: https://files.pythonhosted.org/packages/bd/e3/c232012723f1fbaed61dc0968e80887d6a8344d7914ea415e0bed567fe93/unitxt-1.4.3-py3-none-any.whl (from https://pypi.org/simple/unitxt/) (requires-python:>=3.8) 2026-01-06T13:29:33,983 Found link https://files.pythonhosted.org/packages/56/86/226dd18b4d8ce1f2d32361d0e62d325c689faf3b29767ee5f94ca1b901ab/unitxt-1.4.3.tar.gz (from https://pypi.org/simple/unitxt/) (requires-python:>=3.8), version: 1.4.3 2026-01-06T13:29:33,984 Skipping link: No binaries permitted for unitxt: https://files.pythonhosted.org/packages/3d/e8/c8ddc4127f002b8c5eb3f17ab0d2950a8a8bcb1f2f0d63259d8717dcac16/unitxt-1.4.4-py3-none-any.whl (from https://pypi.org/simple/unitxt/) (requires-python:>=3.8) 2026-01-06T13:29:33,985 Found link https://files.pythonhosted.org/packages/86/c3/b1b31fdb53b11adbe576820edf7ade73f75cf6297c5175989d6003be83bc/unitxt-1.4.4.tar.gz (from https://pypi.org/simple/unitxt/) (requires-python:>=3.8), version: 1.4.4 2026-01-06T13:29:33,986 Skipping link: No binaries permitted for unitxt: https://files.pythonhosted.org/packages/52/45/afed7aabb6e0a642a7311c4a4fc0aa9096946da528e88d8dbc006aa8d452/unitxt-1.4.5-py3-none-any.whl (from https://pypi.org/simple/unitxt/) (requires-python:>=3.8) 2026-01-06T13:29:33,986 Found link https://files.pythonhosted.org/packages/a4/54/d3fc1e45b47c941b0adf4fd7740cd3a92007e3860f7ba8bcace66c813369/unitxt-1.4.5.tar.gz (from https://pypi.org/simple/unitxt/) (requires-python:>=3.8), version: 1.4.5 2026-01-06T13:29:33,987 Skipping link: No binaries permitted for unitxt: https://files.pythonhosted.org/packages/49/5f/6b1d8130c1f0d56187fc918cdabd697417ef95c4285799f11dfb7cbfe8aa/unitxt-1.4.6-py3-none-any.whl (from https://pypi.org/simple/unitxt/) (requires-python:>=3.8) 2026-01-06T13:29:33,988 Found link https://files.pythonhosted.org/packages/a5/0f/0295e4722eb7a3098cc1b9f62f2b39bf3972dfd6544a447980213b061cad/unitxt-1.4.6.tar.gz (from https://pypi.org/simple/unitxt/) (requires-python:>=3.8), version: 1.4.6 2026-01-06T13:29:33,988 Skipping link: No binaries permitted for unitxt: https://files.pythonhosted.org/packages/57/59/c81dc1337ac379c70b92bc3e69f82eecee8883b4b6d474703047ead2b8bf/unitxt-1.5.0-py3-none-any.whl (from https://pypi.org/simple/unitxt/) (requires-python:>=3.8) 2026-01-06T13:29:33,989 Found link https://files.pythonhosted.org/packages/c2/fc/75d869a8b0fa48c0f30309a8abb4bf36b2e5f924bfa4afab92d17da201e7/unitxt-1.5.0.tar.gz (from https://pypi.org/simple/unitxt/) (requires-python:>=3.8), version: 1.5.0 2026-01-06T13:29:33,990 Skipping link: No binaries permitted for unitxt: https://files.pythonhosted.org/packages/50/f6/719d57e6078cc25b2af211c3387d01c7fe4357f86c832e4474385dca1bf0/unitxt-1.5.1-py3-none-any.whl (from https://pypi.org/simple/unitxt/) (requires-python:>=3.8) 2026-01-06T13:29:33,991 Found link https://files.pythonhosted.org/packages/70/bf/c817e0d0ebd5ebc9150fc760d1959d981a9062cc5929a3fee2da82c78bc2/unitxt-1.5.1.tar.gz (from https://pypi.org/simple/unitxt/) (requires-python:>=3.8), version: 1.5.1 2026-01-06T13:29:33,991 Skipping link: No binaries permitted for unitxt: https://files.pythonhosted.org/packages/9e/01/58cbc78cd7cb05e39809983d2cb9ad5ae60850c1e032c9909ea090b60c72/unitxt-1.5.2-py3-none-any.whl (from https://pypi.org/simple/unitxt/) (requires-python:>=3.8) 2026-01-06T13:29:33,992 Found link https://files.pythonhosted.org/packages/20/a4/d279ec7c566ffe56ad2773f4baf4e1ee7156c1127616131d30b5b840eb5c/unitxt-1.5.2.tar.gz (from https://pypi.org/simple/unitxt/) (requires-python:>=3.8), version: 1.5.2 2026-01-06T13:29:33,993 Skipping link: No binaries permitted for unitxt: https://files.pythonhosted.org/packages/0d/ae/c094bd4e161d89d21c5b8dcbe1178307a56eee3754f882ac78b9ea7d6eb0/unitxt-1.5.3-py3-none-any.whl (from https://pypi.org/simple/unitxt/) (requires-python:>=3.8) 2026-01-06T13:29:33,994 Found link https://files.pythonhosted.org/packages/5f/54/209ba8eae604f8d96ff4f4cf5b59eb462b942fd891bf37c0a5170a3efda5/unitxt-1.5.3.tar.gz (from https://pypi.org/simple/unitxt/) (requires-python:>=3.8), version: 1.5.3 2026-01-06T13:29:33,995 Skipping link: No binaries permitted for unitxt: https://files.pythonhosted.org/packages/48/c4/4d9be75082fb4ac0a20f208f16f606c81af9e2d3a8ca2e10d00a01907a5e/unitxt-1.6.0-py3-none-any.whl (from https://pypi.org/simple/unitxt/) (requires-python:>=3.8) 2026-01-06T13:29:33,996 Found link https://files.pythonhosted.org/packages/9b/0b/4112e4a959d3ba21750a69de68130b4b7bf8875e7497320ea2d8972dbbcf/unitxt-1.6.0.tar.gz (from https://pypi.org/simple/unitxt/) (requires-python:>=3.8), version: 1.6.0 2026-01-06T13:29:33,996 Skipping link: No binaries permitted for unitxt: https://files.pythonhosted.org/packages/e4/85/35d17f95e0c03d334fd146352f7a9848c46a2b705075eb99518617a6ac87/unitxt-1.6.1-py3-none-any.whl (from https://pypi.org/simple/unitxt/) (requires-python:>=3.8) 2026-01-06T13:29:33,997 Found link https://files.pythonhosted.org/packages/2f/09/1b17e594bcbcdefa162a51fe2b6a6e9ddc01bf95968d3bc8013252f76c47/unitxt-1.6.1.tar.gz (from https://pypi.org/simple/unitxt/) (requires-python:>=3.8), version: 1.6.1 2026-01-06T13:29:33,998 Skipping link: No binaries permitted for unitxt: https://files.pythonhosted.org/packages/5c/4e/a7a9c682050216382c3b59daf758c368ac5990db827bd71fd0f40867b72b/unitxt-1.6.2-py3-none-any.whl (from https://pypi.org/simple/unitxt/) (requires-python:>=3.8) 2026-01-06T13:29:33,999 Found link https://files.pythonhosted.org/packages/77/ca/76ad0c2aec3195f05513c5e524e44684dfdb6b50509217fc92cc63654b89/unitxt-1.6.2.tar.gz (from https://pypi.org/simple/unitxt/) (requires-python:>=3.8), version: 1.6.2 2026-01-06T13:29:34,000 Skipping link: No binaries permitted for unitxt: https://files.pythonhosted.org/packages/fb/df/1d62d1d50ac198ceb4029919403afffc2e8447924fa8a7dccacae2fbe254/unitxt-1.6.3-py3-none-any.whl (from https://pypi.org/simple/unitxt/) (requires-python:>=3.8) 2026-01-06T13:29:34,000 Found link https://files.pythonhosted.org/packages/0a/ff/fb18ad9a68114ebec6d83c4692bf76e798be8cb704601927b83c43e77468/unitxt-1.6.3.tar.gz (from https://pypi.org/simple/unitxt/) (requires-python:>=3.8), version: 1.6.3 2026-01-06T13:29:34,001 Skipping link: No binaries permitted for unitxt: https://files.pythonhosted.org/packages/f8/3c/00f9689dc044aefeb12cf6d1711be8b356c1b4a9e9064afbbf8ad3a0386a/unitxt-1.6.4-py3-none-any.whl (from https://pypi.org/simple/unitxt/) (requires-python:>=3.8) 2026-01-06T13:29:34,002 Found link https://files.pythonhosted.org/packages/d9/ce/e0a235cc4c3c4206dace6e136c2185c619e96cffaa8a89ce5c6b29d4d1d2/unitxt-1.6.4.tar.gz (from https://pypi.org/simple/unitxt/) (requires-python:>=3.8), version: 1.6.4 2026-01-06T13:29:34,002 Skipping link: No binaries permitted for unitxt: https://files.pythonhosted.org/packages/c9/6f/1e3cf56c018e921e962833129e9b2e3fdb217d13446069d14947226aa6ff/unitxt-1.6.5-py3-none-any.whl (from https://pypi.org/simple/unitxt/) (requires-python:>=3.8) 2026-01-06T13:29:34,003 Found link https://files.pythonhosted.org/packages/53/89/6402b06a2ee9c183e233fcb3ddf5e94acae69f3469db0dd4b9c832e1de06/unitxt-1.6.5.tar.gz (from https://pypi.org/simple/unitxt/) (requires-python:>=3.8), version: 1.6.5 2026-01-06T13:29:34,004 Skipping link: No binaries permitted for unitxt: https://files.pythonhosted.org/packages/a1/3a/38a54ad28c6001f2ed1cf9b473397d2e50b84562fbb6fc7ef8b12e2f8816/unitxt-1.6.6-py3-none-any.whl (from https://pypi.org/simple/unitxt/) (requires-python:>=3.8) 2026-01-06T13:29:34,005 Found link https://files.pythonhosted.org/packages/2b/68/686ca788728a7b0d9aed1e4554890249bf3b8913157f0af726dd001b6171/unitxt-1.6.6.tar.gz (from https://pypi.org/simple/unitxt/) (requires-python:>=3.8), version: 1.6.6 2026-01-06T13:29:34,006 Skipping link: No binaries permitted for unitxt: https://files.pythonhosted.org/packages/7c/b3/74575ea394250bbdc8cbec7bdee89e1dd256b98bd33c921fa3fb1c6da0de/unitxt-1.7.0-py3-none-any.whl (from https://pypi.org/simple/unitxt/) (requires-python:>=3.8) 2026-01-06T13:29:34,007 Found link https://files.pythonhosted.org/packages/7d/61/def0db05f178011014f52a1c6262782608f445d401aa9038cf7558df5501/unitxt-1.7.0.tar.gz (from https://pypi.org/simple/unitxt/) (requires-python:>=3.8), version: 1.7.0 2026-01-06T13:29:34,007 Skipping link: No binaries permitted for unitxt: https://files.pythonhosted.org/packages/96/3f/74f7b113d7374bae178602cd509611f4e22b71c4c2108b0a0cdb612478bb/unitxt-1.7.1-py3-none-any.whl (from https://pypi.org/simple/unitxt/) (requires-python:>=3.8) 2026-01-06T13:29:34,008 Found link https://files.pythonhosted.org/packages/03/4a/771ffed7a13ed4a5125a2f9b1a3f9bd8ca92bba1efce70816dfad2a3c847/unitxt-1.7.1.tar.gz (from https://pypi.org/simple/unitxt/) (requires-python:>=3.8), version: 1.7.1 2026-01-06T13:29:34,009 Skipping link: No binaries permitted for unitxt: https://files.pythonhosted.org/packages/77/4b/958241779f9e39e2a725e0c5a3b42a30093be8ed979bf3450a33d895eef0/unitxt-1.7.2-py3-none-any.whl (from https://pypi.org/simple/unitxt/) (requires-python:>=3.8) 2026-01-06T13:29:34,010 Found link https://files.pythonhosted.org/packages/71/e8/377300138eea7ddf4e8aca9e5fe027f726d79daea68ff3e5d507d839dc4d/unitxt-1.7.2.tar.gz (from https://pypi.org/simple/unitxt/) (requires-python:>=3.8), version: 1.7.2 2026-01-06T13:29:34,011 Skipping link: No binaries permitted for unitxt: https://files.pythonhosted.org/packages/6b/b5/144bcad686fd0856d5e55afa832af65c5a0ab1cd68e3f5810f99ecad6bbd/unitxt-1.7.3-py3-none-any.whl (from https://pypi.org/simple/unitxt/) (requires-python:>=3.8) 2026-01-06T13:29:34,012 Found link https://files.pythonhosted.org/packages/18/2d/285793d136c1b46181c23c8d5151f19c7f7bbd19df3aaca87c2feea32264/unitxt-1.7.3.tar.gz (from https://pypi.org/simple/unitxt/) (requires-python:>=3.8), version: 1.7.3 2026-01-06T13:29:34,012 Skipping link: No binaries permitted for unitxt: https://files.pythonhosted.org/packages/48/eb/08cbd79d2647219bc56b29fda798ac8f396447abe04ef3918bf209921fa5/unitxt-1.7.4-py3-none-any.whl (from https://pypi.org/simple/unitxt/) (requires-python:>=3.8) 2026-01-06T13:29:34,013 Found link https://files.pythonhosted.org/packages/8c/4e/07f3da23342b34a21bba87a3823a5b07fd9bb57ff000b9f4ca8a25a304a9/unitxt-1.7.4.tar.gz (from https://pypi.org/simple/unitxt/) (requires-python:>=3.8), version: 1.7.4 2026-01-06T13:29:34,014 Skipping link: No binaries permitted for unitxt: https://files.pythonhosted.org/packages/5f/1b/d91ad58df97b9d4abffe3fdb1ecc06f605100d4fc68aa0c648879dc17220/unitxt-1.7.6-py3-none-any.whl (from https://pypi.org/simple/unitxt/) (requires-python:>=3.8) 2026-01-06T13:29:34,014 Found link https://files.pythonhosted.org/packages/8e/cc/ca7a3f531f42997e7b57f60f863813242b20f75fedcf3680098b0564f7f0/unitxt-1.7.6.tar.gz (from https://pypi.org/simple/unitxt/) (requires-python:>=3.8), version: 1.7.6 2026-01-06T13:29:34,015 Skipping link: No binaries permitted for unitxt: https://files.pythonhosted.org/packages/c0/50/130797cf6027e03e31ced6dba58431c112dca7cb0d77aff444d152d5a9ee/unitxt-1.7.7-py3-none-any.whl (from https://pypi.org/simple/unitxt/) (requires-python:>=3.8) 2026-01-06T13:29:34,016 Found link https://files.pythonhosted.org/packages/11/90/50793b6f9dcde0a23dcf8de3e1d051835f23c76b66918248e21964456570/unitxt-1.7.7.tar.gz (from https://pypi.org/simple/unitxt/) (requires-python:>=3.8), version: 1.7.7 2026-01-06T13:29:34,017 Skipping link: No binaries permitted for unitxt: https://files.pythonhosted.org/packages/db/69/b40831baf977a856f684c3b17ba3b93cd7286a0711780f1669e44ef1cf87/unitxt-1.7.8-py3-none-any.whl (from https://pypi.org/simple/unitxt/) (requires-python:>=3.8) 2026-01-06T13:29:34,018 Found link https://files.pythonhosted.org/packages/2a/65/c423c9142c37ca5e6c04b07856aa4403cc8e7cd1ac082986c349bbba8d11/unitxt-1.7.8.tar.gz (from https://pypi.org/simple/unitxt/) (requires-python:>=3.8), version: 1.7.8 2026-01-06T13:29:34,019 Skipping link: No binaries permitted for unitxt: https://files.pythonhosted.org/packages/65/a4/082a98d142a50b232009deb8870060ed1159bef7c7700fc945a5e1b1c576/unitxt-1.7.9-py3-none-any.whl (from https://pypi.org/simple/unitxt/) (requires-python:>=3.8) 2026-01-06T13:29:34,020 Found link https://files.pythonhosted.org/packages/2c/74/aeb29b7ea4c2c5164d7ad2db78380dc0dafff3fb110e55f40990b7dfeb5f/unitxt-1.7.9.tar.gz (from https://pypi.org/simple/unitxt/) (requires-python:>=3.8), version: 1.7.9 2026-01-06T13:29:34,020 Skipping link: No binaries permitted for unitxt: https://files.pythonhosted.org/packages/40/22/f66ec5af55ff05232ceed6000fbdf9c0f9dd75440315c7d7db379484400a/unitxt-1.8.0-py3-none-any.whl (from https://pypi.org/simple/unitxt/) (requires-python:>=3.8) 2026-01-06T13:29:34,021 Found link https://files.pythonhosted.org/packages/f1/70/1567cb0df5f1ecb0b57b7af412afa3d4c6f4d55b13174287215027f78ee0/unitxt-1.8.0.tar.gz (from https://pypi.org/simple/unitxt/) (requires-python:>=3.8), version: 1.8.0 2026-01-06T13:29:34,022 Skipping link: No binaries permitted for unitxt: https://files.pythonhosted.org/packages/45/4f/35ddea885fbf44ed77f59878a8aeeb42bee610ef5c7816cd5686fe11c9e7/unitxt-1.8.1-py3-none-any.whl (from https://pypi.org/simple/unitxt/) (requires-python:>=3.8) 2026-01-06T13:29:34,023 Found link https://files.pythonhosted.org/packages/cf/47/2c4684544ff10770059aa0841f7c1c9f3749c5b0af58854b4199cf75c724/unitxt-1.8.1.tar.gz (from https://pypi.org/simple/unitxt/) (requires-python:>=3.8), version: 1.8.1 2026-01-06T13:29:34,024 Skipping link: No binaries permitted for unitxt: https://files.pythonhosted.org/packages/49/e2/99691f526c7e639ed85a90b7528e26d5ad78813f6f135ec3ae09243e074f/unitxt-1.9.0-py3-none-any.whl (from https://pypi.org/simple/unitxt/) (requires-python:>=3.8) 2026-01-06T13:29:34,025 Found link https://files.pythonhosted.org/packages/e2/98/69dd3bc53ec1d69f15725badf2b4d09e4f59c880d31d391b77e87271e189/unitxt-1.9.0.tar.gz (from https://pypi.org/simple/unitxt/) (requires-python:>=3.8), version: 1.9.0 2026-01-06T13:29:34,025 Skipping link: No binaries permitted for unitxt: https://files.pythonhosted.org/packages/b2/93/cf4654da1a4287252ef58b4ecc282652a22ae0e9e699489a59d8eb6c4770/unitxt-1.10.0-py3-none-any.whl (from https://pypi.org/simple/unitxt/) (requires-python:>=3.8) 2026-01-06T13:29:34,026 Found link https://files.pythonhosted.org/packages/e2/05/b391af435d7374e32801695929e2fff7b2b38c37269fa6f24ad88c5c1e1d/unitxt-1.10.0.tar.gz (from https://pypi.org/simple/unitxt/) (requires-python:>=3.8), version: 1.10.0 2026-01-06T13:29:34,027 Skipping link: No binaries permitted for unitxt: https://files.pythonhosted.org/packages/5b/78/1fd132e1b142d1d5b9fa0f45c1abee0f6f11845ec0383da05270641c714a/unitxt-1.10.1-py3-none-any.whl (from https://pypi.org/simple/unitxt/) (requires-python:>=3.8) 2026-01-06T13:29:34,028 Found link https://files.pythonhosted.org/packages/aa/2c/ff867c9050c46fe0ef969c854e8283395bcea3a9422699783daab29a65ce/unitxt-1.10.1.tar.gz (from https://pypi.org/simple/unitxt/) (requires-python:>=3.8), version: 1.10.1 2026-01-06T13:29:34,028 Skipping link: No binaries permitted for unitxt: https://files.pythonhosted.org/packages/c6/6b/15a29c9c043b70f10bcfe734e69738868cc02ba854d27d5dc3c38148d638/unitxt-1.10.2-py3-none-any.whl (from https://pypi.org/simple/unitxt/) (requires-python:>=3.8) 2026-01-06T13:29:34,029 Found link https://files.pythonhosted.org/packages/ca/bb/36c17130bed6f135a9c8134171f24ce088116ec7e181fb20cdc010d236e1/unitxt-1.10.2.tar.gz (from https://pypi.org/simple/unitxt/) (requires-python:>=3.8), version: 1.10.2 2026-01-06T13:29:34,030 Skipping link: No binaries permitted for unitxt: https://files.pythonhosted.org/packages/ec/59/9f689da2b9d027dc6154a1584e73bcfd395d2ea21f87b89a331920de39f2/unitxt-1.10.3-py3-none-any.whl (from https://pypi.org/simple/unitxt/) (requires-python:>=3.8) 2026-01-06T13:29:34,031 Found link https://files.pythonhosted.org/packages/a5/c2/3502bc5d54fce05e84631015febc3009accf02fe17ebcfe21f8957b41038/unitxt-1.10.3.tar.gz (from https://pypi.org/simple/unitxt/) (requires-python:>=3.8), version: 1.10.3 2026-01-06T13:29:34,032 Skipping link: No binaries permitted for unitxt: https://files.pythonhosted.org/packages/ba/72/38562d593bfbad59884388397d349c02a43f506522a6c38f5f880e33a5c0/unitxt-1.11.0-py3-none-any.whl (from https://pypi.org/simple/unitxt/) (requires-python:>=3.8) 2026-01-06T13:29:34,032 Found link https://files.pythonhosted.org/packages/15/c1/f5691d721631c0dfda9081520048d9f5040006c94bf58a71589448b70ce7/unitxt-1.11.0.tar.gz (from https://pypi.org/simple/unitxt/) (requires-python:>=3.8), version: 1.11.0 2026-01-06T13:29:34,033 Skipping link: No binaries permitted for unitxt: https://files.pythonhosted.org/packages/26/22/9a3ee0912f98885f654beebb03f90294c0fd957c8114ca69bf29e12ad1f6/unitxt-1.11.1-py3-none-any.whl (from https://pypi.org/simple/unitxt/) (requires-python:>=3.8) 2026-01-06T13:29:34,034 Found link https://files.pythonhosted.org/packages/8b/a3/98734125bc1418eff9a00cd296ae17fa485778e8d652a3c245d7a1f73fef/unitxt-1.11.1.tar.gz (from https://pypi.org/simple/unitxt/) (requires-python:>=3.8), version: 1.11.1 2026-01-06T13:29:34,035 Skipping link: No binaries permitted for unitxt: https://files.pythonhosted.org/packages/e1/6e/302b606ffd159dab1261e61aa1f0fe64a7ed6158318ac867b5c832b51e97/unitxt-1.12.0-py3-none-any.whl (from https://pypi.org/simple/unitxt/) (requires-python:>=3.8) 2026-01-06T13:29:34,036 Found link https://files.pythonhosted.org/packages/0c/4a/c0fbee3975ec2fd18df6953120dc221a6191d4d29d89bc52ce4ec3c4718a/unitxt-1.12.0.tar.gz (from https://pypi.org/simple/unitxt/) (requires-python:>=3.8), version: 1.12.0 2026-01-06T13:29:34,037 Skipping link: No binaries permitted for unitxt: https://files.pythonhosted.org/packages/53/aa/fcc64d0486e683ee91b098729a57cdee00b551feae7c3c906c04aa8c082c/unitxt-1.12.2-py3-none-any.whl (from https://pypi.org/simple/unitxt/) (requires-python:>=3.8) 2026-01-06T13:29:34,038 Found link https://files.pythonhosted.org/packages/61/c2/6788469e9954b4d1dc725ea03b8a8d849c3484943bc4f56f33a7b5590311/unitxt-1.12.2.tar.gz (from https://pypi.org/simple/unitxt/) (requires-python:>=3.8), version: 1.12.2 2026-01-06T13:29:34,038 Skipping link: No binaries permitted for unitxt: https://files.pythonhosted.org/packages/34/ca/f36cf428780f82b96cfddf15e66ab362a0f5e67689758cbf16109b49f23d/unitxt-1.12.3-py3-none-any.whl (from https://pypi.org/simple/unitxt/) (requires-python:>=3.8) 2026-01-06T13:29:34,039 Found link https://files.pythonhosted.org/packages/2e/a0/129850543fe0585c455d5d473e7d65a6c510ff9d562e2601ba2945052382/unitxt-1.12.3.tar.gz (from https://pypi.org/simple/unitxt/) (requires-python:>=3.8), version: 1.12.3 2026-01-06T13:29:34,040 Skipping link: No binaries permitted for unitxt: https://files.pythonhosted.org/packages/a4/0e/5ce073bfde80fb99cd1b6ef3725627ebc03221170fc6d7b669d464466e9d/unitxt-1.12.4-py3-none-any.whl (from https://pypi.org/simple/unitxt/) (requires-python:>=3.8) 2026-01-06T13:29:34,041 Found link https://files.pythonhosted.org/packages/e8/0b/f1be5a140bf9b321b27446182f0a0d1d36815ba2d4ca01ab7c5e7a186bba/unitxt-1.12.4.tar.gz (from https://pypi.org/simple/unitxt/) (requires-python:>=3.8), version: 1.12.4 2026-01-06T13:29:34,041 Skipping link: No binaries permitted for unitxt: https://files.pythonhosted.org/packages/ce/22/9eb17d4ffd417aaee5bc2d92b1846237b96198bba297f98ff87d07e1a345/unitxt-1.13.0-py3-none-any.whl (from https://pypi.org/simple/unitxt/) (requires-python:>=3.8) 2026-01-06T13:29:34,042 Found link https://files.pythonhosted.org/packages/f6/85/10188d25411e97b47f42a6e1d58dc7ca68537a6cf26acfc3089e8608a98c/unitxt-1.13.0.tar.gz (from https://pypi.org/simple/unitxt/) (requires-python:>=3.8), version: 1.13.0 2026-01-06T13:29:34,043 Skipping link: No binaries permitted for unitxt: https://files.pythonhosted.org/packages/da/61/1e51d544f85194f8c2d614ddb8f33a0d6b9cce39e3419b7d0cd6a02a17dc/unitxt-1.13.1-py3-none-any.whl (from https://pypi.org/simple/unitxt/) (requires-python:>=3.8) 2026-01-06T13:29:34,044 Found link https://files.pythonhosted.org/packages/cc/b1/fab39a111d07c512f66ecca4e34f887539b1c1cf3251c6e4bd3c3c1535b2/unitxt-1.13.1.tar.gz (from https://pypi.org/simple/unitxt/) (requires-python:>=3.8), version: 1.13.1 2026-01-06T13:29:34,045 Skipping link: No binaries permitted for unitxt: https://files.pythonhosted.org/packages/07/bc/91c014790d9cfb9742766c0c76928dac7313c183fac30e40a158bcbe5fc7/unitxt-1.14.0-py3-none-any.whl (from https://pypi.org/simple/unitxt/) (requires-python:>=3.8) 2026-01-06T13:29:34,046 Found link https://files.pythonhosted.org/packages/70/24/78cc6337efc8e99c168dac278e70eccfa344669e06e89403bc77e526bec9/unitxt-1.14.0.tar.gz (from https://pypi.org/simple/unitxt/) (requires-python:>=3.8), version: 1.14.0 2026-01-06T13:29:34,047 Skipping link: No binaries permitted for unitxt: https://files.pythonhosted.org/packages/f7/de/756bf8d48d4b998e3a16c3c754231d6655be5ba2784f50014e138975279f/unitxt-1.14.1-py3-none-any.whl (from https://pypi.org/simple/unitxt/) (requires-python:>=3.8) 2026-01-06T13:29:34,048 Found link https://files.pythonhosted.org/packages/4a/68/dfc467083e42ee09998e108b4347c740121c9c22940dbef280f52d55facf/unitxt-1.14.1.tar.gz (from https://pypi.org/simple/unitxt/) (requires-python:>=3.8), version: 1.14.1 2026-01-06T13:29:34,048 Skipping link: No binaries permitted for unitxt: https://files.pythonhosted.org/packages/c7/77/4f5ddf5e206df145db14fb61687457f082c9797da4e96ca54b7685245718/unitxt-1.15.6-py3-none-any.whl (from https://pypi.org/simple/unitxt/) (requires-python:>=3.8) 2026-01-06T13:29:34,050 Found link https://files.pythonhosted.org/packages/b9/f0/de2fba113f54a3da5bba12b570d95591dca28b05fb98209a54a1c0f7a4bd/unitxt-1.15.6.tar.gz (from https://pypi.org/simple/unitxt/) (requires-python:>=3.8), version: 1.15.6 2026-01-06T13:29:34,050 Skipping link: No binaries permitted for unitxt: https://files.pythonhosted.org/packages/48/3f/dee7f199ed4b28c0cad74bce821b3a94f45470535f496b4578c267144ec7/unitxt-1.15.7-py3-none-any.whl (from https://pypi.org/simple/unitxt/) (requires-python:>=3.8) 2026-01-06T13:29:34,051 Found link https://files.pythonhosted.org/packages/0b/6d/f1a559b32a7c43e7804936b1e51cafd0b04fcf31a72b28cd1989e7a0680c/unitxt-1.15.7.tar.gz (from https://pypi.org/simple/unitxt/) (requires-python:>=3.8), version: 1.15.7 2026-01-06T13:29:34,052 Skipping link: No binaries permitted for unitxt: https://files.pythonhosted.org/packages/c5/20/0f408a271a4b7496cc9351196dfaf0d4eb21ed443a4c0bdf6a8f224bcb15/unitxt-1.15.8-py3-none-any.whl (from https://pypi.org/simple/unitxt/) (requires-python:>=3.8) 2026-01-06T13:29:34,052 Found link https://files.pythonhosted.org/packages/a1/7e/aee80d7b5565d02a012070d7fd37631a47b70da99976d58fd2c7980d8d9a/unitxt-1.15.8.tar.gz (from https://pypi.org/simple/unitxt/) (requires-python:>=3.8), version: 1.15.8 2026-01-06T13:29:34,053 Skipping link: No binaries permitted for unitxt: https://files.pythonhosted.org/packages/39/e7/4c4ae5000ffaafcaec7644dcaad1afee8ef4baf035a1c0ed52f0df988c6b/unitxt-1.15.9-py3-none-any.whl (from https://pypi.org/simple/unitxt/) (requires-python:>=3.8) 2026-01-06T13:29:34,054 Found link https://files.pythonhosted.org/packages/ba/e2/45cd1839c84b9c0651451e9abd364f058aed4b0a4a725573ad2e6d3b87aa/unitxt-1.15.9.tar.gz (from https://pypi.org/simple/unitxt/) (requires-python:>=3.8), version: 1.15.9 2026-01-06T13:29:34,054 Skipping link: No binaries permitted for unitxt: https://files.pythonhosted.org/packages/dc/ef/9cffc953f5ea4eb17698c1163819afa181a9d8892672114131ccffcb9699/unitxt-1.15.10-py3-none-any.whl (from https://pypi.org/simple/unitxt/) (requires-python:>=3.8) 2026-01-06T13:29:34,055 Found link https://files.pythonhosted.org/packages/7a/8a/eb348a8a441071e738673e838766135dbe85971aab5bf5647b648bd8f9b1/unitxt-1.15.10.tar.gz (from https://pypi.org/simple/unitxt/) (requires-python:>=3.8), version: 1.15.10 2026-01-06T13:29:34,056 Skipping link: No binaries permitted for unitxt: https://files.pythonhosted.org/packages/c1/a1/5101918d00f623986322f755d775ababff05c0d9efd469a6d8b289e4af28/unitxt-1.16.0-py3-none-any.whl (from https://pypi.org/simple/unitxt/) (requires-python:>=3.8) 2026-01-06T13:29:34,057 Found link https://files.pythonhosted.org/packages/af/52/fa432517d161487482a062fe1bce3dfebf532e5d5a9a3571af65ef2642ea/unitxt-1.16.0.tar.gz (from https://pypi.org/simple/unitxt/) (requires-python:>=3.8), version: 1.16.0 2026-01-06T13:29:34,058 Skipping link: No binaries permitted for unitxt: https://files.pythonhosted.org/packages/68/39/ec4043f2009ac9ca7ab6920384e9b7eed0dc83f6629cce3c157528838cc8/unitxt-1.16.1-py3-none-any.whl (from https://pypi.org/simple/unitxt/) (requires-python:>=3.8) 2026-01-06T13:29:34,059 Found link https://files.pythonhosted.org/packages/05/7a/795a963d77756283170bb036ffbabcd4558637addc387164fd05b5307ec8/unitxt-1.16.1.tar.gz (from https://pypi.org/simple/unitxt/) (requires-python:>=3.8), version: 1.16.1 2026-01-06T13:29:34,059 Skipping link: No binaries permitted for unitxt: https://files.pythonhosted.org/packages/eb/82/36c6929e0098c2a8dbbf0c87e4d0dc3c57e82e88446a42a2195e3bf714c6/unitxt-1.16.2-py3-none-any.whl (from https://pypi.org/simple/unitxt/) (requires-python:>=3.8) 2026-01-06T13:29:34,060 Found link https://files.pythonhosted.org/packages/39/6e/b9d2ec30ad363fee9f5b9af3a9cbeaa1ff17552617acf55a37825663ebcc/unitxt-1.16.2.tar.gz (from https://pypi.org/simple/unitxt/) (requires-python:>=3.8), version: 1.16.2 2026-01-06T13:29:34,061 Skipping link: No binaries permitted for unitxt: https://files.pythonhosted.org/packages/d5/7a/10608d7223e148fd77fbe44a8c50e9069dcdce3331c0f561bf7ddcae791d/unitxt-1.16.3-py3-none-any.whl (from https://pypi.org/simple/unitxt/) (requires-python:>=3.8) 2026-01-06T13:29:34,062 Found link https://files.pythonhosted.org/packages/70/99/c9af119e0ee12a03e4eb1aba238de3cbdcedee4428389f6729631f0accba/unitxt-1.16.3.tar.gz (from https://pypi.org/simple/unitxt/) (requires-python:>=3.8), version: 1.16.3 2026-01-06T13:29:34,063 Skipping link: No binaries permitted for unitxt: https://files.pythonhosted.org/packages/12/4b/f32a0b0faaff9f9313b7c545ff694c388c049bf94b065440d4c385c92ef5/unitxt-1.16.4-py3-none-any.whl (from https://pypi.org/simple/unitxt/) (requires-python:>=3.8) 2026-01-06T13:29:34,064 Found link https://files.pythonhosted.org/packages/95/81/aa5f10427622f38453ac1886ac01e15cbcc2f1c9ff18d94c347ae2a8095a/unitxt-1.16.4.tar.gz (from https://pypi.org/simple/unitxt/) (requires-python:>=3.8), version: 1.16.4 2026-01-06T13:29:34,064 Skipping link: No binaries permitted for unitxt: https://files.pythonhosted.org/packages/dc/7f/1326785089371de1104510f16bdca0ae45b8f15323d0eddf73d8d8a8a4ac/unitxt-1.17.0-py3-none-any.whl (from https://pypi.org/simple/unitxt/) (requires-python:>=3.8) 2026-01-06T13:29:34,065 Found link https://files.pythonhosted.org/packages/4e/58/186b6b1966401921b2f1f28a3fec113271eb9fb07e404b034aa11314950a/unitxt-1.17.0.tar.gz (from https://pypi.org/simple/unitxt/) (requires-python:>=3.8), version: 1.17.0 2026-01-06T13:29:34,066 Skipping link: No binaries permitted for unitxt: https://files.pythonhosted.org/packages/4f/e3/a56211d050bab7c9f47d66a3ae79341504068c57afdafdc198ac9d3e8423/unitxt-1.17.1-py3-none-any.whl (from https://pypi.org/simple/unitxt/) (requires-python:>=3.8) 2026-01-06T13:29:34,067 Found link https://files.pythonhosted.org/packages/0a/fe/3840438766376433e26ee3bcfae015aa54bb90b81d1f908e3f43efe1aec3/unitxt-1.17.1.tar.gz (from https://pypi.org/simple/unitxt/) (requires-python:>=3.8), version: 1.17.1 2026-01-06T13:29:34,067 Skipping link: No binaries permitted for unitxt: https://files.pythonhosted.org/packages/c1/f7/331ef88d7a201fa6fab7aa3c4da5e362dbc42ee7cb438f4598289ef4173c/unitxt-1.17.2-py3-none-any.whl (from https://pypi.org/simple/unitxt/) (requires-python:>=3.8) 2026-01-06T13:29:34,068 Found link https://files.pythonhosted.org/packages/96/cb/bf79447be5333489a539cb339caa4755990a03ea1f0a72b06d4fd5cad91a/unitxt-1.17.2.tar.gz (from https://pypi.org/simple/unitxt/) (requires-python:>=3.8), version: 1.17.2 2026-01-06T13:29:34,069 Skipping link: No binaries permitted for unitxt: https://files.pythonhosted.org/packages/7f/54/c07931fdfde9216bfdbfc0f750c6ac4b4dac699b45f2743750097f3c3282/unitxt-1.18.0-py3-none-any.whl (from https://pypi.org/simple/unitxt/) (requires-python:>=3.8) 2026-01-06T13:29:34,070 Found link https://files.pythonhosted.org/packages/7f/b9/40673c1639ea52b808066a58c2a6d7728760c720a7a67189a05126c62eec/unitxt-1.18.0.tar.gz (from https://pypi.org/simple/unitxt/) (requires-python:>=3.8), version: 1.18.0 2026-01-06T13:29:34,071 Skipping link: No binaries permitted for unitxt: https://files.pythonhosted.org/packages/8f/be/5b04f2a962f443fb1232385056a66030703a1ea5eb0668717a50f4624950/unitxt-1.19.0-py3-none-any.whl (from https://pypi.org/simple/unitxt/) (requires-python:>=3.8) 2026-01-06T13:29:34,072 Found link https://files.pythonhosted.org/packages/84/0c/7bbf65409b22d468f9263d527a51530a489f3fccb8faba33ab6b151b0c09/unitxt-1.19.0.tar.gz (from https://pypi.org/simple/unitxt/) (requires-python:>=3.8), version: 1.19.0 2026-01-06T13:29:34,072 Skipping link: No binaries permitted for unitxt: https://files.pythonhosted.org/packages/a7/65/6d51e684ab355851a671f1277aec67c3f202bef15657b6e2e03d9fc035c6/unitxt-1.20.0-py3-none-any.whl (from https://pypi.org/simple/unitxt/) (requires-python:>=3.8) 2026-01-06T13:29:34,073 Found link https://files.pythonhosted.org/packages/95/ea/67cb2f1c98950176d24cf36aaa708e8574df868c62f9c244839c1757d3bc/unitxt-1.20.0.tar.gz (from https://pypi.org/simple/unitxt/) (requires-python:>=3.8), version: 1.20.0 2026-01-06T13:29:34,074 Skipping link: No binaries permitted for unitxt: https://files.pythonhosted.org/packages/51/22/104bc58e591adf8c1ab5aa7394dac2f4b8c9d6d049864c06ff5f0761d0bd/unitxt-1.21.0-py3-none-any.whl (from https://pypi.org/simple/unitxt/) (requires-python:>=3.8) 2026-01-06T13:29:34,075 Found link https://files.pythonhosted.org/packages/07/11/212b1d9b9a0125adf6df3fc61f764f7779a5722fc3a7800346669e591300/unitxt-1.21.0.tar.gz (from https://pypi.org/simple/unitxt/) (requires-python:>=3.8), version: 1.21.0 2026-01-06T13:29:34,076 Skipping link: No binaries permitted for unitxt: https://files.pythonhosted.org/packages/35/b0/31d6a49431770663f238eca5d76c0bafe7d094c0cb6c8a0fe7142b7c3f14/unitxt-1.22.0-py3-none-any.whl (from https://pypi.org/simple/unitxt/) (requires-python:>=3.8) 2026-01-06T13:29:34,076 Found link https://files.pythonhosted.org/packages/65/dc/648810f78839db26139e88b7388f9f3481578e0005c406adb7727227e0b1/unitxt-1.22.0.tar.gz (from https://pypi.org/simple/unitxt/) (requires-python:>=3.8), version: 1.22.0 2026-01-06T13:29:34,077 Skipping link: No binaries permitted for unitxt: https://files.pythonhosted.org/packages/20/47/c7fc9adca33de9c0183d4be4a6a0f4ef204cbe08395aed0f34910738b0f1/unitxt-1.22.1-py3-none-any.whl (from https://pypi.org/simple/unitxt/) (requires-python:>=3.8) 2026-01-06T13:29:34,078 Found link https://files.pythonhosted.org/packages/9a/bb/31f76a0c74d78150a845cd4e46c5a385d41cd25aa189e2665c249b81c775/unitxt-1.22.1.tar.gz (from https://pypi.org/simple/unitxt/) (requires-python:>=3.8), version: 1.22.1 2026-01-06T13:29:34,078 Skipping link: No binaries permitted for unitxt: https://files.pythonhosted.org/packages/71/25/7381055a00d191f137f01c85ba18ab1c78317a68fbe1d2695862134211bf/unitxt-1.22.2-py3-none-any.whl (from https://pypi.org/simple/unitxt/) (requires-python:>=3.8) 2026-01-06T13:29:34,079 Found link https://files.pythonhosted.org/packages/50/b8/3605637a5a8632e761261c15f586f45055871dea28db9196bc813d98acbd/unitxt-1.22.2.tar.gz (from https://pypi.org/simple/unitxt/) (requires-python:>=3.8), version: 1.22.2 2026-01-06T13:29:34,080 Skipping link: No binaries permitted for unitxt: https://files.pythonhosted.org/packages/6e/9e/53c5da526410e603534303eb0a8d317c00a448f0ce284dee30c8e1e81a0c/unitxt-1.22.3-py3-none-any.whl (from https://pypi.org/simple/unitxt/) (requires-python:>=3.8) 2026-01-06T13:29:34,081 Found link https://files.pythonhosted.org/packages/a9/a1/c0863aee6a05bde3d3cc2bd4334483cd5198f1a8dff3c662d0744800af78/unitxt-1.22.3.tar.gz (from https://pypi.org/simple/unitxt/) (requires-python:>=3.8), version: 1.22.3 2026-01-06T13:29:34,082 Skipping link: No binaries permitted for unitxt: https://files.pythonhosted.org/packages/0f/87/03ed3b5edfd7b5d34d4deb6a12ef02e7834b1db0c873acbe69096b1fa8ba/unitxt-1.22.4-py3-none-any.whl (from https://pypi.org/simple/unitxt/) (requires-python:>=3.8) 2026-01-06T13:29:34,083 Found link https://files.pythonhosted.org/packages/db/bf/7b3fba584153936ba717c3865374633bc451e3ba420f71e617b71b478f18/unitxt-1.22.4.tar.gz (from https://pypi.org/simple/unitxt/) (requires-python:>=3.8), version: 1.22.4 2026-01-06T13:29:34,083 Skipping link: No binaries permitted for unitxt: https://files.pythonhosted.org/packages/36/47/65d15e6072dff8f6df1a263d047d7c07c75f364cb4baf286aa369409c9a0/unitxt-1.23.0-py3-none-any.whl (from https://pypi.org/simple/unitxt/) (requires-python:>=3.8) 2026-01-06T13:29:34,084 Found link https://files.pythonhosted.org/packages/28/06/90d21fd59a884150b97d2439e879c1ab1655d49ab125b696b66d371a56d1/unitxt-1.23.0.tar.gz (from https://pypi.org/simple/unitxt/) (requires-python:>=3.8), version: 1.23.0 2026-01-06T13:29:34,085 Skipping link: No binaries permitted for unitxt: https://files.pythonhosted.org/packages/62/de/a84986a8c771bd8c2de4d82b9ec9654eec0701db30b5269a1c98b0b40e72/unitxt-1.23.1-py3-none-any.whl (from https://pypi.org/simple/unitxt/) (requires-python:>=3.8) 2026-01-06T13:29:34,086 Found link https://files.pythonhosted.org/packages/c2/09/8d2aed1843a291ebc1ee82ce32bf8815a9eb65fcd6bacc70d38f23cc2e44/unitxt-1.23.1.tar.gz (from https://pypi.org/simple/unitxt/) (requires-python:>=3.8), version: 1.23.1 2026-01-06T13:29:34,087 Skipping link: No binaries permitted for unitxt: https://files.pythonhosted.org/packages/d7/61/73e8fcb9a33dfaed609eb52301656bccc21a4e372a970d98706c948e2ce9/unitxt-1.24.0-py3-none-any.whl (from https://pypi.org/simple/unitxt/) (requires-python:>=3.8) 2026-01-06T13:29:34,088 Found link https://files.pythonhosted.org/packages/3d/2e/abf220721625586c937585370a93bb0e6e9bd6462cf8313565c5c7107a64/unitxt-1.24.0.tar.gz (from https://pypi.org/simple/unitxt/) (requires-python:>=3.8), version: 1.24.0 2026-01-06T13:29:34,088 Skipping link: No binaries permitted for unitxt: https://files.pythonhosted.org/packages/27/f5/0b39aa090e8e3f431ca9cdb56da92af77982a0497f7853cb1aa60f1c1943/unitxt-1.25.0-py3-none-any.whl (from https://pypi.org/simple/unitxt/) (requires-python:>=3.8) 2026-01-06T13:29:34,089 Found link https://files.pythonhosted.org/packages/d1/35/4f3bb7d13a262470c6cde689b3ded940988220a2140f4781c747fac6654c/unitxt-1.25.0.tar.gz (from https://pypi.org/simple/unitxt/) (requires-python:>=3.8), version: 1.25.0 2026-01-06T13:29:34,090 Skipping link: No binaries permitted for unitxt: https://files.pythonhosted.org/packages/3f/df/cd7c2bb8bafe0fc13e825f9b2d93c205804642a7460637c3d4b595d976c9/unitxt-1.26.0-py3-none-any.whl (from https://pypi.org/simple/unitxt/) (requires-python:>=3.8) 2026-01-06T13:29:34,090 Found link https://files.pythonhosted.org/packages/8e/88/434ccf056e5899cdb0664793110f8865bfa76af5ad0b801edbfdb756e937/unitxt-1.26.0.tar.gz (from https://pypi.org/simple/unitxt/) (requires-python:>=3.8), version: 1.26.0 2026-01-06T13:29:34,091 Skipping link: No binaries permitted for unitxt: https://files.pythonhosted.org/packages/ba/93/2d917b7d44136fcecbe432242b3f862e282afb06a3cebdf3b7a80c2fd97d/unitxt-1.26.1-py3-none-any.whl (from https://pypi.org/simple/unitxt/) (requires-python:>=3.8) 2026-01-06T13:29:34,092 Found link https://files.pythonhosted.org/packages/9b/df/e79513c8324b6e06982e5f951a5ce10d529261f6c4018d83148f1d0aae34/unitxt-1.26.1.tar.gz (from https://pypi.org/simple/unitxt/) (requires-python:>=3.8), version: 1.26.1 2026-01-06T13:29:34,093 Skipping link: No binaries permitted for unitxt: https://files.pythonhosted.org/packages/b4/18/b5e41a3e4c3f932cf3b85aa07f9946c58002ac0197a388e764cedf270521/unitxt-1.26.2-py3-none-any.whl (from https://pypi.org/simple/unitxt/) (requires-python:>=3.8) 2026-01-06T13:29:34,094 Found link https://files.pythonhosted.org/packages/c4/3e/327710b0d0b2d3486c91dc6fd19c788373f48ec5819ae4a8c4d8df2af22b/unitxt-1.26.2.tar.gz (from https://pypi.org/simple/unitxt/) (requires-python:>=3.8), version: 1.26.2 2026-01-06T13:29:34,094 Skipping link: No binaries permitted for unitxt: https://files.pythonhosted.org/packages/c3/8a/2b2328bb2ca0a7521de1c77b168081738ed27a43b0b24c35c438f73e33d3/unitxt-1.26.3-py3-none-any.whl (from https://pypi.org/simple/unitxt/) (requires-python:>=3.8) 2026-01-06T13:29:34,095 Found link https://files.pythonhosted.org/packages/8d/71/0026f05fa1b0bfc72d541f4225301b174ff498a9f31ce4c43f4aeb30991a/unitxt-1.26.3.tar.gz (from https://pypi.org/simple/unitxt/) (requires-python:>=3.8), version: 1.26.3 2026-01-06T13:29:34,096 Skipping link: No binaries permitted for unitxt: https://files.pythonhosted.org/packages/21/8e/6b80f38968d2028d29cfd73a4e35f88deb7b9b25d6560ec0321dfefba17a/unitxt-1.26.4-py3-none-any.whl (from https://pypi.org/simple/unitxt/) (requires-python:>=3.8) 2026-01-06T13:29:34,097 Found link https://files.pythonhosted.org/packages/8b/63/25be472438554113d73bd0ba6376796896a681d39eefbf6c84f360c4513d/unitxt-1.26.4.tar.gz (from https://pypi.org/simple/unitxt/) (requires-python:>=3.8), version: 1.26.4 2026-01-06T13:29:34,098 Skipping link: No binaries permitted for unitxt: https://files.pythonhosted.org/packages/a6/c0/f71a77e934bdbf92d27e4aaa43f5fb2a7344cb9a3b5da54ba4c307803f21/unitxt-1.26.5-py3-none-any.whl (from https://pypi.org/simple/unitxt/) (requires-python:>=3.8) 2026-01-06T13:29:34,099 Found link https://files.pythonhosted.org/packages/b7/a6/f340d3caad1c471163ff69e4887e9fe268531e3e2923fab16c1d72708d5f/unitxt-1.26.5.tar.gz (from https://pypi.org/simple/unitxt/) (requires-python:>=3.8), version: 1.26.5 2026-01-06T13:29:34,100 Skipping link: No binaries permitted for unitxt: https://files.pythonhosted.org/packages/61/b8/94feb68e8c5b41218d6628669f5810d6b355dfa06d1db9ced22025b1b28c/unitxt-1.26.6-py3-none-any.whl (from https://pypi.org/simple/unitxt/) (requires-python:>=3.8) 2026-01-06T13:29:34,100 Found link https://files.pythonhosted.org/packages/d8/7e/db3a123bd5e8220299d10e9b7d6f7d3072b8f878708a13113bd5dc61e52a/unitxt-1.26.6.tar.gz (from https://pypi.org/simple/unitxt/) (requires-python:>=3.8), version: 1.26.6 2026-01-06T13:29:34,101 Skipping link: No binaries permitted for unitxt: https://files.pythonhosted.org/packages/22/0a/36d6c355c916eb5082323c8458f3185018d826956e673a6c09cd033e801a/unitxt-1.26.7-py3-none-any.whl (from https://pypi.org/simple/unitxt/) (requires-python:>=3.8) 2026-01-06T13:29:34,102 Found link https://files.pythonhosted.org/packages/aa/b1/e123a7cabdda6c77cce021925e68b3c6b420a8017884736181f147f1ca33/unitxt-1.26.7.tar.gz (from https://pypi.org/simple/unitxt/) (requires-python:>=3.8), version: 1.26.7 2026-01-06T13:29:34,102 Skipping link: No binaries permitted for unitxt: https://files.pythonhosted.org/packages/50/85/094363f7f5da524949ed6c4ab16024f36c3d3a2ec60e25291f7a32d2f5c6/unitxt-1.26.8-py3-none-any.whl (from https://pypi.org/simple/unitxt/) (requires-python:>=3.8) 2026-01-06T13:29:34,103 Found link https://files.pythonhosted.org/packages/45/a0/2498b08680bf78163321840c236322cf49422fac1f7afd0eebc7b4aa643d/unitxt-1.26.8.tar.gz (from https://pypi.org/simple/unitxt/) (requires-python:>=3.8), version: 1.26.8 2026-01-06T13:29:34,104 Fetching project page and analyzing links: https://www.piwheels.org/simple/unitxt/ 2026-01-06T13:29:34,105 Getting page https://www.piwheels.org/simple/unitxt/ 2026-01-06T13:29:34,106 Found index url https://www.piwheels.org/simple 2026-01-06T13:29:34,349 Fetched page https://www.piwheels.org/simple/unitxt/ as text/html 2026-01-06T13:29:34,360 Skipping link: No binaries permitted for unitxt: https://www.piwheels.org/simple/unitxt/unitxt-1.26.7-py3-none-any.whl#sha256=1bf931de32df61cc6593135d9767737307d7fde8765e0b15dcacd20bd488e53e (from https://www.piwheels.org/simple/unitxt/) (requires-python:>=3.8) 2026-01-06T13:29:34,360 Skipping link: No binaries permitted for unitxt: https://archive1.piwheels.org/simple/unitxt/unitxt-1.26.6-py3-none-any.whl#sha256=5cdb7b8221f1a7997250d9aaf8b089439479a9c547e674573b4b22a7003ba664 (from https://www.piwheels.org/simple/unitxt/) (requires-python:>=3.8) 2026-01-06T13:29:34,361 Skipping link: No binaries permitted for unitxt: https://archive1.piwheels.org/simple/unitxt/unitxt-1.26.5-py3-none-any.whl#sha256=50928ba0f2db3e11d754b5d360806bcaed7889def23311e08bb674682bf82dad (from https://www.piwheels.org/simple/unitxt/) (requires-python:>=3.8) 2026-01-06T13:29:34,362 Skipping link: No binaries permitted for unitxt: https://archive1.piwheels.org/simple/unitxt/unitxt-1.26.4-py3-none-any.whl#sha256=ba799ee72a97c6a21a9fe89d07ca84bb12e95396e4580f01022d6ebc8f22b052 (from https://www.piwheels.org/simple/unitxt/) (requires-python:>=3.8) 2026-01-06T13:29:34,362 Skipping link: No binaries permitted for unitxt: https://archive1.piwheels.org/simple/unitxt/unitxt-1.26.3-py3-none-any.whl#sha256=41b3345e5e9aa9442e972ec1061914f96fca699935837596049f55fdbff8a352 (from https://www.piwheels.org/simple/unitxt/) (requires-python:>=3.8) 2026-01-06T13:29:34,363 Skipping link: No binaries permitted for unitxt: https://archive1.piwheels.org/simple/unitxt/unitxt-1.26.2-py3-none-any.whl#sha256=8938710761272f29708076f5ff3eb69284a2bdd3efccb7c71f3d58266d696d0a (from https://www.piwheels.org/simple/unitxt/) (requires-python:>=3.8) 2026-01-06T13:29:34,363 Skipping link: No binaries permitted for unitxt: https://archive1.piwheels.org/simple/unitxt/unitxt-1.26.1-py3-none-any.whl#sha256=249aef3d72d6087909fcfe44da337c0d4329a8d850752bf782a8a48963f9e315 (from https://www.piwheels.org/simple/unitxt/) (requires-python:>=3.8) 2026-01-06T13:29:34,364 Skipping link: No binaries permitted for unitxt: https://archive1.piwheels.org/simple/unitxt/unitxt-1.26.0-py3-none-any.whl#sha256=d975f99895a416a4b8592ad4981ce05a0b2ebfce1468171716ccaebc27144fe9 (from https://www.piwheels.org/simple/unitxt/) (requires-python:>=3.8) 2026-01-06T13:29:34,365 Skipping link: No binaries permitted for unitxt: https://archive1.piwheels.org/simple/unitxt/unitxt-1.25.0-py3-none-any.whl#sha256=7f29296002a9df0ee50f136d9c64fa48921c3e6b91a182b9c47494bbb39fba36 (from https://www.piwheels.org/simple/unitxt/) (requires-python:>=3.8) 2026-01-06T13:29:34,365 Skipping link: No binaries permitted for unitxt: https://archive1.piwheels.org/simple/unitxt/unitxt-1.24.0-py3-none-any.whl#sha256=5faab657fe934ff3e9ef545f8570b89629cd01f269b0d87ecd29dff92474cb51 (from https://www.piwheels.org/simple/unitxt/) (requires-python:>=3.8) 2026-01-06T13:29:34,366 Skipping link: No binaries permitted for unitxt: https://archive1.piwheels.org/simple/unitxt/unitxt-1.23.1-py3-none-any.whl#sha256=202aad8b827cecf0fd794c2f70e17200f1f59ef2d7bdeb5e85889aac1cf7f19f (from https://www.piwheels.org/simple/unitxt/) (requires-python:>=3.8) 2026-01-06T13:29:34,366 Skipping link: No binaries permitted for unitxt: https://archive1.piwheels.org/simple/unitxt/unitxt-1.23.0-py3-none-any.whl#sha256=6ca125bcf7a402049bfe28fecc5175862e0e94d0ae119e711c65a5788a2bda98 (from https://www.piwheels.org/simple/unitxt/) (requires-python:>=3.8) 2026-01-06T13:29:34,367 Skipping link: No binaries permitted for unitxt: https://archive1.piwheels.org/simple/unitxt/unitxt-1.22.4-py3-none-any.whl#sha256=d7b3fb369e39eea3f7a9020d0de002c2159da1d7e0e59f05188e353627488e42 (from https://www.piwheels.org/simple/unitxt/) (requires-python:>=3.8) 2026-01-06T13:29:34,367 Skipping link: No binaries permitted for unitxt: https://archive1.piwheels.org/simple/unitxt/unitxt-1.22.3-py3-none-any.whl#sha256=6191b273b617bd2ece88767dd8b16f8318517ba0810377d27d16dc7b9e590dcb (from https://www.piwheels.org/simple/unitxt/) (requires-python:>=3.8) 2026-01-06T13:29:34,368 Skipping link: No binaries permitted for unitxt: https://archive1.piwheels.org/simple/unitxt/unitxt-1.22.2-py3-none-any.whl#sha256=79a2fafd79be53d90c8a302f6b9b3fc6caa47004bae9e29dc945b75d7f1f5ac7 (from https://www.piwheels.org/simple/unitxt/) (requires-python:>=3.8) 2026-01-06T13:29:34,368 Skipping link: No binaries permitted for unitxt: https://archive1.piwheels.org/simple/unitxt/unitxt-1.22.1-py3-none-any.whl#sha256=d04567b442c00815adab0efd3d9079b6401e960507f80c070fa30dec72bc3286 (from https://www.piwheels.org/simple/unitxt/) (requires-python:>=3.8) 2026-01-06T13:29:34,369 Skipping link: No binaries permitted for unitxt: https://archive1.piwheels.org/simple/unitxt/unitxt-1.22.0-py3-none-any.whl#sha256=8fe219da3d2fba763d78b017bb9e0afb4ed7d3b66a942496ac11f903a9f6c3a4 (from https://www.piwheels.org/simple/unitxt/) (requires-python:>=3.8) 2026-01-06T13:29:34,370 Skipping link: No binaries permitted for unitxt: https://archive1.piwheels.org/simple/unitxt/unitxt-1.21.0-py3-none-any.whl#sha256=a3cc0d8765d375b7811431310b10f25538c06d930c20533ea5b33e3a6e7e9d6e (from https://www.piwheels.org/simple/unitxt/) (requires-python:>=3.8) 2026-01-06T13:29:34,370 Skipping link: No binaries permitted for unitxt: https://archive1.piwheels.org/simple/unitxt/unitxt-1.20.0-py3-none-any.whl#sha256=4f2d951df83d84af78a712031e5a7b50267ed7414506901c1027b838340f1b1e (from https://www.piwheels.org/simple/unitxt/) (requires-python:>=3.8) 2026-01-06T13:29:34,371 Skipping link: No binaries permitted for unitxt: https://archive1.piwheels.org/simple/unitxt/unitxt-1.19.0-py3-none-any.whl#sha256=9a50ce6821619c85e41b78b2f7ad1a27f95ea27e62c988ef658d47a88077ad2b (from https://www.piwheels.org/simple/unitxt/) (requires-python:>=3.8) 2026-01-06T13:29:34,371 Skipping link: No binaries permitted for unitxt: https://archive1.piwheels.org/simple/unitxt/unitxt-1.18.0-py3-none-any.whl#sha256=bd53260ec29c82abef68c7b2a955d8c397ba0b64f5b92e0bdcfc7a9b887c053d (from https://www.piwheels.org/simple/unitxt/) (requires-python:>=3.8) 2026-01-06T13:29:34,372 Skipping link: No binaries permitted for unitxt: https://archive1.piwheels.org/simple/unitxt/unitxt-1.17.2-py3-none-any.whl#sha256=37ba61972e9bdc1014f633b3df104fd56e0b77989263a033aac14fbf57a1f534 (from https://www.piwheels.org/simple/unitxt/) (requires-python:>=3.8) 2026-01-06T13:29:34,373 Skipping link: No binaries permitted for unitxt: https://archive1.piwheels.org/simple/unitxt/unitxt-1.17.1-py3-none-any.whl#sha256=a3fdf135f154ad6dff3e6d9deba685dbf94bf9968382f93fdbc43a64fea27d45 (from https://www.piwheels.org/simple/unitxt/) (requires-python:>=3.8) 2026-01-06T13:29:34,373 Skipping link: No binaries permitted for unitxt: https://archive1.piwheels.org/simple/unitxt/unitxt-1.17.0-py3-none-any.whl#sha256=d029e01585bc1ee13c3ad96dbdcb8921036d0f2752716e1477bf757d84b6c6cc (from https://www.piwheels.org/simple/unitxt/) (requires-python:>=3.8) 2026-01-06T13:29:34,373 Skipping link: No binaries permitted for unitxt: https://archive1.piwheels.org/simple/unitxt/unitxt-1.16.4-py3-none-any.whl#sha256=70026ae1118327261b6a997a655dd60f50db2f637dcbbdeb423b214739e60712 (from https://www.piwheels.org/simple/unitxt/) (requires-python:>=3.8) 2026-01-06T13:29:34,374 Skipping link: No binaries permitted for unitxt: https://archive1.piwheels.org/simple/unitxt/unitxt-1.16.3-py3-none-any.whl#sha256=cc4627f40b27ccf86d3e148d37bf12b3a58cf72bcf4b4dd3a8e95a6484856643 (from https://www.piwheels.org/simple/unitxt/) (requires-python:>=3.8) 2026-01-06T13:29:34,374 Skipping link: No binaries permitted for unitxt: https://archive1.piwheels.org/simple/unitxt/unitxt-1.16.2-py3-none-any.whl#sha256=4f6b72a4c34b5bd05a87007f84b86ce3d4bc645639deb85aebceab2b360eb806 (from https://www.piwheels.org/simple/unitxt/) (requires-python:>=3.8) 2026-01-06T13:29:34,375 Skipping link: No binaries permitted for unitxt: https://archive1.piwheels.org/simple/unitxt/unitxt-1.16.1-py3-none-any.whl#sha256=70aaf53f2794be1a7d22cd8c65957b9afdf8dda58efc09a723320274ac5ecb30 (from https://www.piwheels.org/simple/unitxt/) (requires-python:>=3.8) 2026-01-06T13:29:34,375 Skipping link: No binaries permitted for unitxt: https://archive1.piwheels.org/simple/unitxt/unitxt-1.16.0-py3-none-any.whl#sha256=498d60de1829c4369a67ffc748a7149accca692ce10b969d968510a6d5e6b9f2 (from https://www.piwheels.org/simple/unitxt/) (requires-python:>=3.8) 2026-01-06T13:29:34,376 Skipping link: No binaries permitted for unitxt: https://archive1.piwheels.org/simple/unitxt/unitxt-1.15.10-py3-none-any.whl#sha256=e8330cccf455567c9a9a2e7e8442bd29c13fa52d4347ed40d1863d5d8251b106 (from https://www.piwheels.org/simple/unitxt/) (requires-python:>=3.8) 2026-01-06T13:29:34,377 Skipping link: No binaries permitted for unitxt: https://archive1.piwheels.org/simple/unitxt/unitxt-1.15.9-py3-none-any.whl#sha256=e3f95b0317a6814314667a949ef664c63f77c3205c50469a073bda29ffa237ee (from https://www.piwheels.org/simple/unitxt/) (requires-python:>=3.8) 2026-01-06T13:29:34,377 Skipping link: No binaries permitted for unitxt: https://archive1.piwheels.org/simple/unitxt/unitxt-1.15.8-py3-none-any.whl#sha256=e60b21e2a67ecbd56e8f2d62b53bfe224d64fa8ff94f01eea74d9e54712d0b2c (from https://www.piwheels.org/simple/unitxt/) (requires-python:>=3.8) 2026-01-06T13:29:34,378 Skipping link: No binaries permitted for unitxt: https://archive1.piwheels.org/simple/unitxt/unitxt-1.15.7-py3-none-any.whl#sha256=c1324bdeeda9f2e18f5d84e0d7b4bf4edf46ca79b959180993472ecaa0fba2a0 (from https://www.piwheels.org/simple/unitxt/) (requires-python:>=3.8) 2026-01-06T13:29:34,378 Skipping link: No binaries permitted for unitxt: https://archive1.piwheels.org/simple/unitxt/unitxt-1.15.6-py3-none-any.whl#sha256=614a1b437c499d5c5525bbf96dab1a1ad9e1c9c102ee14199dfbced6ed5ef464 (from https://www.piwheels.org/simple/unitxt/) (requires-python:>=3.8) 2026-01-06T13:29:34,379 Skipping link: No binaries permitted for unitxt: https://archive1.piwheels.org/simple/unitxt/unitxt-0.0.1-py3-none-any.whl#sha256=d5db4950544d2741808be98b6a40f37b95b9eef3012027ea5ed4093d8d4fe688 (from https://www.piwheels.org/simple/unitxt/) 2026-01-06T13:29:34,380 Skipping link: not a file: https://www.piwheels.org/simple/unitxt/ 2026-01-06T13:29:34,381 Skipping link: not a file: https://pypi.org/simple/unitxt/ 2026-01-06T13:29:34,413 Given no hashes to check 1 links for project 'unitxt': discarding no candidates 2026-01-06T13:29:34,431 Collecting unitxt==1.26.8 2026-01-06T13:29:34,433 Created temporary directory: /tmp/pip-unpack-j1vvemq4 2026-01-06T13:29:34,649 Downloading unitxt-1.26.8.tar.gz (28.8 MB) 2026-01-06T13:29:48,032 Added unitxt==1.26.8 from https://files.pythonhosted.org/packages/45/a0/2498b08680bf78163321840c236322cf49422fac1f7afd0eebc7b4aa643d/unitxt-1.26.8.tar.gz to build tracker '/tmp/pip-build-tracker-_kpo56qn' 2026-01-06T13:29:48,042 Created temporary directory: /tmp/pip-build-env-xp07urtj 2026-01-06T13:29:48,046 Installing build dependencies: started 2026-01-06T13:29:48,047 Running command pip subprocess to install build dependencies 2026-01-06T13:29:49,216 Using pip 23.0.1 from /usr/lib/python3/dist-packages/pip (python 3.11) 2026-01-06T13:29:49,804 DEPRECATION: --no-binary currently disables reading from the cache of locally built wheels. In the future --no-binary will not influence the wheel cache. pip 23.1 will enforce this behaviour change. A possible replacement is to use the --no-cache-dir option. You can use the flag --use-feature=no-binary-enable-wheel-cache to test the upcoming behaviour. Discussion can be found at https://github.com/pypa/pip/issues/11453 2026-01-06T13:29:49,828 Looking in indexes: https://pypi.org/simple, https://www.piwheels.org/simple 2026-01-06T13:29:51,549 Collecting setuptools 2026-01-06T13:29:51,643 Using cached https://www.piwheels.org/simple/setuptools/setuptools-80.9.0-py3-none-any.whl (1.2 MB) 2026-01-06T13:29:51,939 Collecting wheel 2026-01-06T13:29:51,955 Using cached https://www.piwheels.org/simple/wheel/wheel-0.45.1-py3-none-any.whl (72 kB) 2026-01-06T13:29:54,944 Installing collected packages: wheel, setuptools 2026-01-06T13:29:55,186 Creating /tmp/pip-build-env-xp07urtj/overlay/local/bin 2026-01-06T13:29:55,188 changing mode of /tmp/pip-build-env-xp07urtj/overlay/local/bin/wheel to 755 2026-01-06T13:29:59,037 Successfully installed setuptools-80.9.0 wheel-0.45.1 2026-01-06T13:29:59,308 Installing build dependencies: finished with status 'done' 2026-01-06T13:29:59,314 Getting requirements to build wheel: started 2026-01-06T13:29:59,316 Running command Getting requirements to build wheel 2026-01-06T13:30:00,237 /tmp/pip-build-env-xp07urtj/overlay/local/lib/python3.11/dist-packages/setuptools/config/_apply_pyprojecttoml.py:82: SetuptoolsDeprecationWarning: `project.license` as a TOML table is deprecated 2026-01-06T13:30:00,237 !! 2026-01-06T13:30:00,239 ******************************************************************************** 2026-01-06T13:30:00,239 Please use a simple string containing a SPDX expression for `project.license`. You can also use `project.license-files`. (Both options available on setuptools>=77.0.0). 2026-01-06T13:30:00,241 By 2026-Feb-18, you need to update your project and remove deprecated calls 2026-01-06T13:30:00,241 or your builds will no longer be supported. 2026-01-06T13:30:00,243 See https://packaging.python.org/en/latest/guides/writing-pyproject-toml/#license for details. 2026-01-06T13:30:00,243 ******************************************************************************** 2026-01-06T13:30:00,245 !! 2026-01-06T13:30:00,245 corresp(dist, value, root_dir) 2026-01-06T13:30:00,348 running egg_info 2026-01-06T13:30:00,355 writing src/unitxt.egg-info/PKG-INFO 2026-01-06T13:30:00,390 writing dependency_links to src/unitxt.egg-info/dependency_links.txt 2026-01-06T13:30:00,392 writing entry points to src/unitxt.egg-info/entry_points.txt 2026-01-06T13:30:00,410 writing requirements to src/unitxt.egg-info/requires.txt 2026-01-06T13:30:00,412 writing top-level names to src/unitxt.egg-info/top_level.txt 2026-01-06T13:30:02,042 reading manifest file 'src/unitxt.egg-info/SOURCES.txt' 2026-01-06T13:30:02,310 adding license file 'LICENSE' 2026-01-06T13:30:02,566 writing manifest file 'src/unitxt.egg-info/SOURCES.txt' 2026-01-06T13:30:02,712 Getting requirements to build wheel: finished with status 'done' 2026-01-06T13:30:02,715 Created temporary directory: /tmp/pip-modern-metadata-xy5n2bpq 2026-01-06T13:30:02,717 Preparing metadata (pyproject.toml): started 2026-01-06T13:30:02,718 Running command Preparing metadata (pyproject.toml) 2026-01-06T13:30:03,446 /tmp/pip-build-env-xp07urtj/overlay/local/lib/python3.11/dist-packages/setuptools/config/_apply_pyprojecttoml.py:82: SetuptoolsDeprecationWarning: `project.license` as a TOML table is deprecated 2026-01-06T13:30:03,446 !! 2026-01-06T13:30:03,447 ******************************************************************************** 2026-01-06T13:30:03,448 Please use a simple string containing a SPDX expression for `project.license`. You can also use `project.license-files`. (Both options available on setuptools>=77.0.0). 2026-01-06T13:30:03,449 By 2026-Feb-18, you need to update your project and remove deprecated calls 2026-01-06T13:30:03,449 or your builds will no longer be supported. 2026-01-06T13:30:03,451 See https://packaging.python.org/en/latest/guides/writing-pyproject-toml/#license for details. 2026-01-06T13:30:03,451 ******************************************************************************** 2026-01-06T13:30:03,452 !! 2026-01-06T13:30:03,453 corresp(dist, value, root_dir) 2026-01-06T13:30:03,572 running dist_info 2026-01-06T13:30:03,584 creating /tmp/pip-modern-metadata-xy5n2bpq/unitxt.egg-info 2026-01-06T13:30:03,585 writing /tmp/pip-modern-metadata-xy5n2bpq/unitxt.egg-info/PKG-INFO 2026-01-06T13:30:03,620 writing dependency_links to /tmp/pip-modern-metadata-xy5n2bpq/unitxt.egg-info/dependency_links.txt 2026-01-06T13:30:03,622 writing entry points to /tmp/pip-modern-metadata-xy5n2bpq/unitxt.egg-info/entry_points.txt 2026-01-06T13:30:03,641 writing requirements to /tmp/pip-modern-metadata-xy5n2bpq/unitxt.egg-info/requires.txt 2026-01-06T13:30:03,642 writing top-level names to /tmp/pip-modern-metadata-xy5n2bpq/unitxt.egg-info/top_level.txt 2026-01-06T13:30:03,644 writing manifest file '/tmp/pip-modern-metadata-xy5n2bpq/unitxt.egg-info/SOURCES.txt' 2026-01-06T13:30:04,763 reading manifest file '/tmp/pip-modern-metadata-xy5n2bpq/unitxt.egg-info/SOURCES.txt' 2026-01-06T13:30:04,765 adding license file 'LICENSE' 2026-01-06T13:30:04,938 writing manifest file '/tmp/pip-modern-metadata-xy5n2bpq/unitxt.egg-info/SOURCES.txt' 2026-01-06T13:30:04,946 creating '/tmp/pip-modern-metadata-xy5n2bpq/unitxt-1.26.8.dist-info' 2026-01-06T13:30:05,081 Preparing metadata (pyproject.toml): finished with status 'done' 2026-01-06T13:30:05,090 Source in /tmp/pip-wheel-w9aiuin0/unitxt_04b40a2a37b74aabba47cfceab934250 has version 1.26.8, which satisfies requirement unitxt==1.26.8 from https://files.pythonhosted.org/packages/45/a0/2498b08680bf78163321840c236322cf49422fac1f7afd0eebc7b4aa643d/unitxt-1.26.8.tar.gz 2026-01-06T13:30:05,091 Removed unitxt==1.26.8 from https://files.pythonhosted.org/packages/45/a0/2498b08680bf78163321840c236322cf49422fac1f7afd0eebc7b4aa643d/unitxt-1.26.8.tar.gz from build tracker '/tmp/pip-build-tracker-_kpo56qn' 2026-01-06T13:30:05,103 Created temporary directory: /tmp/pip-unpack-9iv5g0t0 2026-01-06T13:30:05,104 Building wheels for collected packages: unitxt 2026-01-06T13:30:05,108 Created temporary directory: /tmp/pip-wheel-nmo1cw7a 2026-01-06T13:30:05,109 Destination directory: /tmp/pip-wheel-nmo1cw7a 2026-01-06T13:30:05,112 Building wheel for unitxt (pyproject.toml): started 2026-01-06T13:30:05,113 Running command Building wheel for unitxt (pyproject.toml) 2026-01-06T13:30:05,813 /tmp/pip-build-env-xp07urtj/overlay/local/lib/python3.11/dist-packages/setuptools/config/_apply_pyprojecttoml.py:82: SetuptoolsDeprecationWarning: `project.license` as a TOML table is deprecated 2026-01-06T13:30:05,813 !! 2026-01-06T13:30:05,814 ******************************************************************************** 2026-01-06T13:30:05,815 Please use a simple string containing a SPDX expression for `project.license`. You can also use `project.license-files`. (Both options available on setuptools>=77.0.0). 2026-01-06T13:30:05,815 By 2026-Feb-18, you need to update your project and remove deprecated calls 2026-01-06T13:30:05,816 or your builds will no longer be supported. 2026-01-06T13:30:05,817 See https://packaging.python.org/en/latest/guides/writing-pyproject-toml/#license for details. 2026-01-06T13:30:05,817 ******************************************************************************** 2026-01-06T13:30:05,818 !! 2026-01-06T13:30:05,819 corresp(dist, value, root_dir) 2026-01-06T13:30:05,908 running bdist_wheel 2026-01-06T13:30:05,929 running build 2026-01-06T13:30:05,929 running build_py 2026-01-06T13:30:05,938 creating build/lib/unitxt 2026-01-06T13:30:05,940 copying src/unitxt/llm_as_judge_utils.py -> build/lib/unitxt 2026-01-06T13:30:05,942 copying src/unitxt/version.py -> build/lib/unitxt 2026-01-06T13:30:05,944 copying src/unitxt/metric_utils.py -> build/lib/unitxt 2026-01-06T13:30:05,947 copying src/unitxt/deprecation_utils.py -> build/lib/unitxt 2026-01-06T13:30:05,950 copying src/unitxt/struct_data_operators.py -> build/lib/unitxt 2026-01-06T13:30:05,953 copying src/unitxt/eval_utils.py -> build/lib/unitxt 2026-01-06T13:30:05,955 copying src/unitxt/text2sql_utils.py -> build/lib/unitxt 2026-01-06T13:30:05,958 copying src/unitxt/stream.py -> build/lib/unitxt 2026-01-06T13:30:05,961 copying src/unitxt/benchmark.py -> build/lib/unitxt 2026-01-06T13:30:05,963 copying src/unitxt/templates.py -> build/lib/unitxt 2026-01-06T13:30:05,966 copying src/unitxt/evaluate_cli.py -> build/lib/unitxt 2026-01-06T13:30:05,969 copying src/unitxt/llm_as_judge_operators.py -> build/lib/unitxt 2026-01-06T13:30:05,971 copying src/unitxt/dataset_utils.py -> build/lib/unitxt 2026-01-06T13:30:05,973 copying src/unitxt/augmentors.py -> build/lib/unitxt 2026-01-06T13:30:05,975 copying src/unitxt/__init__.py -> build/lib/unitxt 2026-01-06T13:30:05,978 copying src/unitxt/llm_as_judge_from_template.py -> build/lib/unitxt 2026-01-06T13:30:05,981 copying src/unitxt/recipe.py -> build/lib/unitxt 2026-01-06T13:30:05,983 copying src/unitxt/utils.py -> build/lib/unitxt 2026-01-06T13:30:05,986 copying src/unitxt/file_utils.py -> build/lib/unitxt 2026-01-06T13:30:05,988 copying src/unitxt/string_operators.py -> build/lib/unitxt 2026-01-06T13:30:05,990 copying src/unitxt/standard.py -> build/lib/unitxt 2026-01-06T13:30:05,993 copying src/unitxt/stream_operators.py -> build/lib/unitxt 2026-01-06T13:30:05,995 copying src/unitxt/dataset.py -> build/lib/unitxt 2026-01-06T13:30:05,997 copying src/unitxt/types.py -> build/lib/unitxt 2026-01-06T13:30:06,000 copying src/unitxt/formats.py -> build/lib/unitxt 2026-01-06T13:30:06,002 copying src/unitxt/operators.py -> build/lib/unitxt 2026-01-06T13:30:06,007 copying src/unitxt/type_utils.py -> build/lib/unitxt 2026-01-06T13:30:06,010 copying src/unitxt/task.py -> build/lib/unitxt 2026-01-06T13:30:06,012 copying src/unitxt/validate.py -> build/lib/unitxt 2026-01-06T13:30:06,014 copying src/unitxt/dataclass.py -> build/lib/unitxt 2026-01-06T13:30:06,017 copying src/unitxt/schema.py -> build/lib/unitxt 2026-01-06T13:30:06,019 copying src/unitxt/metric.py -> build/lib/unitxt 2026-01-06T13:30:06,021 copying src/unitxt/blocks.py -> build/lib/unitxt 2026-01-06T13:30:06,023 copying src/unitxt/collections_operators.py -> build/lib/unitxt 2026-01-06T13:30:06,026 copying src/unitxt/metrics.py -> build/lib/unitxt 2026-01-06T13:30:06,032 copying src/unitxt/system_prompts.py -> build/lib/unitxt 2026-01-06T13:30:06,034 copying src/unitxt/operator.py -> build/lib/unitxt 2026-01-06T13:30:06,037 copying src/unitxt/split_utils.py -> build/lib/unitxt 2026-01-06T13:30:06,040 copying src/unitxt/parsing_utils.py -> build/lib/unitxt 2026-01-06T13:30:06,042 copying src/unitxt/register.py -> build/lib/unitxt 2026-01-06T13:30:06,044 copying src/unitxt/llm_as_judge_chat_templates.py -> build/lib/unitxt 2026-01-06T13:30:06,046 copying src/unitxt/settings_utils.py -> build/lib/unitxt 2026-01-06T13:30:06,048 copying src/unitxt/llm_as_judge.py -> build/lib/unitxt 2026-01-06T13:30:06,052 copying src/unitxt/logging_utils.py -> build/lib/unitxt 2026-01-06T13:30:06,054 copying src/unitxt/collections.py -> build/lib/unitxt 2026-01-06T13:30:06,056 copying src/unitxt/fusion.py -> build/lib/unitxt 2026-01-06T13:30:06,058 copying src/unitxt/inference.py -> build/lib/unitxt 2026-01-06T13:30:06,063 copying src/unitxt/normalizers.py -> build/lib/unitxt 2026-01-06T13:30:06,065 copying src/unitxt/base_metric.py -> build/lib/unitxt 2026-01-06T13:30:06,067 copying src/unitxt/splitters.py -> build/lib/unitxt 2026-01-06T13:30:06,070 copying src/unitxt/span_lableing_operators.py -> build/lib/unitxt 2026-01-06T13:30:06,072 copying src/unitxt/llm_as_judge_constants.py -> build/lib/unitxt 2026-01-06T13:30:06,075 copying src/unitxt/random_utils.py -> build/lib/unitxt 2026-01-06T13:30:06,077 copying src/unitxt/dict_utils.py -> build/lib/unitxt 2026-01-06T13:30:06,080 copying src/unitxt/hf_utils.py -> build/lib/unitxt 2026-01-06T13:30:06,082 copying src/unitxt/card.py -> build/lib/unitxt 2026-01-06T13:30:06,084 copying src/unitxt/text_utils.py -> build/lib/unitxt 2026-01-06T13:30:06,087 copying src/unitxt/image_operators.py -> build/lib/unitxt 2026-01-06T13:30:06,090 copying src/unitxt/loaders.py -> build/lib/unitxt 2026-01-06T13:30:06,093 copying src/unitxt/error_utils.py -> build/lib/unitxt 2026-01-06T13:30:06,095 copying src/unitxt/artifact.py -> build/lib/unitxt 2026-01-06T13:30:06,098 copying src/unitxt/generator_utils.py -> build/lib/unitxt 2026-01-06T13:30:06,100 copying src/unitxt/dialog_operators.py -> build/lib/unitxt 2026-01-06T13:30:06,102 copying src/unitxt/instructions.py -> build/lib/unitxt 2026-01-06T13:30:06,104 copying src/unitxt/processors.py -> build/lib/unitxt 2026-01-06T13:30:06,107 copying src/unitxt/catalog.py -> build/lib/unitxt 2026-01-06T13:30:06,109 copying src/unitxt/serializers.py -> build/lib/unitxt 2026-01-06T13:30:06,112 copying src/unitxt/api.py -> build/lib/unitxt 2026-01-06T13:30:06,115 creating build/lib/unitxt/ui 2026-01-06T13:30:06,116 copying src/unitxt/ui/ui_utils.py -> build/lib/unitxt/ui 2026-01-06T13:30:06,118 copying src/unitxt/ui/__init__.py -> build/lib/unitxt/ui 2026-01-06T13:30:06,120 copying src/unitxt/ui/run.py -> build/lib/unitxt/ui 2026-01-06T13:30:06,123 copying src/unitxt/ui/gradio_utils.py -> build/lib/unitxt/ui 2026-01-06T13:30:06,125 copying src/unitxt/ui/ui_tester.py -> build/lib/unitxt/ui 2026-01-06T13:30:06,127 copying src/unitxt/ui/settings.py -> build/lib/unitxt/ui 2026-01-06T13:30:06,129 copying src/unitxt/ui/load_catalog_data.py -> build/lib/unitxt/ui 2026-01-06T13:30:06,132 creating build/lib/unitxt/test_utils 2026-01-06T13:30:06,133 copying src/unitxt/test_utils/__init__.py -> build/lib/unitxt/test_utils 2026-01-06T13:30:06,135 copying src/unitxt/test_utils/operators.py -> build/lib/unitxt/test_utils 2026-01-06T13:30:06,137 copying src/unitxt/test_utils/metrics.py -> build/lib/unitxt/test_utils 2026-01-06T13:30:06,139 copying src/unitxt/test_utils/storage.py -> build/lib/unitxt/test_utils 2026-01-06T13:30:06,141 copying src/unitxt/test_utils/card.py -> build/lib/unitxt/test_utils 2026-01-06T13:30:06,143 copying src/unitxt/test_utils/artifact.py -> build/lib/unitxt/test_utils 2026-01-06T13:30:06,145 copying src/unitxt/test_utils/catalog.py -> build/lib/unitxt/test_utils 2026-01-06T13:30:06,148 creating build/lib/unitxt/assistant 2026-01-06T13:30:06,149 copying src/unitxt/assistant/__init__.py -> build/lib/unitxt/assistant 2026-01-06T13:30:06,151 copying src/unitxt/assistant/index.py -> build/lib/unitxt/assistant 2026-01-06T13:30:06,153 copying src/unitxt/assistant/app.py -> build/lib/unitxt/assistant 2026-01-06T13:30:06,156 creating build/lib/unitxt/service 2026-01-06T13:30:06,157 copying src/unitxt/service/__init__.py -> build/lib/unitxt/service 2026-01-06T13:30:06,160 creating build/lib/unitxt/assistant/assessment 2026-01-06T13:30:06,161 copying src/unitxt/assistant/assessment/my_pretty_table.py -> build/lib/unitxt/assistant/assessment 2026-01-06T13:30:06,162 copying src/unitxt/assistant/assessment/__init__.py -> build/lib/unitxt/assistant/assessment 2026-01-06T13:30:06,164 copying src/unitxt/assistant/assessment/assistant_inference_engine.py -> build/lib/unitxt/assistant/assessment 2026-01-06T13:30:06,166 creating build/lib/unitxt/service/metrics 2026-01-06T13:30:06,167 copying src/unitxt/service/metrics/__init__.py -> build/lib/unitxt/service/metrics 2026-01-06T13:30:06,169 copying src/unitxt/service/metrics/main.py -> build/lib/unitxt/service/metrics 2026-01-06T13:30:06,171 copying src/unitxt/service/metrics/tokens.py -> build/lib/unitxt/service/metrics 2026-01-06T13:30:06,425 running egg_info 2026-01-06T13:30:06,436 writing src/unitxt.egg-info/PKG-INFO 2026-01-06T13:30:06,470 writing dependency_links to src/unitxt.egg-info/dependency_links.txt 2026-01-06T13:30:06,471 writing entry points to src/unitxt.egg-info/entry_points.txt 2026-01-06T13:30:06,489 writing requirements to src/unitxt.egg-info/requires.txt 2026-01-06T13:30:06,490 writing top-level names to src/unitxt.egg-info/top_level.txt 2026-01-06T13:30:08,180 reading manifest file 'src/unitxt.egg-info/SOURCES.txt' 2026-01-06T13:30:08,441 adding license file 'LICENSE' 2026-01-06T13:30:08,693 writing manifest file 'src/unitxt.egg-info/SOURCES.txt' 2026-01-06T13:30:09,781 creating build/lib/unitxt/catalog/augmentors 2026-01-06T13:30:09,782 copying src/unitxt/catalog/augmentors/augment_whitespace_task_input.json -> build/lib/unitxt/catalog/augmentors 2026-01-06T13:30:09,785 copying src/unitxt/catalog/augmentors/augment_whitespace_prefix_and_suffix_task_input.json -> build/lib/unitxt/catalog/augmentors 2026-01-06T13:30:09,787 copying src/unitxt/catalog/augmentors/no_augmentation.json -> build/lib/unitxt/catalog/augmentors 2026-01-06T13:30:09,789 creating build/lib/unitxt/catalog/augmentors/text 2026-01-06T13:30:09,790 copying src/unitxt/catalog/augmentors/text/whitespace_prefix_suffix.json -> build/lib/unitxt/catalog/augmentors/text 2026-01-06T13:30:09,793 copying src/unitxt/catalog/augmentors/text/white_space.json -> build/lib/unitxt/catalog/augmentors/text 2026-01-06T13:30:09,795 creating build/lib/unitxt/catalog/augmentors/image 2026-01-06T13:30:09,796 copying src/unitxt/catalog/augmentors/image/grid_lines.json -> build/lib/unitxt/catalog/augmentors/image 2026-01-06T13:30:09,798 copying src/unitxt/catalog/augmentors/image/white_noise.json -> build/lib/unitxt/catalog/augmentors/image 2026-01-06T13:30:09,800 copying src/unitxt/catalog/augmentors/image/grey_scale.json -> build/lib/unitxt/catalog/augmentors/image 2026-01-06T13:30:09,802 copying src/unitxt/catalog/augmentors/image/oldify.json -> build/lib/unitxt/catalog/augmentors/image 2026-01-06T13:30:09,804 creating build/lib/unitxt/catalog/augmentors/table 2026-01-06T13:30:09,805 copying src/unitxt/catalog/augmentors/table/transpose.json -> build/lib/unitxt/catalog/augmentors/table 2026-01-06T13:30:09,808 copying src/unitxt/catalog/augmentors/table/duplicate_rows.json -> build/lib/unitxt/catalog/augmentors/table 2026-01-06T13:30:09,810 copying src/unitxt/catalog/augmentors/table/shuffle_rows.json -> build/lib/unitxt/catalog/augmentors/table 2026-01-06T13:30:09,812 copying src/unitxt/catalog/augmentors/table/mask_cols_names.json -> build/lib/unitxt/catalog/augmentors/table 2026-01-06T13:30:09,814 copying src/unitxt/catalog/augmentors/table/truncate_rows.json -> build/lib/unitxt/catalog/augmentors/table 2026-01-06T13:30:09,816 copying src/unitxt/catalog/augmentors/table/shuffle_cols.json -> build/lib/unitxt/catalog/augmentors/table 2026-01-06T13:30:09,819 copying src/unitxt/catalog/augmentors/table/shuffle_cols_names.json -> build/lib/unitxt/catalog/augmentors/table 2026-01-06T13:30:09,821 copying src/unitxt/catalog/augmentors/table/insert_empty_rows.json -> build/lib/unitxt/catalog/augmentors/table 2026-01-06T13:30:09,823 copying src/unitxt/catalog/augmentors/table/duplicate_columns.json -> build/lib/unitxt/catalog/augmentors/table 2026-01-06T13:30:09,826 creating build/lib/unitxt/catalog/engines/openai 2026-01-06T13:30:09,827 copying src/unitxt/catalog/engines/openai/gpt_4o.json -> build/lib/unitxt/catalog/engines/openai 2026-01-06T13:30:09,829 creating build/lib/unitxt/catalog/engines/cross_provider 2026-01-06T13:30:09,831 copying src/unitxt/catalog/engines/cross_provider/llama_3_8b_instruct.json -> build/lib/unitxt/catalog/engines/cross_provider 2026-01-06T13:30:09,833 copying src/unitxt/catalog/engines/cross_provider/llama_3_70b_instruct.json -> build/lib/unitxt/catalog/engines/cross_provider 2026-01-06T13:30:09,836 creating build/lib/unitxt/catalog/engines/rits 2026-01-06T13:30:09,837 copying src/unitxt/catalog/engines/rits/llama_3_1_405b_instruct_fp8.json -> build/lib/unitxt/catalog/engines/rits 2026-01-06T13:30:09,839 copying src/unitxt/catalog/engines/rits/llama_3_1_70b_instruct.json -> build/lib/unitxt/catalog/engines/rits 2026-01-06T13:30:09,842 creating build/lib/unitxt/catalog/engines/rits/llama_3 2026-01-06T13:30:09,843 copying src/unitxt/catalog/engines/rits/llama_3/1_8b_instruct.json -> build/lib/unitxt/catalog/engines/rits/llama_3 2026-01-06T13:30:09,845 creating build/lib/unitxt/catalog/engines/ibm_wml 2026-01-06T13:30:09,846 copying src/unitxt/catalog/engines/ibm_wml/llama_3_3_70b_instruct.json -> build/lib/unitxt/catalog/engines/ibm_wml 2026-01-06T13:30:09,849 creating build/lib/unitxt/catalog/engines/classification 2026-01-06T13:30:09,850 copying src/unitxt/catalog/engines/classification/llama_3_405b_instruct_wml.json -> build/lib/unitxt/catalog/engines/classification 2026-01-06T13:30:09,852 copying src/unitxt/catalog/engines/classification/llama_3_3_70b_instruct_watsonx.json -> build/lib/unitxt/catalog/engines/classification 2026-01-06T13:30:09,854 copying src/unitxt/catalog/engines/classification/llama_3_3_70b_instruct_wml.json -> build/lib/unitxt/catalog/engines/classification 2026-01-06T13:30:09,857 copying src/unitxt/catalog/engines/classification/gpt_4_turbo_2024_04_09_azure_openai.json -> build/lib/unitxt/catalog/engines/classification 2026-01-06T13:30:09,859 copying src/unitxt/catalog/engines/classification/llama_4_maverick_17b_128e_instruct_fp8_watsonx.json -> build/lib/unitxt/catalog/engines/classification 2026-01-06T13:30:09,862 copying src/unitxt/catalog/engines/classification/llama_3_1_70b_instruct_watsonx.json -> build/lib/unitxt/catalog/engines/classification 2026-01-06T13:30:09,864 copying src/unitxt/catalog/engines/classification/gpt_oss_120b_watsonx.json -> build/lib/unitxt/catalog/engines/classification 2026-01-06T13:30:09,866 copying src/unitxt/catalog/engines/classification/mistral_large_watsonx.json -> build/lib/unitxt/catalog/engines/classification 2026-01-06T13:30:09,869 copying src/unitxt/catalog/engines/classification/gpt_oss_120b_rits.json -> build/lib/unitxt/catalog/engines/classification 2026-01-06T13:30:09,871 copying src/unitxt/catalog/engines/classification/mistral_large_instruct_2407_rits.json -> build/lib/unitxt/catalog/engines/classification 2026-01-06T13:30:09,873 copying src/unitxt/catalog/engines/classification/gpt_4o_open_ai.json -> build/lib/unitxt/catalog/engines/classification 2026-01-06T13:30:09,876 copying src/unitxt/catalog/engines/classification/llama_3_1_405b_instruct_fp8_rits.json -> build/lib/unitxt/catalog/engines/classification 2026-01-06T13:30:09,878 copying src/unitxt/catalog/engines/classification/gpt_4o_2024_08_06_azure_openai.json -> build/lib/unitxt/catalog/engines/classification 2026-01-06T13:30:09,880 copying src/unitxt/catalog/engines/classification/llama_3_3_70b_instruct_rits.json -> build/lib/unitxt/catalog/engines/classification 2026-01-06T13:30:09,883 copying src/unitxt/catalog/engines/classification/mixtral_8x7b_instruct_v01_wml.json -> build/lib/unitxt/catalog/engines/classification 2026-01-06T13:30:09,885 copying src/unitxt/catalog/engines/classification/mistral_small_3_1_24b_instruct_2503_wml.json -> build/lib/unitxt/catalog/engines/classification 2026-01-06T13:30:09,887 copying src/unitxt/catalog/engines/classification/llama3_3_ollama.json -> build/lib/unitxt/catalog/engines/classification 2026-01-06T13:30:09,889 copying src/unitxt/catalog/engines/classification/llama_3_1_70b_instruct_wml.json -> build/lib/unitxt/catalog/engines/classification 2026-01-06T13:30:09,891 copying src/unitxt/catalog/engines/classification/llama3_8b_ollama.json -> build/lib/unitxt/catalog/engines/classification 2026-01-06T13:30:09,894 copying src/unitxt/catalog/engines/classification/llama_3_1_70b_instruct_rits.json -> build/lib/unitxt/catalog/engines/classification 2026-01-06T13:30:09,896 copying src/unitxt/catalog/engines/classification/llama_4_maverick_17b_128e_instruct_fp8_rits.json -> build/lib/unitxt/catalog/engines/classification 2026-01-06T13:30:09,898 copying src/unitxt/catalog/engines/classification/gpt_4_turbo_open_ai.json -> build/lib/unitxt/catalog/engines/classification 2026-01-06T13:30:09,900 creating build/lib/unitxt/catalog/engines/ollama 2026-01-06T13:30:09,901 copying src/unitxt/catalog/engines/ollama/llama2.json -> build/lib/unitxt/catalog/engines/ollama 2026-01-06T13:30:09,903 creating build/lib/unitxt/catalog/engines/model 2026-01-06T13:30:09,904 copying src/unitxt/catalog/engines/model/llama_3_8b_instruct.json -> build/lib/unitxt/catalog/engines/model 2026-01-06T13:30:09,906 creating build/lib/unitxt/catalog/engines/model/flan/t5_small 2026-01-06T13:30:09,908 copying src/unitxt/catalog/engines/model/flan/t5_small/hf.json -> build/lib/unitxt/catalog/engines/model/flan/t5_small 2026-01-06T13:30:09,910 creating build/lib/unitxt/catalog/system_prompts 2026-01-06T13:30:09,911 copying src/unitxt/catalog/system_prompts/empty.json -> build/lib/unitxt/catalog/system_prompts 2026-01-06T13:30:09,913 copying src/unitxt/catalog/system_prompts/boolqa.json -> build/lib/unitxt/catalog/system_prompts 2026-01-06T13:30:09,915 creating build/lib/unitxt/catalog/system_prompts/models 2026-01-06T13:30:09,916 copying src/unitxt/catalog/system_prompts/models/japanese_llama.json -> build/lib/unitxt/catalog/system_prompts/models 2026-01-06T13:30:09,919 copying src/unitxt/catalog/system_prompts/models/alpaca.json -> build/lib/unitxt/catalog/system_prompts/models 2026-01-06T13:30:09,921 copying src/unitxt/catalog/system_prompts/models/llama2.json -> build/lib/unitxt/catalog/system_prompts/models 2026-01-06T13:30:09,923 copying src/unitxt/catalog/system_prompts/models/deepseek_coder.json -> build/lib/unitxt/catalog/system_prompts/models 2026-01-06T13:30:09,925 copying src/unitxt/catalog/system_prompts/models/llava_next_llama3_8b.json -> build/lib/unitxt/catalog/system_prompts/models 2026-01-06T13:30:09,927 copying src/unitxt/catalog/system_prompts/models/labradorite.json -> build/lib/unitxt/catalog/system_prompts/models 2026-01-06T13:30:09,929 copying src/unitxt/catalog/system_prompts/models/llama.json -> build/lib/unitxt/catalog/system_prompts/models 2026-01-06T13:30:09,931 creating build/lib/unitxt/catalog/system_prompts/general 2026-01-06T13:30:09,932 copying src/unitxt/catalog/system_prompts/general/be_concise.json -> build/lib/unitxt/catalog/system_prompts/general 2026-01-06T13:30:09,935 creating build/lib/unitxt/catalog/system_prompts/model 2026-01-06T13:30:09,936 copying src/unitxt/catalog/system_prompts/model/granite.json -> build/lib/unitxt/catalog/system_prompts/model 2026-01-06T13:30:09,938 creating build/lib/unitxt/catalog/templates 2026-01-06T13:30:09,939 copying src/unitxt/catalog/templates/empty.json -> build/lib/unitxt/catalog/templates 2026-01-06T13:30:09,941 copying src/unitxt/catalog/templates/key_val_with_new_lines.json -> build/lib/unitxt/catalog/templates 2026-01-06T13:30:09,944 copying src/unitxt/catalog/templates/key_val.json -> build/lib/unitxt/catalog/templates 2026-01-06T13:30:09,946 creating build/lib/unitxt/catalog/templates/response_assessment/pairwise_comparison 2026-01-06T13:30:09,947 copying src/unitxt/catalog/templates/response_assessment/pairwise_comparison/mt_bench_multi_turn.json -> build/lib/unitxt/catalog/templates/response_assessment/pairwise_comparison 2026-01-06T13:30:09,950 copying src/unitxt/catalog/templates/response_assessment/pairwise_comparison/mt_bench_single_turn_with_reference_with_shuffling.json -> build/lib/unitxt/catalog/templates/response_assessment/pairwise_comparison 2026-01-06T13:30:09,952 copying src/unitxt/catalog/templates/response_assessment/pairwise_comparison/mt_bench_multi_turn_with_reference.json -> build/lib/unitxt/catalog/templates/response_assessment/pairwise_comparison 2026-01-06T13:30:09,954 copying src/unitxt/catalog/templates/response_assessment/pairwise_comparison/mt_bench_single_turn_with_shuffling.json -> build/lib/unitxt/catalog/templates/response_assessment/pairwise_comparison 2026-01-06T13:30:09,956 copying src/unitxt/catalog/templates/response_assessment/pairwise_comparison/mt_bench_single_turn_with_reference.json -> build/lib/unitxt/catalog/templates/response_assessment/pairwise_comparison 2026-01-06T13:30:09,958 copying src/unitxt/catalog/templates/response_assessment/pairwise_comparison/mt_bench_multi_turn_with_reference_with_shuffling.json -> build/lib/unitxt/catalog/templates/response_assessment/pairwise_comparison 2026-01-06T13:30:09,961 copying src/unitxt/catalog/templates/response_assessment/pairwise_comparison/mt_bench_multi_turn_with_shuffling.json -> build/lib/unitxt/catalog/templates/response_assessment/pairwise_comparison 2026-01-06T13:30:09,963 copying src/unitxt/catalog/templates/response_assessment/pairwise_comparison/mt_bench_single_turn.json -> build/lib/unitxt/catalog/templates/response_assessment/pairwise_comparison 2026-01-06T13:30:09,965 creating build/lib/unitxt/catalog/templates/response_assessment/rating 2026-01-06T13:30:09,966 copying src/unitxt/catalog/templates/response_assessment/rating/mt_bench_multi_turn.json -> build/lib/unitxt/catalog/templates/response_assessment/rating 2026-01-06T13:30:09,968 copying src/unitxt/catalog/templates/response_assessment/rating/mt_bench_multi_turn_with_reference.json -> build/lib/unitxt/catalog/templates/response_assessment/rating 2026-01-06T13:30:09,971 copying src/unitxt/catalog/templates/response_assessment/rating/mt_bench_single_turn_with_reference.json -> build/lib/unitxt/catalog/templates/response_assessment/rating 2026-01-06T13:30:09,973 copying src/unitxt/catalog/templates/response_assessment/rating/generic_single_turn_with_reference.json -> build/lib/unitxt/catalog/templates/response_assessment/rating 2026-01-06T13:30:09,975 copying src/unitxt/catalog/templates/response_assessment/rating/mt_bench_single_turn.json -> build/lib/unitxt/catalog/templates/response_assessment/rating 2026-01-06T13:30:09,977 copying src/unitxt/catalog/templates/response_assessment/rating/generic_single_turn.json -> build/lib/unitxt/catalog/templates/response_assessment/rating 2026-01-06T13:30:09,980 copying src/unitxt/catalog/templates/response_assessment/rating/table2text_single_turn_with_reference.json -> build/lib/unitxt/catalog/templates/response_assessment/rating 2026-01-06T13:30:09,982 creating build/lib/unitxt/catalog/templates/response_assessment/pairwise_comparative_rating 2026-01-06T13:30:09,983 copying src/unitxt/catalog/templates/response_assessment/pairwise_comparative_rating/arena_hard.json -> build/lib/unitxt/catalog/templates/response_assessment/pairwise_comparative_rating 2026-01-06T13:30:09,985 copying src/unitxt/catalog/templates/response_assessment/pairwise_comparative_rating/prometheus_arena_hard_with_shuffling.json -> build/lib/unitxt/catalog/templates/response_assessment/pairwise_comparative_rating 2026-01-06T13:30:09,987 copying src/unitxt/catalog/templates/response_assessment/pairwise_comparative_rating/prometheus_arena_hard.json -> build/lib/unitxt/catalog/templates/response_assessment/pairwise_comparative_rating 2026-01-06T13:30:09,990 copying src/unitxt/catalog/templates/response_assessment/pairwise_comparative_rating/arena_hard_with_shuffling.json -> build/lib/unitxt/catalog/templates/response_assessment/pairwise_comparative_rating 2026-01-06T13:30:09,992 creating build/lib/unitxt/catalog/templates/selection/by_attribute 2026-01-06T13:30:09,993 copying src/unitxt/catalog/templates/selection/by_attribute/default.json -> build/lib/unitxt/catalog/templates/selection/by_attribute 2026-01-06T13:30:09,995 copying src/unitxt/catalog/templates/selection/by_attribute/all.json -> build/lib/unitxt/catalog/templates/selection/by_attribute 2026-01-06T13:30:09,997 creating build/lib/unitxt/catalog/templates/targeted_sentiment_extraction 2026-01-06T13:30:09,998 copying src/unitxt/catalog/templates/targeted_sentiment_extraction/having_sentiment.json -> build/lib/unitxt/catalog/templates/targeted_sentiment_extraction 2026-01-06T13:30:10,000 copying src/unitxt/catalog/templates/targeted_sentiment_extraction/empty.json -> build/lib/unitxt/catalog/templates/targeted_sentiment_extraction 2026-01-06T13:30:10,002 copying src/unitxt/catalog/templates/targeted_sentiment_extraction/carry_sentiment.json -> build/lib/unitxt/catalog/templates/targeted_sentiment_extraction 2026-01-06T13:30:10,004 copying src/unitxt/catalog/templates/targeted_sentiment_extraction/entities_sentiment.json -> build/lib/unitxt/catalog/templates/targeted_sentiment_extraction 2026-01-06T13:30:10,006 copying src/unitxt/catalog/templates/targeted_sentiment_extraction/all.json -> build/lib/unitxt/catalog/templates/targeted_sentiment_extraction 2026-01-06T13:30:10,009 copying src/unitxt/catalog/templates/targeted_sentiment_extraction/extract_sentiment.json -> build/lib/unitxt/catalog/templates/targeted_sentiment_extraction 2026-01-06T13:30:10,011 creating build/lib/unitxt/catalog/templates/targeted_sentiment_extraction/positive 2026-01-06T13:30:10,012 copying src/unitxt/catalog/templates/targeted_sentiment_extraction/positive/having_sentiment.json -> build/lib/unitxt/catalog/templates/targeted_sentiment_extraction/positive 2026-01-06T13:30:10,014 copying src/unitxt/catalog/templates/targeted_sentiment_extraction/positive/empty.json -> build/lib/unitxt/catalog/templates/targeted_sentiment_extraction/positive 2026-01-06T13:30:10,016 copying src/unitxt/catalog/templates/targeted_sentiment_extraction/positive/sentiment_extracted.json -> build/lib/unitxt/catalog/templates/targeted_sentiment_extraction/positive 2026-01-06T13:30:10,018 copying src/unitxt/catalog/templates/targeted_sentiment_extraction/positive/all.json -> build/lib/unitxt/catalog/templates/targeted_sentiment_extraction/positive 2026-01-06T13:30:10,020 creating build/lib/unitxt/catalog/templates/targeted_sentiment_extraction/neutral 2026-01-06T13:30:10,021 copying src/unitxt/catalog/templates/targeted_sentiment_extraction/neutral/having_sentiment.json -> build/lib/unitxt/catalog/templates/targeted_sentiment_extraction/neutral 2026-01-06T13:30:10,024 copying src/unitxt/catalog/templates/targeted_sentiment_extraction/neutral/empty.json -> build/lib/unitxt/catalog/templates/targeted_sentiment_extraction/neutral 2026-01-06T13:30:10,026 copying src/unitxt/catalog/templates/targeted_sentiment_extraction/neutral/sentiment_extracted.json -> build/lib/unitxt/catalog/templates/targeted_sentiment_extraction/neutral 2026-01-06T13:30:10,028 copying src/unitxt/catalog/templates/targeted_sentiment_extraction/neutral/all.json -> build/lib/unitxt/catalog/templates/targeted_sentiment_extraction/neutral 2026-01-06T13:30:10,030 creating build/lib/unitxt/catalog/templates/targeted_sentiment_extraction/as_json 2026-01-06T13:30:10,031 copying src/unitxt/catalog/templates/targeted_sentiment_extraction/as_json/empty.json -> build/lib/unitxt/catalog/templates/targeted_sentiment_extraction/as_json 2026-01-06T13:30:10,033 copying src/unitxt/catalog/templates/targeted_sentiment_extraction/as_json/convert_with_implicit_keys.json -> build/lib/unitxt/catalog/templates/targeted_sentiment_extraction/as_json 2026-01-06T13:30:10,035 copying src/unitxt/catalog/templates/targeted_sentiment_extraction/as_json/convert_with_explicit_keys.json -> build/lib/unitxt/catalog/templates/targeted_sentiment_extraction/as_json 2026-01-06T13:30:10,037 creating build/lib/unitxt/catalog/templates/targeted_sentiment_extraction/negative 2026-01-06T13:30:10,038 copying src/unitxt/catalog/templates/targeted_sentiment_extraction/negative/having_sentiment.json -> build/lib/unitxt/catalog/templates/targeted_sentiment_extraction/negative 2026-01-06T13:30:10,040 copying src/unitxt/catalog/templates/targeted_sentiment_extraction/negative/empty.json -> build/lib/unitxt/catalog/templates/targeted_sentiment_extraction/negative 2026-01-06T13:30:10,042 copying src/unitxt/catalog/templates/targeted_sentiment_extraction/negative/sentiment_extracted.json -> build/lib/unitxt/catalog/templates/targeted_sentiment_extraction/negative 2026-01-06T13:30:10,044 copying src/unitxt/catalog/templates/targeted_sentiment_extraction/negative/all.json -> build/lib/unitxt/catalog/templates/targeted_sentiment_extraction/negative 2026-01-06T13:30:10,046 creating build/lib/unitxt/catalog/templates/regression/two_texts 2026-01-06T13:30:10,048 copying src/unitxt/catalog/templates/regression/two_texts/simple.json -> build/lib/unitxt/catalog/templates/regression/two_texts 2026-01-06T13:30:10,050 copying src/unitxt/catalog/templates/regression/two_texts/title.json -> build/lib/unitxt/catalog/templates/regression/two_texts 2026-01-06T13:30:10,052 copying src/unitxt/catalog/templates/regression/two_texts/all.json -> build/lib/unitxt/catalog/templates/regression/two_texts 2026-01-06T13:30:10,054 creating build/lib/unitxt/catalog/templates/regression/two_texts/similarity 2026-01-06T13:30:10,055 copying src/unitxt/catalog/templates/regression/two_texts/similarity/flan.json -> build/lib/unitxt/catalog/templates/regression/two_texts/similarity 2026-01-06T13:30:10,057 creating build/lib/unitxt/catalog/templates/regression/single_text 2026-01-06T13:30:10,058 copying src/unitxt/catalog/templates/regression/single_text/simple.json -> build/lib/unitxt/catalog/templates/regression/single_text 2026-01-06T13:30:10,060 copying src/unitxt/catalog/templates/regression/single_text/title.json -> build/lib/unitxt/catalog/templates/regression/single_text 2026-01-06T13:30:10,062 copying src/unitxt/catalog/templates/regression/single_text/all.json -> build/lib/unitxt/catalog/templates/regression/single_text 2026-01-06T13:30:10,064 creating build/lib/unitxt/catalog/templates/grammatical_error_correction 2026-01-06T13:30:10,065 copying src/unitxt/catalog/templates/grammatical_error_correction/simple.json -> build/lib/unitxt/catalog/templates/grammatical_error_correction 2026-01-06T13:30:10,067 copying src/unitxt/catalog/templates/grammatical_error_correction/all.json -> build/lib/unitxt/catalog/templates/grammatical_error_correction 2026-01-06T13:30:10,069 creating build/lib/unitxt/catalog/templates/generation 2026-01-06T13:30:10,070 copying src/unitxt/catalog/templates/generation/empty.json -> build/lib/unitxt/catalog/templates/generation 2026-01-06T13:30:10,073 copying src/unitxt/catalog/templates/generation/default.json -> build/lib/unitxt/catalog/templates/generation 2026-01-06T13:30:10,075 copying src/unitxt/catalog/templates/generation/all.json -> build/lib/unitxt/catalog/templates/generation 2026-01-06T13:30:10,078 creating build/lib/unitxt/catalog/templates/generation/from_pair 2026-01-06T13:30:10,079 copying src/unitxt/catalog/templates/generation/from_pair/default.json -> build/lib/unitxt/catalog/templates/generation/from_pair 2026-01-06T13:30:10,082 copying src/unitxt/catalog/templates/generation/from_pair/all.json -> build/lib/unitxt/catalog/templates/generation/from_pair 2026-01-06T13:30:10,084 creating build/lib/unitxt/catalog/templates/tool_calling 2026-01-06T13:30:10,085 copying src/unitxt/catalog/templates/tool_calling/multi_turn.json -> build/lib/unitxt/catalog/templates/tool_calling 2026-01-06T13:30:10,087 copying src/unitxt/catalog/templates/tool_calling/base.json -> build/lib/unitxt/catalog/templates/tool_calling 2026-01-06T13:30:10,089 creating build/lib/unitxt/catalog/templates/translation/directed 2026-01-06T13:30:10,090 copying src/unitxt/catalog/templates/translation/directed/formal.json -> build/lib/unitxt/catalog/templates/translation/directed 2026-01-06T13:30:10,092 copying src/unitxt/catalog/templates/translation/directed/casual.json -> build/lib/unitxt/catalog/templates/translation/directed 2026-01-06T13:30:10,094 copying src/unitxt/catalog/templates/translation/directed/playful.json -> build/lib/unitxt/catalog/templates/translation/directed 2026-01-06T13:30:10,096 copying src/unitxt/catalog/templates/translation/directed/simple.json -> build/lib/unitxt/catalog/templates/translation/directed 2026-01-06T13:30:10,098 copying src/unitxt/catalog/templates/translation/directed/bluebench.json -> build/lib/unitxt/catalog/templates/translation/directed 2026-01-06T13:30:10,100 copying src/unitxt/catalog/templates/translation/directed/instructional.json -> build/lib/unitxt/catalog/templates/translation/directed 2026-01-06T13:30:10,102 copying src/unitxt/catalog/templates/translation/directed/title.json -> build/lib/unitxt/catalog/templates/translation/directed 2026-01-06T13:30:10,104 copying src/unitxt/catalog/templates/translation/directed/all.json -> build/lib/unitxt/catalog/templates/translation/directed 2026-01-06T13:30:10,106 creating build/lib/unitxt/catalog/templates/qa 2026-01-06T13:30:10,107 copying src/unitxt/catalog/templates/qa/extractive.json -> build/lib/unitxt/catalog/templates/qa 2026-01-06T13:30:10,109 copying src/unitxt/catalog/templates/qa/with_context.json -> build/lib/unitxt/catalog/templates/qa 2026-01-06T13:30:10,111 copying src/unitxt/catalog/templates/qa/open.json -> build/lib/unitxt/catalog/templates/qa 2026-01-06T13:30:10,113 creating build/lib/unitxt/catalog/templates/qa/multi_turn/with_context 2026-01-06T13:30:10,115 copying src/unitxt/catalog/templates/qa/multi_turn/with_context/simple.json -> build/lib/unitxt/catalog/templates/qa/multi_turn/with_context 2026-01-06T13:30:10,117 creating build/lib/unitxt/catalog/templates/qa/llama_vision/multiple_choice/with_context 2026-01-06T13:30:10,119 copying src/unitxt/catalog/templates/qa/llama_vision/multiple_choice/with_context/ai2d.json -> build/lib/unitxt/catalog/templates/qa/llama_vision/multiple_choice/with_context 2026-01-06T13:30:10,121 creating build/lib/unitxt/catalog/templates/qa/llama_vision/with_context 2026-01-06T13:30:10,122 copying src/unitxt/catalog/templates/qa/llama_vision/with_context/chart_qa.json -> build/lib/unitxt/catalog/templates/qa/llama_vision/with_context 2026-01-06T13:30:10,124 copying src/unitxt/catalog/templates/qa/llama_vision/with_context/doc_vqa.json -> build/lib/unitxt/catalog/templates/qa/llama_vision/with_context 2026-01-06T13:30:10,126 copying src/unitxt/catalog/templates/qa/llama_vision/with_context/info_vqa.json -> build/lib/unitxt/catalog/templates/qa/llama_vision/with_context 2026-01-06T13:30:10,128 creating build/lib/unitxt/catalog/templates/qa/multiple_choice 2026-01-06T13:30:10,129 copying src/unitxt/catalog/templates/qa/multiple_choice/lm_eval_harness.json -> build/lib/unitxt/catalog/templates/qa/multiple_choice 2026-01-06T13:30:10,132 copying src/unitxt/catalog/templates/qa/multiple_choice/match.json -> build/lib/unitxt/catalog/templates/qa/multiple_choice 2026-01-06T13:30:10,134 copying src/unitxt/catalog/templates/qa/multiple_choice/helm.json -> build/lib/unitxt/catalog/templates/qa/multiple_choice 2026-01-06T13:30:10,136 copying src/unitxt/catalog/templates/qa/multiple_choice/title.json -> build/lib/unitxt/catalog/templates/qa/multiple_choice 2026-01-06T13:30:10,138 creating build/lib/unitxt/catalog/templates/qa/multiple_choice/with_topic 2026-01-06T13:30:10,139 copying src/unitxt/catalog/templates/qa/multiple_choice/with_topic/lm_eval_harness.json -> build/lib/unitxt/catalog/templates/qa/multiple_choice/with_topic 2026-01-06T13:30:10,141 copying src/unitxt/catalog/templates/qa/multiple_choice/with_topic/mmlu.json -> build/lib/unitxt/catalog/templates/qa/multiple_choice/with_topic 2026-01-06T13:30:10,143 copying src/unitxt/catalog/templates/qa/multiple_choice/with_topic/match.json -> build/lib/unitxt/catalog/templates/qa/multiple_choice/with_topic 2026-01-06T13:30:10,145 copying src/unitxt/catalog/templates/qa/multiple_choice/with_topic/fm_eval.json -> build/lib/unitxt/catalog/templates/qa/multiple_choice/with_topic 2026-01-06T13:30:10,147 copying src/unitxt/catalog/templates/qa/multiple_choice/with_topic/helm.json -> build/lib/unitxt/catalog/templates/qa/multiple_choice/with_topic 2026-01-06T13:30:10,149 copying src/unitxt/catalog/templates/qa/multiple_choice/with_topic/bluebench.json -> build/lib/unitxt/catalog/templates/qa/multiple_choice/with_topic 2026-01-06T13:30:10,151 copying src/unitxt/catalog/templates/qa/multiple_choice/with_topic/title.json -> build/lib/unitxt/catalog/templates/qa/multiple_choice/with_topic 2026-01-06T13:30:10,153 copying src/unitxt/catalog/templates/qa/multiple_choice/with_topic/all.json -> build/lib/unitxt/catalog/templates/qa/multiple_choice/with_topic 2026-01-06T13:30:10,156 creating build/lib/unitxt/catalog/templates/qa/multiple_choice/with_topic/es 2026-01-06T13:30:10,156 copying src/unitxt/catalog/templates/qa/multiple_choice/with_topic/es/lm_eval_harness.json -> build/lib/unitxt/catalog/templates/qa/multiple_choice/with_topic/es 2026-01-06T13:30:10,159 copying src/unitxt/catalog/templates/qa/multiple_choice/with_topic/es/mmlu.json -> build/lib/unitxt/catalog/templates/qa/multiple_choice/with_topic/es 2026-01-06T13:30:10,161 copying src/unitxt/catalog/templates/qa/multiple_choice/with_topic/es/helm.json -> build/lib/unitxt/catalog/templates/qa/multiple_choice/with_topic/es 2026-01-06T13:30:10,163 copying src/unitxt/catalog/templates/qa/multiple_choice/with_topic/es/all.json -> build/lib/unitxt/catalog/templates/qa/multiple_choice/with_topic/es 2026-01-06T13:30:10,165 creating build/lib/unitxt/catalog/templates/qa/multiple_choice/with_topic/de 2026-01-06T13:30:10,166 copying src/unitxt/catalog/templates/qa/multiple_choice/with_topic/de/lm_eval_harness.json -> build/lib/unitxt/catalog/templates/qa/multiple_choice/with_topic/de 2026-01-06T13:30:10,168 copying src/unitxt/catalog/templates/qa/multiple_choice/with_topic/de/mmlu.json -> build/lib/unitxt/catalog/templates/qa/multiple_choice/with_topic/de 2026-01-06T13:30:10,171 copying src/unitxt/catalog/templates/qa/multiple_choice/with_topic/de/helm.json -> build/lib/unitxt/catalog/templates/qa/multiple_choice/with_topic/de 2026-01-06T13:30:10,173 copying src/unitxt/catalog/templates/qa/multiple_choice/with_topic/de/all.json -> build/lib/unitxt/catalog/templates/qa/multiple_choice/with_topic/de 2026-01-06T13:30:10,175 creating build/lib/unitxt/catalog/templates/qa/multiple_choice/with_topic/ja 2026-01-06T13:30:10,176 copying src/unitxt/catalog/templates/qa/multiple_choice/with_topic/ja/lm_eval_harness.json -> build/lib/unitxt/catalog/templates/qa/multiple_choice/with_topic/ja 2026-01-06T13:30:10,178 copying src/unitxt/catalog/templates/qa/multiple_choice/with_topic/ja/mmlu.json -> build/lib/unitxt/catalog/templates/qa/multiple_choice/with_topic/ja 2026-01-06T13:30:10,180 copying src/unitxt/catalog/templates/qa/multiple_choice/with_topic/ja/helm.json -> build/lib/unitxt/catalog/templates/qa/multiple_choice/with_topic/ja 2026-01-06T13:30:10,182 copying src/unitxt/catalog/templates/qa/multiple_choice/with_topic/ja/all.json -> build/lib/unitxt/catalog/templates/qa/multiple_choice/with_topic/ja 2026-01-06T13:30:10,184 creating build/lib/unitxt/catalog/templates/qa/multiple_choice/with_topic/pt 2026-01-06T13:30:10,185 copying src/unitxt/catalog/templates/qa/multiple_choice/with_topic/pt/lm_eval_harness.json -> build/lib/unitxt/catalog/templates/qa/multiple_choice/with_topic/pt 2026-01-06T13:30:10,187 copying src/unitxt/catalog/templates/qa/multiple_choice/with_topic/pt/mmlu.json -> build/lib/unitxt/catalog/templates/qa/multiple_choice/with_topic/pt 2026-01-06T13:30:10,190 copying src/unitxt/catalog/templates/qa/multiple_choice/with_topic/pt/helm.json -> build/lib/unitxt/catalog/templates/qa/multiple_choice/with_topic/pt 2026-01-06T13:30:10,192 copying src/unitxt/catalog/templates/qa/multiple_choice/with_topic/pt/all.json -> build/lib/unitxt/catalog/templates/qa/multiple_choice/with_topic/pt 2026-01-06T13:30:10,193 creating build/lib/unitxt/catalog/templates/qa/multiple_choice/with_topic/fr 2026-01-06T13:30:10,194 copying src/unitxt/catalog/templates/qa/multiple_choice/with_topic/fr/lm_eval_harness.json -> build/lib/unitxt/catalog/templates/qa/multiple_choice/with_topic/fr 2026-01-06T13:30:10,196 copying src/unitxt/catalog/templates/qa/multiple_choice/with_topic/fr/mmlu.json -> build/lib/unitxt/catalog/templates/qa/multiple_choice/with_topic/fr 2026-01-06T13:30:10,199 copying src/unitxt/catalog/templates/qa/multiple_choice/with_topic/fr/helm.json -> build/lib/unitxt/catalog/templates/qa/multiple_choice/with_topic/fr 2026-01-06T13:30:10,201 copying src/unitxt/catalog/templates/qa/multiple_choice/with_topic/fr/all.json -> build/lib/unitxt/catalog/templates/qa/multiple_choice/with_topic/fr 2026-01-06T13:30:10,203 creating build/lib/unitxt/catalog/templates/qa/multiple_choice/open 2026-01-06T13:30:10,204 copying src/unitxt/catalog/templates/qa/multiple_choice/open/lm_eval_harness.json -> build/lib/unitxt/catalog/templates/qa/multiple_choice/open 2026-01-06T13:30:10,206 copying src/unitxt/catalog/templates/qa/multiple_choice/open/mmlu.json -> build/lib/unitxt/catalog/templates/qa/multiple_choice/open 2026-01-06T13:30:10,208 copying src/unitxt/catalog/templates/qa/multiple_choice/open/helm.json -> build/lib/unitxt/catalog/templates/qa/multiple_choice/open 2026-01-06T13:30:10,210 copying src/unitxt/catalog/templates/qa/multiple_choice/open/bluebench.json -> build/lib/unitxt/catalog/templates/qa/multiple_choice/open 2026-01-06T13:30:10,212 copying src/unitxt/catalog/templates/qa/multiple_choice/open/all.json -> build/lib/unitxt/catalog/templates/qa/multiple_choice/open 2026-01-06T13:30:10,214 creating build/lib/unitxt/catalog/templates/qa/multiple_choice/open/es 2026-01-06T13:30:10,215 copying src/unitxt/catalog/templates/qa/multiple_choice/open/es/lm_eval_harness.json -> build/lib/unitxt/catalog/templates/qa/multiple_choice/open/es 2026-01-06T13:30:10,217 copying src/unitxt/catalog/templates/qa/multiple_choice/open/es/mmlu.json -> build/lib/unitxt/catalog/templates/qa/multiple_choice/open/es 2026-01-06T13:30:10,219 copying src/unitxt/catalog/templates/qa/multiple_choice/open/es/helm.json -> build/lib/unitxt/catalog/templates/qa/multiple_choice/open/es 2026-01-06T13:30:10,221 copying src/unitxt/catalog/templates/qa/multiple_choice/open/es/all.json -> build/lib/unitxt/catalog/templates/qa/multiple_choice/open/es 2026-01-06T13:30:10,223 creating build/lib/unitxt/catalog/templates/qa/multiple_choice/open/de 2026-01-06T13:30:10,224 copying src/unitxt/catalog/templates/qa/multiple_choice/open/de/lm_eval_harness.json -> build/lib/unitxt/catalog/templates/qa/multiple_choice/open/de 2026-01-06T13:30:10,227 copying src/unitxt/catalog/templates/qa/multiple_choice/open/de/mmlu.json -> build/lib/unitxt/catalog/templates/qa/multiple_choice/open/de 2026-01-06T13:30:10,229 copying src/unitxt/catalog/templates/qa/multiple_choice/open/de/helm.json -> build/lib/unitxt/catalog/templates/qa/multiple_choice/open/de 2026-01-06T13:30:10,231 copying src/unitxt/catalog/templates/qa/multiple_choice/open/de/all.json -> build/lib/unitxt/catalog/templates/qa/multiple_choice/open/de 2026-01-06T13:30:10,233 creating build/lib/unitxt/catalog/templates/qa/multiple_choice/open/ja 2026-01-06T13:30:10,234 copying src/unitxt/catalog/templates/qa/multiple_choice/open/ja/lm_eval_harness.json -> build/lib/unitxt/catalog/templates/qa/multiple_choice/open/ja 2026-01-06T13:30:10,236 copying src/unitxt/catalog/templates/qa/multiple_choice/open/ja/mmlu.json -> build/lib/unitxt/catalog/templates/qa/multiple_choice/open/ja 2026-01-06T13:30:10,238 copying src/unitxt/catalog/templates/qa/multiple_choice/open/ja/helm.json -> build/lib/unitxt/catalog/templates/qa/multiple_choice/open/ja 2026-01-06T13:30:10,240 copying src/unitxt/catalog/templates/qa/multiple_choice/open/ja/all.json -> build/lib/unitxt/catalog/templates/qa/multiple_choice/open/ja 2026-01-06T13:30:10,242 creating build/lib/unitxt/catalog/templates/qa/multiple_choice/open/pt 2026-01-06T13:30:10,243 copying src/unitxt/catalog/templates/qa/multiple_choice/open/pt/lm_eval_harness.json -> build/lib/unitxt/catalog/templates/qa/multiple_choice/open/pt 2026-01-06T13:30:10,245 copying src/unitxt/catalog/templates/qa/multiple_choice/open/pt/mmlu.json -> build/lib/unitxt/catalog/templates/qa/multiple_choice/open/pt 2026-01-06T13:30:10,248 copying src/unitxt/catalog/templates/qa/multiple_choice/open/pt/helm.json -> build/lib/unitxt/catalog/templates/qa/multiple_choice/open/pt 2026-01-06T13:30:10,250 copying src/unitxt/catalog/templates/qa/multiple_choice/open/pt/all.json -> build/lib/unitxt/catalog/templates/qa/multiple_choice/open/pt 2026-01-06T13:30:10,251 creating build/lib/unitxt/catalog/templates/qa/multiple_choice/open/fr 2026-01-06T13:30:10,252 copying src/unitxt/catalog/templates/qa/multiple_choice/open/fr/lm_eval_harness.json -> build/lib/unitxt/catalog/templates/qa/multiple_choice/open/fr 2026-01-06T13:30:10,254 copying src/unitxt/catalog/templates/qa/multiple_choice/open/fr/mmlu.json -> build/lib/unitxt/catalog/templates/qa/multiple_choice/open/fr 2026-01-06T13:30:10,256 copying src/unitxt/catalog/templates/qa/multiple_choice/open/fr/helm.json -> build/lib/unitxt/catalog/templates/qa/multiple_choice/open/fr 2026-01-06T13:30:10,259 copying src/unitxt/catalog/templates/qa/multiple_choice/open/fr/all.json -> build/lib/unitxt/catalog/templates/qa/multiple_choice/open/fr 2026-01-06T13:30:10,261 creating build/lib/unitxt/catalog/templates/qa/multiple_choice/with_context 2026-01-06T13:30:10,262 copying src/unitxt/catalog/templates/qa/multiple_choice/with_context/lm_eval_harness.json -> build/lib/unitxt/catalog/templates/qa/multiple_choice/with_context 2026-01-06T13:30:10,264 copying src/unitxt/catalog/templates/qa/multiple_choice/with_context/match.json -> build/lib/unitxt/catalog/templates/qa/multiple_choice/with_context 2026-01-06T13:30:10,268 copying src/unitxt/catalog/templates/qa/multiple_choice/with_context/ai2d.json -> build/lib/unitxt/catalog/templates/qa/multiple_choice/with_context 2026-01-06T13:30:10,270 copying src/unitxt/catalog/templates/qa/multiple_choice/with_context/lmms_eval.json -> build/lib/unitxt/catalog/templates/qa/multiple_choice/with_context 2026-01-06T13:30:10,272 copying src/unitxt/catalog/templates/qa/multiple_choice/with_context/bluebench.json -> build/lib/unitxt/catalog/templates/qa/multiple_choice/with_context 2026-01-06T13:30:10,274 copying src/unitxt/catalog/templates/qa/multiple_choice/with_context/exact_answer_instruct.json -> build/lib/unitxt/catalog/templates/qa/multiple_choice/with_context 2026-01-06T13:30:10,277 copying src/unitxt/catalog/templates/qa/multiple_choice/with_context/title.json -> build/lib/unitxt/catalog/templates/qa/multiple_choice/with_context 2026-01-06T13:30:10,279 copying src/unitxt/catalog/templates/qa/multiple_choice/with_context/all.json -> build/lib/unitxt/catalog/templates/qa/multiple_choice/with_context 2026-01-06T13:30:10,281 creating build/lib/unitxt/catalog/templates/qa/multiple_choice/with_context/no_intro 2026-01-06T13:30:10,282 copying src/unitxt/catalog/templates/qa/multiple_choice/with_context/no_intro/lm_eval_harness.json -> build/lib/unitxt/catalog/templates/qa/multiple_choice/with_context/no_intro 2026-01-06T13:30:10,284 copying src/unitxt/catalog/templates/qa/multiple_choice/with_context/no_intro/mmlu.json -> build/lib/unitxt/catalog/templates/qa/multiple_choice/with_context/no_intro 2026-01-06T13:30:10,286 copying src/unitxt/catalog/templates/qa/multiple_choice/with_context/no_intro/helm.json -> build/lib/unitxt/catalog/templates/qa/multiple_choice/with_context/no_intro 2026-01-06T13:30:10,288 copying src/unitxt/catalog/templates/qa/multiple_choice/with_context/no_intro/all.json -> build/lib/unitxt/catalog/templates/qa/multiple_choice/with_context/no_intro 2026-01-06T13:30:10,290 creating build/lib/unitxt/catalog/templates/qa/multiple_choice/with_context/no_intro/es 2026-01-06T13:30:10,291 copying src/unitxt/catalog/templates/qa/multiple_choice/with_context/no_intro/es/lm_eval_harness.json -> build/lib/unitxt/catalog/templates/qa/multiple_choice/with_context/no_intro/es 2026-01-06T13:30:10,293 copying src/unitxt/catalog/templates/qa/multiple_choice/with_context/no_intro/es/mmlu.json -> build/lib/unitxt/catalog/templates/qa/multiple_choice/with_context/no_intro/es 2026-01-06T13:30:10,295 copying src/unitxt/catalog/templates/qa/multiple_choice/with_context/no_intro/es/helm.json -> build/lib/unitxt/catalog/templates/qa/multiple_choice/with_context/no_intro/es 2026-01-06T13:30:10,298 copying src/unitxt/catalog/templates/qa/multiple_choice/with_context/no_intro/es/all.json -> build/lib/unitxt/catalog/templates/qa/multiple_choice/with_context/no_intro/es 2026-01-06T13:30:10,299 creating build/lib/unitxt/catalog/templates/qa/multiple_choice/with_context/no_intro/de 2026-01-06T13:30:10,301 copying src/unitxt/catalog/templates/qa/multiple_choice/with_context/no_intro/de/lm_eval_harness.json -> build/lib/unitxt/catalog/templates/qa/multiple_choice/with_context/no_intro/de 2026-01-06T13:30:10,303 copying src/unitxt/catalog/templates/qa/multiple_choice/with_context/no_intro/de/mmlu.json -> build/lib/unitxt/catalog/templates/qa/multiple_choice/with_context/no_intro/de 2026-01-06T13:30:10,305 copying src/unitxt/catalog/templates/qa/multiple_choice/with_context/no_intro/de/helm.json -> build/lib/unitxt/catalog/templates/qa/multiple_choice/with_context/no_intro/de 2026-01-06T13:30:10,307 copying src/unitxt/catalog/templates/qa/multiple_choice/with_context/no_intro/de/all.json -> build/lib/unitxt/catalog/templates/qa/multiple_choice/with_context/no_intro/de 2026-01-06T13:30:10,309 creating build/lib/unitxt/catalog/templates/qa/multiple_choice/with_context/no_intro/ja 2026-01-06T13:30:10,310 copying src/unitxt/catalog/templates/qa/multiple_choice/with_context/no_intro/ja/lm_eval_harness.json -> build/lib/unitxt/catalog/templates/qa/multiple_choice/with_context/no_intro/ja 2026-01-06T13:30:10,312 copying src/unitxt/catalog/templates/qa/multiple_choice/with_context/no_intro/ja/mmlu.json -> build/lib/unitxt/catalog/templates/qa/multiple_choice/with_context/no_intro/ja 2026-01-06T13:30:10,314 copying src/unitxt/catalog/templates/qa/multiple_choice/with_context/no_intro/ja/helm.json -> build/lib/unitxt/catalog/templates/qa/multiple_choice/with_context/no_intro/ja 2026-01-06T13:30:10,316 copying src/unitxt/catalog/templates/qa/multiple_choice/with_context/no_intro/ja/all.json -> build/lib/unitxt/catalog/templates/qa/multiple_choice/with_context/no_intro/ja 2026-01-06T13:30:10,318 creating build/lib/unitxt/catalog/templates/qa/multiple_choice/with_context/no_intro/pt 2026-01-06T13:30:10,319 copying src/unitxt/catalog/templates/qa/multiple_choice/with_context/no_intro/pt/lm_eval_harness.json -> build/lib/unitxt/catalog/templates/qa/multiple_choice/with_context/no_intro/pt 2026-01-06T13:30:10,322 copying src/unitxt/catalog/templates/qa/multiple_choice/with_context/no_intro/pt/mmlu.json -> build/lib/unitxt/catalog/templates/qa/multiple_choice/with_context/no_intro/pt 2026-01-06T13:30:10,324 copying src/unitxt/catalog/templates/qa/multiple_choice/with_context/no_intro/pt/helm.json -> build/lib/unitxt/catalog/templates/qa/multiple_choice/with_context/no_intro/pt 2026-01-06T13:30:10,326 copying src/unitxt/catalog/templates/qa/multiple_choice/with_context/no_intro/pt/all.json -> build/lib/unitxt/catalog/templates/qa/multiple_choice/with_context/no_intro/pt 2026-01-06T13:30:10,328 creating build/lib/unitxt/catalog/templates/qa/multiple_choice/with_context/no_intro/fr 2026-01-06T13:30:10,329 copying src/unitxt/catalog/templates/qa/multiple_choice/with_context/no_intro/fr/lm_eval_harness.json -> build/lib/unitxt/catalog/templates/qa/multiple_choice/with_context/no_intro/fr 2026-01-06T13:30:10,331 copying src/unitxt/catalog/templates/qa/multiple_choice/with_context/no_intro/fr/mmlu.json -> build/lib/unitxt/catalog/templates/qa/multiple_choice/with_context/no_intro/fr 2026-01-06T13:30:10,333 copying src/unitxt/catalog/templates/qa/multiple_choice/with_context/no_intro/fr/helm.json -> build/lib/unitxt/catalog/templates/qa/multiple_choice/with_context/no_intro/fr 2026-01-06T13:30:10,335 copying src/unitxt/catalog/templates/qa/multiple_choice/with_context/no_intro/fr/all.json -> build/lib/unitxt/catalog/templates/qa/multiple_choice/with_context/no_intro/fr 2026-01-06T13:30:10,337 creating build/lib/unitxt/catalog/templates/qa/multiple_choice/with_context/with_topic 2026-01-06T13:30:10,338 copying src/unitxt/catalog/templates/qa/multiple_choice/with_context/with_topic/lm_eval_harness.json -> build/lib/unitxt/catalog/templates/qa/multiple_choice/with_context/with_topic 2026-01-06T13:30:10,341 copying src/unitxt/catalog/templates/qa/multiple_choice/with_context/with_topic/mmlu.json -> build/lib/unitxt/catalog/templates/qa/multiple_choice/with_context/with_topic 2026-01-06T13:30:10,343 copying src/unitxt/catalog/templates/qa/multiple_choice/with_context/with_topic/match.json -> build/lib/unitxt/catalog/templates/qa/multiple_choice/with_context/with_topic 2026-01-06T13:30:10,345 copying src/unitxt/catalog/templates/qa/multiple_choice/with_context/with_topic/fm_eval.json -> build/lib/unitxt/catalog/templates/qa/multiple_choice/with_context/with_topic 2026-01-06T13:30:10,347 copying src/unitxt/catalog/templates/qa/multiple_choice/with_context/with_topic/helm.json -> build/lib/unitxt/catalog/templates/qa/multiple_choice/with_context/with_topic 2026-01-06T13:30:10,349 copying src/unitxt/catalog/templates/qa/multiple_choice/with_context/with_topic/title.json -> build/lib/unitxt/catalog/templates/qa/multiple_choice/with_context/with_topic 2026-01-06T13:30:10,352 copying src/unitxt/catalog/templates/qa/multiple_choice/with_context/with_topic/all.json -> build/lib/unitxt/catalog/templates/qa/multiple_choice/with_context/with_topic 2026-01-06T13:30:10,354 creating build/lib/unitxt/catalog/templates/qa/multiple_choice/with_context/with_topic/es 2026-01-06T13:30:10,355 copying src/unitxt/catalog/templates/qa/multiple_choice/with_context/with_topic/es/lm_eval_harness.json -> build/lib/unitxt/catalog/templates/qa/multiple_choice/with_context/with_topic/es 2026-01-06T13:30:10,357 copying src/unitxt/catalog/templates/qa/multiple_choice/with_context/with_topic/es/mmlu.json -> build/lib/unitxt/catalog/templates/qa/multiple_choice/with_context/with_topic/es 2026-01-06T13:30:10,360 copying src/unitxt/catalog/templates/qa/multiple_choice/with_context/with_topic/es/helm.json -> build/lib/unitxt/catalog/templates/qa/multiple_choice/with_context/with_topic/es 2026-01-06T13:30:10,362 copying src/unitxt/catalog/templates/qa/multiple_choice/with_context/with_topic/es/all.json -> build/lib/unitxt/catalog/templates/qa/multiple_choice/with_context/with_topic/es 2026-01-06T13:30:10,364 creating build/lib/unitxt/catalog/templates/qa/multiple_choice/with_context/with_topic/de 2026-01-06T13:30:10,365 copying src/unitxt/catalog/templates/qa/multiple_choice/with_context/with_topic/de/lm_eval_harness.json -> build/lib/unitxt/catalog/templates/qa/multiple_choice/with_context/with_topic/de 2026-01-06T13:30:10,367 copying src/unitxt/catalog/templates/qa/multiple_choice/with_context/with_topic/de/mmlu.json -> build/lib/unitxt/catalog/templates/qa/multiple_choice/with_context/with_topic/de 2026-01-06T13:30:10,369 copying src/unitxt/catalog/templates/qa/multiple_choice/with_context/with_topic/de/helm.json -> build/lib/unitxt/catalog/templates/qa/multiple_choice/with_context/with_topic/de 2026-01-06T13:30:10,372 copying src/unitxt/catalog/templates/qa/multiple_choice/with_context/with_topic/de/all.json -> build/lib/unitxt/catalog/templates/qa/multiple_choice/with_context/with_topic/de 2026-01-06T13:30:10,374 creating build/lib/unitxt/catalog/templates/qa/multiple_choice/with_context/with_topic/ja 2026-01-06T13:30:10,375 copying src/unitxt/catalog/templates/qa/multiple_choice/with_context/with_topic/ja/lm_eval_harness.json -> build/lib/unitxt/catalog/templates/qa/multiple_choice/with_context/with_topic/ja 2026-01-06T13:30:10,377 copying src/unitxt/catalog/templates/qa/multiple_choice/with_context/with_topic/ja/mmlu.json -> build/lib/unitxt/catalog/templates/qa/multiple_choice/with_context/with_topic/ja 2026-01-06T13:30:10,379 copying src/unitxt/catalog/templates/qa/multiple_choice/with_context/with_topic/ja/helm.json -> build/lib/unitxt/catalog/templates/qa/multiple_choice/with_context/with_topic/ja 2026-01-06T13:30:10,382 copying src/unitxt/catalog/templates/qa/multiple_choice/with_context/with_topic/ja/all.json -> build/lib/unitxt/catalog/templates/qa/multiple_choice/with_context/with_topic/ja 2026-01-06T13:30:10,384 creating build/lib/unitxt/catalog/templates/qa/multiple_choice/with_context/with_topic/pt 2026-01-06T13:30:10,385 copying src/unitxt/catalog/templates/qa/multiple_choice/with_context/with_topic/pt/lm_eval_harness.json -> build/lib/unitxt/catalog/templates/qa/multiple_choice/with_context/with_topic/pt 2026-01-06T13:30:10,387 copying src/unitxt/catalog/templates/qa/multiple_choice/with_context/with_topic/pt/mmlu.json -> build/lib/unitxt/catalog/templates/qa/multiple_choice/with_context/with_topic/pt 2026-01-06T13:30:10,389 copying src/unitxt/catalog/templates/qa/multiple_choice/with_context/with_topic/pt/helm.json -> build/lib/unitxt/catalog/templates/qa/multiple_choice/with_context/with_topic/pt 2026-01-06T13:30:10,391 copying src/unitxt/catalog/templates/qa/multiple_choice/with_context/with_topic/pt/all.json -> build/lib/unitxt/catalog/templates/qa/multiple_choice/with_context/with_topic/pt 2026-01-06T13:30:10,393 creating build/lib/unitxt/catalog/templates/qa/multiple_choice/with_context/with_topic/fr 2026-01-06T13:30:10,394 copying src/unitxt/catalog/templates/qa/multiple_choice/with_context/with_topic/fr/lm_eval_harness.json -> build/lib/unitxt/catalog/templates/qa/multiple_choice/with_context/with_topic/fr 2026-01-06T13:30:10,397 copying src/unitxt/catalog/templates/qa/multiple_choice/with_context/with_topic/fr/mmlu.json -> build/lib/unitxt/catalog/templates/qa/multiple_choice/with_context/with_topic/fr 2026-01-06T13:30:10,399 copying src/unitxt/catalog/templates/qa/multiple_choice/with_context/with_topic/fr/helm.json -> build/lib/unitxt/catalog/templates/qa/multiple_choice/with_context/with_topic/fr 2026-01-06T13:30:10,401 copying src/unitxt/catalog/templates/qa/multiple_choice/with_context/with_topic/fr/all.json -> build/lib/unitxt/catalog/templates/qa/multiple_choice/with_context/with_topic/fr 2026-01-06T13:30:10,403 creating build/lib/unitxt/catalog/templates/qa/open 2026-01-06T13:30:10,404 copying src/unitxt/catalog/templates/qa/open/empty.json -> build/lib/unitxt/catalog/templates/qa/open 2026-01-06T13:30:10,406 copying src/unitxt/catalog/templates/qa/open/simple.json -> build/lib/unitxt/catalog/templates/qa/open 2026-01-06T13:30:10,408 copying src/unitxt/catalog/templates/qa/open/title.json -> build/lib/unitxt/catalog/templates/qa/open 2026-01-06T13:30:10,410 copying src/unitxt/catalog/templates/qa/open/simple2.json -> build/lib/unitxt/catalog/templates/qa/open 2026-01-06T13:30:10,412 copying src/unitxt/catalog/templates/qa/open/all.json -> build/lib/unitxt/catalog/templates/qa/open 2026-01-06T13:30:10,414 creating build/lib/unitxt/catalog/templates/qa/with_context 2026-01-06T13:30:10,415 copying src/unitxt/catalog/templates/qa/with_context/with_type.json -> build/lib/unitxt/catalog/templates/qa/with_context 2026-01-06T13:30:10,418 copying src/unitxt/catalog/templates/qa/with_context/question_first.json -> build/lib/unitxt/catalog/templates/qa/with_context 2026-01-06T13:30:10,420 copying src/unitxt/catalog/templates/qa/with_context/ffqa.json -> build/lib/unitxt/catalog/templates/qa/with_context 2026-01-06T13:30:10,422 copying src/unitxt/catalog/templates/qa/with_context/chart_qa.json -> build/lib/unitxt/catalog/templates/qa/with_context 2026-01-06T13:30:10,424 copying src/unitxt/catalog/templates/qa/with_context/doc_vqa.json -> build/lib/unitxt/catalog/templates/qa/with_context 2026-01-06T13:30:10,426 copying src/unitxt/catalog/templates/qa/with_context/simple.json -> build/lib/unitxt/catalog/templates/qa/with_context 2026-01-06T13:30:10,428 copying src/unitxt/catalog/templates/qa/with_context/lmms_eval.json -> build/lib/unitxt/catalog/templates/qa/with_context 2026-01-06T13:30:10,430 copying src/unitxt/catalog/templates/qa/with_context/info_vqa.json -> build/lib/unitxt/catalog/templates/qa/with_context 2026-01-06T13:30:10,432 copying src/unitxt/catalog/templates/qa/with_context/websrc.json -> build/lib/unitxt/catalog/templates/qa/with_context 2026-01-06T13:30:10,434 copying src/unitxt/catalog/templates/qa/with_context/title.json -> build/lib/unitxt/catalog/templates/qa/with_context 2026-01-06T13:30:10,436 copying src/unitxt/catalog/templates/qa/with_context/simple2.json -> build/lib/unitxt/catalog/templates/qa/with_context 2026-01-06T13:30:10,439 copying src/unitxt/catalog/templates/qa/with_context/qtsumm.json -> build/lib/unitxt/catalog/templates/qa/with_context 2026-01-06T13:30:10,441 copying src/unitxt/catalog/templates/qa/with_context/all.json -> build/lib/unitxt/catalog/templates/qa/with_context 2026-01-06T13:30:10,443 creating build/lib/unitxt/catalog/templates/summarization/abstractive 2026-01-06T13:30:10,444 copying src/unitxt/catalog/templates/summarization/abstractive/instructive.json -> build/lib/unitxt/catalog/templates/summarization/abstractive 2026-01-06T13:30:10,447 copying src/unitxt/catalog/templates/summarization/abstractive/instruct_passive.json -> build/lib/unitxt/catalog/templates/summarization/abstractive 2026-01-06T13:30:10,449 copying src/unitxt/catalog/templates/summarization/abstractive/instruct_tldr.json -> build/lib/unitxt/catalog/templates/summarization/abstractive 2026-01-06T13:30:10,451 copying src/unitxt/catalog/templates/summarization/abstractive/formal.json -> build/lib/unitxt/catalog/templates/summarization/abstractive 2026-01-06T13:30:10,453 copying src/unitxt/catalog/templates/summarization/abstractive/full.json -> build/lib/unitxt/catalog/templates/summarization/abstractive 2026-01-06T13:30:10,455 copying src/unitxt/catalog/templates/summarization/abstractive/professional.json -> build/lib/unitxt/catalog/templates/summarization/abstractive 2026-01-06T13:30:10,458 copying src/unitxt/catalog/templates/summarization/abstractive/casual.json -> build/lib/unitxt/catalog/templates/summarization/abstractive 2026-01-06T13:30:10,460 copying src/unitxt/catalog/templates/summarization/abstractive/formal_without_label.json -> build/lib/unitxt/catalog/templates/summarization/abstractive 2026-01-06T13:30:10,462 copying src/unitxt/catalog/templates/summarization/abstractive/instruct_write_succinct.json -> build/lib/unitxt/catalog/templates/summarization/abstractive 2026-01-06T13:30:10,464 copying src/unitxt/catalog/templates/summarization/abstractive/instruct_one_sentence.json -> build/lib/unitxt/catalog/templates/summarization/abstractive 2026-01-06T13:30:10,466 copying src/unitxt/catalog/templates/summarization/abstractive/bluebench.json -> build/lib/unitxt/catalog/templates/summarization/abstractive 2026-01-06T13:30:10,468 copying src/unitxt/catalog/templates/summarization/abstractive/write_succinct.json -> build/lib/unitxt/catalog/templates/summarization/abstractive 2026-01-06T13:30:10,470 copying src/unitxt/catalog/templates/summarization/abstractive/passive.json -> build/lib/unitxt/catalog/templates/summarization/abstractive 2026-01-06T13:30:10,472 copying src/unitxt/catalog/templates/summarization/abstractive/title.json -> build/lib/unitxt/catalog/templates/summarization/abstractive 2026-01-06T13:30:10,475 copying src/unitxt/catalog/templates/summarization/abstractive/one_sentence.json -> build/lib/unitxt/catalog/templates/summarization/abstractive 2026-01-06T13:30:10,477 copying src/unitxt/catalog/templates/summarization/abstractive/instruct_full.json -> build/lib/unitxt/catalog/templates/summarization/abstractive 2026-01-06T13:30:10,479 copying src/unitxt/catalog/templates/summarization/abstractive/all.json -> build/lib/unitxt/catalog/templates/summarization/abstractive 2026-01-06T13:30:10,481 creating build/lib/unitxt/catalog/templates/schema_linking 2026-01-06T13:30:10,482 copying src/unitxt/catalog/templates/schema_linking/default.json -> build/lib/unitxt/catalog/templates/schema_linking 2026-01-06T13:30:10,484 copying src/unitxt/catalog/templates/schema_linking/with_hint.json -> build/lib/unitxt/catalog/templates/schema_linking 2026-01-06T13:30:10,486 copying src/unitxt/catalog/templates/schema_linking/all.json -> build/lib/unitxt/catalog/templates/schema_linking 2026-01-06T13:30:10,488 creating build/lib/unitxt/catalog/templates/completion/abstractive 2026-01-06T13:30:10,489 copying src/unitxt/catalog/templates/completion/abstractive/empty.json -> build/lib/unitxt/catalog/templates/completion/abstractive 2026-01-06T13:30:10,492 copying src/unitxt/catalog/templates/completion/abstractive/standard.json -> build/lib/unitxt/catalog/templates/completion/abstractive 2026-01-06T13:30:10,494 copying src/unitxt/catalog/templates/completion/abstractive/all.json -> build/lib/unitxt/catalog/templates/completion/abstractive 2026-01-06T13:30:10,495 creating build/lib/unitxt/catalog/templates/completion/multiple_choice 2026-01-06T13:30:10,497 copying src/unitxt/catalog/templates/completion/multiple_choice/simple.json -> build/lib/unitxt/catalog/templates/completion/multiple_choice 2026-01-06T13:30:10,499 copying src/unitxt/catalog/templates/completion/multiple_choice/enumerated.json -> build/lib/unitxt/catalog/templates/completion/multiple_choice 2026-01-06T13:30:10,501 copying src/unitxt/catalog/templates/completion/multiple_choice/bluebench.json -> build/lib/unitxt/catalog/templates/completion/multiple_choice 2026-01-06T13:30:10,503 copying src/unitxt/catalog/templates/completion/multiple_choice/title.json -> build/lib/unitxt/catalog/templates/completion/multiple_choice 2026-01-06T13:30:10,505 copying src/unitxt/catalog/templates/completion/multiple_choice/standard.json -> build/lib/unitxt/catalog/templates/completion/multiple_choice 2026-01-06T13:30:10,507 copying src/unitxt/catalog/templates/completion/multiple_choice/all.json -> build/lib/unitxt/catalog/templates/completion/multiple_choice 2026-01-06T13:30:10,509 creating build/lib/unitxt/catalog/templates/grammatical_error_detection 2026-01-06T13:30:10,511 copying src/unitxt/catalog/templates/grammatical_error_detection/yes_no.json -> build/lib/unitxt/catalog/templates/grammatical_error_detection 2026-01-06T13:30:10,513 copying src/unitxt/catalog/templates/grammatical_error_detection/all.json -> build/lib/unitxt/catalog/templates/grammatical_error_detection 2026-01-06T13:30:10,515 creating build/lib/unitxt/catalog/templates/text2sql 2026-01-06T13:30:10,516 copying src/unitxt/catalog/templates/text2sql/empty.json -> build/lib/unitxt/catalog/templates/text2sql 2026-01-06T13:30:10,518 copying src/unitxt/catalog/templates/text2sql/you_are_given.json -> build/lib/unitxt/catalog/templates/text2sql 2026-01-06T13:30:10,520 copying src/unitxt/catalog/templates/text2sql/you_are_given_with_sql_prefix.json -> build/lib/unitxt/catalog/templates/text2sql 2026-01-06T13:30:10,522 copying src/unitxt/catalog/templates/text2sql/you_are_given_with_hint_answer_sql_prefix_no_inst.json -> build/lib/unitxt/catalog/templates/text2sql 2026-01-06T13:30:10,524 copying src/unitxt/catalog/templates/text2sql/you_are_given_no_system.json -> build/lib/unitxt/catalog/templates/text2sql 2026-01-06T13:30:10,527 copying src/unitxt/catalog/templates/text2sql/you_are_given_with_hint_with_sql_prefix.json -> build/lib/unitxt/catalog/templates/text2sql 2026-01-06T13:30:10,529 copying src/unitxt/catalog/templates/text2sql/you_are_given_with_hint.json -> build/lib/unitxt/catalog/templates/text2sql 2026-01-06T13:30:10,531 copying src/unitxt/catalog/templates/text2sql/you_are_given_no_system_with_hint.json -> build/lib/unitxt/catalog/templates/text2sql 2026-01-06T13:30:10,534 copying src/unitxt/catalog/templates/text2sql/you_are_given_with_hint_with_out_sql_prefix.json -> build/lib/unitxt/catalog/templates/text2sql 2026-01-06T13:30:10,536 copying src/unitxt/catalog/templates/text2sql/all.json -> build/lib/unitxt/catalog/templates/text2sql 2026-01-06T13:30:10,537 creating build/lib/unitxt/catalog/templates/safety 2026-01-06T13:30:10,538 copying src/unitxt/catalog/templates/safety/llamaguard.json -> build/lib/unitxt/catalog/templates/safety 2026-01-06T13:30:10,541 copying src/unitxt/catalog/templates/safety/harm_rating.json -> build/lib/unitxt/catalog/templates/safety 2026-01-06T13:30:10,543 creating build/lib/unitxt/catalog/templates/rag_eval/faithfulness 2026-01-06T13:30:10,544 copying src/unitxt/catalog/templates/rag_eval/faithfulness/judge_with_question_full.json -> build/lib/unitxt/catalog/templates/rag_eval/faithfulness 2026-01-06T13:30:10,546 copying src/unitxt/catalog/templates/rag_eval/faithfulness/judge_no_question_simplified_verbal_good_bad.json -> build/lib/unitxt/catalog/templates/rag_eval/faithfulness 2026-01-06T13:30:10,548 copying src/unitxt/catalog/templates/rag_eval/faithfulness/judge_no_question_simplified.json -> build/lib/unitxt/catalog/templates/rag_eval/faithfulness 2026-01-06T13:30:10,551 copying src/unitxt/catalog/templates/rag_eval/faithfulness/judge_with_question_simplified_verbal.json -> build/lib/unitxt/catalog/templates/rag_eval/faithfulness 2026-01-06T13:30:10,553 copying src/unitxt/catalog/templates/rag_eval/faithfulness/judge_with_question_simplified_logprobs.json -> build/lib/unitxt/catalog/templates/rag_eval/faithfulness 2026-01-06T13:30:10,555 copying src/unitxt/catalog/templates/rag_eval/faithfulness/judge_with_question_simplified_verbal_good_bad.json -> build/lib/unitxt/catalog/templates/rag_eval/faithfulness 2026-01-06T13:30:10,557 copying src/unitxt/catalog/templates/rag_eval/faithfulness/judge_with_question_full_logprobs.json -> build/lib/unitxt/catalog/templates/rag_eval/faithfulness 2026-01-06T13:30:10,559 copying src/unitxt/catalog/templates/rag_eval/faithfulness/judge_no_question_full_logprobs.json -> build/lib/unitxt/catalog/templates/rag_eval/faithfulness 2026-01-06T13:30:10,562 copying src/unitxt/catalog/templates/rag_eval/faithfulness/judge_no_question_simplified_explain_logprobs.json -> build/lib/unitxt/catalog/templates/rag_eval/faithfulness 2026-01-06T13:30:10,564 copying src/unitxt/catalog/templates/rag_eval/faithfulness/judge_no_question_simplified_numeric.json -> build/lib/unitxt/catalog/templates/rag_eval/faithfulness 2026-01-06T13:30:10,566 copying src/unitxt/catalog/templates/rag_eval/faithfulness/judge_no_question_full.json -> build/lib/unitxt/catalog/templates/rag_eval/faithfulness 2026-01-06T13:30:10,568 copying src/unitxt/catalog/templates/rag_eval/faithfulness/judge_with_question_simplified.json -> build/lib/unitxt/catalog/templates/rag_eval/faithfulness 2026-01-06T13:30:10,570 copying src/unitxt/catalog/templates/rag_eval/faithfulness/judge_with_question_simplified_numeric.json -> build/lib/unitxt/catalog/templates/rag_eval/faithfulness 2026-01-06T13:30:10,572 copying src/unitxt/catalog/templates/rag_eval/faithfulness/judge_no_question_simplified_logprobs.json -> build/lib/unitxt/catalog/templates/rag_eval/faithfulness 2026-01-06T13:30:10,574 copying src/unitxt/catalog/templates/rag_eval/faithfulness/judge_no_question_simplified_explain.json -> build/lib/unitxt/catalog/templates/rag_eval/faithfulness 2026-01-06T13:30:10,577 copying src/unitxt/catalog/templates/rag_eval/faithfulness/judge_no_question_simplified_verbal.json -> build/lib/unitxt/catalog/templates/rag_eval/faithfulness 2026-01-06T13:30:10,579 copying src/unitxt/catalog/templates/rag_eval/faithfulness/all.json -> build/lib/unitxt/catalog/templates/rag_eval/faithfulness 2026-01-06T13:30:10,581 copying src/unitxt/catalog/templates/rag_eval/faithfulness/metric_template.json -> build/lib/unitxt/catalog/templates/rag_eval/faithfulness 2026-01-06T13:30:10,583 creating build/lib/unitxt/catalog/templates/rag_eval/correctness_holistic 2026-01-06T13:30:10,584 copying src/unitxt/catalog/templates/rag_eval/correctness_holistic/judge_correctness_explain_first_logprobs.json -> build/lib/unitxt/catalog/templates/rag_eval/correctness_holistic 2026-01-06T13:30:10,586 copying src/unitxt/catalog/templates/rag_eval/correctness_holistic/judge_correctness_simple.json -> build/lib/unitxt/catalog/templates/rag_eval/correctness_holistic 2026-01-06T13:30:10,588 copying src/unitxt/catalog/templates/rag_eval/correctness_holistic/judge_correctness_simple_numeric.json -> build/lib/unitxt/catalog/templates/rag_eval/correctness_holistic 2026-01-06T13:30:10,590 copying src/unitxt/catalog/templates/rag_eval/correctness_holistic/judge_correctness_explain_first.json -> build/lib/unitxt/catalog/templates/rag_eval/correctness_holistic 2026-01-06T13:30:10,592 copying src/unitxt/catalog/templates/rag_eval/correctness_holistic/all.json -> build/lib/unitxt/catalog/templates/rag_eval/correctness_holistic 2026-01-06T13:30:10,594 copying src/unitxt/catalog/templates/rag_eval/correctness_holistic/judge_correctness_simple_logprobs.json -> build/lib/unitxt/catalog/templates/rag_eval/correctness_holistic 2026-01-06T13:30:10,596 copying src/unitxt/catalog/templates/rag_eval/correctness_holistic/metric_template.json -> build/lib/unitxt/catalog/templates/rag_eval/correctness_holistic 2026-01-06T13:30:10,598 creating build/lib/unitxt/catalog/templates/rag_eval/context_relevance 2026-01-06T13:30:10,599 copying src/unitxt/catalog/templates/rag_eval/context_relevance/judge_context_relevance_ares.json -> build/lib/unitxt/catalog/templates/rag_eval/context_relevance 2026-01-06T13:30:10,601 copying src/unitxt/catalog/templates/rag_eval/context_relevance/judge_context_relevance_ares_numeric.json -> build/lib/unitxt/catalog/templates/rag_eval/context_relevance 2026-01-06T13:30:10,603 copying src/unitxt/catalog/templates/rag_eval/context_relevance/judge_context_relevance_ares_verbal_good_bad.json -> build/lib/unitxt/catalog/templates/rag_eval/context_relevance 2026-01-06T13:30:10,606 copying src/unitxt/catalog/templates/rag_eval/context_relevance/judge_context_relevance.json -> build/lib/unitxt/catalog/templates/rag_eval/context_relevance 2026-01-06T13:30:10,608 copying src/unitxt/catalog/templates/rag_eval/context_relevance/judge_context_relevance_ares_verbal.json -> build/lib/unitxt/catalog/templates/rag_eval/context_relevance 2026-01-06T13:30:10,610 copying src/unitxt/catalog/templates/rag_eval/context_relevance/judge_context_relevance_logprobs.json -> build/lib/unitxt/catalog/templates/rag_eval/context_relevance 2026-01-06T13:30:10,612 copying src/unitxt/catalog/templates/rag_eval/context_relevance/judge_context_relevance_ares_logprobs.json -> build/lib/unitxt/catalog/templates/rag_eval/context_relevance 2026-01-06T13:30:10,614 copying src/unitxt/catalog/templates/rag_eval/context_relevance/all.json -> build/lib/unitxt/catalog/templates/rag_eval/context_relevance 2026-01-06T13:30:10,617 copying src/unitxt/catalog/templates/rag_eval/context_relevance/metric_template.json -> build/lib/unitxt/catalog/templates/rag_eval/context_relevance 2026-01-06T13:30:10,619 creating build/lib/unitxt/catalog/templates/rag_eval/answer_correctness 2026-01-06T13:30:10,620 copying src/unitxt/catalog/templates/rag_eval/answer_correctness/judge_simplified_no_context.json -> build/lib/unitxt/catalog/templates/rag_eval/answer_correctness 2026-01-06T13:30:10,622 copying src/unitxt/catalog/templates/rag_eval/answer_correctness/judge_loose_match_no_context_verbal_good_bad.json -> build/lib/unitxt/catalog/templates/rag_eval/answer_correctness 2026-01-06T13:30:10,624 copying src/unitxt/catalog/templates/rag_eval/answer_correctness/judge_simplified_with_context.json -> build/lib/unitxt/catalog/templates/rag_eval/answer_correctness 2026-01-06T13:30:10,627 copying src/unitxt/catalog/templates/rag_eval/answer_correctness/judge_simplified_with_context_logprobs.json -> build/lib/unitxt/catalog/templates/rag_eval/answer_correctness 2026-01-06T13:30:10,629 copying src/unitxt/catalog/templates/rag_eval/answer_correctness/judge_instruct_qa_format.json -> build/lib/unitxt/catalog/templates/rag_eval/answer_correctness 2026-01-06T13:30:10,631 copying src/unitxt/catalog/templates/rag_eval/answer_correctness/judge_loose_match_no_context.json -> build/lib/unitxt/catalog/templates/rag_eval/answer_correctness 2026-01-06T13:30:10,634 copying src/unitxt/catalog/templates/rag_eval/answer_correctness/judge_simplified_format_logprobs.json -> build/lib/unitxt/catalog/templates/rag_eval/answer_correctness 2026-01-06T13:30:10,636 copying src/unitxt/catalog/templates/rag_eval/answer_correctness/judge_loose_match_no_context_numeric.json -> build/lib/unitxt/catalog/templates/rag_eval/answer_correctness 2026-01-06T13:30:10,638 copying src/unitxt/catalog/templates/rag_eval/answer_correctness/judge_loose_match_no_context_verbal.json -> build/lib/unitxt/catalog/templates/rag_eval/answer_correctness 2026-01-06T13:30:10,641 copying src/unitxt/catalog/templates/rag_eval/answer_correctness/judge_simplified_no_context_logprobs.json -> build/lib/unitxt/catalog/templates/rag_eval/answer_correctness 2026-01-06T13:30:10,644 copying src/unitxt/catalog/templates/rag_eval/answer_correctness/judge_loose_match_no_context_logprobs.json -> build/lib/unitxt/catalog/templates/rag_eval/answer_correctness 2026-01-06T13:30:10,647 copying src/unitxt/catalog/templates/rag_eval/answer_correctness/judge_instruct_qa_format_logprobs.json -> build/lib/unitxt/catalog/templates/rag_eval/answer_correctness 2026-01-06T13:30:10,650 copying src/unitxt/catalog/templates/rag_eval/answer_correctness/judge_simplified_format.json -> build/lib/unitxt/catalog/templates/rag_eval/answer_correctness 2026-01-06T13:30:10,653 copying src/unitxt/catalog/templates/rag_eval/answer_correctness/all.json -> build/lib/unitxt/catalog/templates/rag_eval/answer_correctness 2026-01-06T13:30:10,656 copying src/unitxt/catalog/templates/rag_eval/answer_correctness/metric_template.json -> build/lib/unitxt/catalog/templates/rag_eval/answer_correctness 2026-01-06T13:30:10,658 creating build/lib/unitxt/catalog/templates/rag_eval/answer_relevance 2026-01-06T13:30:10,660 copying src/unitxt/catalog/templates/rag_eval/answer_relevance/judge_answer_relevance_logprobs.json -> build/lib/unitxt/catalog/templates/rag_eval/answer_relevance 2026-01-06T13:30:10,663 copying src/unitxt/catalog/templates/rag_eval/answer_relevance/judge_answer_relevance.json -> build/lib/unitxt/catalog/templates/rag_eval/answer_relevance 2026-01-06T13:30:10,665 copying src/unitxt/catalog/templates/rag_eval/answer_relevance/judge_answer_relevance_verbal_good_bad.json -> build/lib/unitxt/catalog/templates/rag_eval/answer_relevance 2026-01-06T13:30:10,668 copying src/unitxt/catalog/templates/rag_eval/answer_relevance/judge_answer_relevance_numeric.json -> build/lib/unitxt/catalog/templates/rag_eval/answer_relevance 2026-01-06T13:30:10,671 copying src/unitxt/catalog/templates/rag_eval/answer_relevance/all.json -> build/lib/unitxt/catalog/templates/rag_eval/answer_relevance 2026-01-06T13:30:10,673 copying src/unitxt/catalog/templates/rag_eval/answer_relevance/metric_template.json -> build/lib/unitxt/catalog/templates/rag_eval/answer_relevance 2026-01-06T13:30:10,676 creating build/lib/unitxt/catalog/templates/classification/multi_class 2026-01-06T13:30:10,678 copying src/unitxt/catalog/templates/classification/multi_class/empty.json -> build/lib/unitxt/catalog/templates/classification/multi_class 2026-01-06T13:30:10,681 copying src/unitxt/catalog/templates/classification/multi_class/instruct_question_selects.json -> build/lib/unitxt/catalog/templates/classification/multi_class 2026-01-06T13:30:10,683 copying src/unitxt/catalog/templates/classification/multi_class/instruct_question_select_i_think.json -> build/lib/unitxt/catalog/templates/classification/multi_class 2026-01-06T13:30:10,686 copying src/unitxt/catalog/templates/classification/multi_class/bluebench.json -> build/lib/unitxt/catalog/templates/classification/multi_class 2026-01-06T13:30:10,689 copying src/unitxt/catalog/templates/classification/multi_class/default.json -> build/lib/unitxt/catalog/templates/classification/multi_class 2026-01-06T13:30:10,692 copying src/unitxt/catalog/templates/classification/multi_class/instruction.json -> build/lib/unitxt/catalog/templates/classification/multi_class 2026-01-06T13:30:10,694 copying src/unitxt/catalog/templates/classification/multi_class/title.json -> build/lib/unitxt/catalog/templates/classification/multi_class 2026-01-06T13:30:10,697 copying src/unitxt/catalog/templates/classification/multi_class/instruct_select_question.json -> build/lib/unitxt/catalog/templates/classification/multi_class 2026-01-06T13:30:10,700 copying src/unitxt/catalog/templates/classification/multi_class/all.json -> build/lib/unitxt/catalog/templates/classification/multi_class 2026-01-06T13:30:10,702 creating build/lib/unitxt/catalog/templates/classification/multi_class/relation 2026-01-06T13:30:10,703 copying src/unitxt/catalog/templates/classification/multi_class/relation/simple.json -> build/lib/unitxt/catalog/templates/classification/multi_class/relation 2026-01-06T13:30:10,706 copying src/unitxt/catalog/templates/classification/multi_class/relation/default.json -> build/lib/unitxt/catalog/templates/classification/multi_class/relation 2026-01-06T13:30:10,709 copying src/unitxt/catalog/templates/classification/multi_class/relation/all.json -> build/lib/unitxt/catalog/templates/classification/multi_class/relation 2026-01-06T13:30:10,711 creating build/lib/unitxt/catalog/templates/classification/multi_class/relation/truthfulness 2026-01-06T13:30:10,712 copying src/unitxt/catalog/templates/classification/multi_class/relation/truthfulness/flan_1.json -> build/lib/unitxt/catalog/templates/classification/multi_class/relation/truthfulness 2026-01-06T13:30:10,715 copying src/unitxt/catalog/templates/classification/multi_class/relation/truthfulness/flan_4.json -> build/lib/unitxt/catalog/templates/classification/multi_class/relation/truthfulness 2026-01-06T13:30:10,718 copying src/unitxt/catalog/templates/classification/multi_class/relation/truthfulness/flan_5.json -> build/lib/unitxt/catalog/templates/classification/multi_class/relation/truthfulness 2026-01-06T13:30:10,720 copying src/unitxt/catalog/templates/classification/multi_class/relation/truthfulness/flan_3.json -> build/lib/unitxt/catalog/templates/classification/multi_class/relation/truthfulness 2026-01-06T13:30:10,723 copying src/unitxt/catalog/templates/classification/multi_class/relation/truthfulness/flan_2.json -> build/lib/unitxt/catalog/templates/classification/multi_class/relation/truthfulness 2026-01-06T13:30:10,725 copying src/unitxt/catalog/templates/classification/multi_class/relation/truthfulness/flan_6.json -> build/lib/unitxt/catalog/templates/classification/multi_class/relation/truthfulness 2026-01-06T13:30:10,728 copying src/unitxt/catalog/templates/classification/multi_class/relation/truthfulness/all.json -> build/lib/unitxt/catalog/templates/classification/multi_class/relation/truthfulness 2026-01-06T13:30:10,731 copying src/unitxt/catalog/templates/classification/multi_class/relation/truthfulness/flan_7.json -> build/lib/unitxt/catalog/templates/classification/multi_class/relation/truthfulness 2026-01-06T13:30:10,734 creating build/lib/unitxt/catalog/templates/classification/multi_label 2026-01-06T13:30:10,735 copying src/unitxt/catalog/templates/classification/multi_label/empty.json -> build/lib/unitxt/catalog/templates/classification/multi_label 2026-01-06T13:30:10,738 copying src/unitxt/catalog/templates/classification/multi_label/default.json -> build/lib/unitxt/catalog/templates/classification/multi_label 2026-01-06T13:30:10,741 copying src/unitxt/catalog/templates/classification/multi_label/instruction.json -> build/lib/unitxt/catalog/templates/classification/multi_label 2026-01-06T13:30:10,743 copying src/unitxt/catalog/templates/classification/multi_label/title.json -> build/lib/unitxt/catalog/templates/classification/multi_label 2026-01-06T13:30:10,745 copying src/unitxt/catalog/templates/classification/multi_label/all.json -> build/lib/unitxt/catalog/templates/classification/multi_label 2026-01-06T13:30:10,747 creating build/lib/unitxt/catalog/templates/key_value_extraction 2026-01-06T13:30:10,748 copying src/unitxt/catalog/templates/key_value_extraction/extract_in_json_format.json -> build/lib/unitxt/catalog/templates/key_value_extraction 2026-01-06T13:30:10,750 creating build/lib/unitxt/catalog/templates/rewriting/paraphrase 2026-01-06T13:30:10,751 copying src/unitxt/catalog/templates/rewriting/paraphrase/default.json -> build/lib/unitxt/catalog/templates/rewriting/paraphrase 2026-01-06T13:30:10,753 copying src/unitxt/catalog/templates/rewriting/paraphrase/all.json -> build/lib/unitxt/catalog/templates/rewriting/paraphrase 2026-01-06T13:30:10,755 creating build/lib/unitxt/catalog/templates/rewriting/by_attribute 2026-01-06T13:30:10,756 copying src/unitxt/catalog/templates/rewriting/by_attribute/default.json -> build/lib/unitxt/catalog/templates/rewriting/by_attribute 2026-01-06T13:30:10,758 copying src/unitxt/catalog/templates/rewriting/by_attribute/all.json -> build/lib/unitxt/catalog/templates/rewriting/by_attribute 2026-01-06T13:30:10,760 creating build/lib/unitxt/catalog/templates/rag/response_generation 2026-01-06T13:30:10,761 copying src/unitxt/catalog/templates/rag/response_generation/please_respond_chat.json -> build/lib/unitxt/catalog/templates/rag/response_generation 2026-01-06T13:30:10,764 copying src/unitxt/catalog/templates/rag/response_generation/answer_based_on_context_inverted.json -> build/lib/unitxt/catalog/templates/rag/response_generation 2026-01-06T13:30:10,767 copying src/unitxt/catalog/templates/rag/response_generation/bluebench.json -> build/lib/unitxt/catalog/templates/rag/response_generation 2026-01-06T13:30:10,769 copying src/unitxt/catalog/templates/rag/response_generation/answer_based_on_context.json -> build/lib/unitxt/catalog/templates/rag/response_generation 2026-01-06T13:30:10,771 copying src/unitxt/catalog/templates/rag/response_generation/please_respond.json -> build/lib/unitxt/catalog/templates/rag/response_generation 2026-01-06T13:30:10,773 creating build/lib/unitxt/catalog/templates/rag/end_to_end 2026-01-06T13:30:10,774 copying src/unitxt/catalog/templates/rag/end_to_end/json_predictions.json -> build/lib/unitxt/catalog/templates/rag/end_to_end 2026-01-06T13:30:10,776 creating build/lib/unitxt/catalog/templates/span_labeling/extraction 2026-01-06T13:30:10,777 copying src/unitxt/catalog/templates/span_labeling/extraction/empty.json -> build/lib/unitxt/catalog/templates/span_labeling/extraction 2026-01-06T13:30:10,780 copying src/unitxt/catalog/templates/span_labeling/extraction/extract.json -> build/lib/unitxt/catalog/templates/span_labeling/extraction 2026-01-06T13:30:10,782 copying src/unitxt/catalog/templates/span_labeling/extraction/having.json -> build/lib/unitxt/catalog/templates/span_labeling/extraction 2026-01-06T13:30:10,784 copying src/unitxt/catalog/templates/span_labeling/extraction/identify.json -> build/lib/unitxt/catalog/templates/span_labeling/extraction 2026-01-06T13:30:10,786 copying src/unitxt/catalog/templates/span_labeling/extraction/title.json -> build/lib/unitxt/catalog/templates/span_labeling/extraction 2026-01-06T13:30:10,788 copying src/unitxt/catalog/templates/span_labeling/extraction/carry.json -> build/lib/unitxt/catalog/templates/span_labeling/extraction 2026-01-06T13:30:10,790 copying src/unitxt/catalog/templates/span_labeling/extraction/detailed.json -> build/lib/unitxt/catalog/templates/span_labeling/extraction 2026-01-06T13:30:10,792 copying src/unitxt/catalog/templates/span_labeling/extraction/all.json -> build/lib/unitxt/catalog/templates/span_labeling/extraction 2026-01-06T13:30:10,794 creating build/lib/unitxt/catalog/templates/evaluation/preference 2026-01-06T13:30:10,796 copying src/unitxt/catalog/templates/evaluation/preference/default.json -> build/lib/unitxt/catalog/templates/evaluation/preference 2026-01-06T13:30:10,798 copying src/unitxt/catalog/templates/evaluation/preference/all.json -> build/lib/unitxt/catalog/templates/evaluation/preference 2026-01-06T13:30:10,800 creating build/lib/unitxt/catalog/templates/language_identification 2026-01-06T13:30:10,800 copying src/unitxt/catalog/templates/language_identification/simple.json -> build/lib/unitxt/catalog/templates/language_identification 2026-01-06T13:30:10,803 copying src/unitxt/catalog/templates/language_identification/all.json -> build/lib/unitxt/catalog/templates/language_identification 2026-01-06T13:30:10,805 creating build/lib/unitxt/catalog/recipes/torr/wikitq/df 2026-01-06T13:30:10,807 copying src/unitxt/catalog/recipes/torr/wikitq/df/transpose_augmentation_1_demos.json -> build/lib/unitxt/catalog/recipes/torr/wikitq/df 2026-01-06T13:30:10,810 copying src/unitxt/catalog/recipes/torr/wikitq/df/shuffle_cols_augmentation_1_demos.json -> build/lib/unitxt/catalog/recipes/torr/wikitq/df 2026-01-06T13:30:10,812 copying src/unitxt/catalog/recipes/torr/wikitq/df/insert_empty_rows_augmentation_1_demos.json -> build/lib/unitxt/catalog/recipes/torr/wikitq/df 2026-01-06T13:30:10,814 copying src/unitxt/catalog/recipes/torr/wikitq/df/no_augmentation_1_demos.json -> build/lib/unitxt/catalog/recipes/torr/wikitq/df 2026-01-06T13:30:10,816 copying src/unitxt/catalog/recipes/torr/wikitq/df/shuffle_rows_augmentation_1_demos.json -> build/lib/unitxt/catalog/recipes/torr/wikitq/df 2026-01-06T13:30:10,818 creating build/lib/unitxt/catalog/recipes/torr/wikitq/csv 2026-01-06T13:30:10,819 copying src/unitxt/catalog/recipes/torr/wikitq/csv/transpose_augmentation_1_demos.json -> build/lib/unitxt/catalog/recipes/torr/wikitq/csv 2026-01-06T13:30:10,821 copying src/unitxt/catalog/recipes/torr/wikitq/csv/shuffle_cols_augmentation_1_demos.json -> build/lib/unitxt/catalog/recipes/torr/wikitq/csv 2026-01-06T13:30:10,823 copying src/unitxt/catalog/recipes/torr/wikitq/csv/insert_empty_rows_augmentation_1_demos.json -> build/lib/unitxt/catalog/recipes/torr/wikitq/csv 2026-01-06T13:30:10,825 copying src/unitxt/catalog/recipes/torr/wikitq/csv/no_augmentation_1_demos.json -> build/lib/unitxt/catalog/recipes/torr/wikitq/csv 2026-01-06T13:30:10,827 copying src/unitxt/catalog/recipes/torr/wikitq/csv/shuffle_rows_augmentation_1_demos.json -> build/lib/unitxt/catalog/recipes/torr/wikitq/csv 2026-01-06T13:30:10,829 creating build/lib/unitxt/catalog/recipes/torr/wikitq/concat 2026-01-06T13:30:10,830 copying src/unitxt/catalog/recipes/torr/wikitq/concat/transpose_augmentation_1_demos.json -> build/lib/unitxt/catalog/recipes/torr/wikitq/concat 2026-01-06T13:30:10,833 copying src/unitxt/catalog/recipes/torr/wikitq/concat/shuffle_cols_augmentation_1_demos.json -> build/lib/unitxt/catalog/recipes/torr/wikitq/concat 2026-01-06T13:30:10,835 copying src/unitxt/catalog/recipes/torr/wikitq/concat/insert_empty_rows_augmentation_1_demos.json -> build/lib/unitxt/catalog/recipes/torr/wikitq/concat 2026-01-06T13:30:10,837 copying src/unitxt/catalog/recipes/torr/wikitq/concat/no_augmentation_1_demos.json -> build/lib/unitxt/catalog/recipes/torr/wikitq/concat 2026-01-06T13:30:10,839 copying src/unitxt/catalog/recipes/torr/wikitq/concat/shuffle_rows_augmentation_1_demos.json -> build/lib/unitxt/catalog/recipes/torr/wikitq/concat 2026-01-06T13:30:10,842 creating build/lib/unitxt/catalog/recipes/torr/wikitq/html 2026-01-06T13:30:10,843 copying src/unitxt/catalog/recipes/torr/wikitq/html/transpose_augmentation_1_demos.json -> build/lib/unitxt/catalog/recipes/torr/wikitq/html 2026-01-06T13:30:10,845 copying src/unitxt/catalog/recipes/torr/wikitq/html/shuffle_cols_augmentation_1_demos.json -> build/lib/unitxt/catalog/recipes/torr/wikitq/html 2026-01-06T13:30:10,847 copying src/unitxt/catalog/recipes/torr/wikitq/html/insert_empty_rows_augmentation_1_demos.json -> build/lib/unitxt/catalog/recipes/torr/wikitq/html 2026-01-06T13:30:10,849 copying src/unitxt/catalog/recipes/torr/wikitq/html/no_augmentation_1_demos.json -> build/lib/unitxt/catalog/recipes/torr/wikitq/html 2026-01-06T13:30:10,851 copying src/unitxt/catalog/recipes/torr/wikitq/html/shuffle_rows_augmentation_1_demos.json -> build/lib/unitxt/catalog/recipes/torr/wikitq/html 2026-01-06T13:30:10,853 creating build/lib/unitxt/catalog/recipes/torr/wikitq/json 2026-01-06T13:30:10,854 copying src/unitxt/catalog/recipes/torr/wikitq/json/transpose_augmentation_1_demos.json -> build/lib/unitxt/catalog/recipes/torr/wikitq/json 2026-01-06T13:30:10,857 copying src/unitxt/catalog/recipes/torr/wikitq/json/shuffle_cols_augmentation_1_demos.json -> build/lib/unitxt/catalog/recipes/torr/wikitq/json 2026-01-06T13:30:10,859 copying src/unitxt/catalog/recipes/torr/wikitq/json/insert_empty_rows_augmentation_1_demos.json -> build/lib/unitxt/catalog/recipes/torr/wikitq/json 2026-01-06T13:30:10,861 copying src/unitxt/catalog/recipes/torr/wikitq/json/no_augmentation_1_demos.json -> build/lib/unitxt/catalog/recipes/torr/wikitq/json 2026-01-06T13:30:10,863 copying src/unitxt/catalog/recipes/torr/wikitq/json/shuffle_rows_augmentation_1_demos.json -> build/lib/unitxt/catalog/recipes/torr/wikitq/json 2026-01-06T13:30:10,865 creating build/lib/unitxt/catalog/recipes/torr/wikitq/markdown 2026-01-06T13:30:10,866 copying src/unitxt/catalog/recipes/torr/wikitq/markdown/transpose_augmentation_1_demos.json -> build/lib/unitxt/catalog/recipes/torr/wikitq/markdown 2026-01-06T13:30:10,868 copying src/unitxt/catalog/recipes/torr/wikitq/markdown/shuffle_cols_augmentation_1_demos.json -> build/lib/unitxt/catalog/recipes/torr/wikitq/markdown 2026-01-06T13:30:10,870 copying src/unitxt/catalog/recipes/torr/wikitq/markdown/insert_empty_rows_augmentation_1_demos.json -> build/lib/unitxt/catalog/recipes/torr/wikitq/markdown 2026-01-06T13:30:10,873 copying src/unitxt/catalog/recipes/torr/wikitq/markdown/no_augmentation_1_demos.json -> build/lib/unitxt/catalog/recipes/torr/wikitq/markdown 2026-01-06T13:30:10,875 copying src/unitxt/catalog/recipes/torr/wikitq/markdown/shuffle_rows_augmentation_1_demos.json -> build/lib/unitxt/catalog/recipes/torr/wikitq/markdown 2026-01-06T13:30:10,877 creating build/lib/unitxt/catalog/recipes/torr/wikitq/indexed_row_major 2026-01-06T13:30:10,878 copying src/unitxt/catalog/recipes/torr/wikitq/indexed_row_major/transpose_augmentation_1_demos.json -> build/lib/unitxt/catalog/recipes/torr/wikitq/indexed_row_major 2026-01-06T13:30:10,880 copying src/unitxt/catalog/recipes/torr/wikitq/indexed_row_major/shuffle_cols_augmentation_1_demos.json -> build/lib/unitxt/catalog/recipes/torr/wikitq/indexed_row_major 2026-01-06T13:30:10,882 copying src/unitxt/catalog/recipes/torr/wikitq/indexed_row_major/insert_empty_rows_augmentation_1_demos.json -> build/lib/unitxt/catalog/recipes/torr/wikitq/indexed_row_major 2026-01-06T13:30:10,884 copying src/unitxt/catalog/recipes/torr/wikitq/indexed_row_major/no_augmentation_1_demos.json -> build/lib/unitxt/catalog/recipes/torr/wikitq/indexed_row_major 2026-01-06T13:30:10,886 copying src/unitxt/catalog/recipes/torr/wikitq/indexed_row_major/shuffle_rows_augmentation_1_demos.json -> build/lib/unitxt/catalog/recipes/torr/wikitq/indexed_row_major 2026-01-06T13:30:10,888 creating build/lib/unitxt/catalog/recipes/torr/tablebench_fact_checking/df 2026-01-06T13:30:10,890 copying src/unitxt/catalog/recipes/torr/tablebench_fact_checking/df/shuffle_rows_augmentation_5_demos.json -> build/lib/unitxt/catalog/recipes/torr/tablebench_fact_checking/df 2026-01-06T13:30:10,892 copying src/unitxt/catalog/recipes/torr/tablebench_fact_checking/df/no_augmentation_5_demos.json -> build/lib/unitxt/catalog/recipes/torr/tablebench_fact_checking/df 2026-01-06T13:30:10,894 copying src/unitxt/catalog/recipes/torr/tablebench_fact_checking/df/insert_empty_rows_augmentation_5_demos.json -> build/lib/unitxt/catalog/recipes/torr/tablebench_fact_checking/df 2026-01-06T13:30:10,896 copying src/unitxt/catalog/recipes/torr/tablebench_fact_checking/df/transpose_augmentation_5_demos.json -> build/lib/unitxt/catalog/recipes/torr/tablebench_fact_checking/df 2026-01-06T13:30:10,899 copying src/unitxt/catalog/recipes/torr/tablebench_fact_checking/df/shuffle_cols_augmentation_5_demos.json -> build/lib/unitxt/catalog/recipes/torr/tablebench_fact_checking/df 2026-01-06T13:30:10,901 creating build/lib/unitxt/catalog/recipes/torr/tablebench_fact_checking/csv 2026-01-06T13:30:10,902 copying src/unitxt/catalog/recipes/torr/tablebench_fact_checking/csv/shuffle_rows_augmentation_5_demos.json -> build/lib/unitxt/catalog/recipes/torr/tablebench_fact_checking/csv 2026-01-06T13:30:10,904 copying src/unitxt/catalog/recipes/torr/tablebench_fact_checking/csv/no_augmentation_5_demos.json -> build/lib/unitxt/catalog/recipes/torr/tablebench_fact_checking/csv 2026-01-06T13:30:10,906 copying src/unitxt/catalog/recipes/torr/tablebench_fact_checking/csv/insert_empty_rows_augmentation_5_demos.json -> build/lib/unitxt/catalog/recipes/torr/tablebench_fact_checking/csv 2026-01-06T13:30:10,908 copying src/unitxt/catalog/recipes/torr/tablebench_fact_checking/csv/transpose_augmentation_5_demos.json -> build/lib/unitxt/catalog/recipes/torr/tablebench_fact_checking/csv 2026-01-06T13:30:10,910 copying src/unitxt/catalog/recipes/torr/tablebench_fact_checking/csv/shuffle_cols_augmentation_5_demos.json -> build/lib/unitxt/catalog/recipes/torr/tablebench_fact_checking/csv 2026-01-06T13:30:10,912 creating build/lib/unitxt/catalog/recipes/torr/tablebench_fact_checking/concat 2026-01-06T13:30:10,913 copying src/unitxt/catalog/recipes/torr/tablebench_fact_checking/concat/shuffle_rows_augmentation_5_demos.json -> build/lib/unitxt/catalog/recipes/torr/tablebench_fact_checking/concat 2026-01-06T13:30:10,915 copying src/unitxt/catalog/recipes/torr/tablebench_fact_checking/concat/no_augmentation_5_demos.json -> build/lib/unitxt/catalog/recipes/torr/tablebench_fact_checking/concat 2026-01-06T13:30:10,918 copying src/unitxt/catalog/recipes/torr/tablebench_fact_checking/concat/insert_empty_rows_augmentation_5_demos.json -> build/lib/unitxt/catalog/recipes/torr/tablebench_fact_checking/concat 2026-01-06T13:30:10,920 copying src/unitxt/catalog/recipes/torr/tablebench_fact_checking/concat/transpose_augmentation_5_demos.json -> build/lib/unitxt/catalog/recipes/torr/tablebench_fact_checking/concat 2026-01-06T13:30:10,922 copying src/unitxt/catalog/recipes/torr/tablebench_fact_checking/concat/shuffle_cols_augmentation_5_demos.json -> build/lib/unitxt/catalog/recipes/torr/tablebench_fact_checking/concat 2026-01-06T13:30:10,924 creating build/lib/unitxt/catalog/recipes/torr/tablebench_fact_checking/html 2026-01-06T13:30:10,925 copying src/unitxt/catalog/recipes/torr/tablebench_fact_checking/html/shuffle_rows_augmentation_5_demos.json -> build/lib/unitxt/catalog/recipes/torr/tablebench_fact_checking/html 2026-01-06T13:30:10,927 copying src/unitxt/catalog/recipes/torr/tablebench_fact_checking/html/no_augmentation_5_demos.json -> build/lib/unitxt/catalog/recipes/torr/tablebench_fact_checking/html 2026-01-06T13:30:10,929 copying src/unitxt/catalog/recipes/torr/tablebench_fact_checking/html/insert_empty_rows_augmentation_5_demos.json -> build/lib/unitxt/catalog/recipes/torr/tablebench_fact_checking/html 2026-01-06T13:30:10,931 copying src/unitxt/catalog/recipes/torr/tablebench_fact_checking/html/transpose_augmentation_5_demos.json -> build/lib/unitxt/catalog/recipes/torr/tablebench_fact_checking/html 2026-01-06T13:30:10,933 copying src/unitxt/catalog/recipes/torr/tablebench_fact_checking/html/shuffle_cols_augmentation_5_demos.json -> build/lib/unitxt/catalog/recipes/torr/tablebench_fact_checking/html 2026-01-06T13:30:10,935 creating build/lib/unitxt/catalog/recipes/torr/tablebench_fact_checking/json 2026-01-06T13:30:10,936 copying src/unitxt/catalog/recipes/torr/tablebench_fact_checking/json/shuffle_rows_augmentation_5_demos.json -> build/lib/unitxt/catalog/recipes/torr/tablebench_fact_checking/json 2026-01-06T13:30:10,938 copying src/unitxt/catalog/recipes/torr/tablebench_fact_checking/json/no_augmentation_5_demos.json -> build/lib/unitxt/catalog/recipes/torr/tablebench_fact_checking/json 2026-01-06T13:30:10,940 copying src/unitxt/catalog/recipes/torr/tablebench_fact_checking/json/insert_empty_rows_augmentation_5_demos.json -> build/lib/unitxt/catalog/recipes/torr/tablebench_fact_checking/json 2026-01-06T13:30:10,942 copying src/unitxt/catalog/recipes/torr/tablebench_fact_checking/json/transpose_augmentation_5_demos.json -> build/lib/unitxt/catalog/recipes/torr/tablebench_fact_checking/json 2026-01-06T13:30:10,944 copying src/unitxt/catalog/recipes/torr/tablebench_fact_checking/json/shuffle_cols_augmentation_5_demos.json -> build/lib/unitxt/catalog/recipes/torr/tablebench_fact_checking/json 2026-01-06T13:30:10,946 creating build/lib/unitxt/catalog/recipes/torr/tablebench_fact_checking/markdown 2026-01-06T13:30:10,947 copying src/unitxt/catalog/recipes/torr/tablebench_fact_checking/markdown/shuffle_rows_augmentation_5_demos.json -> build/lib/unitxt/catalog/recipes/torr/tablebench_fact_checking/markdown 2026-01-06T13:30:10,950 copying src/unitxt/catalog/recipes/torr/tablebench_fact_checking/markdown/no_augmentation_5_demos.json -> build/lib/unitxt/catalog/recipes/torr/tablebench_fact_checking/markdown 2026-01-06T13:30:10,952 copying src/unitxt/catalog/recipes/torr/tablebench_fact_checking/markdown/insert_empty_rows_augmentation_5_demos.json -> build/lib/unitxt/catalog/recipes/torr/tablebench_fact_checking/markdown 2026-01-06T13:30:10,954 copying src/unitxt/catalog/recipes/torr/tablebench_fact_checking/markdown/transpose_augmentation_5_demos.json -> build/lib/unitxt/catalog/recipes/torr/tablebench_fact_checking/markdown 2026-01-06T13:30:10,956 copying src/unitxt/catalog/recipes/torr/tablebench_fact_checking/markdown/shuffle_cols_augmentation_5_demos.json -> build/lib/unitxt/catalog/recipes/torr/tablebench_fact_checking/markdown 2026-01-06T13:30:10,958 creating build/lib/unitxt/catalog/recipes/torr/tablebench_fact_checking/indexed_row_major 2026-01-06T13:30:10,959 copying src/unitxt/catalog/recipes/torr/tablebench_fact_checking/indexed_row_major/shuffle_rows_augmentation_5_demos.json -> build/lib/unitxt/catalog/recipes/torr/tablebench_fact_checking/indexed_row_major 2026-01-06T13:30:10,961 copying src/unitxt/catalog/recipes/torr/tablebench_fact_checking/indexed_row_major/no_augmentation_5_demos.json -> build/lib/unitxt/catalog/recipes/torr/tablebench_fact_checking/indexed_row_major 2026-01-06T13:30:10,963 copying src/unitxt/catalog/recipes/torr/tablebench_fact_checking/indexed_row_major/insert_empty_rows_augmentation_5_demos.json -> build/lib/unitxt/catalog/recipes/torr/tablebench_fact_checking/indexed_row_major 2026-01-06T13:30:10,965 copying src/unitxt/catalog/recipes/torr/tablebench_fact_checking/indexed_row_major/transpose_augmentation_5_demos.json -> build/lib/unitxt/catalog/recipes/torr/tablebench_fact_checking/indexed_row_major 2026-01-06T13:30:10,967 copying src/unitxt/catalog/recipes/torr/tablebench_fact_checking/indexed_row_major/shuffle_cols_augmentation_5_demos.json -> build/lib/unitxt/catalog/recipes/torr/tablebench_fact_checking/indexed_row_major 2026-01-06T13:30:10,970 creating build/lib/unitxt/catalog/recipes/torr/qtsumm/df 2026-01-06T13:30:10,971 copying src/unitxt/catalog/recipes/torr/qtsumm/df/shuffle_rows_augmentation_5_demos.json -> build/lib/unitxt/catalog/recipes/torr/qtsumm/df 2026-01-06T13:30:10,973 copying src/unitxt/catalog/recipes/torr/qtsumm/df/no_augmentation_5_demos.json -> build/lib/unitxt/catalog/recipes/torr/qtsumm/df 2026-01-06T13:30:10,975 copying src/unitxt/catalog/recipes/torr/qtsumm/df/insert_empty_rows_augmentation_5_demos.json -> build/lib/unitxt/catalog/recipes/torr/qtsumm/df 2026-01-06T13:30:10,978 copying src/unitxt/catalog/recipes/torr/qtsumm/df/transpose_augmentation_5_demos.json -> build/lib/unitxt/catalog/recipes/torr/qtsumm/df 2026-01-06T13:30:10,980 copying src/unitxt/catalog/recipes/torr/qtsumm/df/shuffle_cols_augmentation_5_demos.json -> build/lib/unitxt/catalog/recipes/torr/qtsumm/df 2026-01-06T13:30:10,982 creating build/lib/unitxt/catalog/recipes/torr/qtsumm/csv 2026-01-06T13:30:10,983 copying src/unitxt/catalog/recipes/torr/qtsumm/csv/shuffle_rows_augmentation_5_demos.json -> build/lib/unitxt/catalog/recipes/torr/qtsumm/csv 2026-01-06T13:30:10,985 copying src/unitxt/catalog/recipes/torr/qtsumm/csv/no_augmentation_5_demos.json -> build/lib/unitxt/catalog/recipes/torr/qtsumm/csv 2026-01-06T13:30:10,987 copying src/unitxt/catalog/recipes/torr/qtsumm/csv/insert_empty_rows_augmentation_5_demos.json -> build/lib/unitxt/catalog/recipes/torr/qtsumm/csv 2026-01-06T13:30:10,989 copying src/unitxt/catalog/recipes/torr/qtsumm/csv/transpose_augmentation_5_demos.json -> build/lib/unitxt/catalog/recipes/torr/qtsumm/csv 2026-01-06T13:30:10,991 copying src/unitxt/catalog/recipes/torr/qtsumm/csv/shuffle_cols_augmentation_5_demos.json -> build/lib/unitxt/catalog/recipes/torr/qtsumm/csv 2026-01-06T13:30:10,992 creating build/lib/unitxt/catalog/recipes/torr/qtsumm/concat 2026-01-06T13:30:10,993 copying src/unitxt/catalog/recipes/torr/qtsumm/concat/shuffle_rows_augmentation_5_demos.json -> build/lib/unitxt/catalog/recipes/torr/qtsumm/concat 2026-01-06T13:30:10,995 copying src/unitxt/catalog/recipes/torr/qtsumm/concat/no_augmentation_5_demos.json -> build/lib/unitxt/catalog/recipes/torr/qtsumm/concat 2026-01-06T13:30:10,997 copying src/unitxt/catalog/recipes/torr/qtsumm/concat/insert_empty_rows_augmentation_5_demos.json -> build/lib/unitxt/catalog/recipes/torr/qtsumm/concat 2026-01-06T13:30:11,000 copying src/unitxt/catalog/recipes/torr/qtsumm/concat/transpose_augmentation_5_demos.json -> build/lib/unitxt/catalog/recipes/torr/qtsumm/concat 2026-01-06T13:30:11,001 copying src/unitxt/catalog/recipes/torr/qtsumm/concat/shuffle_cols_augmentation_5_demos.json -> build/lib/unitxt/catalog/recipes/torr/qtsumm/concat 2026-01-06T13:30:11,003 creating build/lib/unitxt/catalog/recipes/torr/qtsumm/html 2026-01-06T13:30:11,004 copying src/unitxt/catalog/recipes/torr/qtsumm/html/shuffle_rows_augmentation_5_demos.json -> build/lib/unitxt/catalog/recipes/torr/qtsumm/html 2026-01-06T13:30:11,007 copying src/unitxt/catalog/recipes/torr/qtsumm/html/no_augmentation_5_demos.json -> build/lib/unitxt/catalog/recipes/torr/qtsumm/html 2026-01-06T13:30:11,009 copying src/unitxt/catalog/recipes/torr/qtsumm/html/insert_empty_rows_augmentation_5_demos.json -> build/lib/unitxt/catalog/recipes/torr/qtsumm/html 2026-01-06T13:30:11,011 copying src/unitxt/catalog/recipes/torr/qtsumm/html/transpose_augmentation_5_demos.json -> build/lib/unitxt/catalog/recipes/torr/qtsumm/html 2026-01-06T13:30:11,013 copying src/unitxt/catalog/recipes/torr/qtsumm/html/shuffle_cols_augmentation_5_demos.json -> build/lib/unitxt/catalog/recipes/torr/qtsumm/html 2026-01-06T13:30:11,015 creating build/lib/unitxt/catalog/recipes/torr/qtsumm/json 2026-01-06T13:30:11,016 copying src/unitxt/catalog/recipes/torr/qtsumm/json/shuffle_rows_augmentation_5_demos.json -> build/lib/unitxt/catalog/recipes/torr/qtsumm/json 2026-01-06T13:30:11,018 copying src/unitxt/catalog/recipes/torr/qtsumm/json/no_augmentation_5_demos.json -> build/lib/unitxt/catalog/recipes/torr/qtsumm/json 2026-01-06T13:30:11,020 copying src/unitxt/catalog/recipes/torr/qtsumm/json/insert_empty_rows_augmentation_5_demos.json -> build/lib/unitxt/catalog/recipes/torr/qtsumm/json 2026-01-06T13:30:11,022 copying src/unitxt/catalog/recipes/torr/qtsumm/json/transpose_augmentation_5_demos.json -> build/lib/unitxt/catalog/recipes/torr/qtsumm/json 2026-01-06T13:30:11,024 copying src/unitxt/catalog/recipes/torr/qtsumm/json/shuffle_cols_augmentation_5_demos.json -> build/lib/unitxt/catalog/recipes/torr/qtsumm/json 2026-01-06T13:30:11,026 creating build/lib/unitxt/catalog/recipes/torr/qtsumm/markdown 2026-01-06T13:30:11,027 copying src/unitxt/catalog/recipes/torr/qtsumm/markdown/shuffle_rows_augmentation_5_demos.json -> build/lib/unitxt/catalog/recipes/torr/qtsumm/markdown 2026-01-06T13:30:11,029 copying src/unitxt/catalog/recipes/torr/qtsumm/markdown/no_augmentation_5_demos.json -> build/lib/unitxt/catalog/recipes/torr/qtsumm/markdown 2026-01-06T13:30:11,031 copying src/unitxt/catalog/recipes/torr/qtsumm/markdown/insert_empty_rows_augmentation_5_demos.json -> build/lib/unitxt/catalog/recipes/torr/qtsumm/markdown 2026-01-06T13:30:11,033 copying src/unitxt/catalog/recipes/torr/qtsumm/markdown/transpose_augmentation_5_demos.json -> build/lib/unitxt/catalog/recipes/torr/qtsumm/markdown 2026-01-06T13:30:11,035 copying src/unitxt/catalog/recipes/torr/qtsumm/markdown/shuffle_cols_augmentation_5_demos.json -> build/lib/unitxt/catalog/recipes/torr/qtsumm/markdown 2026-01-06T13:30:11,037 creating build/lib/unitxt/catalog/recipes/torr/qtsumm/indexed_row_major 2026-01-06T13:30:11,038 copying src/unitxt/catalog/recipes/torr/qtsumm/indexed_row_major/shuffle_rows_augmentation_5_demos.json -> build/lib/unitxt/catalog/recipes/torr/qtsumm/indexed_row_major 2026-01-06T13:30:11,040 copying src/unitxt/catalog/recipes/torr/qtsumm/indexed_row_major/no_augmentation_5_demos.json -> build/lib/unitxt/catalog/recipes/torr/qtsumm/indexed_row_major 2026-01-06T13:30:11,042 copying src/unitxt/catalog/recipes/torr/qtsumm/indexed_row_major/insert_empty_rows_augmentation_5_demos.json -> build/lib/unitxt/catalog/recipes/torr/qtsumm/indexed_row_major 2026-01-06T13:30:11,044 copying src/unitxt/catalog/recipes/torr/qtsumm/indexed_row_major/transpose_augmentation_5_demos.json -> build/lib/unitxt/catalog/recipes/torr/qtsumm/indexed_row_major 2026-01-06T13:30:11,046 copying src/unitxt/catalog/recipes/torr/qtsumm/indexed_row_major/shuffle_cols_augmentation_5_demos.json -> build/lib/unitxt/catalog/recipes/torr/qtsumm/indexed_row_major 2026-01-06T13:30:11,048 creating build/lib/unitxt/catalog/recipes/torr/tablebench_numerical_reasoning/df 2026-01-06T13:30:11,049 copying src/unitxt/catalog/recipes/torr/tablebench_numerical_reasoning/df/shuffle_rows_augmentation_5_demos.json -> build/lib/unitxt/catalog/recipes/torr/tablebench_numerical_reasoning/df 2026-01-06T13:30:11,051 copying src/unitxt/catalog/recipes/torr/tablebench_numerical_reasoning/df/no_augmentation_5_demos.json -> build/lib/unitxt/catalog/recipes/torr/tablebench_numerical_reasoning/df 2026-01-06T13:30:11,053 copying src/unitxt/catalog/recipes/torr/tablebench_numerical_reasoning/df/insert_empty_rows_augmentation_5_demos.json -> build/lib/unitxt/catalog/recipes/torr/tablebench_numerical_reasoning/df 2026-01-06T13:30:11,055 copying src/unitxt/catalog/recipes/torr/tablebench_numerical_reasoning/df/transpose_augmentation_5_demos.json -> build/lib/unitxt/catalog/recipes/torr/tablebench_numerical_reasoning/df 2026-01-06T13:30:11,057 copying src/unitxt/catalog/recipes/torr/tablebench_numerical_reasoning/df/shuffle_cols_augmentation_5_demos.json -> build/lib/unitxt/catalog/recipes/torr/tablebench_numerical_reasoning/df 2026-01-06T13:30:11,059 creating build/lib/unitxt/catalog/recipes/torr/tablebench_numerical_reasoning/csv 2026-01-06T13:30:11,060 copying src/unitxt/catalog/recipes/torr/tablebench_numerical_reasoning/csv/shuffle_rows_augmentation_5_demos.json -> build/lib/unitxt/catalog/recipes/torr/tablebench_numerical_reasoning/csv 2026-01-06T13:30:11,062 copying src/unitxt/catalog/recipes/torr/tablebench_numerical_reasoning/csv/no_augmentation_5_demos.json -> build/lib/unitxt/catalog/recipes/torr/tablebench_numerical_reasoning/csv 2026-01-06T13:30:11,064 copying src/unitxt/catalog/recipes/torr/tablebench_numerical_reasoning/csv/insert_empty_rows_augmentation_5_demos.json -> build/lib/unitxt/catalog/recipes/torr/tablebench_numerical_reasoning/csv 2026-01-06T13:30:11,066 copying src/unitxt/catalog/recipes/torr/tablebench_numerical_reasoning/csv/transpose_augmentation_5_demos.json -> build/lib/unitxt/catalog/recipes/torr/tablebench_numerical_reasoning/csv 2026-01-06T13:30:11,068 copying src/unitxt/catalog/recipes/torr/tablebench_numerical_reasoning/csv/shuffle_cols_augmentation_5_demos.json -> build/lib/unitxt/catalog/recipes/torr/tablebench_numerical_reasoning/csv 2026-01-06T13:30:11,070 creating build/lib/unitxt/catalog/recipes/torr/tablebench_numerical_reasoning/concat 2026-01-06T13:30:11,071 copying src/unitxt/catalog/recipes/torr/tablebench_numerical_reasoning/concat/shuffle_rows_augmentation_5_demos.json -> build/lib/unitxt/catalog/recipes/torr/tablebench_numerical_reasoning/concat 2026-01-06T13:30:11,074 copying src/unitxt/catalog/recipes/torr/tablebench_numerical_reasoning/concat/no_augmentation_5_demos.json -> build/lib/unitxt/catalog/recipes/torr/tablebench_numerical_reasoning/concat 2026-01-06T13:30:11,076 copying src/unitxt/catalog/recipes/torr/tablebench_numerical_reasoning/concat/insert_empty_rows_augmentation_5_demos.json -> build/lib/unitxt/catalog/recipes/torr/tablebench_numerical_reasoning/concat 2026-01-06T13:30:11,077 copying src/unitxt/catalog/recipes/torr/tablebench_numerical_reasoning/concat/transpose_augmentation_5_demos.json -> build/lib/unitxt/catalog/recipes/torr/tablebench_numerical_reasoning/concat 2026-01-06T13:30:11,080 copying src/unitxt/catalog/recipes/torr/tablebench_numerical_reasoning/concat/shuffle_cols_augmentation_5_demos.json -> build/lib/unitxt/catalog/recipes/torr/tablebench_numerical_reasoning/concat 2026-01-06T13:30:11,082 creating build/lib/unitxt/catalog/recipes/torr/tablebench_numerical_reasoning/html 2026-01-06T13:30:11,082 copying src/unitxt/catalog/recipes/torr/tablebench_numerical_reasoning/html/shuffle_rows_augmentation_5_demos.json -> build/lib/unitxt/catalog/recipes/torr/tablebench_numerical_reasoning/html 2026-01-06T13:30:11,085 copying src/unitxt/catalog/recipes/torr/tablebench_numerical_reasoning/html/no_augmentation_5_demos.json -> build/lib/unitxt/catalog/recipes/torr/tablebench_numerical_reasoning/html 2026-01-06T13:30:11,087 copying src/unitxt/catalog/recipes/torr/tablebench_numerical_reasoning/html/insert_empty_rows_augmentation_5_demos.json -> build/lib/unitxt/catalog/recipes/torr/tablebench_numerical_reasoning/html 2026-01-06T13:30:11,089 copying src/unitxt/catalog/recipes/torr/tablebench_numerical_reasoning/html/transpose_augmentation_5_demos.json -> build/lib/unitxt/catalog/recipes/torr/tablebench_numerical_reasoning/html 2026-01-06T13:30:11,091 copying src/unitxt/catalog/recipes/torr/tablebench_numerical_reasoning/html/shuffle_cols_augmentation_5_demos.json -> build/lib/unitxt/catalog/recipes/torr/tablebench_numerical_reasoning/html 2026-01-06T13:30:11,093 creating build/lib/unitxt/catalog/recipes/torr/tablebench_numerical_reasoning/json 2026-01-06T13:30:11,094 copying src/unitxt/catalog/recipes/torr/tablebench_numerical_reasoning/json/shuffle_rows_augmentation_5_demos.json -> build/lib/unitxt/catalog/recipes/torr/tablebench_numerical_reasoning/json 2026-01-06T13:30:11,096 copying src/unitxt/catalog/recipes/torr/tablebench_numerical_reasoning/json/no_augmentation_5_demos.json -> build/lib/unitxt/catalog/recipes/torr/tablebench_numerical_reasoning/json 2026-01-06T13:30:11,098 copying src/unitxt/catalog/recipes/torr/tablebench_numerical_reasoning/json/insert_empty_rows_augmentation_5_demos.json -> build/lib/unitxt/catalog/recipes/torr/tablebench_numerical_reasoning/json 2026-01-06T13:30:11,100 copying src/unitxt/catalog/recipes/torr/tablebench_numerical_reasoning/json/transpose_augmentation_5_demos.json -> build/lib/unitxt/catalog/recipes/torr/tablebench_numerical_reasoning/json 2026-01-06T13:30:11,102 copying src/unitxt/catalog/recipes/torr/tablebench_numerical_reasoning/json/shuffle_cols_augmentation_5_demos.json -> build/lib/unitxt/catalog/recipes/torr/tablebench_numerical_reasoning/json 2026-01-06T13:30:11,104 creating build/lib/unitxt/catalog/recipes/torr/tablebench_numerical_reasoning/markdown 2026-01-06T13:30:11,105 copying src/unitxt/catalog/recipes/torr/tablebench_numerical_reasoning/markdown/shuffle_rows_augmentation_5_demos.json -> build/lib/unitxt/catalog/recipes/torr/tablebench_numerical_reasoning/markdown 2026-01-06T13:30:11,108 copying src/unitxt/catalog/recipes/torr/tablebench_numerical_reasoning/markdown/no_augmentation_5_demos.json -> build/lib/unitxt/catalog/recipes/torr/tablebench_numerical_reasoning/markdown 2026-01-06T13:30:11,110 copying src/unitxt/catalog/recipes/torr/tablebench_numerical_reasoning/markdown/insert_empty_rows_augmentation_5_demos.json -> build/lib/unitxt/catalog/recipes/torr/tablebench_numerical_reasoning/markdown 2026-01-06T13:30:11,112 copying src/unitxt/catalog/recipes/torr/tablebench_numerical_reasoning/markdown/transpose_augmentation_5_demos.json -> build/lib/unitxt/catalog/recipes/torr/tablebench_numerical_reasoning/markdown 2026-01-06T13:30:11,114 copying src/unitxt/catalog/recipes/torr/tablebench_numerical_reasoning/markdown/shuffle_cols_augmentation_5_demos.json -> build/lib/unitxt/catalog/recipes/torr/tablebench_numerical_reasoning/markdown 2026-01-06T13:30:11,116 creating build/lib/unitxt/catalog/recipes/torr/tablebench_numerical_reasoning/indexed_row_major 2026-01-06T13:30:11,116 copying src/unitxt/catalog/recipes/torr/tablebench_numerical_reasoning/indexed_row_major/shuffle_rows_augmentation_5_demos.json -> build/lib/unitxt/catalog/recipes/torr/tablebench_numerical_reasoning/indexed_row_major 2026-01-06T13:30:11,119 copying src/unitxt/catalog/recipes/torr/tablebench_numerical_reasoning/indexed_row_major/no_augmentation_5_demos.json -> build/lib/unitxt/catalog/recipes/torr/tablebench_numerical_reasoning/indexed_row_major 2026-01-06T13:30:11,121 copying src/unitxt/catalog/recipes/torr/tablebench_numerical_reasoning/indexed_row_major/insert_empty_rows_augmentation_5_demos.json -> build/lib/unitxt/catalog/recipes/torr/tablebench_numerical_reasoning/indexed_row_major 2026-01-06T13:30:11,123 copying src/unitxt/catalog/recipes/torr/tablebench_numerical_reasoning/indexed_row_major/transpose_augmentation_5_demos.json -> build/lib/unitxt/catalog/recipes/torr/tablebench_numerical_reasoning/indexed_row_major 2026-01-06T13:30:11,125 copying src/unitxt/catalog/recipes/torr/tablebench_numerical_reasoning/indexed_row_major/shuffle_cols_augmentation_5_demos.json -> build/lib/unitxt/catalog/recipes/torr/tablebench_numerical_reasoning/indexed_row_major 2026-01-06T13:30:11,127 creating build/lib/unitxt/catalog/recipes/torr/numeric_nlg/df 2026-01-06T13:30:11,128 copying src/unitxt/catalog/recipes/torr/numeric_nlg/df/shuffle_rows_augmentation_5_demos.json -> build/lib/unitxt/catalog/recipes/torr/numeric_nlg/df 2026-01-06T13:30:11,130 copying src/unitxt/catalog/recipes/torr/numeric_nlg/df/no_augmentation_5_demos.json -> build/lib/unitxt/catalog/recipes/torr/numeric_nlg/df 2026-01-06T13:30:11,133 copying src/unitxt/catalog/recipes/torr/numeric_nlg/df/insert_empty_rows_augmentation_5_demos.json -> build/lib/unitxt/catalog/recipes/torr/numeric_nlg/df 2026-01-06T13:30:11,135 copying src/unitxt/catalog/recipes/torr/numeric_nlg/df/transpose_augmentation_5_demos.json -> build/lib/unitxt/catalog/recipes/torr/numeric_nlg/df 2026-01-06T13:30:11,137 copying src/unitxt/catalog/recipes/torr/numeric_nlg/df/shuffle_cols_augmentation_5_demos.json -> build/lib/unitxt/catalog/recipes/torr/numeric_nlg/df 2026-01-06T13:30:11,139 creating build/lib/unitxt/catalog/recipes/torr/numeric_nlg/csv 2026-01-06T13:30:11,140 copying src/unitxt/catalog/recipes/torr/numeric_nlg/csv/shuffle_rows_augmentation_5_demos.json -> build/lib/unitxt/catalog/recipes/torr/numeric_nlg/csv 2026-01-06T13:30:11,142 copying src/unitxt/catalog/recipes/torr/numeric_nlg/csv/no_augmentation_5_demos.json -> build/lib/unitxt/catalog/recipes/torr/numeric_nlg/csv 2026-01-06T13:30:11,144 copying src/unitxt/catalog/recipes/torr/numeric_nlg/csv/insert_empty_rows_augmentation_5_demos.json -> build/lib/unitxt/catalog/recipes/torr/numeric_nlg/csv 2026-01-06T13:30:11,146 copying src/unitxt/catalog/recipes/torr/numeric_nlg/csv/transpose_augmentation_5_demos.json -> build/lib/unitxt/catalog/recipes/torr/numeric_nlg/csv 2026-01-06T13:30:11,149 copying src/unitxt/catalog/recipes/torr/numeric_nlg/csv/shuffle_cols_augmentation_5_demos.json -> build/lib/unitxt/catalog/recipes/torr/numeric_nlg/csv 2026-01-06T13:30:11,151 creating build/lib/unitxt/catalog/recipes/torr/numeric_nlg/concat 2026-01-06T13:30:11,151 copying src/unitxt/catalog/recipes/torr/numeric_nlg/concat/shuffle_rows_augmentation_5_demos.json -> build/lib/unitxt/catalog/recipes/torr/numeric_nlg/concat 2026-01-06T13:30:11,154 copying src/unitxt/catalog/recipes/torr/numeric_nlg/concat/no_augmentation_5_demos.json -> build/lib/unitxt/catalog/recipes/torr/numeric_nlg/concat 2026-01-06T13:30:11,156 copying src/unitxt/catalog/recipes/torr/numeric_nlg/concat/insert_empty_rows_augmentation_5_demos.json -> build/lib/unitxt/catalog/recipes/torr/numeric_nlg/concat 2026-01-06T13:30:11,158 copying src/unitxt/catalog/recipes/torr/numeric_nlg/concat/transpose_augmentation_5_demos.json -> build/lib/unitxt/catalog/recipes/torr/numeric_nlg/concat 2026-01-06T13:30:11,160 copying src/unitxt/catalog/recipes/torr/numeric_nlg/concat/shuffle_cols_augmentation_5_demos.json -> build/lib/unitxt/catalog/recipes/torr/numeric_nlg/concat 2026-01-06T13:30:11,162 creating build/lib/unitxt/catalog/recipes/torr/numeric_nlg/html 2026-01-06T13:30:11,163 copying src/unitxt/catalog/recipes/torr/numeric_nlg/html/shuffle_rows_augmentation_5_demos.json -> build/lib/unitxt/catalog/recipes/torr/numeric_nlg/html 2026-01-06T13:30:11,165 copying src/unitxt/catalog/recipes/torr/numeric_nlg/html/no_augmentation_5_demos.json -> build/lib/unitxt/catalog/recipes/torr/numeric_nlg/html 2026-01-06T13:30:11,167 copying src/unitxt/catalog/recipes/torr/numeric_nlg/html/insert_empty_rows_augmentation_5_demos.json -> build/lib/unitxt/catalog/recipes/torr/numeric_nlg/html 2026-01-06T13:30:11,169 copying src/unitxt/catalog/recipes/torr/numeric_nlg/html/transpose_augmentation_5_demos.json -> build/lib/unitxt/catalog/recipes/torr/numeric_nlg/html 2026-01-06T13:30:11,171 copying src/unitxt/catalog/recipes/torr/numeric_nlg/html/shuffle_cols_augmentation_5_demos.json -> build/lib/unitxt/catalog/recipes/torr/numeric_nlg/html 2026-01-06T13:30:11,173 creating build/lib/unitxt/catalog/recipes/torr/numeric_nlg/json 2026-01-06T13:30:11,174 copying src/unitxt/catalog/recipes/torr/numeric_nlg/json/shuffle_rows_augmentation_5_demos.json -> build/lib/unitxt/catalog/recipes/torr/numeric_nlg/json 2026-01-06T13:30:11,176 copying src/unitxt/catalog/recipes/torr/numeric_nlg/json/no_augmentation_5_demos.json -> build/lib/unitxt/catalog/recipes/torr/numeric_nlg/json 2026-01-06T13:30:11,178 copying src/unitxt/catalog/recipes/torr/numeric_nlg/json/insert_empty_rows_augmentation_5_demos.json -> build/lib/unitxt/catalog/recipes/torr/numeric_nlg/json 2026-01-06T13:30:11,180 copying src/unitxt/catalog/recipes/torr/numeric_nlg/json/transpose_augmentation_5_demos.json -> build/lib/unitxt/catalog/recipes/torr/numeric_nlg/json 2026-01-06T13:30:11,182 copying src/unitxt/catalog/recipes/torr/numeric_nlg/json/shuffle_cols_augmentation_5_demos.json -> build/lib/unitxt/catalog/recipes/torr/numeric_nlg/json 2026-01-06T13:30:11,184 creating build/lib/unitxt/catalog/recipes/torr/numeric_nlg/markdown 2026-01-06T13:30:11,185 copying src/unitxt/catalog/recipes/torr/numeric_nlg/markdown/shuffle_rows_augmentation_5_demos.json -> build/lib/unitxt/catalog/recipes/torr/numeric_nlg/markdown 2026-01-06T13:30:11,188 copying src/unitxt/catalog/recipes/torr/numeric_nlg/markdown/no_augmentation_5_demos.json -> build/lib/unitxt/catalog/recipes/torr/numeric_nlg/markdown 2026-01-06T13:30:11,190 copying src/unitxt/catalog/recipes/torr/numeric_nlg/markdown/insert_empty_rows_augmentation_5_demos.json -> build/lib/unitxt/catalog/recipes/torr/numeric_nlg/markdown 2026-01-06T13:30:11,192 copying src/unitxt/catalog/recipes/torr/numeric_nlg/markdown/transpose_augmentation_5_demos.json -> build/lib/unitxt/catalog/recipes/torr/numeric_nlg/markdown 2026-01-06T13:30:11,194 copying src/unitxt/catalog/recipes/torr/numeric_nlg/markdown/shuffle_cols_augmentation_5_demos.json -> build/lib/unitxt/catalog/recipes/torr/numeric_nlg/markdown 2026-01-06T13:30:11,196 creating build/lib/unitxt/catalog/recipes/torr/numeric_nlg/indexed_row_major 2026-01-06T13:30:11,197 copying src/unitxt/catalog/recipes/torr/numeric_nlg/indexed_row_major/shuffle_rows_augmentation_5_demos.json -> build/lib/unitxt/catalog/recipes/torr/numeric_nlg/indexed_row_major 2026-01-06T13:30:11,199 copying src/unitxt/catalog/recipes/torr/numeric_nlg/indexed_row_major/no_augmentation_5_demos.json -> build/lib/unitxt/catalog/recipes/torr/numeric_nlg/indexed_row_major 2026-01-06T13:30:11,201 copying src/unitxt/catalog/recipes/torr/numeric_nlg/indexed_row_major/insert_empty_rows_augmentation_5_demos.json -> build/lib/unitxt/catalog/recipes/torr/numeric_nlg/indexed_row_major 2026-01-06T13:30:11,203 copying src/unitxt/catalog/recipes/torr/numeric_nlg/indexed_row_major/transpose_augmentation_5_demos.json -> build/lib/unitxt/catalog/recipes/torr/numeric_nlg/indexed_row_major 2026-01-06T13:30:11,205 copying src/unitxt/catalog/recipes/torr/numeric_nlg/indexed_row_major/shuffle_cols_augmentation_5_demos.json -> build/lib/unitxt/catalog/recipes/torr/numeric_nlg/indexed_row_major 2026-01-06T13:30:11,207 creating build/lib/unitxt/catalog/recipes/torr/tab_fact/df 2026-01-06T13:30:11,209 copying src/unitxt/catalog/recipes/torr/tab_fact/df/shuffle_rows_augmentation_5_demos.json -> build/lib/unitxt/catalog/recipes/torr/tab_fact/df 2026-01-06T13:30:11,211 copying src/unitxt/catalog/recipes/torr/tab_fact/df/no_augmentation_5_demos.json -> build/lib/unitxt/catalog/recipes/torr/tab_fact/df 2026-01-06T13:30:11,213 copying src/unitxt/catalog/recipes/torr/tab_fact/df/insert_empty_rows_augmentation_5_demos.json -> build/lib/unitxt/catalog/recipes/torr/tab_fact/df 2026-01-06T13:30:11,215 copying src/unitxt/catalog/recipes/torr/tab_fact/df/transpose_augmentation_5_demos.json -> build/lib/unitxt/catalog/recipes/torr/tab_fact/df 2026-01-06T13:30:11,217 copying src/unitxt/catalog/recipes/torr/tab_fact/df/shuffle_cols_augmentation_5_demos.json -> build/lib/unitxt/catalog/recipes/torr/tab_fact/df 2026-01-06T13:30:11,219 creating build/lib/unitxt/catalog/recipes/torr/tab_fact/csv 2026-01-06T13:30:11,220 copying src/unitxt/catalog/recipes/torr/tab_fact/csv/shuffle_rows_augmentation_5_demos.json -> build/lib/unitxt/catalog/recipes/torr/tab_fact/csv 2026-01-06T13:30:11,222 copying src/unitxt/catalog/recipes/torr/tab_fact/csv/no_augmentation_5_demos.json -> build/lib/unitxt/catalog/recipes/torr/tab_fact/csv 2026-01-06T13:30:11,224 copying src/unitxt/catalog/recipes/torr/tab_fact/csv/insert_empty_rows_augmentation_5_demos.json -> build/lib/unitxt/catalog/recipes/torr/tab_fact/csv 2026-01-06T13:30:11,226 copying src/unitxt/catalog/recipes/torr/tab_fact/csv/transpose_augmentation_5_demos.json -> build/lib/unitxt/catalog/recipes/torr/tab_fact/csv 2026-01-06T13:30:11,228 copying src/unitxt/catalog/recipes/torr/tab_fact/csv/shuffle_cols_augmentation_5_demos.json -> build/lib/unitxt/catalog/recipes/torr/tab_fact/csv 2026-01-06T13:30:11,230 creating build/lib/unitxt/catalog/recipes/torr/tab_fact/concat 2026-01-06T13:30:11,231 copying src/unitxt/catalog/recipes/torr/tab_fact/concat/shuffle_rows_augmentation_5_demos.json -> build/lib/unitxt/catalog/recipes/torr/tab_fact/concat 2026-01-06T13:30:11,233 copying src/unitxt/catalog/recipes/torr/tab_fact/concat/no_augmentation_5_demos.json -> build/lib/unitxt/catalog/recipes/torr/tab_fact/concat 2026-01-06T13:30:11,236 copying src/unitxt/catalog/recipes/torr/tab_fact/concat/insert_empty_rows_augmentation_5_demos.json -> build/lib/unitxt/catalog/recipes/torr/tab_fact/concat 2026-01-06T13:30:11,238 copying src/unitxt/catalog/recipes/torr/tab_fact/concat/transpose_augmentation_5_demos.json -> build/lib/unitxt/catalog/recipes/torr/tab_fact/concat 2026-01-06T13:30:11,240 copying src/unitxt/catalog/recipes/torr/tab_fact/concat/shuffle_cols_augmentation_5_demos.json -> build/lib/unitxt/catalog/recipes/torr/tab_fact/concat 2026-01-06T13:30:11,242 creating build/lib/unitxt/catalog/recipes/torr/tab_fact/html 2026-01-06T13:30:11,243 copying src/unitxt/catalog/recipes/torr/tab_fact/html/shuffle_rows_augmentation_5_demos.json -> build/lib/unitxt/catalog/recipes/torr/tab_fact/html 2026-01-06T13:30:11,245 copying src/unitxt/catalog/recipes/torr/tab_fact/html/no_augmentation_5_demos.json -> build/lib/unitxt/catalog/recipes/torr/tab_fact/html 2026-01-06T13:30:11,247 copying src/unitxt/catalog/recipes/torr/tab_fact/html/insert_empty_rows_augmentation_5_demos.json -> build/lib/unitxt/catalog/recipes/torr/tab_fact/html 2026-01-06T13:30:11,249 copying src/unitxt/catalog/recipes/torr/tab_fact/html/transpose_augmentation_5_demos.json -> build/lib/unitxt/catalog/recipes/torr/tab_fact/html 2026-01-06T13:30:11,251 copying src/unitxt/catalog/recipes/torr/tab_fact/html/shuffle_cols_augmentation_5_demos.json -> build/lib/unitxt/catalog/recipes/torr/tab_fact/html 2026-01-06T13:30:11,253 creating build/lib/unitxt/catalog/recipes/torr/tab_fact/json 2026-01-06T13:30:11,254 copying src/unitxt/catalog/recipes/torr/tab_fact/json/shuffle_rows_augmentation_5_demos.json -> build/lib/unitxt/catalog/recipes/torr/tab_fact/json 2026-01-06T13:30:11,256 copying src/unitxt/catalog/recipes/torr/tab_fact/json/no_augmentation_5_demos.json -> build/lib/unitxt/catalog/recipes/torr/tab_fact/json 2026-01-06T13:30:11,258 copying src/unitxt/catalog/recipes/torr/tab_fact/json/insert_empty_rows_augmentation_5_demos.json -> build/lib/unitxt/catalog/recipes/torr/tab_fact/json 2026-01-06T13:30:11,260 copying src/unitxt/catalog/recipes/torr/tab_fact/json/transpose_augmentation_5_demos.json -> build/lib/unitxt/catalog/recipes/torr/tab_fact/json 2026-01-06T13:30:11,262 copying src/unitxt/catalog/recipes/torr/tab_fact/json/shuffle_cols_augmentation_5_demos.json -> build/lib/unitxt/catalog/recipes/torr/tab_fact/json 2026-01-06T13:30:11,264 creating build/lib/unitxt/catalog/recipes/torr/tab_fact/markdown 2026-01-06T13:30:11,265 copying src/unitxt/catalog/recipes/torr/tab_fact/markdown/shuffle_rows_augmentation_5_demos.json -> build/lib/unitxt/catalog/recipes/torr/tab_fact/markdown 2026-01-06T13:30:11,267 copying src/unitxt/catalog/recipes/torr/tab_fact/markdown/no_augmentation_5_demos.json -> build/lib/unitxt/catalog/recipes/torr/tab_fact/markdown 2026-01-06T13:30:11,269 copying src/unitxt/catalog/recipes/torr/tab_fact/markdown/insert_empty_rows_augmentation_5_demos.json -> build/lib/unitxt/catalog/recipes/torr/tab_fact/markdown 2026-01-06T13:30:11,271 copying src/unitxt/catalog/recipes/torr/tab_fact/markdown/transpose_augmentation_5_demos.json -> build/lib/unitxt/catalog/recipes/torr/tab_fact/markdown 2026-01-06T13:30:11,274 copying src/unitxt/catalog/recipes/torr/tab_fact/markdown/shuffle_cols_augmentation_5_demos.json -> build/lib/unitxt/catalog/recipes/torr/tab_fact/markdown 2026-01-06T13:30:11,276 creating build/lib/unitxt/catalog/recipes/torr/tab_fact/indexed_row_major 2026-01-06T13:30:11,276 copying src/unitxt/catalog/recipes/torr/tab_fact/indexed_row_major/shuffle_rows_augmentation_5_demos.json -> build/lib/unitxt/catalog/recipes/torr/tab_fact/indexed_row_major 2026-01-06T13:30:11,279 copying src/unitxt/catalog/recipes/torr/tab_fact/indexed_row_major/no_augmentation_5_demos.json -> build/lib/unitxt/catalog/recipes/torr/tab_fact/indexed_row_major 2026-01-06T13:30:11,281 copying src/unitxt/catalog/recipes/torr/tab_fact/indexed_row_major/insert_empty_rows_augmentation_5_demos.json -> build/lib/unitxt/catalog/recipes/torr/tab_fact/indexed_row_major 2026-01-06T13:30:11,283 copying src/unitxt/catalog/recipes/torr/tab_fact/indexed_row_major/transpose_augmentation_5_demos.json -> build/lib/unitxt/catalog/recipes/torr/tab_fact/indexed_row_major 2026-01-06T13:30:11,285 copying src/unitxt/catalog/recipes/torr/tab_fact/indexed_row_major/shuffle_cols_augmentation_5_demos.json -> build/lib/unitxt/catalog/recipes/torr/tab_fact/indexed_row_major 2026-01-06T13:30:11,287 creating build/lib/unitxt/catalog/recipes/torr/tablebench_data_analysis/df 2026-01-06T13:30:11,289 copying src/unitxt/catalog/recipes/torr/tablebench_data_analysis/df/shuffle_rows_augmentation_5_demos.json -> build/lib/unitxt/catalog/recipes/torr/tablebench_data_analysis/df 2026-01-06T13:30:11,291 copying src/unitxt/catalog/recipes/torr/tablebench_data_analysis/df/no_augmentation_5_demos.json -> build/lib/unitxt/catalog/recipes/torr/tablebench_data_analysis/df 2026-01-06T13:30:11,293 copying src/unitxt/catalog/recipes/torr/tablebench_data_analysis/df/insert_empty_rows_augmentation_5_demos.json -> build/lib/unitxt/catalog/recipes/torr/tablebench_data_analysis/df 2026-01-06T13:30:11,295 copying src/unitxt/catalog/recipes/torr/tablebench_data_analysis/df/transpose_augmentation_5_demos.json -> build/lib/unitxt/catalog/recipes/torr/tablebench_data_analysis/df 2026-01-06T13:30:11,297 copying src/unitxt/catalog/recipes/torr/tablebench_data_analysis/df/shuffle_cols_augmentation_5_demos.json -> build/lib/unitxt/catalog/recipes/torr/tablebench_data_analysis/df 2026-01-06T13:30:11,299 creating build/lib/unitxt/catalog/recipes/torr/tablebench_data_analysis/csv 2026-01-06T13:30:11,300 copying src/unitxt/catalog/recipes/torr/tablebench_data_analysis/csv/shuffle_rows_augmentation_5_demos.json -> build/lib/unitxt/catalog/recipes/torr/tablebench_data_analysis/csv 2026-01-06T13:30:11,302 copying src/unitxt/catalog/recipes/torr/tablebench_data_analysis/csv/no_augmentation_5_demos.json -> build/lib/unitxt/catalog/recipes/torr/tablebench_data_analysis/csv 2026-01-06T13:30:11,304 copying src/unitxt/catalog/recipes/torr/tablebench_data_analysis/csv/insert_empty_rows_augmentation_5_demos.json -> build/lib/unitxt/catalog/recipes/torr/tablebench_data_analysis/csv 2026-01-06T13:30:11,306 copying src/unitxt/catalog/recipes/torr/tablebench_data_analysis/csv/transpose_augmentation_5_demos.json -> build/lib/unitxt/catalog/recipes/torr/tablebench_data_analysis/csv 2026-01-06T13:30:11,308 copying src/unitxt/catalog/recipes/torr/tablebench_data_analysis/csv/shuffle_cols_augmentation_5_demos.json -> build/lib/unitxt/catalog/recipes/torr/tablebench_data_analysis/csv 2026-01-06T13:30:11,310 creating build/lib/unitxt/catalog/recipes/torr/tablebench_data_analysis/concat 2026-01-06T13:30:11,311 copying src/unitxt/catalog/recipes/torr/tablebench_data_analysis/concat/shuffle_rows_augmentation_5_demos.json -> build/lib/unitxt/catalog/recipes/torr/tablebench_data_analysis/concat 2026-01-06T13:30:11,313 copying src/unitxt/catalog/recipes/torr/tablebench_data_analysis/concat/no_augmentation_5_demos.json -> build/lib/unitxt/catalog/recipes/torr/tablebench_data_analysis/concat 2026-01-06T13:30:11,315 copying src/unitxt/catalog/recipes/torr/tablebench_data_analysis/concat/insert_empty_rows_augmentation_5_demos.json -> build/lib/unitxt/catalog/recipes/torr/tablebench_data_analysis/concat 2026-01-06T13:30:11,317 copying src/unitxt/catalog/recipes/torr/tablebench_data_analysis/concat/transpose_augmentation_5_demos.json -> build/lib/unitxt/catalog/recipes/torr/tablebench_data_analysis/concat 2026-01-06T13:30:11,319 copying src/unitxt/catalog/recipes/torr/tablebench_data_analysis/concat/shuffle_cols_augmentation_5_demos.json -> build/lib/unitxt/catalog/recipes/torr/tablebench_data_analysis/concat 2026-01-06T13:30:11,321 creating build/lib/unitxt/catalog/recipes/torr/tablebench_data_analysis/html 2026-01-06T13:30:11,322 copying src/unitxt/catalog/recipes/torr/tablebench_data_analysis/html/shuffle_rows_augmentation_5_demos.json -> build/lib/unitxt/catalog/recipes/torr/tablebench_data_analysis/html 2026-01-06T13:30:11,324 copying src/unitxt/catalog/recipes/torr/tablebench_data_analysis/html/no_augmentation_5_demos.json -> build/lib/unitxt/catalog/recipes/torr/tablebench_data_analysis/html 2026-01-06T13:30:11,326 copying src/unitxt/catalog/recipes/torr/tablebench_data_analysis/html/insert_empty_rows_augmentation_5_demos.json -> build/lib/unitxt/catalog/recipes/torr/tablebench_data_analysis/html 2026-01-06T13:30:11,328 copying src/unitxt/catalog/recipes/torr/tablebench_data_analysis/html/transpose_augmentation_5_demos.json -> build/lib/unitxt/catalog/recipes/torr/tablebench_data_analysis/html 2026-01-06T13:30:11,331 copying src/unitxt/catalog/recipes/torr/tablebench_data_analysis/html/shuffle_cols_augmentation_5_demos.json -> build/lib/unitxt/catalog/recipes/torr/tablebench_data_analysis/html 2026-01-06T13:30:11,333 creating build/lib/unitxt/catalog/recipes/torr/tablebench_data_analysis/json 2026-01-06T13:30:11,334 copying src/unitxt/catalog/recipes/torr/tablebench_data_analysis/json/shuffle_rows_augmentation_5_demos.json -> build/lib/unitxt/catalog/recipes/torr/tablebench_data_analysis/json 2026-01-06T13:30:11,336 copying src/unitxt/catalog/recipes/torr/tablebench_data_analysis/json/no_augmentation_5_demos.json -> build/lib/unitxt/catalog/recipes/torr/tablebench_data_analysis/json 2026-01-06T13:30:11,338 copying src/unitxt/catalog/recipes/torr/tablebench_data_analysis/json/insert_empty_rows_augmentation_5_demos.json -> build/lib/unitxt/catalog/recipes/torr/tablebench_data_analysis/json 2026-01-06T13:30:11,340 copying src/unitxt/catalog/recipes/torr/tablebench_data_analysis/json/transpose_augmentation_5_demos.json -> build/lib/unitxt/catalog/recipes/torr/tablebench_data_analysis/json 2026-01-06T13:30:11,342 copying src/unitxt/catalog/recipes/torr/tablebench_data_analysis/json/shuffle_cols_augmentation_5_demos.json -> build/lib/unitxt/catalog/recipes/torr/tablebench_data_analysis/json 2026-01-06T13:30:11,344 creating build/lib/unitxt/catalog/recipes/torr/tablebench_data_analysis/markdown 2026-01-06T13:30:11,345 copying src/unitxt/catalog/recipes/torr/tablebench_data_analysis/markdown/shuffle_rows_augmentation_5_demos.json -> build/lib/unitxt/catalog/recipes/torr/tablebench_data_analysis/markdown 2026-01-06T13:30:11,347 copying src/unitxt/catalog/recipes/torr/tablebench_data_analysis/markdown/no_augmentation_5_demos.json -> build/lib/unitxt/catalog/recipes/torr/tablebench_data_analysis/markdown 2026-01-06T13:30:11,349 copying src/unitxt/catalog/recipes/torr/tablebench_data_analysis/markdown/insert_empty_rows_augmentation_5_demos.json -> build/lib/unitxt/catalog/recipes/torr/tablebench_data_analysis/markdown 2026-01-06T13:30:11,351 copying src/unitxt/catalog/recipes/torr/tablebench_data_analysis/markdown/transpose_augmentation_5_demos.json -> build/lib/unitxt/catalog/recipes/torr/tablebench_data_analysis/markdown 2026-01-06T13:30:11,353 copying src/unitxt/catalog/recipes/torr/tablebench_data_analysis/markdown/shuffle_cols_augmentation_5_demos.json -> build/lib/unitxt/catalog/recipes/torr/tablebench_data_analysis/markdown 2026-01-06T13:30:11,355 creating build/lib/unitxt/catalog/recipes/torr/tablebench_data_analysis/indexed_row_major 2026-01-06T13:30:11,356 copying src/unitxt/catalog/recipes/torr/tablebench_data_analysis/indexed_row_major/shuffle_rows_augmentation_5_demos.json -> build/lib/unitxt/catalog/recipes/torr/tablebench_data_analysis/indexed_row_major 2026-01-06T13:30:11,358 copying src/unitxt/catalog/recipes/torr/tablebench_data_analysis/indexed_row_major/no_augmentation_5_demos.json -> build/lib/unitxt/catalog/recipes/torr/tablebench_data_analysis/indexed_row_major 2026-01-06T13:30:11,360 copying src/unitxt/catalog/recipes/torr/tablebench_data_analysis/indexed_row_major/insert_empty_rows_augmentation_5_demos.json -> build/lib/unitxt/catalog/recipes/torr/tablebench_data_analysis/indexed_row_major 2026-01-06T13:30:11,362 copying src/unitxt/catalog/recipes/torr/tablebench_data_analysis/indexed_row_major/transpose_augmentation_5_demos.json -> build/lib/unitxt/catalog/recipes/torr/tablebench_data_analysis/indexed_row_major 2026-01-06T13:30:11,364 copying src/unitxt/catalog/recipes/torr/tablebench_data_analysis/indexed_row_major/shuffle_cols_augmentation_5_demos.json -> build/lib/unitxt/catalog/recipes/torr/tablebench_data_analysis/indexed_row_major 2026-01-06T13:30:11,366 creating build/lib/unitxt/catalog/recipes/torr/scigen/df 2026-01-06T13:30:11,368 copying src/unitxt/catalog/recipes/torr/scigen/df/shuffle_rows_augmentation_5_demos.json -> build/lib/unitxt/catalog/recipes/torr/scigen/df 2026-01-06T13:30:11,370 copying src/unitxt/catalog/recipes/torr/scigen/df/no_augmentation_5_demos.json -> build/lib/unitxt/catalog/recipes/torr/scigen/df 2026-01-06T13:30:11,372 copying src/unitxt/catalog/recipes/torr/scigen/df/insert_empty_rows_augmentation_5_demos.json -> build/lib/unitxt/catalog/recipes/torr/scigen/df 2026-01-06T13:30:11,374 copying src/unitxt/catalog/recipes/torr/scigen/df/transpose_augmentation_5_demos.json -> build/lib/unitxt/catalog/recipes/torr/scigen/df 2026-01-06T13:30:11,376 copying src/unitxt/catalog/recipes/torr/scigen/df/shuffle_cols_augmentation_5_demos.json -> build/lib/unitxt/catalog/recipes/torr/scigen/df 2026-01-06T13:30:11,378 creating build/lib/unitxt/catalog/recipes/torr/scigen/csv 2026-01-06T13:30:11,379 copying src/unitxt/catalog/recipes/torr/scigen/csv/shuffle_rows_augmentation_5_demos.json -> build/lib/unitxt/catalog/recipes/torr/scigen/csv 2026-01-06T13:30:11,381 copying src/unitxt/catalog/recipes/torr/scigen/csv/no_augmentation_5_demos.json -> build/lib/unitxt/catalog/recipes/torr/scigen/csv 2026-01-06T13:30:11,383 copying src/unitxt/catalog/recipes/torr/scigen/csv/insert_empty_rows_augmentation_5_demos.json -> build/lib/unitxt/catalog/recipes/torr/scigen/csv 2026-01-06T13:30:11,385 copying src/unitxt/catalog/recipes/torr/scigen/csv/transpose_augmentation_5_demos.json -> build/lib/unitxt/catalog/recipes/torr/scigen/csv 2026-01-06T13:30:11,387 copying src/unitxt/catalog/recipes/torr/scigen/csv/shuffle_cols_augmentation_5_demos.json -> build/lib/unitxt/catalog/recipes/torr/scigen/csv 2026-01-06T13:30:11,389 creating build/lib/unitxt/catalog/recipes/torr/scigen/concat 2026-01-06T13:30:11,390 copying src/unitxt/catalog/recipes/torr/scigen/concat/shuffle_rows_augmentation_5_demos.json -> build/lib/unitxt/catalog/recipes/torr/scigen/concat 2026-01-06T13:30:11,392 copying src/unitxt/catalog/recipes/torr/scigen/concat/no_augmentation_5_demos.json -> build/lib/unitxt/catalog/recipes/torr/scigen/concat 2026-01-06T13:30:11,394 copying src/unitxt/catalog/recipes/torr/scigen/concat/insert_empty_rows_augmentation_5_demos.json -> build/lib/unitxt/catalog/recipes/torr/scigen/concat 2026-01-06T13:30:11,396 copying src/unitxt/catalog/recipes/torr/scigen/concat/transpose_augmentation_5_demos.json -> build/lib/unitxt/catalog/recipes/torr/scigen/concat 2026-01-06T13:30:11,398 copying src/unitxt/catalog/recipes/torr/scigen/concat/shuffle_cols_augmentation_5_demos.json -> build/lib/unitxt/catalog/recipes/torr/scigen/concat 2026-01-06T13:30:11,400 creating build/lib/unitxt/catalog/recipes/torr/scigen/html 2026-01-06T13:30:11,401 copying src/unitxt/catalog/recipes/torr/scigen/html/shuffle_rows_augmentation_5_demos.json -> build/lib/unitxt/catalog/recipes/torr/scigen/html 2026-01-06T13:30:11,403 copying src/unitxt/catalog/recipes/torr/scigen/html/no_augmentation_5_demos.json -> build/lib/unitxt/catalog/recipes/torr/scigen/html 2026-01-06T13:30:11,405 copying src/unitxt/catalog/recipes/torr/scigen/html/insert_empty_rows_augmentation_5_demos.json -> build/lib/unitxt/catalog/recipes/torr/scigen/html 2026-01-06T13:30:11,407 copying src/unitxt/catalog/recipes/torr/scigen/html/transpose_augmentation_5_demos.json -> build/lib/unitxt/catalog/recipes/torr/scigen/html 2026-01-06T13:30:11,409 copying src/unitxt/catalog/recipes/torr/scigen/html/shuffle_cols_augmentation_5_demos.json -> build/lib/unitxt/catalog/recipes/torr/scigen/html 2026-01-06T13:30:11,411 creating build/lib/unitxt/catalog/recipes/torr/scigen/json 2026-01-06T13:30:11,412 copying src/unitxt/catalog/recipes/torr/scigen/json/shuffle_rows_augmentation_5_demos.json -> build/lib/unitxt/catalog/recipes/torr/scigen/json 2026-01-06T13:30:11,414 copying src/unitxt/catalog/recipes/torr/scigen/json/no_augmentation_5_demos.json -> build/lib/unitxt/catalog/recipes/torr/scigen/json 2026-01-06T13:30:11,416 copying src/unitxt/catalog/recipes/torr/scigen/json/insert_empty_rows_augmentation_5_demos.json -> build/lib/unitxt/catalog/recipes/torr/scigen/json 2026-01-06T13:30:11,418 copying src/unitxt/catalog/recipes/torr/scigen/json/transpose_augmentation_5_demos.json -> build/lib/unitxt/catalog/recipes/torr/scigen/json 2026-01-06T13:30:11,420 copying src/unitxt/catalog/recipes/torr/scigen/json/shuffle_cols_augmentation_5_demos.json -> build/lib/unitxt/catalog/recipes/torr/scigen/json 2026-01-06T13:30:11,422 creating build/lib/unitxt/catalog/recipes/torr/scigen/markdown 2026-01-06T13:30:11,423 copying src/unitxt/catalog/recipes/torr/scigen/markdown/shuffle_rows_augmentation_5_demos.json -> build/lib/unitxt/catalog/recipes/torr/scigen/markdown 2026-01-06T13:30:11,426 copying src/unitxt/catalog/recipes/torr/scigen/markdown/no_augmentation_5_demos.json -> build/lib/unitxt/catalog/recipes/torr/scigen/markdown 2026-01-06T13:30:11,428 copying src/unitxt/catalog/recipes/torr/scigen/markdown/insert_empty_rows_augmentation_5_demos.json -> build/lib/unitxt/catalog/recipes/torr/scigen/markdown 2026-01-06T13:30:11,430 copying src/unitxt/catalog/recipes/torr/scigen/markdown/transpose_augmentation_5_demos.json -> build/lib/unitxt/catalog/recipes/torr/scigen/markdown 2026-01-06T13:30:11,432 copying src/unitxt/catalog/recipes/torr/scigen/markdown/shuffle_cols_augmentation_5_demos.json -> build/lib/unitxt/catalog/recipes/torr/scigen/markdown 2026-01-06T13:30:11,434 creating build/lib/unitxt/catalog/recipes/torr/scigen/indexed_row_major 2026-01-06T13:30:11,434 copying src/unitxt/catalog/recipes/torr/scigen/indexed_row_major/shuffle_rows_augmentation_5_demos.json -> build/lib/unitxt/catalog/recipes/torr/scigen/indexed_row_major 2026-01-06T13:30:11,437 copying src/unitxt/catalog/recipes/torr/scigen/indexed_row_major/no_augmentation_5_demos.json -> build/lib/unitxt/catalog/recipes/torr/scigen/indexed_row_major 2026-01-06T13:30:11,439 copying src/unitxt/catalog/recipes/torr/scigen/indexed_row_major/insert_empty_rows_augmentation_5_demos.json -> build/lib/unitxt/catalog/recipes/torr/scigen/indexed_row_major 2026-01-06T13:30:11,441 copying src/unitxt/catalog/recipes/torr/scigen/indexed_row_major/transpose_augmentation_5_demos.json -> build/lib/unitxt/catalog/recipes/torr/scigen/indexed_row_major 2026-01-06T13:30:11,443 copying src/unitxt/catalog/recipes/torr/scigen/indexed_row_major/shuffle_cols_augmentation_5_demos.json -> build/lib/unitxt/catalog/recipes/torr/scigen/indexed_row_major 2026-01-06T13:30:11,445 creating build/lib/unitxt/catalog/recipes/torr/fin_qa/df 2026-01-06T13:30:11,446 copying src/unitxt/catalog/recipes/torr/fin_qa/df/shuffle_rows_augmentation_5_demos.json -> build/lib/unitxt/catalog/recipes/torr/fin_qa/df 2026-01-06T13:30:11,449 copying src/unitxt/catalog/recipes/torr/fin_qa/df/no_augmentation_5_demos.json -> build/lib/unitxt/catalog/recipes/torr/fin_qa/df 2026-01-06T13:30:11,451 copying src/unitxt/catalog/recipes/torr/fin_qa/df/insert_empty_rows_augmentation_5_demos.json -> build/lib/unitxt/catalog/recipes/torr/fin_qa/df 2026-01-06T13:30:11,453 copying src/unitxt/catalog/recipes/torr/fin_qa/df/transpose_augmentation_5_demos.json -> build/lib/unitxt/catalog/recipes/torr/fin_qa/df 2026-01-06T13:30:11,455 copying src/unitxt/catalog/recipes/torr/fin_qa/df/shuffle_cols_augmentation_5_demos.json -> build/lib/unitxt/catalog/recipes/torr/fin_qa/df 2026-01-06T13:30:11,457 creating build/lib/unitxt/catalog/recipes/torr/fin_qa/csv 2026-01-06T13:30:11,458 copying src/unitxt/catalog/recipes/torr/fin_qa/csv/shuffle_rows_augmentation_5_demos.json -> build/lib/unitxt/catalog/recipes/torr/fin_qa/csv 2026-01-06T13:30:11,460 copying src/unitxt/catalog/recipes/torr/fin_qa/csv/no_augmentation_5_demos.json -> build/lib/unitxt/catalog/recipes/torr/fin_qa/csv 2026-01-06T13:30:11,463 copying src/unitxt/catalog/recipes/torr/fin_qa/csv/insert_empty_rows_augmentation_5_demos.json -> build/lib/unitxt/catalog/recipes/torr/fin_qa/csv 2026-01-06T13:30:11,465 copying src/unitxt/catalog/recipes/torr/fin_qa/csv/transpose_augmentation_5_demos.json -> build/lib/unitxt/catalog/recipes/torr/fin_qa/csv 2026-01-06T13:30:11,467 copying src/unitxt/catalog/recipes/torr/fin_qa/csv/shuffle_cols_augmentation_5_demos.json -> build/lib/unitxt/catalog/recipes/torr/fin_qa/csv 2026-01-06T13:30:11,470 creating build/lib/unitxt/catalog/recipes/torr/fin_qa/concat 2026-01-06T13:30:11,471 copying src/unitxt/catalog/recipes/torr/fin_qa/concat/shuffle_rows_augmentation_5_demos.json -> build/lib/unitxt/catalog/recipes/torr/fin_qa/concat 2026-01-06T13:30:11,473 copying src/unitxt/catalog/recipes/torr/fin_qa/concat/no_augmentation_5_demos.json -> build/lib/unitxt/catalog/recipes/torr/fin_qa/concat 2026-01-06T13:30:11,476 copying src/unitxt/catalog/recipes/torr/fin_qa/concat/insert_empty_rows_augmentation_5_demos.json -> build/lib/unitxt/catalog/recipes/torr/fin_qa/concat 2026-01-06T13:30:11,478 copying src/unitxt/catalog/recipes/torr/fin_qa/concat/transpose_augmentation_5_demos.json -> build/lib/unitxt/catalog/recipes/torr/fin_qa/concat 2026-01-06T13:30:11,480 copying src/unitxt/catalog/recipes/torr/fin_qa/concat/shuffle_cols_augmentation_5_demos.json -> build/lib/unitxt/catalog/recipes/torr/fin_qa/concat 2026-01-06T13:30:11,482 creating build/lib/unitxt/catalog/recipes/torr/fin_qa/html 2026-01-06T13:30:11,483 copying src/unitxt/catalog/recipes/torr/fin_qa/html/shuffle_rows_augmentation_5_demos.json -> build/lib/unitxt/catalog/recipes/torr/fin_qa/html 2026-01-06T13:30:11,485 copying src/unitxt/catalog/recipes/torr/fin_qa/html/no_augmentation_5_demos.json -> build/lib/unitxt/catalog/recipes/torr/fin_qa/html 2026-01-06T13:30:11,487 copying src/unitxt/catalog/recipes/torr/fin_qa/html/insert_empty_rows_augmentation_5_demos.json -> build/lib/unitxt/catalog/recipes/torr/fin_qa/html 2026-01-06T13:30:11,489 copying src/unitxt/catalog/recipes/torr/fin_qa/html/transpose_augmentation_5_demos.json -> build/lib/unitxt/catalog/recipes/torr/fin_qa/html 2026-01-06T13:30:11,491 copying src/unitxt/catalog/recipes/torr/fin_qa/html/shuffle_cols_augmentation_5_demos.json -> build/lib/unitxt/catalog/recipes/torr/fin_qa/html 2026-01-06T13:30:11,493 creating build/lib/unitxt/catalog/recipes/torr/fin_qa/json 2026-01-06T13:30:11,493 copying src/unitxt/catalog/recipes/torr/fin_qa/json/shuffle_rows_augmentation_5_demos.json -> build/lib/unitxt/catalog/recipes/torr/fin_qa/json 2026-01-06T13:30:11,496 copying src/unitxt/catalog/recipes/torr/fin_qa/json/no_augmentation_5_demos.json -> build/lib/unitxt/catalog/recipes/torr/fin_qa/json 2026-01-06T13:30:11,498 copying src/unitxt/catalog/recipes/torr/fin_qa/json/insert_empty_rows_augmentation_5_demos.json -> build/lib/unitxt/catalog/recipes/torr/fin_qa/json 2026-01-06T13:30:11,500 copying src/unitxt/catalog/recipes/torr/fin_qa/json/transpose_augmentation_5_demos.json -> build/lib/unitxt/catalog/recipes/torr/fin_qa/json 2026-01-06T13:30:11,502 copying src/unitxt/catalog/recipes/torr/fin_qa/json/shuffle_cols_augmentation_5_demos.json -> build/lib/unitxt/catalog/recipes/torr/fin_qa/json 2026-01-06T13:30:11,504 creating build/lib/unitxt/catalog/recipes/torr/fin_qa/markdown 2026-01-06T13:30:11,505 copying src/unitxt/catalog/recipes/torr/fin_qa/markdown/shuffle_rows_augmentation_5_demos.json -> build/lib/unitxt/catalog/recipes/torr/fin_qa/markdown 2026-01-06T13:30:11,507 copying src/unitxt/catalog/recipes/torr/fin_qa/markdown/no_augmentation_5_demos.json -> build/lib/unitxt/catalog/recipes/torr/fin_qa/markdown 2026-01-06T13:30:11,509 copying src/unitxt/catalog/recipes/torr/fin_qa/markdown/insert_empty_rows_augmentation_5_demos.json -> build/lib/unitxt/catalog/recipes/torr/fin_qa/markdown 2026-01-06T13:30:11,511 copying src/unitxt/catalog/recipes/torr/fin_qa/markdown/transpose_augmentation_5_demos.json -> build/lib/unitxt/catalog/recipes/torr/fin_qa/markdown 2026-01-06T13:30:11,513 copying src/unitxt/catalog/recipes/torr/fin_qa/markdown/shuffle_cols_augmentation_5_demos.json -> build/lib/unitxt/catalog/recipes/torr/fin_qa/markdown 2026-01-06T13:30:11,515 creating build/lib/unitxt/catalog/recipes/torr/fin_qa/indexed_row_major 2026-01-06T13:30:11,516 copying src/unitxt/catalog/recipes/torr/fin_qa/indexed_row_major/shuffle_rows_augmentation_5_demos.json -> build/lib/unitxt/catalog/recipes/torr/fin_qa/indexed_row_major 2026-01-06T13:30:11,519 copying src/unitxt/catalog/recipes/torr/fin_qa/indexed_row_major/no_augmentation_5_demos.json -> build/lib/unitxt/catalog/recipes/torr/fin_qa/indexed_row_major 2026-01-06T13:30:11,521 copying src/unitxt/catalog/recipes/torr/fin_qa/indexed_row_major/insert_empty_rows_augmentation_5_demos.json -> build/lib/unitxt/catalog/recipes/torr/fin_qa/indexed_row_major 2026-01-06T13:30:11,523 copying src/unitxt/catalog/recipes/torr/fin_qa/indexed_row_major/transpose_augmentation_5_demos.json -> build/lib/unitxt/catalog/recipes/torr/fin_qa/indexed_row_major 2026-01-06T13:30:11,525 copying src/unitxt/catalog/recipes/torr/fin_qa/indexed_row_major/shuffle_cols_augmentation_5_demos.json -> build/lib/unitxt/catalog/recipes/torr/fin_qa/indexed_row_major 2026-01-06T13:30:11,527 creating build/lib/unitxt/catalog/recipes/torr/turl_col_type/df 2026-01-06T13:30:11,528 copying src/unitxt/catalog/recipes/torr/turl_col_type/df/shuffle_rows_augmentation_5_demos.json -> build/lib/unitxt/catalog/recipes/torr/turl_col_type/df 2026-01-06T13:30:11,531 copying src/unitxt/catalog/recipes/torr/turl_col_type/df/no_augmentation_5_demos.json -> build/lib/unitxt/catalog/recipes/torr/turl_col_type/df 2026-01-06T13:30:11,533 copying src/unitxt/catalog/recipes/torr/turl_col_type/df/insert_empty_rows_augmentation_5_demos.json -> build/lib/unitxt/catalog/recipes/torr/turl_col_type/df 2026-01-06T13:30:11,535 copying src/unitxt/catalog/recipes/torr/turl_col_type/df/transpose_augmentation_5_demos.json -> build/lib/unitxt/catalog/recipes/torr/turl_col_type/df 2026-01-06T13:30:11,537 copying src/unitxt/catalog/recipes/torr/turl_col_type/df/shuffle_cols_augmentation_5_demos.json -> build/lib/unitxt/catalog/recipes/torr/turl_col_type/df 2026-01-06T13:30:11,539 creating build/lib/unitxt/catalog/recipes/torr/turl_col_type/csv 2026-01-06T13:30:11,540 copying src/unitxt/catalog/recipes/torr/turl_col_type/csv/shuffle_rows_augmentation_5_demos.json -> build/lib/unitxt/catalog/recipes/torr/turl_col_type/csv 2026-01-06T13:30:11,542 copying src/unitxt/catalog/recipes/torr/turl_col_type/csv/no_augmentation_5_demos.json -> build/lib/unitxt/catalog/recipes/torr/turl_col_type/csv 2026-01-06T13:30:11,544 copying src/unitxt/catalog/recipes/torr/turl_col_type/csv/insert_empty_rows_augmentation_5_demos.json -> build/lib/unitxt/catalog/recipes/torr/turl_col_type/csv 2026-01-06T13:30:11,546 copying src/unitxt/catalog/recipes/torr/turl_col_type/csv/transpose_augmentation_5_demos.json -> build/lib/unitxt/catalog/recipes/torr/turl_col_type/csv 2026-01-06T13:30:11,548 copying src/unitxt/catalog/recipes/torr/turl_col_type/csv/shuffle_cols_augmentation_5_demos.json -> build/lib/unitxt/catalog/recipes/torr/turl_col_type/csv 2026-01-06T13:30:11,550 creating build/lib/unitxt/catalog/recipes/torr/turl_col_type/concat 2026-01-06T13:30:11,551 copying src/unitxt/catalog/recipes/torr/turl_col_type/concat/shuffle_rows_augmentation_5_demos.json -> build/lib/unitxt/catalog/recipes/torr/turl_col_type/concat 2026-01-06T13:30:11,553 copying src/unitxt/catalog/recipes/torr/turl_col_type/concat/no_augmentation_5_demos.json -> build/lib/unitxt/catalog/recipes/torr/turl_col_type/concat 2026-01-06T13:30:11,556 copying src/unitxt/catalog/recipes/torr/turl_col_type/concat/insert_empty_rows_augmentation_5_demos.json -> build/lib/unitxt/catalog/recipes/torr/turl_col_type/concat 2026-01-06T13:30:11,558 copying src/unitxt/catalog/recipes/torr/turl_col_type/concat/transpose_augmentation_5_demos.json -> build/lib/unitxt/catalog/recipes/torr/turl_col_type/concat 2026-01-06T13:30:11,560 copying src/unitxt/catalog/recipes/torr/turl_col_type/concat/shuffle_cols_augmentation_5_demos.json -> build/lib/unitxt/catalog/recipes/torr/turl_col_type/concat 2026-01-06T13:30:11,562 creating build/lib/unitxt/catalog/recipes/torr/turl_col_type/html 2026-01-06T13:30:11,564 copying src/unitxt/catalog/recipes/torr/turl_col_type/html/shuffle_rows_augmentation_5_demos.json -> build/lib/unitxt/catalog/recipes/torr/turl_col_type/html 2026-01-06T13:30:11,566 copying src/unitxt/catalog/recipes/torr/turl_col_type/html/no_augmentation_5_demos.json -> build/lib/unitxt/catalog/recipes/torr/turl_col_type/html 2026-01-06T13:30:11,568 copying src/unitxt/catalog/recipes/torr/turl_col_type/html/insert_empty_rows_augmentation_5_demos.json -> build/lib/unitxt/catalog/recipes/torr/turl_col_type/html 2026-01-06T13:30:11,570 copying src/unitxt/catalog/recipes/torr/turl_col_type/html/transpose_augmentation_5_demos.json -> build/lib/unitxt/catalog/recipes/torr/turl_col_type/html 2026-01-06T13:30:11,572 copying src/unitxt/catalog/recipes/torr/turl_col_type/html/shuffle_cols_augmentation_5_demos.json -> build/lib/unitxt/catalog/recipes/torr/turl_col_type/html 2026-01-06T13:30:11,574 creating build/lib/unitxt/catalog/recipes/torr/turl_col_type/json 2026-01-06T13:30:11,575 copying src/unitxt/catalog/recipes/torr/turl_col_type/json/shuffle_rows_augmentation_5_demos.json -> build/lib/unitxt/catalog/recipes/torr/turl_col_type/json 2026-01-06T13:30:11,577 copying src/unitxt/catalog/recipes/torr/turl_col_type/json/no_augmentation_5_demos.json -> build/lib/unitxt/catalog/recipes/torr/turl_col_type/json 2026-01-06T13:30:11,579 copying src/unitxt/catalog/recipes/torr/turl_col_type/json/insert_empty_rows_augmentation_5_demos.json -> build/lib/unitxt/catalog/recipes/torr/turl_col_type/json 2026-01-06T13:30:11,581 copying src/unitxt/catalog/recipes/torr/turl_col_type/json/transpose_augmentation_5_demos.json -> build/lib/unitxt/catalog/recipes/torr/turl_col_type/json 2026-01-06T13:30:11,583 copying src/unitxt/catalog/recipes/torr/turl_col_type/json/shuffle_cols_augmentation_5_demos.json -> build/lib/unitxt/catalog/recipes/torr/turl_col_type/json 2026-01-06T13:30:11,585 creating build/lib/unitxt/catalog/recipes/torr/turl_col_type/markdown 2026-01-06T13:30:11,586 copying src/unitxt/catalog/recipes/torr/turl_col_type/markdown/shuffle_rows_augmentation_5_demos.json -> build/lib/unitxt/catalog/recipes/torr/turl_col_type/markdown 2026-01-06T13:30:11,588 copying src/unitxt/catalog/recipes/torr/turl_col_type/markdown/no_augmentation_5_demos.json -> build/lib/unitxt/catalog/recipes/torr/turl_col_type/markdown 2026-01-06T13:30:11,590 copying src/unitxt/catalog/recipes/torr/turl_col_type/markdown/insert_empty_rows_augmentation_5_demos.json -> build/lib/unitxt/catalog/recipes/torr/turl_col_type/markdown 2026-01-06T13:30:11,592 copying src/unitxt/catalog/recipes/torr/turl_col_type/markdown/transpose_augmentation_5_demos.json -> build/lib/unitxt/catalog/recipes/torr/turl_col_type/markdown 2026-01-06T13:30:11,595 copying src/unitxt/catalog/recipes/torr/turl_col_type/markdown/shuffle_cols_augmentation_5_demos.json -> build/lib/unitxt/catalog/recipes/torr/turl_col_type/markdown 2026-01-06T13:30:11,597 creating build/lib/unitxt/catalog/recipes/torr/turl_col_type/indexed_row_major 2026-01-06T13:30:11,598 copying src/unitxt/catalog/recipes/torr/turl_col_type/indexed_row_major/shuffle_rows_augmentation_5_demos.json -> build/lib/unitxt/catalog/recipes/torr/turl_col_type/indexed_row_major 2026-01-06T13:30:11,600 copying src/unitxt/catalog/recipes/torr/turl_col_type/indexed_row_major/no_augmentation_5_demos.json -> build/lib/unitxt/catalog/recipes/torr/turl_col_type/indexed_row_major 2026-01-06T13:30:11,602 copying src/unitxt/catalog/recipes/torr/turl_col_type/indexed_row_major/insert_empty_rows_augmentation_5_demos.json -> build/lib/unitxt/catalog/recipes/torr/turl_col_type/indexed_row_major 2026-01-06T13:30:11,604 copying src/unitxt/catalog/recipes/torr/turl_col_type/indexed_row_major/transpose_augmentation_5_demos.json -> build/lib/unitxt/catalog/recipes/torr/turl_col_type/indexed_row_major 2026-01-06T13:30:11,606 copying src/unitxt/catalog/recipes/torr/turl_col_type/indexed_row_major/shuffle_cols_augmentation_5_demos.json -> build/lib/unitxt/catalog/recipes/torr/turl_col_type/indexed_row_major 2026-01-06T13:30:11,608 creating build/lib/unitxt/catalog/recipes/bluebench/news_classification 2026-01-06T13:30:11,610 copying src/unitxt/catalog/recipes/bluebench/news_classification/20_newsgroups_short.json -> build/lib/unitxt/catalog/recipes/bluebench/news_classification 2026-01-06T13:30:11,612 creating build/lib/unitxt/catalog/recipes/bluebench/qa_finance 2026-01-06T13:30:11,613 copying src/unitxt/catalog/recipes/bluebench/qa_finance/fin_qa.json -> build/lib/unitxt/catalog/recipes/bluebench/qa_finance 2026-01-06T13:30:11,615 creating build/lib/unitxt/catalog/recipes/bluebench/knowledge 2026-01-06T13:30:11,617 copying src/unitxt/catalog/recipes/bluebench/knowledge/mmlu_pro_business.json -> build/lib/unitxt/catalog/recipes/bluebench/knowledge 2026-01-06T13:30:11,619 copying src/unitxt/catalog/recipes/bluebench/knowledge/mmlu_pro_engineering.json -> build/lib/unitxt/catalog/recipes/bluebench/knowledge 2026-01-06T13:30:11,621 copying src/unitxt/catalog/recipes/bluebench/knowledge/mmlu_pro_other.json -> build/lib/unitxt/catalog/recipes/bluebench/knowledge 2026-01-06T13:30:11,623 copying src/unitxt/catalog/recipes/bluebench/knowledge/mmlu_pro_law.json -> build/lib/unitxt/catalog/recipes/bluebench/knowledge 2026-01-06T13:30:11,625 copying src/unitxt/catalog/recipes/bluebench/knowledge/mmlu_pro_history.json -> build/lib/unitxt/catalog/recipes/bluebench/knowledge 2026-01-06T13:30:11,627 copying src/unitxt/catalog/recipes/bluebench/knowledge/mmlu_pro_health.json -> build/lib/unitxt/catalog/recipes/bluebench/knowledge 2026-01-06T13:30:11,629 copying src/unitxt/catalog/recipes/bluebench/knowledge/mmlu_pro_chemistry.json -> build/lib/unitxt/catalog/recipes/bluebench/knowledge 2026-01-06T13:30:11,631 copying src/unitxt/catalog/recipes/bluebench/knowledge/mmlu_pro_computer_science.json -> build/lib/unitxt/catalog/recipes/bluebench/knowledge 2026-01-06T13:30:11,633 copying src/unitxt/catalog/recipes/bluebench/knowledge/mmlu_pro_physics.json -> build/lib/unitxt/catalog/recipes/bluebench/knowledge 2026-01-06T13:30:11,635 copying src/unitxt/catalog/recipes/bluebench/knowledge/mmlu_pro_philosophy.json -> build/lib/unitxt/catalog/recipes/bluebench/knowledge 2026-01-06T13:30:11,637 copying src/unitxt/catalog/recipes/bluebench/knowledge/mmlu_pro_biology.json -> build/lib/unitxt/catalog/recipes/bluebench/knowledge 2026-01-06T13:30:11,639 copying src/unitxt/catalog/recipes/bluebench/knowledge/mmlu_pro_psychology.json -> build/lib/unitxt/catalog/recipes/bluebench/knowledge 2026-01-06T13:30:11,641 copying src/unitxt/catalog/recipes/bluebench/knowledge/mmlu_pro_economics.json -> build/lib/unitxt/catalog/recipes/bluebench/knowledge 2026-01-06T13:30:11,643 copying src/unitxt/catalog/recipes/bluebench/knowledge/mmlu_pro_math.json -> build/lib/unitxt/catalog/recipes/bluebench/knowledge 2026-01-06T13:30:11,645 creating build/lib/unitxt/catalog/recipes/bluebench/translation 2026-01-06T13:30:11,646 copying src/unitxt/catalog/recipes/bluebench/translation/mt_flores_101_deu_eng.json -> build/lib/unitxt/catalog/recipes/bluebench/translation 2026-01-06T13:30:11,648 copying src/unitxt/catalog/recipes/bluebench/translation/mt_flores_101_por_eng.json -> build/lib/unitxt/catalog/recipes/bluebench/translation 2026-01-06T13:30:11,650 copying src/unitxt/catalog/recipes/bluebench/translation/mt_flores_101_eng_fra.json -> build/lib/unitxt/catalog/recipes/bluebench/translation 2026-01-06T13:30:11,652 copying src/unitxt/catalog/recipes/bluebench/translation/mt_flores_101_eng_spa.json -> build/lib/unitxt/catalog/recipes/bluebench/translation 2026-01-06T13:30:11,655 copying src/unitxt/catalog/recipes/bluebench/translation/mt_flores_101_eng_deu.json -> build/lib/unitxt/catalog/recipes/bluebench/translation 2026-01-06T13:30:11,657 copying src/unitxt/catalog/recipes/bluebench/translation/mt_flores_101_jpn_eng.json -> build/lib/unitxt/catalog/recipes/bluebench/translation 2026-01-06T13:30:11,659 copying src/unitxt/catalog/recipes/bluebench/translation/mt_flores_101_eng_por.json -> build/lib/unitxt/catalog/recipes/bluebench/translation 2026-01-06T13:30:11,661 copying src/unitxt/catalog/recipes/bluebench/translation/mt_flores_101_eng_ron.json -> build/lib/unitxt/catalog/recipes/bluebench/translation 2026-01-06T13:30:11,663 copying src/unitxt/catalog/recipes/bluebench/translation/mt_flores_101_ara_eng.json -> build/lib/unitxt/catalog/recipes/bluebench/translation 2026-01-06T13:30:11,665 copying src/unitxt/catalog/recipes/bluebench/translation/mt_flores_101_kor_eng.json -> build/lib/unitxt/catalog/recipes/bluebench/translation 2026-01-06T13:30:11,667 copying src/unitxt/catalog/recipes/bluebench/translation/mt_flores_101_eng_ara.json -> build/lib/unitxt/catalog/recipes/bluebench/translation 2026-01-06T13:30:11,670 copying src/unitxt/catalog/recipes/bluebench/translation/mt_flores_101_ron_eng.json -> build/lib/unitxt/catalog/recipes/bluebench/translation 2026-01-06T13:30:11,672 copying src/unitxt/catalog/recipes/bluebench/translation/mt_flores_101_spa_eng.json -> build/lib/unitxt/catalog/recipes/bluebench/translation 2026-01-06T13:30:11,673 copying src/unitxt/catalog/recipes/bluebench/translation/mt_flores_101_fra_eng.json -> build/lib/unitxt/catalog/recipes/bluebench/translation 2026-01-06T13:30:11,675 copying src/unitxt/catalog/recipes/bluebench/translation/mt_flores_101_eng_kor.json -> build/lib/unitxt/catalog/recipes/bluebench/translation 2026-01-06T13:30:11,677 creating build/lib/unitxt/catalog/recipes/bluebench/legal 2026-01-06T13:30:11,678 copying src/unitxt/catalog/recipes/bluebench/legal/legalbench_function_of_decision_section.json -> build/lib/unitxt/catalog/recipes/bluebench/legal 2026-01-06T13:30:11,681 copying src/unitxt/catalog/recipes/bluebench/legal/legalbench_proa.json -> build/lib/unitxt/catalog/recipes/bluebench/legal 2026-01-06T13:30:11,683 copying src/unitxt/catalog/recipes/bluebench/legal/legalbench_corporate_lobbying.json -> build/lib/unitxt/catalog/recipes/bluebench/legal 2026-01-06T13:30:11,685 copying src/unitxt/catalog/recipes/bluebench/legal/legalbench_abercrombie.json -> build/lib/unitxt/catalog/recipes/bluebench/legal 2026-01-06T13:30:11,686 copying src/unitxt/catalog/recipes/bluebench/legal/legalbench_international_citizenship_questions.json -> build/lib/unitxt/catalog/recipes/bluebench/legal 2026-01-06T13:30:11,689 creating build/lib/unitxt/catalog/recipes/bluebench/summarization 2026-01-06T13:30:11,690 copying src/unitxt/catalog/recipes/bluebench/summarization/billsum_document_filtered_to_6000_chars.json -> build/lib/unitxt/catalog/recipes/bluebench/summarization 2026-01-06T13:30:11,692 copying src/unitxt/catalog/recipes/bluebench/summarization/tldr_document_filtered_to_6000_chars.json -> build/lib/unitxt/catalog/recipes/bluebench/summarization 2026-01-06T13:30:11,694 creating build/lib/unitxt/catalog/recipes/bluebench/product_help 2026-01-06T13:30:11,695 copying src/unitxt/catalog/recipes/bluebench/product_help/cfpb_product_2023.json -> build/lib/unitxt/catalog/recipes/bluebench/product_help 2026-01-06T13:30:11,697 copying src/unitxt/catalog/recipes/bluebench/product_help/cfpb_product_watsonx.json -> build/lib/unitxt/catalog/recipes/bluebench/product_help 2026-01-06T13:30:11,700 creating build/lib/unitxt/catalog/recipes/bluebench/reasoning 2026-01-06T13:30:11,701 copying src/unitxt/catalog/recipes/bluebench/reasoning/openbook_qa.json -> build/lib/unitxt/catalog/recipes/bluebench/reasoning 2026-01-06T13:30:11,703 copying src/unitxt/catalog/recipes/bluebench/reasoning/hellaswag.json -> build/lib/unitxt/catalog/recipes/bluebench/reasoning 2026-01-06T13:30:11,705 creating build/lib/unitxt/catalog/recipes/bluebench/safety 2026-01-06T13:30:11,706 copying src/unitxt/catalog/recipes/bluebench/safety/attaq_500.json -> build/lib/unitxt/catalog/recipes/bluebench/safety 2026-01-06T13:30:11,708 creating build/lib/unitxt/catalog/recipes/bluebench/rag_general 2026-01-06T13:30:11,709 copying src/unitxt/catalog/recipes/bluebench/rag_general/rag_response_generation_clapnq.json -> build/lib/unitxt/catalog/recipes/bluebench/rag_general 2026-01-06T13:30:11,712 creating build/lib/unitxt/catalog/recipes/bluebench/bias 2026-01-06T13:30:11,713 copying src/unitxt/catalog/recipes/bluebench/bias/safety_bbq_religion.json -> build/lib/unitxt/catalog/recipes/bluebench/bias 2026-01-06T13:30:11,715 copying src/unitxt/catalog/recipes/bluebench/bias/safety_bbq_ses.json -> build/lib/unitxt/catalog/recipes/bluebench/bias 2026-01-06T13:30:11,717 copying src/unitxt/catalog/recipes/bluebench/bias/safety_bbq_nationality.json -> build/lib/unitxt/catalog/recipes/bluebench/bias 2026-01-06T13:30:11,719 copying src/unitxt/catalog/recipes/bluebench/bias/safety_bbq_physical_appearance.json -> build/lib/unitxt/catalog/recipes/bluebench/bias 2026-01-06T13:30:11,721 copying src/unitxt/catalog/recipes/bluebench/bias/safety_bbq_gender_identity.json -> build/lib/unitxt/catalog/recipes/bluebench/bias 2026-01-06T13:30:11,723 copying src/unitxt/catalog/recipes/bluebench/bias/safety_bbq_age.json -> build/lib/unitxt/catalog/recipes/bluebench/bias 2026-01-06T13:30:11,725 copying src/unitxt/catalog/recipes/bluebench/bias/safety_bbq_race_x_ses.json -> build/lib/unitxt/catalog/recipes/bluebench/bias 2026-01-06T13:30:11,727 copying src/unitxt/catalog/recipes/bluebench/bias/safety_bbq_sexual_orientation.json -> build/lib/unitxt/catalog/recipes/bluebench/bias 2026-01-06T13:30:11,729 copying src/unitxt/catalog/recipes/bluebench/bias/safety_bbq_race_ethnicity.json -> build/lib/unitxt/catalog/recipes/bluebench/bias 2026-01-06T13:30:11,731 copying src/unitxt/catalog/recipes/bluebench/bias/safety_bbq_race_x_gender.json -> build/lib/unitxt/catalog/recipes/bluebench/bias 2026-01-06T13:30:11,733 copying src/unitxt/catalog/recipes/bluebench/bias/safety_bbq_disability_status.json -> build/lib/unitxt/catalog/recipes/bluebench/bias 2026-01-06T13:30:11,735 creating build/lib/unitxt/catalog/recipes/bluebench/entity_extraction 2026-01-06T13:30:11,736 copying src/unitxt/catalog/recipes/bluebench/entity_extraction/universal_ner_en_ewt.json -> build/lib/unitxt/catalog/recipes/bluebench/entity_extraction 2026-01-06T13:30:11,738 creating build/lib/unitxt/catalog/recipes/bluebench/chatbot_abilities 2026-01-06T13:30:11,739 copying src/unitxt/catalog/recipes/bluebench/chatbot_abilities/arena_hard_generation_english_gpt_4_0314_reference.json -> build/lib/unitxt/catalog/recipes/bluebench/chatbot_abilities 2026-01-06T13:30:11,741 creating build/lib/unitxt/catalog/tasks 2026-01-06T13:30:11,742 copying src/unitxt/catalog/tasks/text2sql.json -> build/lib/unitxt/catalog/tasks 2026-01-06T13:30:11,744 copying src/unitxt/catalog/tasks/grammatical_error_correction.json -> build/lib/unitxt/catalog/tasks 2026-01-06T13:30:11,746 copying src/unitxt/catalog/tasks/generation.json -> build/lib/unitxt/catalog/tasks 2026-01-06T13:30:11,749 copying src/unitxt/catalog/tasks/schema_linking.json -> build/lib/unitxt/catalog/tasks 2026-01-06T13:30:11,751 copying src/unitxt/catalog/tasks/language_identification.json -> build/lib/unitxt/catalog/tasks 2026-01-06T13:30:11,753 copying src/unitxt/catalog/tasks/key_value_extraction.json -> build/lib/unitxt/catalog/tasks 2026-01-06T13:30:11,755 copying src/unitxt/catalog/tasks/text2sql_logic.json -> build/lib/unitxt/catalog/tasks 2026-01-06T13:30:11,757 creating build/lib/unitxt/catalog/tasks/response_assessment/pairwise_comparison 2026-01-06T13:30:11,759 copying src/unitxt/catalog/tasks/response_assessment/pairwise_comparison/single_turn.json -> build/lib/unitxt/catalog/tasks/response_assessment/pairwise_comparison 2026-01-06T13:30:11,761 copying src/unitxt/catalog/tasks/response_assessment/pairwise_comparison/multi_turn_with_reference.json -> build/lib/unitxt/catalog/tasks/response_assessment/pairwise_comparison 2026-01-06T13:30:11,763 copying src/unitxt/catalog/tasks/response_assessment/pairwise_comparison/multi_turn.json -> build/lib/unitxt/catalog/tasks/response_assessment/pairwise_comparison 2026-01-06T13:30:11,765 copying src/unitxt/catalog/tasks/response_assessment/pairwise_comparison/single_turn_with_reference.json -> build/lib/unitxt/catalog/tasks/response_assessment/pairwise_comparison 2026-01-06T13:30:11,767 creating build/lib/unitxt/catalog/tasks/response_assessment/rating 2026-01-06T13:30:11,768 copying src/unitxt/catalog/tasks/response_assessment/rating/single_turn.json -> build/lib/unitxt/catalog/tasks/response_assessment/rating 2026-01-06T13:30:11,770 copying src/unitxt/catalog/tasks/response_assessment/rating/multi_turn_with_reference.json -> build/lib/unitxt/catalog/tasks/response_assessment/rating 2026-01-06T13:30:11,772 copying src/unitxt/catalog/tasks/response_assessment/rating/multi_turn.json -> build/lib/unitxt/catalog/tasks/response_assessment/rating 2026-01-06T13:30:11,774 copying src/unitxt/catalog/tasks/response_assessment/rating/single_turn_with_reference.json -> build/lib/unitxt/catalog/tasks/response_assessment/rating 2026-01-06T13:30:11,776 creating build/lib/unitxt/catalog/tasks/response_assessment/pairwise_comparative_rating 2026-01-06T13:30:11,777 copying src/unitxt/catalog/tasks/response_assessment/pairwise_comparative_rating/single_turn.json -> build/lib/unitxt/catalog/tasks/response_assessment/pairwise_comparative_rating 2026-01-06T13:30:11,779 creating build/lib/unitxt/catalog/tasks/selection 2026-01-06T13:30:11,780 copying src/unitxt/catalog/tasks/selection/by_attribute.json -> build/lib/unitxt/catalog/tasks/selection 2026-01-06T13:30:11,782 creating build/lib/unitxt/catalog/tasks/targeted_sentiment_extraction 2026-01-06T13:30:11,783 copying src/unitxt/catalog/tasks/targeted_sentiment_extraction/single_sentiment_class.json -> build/lib/unitxt/catalog/tasks/targeted_sentiment_extraction 2026-01-06T13:30:11,785 copying src/unitxt/catalog/tasks/targeted_sentiment_extraction/all_sentiment_classes.json -> build/lib/unitxt/catalog/tasks/targeted_sentiment_extraction 2026-01-06T13:30:11,787 creating build/lib/unitxt/catalog/tasks/regression 2026-01-06T13:30:11,788 copying src/unitxt/catalog/tasks/regression/single_text.json -> build/lib/unitxt/catalog/tasks/regression 2026-01-06T13:30:11,790 copying src/unitxt/catalog/tasks/regression/two_texts.json -> build/lib/unitxt/catalog/tasks/regression 2026-01-06T13:30:11,792 creating build/lib/unitxt/catalog/tasks/regression/two_texts 2026-01-06T13:30:11,793 copying src/unitxt/catalog/tasks/regression/two_texts/similarity.json -> build/lib/unitxt/catalog/tasks/regression/two_texts 2026-01-06T13:30:11,795 creating build/lib/unitxt/catalog/tasks/generation 2026-01-06T13:30:11,796 copying src/unitxt/catalog/tasks/generation/from_pair.json -> build/lib/unitxt/catalog/tasks/generation 2026-01-06T13:30:11,798 creating build/lib/unitxt/catalog/tasks/tool_calling 2026-01-06T13:30:11,799 copying src/unitxt/catalog/tasks/tool_calling/multi_turn.json -> build/lib/unitxt/catalog/tasks/tool_calling 2026-01-06T13:30:11,801 copying src/unitxt/catalog/tasks/tool_calling/supervised.json -> build/lib/unitxt/catalog/tasks/tool_calling 2026-01-06T13:30:11,803 creating build/lib/unitxt/catalog/tasks/translation 2026-01-06T13:30:11,805 copying src/unitxt/catalog/tasks/translation/directed.json -> build/lib/unitxt/catalog/tasks/translation 2026-01-06T13:30:11,807 creating build/lib/unitxt/catalog/tasks/qa 2026-01-06T13:30:11,808 copying src/unitxt/catalog/tasks/qa/extractive.json -> build/lib/unitxt/catalog/tasks/qa 2026-01-06T13:30:11,811 copying src/unitxt/catalog/tasks/qa/with_context.json -> build/lib/unitxt/catalog/tasks/qa 2026-01-06T13:30:11,813 copying src/unitxt/catalog/tasks/qa/open.json -> build/lib/unitxt/catalog/tasks/qa 2026-01-06T13:30:11,815 creating build/lib/unitxt/catalog/tasks/qa/extractive 2026-01-06T13:30:11,815 copying src/unitxt/catalog/tasks/qa/extractive/multi_turn.json -> build/lib/unitxt/catalog/tasks/qa/extractive 2026-01-06T13:30:11,818 creating build/lib/unitxt/catalog/tasks/qa/multiple_choice 2026-01-06T13:30:11,818 copying src/unitxt/catalog/tasks/qa/multiple_choice/with_context.json -> build/lib/unitxt/catalog/tasks/qa/multiple_choice 2026-01-06T13:30:11,821 copying src/unitxt/catalog/tasks/qa/multiple_choice/with_topic.json -> build/lib/unitxt/catalog/tasks/qa/multiple_choice 2026-01-06T13:30:11,823 copying src/unitxt/catalog/tasks/qa/multiple_choice/open.json -> build/lib/unitxt/catalog/tasks/qa/multiple_choice 2026-01-06T13:30:11,825 creating build/lib/unitxt/catalog/tasks/qa/multiple_choice/with_context 2026-01-06T13:30:11,826 copying src/unitxt/catalog/tasks/qa/multiple_choice/with_context/with_topic.json -> build/lib/unitxt/catalog/tasks/qa/multiple_choice/with_context 2026-01-06T13:30:11,828 creating build/lib/unitxt/catalog/tasks/qa/with_context 2026-01-06T13:30:11,829 copying src/unitxt/catalog/tasks/qa/with_context/with_type.json -> build/lib/unitxt/catalog/tasks/qa/with_context 2026-01-06T13:30:11,831 copying src/unitxt/catalog/tasks/qa/with_context/extractive.json -> build/lib/unitxt/catalog/tasks/qa/with_context 2026-01-06T13:30:11,833 copying src/unitxt/catalog/tasks/qa/with_context/with_domain.json -> build/lib/unitxt/catalog/tasks/qa/with_context 2026-01-06T13:30:11,835 copying src/unitxt/catalog/tasks/qa/with_context/abstractive.json -> build/lib/unitxt/catalog/tasks/qa/with_context 2026-01-06T13:30:11,837 creating build/lib/unitxt/catalog/tasks/summarization 2026-01-06T13:30:11,838 copying src/unitxt/catalog/tasks/summarization/abstractive.json -> build/lib/unitxt/catalog/tasks/summarization 2026-01-06T13:30:11,841 creating build/lib/unitxt/catalog/tasks/ner 2026-01-06T13:30:11,842 copying src/unitxt/catalog/tasks/ner/single_entity_type.json -> build/lib/unitxt/catalog/tasks/ner 2026-01-06T13:30:11,844 copying src/unitxt/catalog/tasks/ner/all_entity_types.json -> build/lib/unitxt/catalog/tasks/ner 2026-01-06T13:30:11,846 creating build/lib/unitxt/catalog/tasks/completion 2026-01-06T13:30:11,847 copying src/unitxt/catalog/tasks/completion/extractive.json -> build/lib/unitxt/catalog/tasks/completion 2026-01-06T13:30:11,849 copying src/unitxt/catalog/tasks/completion/multiple_choice.json -> build/lib/unitxt/catalog/tasks/completion 2026-01-06T13:30:11,851 copying src/unitxt/catalog/tasks/completion/abstractive.json -> build/lib/unitxt/catalog/tasks/completion 2026-01-06T13:30:11,853 creating build/lib/unitxt/catalog/tasks/rag_eval/faithfulness 2026-01-06T13:30:11,855 copying src/unitxt/catalog/tasks/rag_eval/faithfulness/non_binary.json -> build/lib/unitxt/catalog/tasks/rag_eval/faithfulness 2026-01-06T13:30:11,857 copying src/unitxt/catalog/tasks/rag_eval/faithfulness/binary.json -> build/lib/unitxt/catalog/tasks/rag_eval/faithfulness 2026-01-06T13:30:11,859 creating build/lib/unitxt/catalog/tasks/rag_eval/correctness_holistic 2026-01-06T13:30:11,860 copying src/unitxt/catalog/tasks/rag_eval/correctness_holistic/non_binary.json -> build/lib/unitxt/catalog/tasks/rag_eval/correctness_holistic 2026-01-06T13:30:11,862 copying src/unitxt/catalog/tasks/rag_eval/correctness_holistic/binary.json -> build/lib/unitxt/catalog/tasks/rag_eval/correctness_holistic 2026-01-06T13:30:11,864 creating build/lib/unitxt/catalog/tasks/rag_eval/context_relevance 2026-01-06T13:30:11,865 copying src/unitxt/catalog/tasks/rag_eval/context_relevance/non_binary.json -> build/lib/unitxt/catalog/tasks/rag_eval/context_relevance 2026-01-06T13:30:11,867 copying src/unitxt/catalog/tasks/rag_eval/context_relevance/binary.json -> build/lib/unitxt/catalog/tasks/rag_eval/context_relevance 2026-01-06T13:30:11,869 creating build/lib/unitxt/catalog/tasks/rag_eval/answer_correctness 2026-01-06T13:30:11,870 copying src/unitxt/catalog/tasks/rag_eval/answer_correctness/non_binary.json -> build/lib/unitxt/catalog/tasks/rag_eval/answer_correctness 2026-01-06T13:30:11,872 copying src/unitxt/catalog/tasks/rag_eval/answer_correctness/binary.json -> build/lib/unitxt/catalog/tasks/rag_eval/answer_correctness 2026-01-06T13:30:11,874 creating build/lib/unitxt/catalog/tasks/rag_eval/answer_relevance 2026-01-06T13:30:11,875 copying src/unitxt/catalog/tasks/rag_eval/answer_relevance/non_binary.json -> build/lib/unitxt/catalog/tasks/rag_eval/answer_relevance 2026-01-06T13:30:11,878 copying src/unitxt/catalog/tasks/rag_eval/answer_relevance/binary.json -> build/lib/unitxt/catalog/tasks/rag_eval/answer_relevance 2026-01-06T13:30:11,880 creating build/lib/unitxt/catalog/tasks/classification 2026-01-06T13:30:11,881 copying src/unitxt/catalog/tasks/classification/binary.json -> build/lib/unitxt/catalog/tasks/classification 2026-01-06T13:30:11,883 copying src/unitxt/catalog/tasks/classification/multi_label.json -> build/lib/unitxt/catalog/tasks/classification 2026-01-06T13:30:11,885 copying src/unitxt/catalog/tasks/classification/multi_class.json -> build/lib/unitxt/catalog/tasks/classification 2026-01-06T13:30:11,887 creating build/lib/unitxt/catalog/tasks/classification/binary 2026-01-06T13:30:11,888 copying src/unitxt/catalog/tasks/classification/binary/zero_or_one.json -> build/lib/unitxt/catalog/tasks/classification/binary 2026-01-06T13:30:11,890 creating build/lib/unitxt/catalog/tasks/classification/multi_class 2026-01-06T13:30:11,891 copying src/unitxt/catalog/tasks/classification/multi_class/relation.json -> build/lib/unitxt/catalog/tasks/classification/multi_class 2026-01-06T13:30:11,894 copying src/unitxt/catalog/tasks/classification/multi_class/with_classes_descriptions.json -> build/lib/unitxt/catalog/tasks/classification/multi_class 2026-01-06T13:30:11,896 copying src/unitxt/catalog/tasks/classification/multi_class/topic_classification.json -> build/lib/unitxt/catalog/tasks/classification/multi_class 2026-01-06T13:30:11,897 creating build/lib/unitxt/catalog/tasks/rewriting 2026-01-06T13:30:11,898 copying src/unitxt/catalog/tasks/rewriting/by_attribute.json -> build/lib/unitxt/catalog/tasks/rewriting 2026-01-06T13:30:11,901 copying src/unitxt/catalog/tasks/rewriting/paraphrase.json -> build/lib/unitxt/catalog/tasks/rewriting 2026-01-06T13:30:11,903 creating build/lib/unitxt/catalog/tasks/rag 2026-01-06T13:30:11,904 copying src/unitxt/catalog/tasks/rag/end_to_end.json -> build/lib/unitxt/catalog/tasks/rag 2026-01-06T13:30:11,906 copying src/unitxt/catalog/tasks/rag/corpora.json -> build/lib/unitxt/catalog/tasks/rag 2026-01-06T13:30:11,908 copying src/unitxt/catalog/tasks/rag/response_generation.json -> build/lib/unitxt/catalog/tasks/rag 2026-01-06T13:30:11,910 creating build/lib/unitxt/catalog/tasks/span_labeling 2026-01-06T13:30:11,911 copying src/unitxt/catalog/tasks/span_labeling/extraction.json -> build/lib/unitxt/catalog/tasks/span_labeling 2026-01-06T13:30:11,913 creating build/lib/unitxt/catalog/tasks/evaluation 2026-01-06T13:30:11,914 copying src/unitxt/catalog/tasks/evaluation/preference.json -> build/lib/unitxt/catalog/tasks/evaluation 2026-01-06T13:30:11,916 creating build/lib/unitxt/catalog/metrics 2026-01-06T13:30:11,917 copying src/unitxt/catalog/metrics/wer.json -> build/lib/unitxt/catalog/metrics 2026-01-06T13:30:11,919 copying src/unitxt/catalog/metrics/weighted_win_rate_correlation.json -> build/lib/unitxt/catalog/metrics 2026-01-06T13:30:11,921 copying src/unitxt/catalog/metrics/normalized_sacrebleu.json -> build/lib/unitxt/catalog/metrics 2026-01-06T13:30:11,923 copying src/unitxt/catalog/metrics/f1_micro_multi_label.json -> build/lib/unitxt/catalog/metrics 2026-01-06T13:30:11,925 copying src/unitxt/catalog/metrics/sacrebleu.json -> build/lib/unitxt/catalog/metrics 2026-01-06T13:30:11,927 copying src/unitxt/catalog/metrics/pearson.json -> build/lib/unitxt/catalog/metrics 2026-01-06T13:30:11,929 copying src/unitxt/catalog/metrics/fin_qa_metric.json -> build/lib/unitxt/catalog/metrics 2026-01-06T13:30:11,931 copying src/unitxt/catalog/metrics/ner.json -> build/lib/unitxt/catalog/metrics 2026-01-06T13:30:11,933 copying src/unitxt/catalog/metrics/mrr.json -> build/lib/unitxt/catalog/metrics 2026-01-06T13:30:11,935 copying src/unitxt/catalog/metrics/root_mean_squared_error.json -> build/lib/unitxt/catalog/metrics 2026-01-06T13:30:11,937 copying src/unitxt/catalog/metrics/meteor.json -> build/lib/unitxt/catalog/metrics 2026-01-06T13:30:11,939 copying src/unitxt/catalog/metrics/recall_micro_multi_label.json -> build/lib/unitxt/catalog/metrics 2026-01-06T13:30:11,941 copying src/unitxt/catalog/metrics/tool_calling.json -> build/lib/unitxt/catalog/metrics 2026-01-06T13:30:11,944 copying src/unitxt/catalog/metrics/max_accuracy_binary.json -> build/lib/unitxt/catalog/metrics 2026-01-06T13:30:11,946 copying src/unitxt/catalog/metrics/retrieval_at_k.json -> build/lib/unitxt/catalog/metrics 2026-01-06T13:30:11,948 copying src/unitxt/catalog/metrics/f1_macro_multi_label.json -> build/lib/unitxt/catalog/metrics 2026-01-06T13:30:11,950 copying src/unitxt/catalog/metrics/spearman.json -> build/lib/unitxt/catalog/metrics 2026-01-06T13:30:11,952 copying src/unitxt/catalog/metrics/string_containment.json -> build/lib/unitxt/catalog/metrics 2026-01-06T13:30:11,954 copying src/unitxt/catalog/metrics/jaccard_index.json -> build/lib/unitxt/catalog/metrics 2026-01-06T13:30:11,956 copying src/unitxt/catalog/metrics/exact_match_mm.json -> build/lib/unitxt/catalog/metrics 2026-01-06T13:30:11,958 copying src/unitxt/catalog/metrics/matthews_correlation.json -> build/lib/unitxt/catalog/metrics 2026-01-06T13:30:11,960 copying src/unitxt/catalog/metrics/websrc_squad_f1.json -> build/lib/unitxt/catalog/metrics 2026-01-06T13:30:11,962 copying src/unitxt/catalog/metrics/f1_strings.json -> build/lib/unitxt/catalog/metrics 2026-01-06T13:30:11,964 copying src/unitxt/catalog/metrics/rerank_recall.json -> build/lib/unitxt/catalog/metrics 2026-01-06T13:30:11,966 copying src/unitxt/catalog/metrics/token_overlap.json -> build/lib/unitxt/catalog/metrics 2026-01-06T13:30:11,968 copying src/unitxt/catalog/metrics/f1_weighted.json -> build/lib/unitxt/catalog/metrics 2026-01-06T13:30:11,970 copying src/unitxt/catalog/metrics/rouge_with_confidence_intervals.json -> build/lib/unitxt/catalog/metrics 2026-01-06T13:30:11,972 copying src/unitxt/catalog/metrics/f1_micro.json -> build/lib/unitxt/catalog/metrics 2026-01-06T13:30:11,974 copying src/unitxt/catalog/metrics/ndcg.json -> build/lib/unitxt/catalog/metrics 2026-01-06T13:30:11,976 copying src/unitxt/catalog/metrics/bleu.json -> build/lib/unitxt/catalog/metrics 2026-01-06T13:30:11,977 copying src/unitxt/catalog/metrics/meteor_hf.json -> build/lib/unitxt/catalog/metrics 2026-01-06T13:30:11,980 copying src/unitxt/catalog/metrics/regard_metric.json -> build/lib/unitxt/catalog/metrics 2026-01-06T13:30:11,982 copying src/unitxt/catalog/metrics/prediction_length.json -> build/lib/unitxt/catalog/metrics 2026-01-06T13:30:11,984 copying src/unitxt/catalog/metrics/recall_binary.json -> build/lib/unitxt/catalog/metrics 2026-01-06T13:30:11,986 copying src/unitxt/catalog/metrics/safety_metric.json -> build/lib/unitxt/catalog/metrics 2026-01-06T13:30:11,988 copying src/unitxt/catalog/metrics/rouge.json -> build/lib/unitxt/catalog/metrics 2026-01-06T13:30:11,990 copying src/unitxt/catalog/metrics/f1_macro.json -> build/lib/unitxt/catalog/metrics 2026-01-06T13:30:11,992 copying src/unitxt/catalog/metrics/roc_auc.json -> build/lib/unitxt/catalog/metrics 2026-01-06T13:30:11,994 copying src/unitxt/catalog/metrics/relaxed_correctness.json -> build/lib/unitxt/catalog/metrics 2026-01-06T13:30:11,997 copying src/unitxt/catalog/metrics/is_code_mixed.json -> build/lib/unitxt/catalog/metrics 2026-01-06T13:30:11,999 copying src/unitxt/catalog/metrics/metric_based_ner.json -> build/lib/unitxt/catalog/metrics 2026-01-06T13:30:12,001 copying src/unitxt/catalog/metrics/precision_micro_multi_label.json -> build/lib/unitxt/catalog/metrics 2026-01-06T13:30:12,003 copying src/unitxt/catalog/metrics/char_edit_distance.json -> build/lib/unitxt/catalog/metrics 2026-01-06T13:30:12,005 copying src/unitxt/catalog/metrics/squad.json -> build/lib/unitxt/catalog/metrics 2026-01-06T13:30:12,007 copying src/unitxt/catalog/metrics/char_edit_dist_accuracy.json -> build/lib/unitxt/catalog/metrics 2026-01-06T13:30:12,009 copying src/unitxt/catalog/metrics/string_containment_ratio.json -> build/lib/unitxt/catalog/metrics 2026-01-06T13:30:12,011 copying src/unitxt/catalog/metrics/recall_macro_multi_label.json -> build/lib/unitxt/catalog/metrics 2026-01-06T13:30:12,013 copying src/unitxt/catalog/metrics/accuracy.json -> build/lib/unitxt/catalog/metrics 2026-01-06T13:30:12,015 copying src/unitxt/catalog/metrics/f1_binary.json -> build/lib/unitxt/catalog/metrics 2026-01-06T13:30:12,017 copying src/unitxt/catalog/metrics/anls.json -> build/lib/unitxt/catalog/metrics 2026-01-06T13:30:12,019 copying src/unitxt/catalog/metrics/unsorted_list_exact_match.json -> build/lib/unitxt/catalog/metrics 2026-01-06T13:30:12,021 copying src/unitxt/catalog/metrics/precision_binary.json -> build/lib/unitxt/catalog/metrics 2026-01-06T13:30:12,023 copying src/unitxt/catalog/metrics/accuracy_binary.json -> build/lib/unitxt/catalog/metrics 2026-01-06T13:30:12,025 copying src/unitxt/catalog/metrics/token_overlap_with_context.json -> build/lib/unitxt/catalog/metrics 2026-01-06T13:30:12,027 copying src/unitxt/catalog/metrics/fuzzyner.json -> build/lib/unitxt/catalog/metrics 2026-01-06T13:30:12,029 copying src/unitxt/catalog/metrics/mean_squared_error.json -> build/lib/unitxt/catalog/metrics 2026-01-06T13:30:12,031 copying src/unitxt/catalog/metrics/max_f1_binary.json -> build/lib/unitxt/catalog/metrics 2026-01-06T13:30:12,033 copying src/unitxt/catalog/metrics/kendalltau_b.json -> build/lib/unitxt/catalog/metrics 2026-01-06T13:30:12,035 copying src/unitxt/catalog/metrics/map.json -> build/lib/unitxt/catalog/metrics 2026-01-06T13:30:12,037 copying src/unitxt/catalog/metrics/precision_macro_multi_label.json -> build/lib/unitxt/catalog/metrics 2026-01-06T13:30:12,039 copying src/unitxt/catalog/metrics/kpa.json -> build/lib/unitxt/catalog/metrics 2026-01-06T13:30:12,041 copying src/unitxt/catalog/metrics/vectara_groundedness_hhem_2_1.json -> build/lib/unitxt/catalog/metrics 2026-01-06T13:30:12,042 copying src/unitxt/catalog/metrics/jaccard_index_words.json -> build/lib/unitxt/catalog/metrics 2026-01-06T13:30:12,044 creating build/lib/unitxt/catalog/metrics/perplexity_chat 2026-01-06T13:30:12,045 copying src/unitxt/catalog/metrics/perplexity_chat/flan_t5_small.json -> build/lib/unitxt/catalog/metrics/perplexity_chat 2026-01-06T13:30:12,047 creating build/lib/unitxt/catalog/metrics/granite_guardian/agentic_risk 2026-01-06T13:30:12,049 copying src/unitxt/catalog/metrics/granite_guardian/agentic_risk/function_call.json -> build/lib/unitxt/catalog/metrics/granite_guardian/agentic_risk 2026-01-06T13:30:12,051 creating build/lib/unitxt/catalog/metrics/granite_guardian/user_risk 2026-01-06T13:30:12,052 copying src/unitxt/catalog/metrics/granite_guardian/user_risk/unethical_behavior.json -> build/lib/unitxt/catalog/metrics/granite_guardian/user_risk 2026-01-06T13:30:12,054 copying src/unitxt/catalog/metrics/granite_guardian/user_risk/jailbreak.json -> build/lib/unitxt/catalog/metrics/granite_guardian/user_risk 2026-01-06T13:30:12,056 copying src/unitxt/catalog/metrics/granite_guardian/user_risk/social_bias.json -> build/lib/unitxt/catalog/metrics/granite_guardian/user_risk 2026-01-06T13:30:12,058 copying src/unitxt/catalog/metrics/granite_guardian/user_risk/violence.json -> build/lib/unitxt/catalog/metrics/granite_guardian/user_risk 2026-01-06T13:30:12,060 copying src/unitxt/catalog/metrics/granite_guardian/user_risk/profanity.json -> build/lib/unitxt/catalog/metrics/granite_guardian/user_risk 2026-01-06T13:30:12,062 copying src/unitxt/catalog/metrics/granite_guardian/user_risk/harm.json -> build/lib/unitxt/catalog/metrics/granite_guardian/user_risk 2026-01-06T13:30:12,064 creating build/lib/unitxt/catalog/metrics/granite_guardian/assistant_risk 2026-01-06T13:30:12,065 copying src/unitxt/catalog/metrics/granite_guardian/assistant_risk/unethical_behavior.json -> build/lib/unitxt/catalog/metrics/granite_guardian/assistant_risk 2026-01-06T13:30:12,067 copying src/unitxt/catalog/metrics/granite_guardian/assistant_risk/social_bias.json -> build/lib/unitxt/catalog/metrics/granite_guardian/assistant_risk 2026-01-06T13:30:12,069 copying src/unitxt/catalog/metrics/granite_guardian/assistant_risk/violence.json -> build/lib/unitxt/catalog/metrics/granite_guardian/assistant_risk 2026-01-06T13:30:12,071 copying src/unitxt/catalog/metrics/granite_guardian/assistant_risk/profanity.json -> build/lib/unitxt/catalog/metrics/granite_guardian/assistant_risk 2026-01-06T13:30:12,073 copying src/unitxt/catalog/metrics/granite_guardian/assistant_risk/harm.json -> build/lib/unitxt/catalog/metrics/granite_guardian/assistant_risk 2026-01-06T13:30:12,075 creating build/lib/unitxt/catalog/metrics/granite_guardian/rag_risk 2026-01-06T13:30:12,076 copying src/unitxt/catalog/metrics/granite_guardian/rag_risk/answer_relevance.json -> build/lib/unitxt/catalog/metrics/granite_guardian/rag_risk 2026-01-06T13:30:12,079 copying src/unitxt/catalog/metrics/granite_guardian/rag_risk/groundedness.json -> build/lib/unitxt/catalog/metrics/granite_guardian/rag_risk 2026-01-06T13:30:12,081 copying src/unitxt/catalog/metrics/granite_guardian/rag_risk/context_relevance.json -> build/lib/unitxt/catalog/metrics/granite_guardian/rag_risk 2026-01-06T13:30:12,083 creating build/lib/unitxt/catalog/metrics/perplexity_a 2026-01-06T13:30:12,084 copying src/unitxt/catalog/metrics/perplexity_a/flan_t5_small.json -> build/lib/unitxt/catalog/metrics/perplexity_a 2026-01-06T13:30:12,087 creating build/lib/unitxt/catalog/metrics/sentence_bert 2026-01-06T13:30:12,088 copying src/unitxt/catalog/metrics/sentence_bert/minilm_l12_v2.json -> build/lib/unitxt/catalog/metrics/sentence_bert 2026-01-06T13:30:12,090 copying src/unitxt/catalog/metrics/sentence_bert/mpnet_base_v2.json -> build/lib/unitxt/catalog/metrics/sentence_bert 2026-01-06T13:30:12,092 copying src/unitxt/catalog/metrics/sentence_bert/bge_large_en_1_5.json -> build/lib/unitxt/catalog/metrics/sentence_bert 2026-01-06T13:30:12,094 creating build/lib/unitxt/catalog/metrics/multi_turn 2026-01-06T13:30:12,096 copying src/unitxt/catalog/metrics/multi_turn/accuracy.json -> build/lib/unitxt/catalog/metrics/multi_turn 2026-01-06T13:30:12,098 copying src/unitxt/catalog/metrics/multi_turn/sequential_success_accuracy.json -> build/lib/unitxt/catalog/metrics/multi_turn 2026-01-06T13:30:12,100 creating build/lib/unitxt/catalog/metrics/tool_calling 2026-01-06T13:30:12,101 copying src/unitxt/catalog/metrics/tool_calling/reflection.json -> build/lib/unitxt/catalog/metrics/tool_calling 2026-01-06T13:30:12,104 creating build/lib/unitxt/catalog/metrics/tool_calling/multi_turn 2026-01-06T13:30:12,105 copying src/unitxt/catalog/metrics/tool_calling/multi_turn/validity.json -> build/lib/unitxt/catalog/metrics/tool_calling/multi_turn 2026-01-06T13:30:12,107 creating build/lib/unitxt/catalog/metrics/tool_calling/multi_turn/correctness 2026-01-06T13:30:12,108 copying src/unitxt/catalog/metrics/tool_calling/multi_turn/correctness/llama_3_3_70b_instruct_judge.json -> build/lib/unitxt/catalog/metrics/tool_calling/multi_turn/correctness 2026-01-06T13:30:12,111 creating build/lib/unitxt/catalog/metrics/tool_calling/correctness 2026-01-06T13:30:12,112 copying src/unitxt/catalog/metrics/tool_calling/correctness/llama_3_3_70b_instruct_judge.json -> build/lib/unitxt/catalog/metrics/tool_calling/correctness 2026-01-06T13:30:12,115 creating build/lib/unitxt/catalog/metrics/tool_calling/key_value 2026-01-06T13:30:12,116 copying src/unitxt/catalog/metrics/tool_calling/key_value/token_overlap.json -> build/lib/unitxt/catalog/metrics/tool_calling/key_value 2026-01-06T13:30:12,119 copying src/unitxt/catalog/metrics/tool_calling/key_value/accuracy.json -> build/lib/unitxt/catalog/metrics/tool_calling/key_value 2026-01-06T13:30:12,121 creating build/lib/unitxt/catalog/metrics/tool_calling/reflection 2026-01-06T13:30:12,122 copying src/unitxt/catalog/metrics/tool_calling/reflection/syntactic.json -> build/lib/unitxt/catalog/metrics/tool_calling/reflection 2026-01-06T13:30:12,124 creating build/lib/unitxt/catalog/metrics/perplexity 2026-01-06T13:30:12,126 copying src/unitxt/catalog/metrics/perplexity/flan_t5_small.json -> build/lib/unitxt/catalog/metrics/perplexity 2026-01-06T13:30:12,128 creating build/lib/unitxt/catalog/metrics/qa/open 2026-01-06T13:30:12,130 copying src/unitxt/catalog/metrics/qa/open/recommended_no_gpu.json -> build/lib/unitxt/catalog/metrics/qa/open 2026-01-06T13:30:12,132 copying src/unitxt/catalog/metrics/qa/open/recommended_local_gpu.json -> build/lib/unitxt/catalog/metrics/qa/open 2026-01-06T13:30:12,134 copying src/unitxt/catalog/metrics/qa/open/recommended_llm_as_judge.json -> build/lib/unitxt/catalog/metrics/qa/open 2026-01-06T13:30:12,137 creating build/lib/unitxt/catalog/metrics/perplexity_nli 2026-01-06T13:30:12,138 copying src/unitxt/catalog/metrics/perplexity_nli/t5_nli_mixture.json -> build/lib/unitxt/catalog/metrics/perplexity_nli 2026-01-06T13:30:12,141 creating build/lib/unitxt/catalog/metrics/bert_score 2026-01-06T13:30:12,142 copying src/unitxt/catalog/metrics/bert_score/deberta_xlarge_mnli.json -> build/lib/unitxt/catalog/metrics/bert_score 2026-01-06T13:30:12,144 copying src/unitxt/catalog/metrics/bert_score/deberta_v3_base_mnli_xnli_ml.json -> build/lib/unitxt/catalog/metrics/bert_score 2026-01-06T13:30:12,146 copying src/unitxt/catalog/metrics/bert_score/bert_base_uncased.json -> build/lib/unitxt/catalog/metrics/bert_score 2026-01-06T13:30:12,149 copying src/unitxt/catalog/metrics/bert_score/distilbert_base_uncased.json -> build/lib/unitxt/catalog/metrics/bert_score 2026-01-06T13:30:12,151 copying src/unitxt/catalog/metrics/bert_score/deberta_base_mnli.json -> build/lib/unitxt/catalog/metrics/bert_score 2026-01-06T13:30:12,153 copying src/unitxt/catalog/metrics/bert_score/deberta_large_mnli.json -> build/lib/unitxt/catalog/metrics/bert_score 2026-01-06T13:30:12,156 creating build/lib/unitxt/catalog/metrics/text2sql 2026-01-06T13:30:12,157 copying src/unitxt/catalog/metrics/text2sql/non_execution_accuracy.json -> build/lib/unitxt/catalog/metrics/text2sql 2026-01-06T13:30:12,159 copying src/unitxt/catalog/metrics/text2sql/execution_logic_accuracy.json -> build/lib/unitxt/catalog/metrics/text2sql 2026-01-06T13:30:12,162 copying src/unitxt/catalog/metrics/text2sql/execution_accuracy.json -> build/lib/unitxt/catalog/metrics/text2sql 2026-01-06T13:30:12,164 creating build/lib/unitxt/catalog/metrics/robustness 2026-01-06T13:30:12,165 copying src/unitxt/catalog/metrics/robustness/fixed_group_absval_norm_hedges_g_paraphrase_string_containment.json -> build/lib/unitxt/catalog/metrics/robustness 2026-01-06T13:30:12,168 copying src/unitxt/catalog/metrics/robustness/fixed_group_pdr_paraphrase_string_containment.json -> build/lib/unitxt/catalog/metrics/robustness 2026-01-06T13:30:12,170 copying src/unitxt/catalog/metrics/robustness/fixed_group_norm_hedges_g_paraphrase_accuracy.json -> build/lib/unitxt/catalog/metrics/robustness 2026-01-06T13:30:12,172 copying src/unitxt/catalog/metrics/robustness/fixed_group_mean_baseline_accuracy.json -> build/lib/unitxt/catalog/metrics/robustness 2026-01-06T13:30:12,175 copying src/unitxt/catalog/metrics/robustness/group_mean_token_overlap.json -> build/lib/unitxt/catalog/metrics/robustness 2026-01-06T13:30:12,177 copying src/unitxt/catalog/metrics/robustness/fixed_group_absval_norm_cohens_h_paraphrase_accuracy.json -> build/lib/unitxt/catalog/metrics/robustness 2026-01-06T13:30:12,179 copying src/unitxt/catalog/metrics/robustness/fixed_group_norm_cohens_h_paraphrase_string_containment.json -> build/lib/unitxt/catalog/metrics/robustness 2026-01-06T13:30:12,182 copying src/unitxt/catalog/metrics/robustness/fixed_group_absval_norm_hedges_g_paraphrase_accuracy.json -> build/lib/unitxt/catalog/metrics/robustness 2026-01-06T13:30:12,184 copying src/unitxt/catalog/metrics/robustness/group_mean_accuracy.json -> build/lib/unitxt/catalog/metrics/robustness 2026-01-06T13:30:12,186 copying src/unitxt/catalog/metrics/robustness/fixed_group_norm_cohens_h_paraphrase_accuracy.json -> build/lib/unitxt/catalog/metrics/robustness 2026-01-06T13:30:12,189 copying src/unitxt/catalog/metrics/robustness/fixed_group_mean_baseline_string_containment.json -> build/lib/unitxt/catalog/metrics/robustness 2026-01-06T13:30:12,191 copying src/unitxt/catalog/metrics/robustness/fixed_group_mean_paraphrase_accuracy.json -> build/lib/unitxt/catalog/metrics/robustness 2026-01-06T13:30:12,193 copying src/unitxt/catalog/metrics/robustness/fixed_group_absval_norm_cohens_h_paraphrase_string_containment.json -> build/lib/unitxt/catalog/metrics/robustness 2026-01-06T13:30:12,196 copying src/unitxt/catalog/metrics/robustness/fixed_group_mean_paraphrase_string_containment.json -> build/lib/unitxt/catalog/metrics/robustness 2026-01-06T13:30:12,198 copying src/unitxt/catalog/metrics/robustness/group_mean_string_containment.json -> build/lib/unitxt/catalog/metrics/robustness 2026-01-06T13:30:12,201 copying src/unitxt/catalog/metrics/robustness/fixed_group_mean_accuracy.json -> build/lib/unitxt/catalog/metrics/robustness 2026-01-06T13:30:12,203 copying src/unitxt/catalog/metrics/robustness/fixed_group_pdr_paraphrase_accuracy.json -> build/lib/unitxt/catalog/metrics/robustness 2026-01-06T13:30:12,206 copying src/unitxt/catalog/metrics/robustness/fixed_group_mean_string_containment.json -> build/lib/unitxt/catalog/metrics/robustness 2026-01-06T13:30:12,208 copying src/unitxt/catalog/metrics/robustness/fixed_group_norm_hedges_g_paraphrase_string_containment.json -> build/lib/unitxt/catalog/metrics/robustness 2026-01-06T13:30:12,210 creating build/lib/unitxt/catalog/metrics/llm_as_judge/binary 2026-01-06T13:30:12,212 copying src/unitxt/catalog/metrics/llm_as_judge/binary/generic_inference_engine_answer_relevance_q_a.json -> build/lib/unitxt/catalog/metrics/llm_as_judge/binary 2026-01-06T13:30:12,215 copying src/unitxt/catalog/metrics/llm_as_judge/binary/generic_inference_engine_answer_correctness_q_a_gt_loose.json -> build/lib/unitxt/catalog/metrics/llm_as_judge/binary 2026-01-06T13:30:12,217 copying src/unitxt/catalog/metrics/llm_as_judge/binary/llama_3_3_70b_instruct_wml_answer_relevance_q_a.json -> build/lib/unitxt/catalog/metrics/llm_as_judge/binary 2026-01-06T13:30:12,220 copying src/unitxt/catalog/metrics/llm_as_judge/binary/llama_3_3_70b_instruct_wml_context_relevance_q_c_ares.json -> build/lib/unitxt/catalog/metrics/llm_as_judge/binary 2026-01-06T13:30:12,222 copying src/unitxt/catalog/metrics/llm_as_judge/binary/llama_3_3_70b_instruct_wml_faithfulness_q_c_a_logprobs.json -> build/lib/unitxt/catalog/metrics/llm_as_judge/binary 2026-01-06T13:30:12,224 copying src/unitxt/catalog/metrics/llm_as_judge/binary/llama_3_3_70b_instruct_wml_context_relevance_q_c_ares_logprobs.json -> build/lib/unitxt/catalog/metrics/llm_as_judge/binary 2026-01-06T13:30:12,227 copying src/unitxt/catalog/metrics/llm_as_judge/binary/generic_inference_engine_context_relevance_q_c_ares.json -> build/lib/unitxt/catalog/metrics/llm_as_judge/binary 2026-01-06T13:30:12,229 copying src/unitxt/catalog/metrics/llm_as_judge/binary/llama_3_3_70b_instruct_wml_faithfulness_c_a.json -> build/lib/unitxt/catalog/metrics/llm_as_judge/binary 2026-01-06T13:30:12,231 copying src/unitxt/catalog/metrics/llm_as_judge/binary/llama_3_3_70b_instruct_wml_correctness_holistic_q_c_a_logprobs.json -> build/lib/unitxt/catalog/metrics/llm_as_judge/binary 2026-01-06T13:30:12,233 copying src/unitxt/catalog/metrics/llm_as_judge/binary/llama_3_3_70b_instruct_wml_faithfulness_q_c_a.json -> build/lib/unitxt/catalog/metrics/llm_as_judge/binary 2026-01-06T13:30:12,236 copying src/unitxt/catalog/metrics/llm_as_judge/binary/llama_3_3_70b_instruct_wml_answer_relevance_q_a_logprobs.json -> build/lib/unitxt/catalog/metrics/llm_as_judge/binary 2026-01-06T13:30:12,238 copying src/unitxt/catalog/metrics/llm_as_judge/binary/generic_inference_engine_faithfulness_c_a.json -> build/lib/unitxt/catalog/metrics/llm_as_judge/binary 2026-01-06T13:30:12,241 copying src/unitxt/catalog/metrics/llm_as_judge/binary/generic_inference_engine_faithfulness_q_c_a.json -> build/lib/unitxt/catalog/metrics/llm_as_judge/binary 2026-01-06T13:30:12,243 copying src/unitxt/catalog/metrics/llm_as_judge/binary/llama_3_3_70b_instruct_wml_faithfulness_c_a_logprobs.json -> build/lib/unitxt/catalog/metrics/llm_as_judge/binary 2026-01-06T13:30:12,245 copying src/unitxt/catalog/metrics/llm_as_judge/binary/llama_3_3_70b_instruct_wml_answer_correctness_q_a_gt_loose.json -> build/lib/unitxt/catalog/metrics/llm_as_judge/binary 2026-01-06T13:30:12,248 copying src/unitxt/catalog/metrics/llm_as_judge/binary/llama_3_3_70b_instruct_wml_correctness_holistic_q_c_a.json -> build/lib/unitxt/catalog/metrics/llm_as_judge/binary 2026-01-06T13:30:12,250 copying src/unitxt/catalog/metrics/llm_as_judge/binary/llama_3_3_70b_instruct_wml_answer_correctness_q_a_gt_loose_logprobs.json -> build/lib/unitxt/catalog/metrics/llm_as_judge/binary 2026-01-06T13:30:12,252 copying src/unitxt/catalog/metrics/llm_as_judge/binary/generic_inference_engine_correctness_holistic_q_c_a.json -> build/lib/unitxt/catalog/metrics/llm_as_judge/binary 2026-01-06T13:30:12,255 creating build/lib/unitxt/catalog/metrics/llm_as_judge/rating 2026-01-06T13:30:12,256 copying src/unitxt/catalog/metrics/llm_as_judge/rating/llama_3_70b_instruct_template_table2text_single_turn_with_reference.json -> build/lib/unitxt/catalog/metrics/llm_as_judge/rating 2026-01-06T13:30:12,258 copying src/unitxt/catalog/metrics/llm_as_judge/rating/llama_3_1_70b_instruct_cross_provider_template_table2text_single_turn_with_reference.json -> build/lib/unitxt/catalog/metrics/llm_as_judge/rating 2026-01-06T13:30:12,261 copying src/unitxt/catalog/metrics/llm_as_judge/rating/mistral_7b_instruct_v0_2_huggingface_template_mt_bench_single_turn.json -> build/lib/unitxt/catalog/metrics/llm_as_judge/rating 2026-01-06T13:30:12,263 creating build/lib/unitxt/catalog/metrics/llm_as_judge/rating/llama_3_8b_instruct 2026-01-06T13:30:12,264 copying src/unitxt/catalog/metrics/llm_as_judge/rating/llama_3_8b_instruct/mt_bench_single_turn.json -> build/lib/unitxt/catalog/metrics/llm_as_judge/rating/llama_3_8b_instruct 2026-01-06T13:30:12,267 creating build/lib/unitxt/catalog/metrics/llm_as_judge/rating/llama_3_70b_instruct 2026-01-06T13:30:12,268 copying src/unitxt/catalog/metrics/llm_as_judge/rating/llama_3_70b_instruct/generic_single_turn_with_reference.json -> build/lib/unitxt/catalog/metrics/llm_as_judge/rating/llama_3_70b_instruct 2026-01-06T13:30:12,270 copying src/unitxt/catalog/metrics/llm_as_judge/rating/llama_3_70b_instruct/mt_bench_single_turn.json -> build/lib/unitxt/catalog/metrics/llm_as_judge/rating/llama_3_70b_instruct 2026-01-06T13:30:12,273 copying src/unitxt/catalog/metrics/llm_as_judge/rating/llama_3_70b_instruct/generic_single_turn.json -> build/lib/unitxt/catalog/metrics/llm_as_judge/rating/llama_3_70b_instruct 2026-01-06T13:30:12,275 creating build/lib/unitxt/catalog/metrics/llm_as_judge/pairwise/aws 2026-01-06T13:30:12,277 copying src/unitxt/catalog/metrics/llm_as_judge/pairwise/aws/deepseek_v3.json -> build/lib/unitxt/catalog/metrics/llm_as_judge/pairwise/aws 2026-01-06T13:30:12,279 copying src/unitxt/catalog/metrics/llm_as_judge/pairwise/aws/llama4_maverick.json -> build/lib/unitxt/catalog/metrics/llm_as_judge/pairwise/aws 2026-01-06T13:30:12,282 copying src/unitxt/catalog/metrics/llm_as_judge/pairwise/aws/llama4_scout.json -> build/lib/unitxt/catalog/metrics/llm_as_judge/pairwise/aws 2026-01-06T13:30:12,284 copying src/unitxt/catalog/metrics/llm_as_judge/pairwise/aws/llama3_1_405b.json -> build/lib/unitxt/catalog/metrics/llm_as_judge/pairwise/aws 2026-01-06T13:30:12,286 copying src/unitxt/catalog/metrics/llm_as_judge/pairwise/aws/llama3_3_70b.json -> build/lib/unitxt/catalog/metrics/llm_as_judge/pairwise/aws 2026-01-06T13:30:12,289 copying src/unitxt/catalog/metrics/llm_as_judge/pairwise/aws/mixtral_large.json -> build/lib/unitxt/catalog/metrics/llm_as_judge/pairwise/aws 2026-01-06T13:30:12,291 creating build/lib/unitxt/catalog/metrics/llm_as_judge/pairwise/openai 2026-01-06T13:30:12,292 copying src/unitxt/catalog/metrics/llm_as_judge/pairwise/openai/o1_preview.json -> build/lib/unitxt/catalog/metrics/llm_as_judge/pairwise/openai 2026-01-06T13:30:12,295 copying src/unitxt/catalog/metrics/llm_as_judge/pairwise/openai/o1_mini.json -> build/lib/unitxt/catalog/metrics/llm_as_judge/pairwise/openai 2026-01-06T13:30:12,297 copying src/unitxt/catalog/metrics/llm_as_judge/pairwise/openai/gpt_4_1_nano.json -> build/lib/unitxt/catalog/metrics/llm_as_judge/pairwise/openai 2026-01-06T13:30:12,299 copying src/unitxt/catalog/metrics/llm_as_judge/pairwise/openai/gpt_4_1.json -> build/lib/unitxt/catalog/metrics/llm_as_judge/pairwise/openai 2026-01-06T13:30:12,302 copying src/unitxt/catalog/metrics/llm_as_judge/pairwise/openai/gpt_4_1_mini.json -> build/lib/unitxt/catalog/metrics/llm_as_judge/pairwise/openai 2026-01-06T13:30:12,304 copying src/unitxt/catalog/metrics/llm_as_judge/pairwise/openai/gpt_4o.json -> build/lib/unitxt/catalog/metrics/llm_as_judge/pairwise/openai 2026-01-06T13:30:12,307 creating build/lib/unitxt/catalog/metrics/llm_as_judge/pairwise/replicate 2026-01-06T13:30:12,308 copying src/unitxt/catalog/metrics/llm_as_judge/pairwise/replicate/llama4_maverick.json -> build/lib/unitxt/catalog/metrics/llm_as_judge/pairwise/replicate 2026-01-06T13:30:12,310 copying src/unitxt/catalog/metrics/llm_as_judge/pairwise/replicate/llama4_scout.json -> build/lib/unitxt/catalog/metrics/llm_as_judge/pairwise/replicate 2026-01-06T13:30:12,313 copying src/unitxt/catalog/metrics/llm_as_judge/pairwise/replicate/gpt_4_1.json -> build/lib/unitxt/catalog/metrics/llm_as_judge/pairwise/replicate 2026-01-06T13:30:12,315 creating build/lib/unitxt/catalog/metrics/llm_as_judge/pairwise/together_ai 2026-01-06T13:30:12,316 copying src/unitxt/catalog/metrics/llm_as_judge/pairwise/together_ai/deepseek_v3.json -> build/lib/unitxt/catalog/metrics/llm_as_judge/pairwise/together_ai 2026-01-06T13:30:12,319 copying src/unitxt/catalog/metrics/llm_as_judge/pairwise/together_ai/llama4_maverick.json -> build/lib/unitxt/catalog/metrics/llm_as_judge/pairwise/together_ai 2026-01-06T13:30:12,321 copying src/unitxt/catalog/metrics/llm_as_judge/pairwise/together_ai/llama4_scout.json -> build/lib/unitxt/catalog/metrics/llm_as_judge/pairwise/together_ai 2026-01-06T13:30:12,324 copying src/unitxt/catalog/metrics/llm_as_judge/pairwise/together_ai/llama3_1_405b.json -> build/lib/unitxt/catalog/metrics/llm_as_judge/pairwise/together_ai 2026-01-06T13:30:12,327 copying src/unitxt/catalog/metrics/llm_as_judge/pairwise/together_ai/llama3_3_70b.json -> build/lib/unitxt/catalog/metrics/llm_as_judge/pairwise/together_ai 2026-01-06T13:30:12,329 copying src/unitxt/catalog/metrics/llm_as_judge/pairwise/together_ai/llama3_1_70b.json -> build/lib/unitxt/catalog/metrics/llm_as_judge/pairwise/together_ai 2026-01-06T13:30:12,331 copying src/unitxt/catalog/metrics/llm_as_judge/pairwise/together_ai/llama3_1_8b.json -> build/lib/unitxt/catalog/metrics/llm_as_judge/pairwise/together_ai 2026-01-06T13:30:12,334 creating build/lib/unitxt/catalog/metrics/llm_as_judge/pairwise/azure_openai 2026-01-06T13:30:12,335 copying src/unitxt/catalog/metrics/llm_as_judge/pairwise/azure_openai/o1_preview.json -> build/lib/unitxt/catalog/metrics/llm_as_judge/pairwise/azure_openai 2026-01-06T13:30:12,337 copying src/unitxt/catalog/metrics/llm_as_judge/pairwise/azure_openai/llama4_maverick.json -> build/lib/unitxt/catalog/metrics/llm_as_judge/pairwise/azure_openai 2026-01-06T13:30:12,340 copying src/unitxt/catalog/metrics/llm_as_judge/pairwise/azure_openai/llama4_scout.json -> build/lib/unitxt/catalog/metrics/llm_as_judge/pairwise/azure_openai 2026-01-06T13:30:12,342 copying src/unitxt/catalog/metrics/llm_as_judge/pairwise/azure_openai/llama3_3_70b.json -> build/lib/unitxt/catalog/metrics/llm_as_judge/pairwise/azure_openai 2026-01-06T13:30:12,344 copying src/unitxt/catalog/metrics/llm_as_judge/pairwise/azure_openai/o1_mini.json -> build/lib/unitxt/catalog/metrics/llm_as_judge/pairwise/azure_openai 2026-01-06T13:30:12,346 copying src/unitxt/catalog/metrics/llm_as_judge/pairwise/azure_openai/gpt_4_1_nano.json -> build/lib/unitxt/catalog/metrics/llm_as_judge/pairwise/azure_openai 2026-01-06T13:30:12,349 copying src/unitxt/catalog/metrics/llm_as_judge/pairwise/azure_openai/gpt_4_1.json -> build/lib/unitxt/catalog/metrics/llm_as_judge/pairwise/azure_openai 2026-01-06T13:30:12,351 copying src/unitxt/catalog/metrics/llm_as_judge/pairwise/azure_openai/gpt_4_1_mini.json -> build/lib/unitxt/catalog/metrics/llm_as_judge/pairwise/azure_openai 2026-01-06T13:30:12,353 copying src/unitxt/catalog/metrics/llm_as_judge/pairwise/azure_openai/gpt_4o.json -> build/lib/unitxt/catalog/metrics/llm_as_judge/pairwise/azure_openai 2026-01-06T13:30:12,356 creating build/lib/unitxt/catalog/metrics/llm_as_judge/pairwise/rits 2026-01-06T13:30:12,357 copying src/unitxt/catalog/metrics/llm_as_judge/pairwise/rits/deepseek_v3.json -> build/lib/unitxt/catalog/metrics/llm_as_judge/pairwise/rits 2026-01-06T13:30:12,359 copying src/unitxt/catalog/metrics/llm_as_judge/pairwise/rits/llama4_maverick.json -> build/lib/unitxt/catalog/metrics/llm_as_judge/pairwise/rits 2026-01-06T13:30:12,362 copying src/unitxt/catalog/metrics/llm_as_judge/pairwise/rits/llama4_scout.json -> build/lib/unitxt/catalog/metrics/llm_as_judge/pairwise/rits 2026-01-06T13:30:12,364 copying src/unitxt/catalog/metrics/llm_as_judge/pairwise/rits/granite3_3_8b.json -> build/lib/unitxt/catalog/metrics/llm_as_judge/pairwise/rits 2026-01-06T13:30:12,366 copying src/unitxt/catalog/metrics/llm_as_judge/pairwise/rits/llama3_1_405b.json -> build/lib/unitxt/catalog/metrics/llm_as_judge/pairwise/rits 2026-01-06T13:30:12,369 copying src/unitxt/catalog/metrics/llm_as_judge/pairwise/rits/llama3_3_70b.json -> build/lib/unitxt/catalog/metrics/llm_as_judge/pairwise/rits 2026-01-06T13:30:12,371 copying src/unitxt/catalog/metrics/llm_as_judge/pairwise/rits/mixtral8_7b.json -> build/lib/unitxt/catalog/metrics/llm_as_judge/pairwise/rits 2026-01-06T13:30:12,374 copying src/unitxt/catalog/metrics/llm_as_judge/pairwise/rits/llama3_1_8b.json -> build/lib/unitxt/catalog/metrics/llm_as_judge/pairwise/rits 2026-01-06T13:30:12,376 copying src/unitxt/catalog/metrics/llm_as_judge/pairwise/rits/granite3_2_8b.json -> build/lib/unitxt/catalog/metrics/llm_as_judge/pairwise/rits 2026-01-06T13:30:12,378 copying src/unitxt/catalog/metrics/llm_as_judge/pairwise/rits/mixtral_large.json -> build/lib/unitxt/catalog/metrics/llm_as_judge/pairwise/rits 2026-01-06T13:30:12,381 copying src/unitxt/catalog/metrics/llm_as_judge/pairwise/rits/granite3_0_8b.json -> build/lib/unitxt/catalog/metrics/llm_as_judge/pairwise/rits 2026-01-06T13:30:12,383 copying src/unitxt/catalog/metrics/llm_as_judge/pairwise/rits/granite3_1_8b.json -> build/lib/unitxt/catalog/metrics/llm_as_judge/pairwise/rits 2026-01-06T13:30:12,386 creating build/lib/unitxt/catalog/metrics/llm_as_judge/pairwise/watsonx 2026-01-06T13:30:12,387 copying src/unitxt/catalog/metrics/llm_as_judge/pairwise/watsonx/granite3_3_8b.json -> build/lib/unitxt/catalog/metrics/llm_as_judge/pairwise/watsonx 2026-01-06T13:30:12,389 copying src/unitxt/catalog/metrics/llm_as_judge/pairwise/watsonx/llama3_1_405b.json -> build/lib/unitxt/catalog/metrics/llm_as_judge/pairwise/watsonx 2026-01-06T13:30:12,392 copying src/unitxt/catalog/metrics/llm_as_judge/pairwise/watsonx/llama3_3_70b.json -> build/lib/unitxt/catalog/metrics/llm_as_judge/pairwise/watsonx 2026-01-06T13:30:12,394 copying src/unitxt/catalog/metrics/llm_as_judge/pairwise/watsonx/llama3_1_70b.json -> build/lib/unitxt/catalog/metrics/llm_as_judge/pairwise/watsonx 2026-01-06T13:30:12,396 copying src/unitxt/catalog/metrics/llm_as_judge/pairwise/watsonx/mixtral8_7b.json -> build/lib/unitxt/catalog/metrics/llm_as_judge/pairwise/watsonx 2026-01-06T13:30:12,398 copying src/unitxt/catalog/metrics/llm_as_judge/pairwise/watsonx/llama3_1_8b.json -> build/lib/unitxt/catalog/metrics/llm_as_judge/pairwise/watsonx 2026-01-06T13:30:12,401 copying src/unitxt/catalog/metrics/llm_as_judge/pairwise/watsonx/granite3_2_8b.json -> build/lib/unitxt/catalog/metrics/llm_as_judge/pairwise/watsonx 2026-01-06T13:30:12,403 copying src/unitxt/catalog/metrics/llm_as_judge/pairwise/watsonx/mixtral_large.json -> build/lib/unitxt/catalog/metrics/llm_as_judge/pairwise/watsonx 2026-01-06T13:30:12,406 copying src/unitxt/catalog/metrics/llm_as_judge/pairwise/watsonx/granite3_0_8b.json -> build/lib/unitxt/catalog/metrics/llm_as_judge/pairwise/watsonx 2026-01-06T13:30:12,408 creating build/lib/unitxt/catalog/metrics/llm_as_judge/pairwise/vertex_ai 2026-01-06T13:30:12,409 copying src/unitxt/catalog/metrics/llm_as_judge/pairwise/vertex_ai/gemini_2_5_flash.json -> build/lib/unitxt/catalog/metrics/llm_as_judge/pairwise/vertex_ai 2026-01-06T13:30:12,412 copying src/unitxt/catalog/metrics/llm_as_judge/pairwise/vertex_ai/gemmini_2_5_pro.json -> build/lib/unitxt/catalog/metrics/llm_as_judge/pairwise/vertex_ai 2026-01-06T13:30:12,414 creating build/lib/unitxt/catalog/metrics/llm_as_judge/pairwise/criteria 2026-01-06T13:30:12,415 copying src/unitxt/catalog/metrics/llm_as_judge/pairwise/criteria/factually_consistent.json -> build/lib/unitxt/catalog/metrics/llm_as_judge/pairwise/criteria 2026-01-06T13:30:12,418 copying src/unitxt/catalog/metrics/llm_as_judge/pairwise/criteria/temperature_in_celsius_and_fahrenheit.json -> build/lib/unitxt/catalog/metrics/llm_as_judge/pairwise/criteria 2026-01-06T13:30:12,420 copying src/unitxt/catalog/metrics/llm_as_judge/pairwise/criteria/inclusivity.json -> build/lib/unitxt/catalog/metrics/llm_as_judge/pairwise/criteria 2026-01-06T13:30:12,422 copying src/unitxt/catalog/metrics/llm_as_judge/pairwise/criteria/reference_document_faithfulness.json -> build/lib/unitxt/catalog/metrics/llm_as_judge/pairwise/criteria 2026-01-06T13:30:12,424 copying src/unitxt/catalog/metrics/llm_as_judge/pairwise/criteria/funny_joke.json -> build/lib/unitxt/catalog/metrics/llm_as_judge/pairwise/criteria 2026-01-06T13:30:12,427 copying src/unitxt/catalog/metrics/llm_as_judge/pairwise/criteria/summarization_preference.json -> build/lib/unitxt/catalog/metrics/llm_as_judge/pairwise/criteria 2026-01-06T13:30:12,429 copying src/unitxt/catalog/metrics/llm_as_judge/pairwise/criteria/email_inclusivity.json -> build/lib/unitxt/catalog/metrics/llm_as_judge/pairwise/criteria 2026-01-06T13:30:12,431 creating build/lib/unitxt/catalog/metrics/llm_as_judge/pairwise/ollama 2026-01-06T13:30:12,432 copying src/unitxt/catalog/metrics/llm_as_judge/pairwise/ollama/granite3_3_8b.json -> build/lib/unitxt/catalog/metrics/llm_as_judge/pairwise/ollama 2026-01-06T13:30:12,435 copying src/unitxt/catalog/metrics/llm_as_judge/pairwise/ollama/llama3_1_405b.json -> build/lib/unitxt/catalog/metrics/llm_as_judge/pairwise/ollama 2026-01-06T13:30:12,437 copying src/unitxt/catalog/metrics/llm_as_judge/pairwise/ollama/llama3_3_70b.json -> build/lib/unitxt/catalog/metrics/llm_as_judge/pairwise/ollama 2026-01-06T13:30:12,439 copying src/unitxt/catalog/metrics/llm_as_judge/pairwise/ollama/llama3_1_70b.json -> build/lib/unitxt/catalog/metrics/llm_as_judge/pairwise/ollama 2026-01-06T13:30:12,442 copying src/unitxt/catalog/metrics/llm_as_judge/pairwise/ollama/llama3_1_8b.json -> build/lib/unitxt/catalog/metrics/llm_as_judge/pairwise/ollama 2026-01-06T13:30:12,444 creating build/lib/unitxt/catalog/metrics/llm_as_judge/safety 2026-01-06T13:30:12,446 copying src/unitxt/catalog/metrics/llm_as_judge/safety/llama_3_3_70b_instruct_ibm_watsonx_template_harm_rating.json -> build/lib/unitxt/catalog/metrics/llm_as_judge/safety 2026-01-06T13:30:12,448 copying src/unitxt/catalog/metrics/llm_as_judge/safety/llamaguard.json -> build/lib/unitxt/catalog/metrics/llm_as_judge/safety 2026-01-06T13:30:12,450 creating build/lib/unitxt/catalog/metrics/llm_as_judge/pairwise_comparative_rating 2026-01-06T13:30:12,451 copying src/unitxt/catalog/metrics/llm_as_judge/pairwise_comparative_rating/llama_3_70b_instruct_generic_engine_template_arena_hard.json -> build/lib/unitxt/catalog/metrics/llm_as_judge/pairwise_comparative_rating 2026-01-06T13:30:12,454 copying src/unitxt/catalog/metrics/llm_as_judge/pairwise_comparative_rating/llama_3_70b_instruct_ibm_wml_template_arena_hard.json -> build/lib/unitxt/catalog/metrics/llm_as_judge/pairwise_comparative_rating 2026-01-06T13:30:12,457 copying src/unitxt/catalog/metrics/llm_as_judge/pairwise_comparative_rating/llama_3_70b_instruct_ibm_wml_template_arena_hard_with_shuffling.json -> build/lib/unitxt/catalog/metrics/llm_as_judge/pairwise_comparative_rating 2026-01-06T13:30:12,459 copying src/unitxt/catalog/metrics/llm_as_judge/pairwise_comparative_rating/llama_3_70b_instruct_generic_engine_template_arena_hard_with_shuffling.json -> build/lib/unitxt/catalog/metrics/llm_as_judge/pairwise_comparative_rating 2026-01-06T13:30:12,462 copying src/unitxt/catalog/metrics/llm_as_judge/pairwise_comparative_rating/llama_3_8b_instruct_generic_engine_template_arena_hard_with_shuffling.json -> build/lib/unitxt/catalog/metrics/llm_as_judge/pairwise_comparative_rating 2026-01-06T13:30:12,464 copying src/unitxt/catalog/metrics/llm_as_judge/pairwise_comparative_rating/llama_3_8b_instruct_generic_engine_template_arena_hard.json -> build/lib/unitxt/catalog/metrics/llm_as_judge/pairwise_comparative_rating 2026-01-06T13:30:12,466 creating build/lib/unitxt/catalog/metrics/llm_as_judge/pairwise_comparative_rating/llama_3_8b_instruct 2026-01-06T13:30:12,468 copying src/unitxt/catalog/metrics/llm_as_judge/pairwise_comparative_rating/llama_3_8b_instruct/template_arena_hard.json -> build/lib/unitxt/catalog/metrics/llm_as_judge/pairwise_comparative_rating/llama_3_8b_instruct 2026-01-06T13:30:12,470 creating build/lib/unitxt/catalog/metrics/llm_as_judge/pairwise_comparative_rating/llama_3_3_70b_instruct 2026-01-06T13:30:12,471 copying src/unitxt/catalog/metrics/llm_as_judge/pairwise_comparative_rating/llama_3_3_70b_instruct/template_arena_hard.json -> build/lib/unitxt/catalog/metrics/llm_as_judge/pairwise_comparative_rating/llama_3_3_70b_instruct 2026-01-06T13:30:12,474 creating build/lib/unitxt/catalog/metrics/llm_as_judge/pairwise_comparative_rating/llama_3_70b_instruct 2026-01-06T13:30:12,475 copying src/unitxt/catalog/metrics/llm_as_judge/pairwise_comparative_rating/llama_3_70b_instruct/template_arena_hard.json -> build/lib/unitxt/catalog/metrics/llm_as_judge/pairwise_comparative_rating/llama_3_70b_instruct 2026-01-06T13:30:12,477 creating build/lib/unitxt/catalog/metrics/llm_as_judge/direct/aws 2026-01-06T13:30:12,479 copying src/unitxt/catalog/metrics/llm_as_judge/direct/aws/deepseek_v3.json -> build/lib/unitxt/catalog/metrics/llm_as_judge/direct/aws 2026-01-06T13:30:12,481 copying src/unitxt/catalog/metrics/llm_as_judge/direct/aws/llama4_maverick.json -> build/lib/unitxt/catalog/metrics/llm_as_judge/direct/aws 2026-01-06T13:30:12,484 copying src/unitxt/catalog/metrics/llm_as_judge/direct/aws/llama4_scout.json -> build/lib/unitxt/catalog/metrics/llm_as_judge/direct/aws 2026-01-06T13:30:12,486 copying src/unitxt/catalog/metrics/llm_as_judge/direct/aws/llama3_1_405b.json -> build/lib/unitxt/catalog/metrics/llm_as_judge/direct/aws 2026-01-06T13:30:12,489 copying src/unitxt/catalog/metrics/llm_as_judge/direct/aws/llama3_3_70b.json -> build/lib/unitxt/catalog/metrics/llm_as_judge/direct/aws 2026-01-06T13:30:12,491 copying src/unitxt/catalog/metrics/llm_as_judge/direct/aws/mixtral_large.json -> build/lib/unitxt/catalog/metrics/llm_as_judge/direct/aws 2026-01-06T13:30:12,493 creating build/lib/unitxt/catalog/metrics/llm_as_judge/direct/openai 2026-01-06T13:30:12,495 copying src/unitxt/catalog/metrics/llm_as_judge/direct/openai/o1_preview.json -> build/lib/unitxt/catalog/metrics/llm_as_judge/direct/openai 2026-01-06T13:30:12,497 copying src/unitxt/catalog/metrics/llm_as_judge/direct/openai/o1_mini.json -> build/lib/unitxt/catalog/metrics/llm_as_judge/direct/openai 2026-01-06T13:30:12,500 copying src/unitxt/catalog/metrics/llm_as_judge/direct/openai/gpt_4_1_nano.json -> build/lib/unitxt/catalog/metrics/llm_as_judge/direct/openai 2026-01-06T13:30:12,502 copying src/unitxt/catalog/metrics/llm_as_judge/direct/openai/gpt_4_1.json -> build/lib/unitxt/catalog/metrics/llm_as_judge/direct/openai 2026-01-06T13:30:12,504 copying src/unitxt/catalog/metrics/llm_as_judge/direct/openai/gpt_4_1_mini.json -> build/lib/unitxt/catalog/metrics/llm_as_judge/direct/openai 2026-01-06T13:30:12,506 copying src/unitxt/catalog/metrics/llm_as_judge/direct/openai/gpt_4o.json -> build/lib/unitxt/catalog/metrics/llm_as_judge/direct/openai 2026-01-06T13:30:12,509 creating build/lib/unitxt/catalog/metrics/llm_as_judge/direct/replicate 2026-01-06T13:30:12,510 copying src/unitxt/catalog/metrics/llm_as_judge/direct/replicate/llama4_maverick.json -> build/lib/unitxt/catalog/metrics/llm_as_judge/direct/replicate 2026-01-06T13:30:12,512 copying src/unitxt/catalog/metrics/llm_as_judge/direct/replicate/llama4_scout.json -> build/lib/unitxt/catalog/metrics/llm_as_judge/direct/replicate 2026-01-06T13:30:12,515 copying src/unitxt/catalog/metrics/llm_as_judge/direct/replicate/gpt_4_1.json -> build/lib/unitxt/catalog/metrics/llm_as_judge/direct/replicate 2026-01-06T13:30:12,517 creating build/lib/unitxt/catalog/metrics/llm_as_judge/direct/together_ai 2026-01-06T13:30:12,519 copying src/unitxt/catalog/metrics/llm_as_judge/direct/together_ai/deepseek_v3.json -> build/lib/unitxt/catalog/metrics/llm_as_judge/direct/together_ai 2026-01-06T13:30:12,521 copying src/unitxt/catalog/metrics/llm_as_judge/direct/together_ai/llama4_maverick.json -> build/lib/unitxt/catalog/metrics/llm_as_judge/direct/together_ai 2026-01-06T13:30:12,523 copying src/unitxt/catalog/metrics/llm_as_judge/direct/together_ai/llama4_scout.json -> build/lib/unitxt/catalog/metrics/llm_as_judge/direct/together_ai 2026-01-06T13:30:12,526 copying src/unitxt/catalog/metrics/llm_as_judge/direct/together_ai/llama3_1_405b.json -> build/lib/unitxt/catalog/metrics/llm_as_judge/direct/together_ai 2026-01-06T13:30:12,528 copying src/unitxt/catalog/metrics/llm_as_judge/direct/together_ai/llama3_3_70b.json -> build/lib/unitxt/catalog/metrics/llm_as_judge/direct/together_ai 2026-01-06T13:30:12,530 copying src/unitxt/catalog/metrics/llm_as_judge/direct/together_ai/llama3_1_70b.json -> build/lib/unitxt/catalog/metrics/llm_as_judge/direct/together_ai 2026-01-06T13:30:12,533 copying src/unitxt/catalog/metrics/llm_as_judge/direct/together_ai/llama3_1_8b.json -> build/lib/unitxt/catalog/metrics/llm_as_judge/direct/together_ai 2026-01-06T13:30:12,535 creating build/lib/unitxt/catalog/metrics/llm_as_judge/direct/azure_openai 2026-01-06T13:30:12,536 copying src/unitxt/catalog/metrics/llm_as_judge/direct/azure_openai/o1_preview.json -> build/lib/unitxt/catalog/metrics/llm_as_judge/direct/azure_openai 2026-01-06T13:30:12,539 copying src/unitxt/catalog/metrics/llm_as_judge/direct/azure_openai/llama4_maverick.json -> build/lib/unitxt/catalog/metrics/llm_as_judge/direct/azure_openai 2026-01-06T13:30:12,541 copying src/unitxt/catalog/metrics/llm_as_judge/direct/azure_openai/llama4_scout.json -> build/lib/unitxt/catalog/metrics/llm_as_judge/direct/azure_openai 2026-01-06T13:30:12,543 copying src/unitxt/catalog/metrics/llm_as_judge/direct/azure_openai/llama3_3_70b.json -> build/lib/unitxt/catalog/metrics/llm_as_judge/direct/azure_openai 2026-01-06T13:30:12,546 copying src/unitxt/catalog/metrics/llm_as_judge/direct/azure_openai/o1_mini.json -> build/lib/unitxt/catalog/metrics/llm_as_judge/direct/azure_openai 2026-01-06T13:30:12,549 copying src/unitxt/catalog/metrics/llm_as_judge/direct/azure_openai/gpt_4_1_nano.json -> build/lib/unitxt/catalog/metrics/llm_as_judge/direct/azure_openai 2026-01-06T13:30:12,552 copying src/unitxt/catalog/metrics/llm_as_judge/direct/azure_openai/gpt_4_1.json -> build/lib/unitxt/catalog/metrics/llm_as_judge/direct/azure_openai 2026-01-06T13:30:12,555 copying src/unitxt/catalog/metrics/llm_as_judge/direct/azure_openai/gpt_4_1_mini.json -> build/lib/unitxt/catalog/metrics/llm_as_judge/direct/azure_openai 2026-01-06T13:30:12,557 copying src/unitxt/catalog/metrics/llm_as_judge/direct/azure_openai/gpt_4o.json -> build/lib/unitxt/catalog/metrics/llm_as_judge/direct/azure_openai 2026-01-06T13:30:12,560 creating build/lib/unitxt/catalog/metrics/llm_as_judge/direct/rits 2026-01-06T13:30:12,561 copying src/unitxt/catalog/metrics/llm_as_judge/direct/rits/deepseek_v3.json -> build/lib/unitxt/catalog/metrics/llm_as_judge/direct/rits 2026-01-06T13:30:12,563 copying src/unitxt/catalog/metrics/llm_as_judge/direct/rits/llama4_maverick.json -> build/lib/unitxt/catalog/metrics/llm_as_judge/direct/rits 2026-01-06T13:30:12,566 copying src/unitxt/catalog/metrics/llm_as_judge/direct/rits/llama4_scout.json -> build/lib/unitxt/catalog/metrics/llm_as_judge/direct/rits 2026-01-06T13:30:12,568 copying src/unitxt/catalog/metrics/llm_as_judge/direct/rits/granite3_3_8b.json -> build/lib/unitxt/catalog/metrics/llm_as_judge/direct/rits 2026-01-06T13:30:12,570 copying src/unitxt/catalog/metrics/llm_as_judge/direct/rits/llama3_1_405b.json -> build/lib/unitxt/catalog/metrics/llm_as_judge/direct/rits 2026-01-06T13:30:12,572 copying src/unitxt/catalog/metrics/llm_as_judge/direct/rits/llama3_3_70b.json -> build/lib/unitxt/catalog/metrics/llm_as_judge/direct/rits 2026-01-06T13:30:12,575 copying src/unitxt/catalog/metrics/llm_as_judge/direct/rits/mixtral8_7b.json -> build/lib/unitxt/catalog/metrics/llm_as_judge/direct/rits 2026-01-06T13:30:12,577 copying src/unitxt/catalog/metrics/llm_as_judge/direct/rits/llama3_1_8b.json -> build/lib/unitxt/catalog/metrics/llm_as_judge/direct/rits 2026-01-06T13:30:12,579 copying src/unitxt/catalog/metrics/llm_as_judge/direct/rits/granite3_2_8b.json -> build/lib/unitxt/catalog/metrics/llm_as_judge/direct/rits 2026-01-06T13:30:12,581 copying src/unitxt/catalog/metrics/llm_as_judge/direct/rits/mixtral_large.json -> build/lib/unitxt/catalog/metrics/llm_as_judge/direct/rits 2026-01-06T13:30:12,583 copying src/unitxt/catalog/metrics/llm_as_judge/direct/rits/granite3_0_8b.json -> build/lib/unitxt/catalog/metrics/llm_as_judge/direct/rits 2026-01-06T13:30:12,585 copying src/unitxt/catalog/metrics/llm_as_judge/direct/rits/granite3_1_8b.json -> build/lib/unitxt/catalog/metrics/llm_as_judge/direct/rits 2026-01-06T13:30:12,587 creating build/lib/unitxt/catalog/metrics/llm_as_judge/direct/watsonx 2026-01-06T13:30:12,588 copying src/unitxt/catalog/metrics/llm_as_judge/direct/watsonx/granite3_3_8b.json -> build/lib/unitxt/catalog/metrics/llm_as_judge/direct/watsonx 2026-01-06T13:30:12,590 copying src/unitxt/catalog/metrics/llm_as_judge/direct/watsonx/llama3_1_405b.json -> build/lib/unitxt/catalog/metrics/llm_as_judge/direct/watsonx 2026-01-06T13:30:12,592 copying src/unitxt/catalog/metrics/llm_as_judge/direct/watsonx/llama3_3_70b.json -> build/lib/unitxt/catalog/metrics/llm_as_judge/direct/watsonx 2026-01-06T13:30:12,594 copying src/unitxt/catalog/metrics/llm_as_judge/direct/watsonx/llama3_1_70b.json -> build/lib/unitxt/catalog/metrics/llm_as_judge/direct/watsonx 2026-01-06T13:30:12,596 copying src/unitxt/catalog/metrics/llm_as_judge/direct/watsonx/mixtral8_7b.json -> build/lib/unitxt/catalog/metrics/llm_as_judge/direct/watsonx 2026-01-06T13:30:12,598 copying src/unitxt/catalog/metrics/llm_as_judge/direct/watsonx/llama3_1_8b.json -> build/lib/unitxt/catalog/metrics/llm_as_judge/direct/watsonx 2026-01-06T13:30:12,600 copying src/unitxt/catalog/metrics/llm_as_judge/direct/watsonx/granite3_2_8b.json -> build/lib/unitxt/catalog/metrics/llm_as_judge/direct/watsonx 2026-01-06T13:30:12,602 copying src/unitxt/catalog/metrics/llm_as_judge/direct/watsonx/mixtral_large.json -> build/lib/unitxt/catalog/metrics/llm_as_judge/direct/watsonx 2026-01-06T13:30:12,604 copying src/unitxt/catalog/metrics/llm_as_judge/direct/watsonx/granite3_0_8b.json -> build/lib/unitxt/catalog/metrics/llm_as_judge/direct/watsonx 2026-01-06T13:30:12,607 creating build/lib/unitxt/catalog/metrics/llm_as_judge/direct/vertex_ai 2026-01-06T13:30:12,607 copying src/unitxt/catalog/metrics/llm_as_judge/direct/vertex_ai/gemini_2_5_flash.json -> build/lib/unitxt/catalog/metrics/llm_as_judge/direct/vertex_ai 2026-01-06T13:30:12,610 copying src/unitxt/catalog/metrics/llm_as_judge/direct/vertex_ai/gemmini_2_5_pro.json -> build/lib/unitxt/catalog/metrics/llm_as_judge/direct/vertex_ai 2026-01-06T13:30:12,612 creating build/lib/unitxt/catalog/metrics/llm_as_judge/direct/criteria 2026-01-06T13:30:12,613 copying src/unitxt/catalog/metrics/llm_as_judge/direct/criteria/insensitivity.json -> build/lib/unitxt/catalog/metrics/llm_as_judge/direct/criteria 2026-01-06T13:30:12,615 copying src/unitxt/catalog/metrics/llm_as_judge/direct/criteria/user_message_unethical_behavior.json -> build/lib/unitxt/catalog/metrics/llm_as_judge/direct/criteria 2026-01-06T13:30:12,617 copying src/unitxt/catalog/metrics/llm_as_judge/direct/criteria/consistency.json -> build/lib/unitxt/catalog/metrics/llm_as_judge/direct/criteria 2026-01-06T13:30:12,620 copying src/unitxt/catalog/metrics/llm_as_judge/direct/criteria/manipulative_email.json -> build/lib/unitxt/catalog/metrics/llm_as_judge/direct/criteria 2026-01-06T13:30:12,622 copying src/unitxt/catalog/metrics/llm_as_judge/direct/criteria/naturalness.json -> build/lib/unitxt/catalog/metrics/llm_as_judge/direct/criteria 2026-01-06T13:30:12,624 copying src/unitxt/catalog/metrics/llm_as_judge/direct/criteria/user_message_general_harm.json -> build/lib/unitxt/catalog/metrics/llm_as_judge/direct/criteria 2026-01-06T13:30:12,626 copying src/unitxt/catalog/metrics/llm_as_judge/direct/criteria/assistant_message_groundedness.json -> build/lib/unitxt/catalog/metrics/llm_as_judge/direct/criteria 2026-01-06T13:30:12,628 copying src/unitxt/catalog/metrics/llm_as_judge/direct/criteria/assistant_message_unethical_behavior.json -> build/lib/unitxt/catalog/metrics/llm_as_judge/direct/criteria 2026-01-06T13:30:12,630 copying src/unitxt/catalog/metrics/llm_as_judge/direct/criteria/email_effectiveness.json -> build/lib/unitxt/catalog/metrics/llm_as_judge/direct/criteria 2026-01-06T13:30:12,632 copying src/unitxt/catalog/metrics/llm_as_judge/direct/criteria/irrelevant_information.json -> build/lib/unitxt/catalog/metrics/llm_as_judge/direct/criteria 2026-01-06T13:30:12,634 copying src/unitxt/catalog/metrics/llm_as_judge/direct/criteria/toxicity.json -> build/lib/unitxt/catalog/metrics/llm_as_judge/direct/criteria 2026-01-06T13:30:12,636 copying src/unitxt/catalog/metrics/llm_as_judge/direct/criteria/logical_validity_of_reasoning.json -> build/lib/unitxt/catalog/metrics/llm_as_judge/direct/criteria 2026-01-06T13:30:12,639 copying src/unitxt/catalog/metrics/llm_as_judge/direct/criteria/examples_and_details.json -> build/lib/unitxt/catalog/metrics/llm_as_judge/direct/criteria 2026-01-06T13:30:12,641 copying src/unitxt/catalog/metrics/llm_as_judge/direct/criteria/step_by_step_reasoning_bad_grammar.json -> build/lib/unitxt/catalog/metrics/llm_as_judge/direct/criteria 2026-01-06T13:30:12,643 copying src/unitxt/catalog/metrics/llm_as_judge/direct/criteria/grammar_and_punctuation.json -> build/lib/unitxt/catalog/metrics/llm_as_judge/direct/criteria 2026-01-06T13:30:12,645 copying src/unitxt/catalog/metrics/llm_as_judge/direct/criteria/harmfulness.json -> build/lib/unitxt/catalog/metrics/llm_as_judge/direct/criteria 2026-01-06T13:30:12,647 copying src/unitxt/catalog/metrics/llm_as_judge/direct/criteria/temperature_in_celsius_and_fahrenheit.json -> build/lib/unitxt/catalog/metrics/llm_as_judge/direct/criteria 2026-01-06T13:30:12,649 copying src/unitxt/catalog/metrics/llm_as_judge/direct/criteria/step_by_step_reasoning_contradiction.json -> build/lib/unitxt/catalog/metrics/llm_as_judge/direct/criteria 2026-01-06T13:30:12,651 copying src/unitxt/catalog/metrics/llm_as_judge/direct/criteria/step_by_step_reasoning_hallucination.json -> build/lib/unitxt/catalog/metrics/llm_as_judge/direct/criteria 2026-01-06T13:30:12,653 copying src/unitxt/catalog/metrics/llm_as_judge/direct/criteria/user_message_jailbreak.json -> build/lib/unitxt/catalog/metrics/llm_as_judge/direct/criteria 2026-01-06T13:30:12,655 copying src/unitxt/catalog/metrics/llm_as_judge/direct/criteria/information_outside_reference.json -> build/lib/unitxt/catalog/metrics/llm_as_judge/direct/criteria 2026-01-06T13:30:12,658 copying src/unitxt/catalog/metrics/llm_as_judge/direct/criteria/conversational.json -> build/lib/unitxt/catalog/metrics/llm_as_judge/direct/criteria 2026-01-06T13:30:12,660 copying src/unitxt/catalog/metrics/llm_as_judge/direct/criteria/answer_relevance.json -> build/lib/unitxt/catalog/metrics/llm_as_judge/direct/criteria 2026-01-06T13:30:12,662 copying src/unitxt/catalog/metrics/llm_as_judge/direct/criteria/user_message_profanity.json -> build/lib/unitxt/catalog/metrics/llm_as_judge/direct/criteria 2026-01-06T13:30:12,664 copying src/unitxt/catalog/metrics/llm_as_judge/direct/criteria/step_by_step_reasoning_arithmetic.json -> build/lib/unitxt/catalog/metrics/llm_as_judge/direct/criteria 2026-01-06T13:30:12,666 copying src/unitxt/catalog/metrics/llm_as_judge/direct/criteria/summarization_coherence.json -> build/lib/unitxt/catalog/metrics/llm_as_judge/direct/criteria 2026-01-06T13:30:12,668 copying src/unitxt/catalog/metrics/llm_as_judge/direct/criteria/answer_completeness.json -> build/lib/unitxt/catalog/metrics/llm_as_judge/direct/criteria 2026-01-06T13:30:12,670 copying src/unitxt/catalog/metrics/llm_as_judge/direct/criteria/engagement.json -> build/lib/unitxt/catalog/metrics/llm_as_judge/direct/criteria 2026-01-06T13:30:12,673 copying src/unitxt/catalog/metrics/llm_as_judge/direct/criteria/step_by_step_reasoning_coherency.json -> build/lib/unitxt/catalog/metrics/llm_as_judge/direct/criteria 2026-01-06T13:30:12,675 copying src/unitxt/catalog/metrics/llm_as_judge/direct/criteria/step_by_step_reasoning_commonsense.json -> build/lib/unitxt/catalog/metrics/llm_as_judge/direct/criteria 2026-01-06T13:30:12,677 copying src/unitxt/catalog/metrics/llm_as_judge/direct/criteria/reference_document_faithfulness.json -> build/lib/unitxt/catalog/metrics/llm_as_judge/direct/criteria 2026-01-06T13:30:12,679 copying src/unitxt/catalog/metrics/llm_as_judge/direct/criteria/assistant_message_compliance.json -> build/lib/unitxt/catalog/metrics/llm_as_judge/direct/criteria 2026-01-06T13:30:12,681 copying src/unitxt/catalog/metrics/llm_as_judge/direct/criteria/coherence.json -> build/lib/unitxt/catalog/metrics/llm_as_judge/direct/criteria 2026-01-06T13:30:12,683 copying src/unitxt/catalog/metrics/llm_as_judge/direct/criteria/summarization_relevance.json -> build/lib/unitxt/catalog/metrics/llm_as_judge/direct/criteria 2026-01-06T13:30:12,685 copying src/unitxt/catalog/metrics/llm_as_judge/direct/criteria/step_by_step_reasoning_non_coherent.json -> build/lib/unitxt/catalog/metrics/llm_as_judge/direct/criteria 2026-01-06T13:30:12,687 copying src/unitxt/catalog/metrics/llm_as_judge/direct/criteria/empathy.json -> build/lib/unitxt/catalog/metrics/llm_as_judge/direct/criteria 2026-01-06T13:30:12,689 copying src/unitxt/catalog/metrics/llm_as_judge/direct/criteria/summarization_fluency.json -> build/lib/unitxt/catalog/metrics/llm_as_judge/direct/criteria 2026-01-06T13:30:12,691 copying src/unitxt/catalog/metrics/llm_as_judge/direct/criteria/question_answer_quality.json -> build/lib/unitxt/catalog/metrics/llm_as_judge/direct/criteria 2026-01-06T13:30:12,693 copying src/unitxt/catalog/metrics/llm_as_judge/direct/criteria/relevance.json -> build/lib/unitxt/catalog/metrics/llm_as_judge/direct/criteria 2026-01-06T13:30:12,696 copying src/unitxt/catalog/metrics/llm_as_judge/direct/criteria/assistant_message_violence.json -> build/lib/unitxt/catalog/metrics/llm_as_judge/direct/criteria 2026-01-06T13:30:12,698 copying src/unitxt/catalog/metrics/llm_as_judge/direct/criteria/objectivity.json -> build/lib/unitxt/catalog/metrics/llm_as_judge/direct/criteria 2026-01-06T13:30:12,700 copying src/unitxt/catalog/metrics/llm_as_judge/direct/criteria/step_by_step_reasoning_overall_quality.json -> build/lib/unitxt/catalog/metrics/llm_as_judge/direct/criteria 2026-01-06T13:30:12,702 copying src/unitxt/catalog/metrics/llm_as_judge/direct/criteria/user_message_social_bias.json -> build/lib/unitxt/catalog/metrics/llm_as_judge/direct/criteria 2026-01-06T13:30:12,704 copying src/unitxt/catalog/metrics/llm_as_judge/direct/criteria/email_structure.json -> build/lib/unitxt/catalog/metrics/llm_as_judge/direct/criteria 2026-01-06T13:30:12,706 copying src/unitxt/catalog/metrics/llm_as_judge/direct/criteria/summarization_preference.json -> build/lib/unitxt/catalog/metrics/llm_as_judge/direct/criteria 2026-01-06T13:30:12,708 copying src/unitxt/catalog/metrics/llm_as_judge/direct/criteria/summarization_informativeness.json -> build/lib/unitxt/catalog/metrics/llm_as_judge/direct/criteria 2026-01-06T13:30:12,711 copying src/unitxt/catalog/metrics/llm_as_judge/direct/criteria/truthfulness.json -> build/lib/unitxt/catalog/metrics/llm_as_judge/direct/criteria 2026-01-06T13:30:12,713 copying src/unitxt/catalog/metrics/llm_as_judge/direct/criteria/fluency.json -> build/lib/unitxt/catalog/metrics/llm_as_judge/direct/criteria 2026-01-06T13:30:12,715 copying src/unitxt/catalog/metrics/llm_as_judge/direct/criteria/tool_calling_correctness.json -> build/lib/unitxt/catalog/metrics/llm_as_judge/direct/criteria 2026-01-06T13:30:12,717 copying src/unitxt/catalog/metrics/llm_as_judge/direct/criteria/step_by_step_reasoning_non_factual.json -> build/lib/unitxt/catalog/metrics/llm_as_judge/direct/criteria 2026-01-06T13:30:12,720 copying src/unitxt/catalog/metrics/llm_as_judge/direct/criteria/context_context_relevance.json -> build/lib/unitxt/catalog/metrics/llm_as_judge/direct/criteria 2026-01-06T13:30:12,722 copying src/unitxt/catalog/metrics/llm_as_judge/direct/criteria/adherence_with_format.json -> build/lib/unitxt/catalog/metrics/llm_as_judge/direct/criteria 2026-01-06T13:30:12,724 copying src/unitxt/catalog/metrics/llm_as_judge/direct/criteria/step_by_step_reasoning_redundancy.json -> build/lib/unitxt/catalog/metrics/llm_as_judge/direct/criteria 2026-01-06T13:30:12,726 copying src/unitxt/catalog/metrics/llm_as_judge/direct/criteria/assistant_message_social_bias.json -> build/lib/unitxt/catalog/metrics/llm_as_judge/direct/criteria 2026-01-06T13:30:12,728 copying src/unitxt/catalog/metrics/llm_as_judge/direct/criteria/step_by_step_reasoning_missing_steps.json -> build/lib/unitxt/catalog/metrics/llm_as_judge/direct/criteria 2026-01-06T13:30:12,730 copying src/unitxt/catalog/metrics/llm_as_judge/direct/criteria/assistant_message_answer_relevance.json -> build/lib/unitxt/catalog/metrics/llm_as_judge/direct/criteria 2026-01-06T13:30:12,732 copying src/unitxt/catalog/metrics/llm_as_judge/direct/criteria/professional_tone.json -> build/lib/unitxt/catalog/metrics/llm_as_judge/direct/criteria 2026-01-06T13:30:12,734 copying src/unitxt/catalog/metrics/llm_as_judge/direct/criteria/user_message_violence.json -> build/lib/unitxt/catalog/metrics/llm_as_judge/direct/criteria 2026-01-06T13:30:12,736 copying src/unitxt/catalog/metrics/llm_as_judge/direct/criteria/conciseness.json -> build/lib/unitxt/catalog/metrics/llm_as_judge/direct/criteria 2026-01-06T13:30:12,739 copying src/unitxt/catalog/metrics/llm_as_judge/direct/criteria/translation_quality.json -> build/lib/unitxt/catalog/metrics/llm_as_judge/direct/criteria 2026-01-06T13:30:12,741 copying src/unitxt/catalog/metrics/llm_as_judge/direct/criteria/information_from_reference.json -> build/lib/unitxt/catalog/metrics/llm_as_judge/direct/criteria 2026-01-06T13:30:12,743 copying src/unitxt/catalog/metrics/llm_as_judge/direct/criteria/step_by_step_reasoning_repetition.json -> build/lib/unitxt/catalog/metrics/llm_as_judge/direct/criteria 2026-01-06T13:30:12,745 copying src/unitxt/catalog/metrics/llm_as_judge/direct/criteria/assistant_message_general_harm.json -> build/lib/unitxt/catalog/metrics/llm_as_judge/direct/criteria 2026-01-06T13:30:12,747 copying src/unitxt/catalog/metrics/llm_as_judge/direct/criteria/assistant_message_profanity.json -> build/lib/unitxt/catalog/metrics/llm_as_judge/direct/criteria 2026-01-06T13:30:12,750 copying src/unitxt/catalog/metrics/llm_as_judge/direct/criteria/step_by_step_reasoning_bad_final_answer.json -> build/lib/unitxt/catalog/metrics/llm_as_judge/direct/criteria 2026-01-06T13:30:12,752 copying src/unitxt/catalog/metrics/llm_as_judge/direct/criteria/correctness_based_on_ground_truth.json -> build/lib/unitxt/catalog/metrics/llm_as_judge/direct/criteria 2026-01-06T13:30:12,754 creating build/lib/unitxt/catalog/metrics/llm_as_judge/direct/ollama 2026-01-06T13:30:12,755 copying src/unitxt/catalog/metrics/llm_as_judge/direct/ollama/granite3_3_8b.json -> build/lib/unitxt/catalog/metrics/llm_as_judge/direct/ollama 2026-01-06T13:30:12,758 copying src/unitxt/catalog/metrics/llm_as_judge/direct/ollama/llama3_1_405b.json -> build/lib/unitxt/catalog/metrics/llm_as_judge/direct/ollama 2026-01-06T13:30:12,760 copying src/unitxt/catalog/metrics/llm_as_judge/direct/ollama/llama3_3_70b.json -> build/lib/unitxt/catalog/metrics/llm_as_judge/direct/ollama 2026-01-06T13:30:12,763 copying src/unitxt/catalog/metrics/llm_as_judge/direct/ollama/llama3_1_70b.json -> build/lib/unitxt/catalog/metrics/llm_as_judge/direct/ollama 2026-01-06T13:30:12,765 copying src/unitxt/catalog/metrics/llm_as_judge/direct/ollama/llama3_1_8b.json -> build/lib/unitxt/catalog/metrics/llm_as_judge/direct/ollama 2026-01-06T13:30:12,767 creating build/lib/unitxt/catalog/metrics/key_value_extraction 2026-01-06T13:30:12,768 copying src/unitxt/catalog/metrics/key_value_extraction/token_overlap.json -> build/lib/unitxt/catalog/metrics/key_value_extraction 2026-01-06T13:30:12,770 copying src/unitxt/catalog/metrics/key_value_extraction/accuracy.json -> build/lib/unitxt/catalog/metrics/key_value_extraction 2026-01-06T13:30:12,772 creating build/lib/unitxt/catalog/metrics/rag 2026-01-06T13:30:12,773 copying src/unitxt/catalog/metrics/rag/granite_guardian_context_relevance.json -> build/lib/unitxt/catalog/metrics/rag 2026-01-06T13:30:12,775 copying src/unitxt/catalog/metrics/rag/context_perplexity.json -> build/lib/unitxt/catalog/metrics/rag 2026-01-06T13:30:12,777 copying src/unitxt/catalog/metrics/rag/granite_guardian_groundedness.json -> build/lib/unitxt/catalog/metrics/rag 2026-01-06T13:30:12,779 copying src/unitxt/catalog/metrics/rag/answer_correctness.json -> build/lib/unitxt/catalog/metrics/rag 2026-01-06T13:30:12,781 copying src/unitxt/catalog/metrics/rag/faithfulness.json -> build/lib/unitxt/catalog/metrics/rag 2026-01-06T13:30:12,783 copying src/unitxt/catalog/metrics/rag/context_correctness.json -> build/lib/unitxt/catalog/metrics/rag 2026-01-06T13:30:12,785 copying src/unitxt/catalog/metrics/rag/context_relevance.json -> build/lib/unitxt/catalog/metrics/rag 2026-01-06T13:30:12,787 copying src/unitxt/catalog/metrics/rag/granite_guardian_answer_relevance.json -> build/lib/unitxt/catalog/metrics/rag 2026-01-06T13:30:12,790 copying src/unitxt/catalog/metrics/rag/answer_reward.json -> build/lib/unitxt/catalog/metrics/rag 2026-01-06T13:30:12,793 copying src/unitxt/catalog/metrics/rag/answer_inference.json -> build/lib/unitxt/catalog/metrics/rag 2026-01-06T13:30:12,795 creating build/lib/unitxt/catalog/metrics/rag/faithfulness 2026-01-06T13:30:12,796 copying src/unitxt/catalog/metrics/rag/faithfulness/llama_3_3_70b_instruct_wml_q_c_a.json -> build/lib/unitxt/catalog/metrics/rag/faithfulness 2026-01-06T13:30:12,799 copying src/unitxt/catalog/metrics/rag/faithfulness/sentence_bert_mini_lm.json -> build/lib/unitxt/catalog/metrics/rag/faithfulness 2026-01-06T13:30:12,801 copying src/unitxt/catalog/metrics/rag/faithfulness/llama_3_3_70b_instruct_wml_q_c_a_verbal.json -> build/lib/unitxt/catalog/metrics/rag/faithfulness 2026-01-06T13:30:12,804 copying src/unitxt/catalog/metrics/rag/faithfulness/generic_inference_engine_q_c_a.json -> build/lib/unitxt/catalog/metrics/rag/faithfulness 2026-01-06T13:30:12,806 copying src/unitxt/catalog/metrics/rag/faithfulness/vectara_hhem_2_1.json -> build/lib/unitxt/catalog/metrics/rag/faithfulness 2026-01-06T13:30:12,808 copying src/unitxt/catalog/metrics/rag/faithfulness/llama_3_3_70b_instruct_wml_q_c_a_logprobs.json -> build/lib/unitxt/catalog/metrics/rag/faithfulness 2026-01-06T13:30:12,810 copying src/unitxt/catalog/metrics/rag/faithfulness/llama_3_3_70b_instruct_wml_c_a_logprobs.json -> build/lib/unitxt/catalog/metrics/rag/faithfulness 2026-01-06T13:30:12,812 copying src/unitxt/catalog/metrics/rag/faithfulness/bert_score_k_precision.json -> build/lib/unitxt/catalog/metrics/rag/faithfulness 2026-01-06T13:30:12,814 copying src/unitxt/catalog/metrics/rag/faithfulness/generic_inference_engine_c_a_verbal.json -> build/lib/unitxt/catalog/metrics/rag/faithfulness 2026-01-06T13:30:12,816 copying src/unitxt/catalog/metrics/rag/faithfulness/llama_3_3_70b_instruct_wml_c_a_verbal.json -> build/lib/unitxt/catalog/metrics/rag/faithfulness 2026-01-06T13:30:12,819 copying src/unitxt/catalog/metrics/rag/faithfulness/generic_inference_engine_c_a.json -> build/lib/unitxt/catalog/metrics/rag/faithfulness 2026-01-06T13:30:12,821 copying src/unitxt/catalog/metrics/rag/faithfulness/sentence_bert_bge.json -> build/lib/unitxt/catalog/metrics/rag/faithfulness 2026-01-06T13:30:12,824 copying src/unitxt/catalog/metrics/rag/faithfulness/llama_index_by_gpt_3_5_turbo.json -> build/lib/unitxt/catalog/metrics/rag/faithfulness 2026-01-06T13:30:12,826 copying src/unitxt/catalog/metrics/rag/faithfulness/llama_3_3_70b_instruct_wml_c_a.json -> build/lib/unitxt/catalog/metrics/rag/faithfulness 2026-01-06T13:30:12,829 copying src/unitxt/catalog/metrics/rag/faithfulness/llama_index_by_mock.json -> build/lib/unitxt/catalog/metrics/rag/faithfulness 2026-01-06T13:30:12,831 copying src/unitxt/catalog/metrics/rag/faithfulness/token_k_precision.json -> build/lib/unitxt/catalog/metrics/rag/faithfulness 2026-01-06T13:30:12,833 copying src/unitxt/catalog/metrics/rag/faithfulness/bert_score_k_precision_ml.json -> build/lib/unitxt/catalog/metrics/rag/faithfulness 2026-01-06T13:30:12,835 copying src/unitxt/catalog/metrics/rag/faithfulness/generic_inference_engine_q_c_a_verbal.json -> build/lib/unitxt/catalog/metrics/rag/faithfulness 2026-01-06T13:30:12,838 creating build/lib/unitxt/catalog/metrics/rag/response_generation/faithfulness 2026-01-06T13:30:12,840 copying src/unitxt/catalog/metrics/rag/response_generation/faithfulness/sentence_bert_mini_lm.json -> build/lib/unitxt/catalog/metrics/rag/response_generation/faithfulness 2026-01-06T13:30:12,842 copying src/unitxt/catalog/metrics/rag/response_generation/faithfulness/llama_4_maverick_rits_judge.json -> build/lib/unitxt/catalog/metrics/rag/response_generation/faithfulness 2026-01-06T13:30:12,845 copying src/unitxt/catalog/metrics/rag/response_generation/faithfulness/llama_4_maverick_watsonx_judge.json -> build/lib/unitxt/catalog/metrics/rag/response_generation/faithfulness 2026-01-06T13:30:12,847 copying src/unitxt/catalog/metrics/rag/response_generation/faithfulness/mistral_large_instruct_watsonx_judge.json -> build/lib/unitxt/catalog/metrics/rag/response_generation/faithfulness 2026-01-06T13:30:12,849 copying src/unitxt/catalog/metrics/rag/response_generation/faithfulness/vectara_hhem_2_1.json -> build/lib/unitxt/catalog/metrics/rag/response_generation/faithfulness 2026-01-06T13:30:12,852 copying src/unitxt/catalog/metrics/rag/response_generation/faithfulness/bert_score_k_precision.json -> build/lib/unitxt/catalog/metrics/rag/response_generation/faithfulness 2026-01-06T13:30:12,854 copying src/unitxt/catalog/metrics/rag/response_generation/faithfulness/gpt_oss_120b_rits_judge.json -> build/lib/unitxt/catalog/metrics/rag/response_generation/faithfulness 2026-01-06T13:30:12,856 copying src/unitxt/catalog/metrics/rag/response_generation/faithfulness/mistral_large_instruct_rits_judge.json -> build/lib/unitxt/catalog/metrics/rag/response_generation/faithfulness 2026-01-06T13:30:12,858 copying src/unitxt/catalog/metrics/rag/response_generation/faithfulness/generic_inference_engine_judge.json -> build/lib/unitxt/catalog/metrics/rag/response_generation/faithfulness 2026-01-06T13:30:12,861 copying src/unitxt/catalog/metrics/rag/response_generation/faithfulness/sentence_bert_bge.json -> build/lib/unitxt/catalog/metrics/rag/response_generation/faithfulness 2026-01-06T13:30:12,864 copying src/unitxt/catalog/metrics/rag/response_generation/faithfulness/gpt_4o_azure_judge.json -> build/lib/unitxt/catalog/metrics/rag/response_generation/faithfulness 2026-01-06T13:30:12,866 copying src/unitxt/catalog/metrics/rag/response_generation/faithfulness/llama_3_3_70b_instruct_rits_judge.json -> build/lib/unitxt/catalog/metrics/rag/response_generation/faithfulness 2026-01-06T13:30:12,869 copying src/unitxt/catalog/metrics/rag/response_generation/faithfulness/llama_3_3_70b_instruct_watsonx_judge.json -> build/lib/unitxt/catalog/metrics/rag/response_generation/faithfulness 2026-01-06T13:30:12,872 copying src/unitxt/catalog/metrics/rag/response_generation/faithfulness/token_k_precision.json -> build/lib/unitxt/catalog/metrics/rag/response_generation/faithfulness 2026-01-06T13:30:12,874 copying src/unitxt/catalog/metrics/rag/response_generation/faithfulness/gpt_oss_120b_watsonx_judge.json -> build/lib/unitxt/catalog/metrics/rag/response_generation/faithfulness 2026-01-06T13:30:12,877 copying src/unitxt/catalog/metrics/rag/response_generation/faithfulness/bert_score_k_precision_ml.json -> build/lib/unitxt/catalog/metrics/rag/response_generation/faithfulness 2026-01-06T13:30:12,880 copying src/unitxt/catalog/metrics/rag/response_generation/faithfulness/mistral_small_3_1_24b_instruct_2503_wml_judge.json -> build/lib/unitxt/catalog/metrics/rag/response_generation/faithfulness 2026-01-06T13:30:12,882 creating build/lib/unitxt/catalog/metrics/rag/response_generation/faithfullness 2026-01-06T13:30:12,884 copying src/unitxt/catalog/metrics/rag/response_generation/faithfullness/token_overlap.json -> build/lib/unitxt/catalog/metrics/rag/response_generation/faithfullness 2026-01-06T13:30:12,886 creating build/lib/unitxt/catalog/metrics/rag/response_generation/answer_correctness 2026-01-06T13:30:12,887 copying src/unitxt/catalog/metrics/rag/response_generation/answer_correctness/bert_score_recall_ml.json -> build/lib/unitxt/catalog/metrics/rag/response_generation/answer_correctness 2026-01-06T13:30:12,890 copying src/unitxt/catalog/metrics/rag/response_generation/answer_correctness/sentence_bert_mini_lm.json -> build/lib/unitxt/catalog/metrics/rag/response_generation/answer_correctness 2026-01-06T13:30:12,893 copying src/unitxt/catalog/metrics/rag/response_generation/answer_correctness/llama_4_maverick_rits_judge.json -> build/lib/unitxt/catalog/metrics/rag/response_generation/answer_correctness 2026-01-06T13:30:12,895 copying src/unitxt/catalog/metrics/rag/response_generation/answer_correctness/llama_4_maverick_watsonx_judge.json -> build/lib/unitxt/catalog/metrics/rag/response_generation/answer_correctness 2026-01-06T13:30:12,898 copying src/unitxt/catalog/metrics/rag/response_generation/answer_correctness/mistral_large_instruct_watsonx_judge.json -> build/lib/unitxt/catalog/metrics/rag/response_generation/answer_correctness 2026-01-06T13:30:12,900 copying src/unitxt/catalog/metrics/rag/response_generation/answer_correctness/bert_score_recall.json -> build/lib/unitxt/catalog/metrics/rag/response_generation/answer_correctness 2026-01-06T13:30:12,903 copying src/unitxt/catalog/metrics/rag/response_generation/answer_correctness/gpt_oss_120b_rits_judge.json -> build/lib/unitxt/catalog/metrics/rag/response_generation/answer_correctness 2026-01-06T13:30:12,906 copying src/unitxt/catalog/metrics/rag/response_generation/answer_correctness/mistral_large_instruct_rits_judge.json -> build/lib/unitxt/catalog/metrics/rag/response_generation/answer_correctness 2026-01-06T13:30:12,909 copying src/unitxt/catalog/metrics/rag/response_generation/answer_correctness/generic_inference_engine_judge.json -> build/lib/unitxt/catalog/metrics/rag/response_generation/answer_correctness 2026-01-06T13:30:12,911 copying src/unitxt/catalog/metrics/rag/response_generation/answer_correctness/sentence_bert_bge.json -> build/lib/unitxt/catalog/metrics/rag/response_generation/answer_correctness 2026-01-06T13:30:12,914 copying src/unitxt/catalog/metrics/rag/response_generation/answer_correctness/gpt_4o_azure_judge.json -> build/lib/unitxt/catalog/metrics/rag/response_generation/answer_correctness 2026-01-06T13:30:12,916 copying src/unitxt/catalog/metrics/rag/response_generation/answer_correctness/llama_3_3_70b_instruct_rits_judge.json -> build/lib/unitxt/catalog/metrics/rag/response_generation/answer_correctness 2026-01-06T13:30:12,919 copying src/unitxt/catalog/metrics/rag/response_generation/answer_correctness/llama_3_3_70b_instruct_watsonx_judge.json -> build/lib/unitxt/catalog/metrics/rag/response_generation/answer_correctness 2026-01-06T13:30:12,922 copying src/unitxt/catalog/metrics/rag/response_generation/answer_correctness/token_recall.json -> build/lib/unitxt/catalog/metrics/rag/response_generation/answer_correctness 2026-01-06T13:30:12,925 copying src/unitxt/catalog/metrics/rag/response_generation/answer_correctness/gpt_oss_120b_watsonx_judge.json -> build/lib/unitxt/catalog/metrics/rag/response_generation/answer_correctness 2026-01-06T13:30:12,927 copying src/unitxt/catalog/metrics/rag/response_generation/answer_correctness/mistral_small_3_1_24b_instruct_2503_wml_judge.json -> build/lib/unitxt/catalog/metrics/rag/response_generation/answer_correctness 2026-01-06T13:30:12,930 creating build/lib/unitxt/catalog/metrics/rag/response_generation/adherence_with_format 2026-01-06T13:30:12,931 copying src/unitxt/catalog/metrics/rag/response_generation/adherence_with_format/llama_3_3_70b_instruct_judge.json -> build/lib/unitxt/catalog/metrics/rag/response_generation/adherence_with_format 2026-01-06T13:30:12,934 creating build/lib/unitxt/catalog/metrics/rag/response_generation/answer_completeness 2026-01-06T13:30:12,935 copying src/unitxt/catalog/metrics/rag/response_generation/answer_completeness/llama_3_3_70b_instruct_judge.json -> build/lib/unitxt/catalog/metrics/rag/response_generation/answer_completeness 2026-01-06T13:30:12,938 creating build/lib/unitxt/catalog/metrics/rag/response_generation/correctness 2026-01-06T13:30:12,940 copying src/unitxt/catalog/metrics/rag/response_generation/correctness/token_overlap.json -> build/lib/unitxt/catalog/metrics/rag/response_generation/correctness 2026-01-06T13:30:12,942 creating build/lib/unitxt/catalog/metrics/rag/response_generation/correctness/bert_score 2026-01-06T13:30:12,943 copying src/unitxt/catalog/metrics/rag/response_generation/correctness/bert_score/deberta_v3_base_mnli_xnli_ml.json -> build/lib/unitxt/catalog/metrics/rag/response_generation/correctness/bert_score 2026-01-06T13:30:12,946 copying src/unitxt/catalog/metrics/rag/response_generation/correctness/bert_score/deberta_large_mnli.json -> build/lib/unitxt/catalog/metrics/rag/response_generation/correctness/bert_score 2026-01-06T13:30:12,949 creating build/lib/unitxt/catalog/metrics/rag/response_generation/answer_relevance 2026-01-06T13:30:12,950 copying src/unitxt/catalog/metrics/rag/response_generation/answer_relevance/llama_4_maverick_rits_judge.json -> build/lib/unitxt/catalog/metrics/rag/response_generation/answer_relevance 2026-01-06T13:30:12,953 copying src/unitxt/catalog/metrics/rag/response_generation/answer_relevance/llama_4_maverick_watsonx_judge.json -> build/lib/unitxt/catalog/metrics/rag/response_generation/answer_relevance 2026-01-06T13:30:12,956 copying src/unitxt/catalog/metrics/rag/response_generation/answer_relevance/mistral_large_instruct_watsonx_judge.json -> build/lib/unitxt/catalog/metrics/rag/response_generation/answer_relevance 2026-01-06T13:30:12,958 copying src/unitxt/catalog/metrics/rag/response_generation/answer_relevance/gpt_oss_120b_rits_judge.json -> build/lib/unitxt/catalog/metrics/rag/response_generation/answer_relevance 2026-01-06T13:30:12,960 copying src/unitxt/catalog/metrics/rag/response_generation/answer_relevance/mistral_large_instruct_rits_judge.json -> build/lib/unitxt/catalog/metrics/rag/response_generation/answer_relevance 2026-01-06T13:30:12,962 copying src/unitxt/catalog/metrics/rag/response_generation/answer_relevance/generic_inference_engine_judge.json -> build/lib/unitxt/catalog/metrics/rag/response_generation/answer_relevance 2026-01-06T13:30:12,965 copying src/unitxt/catalog/metrics/rag/response_generation/answer_relevance/gpt_4o_azure_judge.json -> build/lib/unitxt/catalog/metrics/rag/response_generation/answer_relevance 2026-01-06T13:30:12,967 copying src/unitxt/catalog/metrics/rag/response_generation/answer_relevance/llama_3_3_70b_instruct_rits_judge.json -> build/lib/unitxt/catalog/metrics/rag/response_generation/answer_relevance 2026-01-06T13:30:12,969 copying src/unitxt/catalog/metrics/rag/response_generation/answer_relevance/llama_3_3_70b_instruct_watsonx_judge.json -> build/lib/unitxt/catalog/metrics/rag/response_generation/answer_relevance 2026-01-06T13:30:12,971 copying src/unitxt/catalog/metrics/rag/response_generation/answer_relevance/token_recall.json -> build/lib/unitxt/catalog/metrics/rag/response_generation/answer_relevance 2026-01-06T13:30:12,973 copying src/unitxt/catalog/metrics/rag/response_generation/answer_relevance/gpt_oss_120b_watsonx_judge.json -> build/lib/unitxt/catalog/metrics/rag/response_generation/answer_relevance 2026-01-06T13:30:12,975 copying src/unitxt/catalog/metrics/rag/response_generation/answer_relevance/answer_reward.json -> build/lib/unitxt/catalog/metrics/rag/response_generation/answer_relevance 2026-01-06T13:30:12,977 copying src/unitxt/catalog/metrics/rag/response_generation/answer_relevance/mistral_small_3_1_24b_instruct_2503_wml_judge.json -> build/lib/unitxt/catalog/metrics/rag/response_generation/answer_relevance 2026-01-06T13:30:12,979 creating build/lib/unitxt/catalog/metrics/rag/response_generation/recommended/llmaj_rits 2026-01-06T13:30:12,981 copying src/unitxt/catalog/metrics/rag/response_generation/recommended/llmaj_rits/all.json -> build/lib/unitxt/catalog/metrics/rag/response_generation/recommended/llmaj_rits 2026-01-06T13:30:12,983 creating build/lib/unitxt/catalog/metrics/rag/response_generation/recommended/small_llm 2026-01-06T13:30:12,984 copying src/unitxt/catalog/metrics/rag/response_generation/recommended/small_llm/all.json -> build/lib/unitxt/catalog/metrics/rag/response_generation/recommended/small_llm 2026-01-06T13:30:12,986 creating build/lib/unitxt/catalog/metrics/rag/response_generation/recommended/cpu_only 2026-01-06T13:30:12,987 copying src/unitxt/catalog/metrics/rag/response_generation/recommended/cpu_only/all.json -> build/lib/unitxt/catalog/metrics/rag/response_generation/recommended/cpu_only 2026-01-06T13:30:12,989 creating build/lib/unitxt/catalog/metrics/rag/response_generation/recommended/llmaj_watsonx 2026-01-06T13:30:12,990 copying src/unitxt/catalog/metrics/rag/response_generation/recommended/llmaj_watsonx/all.json -> build/lib/unitxt/catalog/metrics/rag/response_generation/recommended/llmaj_watsonx 2026-01-06T13:30:12,992 creating build/lib/unitxt/catalog/metrics/rag/response_generation/recommended/llmaj_azure 2026-01-06T13:30:12,993 copying src/unitxt/catalog/metrics/rag/response_generation/recommended/llmaj_azure/all.json -> build/lib/unitxt/catalog/metrics/rag/response_generation/recommended/llmaj_azure 2026-01-06T13:30:12,995 creating build/lib/unitxt/catalog/metrics/rag/correctness_holistic 2026-01-06T13:30:12,996 copying src/unitxt/catalog/metrics/rag/correctness_holistic/llama_3_3_70b_instruct_wml_q_c_a.json -> build/lib/unitxt/catalog/metrics/rag/correctness_holistic 2026-01-06T13:30:12,998 copying src/unitxt/catalog/metrics/rag/correctness_holistic/generic_inference_engine_q_c_a_numeric.json -> build/lib/unitxt/catalog/metrics/rag/correctness_holistic 2026-01-06T13:30:13,000 copying src/unitxt/catalog/metrics/rag/correctness_holistic/generic_inference_engine_q_c_a.json -> build/lib/unitxt/catalog/metrics/rag/correctness_holistic 2026-01-06T13:30:13,002 copying src/unitxt/catalog/metrics/rag/correctness_holistic/llama_3_3_70b_instruct_wml_q_c_a_logprobs.json -> build/lib/unitxt/catalog/metrics/rag/correctness_holistic 2026-01-06T13:30:13,005 copying src/unitxt/catalog/metrics/rag/correctness_holistic/llama_3_3_70b_instruct_wml_q_c_a_numeric.json -> build/lib/unitxt/catalog/metrics/rag/correctness_holistic 2026-01-06T13:30:13,007 creating build/lib/unitxt/catalog/metrics/rag/external_rag 2026-01-06T13:30:13,007 copying src/unitxt/catalog/metrics/rag/external_rag/answer_correctness.json -> build/lib/unitxt/catalog/metrics/rag/external_rag 2026-01-06T13:30:13,010 copying src/unitxt/catalog/metrics/rag/external_rag/faithfulness.json -> build/lib/unitxt/catalog/metrics/rag/external_rag 2026-01-06T13:30:13,012 copying src/unitxt/catalog/metrics/rag/external_rag/context_correctness.json -> build/lib/unitxt/catalog/metrics/rag/external_rag 2026-01-06T13:30:13,014 copying src/unitxt/catalog/metrics/rag/external_rag/context_relevance.json -> build/lib/unitxt/catalog/metrics/rag/external_rag 2026-01-06T13:30:13,016 copying src/unitxt/catalog/metrics/rag/external_rag/answer_reward.json -> build/lib/unitxt/catalog/metrics/rag/external_rag 2026-01-06T13:30:13,018 creating build/lib/unitxt/catalog/metrics/rag/external_rag/faithfulness 2026-01-06T13:30:13,019 copying src/unitxt/catalog/metrics/rag/external_rag/faithfulness/sentence_bert_mini_lm.json -> build/lib/unitxt/catalog/metrics/rag/external_rag/faithfulness 2026-01-06T13:30:13,022 copying src/unitxt/catalog/metrics/rag/external_rag/faithfulness/llama_4_maverick_rits_judge.json -> build/lib/unitxt/catalog/metrics/rag/external_rag/faithfulness 2026-01-06T13:30:13,024 copying src/unitxt/catalog/metrics/rag/external_rag/faithfulness/llama_4_maverick_watsonx_judge.json -> build/lib/unitxt/catalog/metrics/rag/external_rag/faithfulness 2026-01-06T13:30:13,026 copying src/unitxt/catalog/metrics/rag/external_rag/faithfulness/mistral_large_instruct_watsonx_judge.json -> build/lib/unitxt/catalog/metrics/rag/external_rag/faithfulness 2026-01-06T13:30:13,028 copying src/unitxt/catalog/metrics/rag/external_rag/faithfulness/vectara_hhem_2_1.json -> build/lib/unitxt/catalog/metrics/rag/external_rag/faithfulness 2026-01-06T13:30:13,030 copying src/unitxt/catalog/metrics/rag/external_rag/faithfulness/bert_score_k_precision.json -> build/lib/unitxt/catalog/metrics/rag/external_rag/faithfulness 2026-01-06T13:30:13,032 copying src/unitxt/catalog/metrics/rag/external_rag/faithfulness/gpt_oss_120b_rits_judge.json -> build/lib/unitxt/catalog/metrics/rag/external_rag/faithfulness 2026-01-06T13:30:13,034 copying src/unitxt/catalog/metrics/rag/external_rag/faithfulness/mistral_large_instruct_rits_judge.json -> build/lib/unitxt/catalog/metrics/rag/external_rag/faithfulness 2026-01-06T13:30:13,037 copying src/unitxt/catalog/metrics/rag/external_rag/faithfulness/generic_inference_engine_judge.json -> build/lib/unitxt/catalog/metrics/rag/external_rag/faithfulness 2026-01-06T13:30:13,039 copying src/unitxt/catalog/metrics/rag/external_rag/faithfulness/sentence_bert_bge.json -> build/lib/unitxt/catalog/metrics/rag/external_rag/faithfulness 2026-01-06T13:30:13,041 copying src/unitxt/catalog/metrics/rag/external_rag/faithfulness/gpt_4o_azure_judge.json -> build/lib/unitxt/catalog/metrics/rag/external_rag/faithfulness 2026-01-06T13:30:13,043 copying src/unitxt/catalog/metrics/rag/external_rag/faithfulness/llama_3_3_70b_instruct_rits_judge.json -> build/lib/unitxt/catalog/metrics/rag/external_rag/faithfulness 2026-01-06T13:30:13,045 copying src/unitxt/catalog/metrics/rag/external_rag/faithfulness/llama_3_3_70b_instruct_watsonx_judge.json -> build/lib/unitxt/catalog/metrics/rag/external_rag/faithfulness 2026-01-06T13:30:13,047 copying src/unitxt/catalog/metrics/rag/external_rag/faithfulness/token_k_precision.json -> build/lib/unitxt/catalog/metrics/rag/external_rag/faithfulness 2026-01-06T13:30:13,050 copying src/unitxt/catalog/metrics/rag/external_rag/faithfulness/gpt_oss_120b_watsonx_judge.json -> build/lib/unitxt/catalog/metrics/rag/external_rag/faithfulness 2026-01-06T13:30:13,052 copying src/unitxt/catalog/metrics/rag/external_rag/faithfulness/bert_score_k_precision_ml.json -> build/lib/unitxt/catalog/metrics/rag/external_rag/faithfulness 2026-01-06T13:30:13,054 copying src/unitxt/catalog/metrics/rag/external_rag/faithfulness/mistral_small_3_1_24b_instruct_2503_wml_judge.json -> build/lib/unitxt/catalog/metrics/rag/external_rag/faithfulness 2026-01-06T13:30:13,056 creating build/lib/unitxt/catalog/metrics/rag/external_rag/context_relevance 2026-01-06T13:30:13,057 copying src/unitxt/catalog/metrics/rag/external_rag/context_relevance/sentence_bert_mini_lm.json -> build/lib/unitxt/catalog/metrics/rag/external_rag/context_relevance 2026-01-06T13:30:13,059 copying src/unitxt/catalog/metrics/rag/external_rag/context_relevance/llama_4_maverick_rits_judge.json -> build/lib/unitxt/catalog/metrics/rag/external_rag/context_relevance 2026-01-06T13:30:13,061 copying src/unitxt/catalog/metrics/rag/external_rag/context_relevance/perplexity_flan_t5_small.json -> build/lib/unitxt/catalog/metrics/rag/external_rag/context_relevance 2026-01-06T13:30:13,064 copying src/unitxt/catalog/metrics/rag/external_rag/context_relevance/llama_4_maverick_watsonx_judge.json -> build/lib/unitxt/catalog/metrics/rag/external_rag/context_relevance 2026-01-06T13:30:13,066 copying src/unitxt/catalog/metrics/rag/external_rag/context_relevance/mistral_large_instruct_watsonx_judge.json -> build/lib/unitxt/catalog/metrics/rag/external_rag/context_relevance 2026-01-06T13:30:13,068 copying src/unitxt/catalog/metrics/rag/external_rag/context_relevance/gpt_oss_120b_rits_judge.json -> build/lib/unitxt/catalog/metrics/rag/external_rag/context_relevance 2026-01-06T13:30:13,070 copying src/unitxt/catalog/metrics/rag/external_rag/context_relevance/mistral_large_instruct_rits_judge.json -> build/lib/unitxt/catalog/metrics/rag/external_rag/context_relevance 2026-01-06T13:30:13,072 copying src/unitxt/catalog/metrics/rag/external_rag/context_relevance/token_precision.json -> build/lib/unitxt/catalog/metrics/rag/external_rag/context_relevance 2026-01-06T13:30:13,074 copying src/unitxt/catalog/metrics/rag/external_rag/context_relevance/generic_inference_engine_judge.json -> build/lib/unitxt/catalog/metrics/rag/external_rag/context_relevance 2026-01-06T13:30:13,076 copying src/unitxt/catalog/metrics/rag/external_rag/context_relevance/sentence_bert_bge.json -> build/lib/unitxt/catalog/metrics/rag/external_rag/context_relevance 2026-01-06T13:30:13,078 copying src/unitxt/catalog/metrics/rag/external_rag/context_relevance/gpt_4o_azure_judge.json -> build/lib/unitxt/catalog/metrics/rag/external_rag/context_relevance 2026-01-06T13:30:13,080 copying src/unitxt/catalog/metrics/rag/external_rag/context_relevance/llama_3_3_70b_instruct_rits_judge.json -> build/lib/unitxt/catalog/metrics/rag/external_rag/context_relevance 2026-01-06T13:30:13,082 copying src/unitxt/catalog/metrics/rag/external_rag/context_relevance/llama_3_3_70b_instruct_watsonx_judge.json -> build/lib/unitxt/catalog/metrics/rag/external_rag/context_relevance 2026-01-06T13:30:13,085 copying src/unitxt/catalog/metrics/rag/external_rag/context_relevance/gpt_oss_120b_watsonx_judge.json -> build/lib/unitxt/catalog/metrics/rag/external_rag/context_relevance 2026-01-06T13:30:13,087 copying src/unitxt/catalog/metrics/rag/external_rag/context_relevance/mistral_small_3_1_24b_instruct_2503_wml_judge.json -> build/lib/unitxt/catalog/metrics/rag/external_rag/context_relevance 2026-01-06T13:30:13,089 creating build/lib/unitxt/catalog/metrics/rag/external_rag/answer_correctness 2026-01-06T13:30:13,090 copying src/unitxt/catalog/metrics/rag/external_rag/answer_correctness/bert_score_recall_ml.json -> build/lib/unitxt/catalog/metrics/rag/external_rag/answer_correctness 2026-01-06T13:30:13,092 copying src/unitxt/catalog/metrics/rag/external_rag/answer_correctness/sentence_bert_mini_lm.json -> build/lib/unitxt/catalog/metrics/rag/external_rag/answer_correctness 2026-01-06T13:30:13,094 copying src/unitxt/catalog/metrics/rag/external_rag/answer_correctness/llama_4_maverick_rits_judge.json -> build/lib/unitxt/catalog/metrics/rag/external_rag/answer_correctness 2026-01-06T13:30:13,096 copying src/unitxt/catalog/metrics/rag/external_rag/answer_correctness/llama_4_maverick_watsonx_judge.json -> build/lib/unitxt/catalog/metrics/rag/external_rag/answer_correctness 2026-01-06T13:30:13,098 copying src/unitxt/catalog/metrics/rag/external_rag/answer_correctness/mistral_large_instruct_watsonx_judge.json -> build/lib/unitxt/catalog/metrics/rag/external_rag/answer_correctness 2026-01-06T13:30:13,100 copying src/unitxt/catalog/metrics/rag/external_rag/answer_correctness/bert_score_recall.json -> build/lib/unitxt/catalog/metrics/rag/external_rag/answer_correctness 2026-01-06T13:30:13,102 copying src/unitxt/catalog/metrics/rag/external_rag/answer_correctness/gpt_oss_120b_rits_judge.json -> build/lib/unitxt/catalog/metrics/rag/external_rag/answer_correctness 2026-01-06T13:30:13,105 copying src/unitxt/catalog/metrics/rag/external_rag/answer_correctness/mistral_large_instruct_rits_judge.json -> build/lib/unitxt/catalog/metrics/rag/external_rag/answer_correctness 2026-01-06T13:30:13,107 copying src/unitxt/catalog/metrics/rag/external_rag/answer_correctness/generic_inference_engine_judge.json -> build/lib/unitxt/catalog/metrics/rag/external_rag/answer_correctness 2026-01-06T13:30:13,109 copying src/unitxt/catalog/metrics/rag/external_rag/answer_correctness/sentence_bert_bge.json -> build/lib/unitxt/catalog/metrics/rag/external_rag/answer_correctness 2026-01-06T13:30:13,111 copying src/unitxt/catalog/metrics/rag/external_rag/answer_correctness/gpt_4o_azure_judge.json -> build/lib/unitxt/catalog/metrics/rag/external_rag/answer_correctness 2026-01-06T13:30:13,113 copying src/unitxt/catalog/metrics/rag/external_rag/answer_correctness/llama_3_3_70b_instruct_rits_judge.json -> build/lib/unitxt/catalog/metrics/rag/external_rag/answer_correctness 2026-01-06T13:30:13,115 copying src/unitxt/catalog/metrics/rag/external_rag/answer_correctness/llama_3_3_70b_instruct_watsonx_judge.json -> build/lib/unitxt/catalog/metrics/rag/external_rag/answer_correctness 2026-01-06T13:30:13,117 copying src/unitxt/catalog/metrics/rag/external_rag/answer_correctness/token_recall.json -> build/lib/unitxt/catalog/metrics/rag/external_rag/answer_correctness 2026-01-06T13:30:13,119 copying src/unitxt/catalog/metrics/rag/external_rag/answer_correctness/gpt_oss_120b_watsonx_judge.json -> build/lib/unitxt/catalog/metrics/rag/external_rag/answer_correctness 2026-01-06T13:30:13,121 copying src/unitxt/catalog/metrics/rag/external_rag/answer_correctness/mistral_small_3_1_24b_instruct_2503_wml_judge.json -> build/lib/unitxt/catalog/metrics/rag/external_rag/answer_correctness 2026-01-06T13:30:13,123 creating build/lib/unitxt/catalog/metrics/rag/external_rag/answer_relevance 2026-01-06T13:30:13,124 copying src/unitxt/catalog/metrics/rag/external_rag/answer_relevance/llama_4_maverick_rits_judge.json -> build/lib/unitxt/catalog/metrics/rag/external_rag/answer_relevance 2026-01-06T13:30:13,126 copying src/unitxt/catalog/metrics/rag/external_rag/answer_relevance/llama_4_maverick_watsonx_judge.json -> build/lib/unitxt/catalog/metrics/rag/external_rag/answer_relevance 2026-01-06T13:30:13,128 copying src/unitxt/catalog/metrics/rag/external_rag/answer_relevance/mistral_large_instruct_watsonx_judge.json -> build/lib/unitxt/catalog/metrics/rag/external_rag/answer_relevance 2026-01-06T13:30:13,131 copying src/unitxt/catalog/metrics/rag/external_rag/answer_relevance/gpt_oss_120b_rits_judge.json -> build/lib/unitxt/catalog/metrics/rag/external_rag/answer_relevance 2026-01-06T13:30:13,133 copying src/unitxt/catalog/metrics/rag/external_rag/answer_relevance/mistral_large_instruct_rits_judge.json -> build/lib/unitxt/catalog/metrics/rag/external_rag/answer_relevance 2026-01-06T13:30:13,135 copying src/unitxt/catalog/metrics/rag/external_rag/answer_relevance/generic_inference_engine_judge.json -> build/lib/unitxt/catalog/metrics/rag/external_rag/answer_relevance 2026-01-06T13:30:13,137 copying src/unitxt/catalog/metrics/rag/external_rag/answer_relevance/gpt_4o_azure_judge.json -> build/lib/unitxt/catalog/metrics/rag/external_rag/answer_relevance 2026-01-06T13:30:13,139 copying src/unitxt/catalog/metrics/rag/external_rag/answer_relevance/llama_3_3_70b_instruct_rits_judge.json -> build/lib/unitxt/catalog/metrics/rag/external_rag/answer_relevance 2026-01-06T13:30:13,141 copying src/unitxt/catalog/metrics/rag/external_rag/answer_relevance/llama_3_3_70b_instruct_watsonx_judge.json -> build/lib/unitxt/catalog/metrics/rag/external_rag/answer_relevance 2026-01-06T13:30:13,144 copying src/unitxt/catalog/metrics/rag/external_rag/answer_relevance/token_recall.json -> build/lib/unitxt/catalog/metrics/rag/external_rag/answer_relevance 2026-01-06T13:30:13,146 copying src/unitxt/catalog/metrics/rag/external_rag/answer_relevance/gpt_oss_120b_watsonx_judge.json -> build/lib/unitxt/catalog/metrics/rag/external_rag/answer_relevance 2026-01-06T13:30:13,148 copying src/unitxt/catalog/metrics/rag/external_rag/answer_relevance/answer_reward.json -> build/lib/unitxt/catalog/metrics/rag/external_rag/answer_relevance 2026-01-06T13:30:13,150 copying src/unitxt/catalog/metrics/rag/external_rag/answer_relevance/mistral_small_3_1_24b_instruct_2503_wml_judge.json -> build/lib/unitxt/catalog/metrics/rag/external_rag/answer_relevance 2026-01-06T13:30:13,152 creating build/lib/unitxt/catalog/metrics/rag/external_rag/context_correctness 2026-01-06T13:30:13,153 copying src/unitxt/catalog/metrics/rag/external_rag/context_correctness/mrr.json -> build/lib/unitxt/catalog/metrics/rag/external_rag/context_correctness 2026-01-06T13:30:13,156 copying src/unitxt/catalog/metrics/rag/external_rag/context_correctness/retrieval_at_k.json -> build/lib/unitxt/catalog/metrics/rag/external_rag/context_correctness 2026-01-06T13:30:13,158 copying src/unitxt/catalog/metrics/rag/external_rag/context_correctness/map.json -> build/lib/unitxt/catalog/metrics/rag/external_rag/context_correctness 2026-01-06T13:30:13,160 creating build/lib/unitxt/catalog/metrics/rag/external_rag/recommended/llmaj_rits 2026-01-06T13:30:13,161 copying src/unitxt/catalog/metrics/rag/external_rag/recommended/llmaj_rits/all.json -> build/lib/unitxt/catalog/metrics/rag/external_rag/recommended/llmaj_rits 2026-01-06T13:30:13,163 creating build/lib/unitxt/catalog/metrics/rag/external_rag/recommended/small_llm 2026-01-06T13:30:13,164 copying src/unitxt/catalog/metrics/rag/external_rag/recommended/small_llm/all.json -> build/lib/unitxt/catalog/metrics/rag/external_rag/recommended/small_llm 2026-01-06T13:30:13,166 creating build/lib/unitxt/catalog/metrics/rag/external_rag/recommended/cpu_only 2026-01-06T13:30:13,167 copying src/unitxt/catalog/metrics/rag/external_rag/recommended/cpu_only/all.json -> build/lib/unitxt/catalog/metrics/rag/external_rag/recommended/cpu_only 2026-01-06T13:30:13,169 creating build/lib/unitxt/catalog/metrics/rag/external_rag/recommended/llmaj_watsonx 2026-01-06T13:30:13,170 copying src/unitxt/catalog/metrics/rag/external_rag/recommended/llmaj_watsonx/all.json -> build/lib/unitxt/catalog/metrics/rag/external_rag/recommended/llmaj_watsonx 2026-01-06T13:30:13,173 creating build/lib/unitxt/catalog/metrics/rag/external_rag/recommended/llmaj_azure 2026-01-06T13:30:13,174 copying src/unitxt/catalog/metrics/rag/external_rag/recommended/llmaj_azure/all.json -> build/lib/unitxt/catalog/metrics/rag/external_rag/recommended/llmaj_azure 2026-01-06T13:30:13,176 creating build/lib/unitxt/catalog/metrics/rag/end_to_end 2026-01-06T13:30:13,177 copying src/unitxt/catalog/metrics/rag/end_to_end/answer_correctness.json -> build/lib/unitxt/catalog/metrics/rag/end_to_end 2026-01-06T13:30:13,179 copying src/unitxt/catalog/metrics/rag/end_to_end/answer_faithfulness.json -> build/lib/unitxt/catalog/metrics/rag/end_to_end 2026-01-06T13:30:13,181 copying src/unitxt/catalog/metrics/rag/end_to_end/context_correctness.json -> build/lib/unitxt/catalog/metrics/rag/end_to_end 2026-01-06T13:30:13,183 copying src/unitxt/catalog/metrics/rag/end_to_end/context_relevance.json -> build/lib/unitxt/catalog/metrics/rag/end_to_end 2026-01-06T13:30:13,185 copying src/unitxt/catalog/metrics/rag/end_to_end/answer_reward.json -> build/lib/unitxt/catalog/metrics/rag/end_to_end 2026-01-06T13:30:13,187 creating build/lib/unitxt/catalog/metrics/rag/end_to_end/faithfulness 2026-01-06T13:30:13,188 copying src/unitxt/catalog/metrics/rag/end_to_end/faithfulness/sentence_bert_mini_lm.json -> build/lib/unitxt/catalog/metrics/rag/end_to_end/faithfulness 2026-01-06T13:30:13,191 copying src/unitxt/catalog/metrics/rag/end_to_end/faithfulness/llama_4_maverick_rits_judge.json -> build/lib/unitxt/catalog/metrics/rag/end_to_end/faithfulness 2026-01-06T13:30:13,193 copying src/unitxt/catalog/metrics/rag/end_to_end/faithfulness/llama_4_maverick_watsonx_judge.json -> build/lib/unitxt/catalog/metrics/rag/end_to_end/faithfulness 2026-01-06T13:30:13,195 copying src/unitxt/catalog/metrics/rag/end_to_end/faithfulness/mistral_large_instruct_watsonx_judge.json -> build/lib/unitxt/catalog/metrics/rag/end_to_end/faithfulness 2026-01-06T13:30:13,197 copying src/unitxt/catalog/metrics/rag/end_to_end/faithfulness/vectara_hhem_2_1.json -> build/lib/unitxt/catalog/metrics/rag/end_to_end/faithfulness 2026-01-06T13:30:13,199 copying src/unitxt/catalog/metrics/rag/end_to_end/faithfulness/bert_score_k_precision.json -> build/lib/unitxt/catalog/metrics/rag/end_to_end/faithfulness 2026-01-06T13:30:13,201 copying src/unitxt/catalog/metrics/rag/end_to_end/faithfulness/gpt_oss_120b_rits_judge.json -> build/lib/unitxt/catalog/metrics/rag/end_to_end/faithfulness 2026-01-06T13:30:13,203 copying src/unitxt/catalog/metrics/rag/end_to_end/faithfulness/mistral_large_instruct_rits_judge.json -> build/lib/unitxt/catalog/metrics/rag/end_to_end/faithfulness 2026-01-06T13:30:13,206 copying src/unitxt/catalog/metrics/rag/end_to_end/faithfulness/generic_inference_engine_judge.json -> build/lib/unitxt/catalog/metrics/rag/end_to_end/faithfulness 2026-01-06T13:30:13,208 copying src/unitxt/catalog/metrics/rag/end_to_end/faithfulness/sentence_bert_bge.json -> build/lib/unitxt/catalog/metrics/rag/end_to_end/faithfulness 2026-01-06T13:30:13,210 copying src/unitxt/catalog/metrics/rag/end_to_end/faithfulness/gpt_4o_azure_judge.json -> build/lib/unitxt/catalog/metrics/rag/end_to_end/faithfulness 2026-01-06T13:30:13,212 copying src/unitxt/catalog/metrics/rag/end_to_end/faithfulness/llama_3_3_70b_instruct_rits_judge.json -> build/lib/unitxt/catalog/metrics/rag/end_to_end/faithfulness 2026-01-06T13:30:13,214 copying src/unitxt/catalog/metrics/rag/end_to_end/faithfulness/llama_3_3_70b_instruct_watsonx_judge.json -> build/lib/unitxt/catalog/metrics/rag/end_to_end/faithfulness 2026-01-06T13:30:13,216 copying src/unitxt/catalog/metrics/rag/end_to_end/faithfulness/token_k_precision.json -> build/lib/unitxt/catalog/metrics/rag/end_to_end/faithfulness 2026-01-06T13:30:13,218 copying src/unitxt/catalog/metrics/rag/end_to_end/faithfulness/gpt_oss_120b_watsonx_judge.json -> build/lib/unitxt/catalog/metrics/rag/end_to_end/faithfulness 2026-01-06T13:30:13,220 copying src/unitxt/catalog/metrics/rag/end_to_end/faithfulness/bert_score_k_precision_ml.json -> build/lib/unitxt/catalog/metrics/rag/end_to_end/faithfulness 2026-01-06T13:30:13,223 copying src/unitxt/catalog/metrics/rag/end_to_end/faithfulness/mistral_small_3_1_24b_instruct_2503_wml_judge.json -> build/lib/unitxt/catalog/metrics/rag/end_to_end/faithfulness 2026-01-06T13:30:13,225 creating build/lib/unitxt/catalog/metrics/rag/end_to_end/context_relevance 2026-01-06T13:30:13,226 copying src/unitxt/catalog/metrics/rag/end_to_end/context_relevance/sentence_bert_mini_lm.json -> build/lib/unitxt/catalog/metrics/rag/end_to_end/context_relevance 2026-01-06T13:30:13,228 copying src/unitxt/catalog/metrics/rag/end_to_end/context_relevance/llama_4_maverick_rits_judge.json -> build/lib/unitxt/catalog/metrics/rag/end_to_end/context_relevance 2026-01-06T13:30:13,230 copying src/unitxt/catalog/metrics/rag/end_to_end/context_relevance/perplexity_flan_t5_small.json -> build/lib/unitxt/catalog/metrics/rag/end_to_end/context_relevance 2026-01-06T13:30:13,232 copying src/unitxt/catalog/metrics/rag/end_to_end/context_relevance/llama_4_maverick_watsonx_judge.json -> build/lib/unitxt/catalog/metrics/rag/end_to_end/context_relevance 2026-01-06T13:30:13,234 copying src/unitxt/catalog/metrics/rag/end_to_end/context_relevance/mistral_large_instruct_watsonx_judge.json -> build/lib/unitxt/catalog/metrics/rag/end_to_end/context_relevance 2026-01-06T13:30:13,236 copying src/unitxt/catalog/metrics/rag/end_to_end/context_relevance/gpt_oss_120b_rits_judge.json -> build/lib/unitxt/catalog/metrics/rag/end_to_end/context_relevance 2026-01-06T13:30:13,238 copying src/unitxt/catalog/metrics/rag/end_to_end/context_relevance/mistral_large_instruct_rits_judge.json -> build/lib/unitxt/catalog/metrics/rag/end_to_end/context_relevance 2026-01-06T13:30:13,241 copying src/unitxt/catalog/metrics/rag/end_to_end/context_relevance/token_precision.json -> build/lib/unitxt/catalog/metrics/rag/end_to_end/context_relevance 2026-01-06T13:30:13,243 copying src/unitxt/catalog/metrics/rag/end_to_end/context_relevance/generic_inference_engine_judge.json -> build/lib/unitxt/catalog/metrics/rag/end_to_end/context_relevance 2026-01-06T13:30:13,245 copying src/unitxt/catalog/metrics/rag/end_to_end/context_relevance/sentence_bert_bge.json -> build/lib/unitxt/catalog/metrics/rag/end_to_end/context_relevance 2026-01-06T13:30:13,247 copying src/unitxt/catalog/metrics/rag/end_to_end/context_relevance/gpt_4o_azure_judge.json -> build/lib/unitxt/catalog/metrics/rag/end_to_end/context_relevance 2026-01-06T13:30:13,249 copying src/unitxt/catalog/metrics/rag/end_to_end/context_relevance/llama_3_3_70b_instruct_rits_judge.json -> build/lib/unitxt/catalog/metrics/rag/end_to_end/context_relevance 2026-01-06T13:30:13,251 copying src/unitxt/catalog/metrics/rag/end_to_end/context_relevance/llama_3_3_70b_instruct_watsonx_judge.json -> build/lib/unitxt/catalog/metrics/rag/end_to_end/context_relevance 2026-01-06T13:30:13,253 copying src/unitxt/catalog/metrics/rag/end_to_end/context_relevance/gpt_oss_120b_watsonx_judge.json -> build/lib/unitxt/catalog/metrics/rag/end_to_end/context_relevance 2026-01-06T13:30:13,255 copying src/unitxt/catalog/metrics/rag/end_to_end/context_relevance/mistral_small_3_1_24b_instruct_2503_wml_judge.json -> build/lib/unitxt/catalog/metrics/rag/end_to_end/context_relevance 2026-01-06T13:30:13,257 creating build/lib/unitxt/catalog/metrics/rag/end_to_end/answer_correctness 2026-01-06T13:30:13,258 copying src/unitxt/catalog/metrics/rag/end_to_end/answer_correctness/bert_score_recall_ml.json -> build/lib/unitxt/catalog/metrics/rag/end_to_end/answer_correctness 2026-01-06T13:30:13,260 copying src/unitxt/catalog/metrics/rag/end_to_end/answer_correctness/sentence_bert_mini_lm.json -> build/lib/unitxt/catalog/metrics/rag/end_to_end/answer_correctness 2026-01-06T13:30:13,262 copying src/unitxt/catalog/metrics/rag/end_to_end/answer_correctness/llama_4_maverick_rits_judge.json -> build/lib/unitxt/catalog/metrics/rag/end_to_end/answer_correctness 2026-01-06T13:30:13,264 copying src/unitxt/catalog/metrics/rag/end_to_end/answer_correctness/llama_4_maverick_watsonx_judge.json -> build/lib/unitxt/catalog/metrics/rag/end_to_end/answer_correctness 2026-01-06T13:30:13,267 copying src/unitxt/catalog/metrics/rag/end_to_end/answer_correctness/mistral_large_instruct_watsonx_judge.json -> build/lib/unitxt/catalog/metrics/rag/end_to_end/answer_correctness 2026-01-06T13:30:13,269 copying src/unitxt/catalog/metrics/rag/end_to_end/answer_correctness/bert_score_recall.json -> build/lib/unitxt/catalog/metrics/rag/end_to_end/answer_correctness 2026-01-06T13:30:13,271 copying src/unitxt/catalog/metrics/rag/end_to_end/answer_correctness/gpt_oss_120b_rits_judge.json -> build/lib/unitxt/catalog/metrics/rag/end_to_end/answer_correctness 2026-01-06T13:30:13,273 copying src/unitxt/catalog/metrics/rag/end_to_end/answer_correctness/mistral_large_instruct_rits_judge.json -> build/lib/unitxt/catalog/metrics/rag/end_to_end/answer_correctness 2026-01-06T13:30:13,275 copying src/unitxt/catalog/metrics/rag/end_to_end/answer_correctness/generic_inference_engine_judge.json -> build/lib/unitxt/catalog/metrics/rag/end_to_end/answer_correctness 2026-01-06T13:30:13,277 copying src/unitxt/catalog/metrics/rag/end_to_end/answer_correctness/sentence_bert_bge.json -> build/lib/unitxt/catalog/metrics/rag/end_to_end/answer_correctness 2026-01-06T13:30:13,279 copying src/unitxt/catalog/metrics/rag/end_to_end/answer_correctness/gpt_4o_azure_judge.json -> build/lib/unitxt/catalog/metrics/rag/end_to_end/answer_correctness 2026-01-06T13:30:13,282 copying src/unitxt/catalog/metrics/rag/end_to_end/answer_correctness/llama_3_3_70b_instruct_rits_judge.json -> build/lib/unitxt/catalog/metrics/rag/end_to_end/answer_correctness 2026-01-06T13:30:13,284 copying src/unitxt/catalog/metrics/rag/end_to_end/answer_correctness/llama_3_3_70b_instruct_watsonx_judge.json -> build/lib/unitxt/catalog/metrics/rag/end_to_end/answer_correctness 2026-01-06T13:30:13,286 copying src/unitxt/catalog/metrics/rag/end_to_end/answer_correctness/token_recall.json -> build/lib/unitxt/catalog/metrics/rag/end_to_end/answer_correctness 2026-01-06T13:30:13,288 copying src/unitxt/catalog/metrics/rag/end_to_end/answer_correctness/gpt_oss_120b_watsonx_judge.json -> build/lib/unitxt/catalog/metrics/rag/end_to_end/answer_correctness 2026-01-06T13:30:13,291 copying src/unitxt/catalog/metrics/rag/end_to_end/answer_correctness/mistral_small_3_1_24b_instruct_2503_wml_judge.json -> build/lib/unitxt/catalog/metrics/rag/end_to_end/answer_correctness 2026-01-06T13:30:13,293 creating build/lib/unitxt/catalog/metrics/rag/end_to_end/answer_relevance 2026-01-06T13:30:13,294 copying src/unitxt/catalog/metrics/rag/end_to_end/answer_relevance/llama_4_maverick_rits_judge.json -> build/lib/unitxt/catalog/metrics/rag/end_to_end/answer_relevance 2026-01-06T13:30:13,296 copying src/unitxt/catalog/metrics/rag/end_to_end/answer_relevance/llama_4_maverick_watsonx_judge.json -> build/lib/unitxt/catalog/metrics/rag/end_to_end/answer_relevance 2026-01-06T13:30:13,298 copying src/unitxt/catalog/metrics/rag/end_to_end/answer_relevance/mistral_large_instruct_watsonx_judge.json -> build/lib/unitxt/catalog/metrics/rag/end_to_end/answer_relevance 2026-01-06T13:30:13,300 copying src/unitxt/catalog/metrics/rag/end_to_end/answer_relevance/gpt_oss_120b_rits_judge.json -> build/lib/unitxt/catalog/metrics/rag/end_to_end/answer_relevance 2026-01-06T13:30:13,303 copying src/unitxt/catalog/metrics/rag/end_to_end/answer_relevance/mistral_large_instruct_rits_judge.json -> build/lib/unitxt/catalog/metrics/rag/end_to_end/answer_relevance 2026-01-06T13:30:13,305 copying src/unitxt/catalog/metrics/rag/end_to_end/answer_relevance/generic_inference_engine_judge.json -> build/lib/unitxt/catalog/metrics/rag/end_to_end/answer_relevance 2026-01-06T13:30:13,307 copying src/unitxt/catalog/metrics/rag/end_to_end/answer_relevance/gpt_4o_azure_judge.json -> build/lib/unitxt/catalog/metrics/rag/end_to_end/answer_relevance 2026-01-06T13:30:13,309 copying src/unitxt/catalog/metrics/rag/end_to_end/answer_relevance/llama_3_3_70b_instruct_rits_judge.json -> build/lib/unitxt/catalog/metrics/rag/end_to_end/answer_relevance 2026-01-06T13:30:13,311 copying src/unitxt/catalog/metrics/rag/end_to_end/answer_relevance/llama_3_3_70b_instruct_watsonx_judge.json -> build/lib/unitxt/catalog/metrics/rag/end_to_end/answer_relevance 2026-01-06T13:30:13,313 copying src/unitxt/catalog/metrics/rag/end_to_end/answer_relevance/token_recall.json -> build/lib/unitxt/catalog/metrics/rag/end_to_end/answer_relevance 2026-01-06T13:30:13,316 copying src/unitxt/catalog/metrics/rag/end_to_end/answer_relevance/gpt_oss_120b_watsonx_judge.json -> build/lib/unitxt/catalog/metrics/rag/end_to_end/answer_relevance 2026-01-06T13:30:13,318 copying src/unitxt/catalog/metrics/rag/end_to_end/answer_relevance/answer_reward.json -> build/lib/unitxt/catalog/metrics/rag/end_to_end/answer_relevance 2026-01-06T13:30:13,320 copying src/unitxt/catalog/metrics/rag/end_to_end/answer_relevance/mistral_small_3_1_24b_instruct_2503_wml_judge.json -> build/lib/unitxt/catalog/metrics/rag/end_to_end/answer_relevance 2026-01-06T13:30:13,323 creating build/lib/unitxt/catalog/metrics/rag/end_to_end/context_correctness 2026-01-06T13:30:13,324 copying src/unitxt/catalog/metrics/rag/end_to_end/context_correctness/mrr.json -> build/lib/unitxt/catalog/metrics/rag/end_to_end/context_correctness 2026-01-06T13:30:13,326 copying src/unitxt/catalog/metrics/rag/end_to_end/context_correctness/retrieval_at_k.json -> build/lib/unitxt/catalog/metrics/rag/end_to_end/context_correctness 2026-01-06T13:30:13,328 copying src/unitxt/catalog/metrics/rag/end_to_end/context_correctness/map.json -> build/lib/unitxt/catalog/metrics/rag/end_to_end/context_correctness 2026-01-06T13:30:13,330 creating build/lib/unitxt/catalog/metrics/rag/end_to_end/recommended/llmaj_rits 2026-01-06T13:30:13,332 copying src/unitxt/catalog/metrics/rag/end_to_end/recommended/llmaj_rits/all.json -> build/lib/unitxt/catalog/metrics/rag/end_to_end/recommended/llmaj_rits 2026-01-06T13:30:13,334 creating build/lib/unitxt/catalog/metrics/rag/end_to_end/recommended/small_llm 2026-01-06T13:30:13,335 copying src/unitxt/catalog/metrics/rag/end_to_end/recommended/small_llm/all.json -> build/lib/unitxt/catalog/metrics/rag/end_to_end/recommended/small_llm 2026-01-06T13:30:13,338 creating build/lib/unitxt/catalog/metrics/rag/end_to_end/recommended/cpu_only 2026-01-06T13:30:13,339 copying src/unitxt/catalog/metrics/rag/end_to_end/recommended/cpu_only/all.json -> build/lib/unitxt/catalog/metrics/rag/end_to_end/recommended/cpu_only 2026-01-06T13:30:13,341 creating build/lib/unitxt/catalog/metrics/rag/end_to_end/recommended/llmaj_watsonx 2026-01-06T13:30:13,342 copying src/unitxt/catalog/metrics/rag/end_to_end/recommended/llmaj_watsonx/all.json -> build/lib/unitxt/catalog/metrics/rag/end_to_end/recommended/llmaj_watsonx 2026-01-06T13:30:13,344 creating build/lib/unitxt/catalog/metrics/rag/end_to_end/recommended/llmaj_azure 2026-01-06T13:30:13,345 copying src/unitxt/catalog/metrics/rag/end_to_end/recommended/llmaj_azure/all.json -> build/lib/unitxt/catalog/metrics/rag/end_to_end/recommended/llmaj_azure 2026-01-06T13:30:13,347 creating build/lib/unitxt/catalog/metrics/rag/context_relevance 2026-01-06T13:30:13,348 copying src/unitxt/catalog/metrics/rag/context_relevance/sentence_bert_mini_lm.json -> build/lib/unitxt/catalog/metrics/rag/context_relevance 2026-01-06T13:30:13,350 copying src/unitxt/catalog/metrics/rag/context_relevance/perplexity_flan_t5_small.json -> build/lib/unitxt/catalog/metrics/rag/context_relevance 2026-01-06T13:30:13,352 copying src/unitxt/catalog/metrics/rag/context_relevance/generic_inference_engine_q_c_ares.json -> build/lib/unitxt/catalog/metrics/rag/context_relevance 2026-01-06T13:30:13,354 copying src/unitxt/catalog/metrics/rag/context_relevance/llama_3_3_70b_instruct_wml_q_c_ares.json -> build/lib/unitxt/catalog/metrics/rag/context_relevance 2026-01-06T13:30:13,356 copying src/unitxt/catalog/metrics/rag/context_relevance/llama_3_3_70b_instruct_wml_q_c_ares_numeric.json -> build/lib/unitxt/catalog/metrics/rag/context_relevance 2026-01-06T13:30:13,358 copying src/unitxt/catalog/metrics/rag/context_relevance/token_precision.json -> build/lib/unitxt/catalog/metrics/rag/context_relevance 2026-01-06T13:30:13,360 copying src/unitxt/catalog/metrics/rag/context_relevance/llama_3_3_70b_instruct_wml_q_c_ares_logprobs.json -> build/lib/unitxt/catalog/metrics/rag/context_relevance 2026-01-06T13:30:13,362 copying src/unitxt/catalog/metrics/rag/context_relevance/sentence_bert_bge.json -> build/lib/unitxt/catalog/metrics/rag/context_relevance 2026-01-06T13:30:13,364 copying src/unitxt/catalog/metrics/rag/context_relevance/generic_inference_engine_q_c_ares_numeric.json -> build/lib/unitxt/catalog/metrics/rag/context_relevance 2026-01-06T13:30:13,366 creating build/lib/unitxt/catalog/metrics/rag/answer_correctness 2026-01-06T13:30:13,367 copying src/unitxt/catalog/metrics/rag/answer_correctness/bert_score_recall_ml.json -> build/lib/unitxt/catalog/metrics/rag/answer_correctness 2026-01-06T13:30:13,370 copying src/unitxt/catalog/metrics/rag/answer_correctness/sentence_bert_mini_lm.json -> build/lib/unitxt/catalog/metrics/rag/answer_correctness 2026-01-06T13:30:13,372 copying src/unitxt/catalog/metrics/rag/answer_correctness/llama_3_3_70b_instruct_wml_q_a_gt_loose.json -> build/lib/unitxt/catalog/metrics/rag/answer_correctness 2026-01-06T13:30:13,374 copying src/unitxt/catalog/metrics/rag/answer_correctness/llama_3_3_70b_instruct_wml_q_a_gt_loose_logprobs.json -> build/lib/unitxt/catalog/metrics/rag/answer_correctness 2026-01-06T13:30:13,376 copying src/unitxt/catalog/metrics/rag/answer_correctness/bert_score_recall.json -> build/lib/unitxt/catalog/metrics/rag/answer_correctness 2026-01-06T13:30:13,378 copying src/unitxt/catalog/metrics/rag/answer_correctness/sentence_bert_bge.json -> build/lib/unitxt/catalog/metrics/rag/answer_correctness 2026-01-06T13:30:13,380 copying src/unitxt/catalog/metrics/rag/answer_correctness/llama_3_3_70b_instruct_wml_q_a_gt_loose_numeric.json -> build/lib/unitxt/catalog/metrics/rag/answer_correctness 2026-01-06T13:30:13,383 copying src/unitxt/catalog/metrics/rag/answer_correctness/token_recall.json -> build/lib/unitxt/catalog/metrics/rag/answer_correctness 2026-01-06T13:30:13,385 copying src/unitxt/catalog/metrics/rag/answer_correctness/generic_inference_engine_q_a_gt_loose_numeric.json -> build/lib/unitxt/catalog/metrics/rag/answer_correctness 2026-01-06T13:30:13,387 copying src/unitxt/catalog/metrics/rag/answer_correctness/generic_inference_engine_q_a_gt_loose.json -> build/lib/unitxt/catalog/metrics/rag/answer_correctness 2026-01-06T13:30:13,389 creating build/lib/unitxt/catalog/metrics/rag/correctness 2026-01-06T13:30:13,390 copying src/unitxt/catalog/metrics/rag/correctness/llama_index_by_gpt_3_5_turbo.json -> build/lib/unitxt/catalog/metrics/rag/correctness 2026-01-06T13:30:13,392 copying src/unitxt/catalog/metrics/rag/correctness/llama_index_by_mock.json -> build/lib/unitxt/catalog/metrics/rag/correctness 2026-01-06T13:30:13,394 creating build/lib/unitxt/catalog/metrics/rag/answer_relevance 2026-01-06T13:30:13,395 copying src/unitxt/catalog/metrics/rag/answer_relevance/generic_inference_engine_q_a.json -> build/lib/unitxt/catalog/metrics/rag/answer_relevance 2026-01-06T13:30:13,397 copying src/unitxt/catalog/metrics/rag/answer_relevance/llama_3_3_70b_instruct_wml_q_a_numeric.json -> build/lib/unitxt/catalog/metrics/rag/answer_relevance 2026-01-06T13:30:13,399 copying src/unitxt/catalog/metrics/rag/answer_relevance/generic_inference_engine_q_a_numeric.json -> build/lib/unitxt/catalog/metrics/rag/answer_relevance 2026-01-06T13:30:13,401 copying src/unitxt/catalog/metrics/rag/answer_relevance/llama_3_3_70b_instruct_wml_q_a_logprobs.json -> build/lib/unitxt/catalog/metrics/rag/answer_relevance 2026-01-06T13:30:13,403 copying src/unitxt/catalog/metrics/rag/answer_relevance/llama_3_3_70b_instruct_wml_q_a.json -> build/lib/unitxt/catalog/metrics/rag/answer_relevance 2026-01-06T13:30:13,405 copying src/unitxt/catalog/metrics/rag/answer_relevance/token_recall.json -> build/lib/unitxt/catalog/metrics/rag/answer_relevance 2026-01-06T13:30:13,407 creating build/lib/unitxt/catalog/metrics/rag/context_correctness 2026-01-06T13:30:13,409 copying src/unitxt/catalog/metrics/rag/context_correctness/mrr.json -> build/lib/unitxt/catalog/metrics/rag/context_correctness 2026-01-06T13:30:13,411 copying src/unitxt/catalog/metrics/rag/context_correctness/retrieval_at_k.json -> build/lib/unitxt/catalog/metrics/rag/context_correctness 2026-01-06T13:30:13,413 copying src/unitxt/catalog/metrics/rag/context_correctness/map.json -> build/lib/unitxt/catalog/metrics/rag/context_correctness 2026-01-06T13:30:13,415 creating build/lib/unitxt/catalog/metrics/reward 2026-01-06T13:30:13,416 copying src/unitxt/catalog/metrics/reward/deberta_v3_large_v2.json -> build/lib/unitxt/catalog/metrics/reward 2026-01-06T13:30:13,418 creating build/lib/unitxt/catalog/metrics/perplexity_q 2026-01-06T13:30:13,419 copying src/unitxt/catalog/metrics/perplexity_q/flan_t5_small.json -> build/lib/unitxt/catalog/metrics/perplexity_q 2026-01-06T13:30:13,421 creating build/lib/unitxt/catalog/cards 2026-01-06T13:30:13,422 copying src/unitxt/catalog/cards/race_high.json -> build/lib/unitxt/catalog/cards 2026-01-06T13:30:13,424 copying src/unitxt/catalog/cards/stsb.json -> build/lib/unitxt/catalog/cards 2026-01-06T13:30:13,427 copying src/unitxt/catalog/cards/coedit_error_detection.json -> build/lib/unitxt/catalog/cards 2026-01-06T13:30:13,429 copying src/unitxt/catalog/cards/atis.json -> build/lib/unitxt/catalog/cards 2026-01-06T13:30:13,432 copying src/unitxt/catalog/cards/sciq.json -> build/lib/unitxt/catalog/cards 2026-01-06T13:30:13,434 copying src/unitxt/catalog/cards/wsc.json -> build/lib/unitxt/catalog/cards 2026-01-06T13:30:13,436 copying src/unitxt/catalog/cards/coedit_gec.json -> build/lib/unitxt/catalog/cards 2026-01-06T13:30:13,438 copying src/unitxt/catalog/cards/pop_qa_robust.json -> build/lib/unitxt/catalog/cards 2026-01-06T13:30:13,441 copying src/unitxt/catalog/cards/cola.json -> build/lib/unitxt/catalog/cards 2026-01-06T13:30:13,443 copying src/unitxt/catalog/cards/race_middle.json -> build/lib/unitxt/catalog/cards 2026-01-06T13:30:13,445 copying src/unitxt/catalog/cards/unfair_tos.json -> build/lib/unitxt/catalog/cards 2026-01-06T13:30:13,447 copying src/unitxt/catalog/cards/news_category_classification_headline.json -> build/lib/unitxt/catalog/cards 2026-01-06T13:30:13,450 copying src/unitxt/catalog/cards/billsum_document_filtered_to_6000_chars.json -> build/lib/unitxt/catalog/cards 2026-01-06T13:30:13,452 copying src/unitxt/catalog/cards/wiki_bio.json -> build/lib/unitxt/catalog/cards 2026-01-06T13:30:13,454 copying src/unitxt/catalog/cards/human_eval.json -> build/lib/unitxt/catalog/cards 2026-01-06T13:30:13,456 copying src/unitxt/catalog/cards/tldr.json -> build/lib/unitxt/catalog/cards 2026-01-06T13:30:13,458 copying src/unitxt/catalog/cards/mnli.json -> build/lib/unitxt/catalog/cards 2026-01-06T13:30:13,461 copying src/unitxt/catalog/cards/chart_qa.json -> build/lib/unitxt/catalog/cards 2026-01-06T13:30:13,463 copying src/unitxt/catalog/cards/xsum.json -> build/lib/unitxt/catalog/cards 2026-01-06T13:30:13,465 copying src/unitxt/catalog/cards/chart_qa_lmms_eval.json -> build/lib/unitxt/catalog/cards 2026-01-06T13:30:13,467 copying src/unitxt/catalog/cards/turl_col_type.json -> build/lib/unitxt/catalog/cards 2026-01-06T13:30:13,470 copying src/unitxt/catalog/cards/sst2.json -> build/lib/unitxt/catalog/cards 2026-01-06T13:30:13,472 copying src/unitxt/catalog/cards/banking77.json -> build/lib/unitxt/catalog/cards 2026-01-06T13:30:13,475 copying src/unitxt/catalog/cards/medical_abstracts.json -> build/lib/unitxt/catalog/cards 2026-01-06T13:30:13,477 copying src/unitxt/catalog/cards/trec.json -> build/lib/unitxt/catalog/cards 2026-01-06T13:30:13,479 copying src/unitxt/catalog/cards/tablerow_classify.json -> build/lib/unitxt/catalog/cards 2026-01-06T13:30:13,481 copying src/unitxt/catalog/cards/mrpc.json -> build/lib/unitxt/catalog/cards 2026-01-06T13:30:13,484 copying src/unitxt/catalog/cards/wikitq.json -> build/lib/unitxt/catalog/cards 2026-01-06T13:30:13,486 copying src/unitxt/catalog/cards/almost_evil.json -> build/lib/unitxt/catalog/cards 2026-01-06T13:30:13,488 copying src/unitxt/catalog/cards/ai2d.json -> build/lib/unitxt/catalog/cards 2026-01-06T13:30:13,491 copying src/unitxt/catalog/cards/simple_qa.json -> build/lib/unitxt/catalog/cards 2026-01-06T13:30:13,493 copying src/unitxt/catalog/cards/hh_rlhf.json -> build/lib/unitxt/catalog/cards 2026-01-06T13:30:13,495 copying src/unitxt/catalog/cards/numeric_nlg.json -> build/lib/unitxt/catalog/cards 2026-01-06T13:30:13,497 copying src/unitxt/catalog/cards/attaq_500.json -> build/lib/unitxt/catalog/cards 2026-01-06T13:30:13,501 copying src/unitxt/catalog/cards/seed_bench.json -> build/lib/unitxt/catalog/cards 2026-01-06T13:30:13,503 copying src/unitxt/catalog/cards/ledgar.json -> build/lib/unitxt/catalog/cards 2026-01-06T13:30:13,506 copying src/unitxt/catalog/cards/openbook_qa.json -> build/lib/unitxt/catalog/cards 2026-01-06T13:30:13,508 copying src/unitxt/catalog/cards/dart.json -> build/lib/unitxt/catalog/cards 2026-01-06T13:30:13,510 copying src/unitxt/catalog/cards/billsum_document_filtered_to_10000_chars.json -> build/lib/unitxt/catalog/cards 2026-01-06T13:30:13,512 copying src/unitxt/catalog/cards/piqa.json -> build/lib/unitxt/catalog/cards 2026-01-06T13:30:13,515 copying src/unitxt/catalog/cards/toxigen.json -> build/lib/unitxt/catalog/cards 2026-01-06T13:30:13,517 copying src/unitxt/catalog/cards/tablebench.json -> build/lib/unitxt/catalog/cards 2026-01-06T13:30:13,519 copying src/unitxt/catalog/cards/social_iqa.json -> build/lib/unitxt/catalog/cards 2026-01-06T13:30:13,521 copying src/unitxt/catalog/cards/pop_qa.json -> build/lib/unitxt/catalog/cards 2026-01-06T13:30:13,524 copying src/unitxt/catalog/cards/qnli.json -> build/lib/unitxt/catalog/cards 2026-01-06T13:30:13,526 copying src/unitxt/catalog/cards/hellaswag.json -> build/lib/unitxt/catalog/cards 2026-01-06T13:30:13,528 copying src/unitxt/catalog/cards/tldr_document_filtered_to_10000_chars.json -> build/lib/unitxt/catalog/cards 2026-01-06T13:30:13,530 copying src/unitxt/catalog/cards/mbpp.json -> build/lib/unitxt/catalog/cards 2026-01-06T13:30:13,533 copying src/unitxt/catalog/cards/open_australian_legal_qa.json -> build/lib/unitxt/catalog/cards 2026-01-06T13:30:13,535 copying src/unitxt/catalog/cards/dbpedia_14.json -> build/lib/unitxt/catalog/cards 2026-01-06T13:30:13,537 copying src/unitxt/catalog/cards/info_vqa.json -> build/lib/unitxt/catalog/cards 2026-01-06T13:30:13,539 copying src/unitxt/catalog/cards/race_all.json -> build/lib/unitxt/catalog/cards 2026-01-06T13:30:13,541 copying src/unitxt/catalog/cards/tldr_document_filtered_to_6000_chars.json -> build/lib/unitxt/catalog/cards 2026-01-06T13:30:13,544 copying src/unitxt/catalog/cards/ethos_binary.json -> build/lib/unitxt/catalog/cards 2026-01-06T13:30:13,546 copying src/unitxt/catalog/cards/tablebench_data_analysis.json -> build/lib/unitxt/catalog/cards 2026-01-06T13:30:13,548 copying src/unitxt/catalog/cards/attaq.json -> build/lib/unitxt/catalog/cards 2026-01-06T13:30:13,550 copying src/unitxt/catalog/cards/tablebench_numerical_reasoning.json -> build/lib/unitxt/catalog/cards 2026-01-06T13:30:13,552 copying src/unitxt/catalog/cards/yahoo_answers_topics.json -> build/lib/unitxt/catalog/cards 2026-01-06T13:30:13,555 copying src/unitxt/catalog/cards/language_identification.json -> build/lib/unitxt/catalog/cards 2026-01-06T13:30:13,557 copying src/unitxt/catalog/cards/copa.json -> build/lib/unitxt/catalog/cards 2026-01-06T13:30:13,559 copying src/unitxt/catalog/cards/xlam_function_calling_60k.json -> build/lib/unitxt/catalog/cards 2026-01-06T13:30:13,561 copying src/unitxt/catalog/cards/tablebench_fact_checking.json -> build/lib/unitxt/catalog/cards 2026-01-06T13:30:13,563 copying src/unitxt/catalog/cards/wnli.json -> build/lib/unitxt/catalog/cards 2026-01-06T13:30:13,565 copying src/unitxt/catalog/cards/summarize_from_human_feedback.json -> build/lib/unitxt/catalog/cards 2026-01-06T13:30:13,568 copying src/unitxt/catalog/cards/fin_qa.json -> build/lib/unitxt/catalog/cards 2026-01-06T13:30:13,570 copying src/unitxt/catalog/cards/20_newsgroups_short.json -> build/lib/unitxt/catalog/cards 2026-01-06T13:30:13,572 copying src/unitxt/catalog/cards/long_bench_v2.json -> build/lib/unitxt/catalog/cards 2026-01-06T13:30:13,575 copying src/unitxt/catalog/cards/squad.json -> build/lib/unitxt/catalog/cards 2026-01-06T13:30:13,577 copying src/unitxt/catalog/cards/law_stack_exchange.json -> build/lib/unitxt/catalog/cards 2026-01-06T13:30:13,579 copying src/unitxt/catalog/cards/atta_q.json -> build/lib/unitxt/catalog/cards 2026-01-06T13:30:13,581 copying src/unitxt/catalog/cards/cnn_dailymail.json -> build/lib/unitxt/catalog/cards 2026-01-06T13:30:13,583 copying src/unitxt/catalog/cards/bold.json -> build/lib/unitxt/catalog/cards 2026-01-06T13:30:13,585 copying src/unitxt/catalog/cards/tab_fact.json -> build/lib/unitxt/catalog/cards 2026-01-06T13:30:13,588 copying src/unitxt/catalog/cards/financial_tweets.json -> build/lib/unitxt/catalog/cards 2026-01-06T13:30:13,590 copying src/unitxt/catalog/cards/websrc.json -> build/lib/unitxt/catalog/cards 2026-01-06T13:30:13,592 copying src/unitxt/catalog/cards/ag_news.json -> build/lib/unitxt/catalog/cards 2026-01-06T13:30:13,594 copying src/unitxt/catalog/cards/frames.json -> build/lib/unitxt/catalog/cards 2026-01-06T13:30:13,597 copying src/unitxt/catalog/cards/argument_topic.json -> build/lib/unitxt/catalog/cards 2026-01-06T13:30:13,599 copying src/unitxt/catalog/cards/claim_stance_topic.json -> build/lib/unitxt/catalog/cards 2026-01-06T13:30:13,601 copying src/unitxt/catalog/cards/billsum.json -> build/lib/unitxt/catalog/cards 2026-01-06T13:30:13,604 copying src/unitxt/catalog/cards/info_vqa_lmms_eval.json -> build/lib/unitxt/catalog/cards 2026-01-06T13:30:13,606 copying src/unitxt/catalog/cards/scigen.json -> build/lib/unitxt/catalog/cards 2026-01-06T13:30:13,608 copying src/unitxt/catalog/cards/20_newsgroups.json -> build/lib/unitxt/catalog/cards 2026-01-06T13:30:13,611 copying src/unitxt/catalog/cards/qqp.json -> build/lib/unitxt/catalog/cards 2026-01-06T13:30:13,613 copying src/unitxt/catalog/cards/qtsumm.json -> build/lib/unitxt/catalog/cards 2026-01-06T13:30:13,615 copying src/unitxt/catalog/cards/quality.json -> build/lib/unitxt/catalog/cards 2026-01-06T13:30:13,617 copying src/unitxt/catalog/cards/rte.json -> build/lib/unitxt/catalog/cards 2026-01-06T13:30:13,619 creating build/lib/unitxt/catalog/cards/mmlu 2026-01-06T13:30:13,620 copying src/unitxt/catalog/cards/mmlu/elementary_mathematics.json -> build/lib/unitxt/catalog/cards/mmlu 2026-01-06T13:30:13,622 copying src/unitxt/catalog/cards/mmlu/human_aging.json -> build/lib/unitxt/catalog/cards/mmlu 2026-01-06T13:30:13,624 copying src/unitxt/catalog/cards/mmlu/high_school_computer_science.json -> build/lib/unitxt/catalog/cards/mmlu 2026-01-06T13:30:13,626 copying src/unitxt/catalog/cards/mmlu/college_physics.json -> build/lib/unitxt/catalog/cards/mmlu 2026-01-06T13:30:13,629 copying src/unitxt/catalog/cards/mmlu/college_medicine.json -> build/lib/unitxt/catalog/cards/mmlu 2026-01-06T13:30:13,631 copying src/unitxt/catalog/cards/mmlu/college_mathematics.json -> build/lib/unitxt/catalog/cards/mmlu 2026-01-06T13:30:13,633 copying src/unitxt/catalog/cards/mmlu/high_school_microeconomics.json -> build/lib/unitxt/catalog/cards/mmlu 2026-01-06T13:30:13,635 copying src/unitxt/catalog/cards/mmlu/anatomy.json -> build/lib/unitxt/catalog/cards/mmlu 2026-01-06T13:30:13,637 copying src/unitxt/catalog/cards/mmlu/world_religions.json -> build/lib/unitxt/catalog/cards/mmlu 2026-01-06T13:30:13,640 copying src/unitxt/catalog/cards/mmlu/management.json -> build/lib/unitxt/catalog/cards/mmlu 2026-01-06T13:30:13,642 copying src/unitxt/catalog/cards/mmlu/moral_scenarios.json -> build/lib/unitxt/catalog/cards/mmlu 2026-01-06T13:30:13,644 copying src/unitxt/catalog/cards/mmlu/global_facts.json -> build/lib/unitxt/catalog/cards/mmlu 2026-01-06T13:30:13,647 copying src/unitxt/catalog/cards/mmlu/miscellaneous.json -> build/lib/unitxt/catalog/cards/mmlu 2026-01-06T13:30:13,649 copying src/unitxt/catalog/cards/mmlu/clinical_knowledge.json -> build/lib/unitxt/catalog/cards/mmlu 2026-01-06T13:30:13,651 copying src/unitxt/catalog/cards/mmlu/high_school_biology.json -> build/lib/unitxt/catalog/cards/mmlu 2026-01-06T13:30:13,653 copying src/unitxt/catalog/cards/mmlu/prehistory.json -> build/lib/unitxt/catalog/cards/mmlu 2026-01-06T13:30:13,655 copying src/unitxt/catalog/cards/mmlu/high_school_us_history.json -> build/lib/unitxt/catalog/cards/mmlu 2026-01-06T13:30:13,658 copying src/unitxt/catalog/cards/mmlu/international_law.json -> build/lib/unitxt/catalog/cards/mmlu 2026-01-06T13:30:13,660 copying src/unitxt/catalog/cards/mmlu/college_computer_science.json -> build/lib/unitxt/catalog/cards/mmlu 2026-01-06T13:30:13,662 copying src/unitxt/catalog/cards/mmlu/astronomy.json -> build/lib/unitxt/catalog/cards/mmlu 2026-01-06T13:30:13,664 copying src/unitxt/catalog/cards/mmlu/high_school_european_history.json -> build/lib/unitxt/catalog/cards/mmlu 2026-01-06T13:30:13,667 copying src/unitxt/catalog/cards/mmlu/electrical_engineering.json -> build/lib/unitxt/catalog/cards/mmlu 2026-01-06T13:30:13,669 copying src/unitxt/catalog/cards/mmlu/nutrition.json -> build/lib/unitxt/catalog/cards/mmlu 2026-01-06T13:30:13,671 copying src/unitxt/catalog/cards/mmlu/abstract_algebra.json -> build/lib/unitxt/catalog/cards/mmlu 2026-01-06T13:30:13,673 copying src/unitxt/catalog/cards/mmlu/professional_medicine.json -> build/lib/unitxt/catalog/cards/mmlu 2026-01-06T13:30:13,676 copying src/unitxt/catalog/cards/mmlu/human_sexuality.json -> build/lib/unitxt/catalog/cards/mmlu 2026-01-06T13:30:13,678 copying src/unitxt/catalog/cards/mmlu/business_ethics.json -> build/lib/unitxt/catalog/cards/mmlu 2026-01-06T13:30:13,680 copying src/unitxt/catalog/cards/mmlu/high_school_chemistry.json -> build/lib/unitxt/catalog/cards/mmlu 2026-01-06T13:30:13,682 copying src/unitxt/catalog/cards/mmlu/logical_fallacies.json -> build/lib/unitxt/catalog/cards/mmlu 2026-01-06T13:30:13,685 copying src/unitxt/catalog/cards/mmlu/formal_logic.json -> build/lib/unitxt/catalog/cards/mmlu 2026-01-06T13:30:13,687 copying src/unitxt/catalog/cards/mmlu/high_school_psychology.json -> build/lib/unitxt/catalog/cards/mmlu 2026-01-06T13:30:13,689 copying src/unitxt/catalog/cards/mmlu/medical_genetics.json -> build/lib/unitxt/catalog/cards/mmlu 2026-01-06T13:30:13,691 copying src/unitxt/catalog/cards/mmlu/security_studies.json -> build/lib/unitxt/catalog/cards/mmlu 2026-01-06T13:30:13,694 copying src/unitxt/catalog/cards/mmlu/high_school_macroeconomics.json -> build/lib/unitxt/catalog/cards/mmlu 2026-01-06T13:30:13,696 copying src/unitxt/catalog/cards/mmlu/professional_law.json -> build/lib/unitxt/catalog/cards/mmlu 2026-01-06T13:30:13,698 copying src/unitxt/catalog/cards/mmlu/high_school_physics.json -> build/lib/unitxt/catalog/cards/mmlu 2026-01-06T13:30:13,700 copying src/unitxt/catalog/cards/mmlu/econometrics.json -> build/lib/unitxt/catalog/cards/mmlu 2026-01-06T13:30:13,702 copying src/unitxt/catalog/cards/mmlu/sociology.json -> build/lib/unitxt/catalog/cards/mmlu 2026-01-06T13:30:13,704 copying src/unitxt/catalog/cards/mmlu/moral_disputes.json -> build/lib/unitxt/catalog/cards/mmlu 2026-01-06T13:30:13,707 copying src/unitxt/catalog/cards/mmlu/college_chemistry.json -> build/lib/unitxt/catalog/cards/mmlu 2026-01-06T13:30:13,709 copying src/unitxt/catalog/cards/mmlu/high_school_geography.json -> build/lib/unitxt/catalog/cards/mmlu 2026-01-06T13:30:13,711 copying src/unitxt/catalog/cards/mmlu/jurisprudence.json -> build/lib/unitxt/catalog/cards/mmlu 2026-01-06T13:30:13,713 copying src/unitxt/catalog/cards/mmlu/high_school_statistics.json -> build/lib/unitxt/catalog/cards/mmlu 2026-01-06T13:30:13,715 copying src/unitxt/catalog/cards/mmlu/professional_accounting.json -> build/lib/unitxt/catalog/cards/mmlu 2026-01-06T13:30:13,717 copying src/unitxt/catalog/cards/mmlu/us_foreign_policy.json -> build/lib/unitxt/catalog/cards/mmlu 2026-01-06T13:30:13,719 copying src/unitxt/catalog/cards/mmlu/professional_psychology.json -> build/lib/unitxt/catalog/cards/mmlu 2026-01-06T13:30:13,722 copying src/unitxt/catalog/cards/mmlu/public_relations.json -> build/lib/unitxt/catalog/cards/mmlu 2026-01-06T13:30:13,724 copying src/unitxt/catalog/cards/mmlu/computer_security.json -> build/lib/unitxt/catalog/cards/mmlu 2026-01-06T13:30:13,726 copying src/unitxt/catalog/cards/mmlu/philosophy.json -> build/lib/unitxt/catalog/cards/mmlu 2026-01-06T13:30:13,728 copying src/unitxt/catalog/cards/mmlu/virology.json -> build/lib/unitxt/catalog/cards/mmlu 2026-01-06T13:30:13,731 copying src/unitxt/catalog/cards/mmlu/marketing.json -> build/lib/unitxt/catalog/cards/mmlu 2026-01-06T13:30:13,733 copying src/unitxt/catalog/cards/mmlu/high_school_world_history.json -> build/lib/unitxt/catalog/cards/mmlu 2026-01-06T13:30:13,735 copying src/unitxt/catalog/cards/mmlu/machine_learning.json -> build/lib/unitxt/catalog/cards/mmlu 2026-01-06T13:30:13,737 copying src/unitxt/catalog/cards/mmlu/high_school_government_and_politics.json -> build/lib/unitxt/catalog/cards/mmlu 2026-01-06T13:30:13,739 copying src/unitxt/catalog/cards/mmlu/conceptual_physics.json -> build/lib/unitxt/catalog/cards/mmlu 2026-01-06T13:30:13,742 copying src/unitxt/catalog/cards/mmlu/college_biology.json -> build/lib/unitxt/catalog/cards/mmlu 2026-01-06T13:30:13,744 copying src/unitxt/catalog/cards/mmlu/high_school_mathematics.json -> build/lib/unitxt/catalog/cards/mmlu 2026-01-06T13:30:13,746 creating build/lib/unitxt/catalog/cards/head_qa 2026-01-06T13:30:13,747 copying src/unitxt/catalog/cards/head_qa/ru.json -> build/lib/unitxt/catalog/cards/head_qa 2026-01-06T13:30:13,750 copying src/unitxt/catalog/cards/head_qa/en.json -> build/lib/unitxt/catalog/cards/head_qa 2026-01-06T13:30:13,752 copying src/unitxt/catalog/cards/head_qa/it.json -> build/lib/unitxt/catalog/cards/head_qa 2026-01-06T13:30:13,754 copying src/unitxt/catalog/cards/head_qa/es.json -> build/lib/unitxt/catalog/cards/head_qa 2026-01-06T13:30:13,756 copying src/unitxt/catalog/cards/head_qa/gl.json -> build/lib/unitxt/catalog/cards/head_qa 2026-01-06T13:30:13,759 creating build/lib/unitxt/catalog/cards/amazon_mass 2026-01-06T13:30:13,760 copying src/unitxt/catalog/cards/amazon_mass/sl_SL.json -> build/lib/unitxt/catalog/cards/amazon_mass 2026-01-06T13:30:13,763 copying src/unitxt/catalog/cards/amazon_mass/cy_GB.json -> build/lib/unitxt/catalog/cards/amazon_mass 2026-01-06T13:30:13,765 copying src/unitxt/catalog/cards/amazon_mass/fi_FI.json -> build/lib/unitxt/catalog/cards/amazon_mass 2026-01-06T13:30:13,768 copying src/unitxt/catalog/cards/amazon_mass/jv_ID.json -> build/lib/unitxt/catalog/cards/amazon_mass 2026-01-06T13:30:13,770 copying src/unitxt/catalog/cards/amazon_mass/he_IL.json -> build/lib/unitxt/catalog/cards/amazon_mass 2026-01-06T13:30:13,772 copying src/unitxt/catalog/cards/amazon_mass/es_ES.json -> build/lib/unitxt/catalog/cards/amazon_mass 2026-01-06T13:30:13,775 copying src/unitxt/catalog/cards/amazon_mass/it_IT.json -> build/lib/unitxt/catalog/cards/amazon_mass 2026-01-06T13:30:13,777 copying src/unitxt/catalog/cards/amazon_mass/hy_AM.json -> build/lib/unitxt/catalog/cards/amazon_mass 2026-01-06T13:30:13,780 copying src/unitxt/catalog/cards/amazon_mass/ur_PK.json -> build/lib/unitxt/catalog/cards/amazon_mass 2026-01-06T13:30:13,782 copying src/unitxt/catalog/cards/amazon_mass/de_DE.json -> build/lib/unitxt/catalog/cards/amazon_mass 2026-01-06T13:30:13,785 copying src/unitxt/catalog/cards/amazon_mass/km_KH.json -> build/lib/unitxt/catalog/cards/amazon_mass 2026-01-06T13:30:13,787 copying src/unitxt/catalog/cards/amazon_mass/my_MM.json -> build/lib/unitxt/catalog/cards/amazon_mass 2026-01-06T13:30:13,790 copying src/unitxt/catalog/cards/amazon_mass/af_ZA.json -> build/lib/unitxt/catalog/cards/amazon_mass 2026-01-06T13:30:13,792 copying src/unitxt/catalog/cards/amazon_mass/el_GR.json -> build/lib/unitxt/catalog/cards/amazon_mass 2026-01-06T13:30:13,795 copying src/unitxt/catalog/cards/amazon_mass/ca_ES.json -> build/lib/unitxt/catalog/cards/amazon_mass 2026-01-06T13:30:13,798 copying src/unitxt/catalog/cards/amazon_mass/vi_VN.json -> build/lib/unitxt/catalog/cards/amazon_mass 2026-01-06T13:30:13,800 copying src/unitxt/catalog/cards/amazon_mass/fa_IR.json -> build/lib/unitxt/catalog/cards/amazon_mass 2026-01-06T13:30:13,803 copying src/unitxt/catalog/cards/amazon_mass/zh_CN.json -> build/lib/unitxt/catalog/cards/amazon_mass 2026-01-06T13:30:13,805 copying src/unitxt/catalog/cards/amazon_mass/sq_AL.json -> build/lib/unitxt/catalog/cards/amazon_mass 2026-01-06T13:30:13,808 copying src/unitxt/catalog/cards/amazon_mass/hu_HU.json -> build/lib/unitxt/catalog/cards/amazon_mass 2026-01-06T13:30:13,811 copying src/unitxt/catalog/cards/amazon_mass/az_AZ.json -> build/lib/unitxt/catalog/cards/amazon_mass 2026-01-06T13:30:13,813 copying src/unitxt/catalog/cards/amazon_mass/nb_NO.json -> build/lib/unitxt/catalog/cards/amazon_mass 2026-01-06T13:30:13,816 copying src/unitxt/catalog/cards/amazon_mass/nl_NL.json -> build/lib/unitxt/catalog/cards/amazon_mass 2026-01-06T13:30:13,818 copying src/unitxt/catalog/cards/amazon_mass/bn_BD.json -> build/lib/unitxt/catalog/cards/amazon_mass 2026-01-06T13:30:13,821 copying src/unitxt/catalog/cards/amazon_mass/ms_MY.json -> build/lib/unitxt/catalog/cards/amazon_mass 2026-01-06T13:30:13,824 copying src/unitxt/catalog/cards/amazon_mass/ja_JP.json -> build/lib/unitxt/catalog/cards/amazon_mass 2026-01-06T13:30:13,826 copying src/unitxt/catalog/cards/amazon_mass/ar_SA.json -> build/lib/unitxt/catalog/cards/amazon_mass 2026-01-06T13:30:13,829 copying src/unitxt/catalog/cards/amazon_mass/en_US.json -> build/lib/unitxt/catalog/cards/amazon_mass 2026-01-06T13:30:13,831 copying src/unitxt/catalog/cards/amazon_mass/zh_TW.json -> build/lib/unitxt/catalog/cards/amazon_mass 2026-01-06T13:30:13,834 copying src/unitxt/catalog/cards/amazon_mass/tl_PH.json -> build/lib/unitxt/catalog/cards/amazon_mass 2026-01-06T13:30:13,837 copying src/unitxt/catalog/cards/amazon_mass/ta_IN.json -> build/lib/unitxt/catalog/cards/amazon_mass 2026-01-06T13:30:13,839 copying src/unitxt/catalog/cards/amazon_mass/pt_PT.json -> build/lib/unitxt/catalog/cards/amazon_mass 2026-01-06T13:30:13,842 copying src/unitxt/catalog/cards/amazon_mass/tr_TR.json -> build/lib/unitxt/catalog/cards/amazon_mass 2026-01-06T13:30:13,844 copying src/unitxt/catalog/cards/amazon_mass/mn_MN.json -> build/lib/unitxt/catalog/cards/amazon_mass 2026-01-06T13:30:13,847 copying src/unitxt/catalog/cards/amazon_mass/sv_SE.json -> build/lib/unitxt/catalog/cards/amazon_mass 2026-01-06T13:30:13,849 copying src/unitxt/catalog/cards/amazon_mass/ml_IN.json -> build/lib/unitxt/catalog/cards/amazon_mass 2026-01-06T13:30:13,852 copying src/unitxt/catalog/cards/amazon_mass/da_DK.json -> build/lib/unitxt/catalog/cards/amazon_mass 2026-01-06T13:30:13,854 copying src/unitxt/catalog/cards/amazon_mass/sw_KE.json -> build/lib/unitxt/catalog/cards/amazon_mass 2026-01-06T13:30:13,857 copying src/unitxt/catalog/cards/amazon_mass/id_ID.json -> build/lib/unitxt/catalog/cards/amazon_mass 2026-01-06T13:30:13,859 copying src/unitxt/catalog/cards/amazon_mass/ka_GE.json -> build/lib/unitxt/catalog/cards/amazon_mass 2026-01-06T13:30:13,862 copying src/unitxt/catalog/cards/amazon_mass/pl_PL.json -> build/lib/unitxt/catalog/cards/amazon_mass 2026-01-06T13:30:13,864 copying src/unitxt/catalog/cards/amazon_mass/ko_KR.json -> build/lib/unitxt/catalog/cards/amazon_mass 2026-01-06T13:30:13,867 copying src/unitxt/catalog/cards/amazon_mass/te_IN.json -> build/lib/unitxt/catalog/cards/amazon_mass 2026-01-06T13:30:13,869 copying src/unitxt/catalog/cards/amazon_mass/ro_RO.json -> build/lib/unitxt/catalog/cards/amazon_mass 2026-01-06T13:30:13,872 copying src/unitxt/catalog/cards/amazon_mass/am_ET.json -> build/lib/unitxt/catalog/cards/amazon_mass 2026-01-06T13:30:13,875 copying src/unitxt/catalog/cards/amazon_mass/th_TH.json -> build/lib/unitxt/catalog/cards/amazon_mass 2026-01-06T13:30:13,877 copying src/unitxt/catalog/cards/amazon_mass/is_IS.json -> build/lib/unitxt/catalog/cards/amazon_mass 2026-01-06T13:30:13,880 copying src/unitxt/catalog/cards/amazon_mass/hi_IN.json -> build/lib/unitxt/catalog/cards/amazon_mass 2026-01-06T13:30:13,883 copying src/unitxt/catalog/cards/amazon_mass/fr_FR.json -> build/lib/unitxt/catalog/cards/amazon_mass 2026-01-06T13:30:13,885 copying src/unitxt/catalog/cards/amazon_mass/lv_LV.json -> build/lib/unitxt/catalog/cards/amazon_mass 2026-01-06T13:30:13,888 copying src/unitxt/catalog/cards/amazon_mass/all.json -> build/lib/unitxt/catalog/cards/amazon_mass 2026-01-06T13:30:13,890 copying src/unitxt/catalog/cards/amazon_mass/ru_RU.json -> build/lib/unitxt/catalog/cards/amazon_mass 2026-01-06T13:30:13,893 copying src/unitxt/catalog/cards/amazon_mass/kn_IN.json -> build/lib/unitxt/catalog/cards/amazon_mass 2026-01-06T13:30:13,895 creating build/lib/unitxt/catalog/cards/amazon_mass/all_1 2026-01-06T13:30:13,897 copying src/unitxt/catalog/cards/amazon_mass/all_1/1.json -> build/lib/unitxt/catalog/cards/amazon_mass/all_1 2026-01-06T13:30:13,899 creating build/lib/unitxt/catalog/cards/wmt 2026-01-06T13:30:13,900 copying src/unitxt/catalog/cards/wmt/en_fr.json -> build/lib/unitxt/catalog/cards/wmt 2026-01-06T13:30:13,902 copying src/unitxt/catalog/cards/wmt/en_ro.json -> build/lib/unitxt/catalog/cards/wmt 2026-01-06T13:30:13,904 copying src/unitxt/catalog/cards/wmt/en_de.json -> build/lib/unitxt/catalog/cards/wmt 2026-01-06T13:30:13,906 creating build/lib/unitxt/catalog/cards/tablebench_fact_checking 2026-01-06T13:30:13,907 copying src/unitxt/catalog/cards/tablebench_fact_checking/legacy.json -> build/lib/unitxt/catalog/cards/tablebench_fact_checking 2026-01-06T13:30:13,910 creating build/lib/unitxt/catalog/cards/bfcl 2026-01-06T13:30:13,911 copying src/unitxt/catalog/cards/bfcl/simple_v3.json -> build/lib/unitxt/catalog/cards/bfcl 2026-01-06T13:30:13,913 creating build/lib/unitxt/catalog/cards/bfcl/multi_turn 2026-01-06T13:30:13,914 copying src/unitxt/catalog/cards/bfcl/multi_turn/simple_v3.json -> build/lib/unitxt/catalog/cards/bfcl/multi_turn 2026-01-06T13:30:13,917 copying src/unitxt/catalog/cards/bfcl/multi_turn/live_parallel_v3.json -> build/lib/unitxt/catalog/cards/bfcl/multi_turn 2026-01-06T13:30:13,919 copying src/unitxt/catalog/cards/bfcl/multi_turn/live_relevance_v3.json -> build/lib/unitxt/catalog/cards/bfcl/multi_turn 2026-01-06T13:30:13,921 copying src/unitxt/catalog/cards/bfcl/multi_turn/parallel_multiple_v3.json -> build/lib/unitxt/catalog/cards/bfcl/multi_turn 2026-01-06T13:30:13,924 copying src/unitxt/catalog/cards/bfcl/multi_turn/live_simple_v3.json -> build/lib/unitxt/catalog/cards/bfcl/multi_turn 2026-01-06T13:30:13,926 copying src/unitxt/catalog/cards/bfcl/multi_turn/live_irrelevance_v3.json -> build/lib/unitxt/catalog/cards/bfcl/multi_turn 2026-01-06T13:30:13,928 copying src/unitxt/catalog/cards/bfcl/multi_turn/live_multiple_v3.json -> build/lib/unitxt/catalog/cards/bfcl/multi_turn 2026-01-06T13:30:13,930 copying src/unitxt/catalog/cards/bfcl/multi_turn/multiple_v3.json -> build/lib/unitxt/catalog/cards/bfcl/multi_turn 2026-01-06T13:30:13,932 copying src/unitxt/catalog/cards/bfcl/multi_turn/live_parallel_multiple_v3.json -> build/lib/unitxt/catalog/cards/bfcl/multi_turn 2026-01-06T13:30:13,934 copying src/unitxt/catalog/cards/bfcl/multi_turn/parallel_v3.json -> build/lib/unitxt/catalog/cards/bfcl/multi_turn 2026-01-06T13:30:13,936 copying src/unitxt/catalog/cards/bfcl/multi_turn/javascript_v3.json -> build/lib/unitxt/catalog/cards/bfcl/multi_turn 2026-01-06T13:30:13,939 copying src/unitxt/catalog/cards/bfcl/multi_turn/java_v3.json -> build/lib/unitxt/catalog/cards/bfcl/multi_turn 2026-01-06T13:30:13,941 creating build/lib/unitxt/catalog/cards/almost_evil 2026-01-06T13:30:13,942 copying src/unitxt/catalog/cards/almost_evil/nl.json -> build/lib/unitxt/catalog/cards/almost_evil 2026-01-06T13:30:13,944 copying src/unitxt/catalog/cards/almost_evil/ru.json -> build/lib/unitxt/catalog/cards/almost_evil 2026-01-06T13:30:13,946 copying src/unitxt/catalog/cards/almost_evil/en.json -> build/lib/unitxt/catalog/cards/almost_evil 2026-01-06T13:30:13,949 copying src/unitxt/catalog/cards/almost_evil/it.json -> build/lib/unitxt/catalog/cards/almost_evil 2026-01-06T13:30:13,951 copying src/unitxt/catalog/cards/almost_evil/es.json -> build/lib/unitxt/catalog/cards/almost_evil 2026-01-06T13:30:13,953 copying src/unitxt/catalog/cards/almost_evil/pt.json -> build/lib/unitxt/catalog/cards/almost_evil 2026-01-06T13:30:13,956 copying src/unitxt/catalog/cards/almost_evil/de.json -> build/lib/unitxt/catalog/cards/almost_evil 2026-01-06T13:30:13,958 copying src/unitxt/catalog/cards/almost_evil/fr.json -> build/lib/unitxt/catalog/cards/almost_evil 2026-01-06T13:30:13,960 creating build/lib/unitxt/catalog/cards/xwinogrande 2026-01-06T13:30:13,961 copying src/unitxt/catalog/cards/xwinogrande/zh.json -> build/lib/unitxt/catalog/cards/xwinogrande 2026-01-06T13:30:13,963 copying src/unitxt/catalog/cards/xwinogrande/jp.json -> build/lib/unitxt/catalog/cards/xwinogrande 2026-01-06T13:30:13,965 copying src/unitxt/catalog/cards/xwinogrande/ru.json -> build/lib/unitxt/catalog/cards/xwinogrande 2026-01-06T13:30:13,968 copying src/unitxt/catalog/cards/xwinogrande/en.json -> build/lib/unitxt/catalog/cards/xwinogrande 2026-01-06T13:30:13,970 copying src/unitxt/catalog/cards/xwinogrande/pt.json -> build/lib/unitxt/catalog/cards/xwinogrande 2026-01-06T13:30:13,972 creating build/lib/unitxt/catalog/cards/biggen_bench/results 2026-01-06T13:30:13,973 copying src/unitxt/catalog/cards/biggen_bench/results/human_eval.json -> build/lib/unitxt/catalog/cards/biggen_bench/results 2026-01-06T13:30:13,976 creating build/lib/unitxt/catalog/cards/winogrande 2026-01-06T13:30:13,977 copying src/unitxt/catalog/cards/winogrande/s.json -> build/lib/unitxt/catalog/cards/winogrande 2026-01-06T13:30:13,980 copying src/unitxt/catalog/cards/winogrande/xs.json -> build/lib/unitxt/catalog/cards/winogrande 2026-01-06T13:30:13,982 copying src/unitxt/catalog/cards/winogrande/xl.json -> build/lib/unitxt/catalog/cards/winogrande 2026-01-06T13:30:13,984 copying src/unitxt/catalog/cards/winogrande/debiased.json -> build/lib/unitxt/catalog/cards/winogrande 2026-01-06T13:30:13,986 copying src/unitxt/catalog/cards/winogrande/m.json -> build/lib/unitxt/catalog/cards/winogrande 2026-01-06T13:30:13,988 copying src/unitxt/catalog/cards/winogrande/l.json -> build/lib/unitxt/catalog/cards/winogrande 2026-01-06T13:30:13,990 creating build/lib/unitxt/catalog/cards/wnli 2026-01-06T13:30:13,991 copying src/unitxt/catalog/cards/wnli/truthfulness.json -> build/lib/unitxt/catalog/cards/wnli 2026-01-06T13:30:13,993 creating build/lib/unitxt/catalog/cards/global_mmlu/uk 2026-01-06T13:30:13,995 copying src/unitxt/catalog/cards/global_mmlu/uk/elementary_mathematics.json -> build/lib/unitxt/catalog/cards/global_mmlu/uk 2026-01-06T13:30:13,997 copying src/unitxt/catalog/cards/global_mmlu/uk/human_aging.json -> build/lib/unitxt/catalog/cards/global_mmlu/uk 2026-01-06T13:30:13,999 copying src/unitxt/catalog/cards/global_mmlu/uk/high_school_computer_science.json -> build/lib/unitxt/catalog/cards/global_mmlu/uk 2026-01-06T13:30:14,001 copying src/unitxt/catalog/cards/global_mmlu/uk/college_physics.json -> build/lib/unitxt/catalog/cards/global_mmlu/uk 2026-01-06T13:30:14,003 copying src/unitxt/catalog/cards/global_mmlu/uk/college_medicine.json -> build/lib/unitxt/catalog/cards/global_mmlu/uk 2026-01-06T13:30:14,006 copying src/unitxt/catalog/cards/global_mmlu/uk/college_mathematics.json -> build/lib/unitxt/catalog/cards/global_mmlu/uk 2026-01-06T13:30:14,008 copying src/unitxt/catalog/cards/global_mmlu/uk/high_school_microeconomics.json -> build/lib/unitxt/catalog/cards/global_mmlu/uk 2026-01-06T13:30:14,010 copying src/unitxt/catalog/cards/global_mmlu/uk/anatomy.json -> build/lib/unitxt/catalog/cards/global_mmlu/uk 2026-01-06T13:30:14,012 copying src/unitxt/catalog/cards/global_mmlu/uk/world_religions.json -> build/lib/unitxt/catalog/cards/global_mmlu/uk 2026-01-06T13:30:14,014 copying src/unitxt/catalog/cards/global_mmlu/uk/management.json -> build/lib/unitxt/catalog/cards/global_mmlu/uk 2026-01-06T13:30:14,017 copying src/unitxt/catalog/cards/global_mmlu/uk/moral_scenarios.json -> build/lib/unitxt/catalog/cards/global_mmlu/uk 2026-01-06T13:30:14,019 copying src/unitxt/catalog/cards/global_mmlu/uk/global_facts.json -> build/lib/unitxt/catalog/cards/global_mmlu/uk 2026-01-06T13:30:14,021 copying src/unitxt/catalog/cards/global_mmlu/uk/miscellaneous.json -> build/lib/unitxt/catalog/cards/global_mmlu/uk 2026-01-06T13:30:14,023 copying src/unitxt/catalog/cards/global_mmlu/uk/clinical_knowledge.json -> build/lib/unitxt/catalog/cards/global_mmlu/uk 2026-01-06T13:30:14,025 copying src/unitxt/catalog/cards/global_mmlu/uk/high_school_biology.json -> build/lib/unitxt/catalog/cards/global_mmlu/uk 2026-01-06T13:30:14,028 copying src/unitxt/catalog/cards/global_mmlu/uk/prehistory.json -> build/lib/unitxt/catalog/cards/global_mmlu/uk 2026-01-06T13:30:14,030 copying src/unitxt/catalog/cards/global_mmlu/uk/high_school_us_history.json -> build/lib/unitxt/catalog/cards/global_mmlu/uk 2026-01-06T13:30:14,032 copying src/unitxt/catalog/cards/global_mmlu/uk/international_law.json -> build/lib/unitxt/catalog/cards/global_mmlu/uk 2026-01-06T13:30:14,034 copying src/unitxt/catalog/cards/global_mmlu/uk/college_computer_science.json -> build/lib/unitxt/catalog/cards/global_mmlu/uk 2026-01-06T13:30:14,037 copying src/unitxt/catalog/cards/global_mmlu/uk/astronomy.json -> build/lib/unitxt/catalog/cards/global_mmlu/uk 2026-01-06T13:30:14,039 copying src/unitxt/catalog/cards/global_mmlu/uk/high_school_european_history.json -> build/lib/unitxt/catalog/cards/global_mmlu/uk 2026-01-06T13:30:14,041 copying src/unitxt/catalog/cards/global_mmlu/uk/electrical_engineering.json -> build/lib/unitxt/catalog/cards/global_mmlu/uk 2026-01-06T13:30:14,044 copying src/unitxt/catalog/cards/global_mmlu/uk/nutrition.json -> build/lib/unitxt/catalog/cards/global_mmlu/uk 2026-01-06T13:30:14,046 copying src/unitxt/catalog/cards/global_mmlu/uk/abstract_algebra.json -> build/lib/unitxt/catalog/cards/global_mmlu/uk 2026-01-06T13:30:14,048 copying src/unitxt/catalog/cards/global_mmlu/uk/professional_medicine.json -> build/lib/unitxt/catalog/cards/global_mmlu/uk 2026-01-06T13:30:14,051 copying src/unitxt/catalog/cards/global_mmlu/uk/human_sexuality.json -> build/lib/unitxt/catalog/cards/global_mmlu/uk 2026-01-06T13:30:14,053 copying src/unitxt/catalog/cards/global_mmlu/uk/business_ethics.json -> build/lib/unitxt/catalog/cards/global_mmlu/uk 2026-01-06T13:30:14,055 copying src/unitxt/catalog/cards/global_mmlu/uk/high_school_chemistry.json -> build/lib/unitxt/catalog/cards/global_mmlu/uk 2026-01-06T13:30:14,057 copying src/unitxt/catalog/cards/global_mmlu/uk/logical_fallacies.json -> build/lib/unitxt/catalog/cards/global_mmlu/uk 2026-01-06T13:30:14,059 copying src/unitxt/catalog/cards/global_mmlu/uk/formal_logic.json -> build/lib/unitxt/catalog/cards/global_mmlu/uk 2026-01-06T13:30:14,061 copying src/unitxt/catalog/cards/global_mmlu/uk/high_school_psychology.json -> build/lib/unitxt/catalog/cards/global_mmlu/uk 2026-01-06T13:30:14,064 copying src/unitxt/catalog/cards/global_mmlu/uk/medical_genetics.json -> build/lib/unitxt/catalog/cards/global_mmlu/uk 2026-01-06T13:30:14,066 copying src/unitxt/catalog/cards/global_mmlu/uk/security_studies.json -> build/lib/unitxt/catalog/cards/global_mmlu/uk 2026-01-06T13:30:14,068 copying src/unitxt/catalog/cards/global_mmlu/uk/high_school_macroeconomics.json -> build/lib/unitxt/catalog/cards/global_mmlu/uk 2026-01-06T13:30:14,070 copying src/unitxt/catalog/cards/global_mmlu/uk/professional_law.json -> build/lib/unitxt/catalog/cards/global_mmlu/uk 2026-01-06T13:30:14,073 copying src/unitxt/catalog/cards/global_mmlu/uk/high_school_physics.json -> build/lib/unitxt/catalog/cards/global_mmlu/uk 2026-01-06T13:30:14,076 copying src/unitxt/catalog/cards/global_mmlu/uk/econometrics.json -> build/lib/unitxt/catalog/cards/global_mmlu/uk 2026-01-06T13:30:14,078 copying src/unitxt/catalog/cards/global_mmlu/uk/sociology.json -> build/lib/unitxt/catalog/cards/global_mmlu/uk 2026-01-06T13:30:14,080 copying src/unitxt/catalog/cards/global_mmlu/uk/moral_disputes.json -> build/lib/unitxt/catalog/cards/global_mmlu/uk 2026-01-06T13:30:14,083 copying src/unitxt/catalog/cards/global_mmlu/uk/college_chemistry.json -> build/lib/unitxt/catalog/cards/global_mmlu/uk 2026-01-06T13:30:14,085 copying src/unitxt/catalog/cards/global_mmlu/uk/high_school_geography.json -> build/lib/unitxt/catalog/cards/global_mmlu/uk 2026-01-06T13:30:14,087 copying src/unitxt/catalog/cards/global_mmlu/uk/jurisprudence.json -> build/lib/unitxt/catalog/cards/global_mmlu/uk 2026-01-06T13:30:14,089 copying src/unitxt/catalog/cards/global_mmlu/uk/high_school_statistics.json -> build/lib/unitxt/catalog/cards/global_mmlu/uk 2026-01-06T13:30:14,091 copying src/unitxt/catalog/cards/global_mmlu/uk/professional_accounting.json -> build/lib/unitxt/catalog/cards/global_mmlu/uk 2026-01-06T13:30:14,094 copying src/unitxt/catalog/cards/global_mmlu/uk/us_foreign_policy.json -> build/lib/unitxt/catalog/cards/global_mmlu/uk 2026-01-06T13:30:14,096 copying src/unitxt/catalog/cards/global_mmlu/uk/professional_psychology.json -> build/lib/unitxt/catalog/cards/global_mmlu/uk 2026-01-06T13:30:14,098 copying src/unitxt/catalog/cards/global_mmlu/uk/public_relations.json -> build/lib/unitxt/catalog/cards/global_mmlu/uk 2026-01-06T13:30:14,100 copying src/unitxt/catalog/cards/global_mmlu/uk/computer_security.json -> build/lib/unitxt/catalog/cards/global_mmlu/uk 2026-01-06T13:30:14,103 copying src/unitxt/catalog/cards/global_mmlu/uk/philosophy.json -> build/lib/unitxt/catalog/cards/global_mmlu/uk 2026-01-06T13:30:14,105 copying src/unitxt/catalog/cards/global_mmlu/uk/virology.json -> build/lib/unitxt/catalog/cards/global_mmlu/uk 2026-01-06T13:30:14,107 copying src/unitxt/catalog/cards/global_mmlu/uk/marketing.json -> build/lib/unitxt/catalog/cards/global_mmlu/uk 2026-01-06T13:30:14,110 copying src/unitxt/catalog/cards/global_mmlu/uk/high_school_world_history.json -> build/lib/unitxt/catalog/cards/global_mmlu/uk 2026-01-06T13:30:14,112 copying src/unitxt/catalog/cards/global_mmlu/uk/machine_learning.json -> build/lib/unitxt/catalog/cards/global_mmlu/uk 2026-01-06T13:30:14,114 copying src/unitxt/catalog/cards/global_mmlu/uk/high_school_government_and_politics.json -> build/lib/unitxt/catalog/cards/global_mmlu/uk 2026-01-06T13:30:14,116 copying src/unitxt/catalog/cards/global_mmlu/uk/conceptual_physics.json -> build/lib/unitxt/catalog/cards/global_mmlu/uk 2026-01-06T13:30:14,118 copying src/unitxt/catalog/cards/global_mmlu/uk/college_biology.json -> build/lib/unitxt/catalog/cards/global_mmlu/uk 2026-01-06T13:30:14,120 copying src/unitxt/catalog/cards/global_mmlu/uk/high_school_mathematics.json -> build/lib/unitxt/catalog/cards/global_mmlu/uk 2026-01-06T13:30:14,122 creating build/lib/unitxt/catalog/cards/global_mmlu/ny 2026-01-06T13:30:14,123 copying src/unitxt/catalog/cards/global_mmlu/ny/elementary_mathematics.json -> build/lib/unitxt/catalog/cards/global_mmlu/ny 2026-01-06T13:30:14,126 copying src/unitxt/catalog/cards/global_mmlu/ny/human_aging.json -> build/lib/unitxt/catalog/cards/global_mmlu/ny 2026-01-06T13:30:14,128 copying src/unitxt/catalog/cards/global_mmlu/ny/high_school_computer_science.json -> build/lib/unitxt/catalog/cards/global_mmlu/ny 2026-01-06T13:30:14,130 copying src/unitxt/catalog/cards/global_mmlu/ny/college_physics.json -> build/lib/unitxt/catalog/cards/global_mmlu/ny 2026-01-06T13:30:14,132 copying src/unitxt/catalog/cards/global_mmlu/ny/college_medicine.json -> build/lib/unitxt/catalog/cards/global_mmlu/ny 2026-01-06T13:30:14,134 copying src/unitxt/catalog/cards/global_mmlu/ny/college_mathematics.json -> build/lib/unitxt/catalog/cards/global_mmlu/ny 2026-01-06T13:30:14,137 copying src/unitxt/catalog/cards/global_mmlu/ny/high_school_microeconomics.json -> build/lib/unitxt/catalog/cards/global_mmlu/ny 2026-01-06T13:30:14,139 copying src/unitxt/catalog/cards/global_mmlu/ny/anatomy.json -> build/lib/unitxt/catalog/cards/global_mmlu/ny 2026-01-06T13:30:14,141 copying src/unitxt/catalog/cards/global_mmlu/ny/world_religions.json -> build/lib/unitxt/catalog/cards/global_mmlu/ny 2026-01-06T13:30:14,143 copying src/unitxt/catalog/cards/global_mmlu/ny/management.json -> build/lib/unitxt/catalog/cards/global_mmlu/ny 2026-01-06T13:30:14,146 copying src/unitxt/catalog/cards/global_mmlu/ny/moral_scenarios.json -> build/lib/unitxt/catalog/cards/global_mmlu/ny 2026-01-06T13:30:14,148 copying src/unitxt/catalog/cards/global_mmlu/ny/global_facts.json -> build/lib/unitxt/catalog/cards/global_mmlu/ny 2026-01-06T13:30:14,150 copying src/unitxt/catalog/cards/global_mmlu/ny/miscellaneous.json -> build/lib/unitxt/catalog/cards/global_mmlu/ny 2026-01-06T13:30:14,152 copying src/unitxt/catalog/cards/global_mmlu/ny/clinical_knowledge.json -> build/lib/unitxt/catalog/cards/global_mmlu/ny 2026-01-06T13:30:14,155 copying src/unitxt/catalog/cards/global_mmlu/ny/high_school_biology.json -> build/lib/unitxt/catalog/cards/global_mmlu/ny 2026-01-06T13:30:14,157 copying src/unitxt/catalog/cards/global_mmlu/ny/prehistory.json -> build/lib/unitxt/catalog/cards/global_mmlu/ny 2026-01-06T13:30:14,159 copying src/unitxt/catalog/cards/global_mmlu/ny/high_school_us_history.json -> build/lib/unitxt/catalog/cards/global_mmlu/ny 2026-01-06T13:30:14,161 copying src/unitxt/catalog/cards/global_mmlu/ny/international_law.json -> build/lib/unitxt/catalog/cards/global_mmlu/ny 2026-01-06T13:30:14,163 copying src/unitxt/catalog/cards/global_mmlu/ny/college_computer_science.json -> build/lib/unitxt/catalog/cards/global_mmlu/ny 2026-01-06T13:30:14,166 copying src/unitxt/catalog/cards/global_mmlu/ny/astronomy.json -> build/lib/unitxt/catalog/cards/global_mmlu/ny 2026-01-06T13:30:14,168 copying src/unitxt/catalog/cards/global_mmlu/ny/high_school_european_history.json -> build/lib/unitxt/catalog/cards/global_mmlu/ny 2026-01-06T13:30:14,170 copying src/unitxt/catalog/cards/global_mmlu/ny/electrical_engineering.json -> build/lib/unitxt/catalog/cards/global_mmlu/ny 2026-01-06T13:30:14,172 copying src/unitxt/catalog/cards/global_mmlu/ny/nutrition.json -> build/lib/unitxt/catalog/cards/global_mmlu/ny 2026-01-06T13:30:14,174 copying src/unitxt/catalog/cards/global_mmlu/ny/abstract_algebra.json -> build/lib/unitxt/catalog/cards/global_mmlu/ny 2026-01-06T13:30:14,177 copying src/unitxt/catalog/cards/global_mmlu/ny/professional_medicine.json -> build/lib/unitxt/catalog/cards/global_mmlu/ny 2026-01-06T13:30:14,179 copying src/unitxt/catalog/cards/global_mmlu/ny/human_sexuality.json -> build/lib/unitxt/catalog/cards/global_mmlu/ny 2026-01-06T13:30:14,181 copying src/unitxt/catalog/cards/global_mmlu/ny/business_ethics.json -> build/lib/unitxt/catalog/cards/global_mmlu/ny 2026-01-06T13:30:14,183 copying src/unitxt/catalog/cards/global_mmlu/ny/high_school_chemistry.json -> build/lib/unitxt/catalog/cards/global_mmlu/ny 2026-01-06T13:30:14,186 copying src/unitxt/catalog/cards/global_mmlu/ny/logical_fallacies.json -> build/lib/unitxt/catalog/cards/global_mmlu/ny 2026-01-06T13:30:14,188 copying src/unitxt/catalog/cards/global_mmlu/ny/formal_logic.json -> build/lib/unitxt/catalog/cards/global_mmlu/ny 2026-01-06T13:30:14,190 copying src/unitxt/catalog/cards/global_mmlu/ny/high_school_psychology.json -> build/lib/unitxt/catalog/cards/global_mmlu/ny 2026-01-06T13:30:14,192 copying src/unitxt/catalog/cards/global_mmlu/ny/medical_genetics.json -> build/lib/unitxt/catalog/cards/global_mmlu/ny 2026-01-06T13:30:14,194 copying src/unitxt/catalog/cards/global_mmlu/ny/security_studies.json -> build/lib/unitxt/catalog/cards/global_mmlu/ny 2026-01-06T13:30:14,196 copying src/unitxt/catalog/cards/global_mmlu/ny/high_school_macroeconomics.json -> build/lib/unitxt/catalog/cards/global_mmlu/ny 2026-01-06T13:30:14,199 copying src/unitxt/catalog/cards/global_mmlu/ny/professional_law.json -> build/lib/unitxt/catalog/cards/global_mmlu/ny 2026-01-06T13:30:14,201 copying src/unitxt/catalog/cards/global_mmlu/ny/high_school_physics.json -> build/lib/unitxt/catalog/cards/global_mmlu/ny 2026-01-06T13:30:14,203 copying src/unitxt/catalog/cards/global_mmlu/ny/econometrics.json -> build/lib/unitxt/catalog/cards/global_mmlu/ny 2026-01-06T13:30:14,205 copying src/unitxt/catalog/cards/global_mmlu/ny/sociology.json -> build/lib/unitxt/catalog/cards/global_mmlu/ny 2026-01-06T13:30:14,208 copying src/unitxt/catalog/cards/global_mmlu/ny/moral_disputes.json -> build/lib/unitxt/catalog/cards/global_mmlu/ny 2026-01-06T13:30:14,210 copying src/unitxt/catalog/cards/global_mmlu/ny/college_chemistry.json -> build/lib/unitxt/catalog/cards/global_mmlu/ny 2026-01-06T13:30:14,212 copying src/unitxt/catalog/cards/global_mmlu/ny/high_school_geography.json -> build/lib/unitxt/catalog/cards/global_mmlu/ny 2026-01-06T13:30:14,214 copying src/unitxt/catalog/cards/global_mmlu/ny/jurisprudence.json -> build/lib/unitxt/catalog/cards/global_mmlu/ny 2026-01-06T13:30:14,217 copying src/unitxt/catalog/cards/global_mmlu/ny/high_school_statistics.json -> build/lib/unitxt/catalog/cards/global_mmlu/ny 2026-01-06T13:30:14,219 copying src/unitxt/catalog/cards/global_mmlu/ny/professional_accounting.json -> build/lib/unitxt/catalog/cards/global_mmlu/ny 2026-01-06T13:30:14,221 copying src/unitxt/catalog/cards/global_mmlu/ny/us_foreign_policy.json -> build/lib/unitxt/catalog/cards/global_mmlu/ny 2026-01-06T13:30:14,223 copying src/unitxt/catalog/cards/global_mmlu/ny/professional_psychology.json -> build/lib/unitxt/catalog/cards/global_mmlu/ny 2026-01-06T13:30:14,225 copying src/unitxt/catalog/cards/global_mmlu/ny/public_relations.json -> build/lib/unitxt/catalog/cards/global_mmlu/ny 2026-01-06T13:30:14,228 copying src/unitxt/catalog/cards/global_mmlu/ny/computer_security.json -> build/lib/unitxt/catalog/cards/global_mmlu/ny 2026-01-06T13:30:14,230 copying src/unitxt/catalog/cards/global_mmlu/ny/philosophy.json -> build/lib/unitxt/catalog/cards/global_mmlu/ny 2026-01-06T13:30:14,232 copying src/unitxt/catalog/cards/global_mmlu/ny/virology.json -> build/lib/unitxt/catalog/cards/global_mmlu/ny 2026-01-06T13:30:14,234 copying src/unitxt/catalog/cards/global_mmlu/ny/marketing.json -> build/lib/unitxt/catalog/cards/global_mmlu/ny 2026-01-06T13:30:14,237 copying src/unitxt/catalog/cards/global_mmlu/ny/high_school_world_history.json -> build/lib/unitxt/catalog/cards/global_mmlu/ny 2026-01-06T13:30:14,239 copying src/unitxt/catalog/cards/global_mmlu/ny/machine_learning.json -> build/lib/unitxt/catalog/cards/global_mmlu/ny 2026-01-06T13:30:14,241 copying src/unitxt/catalog/cards/global_mmlu/ny/high_school_government_and_politics.json -> build/lib/unitxt/catalog/cards/global_mmlu/ny 2026-01-06T13:30:14,243 copying src/unitxt/catalog/cards/global_mmlu/ny/conceptual_physics.json -> build/lib/unitxt/catalog/cards/global_mmlu/ny 2026-01-06T13:30:14,246 copying src/unitxt/catalog/cards/global_mmlu/ny/college_biology.json -> build/lib/unitxt/catalog/cards/global_mmlu/ny 2026-01-06T13:30:14,248 copying src/unitxt/catalog/cards/global_mmlu/ny/high_school_mathematics.json -> build/lib/unitxt/catalog/cards/global_mmlu/ny 2026-01-06T13:30:14,250 creating build/lib/unitxt/catalog/cards/global_mmlu/so 2026-01-06T13:30:14,251 copying src/unitxt/catalog/cards/global_mmlu/so/elementary_mathematics.json -> build/lib/unitxt/catalog/cards/global_mmlu/so 2026-01-06T13:30:14,253 copying src/unitxt/catalog/cards/global_mmlu/so/human_aging.json -> build/lib/unitxt/catalog/cards/global_mmlu/so 2026-01-06T13:30:14,255 copying src/unitxt/catalog/cards/global_mmlu/so/high_school_computer_science.json -> build/lib/unitxt/catalog/cards/global_mmlu/so 2026-01-06T13:30:14,257 copying src/unitxt/catalog/cards/global_mmlu/so/college_physics.json -> build/lib/unitxt/catalog/cards/global_mmlu/so 2026-01-06T13:30:14,260 copying src/unitxt/catalog/cards/global_mmlu/so/college_medicine.json -> build/lib/unitxt/catalog/cards/global_mmlu/so 2026-01-06T13:30:14,262 copying src/unitxt/catalog/cards/global_mmlu/so/college_mathematics.json -> build/lib/unitxt/catalog/cards/global_mmlu/so 2026-01-06T13:30:14,264 copying src/unitxt/catalog/cards/global_mmlu/so/high_school_microeconomics.json -> build/lib/unitxt/catalog/cards/global_mmlu/so 2026-01-06T13:30:14,268 copying src/unitxt/catalog/cards/global_mmlu/so/anatomy.json -> build/lib/unitxt/catalog/cards/global_mmlu/so 2026-01-06T13:30:14,270 copying src/unitxt/catalog/cards/global_mmlu/so/world_religions.json -> build/lib/unitxt/catalog/cards/global_mmlu/so 2026-01-06T13:30:14,272 copying src/unitxt/catalog/cards/global_mmlu/so/management.json -> build/lib/unitxt/catalog/cards/global_mmlu/so 2026-01-06T13:30:14,275 copying src/unitxt/catalog/cards/global_mmlu/so/moral_scenarios.json -> build/lib/unitxt/catalog/cards/global_mmlu/so 2026-01-06T13:30:14,277 copying src/unitxt/catalog/cards/global_mmlu/so/global_facts.json -> build/lib/unitxt/catalog/cards/global_mmlu/so 2026-01-06T13:30:14,279 copying src/unitxt/catalog/cards/global_mmlu/so/miscellaneous.json -> build/lib/unitxt/catalog/cards/global_mmlu/so 2026-01-06T13:30:14,281 copying src/unitxt/catalog/cards/global_mmlu/so/clinical_knowledge.json -> build/lib/unitxt/catalog/cards/global_mmlu/so 2026-01-06T13:30:14,284 copying src/unitxt/catalog/cards/global_mmlu/so/high_school_biology.json -> build/lib/unitxt/catalog/cards/global_mmlu/so 2026-01-06T13:30:14,286 copying src/unitxt/catalog/cards/global_mmlu/so/prehistory.json -> build/lib/unitxt/catalog/cards/global_mmlu/so 2026-01-06T13:30:14,288 copying src/unitxt/catalog/cards/global_mmlu/so/high_school_us_history.json -> build/lib/unitxt/catalog/cards/global_mmlu/so 2026-01-06T13:30:14,290 copying src/unitxt/catalog/cards/global_mmlu/so/international_law.json -> build/lib/unitxt/catalog/cards/global_mmlu/so 2026-01-06T13:30:14,292 copying src/unitxt/catalog/cards/global_mmlu/so/college_computer_science.json -> build/lib/unitxt/catalog/cards/global_mmlu/so 2026-01-06T13:30:14,295 copying src/unitxt/catalog/cards/global_mmlu/so/astronomy.json -> build/lib/unitxt/catalog/cards/global_mmlu/so 2026-01-06T13:30:14,297 copying src/unitxt/catalog/cards/global_mmlu/so/high_school_european_history.json -> build/lib/unitxt/catalog/cards/global_mmlu/so 2026-01-06T13:30:14,299 copying src/unitxt/catalog/cards/global_mmlu/so/electrical_engineering.json -> build/lib/unitxt/catalog/cards/global_mmlu/so 2026-01-06T13:30:14,301 copying src/unitxt/catalog/cards/global_mmlu/so/nutrition.json -> build/lib/unitxt/catalog/cards/global_mmlu/so 2026-01-06T13:30:14,304 copying src/unitxt/catalog/cards/global_mmlu/so/abstract_algebra.json -> build/lib/unitxt/catalog/cards/global_mmlu/so 2026-01-06T13:30:14,306 copying src/unitxt/catalog/cards/global_mmlu/so/professional_medicine.json -> build/lib/unitxt/catalog/cards/global_mmlu/so 2026-01-06T13:30:14,308 copying src/unitxt/catalog/cards/global_mmlu/so/human_sexuality.json -> build/lib/unitxt/catalog/cards/global_mmlu/so 2026-01-06T13:30:14,310 copying src/unitxt/catalog/cards/global_mmlu/so/business_ethics.json -> build/lib/unitxt/catalog/cards/global_mmlu/so 2026-01-06T13:30:14,312 copying src/unitxt/catalog/cards/global_mmlu/so/high_school_chemistry.json -> build/lib/unitxt/catalog/cards/global_mmlu/so 2026-01-06T13:30:14,315 copying src/unitxt/catalog/cards/global_mmlu/so/logical_fallacies.json -> build/lib/unitxt/catalog/cards/global_mmlu/so 2026-01-06T13:30:14,317 copying src/unitxt/catalog/cards/global_mmlu/so/formal_logic.json -> build/lib/unitxt/catalog/cards/global_mmlu/so 2026-01-06T13:30:14,319 copying src/unitxt/catalog/cards/global_mmlu/so/high_school_psychology.json -> build/lib/unitxt/catalog/cards/global_mmlu/so 2026-01-06T13:30:14,321 copying src/unitxt/catalog/cards/global_mmlu/so/medical_genetics.json -> build/lib/unitxt/catalog/cards/global_mmlu/so 2026-01-06T13:30:14,323 copying src/unitxt/catalog/cards/global_mmlu/so/security_studies.json -> build/lib/unitxt/catalog/cards/global_mmlu/so 2026-01-06T13:30:14,325 copying src/unitxt/catalog/cards/global_mmlu/so/high_school_macroeconomics.json -> build/lib/unitxt/catalog/cards/global_mmlu/so 2026-01-06T13:30:14,328 copying src/unitxt/catalog/cards/global_mmlu/so/professional_law.json -> build/lib/unitxt/catalog/cards/global_mmlu/so 2026-01-06T13:30:14,330 copying src/unitxt/catalog/cards/global_mmlu/so/high_school_physics.json -> build/lib/unitxt/catalog/cards/global_mmlu/so 2026-01-06T13:30:14,332 copying src/unitxt/catalog/cards/global_mmlu/so/econometrics.json -> build/lib/unitxt/catalog/cards/global_mmlu/so 2026-01-06T13:30:14,334 copying src/unitxt/catalog/cards/global_mmlu/so/sociology.json -> build/lib/unitxt/catalog/cards/global_mmlu/so 2026-01-06T13:30:14,337 copying src/unitxt/catalog/cards/global_mmlu/so/moral_disputes.json -> build/lib/unitxt/catalog/cards/global_mmlu/so 2026-01-06T13:30:14,339 copying src/unitxt/catalog/cards/global_mmlu/so/college_chemistry.json -> build/lib/unitxt/catalog/cards/global_mmlu/so 2026-01-06T13:30:14,341 copying src/unitxt/catalog/cards/global_mmlu/so/high_school_geography.json -> build/lib/unitxt/catalog/cards/global_mmlu/so 2026-01-06T13:30:14,343 copying src/unitxt/catalog/cards/global_mmlu/so/jurisprudence.json -> build/lib/unitxt/catalog/cards/global_mmlu/so 2026-01-06T13:30:14,346 copying src/unitxt/catalog/cards/global_mmlu/so/high_school_statistics.json -> build/lib/unitxt/catalog/cards/global_mmlu/so 2026-01-06T13:30:14,348 copying src/unitxt/catalog/cards/global_mmlu/so/professional_accounting.json -> build/lib/unitxt/catalog/cards/global_mmlu/so 2026-01-06T13:30:14,350 copying src/unitxt/catalog/cards/global_mmlu/so/us_foreign_policy.json -> build/lib/unitxt/catalog/cards/global_mmlu/so 2026-01-06T13:30:14,352 copying src/unitxt/catalog/cards/global_mmlu/so/professional_psychology.json -> build/lib/unitxt/catalog/cards/global_mmlu/so 2026-01-06T13:30:14,354 copying src/unitxt/catalog/cards/global_mmlu/so/public_relations.json -> build/lib/unitxt/catalog/cards/global_mmlu/so 2026-01-06T13:30:14,356 copying src/unitxt/catalog/cards/global_mmlu/so/computer_security.json -> build/lib/unitxt/catalog/cards/global_mmlu/so 2026-01-06T13:30:14,359 copying src/unitxt/catalog/cards/global_mmlu/so/philosophy.json -> build/lib/unitxt/catalog/cards/global_mmlu/so 2026-01-06T13:30:14,361 copying src/unitxt/catalog/cards/global_mmlu/so/virology.json -> build/lib/unitxt/catalog/cards/global_mmlu/so 2026-01-06T13:30:14,363 copying src/unitxt/catalog/cards/global_mmlu/so/marketing.json -> build/lib/unitxt/catalog/cards/global_mmlu/so 2026-01-06T13:30:14,366 copying src/unitxt/catalog/cards/global_mmlu/so/high_school_world_history.json -> build/lib/unitxt/catalog/cards/global_mmlu/so 2026-01-06T13:30:14,368 copying src/unitxt/catalog/cards/global_mmlu/so/machine_learning.json -> build/lib/unitxt/catalog/cards/global_mmlu/so 2026-01-06T13:30:14,370 copying src/unitxt/catalog/cards/global_mmlu/so/high_school_government_and_politics.json -> build/lib/unitxt/catalog/cards/global_mmlu/so 2026-01-06T13:30:14,372 copying src/unitxt/catalog/cards/global_mmlu/so/conceptual_physics.json -> build/lib/unitxt/catalog/cards/global_mmlu/so 2026-01-06T13:30:14,374 copying src/unitxt/catalog/cards/global_mmlu/so/college_biology.json -> build/lib/unitxt/catalog/cards/global_mmlu/so 2026-01-06T13:30:14,376 copying src/unitxt/catalog/cards/global_mmlu/so/high_school_mathematics.json -> build/lib/unitxt/catalog/cards/global_mmlu/so 2026-01-06T13:30:14,378 creating build/lib/unitxt/catalog/cards/global_mmlu/he 2026-01-06T13:30:14,379 copying src/unitxt/catalog/cards/global_mmlu/he/elementary_mathematics.json -> build/lib/unitxt/catalog/cards/global_mmlu/he 2026-01-06T13:30:14,382 copying src/unitxt/catalog/cards/global_mmlu/he/human_aging.json -> build/lib/unitxt/catalog/cards/global_mmlu/he 2026-01-06T13:30:14,384 copying src/unitxt/catalog/cards/global_mmlu/he/high_school_computer_science.json -> build/lib/unitxt/catalog/cards/global_mmlu/he 2026-01-06T13:30:14,386 copying src/unitxt/catalog/cards/global_mmlu/he/college_physics.json -> build/lib/unitxt/catalog/cards/global_mmlu/he 2026-01-06T13:30:14,388 copying src/unitxt/catalog/cards/global_mmlu/he/college_medicine.json -> build/lib/unitxt/catalog/cards/global_mmlu/he 2026-01-06T13:30:14,391 copying src/unitxt/catalog/cards/global_mmlu/he/college_mathematics.json -> build/lib/unitxt/catalog/cards/global_mmlu/he 2026-01-06T13:30:14,393 copying src/unitxt/catalog/cards/global_mmlu/he/high_school_microeconomics.json -> build/lib/unitxt/catalog/cards/global_mmlu/he 2026-01-06T13:30:14,395 copying src/unitxt/catalog/cards/global_mmlu/he/anatomy.json -> build/lib/unitxt/catalog/cards/global_mmlu/he 2026-01-06T13:30:14,397 copying src/unitxt/catalog/cards/global_mmlu/he/world_religions.json -> build/lib/unitxt/catalog/cards/global_mmlu/he 2026-01-06T13:30:14,399 copying src/unitxt/catalog/cards/global_mmlu/he/management.json -> build/lib/unitxt/catalog/cards/global_mmlu/he 2026-01-06T13:30:14,402 copying src/unitxt/catalog/cards/global_mmlu/he/moral_scenarios.json -> build/lib/unitxt/catalog/cards/global_mmlu/he 2026-01-06T13:30:14,404 copying src/unitxt/catalog/cards/global_mmlu/he/global_facts.json -> build/lib/unitxt/catalog/cards/global_mmlu/he 2026-01-06T13:30:14,406 copying src/unitxt/catalog/cards/global_mmlu/he/miscellaneous.json -> build/lib/unitxt/catalog/cards/global_mmlu/he 2026-01-06T13:30:14,408 copying src/unitxt/catalog/cards/global_mmlu/he/clinical_knowledge.json -> build/lib/unitxt/catalog/cards/global_mmlu/he 2026-01-06T13:30:14,411 copying src/unitxt/catalog/cards/global_mmlu/he/high_school_biology.json -> build/lib/unitxt/catalog/cards/global_mmlu/he 2026-01-06T13:30:14,413 copying src/unitxt/catalog/cards/global_mmlu/he/prehistory.json -> build/lib/unitxt/catalog/cards/global_mmlu/he 2026-01-06T13:30:14,415 copying src/unitxt/catalog/cards/global_mmlu/he/high_school_us_history.json -> build/lib/unitxt/catalog/cards/global_mmlu/he 2026-01-06T13:30:14,417 copying src/unitxt/catalog/cards/global_mmlu/he/international_law.json -> build/lib/unitxt/catalog/cards/global_mmlu/he 2026-01-06T13:30:14,420 copying src/unitxt/catalog/cards/global_mmlu/he/college_computer_science.json -> build/lib/unitxt/catalog/cards/global_mmlu/he 2026-01-06T13:30:14,422 copying src/unitxt/catalog/cards/global_mmlu/he/astronomy.json -> build/lib/unitxt/catalog/cards/global_mmlu/he 2026-01-06T13:30:14,424 copying src/unitxt/catalog/cards/global_mmlu/he/high_school_european_history.json -> build/lib/unitxt/catalog/cards/global_mmlu/he 2026-01-06T13:30:14,426 copying src/unitxt/catalog/cards/global_mmlu/he/electrical_engineering.json -> build/lib/unitxt/catalog/cards/global_mmlu/he 2026-01-06T13:30:14,429 copying src/unitxt/catalog/cards/global_mmlu/he/nutrition.json -> build/lib/unitxt/catalog/cards/global_mmlu/he 2026-01-06T13:30:14,431 copying src/unitxt/catalog/cards/global_mmlu/he/abstract_algebra.json -> build/lib/unitxt/catalog/cards/global_mmlu/he 2026-01-06T13:30:14,433 copying src/unitxt/catalog/cards/global_mmlu/he/professional_medicine.json -> build/lib/unitxt/catalog/cards/global_mmlu/he 2026-01-06T13:30:14,435 copying src/unitxt/catalog/cards/global_mmlu/he/human_sexuality.json -> build/lib/unitxt/catalog/cards/global_mmlu/he 2026-01-06T13:30:14,437 copying src/unitxt/catalog/cards/global_mmlu/he/business_ethics.json -> build/lib/unitxt/catalog/cards/global_mmlu/he 2026-01-06T13:30:14,439 copying src/unitxt/catalog/cards/global_mmlu/he/high_school_chemistry.json -> build/lib/unitxt/catalog/cards/global_mmlu/he 2026-01-06T13:30:14,441 copying src/unitxt/catalog/cards/global_mmlu/he/logical_fallacies.json -> build/lib/unitxt/catalog/cards/global_mmlu/he 2026-01-06T13:30:14,444 copying src/unitxt/catalog/cards/global_mmlu/he/formal_logic.json -> build/lib/unitxt/catalog/cards/global_mmlu/he 2026-01-06T13:30:14,446 copying src/unitxt/catalog/cards/global_mmlu/he/high_school_psychology.json -> build/lib/unitxt/catalog/cards/global_mmlu/he 2026-01-06T13:30:14,448 copying src/unitxt/catalog/cards/global_mmlu/he/medical_genetics.json -> build/lib/unitxt/catalog/cards/global_mmlu/he 2026-01-06T13:30:14,450 copying src/unitxt/catalog/cards/global_mmlu/he/security_studies.json -> build/lib/unitxt/catalog/cards/global_mmlu/he 2026-01-06T13:30:14,452 copying src/unitxt/catalog/cards/global_mmlu/he/high_school_macroeconomics.json -> build/lib/unitxt/catalog/cards/global_mmlu/he 2026-01-06T13:30:14,454 copying src/unitxt/catalog/cards/global_mmlu/he/professional_law.json -> build/lib/unitxt/catalog/cards/global_mmlu/he 2026-01-06T13:30:14,457 copying src/unitxt/catalog/cards/global_mmlu/he/high_school_physics.json -> build/lib/unitxt/catalog/cards/global_mmlu/he 2026-01-06T13:30:14,459 copying src/unitxt/catalog/cards/global_mmlu/he/econometrics.json -> build/lib/unitxt/catalog/cards/global_mmlu/he 2026-01-06T13:30:14,461 copying src/unitxt/catalog/cards/global_mmlu/he/sociology.json -> build/lib/unitxt/catalog/cards/global_mmlu/he 2026-01-06T13:30:14,463 copying src/unitxt/catalog/cards/global_mmlu/he/moral_disputes.json -> build/lib/unitxt/catalog/cards/global_mmlu/he 2026-01-06T13:30:14,465 copying src/unitxt/catalog/cards/global_mmlu/he/college_chemistry.json -> build/lib/unitxt/catalog/cards/global_mmlu/he 2026-01-06T13:30:14,467 copying src/unitxt/catalog/cards/global_mmlu/he/high_school_geography.json -> build/lib/unitxt/catalog/cards/global_mmlu/he 2026-01-06T13:30:14,470 copying src/unitxt/catalog/cards/global_mmlu/he/jurisprudence.json -> build/lib/unitxt/catalog/cards/global_mmlu/he 2026-01-06T13:30:14,472 copying src/unitxt/catalog/cards/global_mmlu/he/high_school_statistics.json -> build/lib/unitxt/catalog/cards/global_mmlu/he 2026-01-06T13:30:14,474 copying src/unitxt/catalog/cards/global_mmlu/he/professional_accounting.json -> build/lib/unitxt/catalog/cards/global_mmlu/he 2026-01-06T13:30:14,476 copying src/unitxt/catalog/cards/global_mmlu/he/us_foreign_policy.json -> build/lib/unitxt/catalog/cards/global_mmlu/he 2026-01-06T13:30:14,479 copying src/unitxt/catalog/cards/global_mmlu/he/professional_psychology.json -> build/lib/unitxt/catalog/cards/global_mmlu/he 2026-01-06T13:30:14,481 copying src/unitxt/catalog/cards/global_mmlu/he/public_relations.json -> build/lib/unitxt/catalog/cards/global_mmlu/he 2026-01-06T13:30:14,483 copying src/unitxt/catalog/cards/global_mmlu/he/computer_security.json -> build/lib/unitxt/catalog/cards/global_mmlu/he 2026-01-06T13:30:14,485 copying src/unitxt/catalog/cards/global_mmlu/he/philosophy.json -> build/lib/unitxt/catalog/cards/global_mmlu/he 2026-01-06T13:30:14,487 copying src/unitxt/catalog/cards/global_mmlu/he/virology.json -> build/lib/unitxt/catalog/cards/global_mmlu/he 2026-01-06T13:30:14,489 copying src/unitxt/catalog/cards/global_mmlu/he/marketing.json -> build/lib/unitxt/catalog/cards/global_mmlu/he 2026-01-06T13:30:14,492 copying src/unitxt/catalog/cards/global_mmlu/he/high_school_world_history.json -> build/lib/unitxt/catalog/cards/global_mmlu/he 2026-01-06T13:30:14,494 copying src/unitxt/catalog/cards/global_mmlu/he/machine_learning.json -> build/lib/unitxt/catalog/cards/global_mmlu/he 2026-01-06T13:30:14,496 copying src/unitxt/catalog/cards/global_mmlu/he/high_school_government_and_politics.json -> build/lib/unitxt/catalog/cards/global_mmlu/he 2026-01-06T13:30:14,498 copying src/unitxt/catalog/cards/global_mmlu/he/conceptual_physics.json -> build/lib/unitxt/catalog/cards/global_mmlu/he 2026-01-06T13:30:14,500 copying src/unitxt/catalog/cards/global_mmlu/he/college_biology.json -> build/lib/unitxt/catalog/cards/global_mmlu/he 2026-01-06T13:30:14,502 copying src/unitxt/catalog/cards/global_mmlu/he/high_school_mathematics.json -> build/lib/unitxt/catalog/cards/global_mmlu/he 2026-01-06T13:30:14,504 creating build/lib/unitxt/catalog/cards/global_mmlu/en 2026-01-06T13:30:14,505 copying src/unitxt/catalog/cards/global_mmlu/en/elementary_mathematics.json -> build/lib/unitxt/catalog/cards/global_mmlu/en 2026-01-06T13:30:14,507 copying src/unitxt/catalog/cards/global_mmlu/en/human_aging.json -> build/lib/unitxt/catalog/cards/global_mmlu/en 2026-01-06T13:30:14,510 copying src/unitxt/catalog/cards/global_mmlu/en/high_school_computer_science.json -> build/lib/unitxt/catalog/cards/global_mmlu/en 2026-01-06T13:30:14,512 copying src/unitxt/catalog/cards/global_mmlu/en/college_physics.json -> build/lib/unitxt/catalog/cards/global_mmlu/en 2026-01-06T13:30:14,514 copying src/unitxt/catalog/cards/global_mmlu/en/college_medicine.json -> build/lib/unitxt/catalog/cards/global_mmlu/en 2026-01-06T13:30:14,516 copying src/unitxt/catalog/cards/global_mmlu/en/college_mathematics.json -> build/lib/unitxt/catalog/cards/global_mmlu/en 2026-01-06T13:30:14,519 copying src/unitxt/catalog/cards/global_mmlu/en/high_school_microeconomics.json -> build/lib/unitxt/catalog/cards/global_mmlu/en 2026-01-06T13:30:14,521 copying src/unitxt/catalog/cards/global_mmlu/en/anatomy.json -> build/lib/unitxt/catalog/cards/global_mmlu/en 2026-01-06T13:30:14,523 copying src/unitxt/catalog/cards/global_mmlu/en/world_religions.json -> build/lib/unitxt/catalog/cards/global_mmlu/en 2026-01-06T13:30:14,525 copying src/unitxt/catalog/cards/global_mmlu/en/management.json -> build/lib/unitxt/catalog/cards/global_mmlu/en 2026-01-06T13:30:14,528 copying src/unitxt/catalog/cards/global_mmlu/en/moral_scenarios.json -> build/lib/unitxt/catalog/cards/global_mmlu/en 2026-01-06T13:30:14,530 copying src/unitxt/catalog/cards/global_mmlu/en/global_facts.json -> build/lib/unitxt/catalog/cards/global_mmlu/en 2026-01-06T13:30:14,532 copying src/unitxt/catalog/cards/global_mmlu/en/miscellaneous.json -> build/lib/unitxt/catalog/cards/global_mmlu/en 2026-01-06T13:30:14,534 copying src/unitxt/catalog/cards/global_mmlu/en/clinical_knowledge.json -> build/lib/unitxt/catalog/cards/global_mmlu/en 2026-01-06T13:30:14,537 copying src/unitxt/catalog/cards/global_mmlu/en/high_school_biology.json -> build/lib/unitxt/catalog/cards/global_mmlu/en 2026-01-06T13:30:14,539 copying src/unitxt/catalog/cards/global_mmlu/en/prehistory.json -> build/lib/unitxt/catalog/cards/global_mmlu/en 2026-01-06T13:30:14,541 copying src/unitxt/catalog/cards/global_mmlu/en/high_school_us_history.json -> build/lib/unitxt/catalog/cards/global_mmlu/en 2026-01-06T13:30:14,543 copying src/unitxt/catalog/cards/global_mmlu/en/international_law.json -> build/lib/unitxt/catalog/cards/global_mmlu/en 2026-01-06T13:30:14,546 copying src/unitxt/catalog/cards/global_mmlu/en/college_computer_science.json -> build/lib/unitxt/catalog/cards/global_mmlu/en 2026-01-06T13:30:14,548 copying src/unitxt/catalog/cards/global_mmlu/en/astronomy.json -> build/lib/unitxt/catalog/cards/global_mmlu/en 2026-01-06T13:30:14,550 copying src/unitxt/catalog/cards/global_mmlu/en/high_school_european_history.json -> build/lib/unitxt/catalog/cards/global_mmlu/en 2026-01-06T13:30:14,552 copying src/unitxt/catalog/cards/global_mmlu/en/electrical_engineering.json -> build/lib/unitxt/catalog/cards/global_mmlu/en 2026-01-06T13:30:14,554 copying src/unitxt/catalog/cards/global_mmlu/en/nutrition.json -> build/lib/unitxt/catalog/cards/global_mmlu/en 2026-01-06T13:30:14,556 copying src/unitxt/catalog/cards/global_mmlu/en/abstract_algebra.json -> build/lib/unitxt/catalog/cards/global_mmlu/en 2026-01-06T13:30:14,558 copying src/unitxt/catalog/cards/global_mmlu/en/professional_medicine.json -> build/lib/unitxt/catalog/cards/global_mmlu/en 2026-01-06T13:30:14,560 copying src/unitxt/catalog/cards/global_mmlu/en/human_sexuality.json -> build/lib/unitxt/catalog/cards/global_mmlu/en 2026-01-06T13:30:14,563 copying src/unitxt/catalog/cards/global_mmlu/en/business_ethics.json -> build/lib/unitxt/catalog/cards/global_mmlu/en 2026-01-06T13:30:14,565 copying src/unitxt/catalog/cards/global_mmlu/en/high_school_chemistry.json -> build/lib/unitxt/catalog/cards/global_mmlu/en 2026-01-06T13:30:14,567 copying src/unitxt/catalog/cards/global_mmlu/en/logical_fallacies.json -> build/lib/unitxt/catalog/cards/global_mmlu/en 2026-01-06T13:30:14,569 copying src/unitxt/catalog/cards/global_mmlu/en/formal_logic.json -> build/lib/unitxt/catalog/cards/global_mmlu/en 2026-01-06T13:30:14,571 copying src/unitxt/catalog/cards/global_mmlu/en/high_school_psychology.json -> build/lib/unitxt/catalog/cards/global_mmlu/en 2026-01-06T13:30:14,574 copying src/unitxt/catalog/cards/global_mmlu/en/medical_genetics.json -> build/lib/unitxt/catalog/cards/global_mmlu/en 2026-01-06T13:30:14,576 copying src/unitxt/catalog/cards/global_mmlu/en/security_studies.json -> build/lib/unitxt/catalog/cards/global_mmlu/en 2026-01-06T13:30:14,578 copying src/unitxt/catalog/cards/global_mmlu/en/high_school_macroeconomics.json -> build/lib/unitxt/catalog/cards/global_mmlu/en 2026-01-06T13:30:14,580 copying src/unitxt/catalog/cards/global_mmlu/en/professional_law.json -> build/lib/unitxt/catalog/cards/global_mmlu/en 2026-01-06T13:30:14,582 copying src/unitxt/catalog/cards/global_mmlu/en/high_school_physics.json -> build/lib/unitxt/catalog/cards/global_mmlu/en 2026-01-06T13:30:14,585 copying src/unitxt/catalog/cards/global_mmlu/en/econometrics.json -> build/lib/unitxt/catalog/cards/global_mmlu/en 2026-01-06T13:30:14,587 copying src/unitxt/catalog/cards/global_mmlu/en/sociology.json -> build/lib/unitxt/catalog/cards/global_mmlu/en 2026-01-06T13:30:14,589 copying src/unitxt/catalog/cards/global_mmlu/en/moral_disputes.json -> build/lib/unitxt/catalog/cards/global_mmlu/en 2026-01-06T13:30:14,592 copying src/unitxt/catalog/cards/global_mmlu/en/college_chemistry.json -> build/lib/unitxt/catalog/cards/global_mmlu/en 2026-01-06T13:30:14,594 copying src/unitxt/catalog/cards/global_mmlu/en/high_school_geography.json -> build/lib/unitxt/catalog/cards/global_mmlu/en 2026-01-06T13:30:14,597 copying src/unitxt/catalog/cards/global_mmlu/en/jurisprudence.json -> build/lib/unitxt/catalog/cards/global_mmlu/en 2026-01-06T13:30:14,600 copying src/unitxt/catalog/cards/global_mmlu/en/high_school_statistics.json -> build/lib/unitxt/catalog/cards/global_mmlu/en 2026-01-06T13:30:14,602 copying src/unitxt/catalog/cards/global_mmlu/en/professional_accounting.json -> build/lib/unitxt/catalog/cards/global_mmlu/en 2026-01-06T13:30:14,604 copying src/unitxt/catalog/cards/global_mmlu/en/us_foreign_policy.json -> build/lib/unitxt/catalog/cards/global_mmlu/en 2026-01-06T13:30:14,607 copying src/unitxt/catalog/cards/global_mmlu/en/professional_psychology.json -> build/lib/unitxt/catalog/cards/global_mmlu/en 2026-01-06T13:30:14,610 copying src/unitxt/catalog/cards/global_mmlu/en/public_relations.json -> build/lib/unitxt/catalog/cards/global_mmlu/en 2026-01-06T13:30:14,612 copying src/unitxt/catalog/cards/global_mmlu/en/computer_security.json -> build/lib/unitxt/catalog/cards/global_mmlu/en 2026-01-06T13:30:14,614 copying src/unitxt/catalog/cards/global_mmlu/en/philosophy.json -> build/lib/unitxt/catalog/cards/global_mmlu/en 2026-01-06T13:30:14,617 copying src/unitxt/catalog/cards/global_mmlu/en/virology.json -> build/lib/unitxt/catalog/cards/global_mmlu/en 2026-01-06T13:30:14,620 copying src/unitxt/catalog/cards/global_mmlu/en/marketing.json -> build/lib/unitxt/catalog/cards/global_mmlu/en 2026-01-06T13:30:14,622 copying src/unitxt/catalog/cards/global_mmlu/en/high_school_world_history.json -> build/lib/unitxt/catalog/cards/global_mmlu/en 2026-01-06T13:30:14,625 copying src/unitxt/catalog/cards/global_mmlu/en/machine_learning.json -> build/lib/unitxt/catalog/cards/global_mmlu/en 2026-01-06T13:30:14,628 copying src/unitxt/catalog/cards/global_mmlu/en/high_school_government_and_politics.json -> build/lib/unitxt/catalog/cards/global_mmlu/en 2026-01-06T13:30:14,631 copying src/unitxt/catalog/cards/global_mmlu/en/conceptual_physics.json -> build/lib/unitxt/catalog/cards/global_mmlu/en 2026-01-06T13:30:14,633 copying src/unitxt/catalog/cards/global_mmlu/en/college_biology.json -> build/lib/unitxt/catalog/cards/global_mmlu/en 2026-01-06T13:30:14,636 copying src/unitxt/catalog/cards/global_mmlu/en/high_school_mathematics.json -> build/lib/unitxt/catalog/cards/global_mmlu/en 2026-01-06T13:30:14,638 creating build/lib/unitxt/catalog/cards/global_mmlu/es 2026-01-06T13:30:14,639 copying src/unitxt/catalog/cards/global_mmlu/es/elementary_mathematics.json -> build/lib/unitxt/catalog/cards/global_mmlu/es 2026-01-06T13:30:14,642 copying src/unitxt/catalog/cards/global_mmlu/es/human_aging.json -> build/lib/unitxt/catalog/cards/global_mmlu/es 2026-01-06T13:30:14,645 copying src/unitxt/catalog/cards/global_mmlu/es/high_school_computer_science.json -> build/lib/unitxt/catalog/cards/global_mmlu/es 2026-01-06T13:30:14,647 copying src/unitxt/catalog/cards/global_mmlu/es/college_physics.json -> build/lib/unitxt/catalog/cards/global_mmlu/es 2026-01-06T13:30:14,649 copying src/unitxt/catalog/cards/global_mmlu/es/college_medicine.json -> build/lib/unitxt/catalog/cards/global_mmlu/es 2026-01-06T13:30:14,652 copying src/unitxt/catalog/cards/global_mmlu/es/college_mathematics.json -> build/lib/unitxt/catalog/cards/global_mmlu/es 2026-01-06T13:30:14,655 copying src/unitxt/catalog/cards/global_mmlu/es/high_school_microeconomics.json -> build/lib/unitxt/catalog/cards/global_mmlu/es 2026-01-06T13:30:14,657 copying src/unitxt/catalog/cards/global_mmlu/es/anatomy.json -> build/lib/unitxt/catalog/cards/global_mmlu/es 2026-01-06T13:30:14,659 copying src/unitxt/catalog/cards/global_mmlu/es/world_religions.json -> build/lib/unitxt/catalog/cards/global_mmlu/es 2026-01-06T13:30:14,662 copying src/unitxt/catalog/cards/global_mmlu/es/management.json -> build/lib/unitxt/catalog/cards/global_mmlu/es 2026-01-06T13:30:14,664 copying src/unitxt/catalog/cards/global_mmlu/es/moral_scenarios.json -> build/lib/unitxt/catalog/cards/global_mmlu/es 2026-01-06T13:30:14,667 copying src/unitxt/catalog/cards/global_mmlu/es/global_facts.json -> build/lib/unitxt/catalog/cards/global_mmlu/es 2026-01-06T13:30:14,669 copying src/unitxt/catalog/cards/global_mmlu/es/miscellaneous.json -> build/lib/unitxt/catalog/cards/global_mmlu/es 2026-01-06T13:30:14,672 copying src/unitxt/catalog/cards/global_mmlu/es/clinical_knowledge.json -> build/lib/unitxt/catalog/cards/global_mmlu/es 2026-01-06T13:30:14,675 copying src/unitxt/catalog/cards/global_mmlu/es/high_school_biology.json -> build/lib/unitxt/catalog/cards/global_mmlu/es 2026-01-06T13:30:14,677 copying src/unitxt/catalog/cards/global_mmlu/es/prehistory.json -> build/lib/unitxt/catalog/cards/global_mmlu/es 2026-01-06T13:30:14,679 copying src/unitxt/catalog/cards/global_mmlu/es/high_school_us_history.json -> build/lib/unitxt/catalog/cards/global_mmlu/es 2026-01-06T13:30:14,682 copying src/unitxt/catalog/cards/global_mmlu/es/international_law.json -> build/lib/unitxt/catalog/cards/global_mmlu/es 2026-01-06T13:30:14,685 copying src/unitxt/catalog/cards/global_mmlu/es/college_computer_science.json -> build/lib/unitxt/catalog/cards/global_mmlu/es 2026-01-06T13:30:14,687 copying src/unitxt/catalog/cards/global_mmlu/es/astronomy.json -> build/lib/unitxt/catalog/cards/global_mmlu/es 2026-01-06T13:30:14,690 copying src/unitxt/catalog/cards/global_mmlu/es/high_school_european_history.json -> build/lib/unitxt/catalog/cards/global_mmlu/es 2026-01-06T13:30:14,692 copying src/unitxt/catalog/cards/global_mmlu/es/electrical_engineering.json -> build/lib/unitxt/catalog/cards/global_mmlu/es 2026-01-06T13:30:14,695 copying src/unitxt/catalog/cards/global_mmlu/es/nutrition.json -> build/lib/unitxt/catalog/cards/global_mmlu/es 2026-01-06T13:30:14,697 copying src/unitxt/catalog/cards/global_mmlu/es/abstract_algebra.json -> build/lib/unitxt/catalog/cards/global_mmlu/es 2026-01-06T13:30:14,699 copying src/unitxt/catalog/cards/global_mmlu/es/professional_medicine.json -> build/lib/unitxt/catalog/cards/global_mmlu/es 2026-01-06T13:30:14,702 copying src/unitxt/catalog/cards/global_mmlu/es/human_sexuality.json -> build/lib/unitxt/catalog/cards/global_mmlu/es 2026-01-06T13:30:14,704 copying src/unitxt/catalog/cards/global_mmlu/es/business_ethics.json -> build/lib/unitxt/catalog/cards/global_mmlu/es 2026-01-06T13:30:14,707 copying src/unitxt/catalog/cards/global_mmlu/es/high_school_chemistry.json -> build/lib/unitxt/catalog/cards/global_mmlu/es 2026-01-06T13:30:14,709 copying src/unitxt/catalog/cards/global_mmlu/es/logical_fallacies.json -> build/lib/unitxt/catalog/cards/global_mmlu/es 2026-01-06T13:30:14,712 copying src/unitxt/catalog/cards/global_mmlu/es/formal_logic.json -> build/lib/unitxt/catalog/cards/global_mmlu/es 2026-01-06T13:30:14,715 copying src/unitxt/catalog/cards/global_mmlu/es/high_school_psychology.json -> build/lib/unitxt/catalog/cards/global_mmlu/es 2026-01-06T13:30:14,717 copying src/unitxt/catalog/cards/global_mmlu/es/medical_genetics.json -> build/lib/unitxt/catalog/cards/global_mmlu/es 2026-01-06T13:30:14,719 copying src/unitxt/catalog/cards/global_mmlu/es/security_studies.json -> build/lib/unitxt/catalog/cards/global_mmlu/es 2026-01-06T13:30:14,722 copying src/unitxt/catalog/cards/global_mmlu/es/high_school_macroeconomics.json -> build/lib/unitxt/catalog/cards/global_mmlu/es 2026-01-06T13:30:14,725 copying src/unitxt/catalog/cards/global_mmlu/es/professional_law.json -> build/lib/unitxt/catalog/cards/global_mmlu/es 2026-01-06T13:30:14,727 copying src/unitxt/catalog/cards/global_mmlu/es/high_school_physics.json -> build/lib/unitxt/catalog/cards/global_mmlu/es 2026-01-06T13:30:14,730 copying src/unitxt/catalog/cards/global_mmlu/es/econometrics.json -> build/lib/unitxt/catalog/cards/global_mmlu/es 2026-01-06T13:30:14,733 copying src/unitxt/catalog/cards/global_mmlu/es/sociology.json -> build/lib/unitxt/catalog/cards/global_mmlu/es 2026-01-06T13:30:14,735 copying src/unitxt/catalog/cards/global_mmlu/es/moral_disputes.json -> build/lib/unitxt/catalog/cards/global_mmlu/es 2026-01-06T13:30:14,738 copying src/unitxt/catalog/cards/global_mmlu/es/college_chemistry.json -> build/lib/unitxt/catalog/cards/global_mmlu/es 2026-01-06T13:30:14,741 copying src/unitxt/catalog/cards/global_mmlu/es/high_school_geography.json -> build/lib/unitxt/catalog/cards/global_mmlu/es 2026-01-06T13:30:14,743 copying src/unitxt/catalog/cards/global_mmlu/es/jurisprudence.json -> build/lib/unitxt/catalog/cards/global_mmlu/es 2026-01-06T13:30:14,745 copying src/unitxt/catalog/cards/global_mmlu/es/high_school_statistics.json -> build/lib/unitxt/catalog/cards/global_mmlu/es 2026-01-06T13:30:14,747 copying src/unitxt/catalog/cards/global_mmlu/es/professional_accounting.json -> build/lib/unitxt/catalog/cards/global_mmlu/es 2026-01-06T13:30:14,750 copying src/unitxt/catalog/cards/global_mmlu/es/us_foreign_policy.json -> build/lib/unitxt/catalog/cards/global_mmlu/es 2026-01-06T13:30:14,752 copying src/unitxt/catalog/cards/global_mmlu/es/professional_psychology.json -> build/lib/unitxt/catalog/cards/global_mmlu/es 2026-01-06T13:30:14,754 copying src/unitxt/catalog/cards/global_mmlu/es/public_relations.json -> build/lib/unitxt/catalog/cards/global_mmlu/es 2026-01-06T13:30:14,756 copying src/unitxt/catalog/cards/global_mmlu/es/computer_security.json -> build/lib/unitxt/catalog/cards/global_mmlu/es 2026-01-06T13:30:14,758 copying src/unitxt/catalog/cards/global_mmlu/es/philosophy.json -> build/lib/unitxt/catalog/cards/global_mmlu/es 2026-01-06T13:30:14,760 copying src/unitxt/catalog/cards/global_mmlu/es/virology.json -> build/lib/unitxt/catalog/cards/global_mmlu/es 2026-01-06T13:30:14,762 copying src/unitxt/catalog/cards/global_mmlu/es/marketing.json -> build/lib/unitxt/catalog/cards/global_mmlu/es 2026-01-06T13:30:14,764 copying src/unitxt/catalog/cards/global_mmlu/es/high_school_world_history.json -> build/lib/unitxt/catalog/cards/global_mmlu/es 2026-01-06T13:30:14,766 copying src/unitxt/catalog/cards/global_mmlu/es/machine_learning.json -> build/lib/unitxt/catalog/cards/global_mmlu/es 2026-01-06T13:30:14,769 copying src/unitxt/catalog/cards/global_mmlu/es/high_school_government_and_politics.json -> build/lib/unitxt/catalog/cards/global_mmlu/es 2026-01-06T13:30:14,771 copying src/unitxt/catalog/cards/global_mmlu/es/conceptual_physics.json -> build/lib/unitxt/catalog/cards/global_mmlu/es 2026-01-06T13:30:14,773 copying src/unitxt/catalog/cards/global_mmlu/es/college_biology.json -> build/lib/unitxt/catalog/cards/global_mmlu/es 2026-01-06T13:30:14,775 copying src/unitxt/catalog/cards/global_mmlu/es/high_school_mathematics.json -> build/lib/unitxt/catalog/cards/global_mmlu/es 2026-01-06T13:30:14,777 creating build/lib/unitxt/catalog/cards/global_mmlu/hi 2026-01-06T13:30:14,778 copying src/unitxt/catalog/cards/global_mmlu/hi/elementary_mathematics.json -> build/lib/unitxt/catalog/cards/global_mmlu/hi 2026-01-06T13:30:14,781 copying src/unitxt/catalog/cards/global_mmlu/hi/human_aging.json -> build/lib/unitxt/catalog/cards/global_mmlu/hi 2026-01-06T13:30:14,783 copying src/unitxt/catalog/cards/global_mmlu/hi/high_school_computer_science.json -> build/lib/unitxt/catalog/cards/global_mmlu/hi 2026-01-06T13:30:14,785 copying src/unitxt/catalog/cards/global_mmlu/hi/college_physics.json -> build/lib/unitxt/catalog/cards/global_mmlu/hi 2026-01-06T13:30:14,787 copying src/unitxt/catalog/cards/global_mmlu/hi/college_medicine.json -> build/lib/unitxt/catalog/cards/global_mmlu/hi 2026-01-06T13:30:14,789 copying src/unitxt/catalog/cards/global_mmlu/hi/college_mathematics.json -> build/lib/unitxt/catalog/cards/global_mmlu/hi 2026-01-06T13:30:14,791 copying src/unitxt/catalog/cards/global_mmlu/hi/high_school_microeconomics.json -> build/lib/unitxt/catalog/cards/global_mmlu/hi 2026-01-06T13:30:14,794 copying src/unitxt/catalog/cards/global_mmlu/hi/anatomy.json -> build/lib/unitxt/catalog/cards/global_mmlu/hi 2026-01-06T13:30:14,796 copying src/unitxt/catalog/cards/global_mmlu/hi/world_religions.json -> build/lib/unitxt/catalog/cards/global_mmlu/hi 2026-01-06T13:30:14,799 copying src/unitxt/catalog/cards/global_mmlu/hi/management.json -> build/lib/unitxt/catalog/cards/global_mmlu/hi 2026-01-06T13:30:14,801 copying src/unitxt/catalog/cards/global_mmlu/hi/moral_scenarios.json -> build/lib/unitxt/catalog/cards/global_mmlu/hi 2026-01-06T13:30:14,804 copying src/unitxt/catalog/cards/global_mmlu/hi/global_facts.json -> build/lib/unitxt/catalog/cards/global_mmlu/hi 2026-01-06T13:30:14,806 copying src/unitxt/catalog/cards/global_mmlu/hi/miscellaneous.json -> build/lib/unitxt/catalog/cards/global_mmlu/hi 2026-01-06T13:30:14,808 copying src/unitxt/catalog/cards/global_mmlu/hi/clinical_knowledge.json -> build/lib/unitxt/catalog/cards/global_mmlu/hi 2026-01-06T13:30:14,810 copying src/unitxt/catalog/cards/global_mmlu/hi/high_school_biology.json -> build/lib/unitxt/catalog/cards/global_mmlu/hi 2026-01-06T13:30:14,812 copying src/unitxt/catalog/cards/global_mmlu/hi/prehistory.json -> build/lib/unitxt/catalog/cards/global_mmlu/hi 2026-01-06T13:30:14,814 copying src/unitxt/catalog/cards/global_mmlu/hi/high_school_us_history.json -> build/lib/unitxt/catalog/cards/global_mmlu/hi 2026-01-06T13:30:14,817 copying src/unitxt/catalog/cards/global_mmlu/hi/international_law.json -> build/lib/unitxt/catalog/cards/global_mmlu/hi 2026-01-06T13:30:14,819 copying src/unitxt/catalog/cards/global_mmlu/hi/college_computer_science.json -> build/lib/unitxt/catalog/cards/global_mmlu/hi 2026-01-06T13:30:14,821 copying src/unitxt/catalog/cards/global_mmlu/hi/astronomy.json -> build/lib/unitxt/catalog/cards/global_mmlu/hi 2026-01-06T13:30:14,823 copying src/unitxt/catalog/cards/global_mmlu/hi/high_school_european_history.json -> build/lib/unitxt/catalog/cards/global_mmlu/hi 2026-01-06T13:30:14,826 copying src/unitxt/catalog/cards/global_mmlu/hi/electrical_engineering.json -> build/lib/unitxt/catalog/cards/global_mmlu/hi 2026-01-06T13:30:14,828 copying src/unitxt/catalog/cards/global_mmlu/hi/nutrition.json -> build/lib/unitxt/catalog/cards/global_mmlu/hi 2026-01-06T13:30:14,830 copying src/unitxt/catalog/cards/global_mmlu/hi/abstract_algebra.json -> build/lib/unitxt/catalog/cards/global_mmlu/hi 2026-01-06T13:30:14,832 copying src/unitxt/catalog/cards/global_mmlu/hi/professional_medicine.json -> build/lib/unitxt/catalog/cards/global_mmlu/hi 2026-01-06T13:30:14,834 copying src/unitxt/catalog/cards/global_mmlu/hi/human_sexuality.json -> build/lib/unitxt/catalog/cards/global_mmlu/hi 2026-01-06T13:30:14,837 copying src/unitxt/catalog/cards/global_mmlu/hi/business_ethics.json -> build/lib/unitxt/catalog/cards/global_mmlu/hi 2026-01-06T13:30:14,839 copying src/unitxt/catalog/cards/global_mmlu/hi/high_school_chemistry.json -> build/lib/unitxt/catalog/cards/global_mmlu/hi 2026-01-06T13:30:14,841 copying src/unitxt/catalog/cards/global_mmlu/hi/logical_fallacies.json -> build/lib/unitxt/catalog/cards/global_mmlu/hi 2026-01-06T13:30:14,843 copying src/unitxt/catalog/cards/global_mmlu/hi/formal_logic.json -> build/lib/unitxt/catalog/cards/global_mmlu/hi 2026-01-06T13:30:14,846 copying src/unitxt/catalog/cards/global_mmlu/hi/high_school_psychology.json -> build/lib/unitxt/catalog/cards/global_mmlu/hi 2026-01-06T13:30:14,848 copying src/unitxt/catalog/cards/global_mmlu/hi/medical_genetics.json -> build/lib/unitxt/catalog/cards/global_mmlu/hi 2026-01-06T13:30:14,850 copying src/unitxt/catalog/cards/global_mmlu/hi/security_studies.json -> build/lib/unitxt/catalog/cards/global_mmlu/hi 2026-01-06T13:30:14,853 copying src/unitxt/catalog/cards/global_mmlu/hi/high_school_macroeconomics.json -> build/lib/unitxt/catalog/cards/global_mmlu/hi 2026-01-06T13:30:14,855 copying src/unitxt/catalog/cards/global_mmlu/hi/professional_law.json -> build/lib/unitxt/catalog/cards/global_mmlu/hi 2026-01-06T13:30:14,857 copying src/unitxt/catalog/cards/global_mmlu/hi/high_school_physics.json -> build/lib/unitxt/catalog/cards/global_mmlu/hi 2026-01-06T13:30:14,859 copying src/unitxt/catalog/cards/global_mmlu/hi/econometrics.json -> build/lib/unitxt/catalog/cards/global_mmlu/hi 2026-01-06T13:30:14,861 copying src/unitxt/catalog/cards/global_mmlu/hi/sociology.json -> build/lib/unitxt/catalog/cards/global_mmlu/hi 2026-01-06T13:30:14,864 copying src/unitxt/catalog/cards/global_mmlu/hi/moral_disputes.json -> build/lib/unitxt/catalog/cards/global_mmlu/hi 2026-01-06T13:30:14,866 copying src/unitxt/catalog/cards/global_mmlu/hi/college_chemistry.json -> build/lib/unitxt/catalog/cards/global_mmlu/hi 2026-01-06T13:30:14,868 copying src/unitxt/catalog/cards/global_mmlu/hi/high_school_geography.json -> build/lib/unitxt/catalog/cards/global_mmlu/hi 2026-01-06T13:30:14,870 copying src/unitxt/catalog/cards/global_mmlu/hi/jurisprudence.json -> build/lib/unitxt/catalog/cards/global_mmlu/hi 2026-01-06T13:30:14,872 copying src/unitxt/catalog/cards/global_mmlu/hi/high_school_statistics.json -> build/lib/unitxt/catalog/cards/global_mmlu/hi 2026-01-06T13:30:14,874 copying src/unitxt/catalog/cards/global_mmlu/hi/professional_accounting.json -> build/lib/unitxt/catalog/cards/global_mmlu/hi 2026-01-06T13:30:14,877 copying src/unitxt/catalog/cards/global_mmlu/hi/us_foreign_policy.json -> build/lib/unitxt/catalog/cards/global_mmlu/hi 2026-01-06T13:30:14,879 copying src/unitxt/catalog/cards/global_mmlu/hi/professional_psychology.json -> build/lib/unitxt/catalog/cards/global_mmlu/hi 2026-01-06T13:30:14,881 copying src/unitxt/catalog/cards/global_mmlu/hi/public_relations.json -> build/lib/unitxt/catalog/cards/global_mmlu/hi 2026-01-06T13:30:14,883 copying src/unitxt/catalog/cards/global_mmlu/hi/computer_security.json -> build/lib/unitxt/catalog/cards/global_mmlu/hi 2026-01-06T13:30:14,885 copying src/unitxt/catalog/cards/global_mmlu/hi/philosophy.json -> build/lib/unitxt/catalog/cards/global_mmlu/hi 2026-01-06T13:30:14,887 copying src/unitxt/catalog/cards/global_mmlu/hi/virology.json -> build/lib/unitxt/catalog/cards/global_mmlu/hi 2026-01-06T13:30:14,889 copying src/unitxt/catalog/cards/global_mmlu/hi/marketing.json -> build/lib/unitxt/catalog/cards/global_mmlu/hi 2026-01-06T13:30:14,891 copying src/unitxt/catalog/cards/global_mmlu/hi/high_school_world_history.json -> build/lib/unitxt/catalog/cards/global_mmlu/hi 2026-01-06T13:30:14,894 copying src/unitxt/catalog/cards/global_mmlu/hi/machine_learning.json -> build/lib/unitxt/catalog/cards/global_mmlu/hi 2026-01-06T13:30:14,896 copying src/unitxt/catalog/cards/global_mmlu/hi/high_school_government_and_politics.json -> build/lib/unitxt/catalog/cards/global_mmlu/hi 2026-01-06T13:30:14,898 copying src/unitxt/catalog/cards/global_mmlu/hi/conceptual_physics.json -> build/lib/unitxt/catalog/cards/global_mmlu/hi 2026-01-06T13:30:14,900 copying src/unitxt/catalog/cards/global_mmlu/hi/college_biology.json -> build/lib/unitxt/catalog/cards/global_mmlu/hi 2026-01-06T13:30:14,902 copying src/unitxt/catalog/cards/global_mmlu/hi/high_school_mathematics.json -> build/lib/unitxt/catalog/cards/global_mmlu/hi 2026-01-06T13:30:14,904 creating build/lib/unitxt/catalog/cards/global_mmlu/lt 2026-01-06T13:30:14,905 copying src/unitxt/catalog/cards/global_mmlu/lt/elementary_mathematics.json -> build/lib/unitxt/catalog/cards/global_mmlu/lt 2026-01-06T13:30:14,907 copying src/unitxt/catalog/cards/global_mmlu/lt/human_aging.json -> build/lib/unitxt/catalog/cards/global_mmlu/lt 2026-01-06T13:30:14,910 copying src/unitxt/catalog/cards/global_mmlu/lt/high_school_computer_science.json -> build/lib/unitxt/catalog/cards/global_mmlu/lt 2026-01-06T13:30:14,912 copying src/unitxt/catalog/cards/global_mmlu/lt/college_physics.json -> build/lib/unitxt/catalog/cards/global_mmlu/lt 2026-01-06T13:30:14,914 copying src/unitxt/catalog/cards/global_mmlu/lt/college_medicine.json -> build/lib/unitxt/catalog/cards/global_mmlu/lt 2026-01-06T13:30:14,916 copying src/unitxt/catalog/cards/global_mmlu/lt/college_mathematics.json -> build/lib/unitxt/catalog/cards/global_mmlu/lt 2026-01-06T13:30:14,919 copying src/unitxt/catalog/cards/global_mmlu/lt/high_school_microeconomics.json -> build/lib/unitxt/catalog/cards/global_mmlu/lt 2026-01-06T13:30:14,921 copying src/unitxt/catalog/cards/global_mmlu/lt/anatomy.json -> build/lib/unitxt/catalog/cards/global_mmlu/lt 2026-01-06T13:30:14,923 copying src/unitxt/catalog/cards/global_mmlu/lt/world_religions.json -> build/lib/unitxt/catalog/cards/global_mmlu/lt 2026-01-06T13:30:14,926 copying src/unitxt/catalog/cards/global_mmlu/lt/management.json -> build/lib/unitxt/catalog/cards/global_mmlu/lt 2026-01-06T13:30:14,928 copying src/unitxt/catalog/cards/global_mmlu/lt/moral_scenarios.json -> build/lib/unitxt/catalog/cards/global_mmlu/lt 2026-01-06T13:30:14,930 copying src/unitxt/catalog/cards/global_mmlu/lt/global_facts.json -> build/lib/unitxt/catalog/cards/global_mmlu/lt 2026-01-06T13:30:14,932 copying src/unitxt/catalog/cards/global_mmlu/lt/miscellaneous.json -> build/lib/unitxt/catalog/cards/global_mmlu/lt 2026-01-06T13:30:14,935 copying src/unitxt/catalog/cards/global_mmlu/lt/clinical_knowledge.json -> build/lib/unitxt/catalog/cards/global_mmlu/lt 2026-01-06T13:30:14,937 copying src/unitxt/catalog/cards/global_mmlu/lt/high_school_biology.json -> build/lib/unitxt/catalog/cards/global_mmlu/lt 2026-01-06T13:30:14,939 copying src/unitxt/catalog/cards/global_mmlu/lt/prehistory.json -> build/lib/unitxt/catalog/cards/global_mmlu/lt 2026-01-06T13:30:14,941 copying src/unitxt/catalog/cards/global_mmlu/lt/high_school_us_history.json -> build/lib/unitxt/catalog/cards/global_mmlu/lt 2026-01-06T13:30:14,944 copying src/unitxt/catalog/cards/global_mmlu/lt/international_law.json -> build/lib/unitxt/catalog/cards/global_mmlu/lt 2026-01-06T13:30:14,946 copying src/unitxt/catalog/cards/global_mmlu/lt/college_computer_science.json -> build/lib/unitxt/catalog/cards/global_mmlu/lt 2026-01-06T13:30:14,948 copying src/unitxt/catalog/cards/global_mmlu/lt/astronomy.json -> build/lib/unitxt/catalog/cards/global_mmlu/lt 2026-01-06T13:30:14,950 copying src/unitxt/catalog/cards/global_mmlu/lt/high_school_european_history.json -> build/lib/unitxt/catalog/cards/global_mmlu/lt 2026-01-06T13:30:14,952 copying src/unitxt/catalog/cards/global_mmlu/lt/electrical_engineering.json -> build/lib/unitxt/catalog/cards/global_mmlu/lt 2026-01-06T13:30:14,955 copying src/unitxt/catalog/cards/global_mmlu/lt/nutrition.json -> build/lib/unitxt/catalog/cards/global_mmlu/lt 2026-01-06T13:30:14,957 copying src/unitxt/catalog/cards/global_mmlu/lt/abstract_algebra.json -> build/lib/unitxt/catalog/cards/global_mmlu/lt 2026-01-06T13:30:14,959 copying src/unitxt/catalog/cards/global_mmlu/lt/professional_medicine.json -> build/lib/unitxt/catalog/cards/global_mmlu/lt 2026-01-06T13:30:14,961 copying src/unitxt/catalog/cards/global_mmlu/lt/human_sexuality.json -> build/lib/unitxt/catalog/cards/global_mmlu/lt 2026-01-06T13:30:14,964 copying src/unitxt/catalog/cards/global_mmlu/lt/business_ethics.json -> build/lib/unitxt/catalog/cards/global_mmlu/lt 2026-01-06T13:30:14,966 copying src/unitxt/catalog/cards/global_mmlu/lt/high_school_chemistry.json -> build/lib/unitxt/catalog/cards/global_mmlu/lt 2026-01-06T13:30:14,968 copying src/unitxt/catalog/cards/global_mmlu/lt/logical_fallacies.json -> build/lib/unitxt/catalog/cards/global_mmlu/lt 2026-01-06T13:30:14,970 copying src/unitxt/catalog/cards/global_mmlu/lt/formal_logic.json -> build/lib/unitxt/catalog/cards/global_mmlu/lt 2026-01-06T13:30:14,973 copying src/unitxt/catalog/cards/global_mmlu/lt/high_school_psychology.json -> build/lib/unitxt/catalog/cards/global_mmlu/lt 2026-01-06T13:30:14,975 copying src/unitxt/catalog/cards/global_mmlu/lt/medical_genetics.json -> build/lib/unitxt/catalog/cards/global_mmlu/lt 2026-01-06T13:30:14,977 copying src/unitxt/catalog/cards/global_mmlu/lt/security_studies.json -> build/lib/unitxt/catalog/cards/global_mmlu/lt 2026-01-06T13:30:14,980 copying src/unitxt/catalog/cards/global_mmlu/lt/high_school_macroeconomics.json -> build/lib/unitxt/catalog/cards/global_mmlu/lt 2026-01-06T13:30:14,982 copying src/unitxt/catalog/cards/global_mmlu/lt/professional_law.json -> build/lib/unitxt/catalog/cards/global_mmlu/lt 2026-01-06T13:30:14,984 copying src/unitxt/catalog/cards/global_mmlu/lt/high_school_physics.json -> build/lib/unitxt/catalog/cards/global_mmlu/lt 2026-01-06T13:30:14,986 copying src/unitxt/catalog/cards/global_mmlu/lt/econometrics.json -> build/lib/unitxt/catalog/cards/global_mmlu/lt 2026-01-06T13:30:14,989 copying src/unitxt/catalog/cards/global_mmlu/lt/sociology.json -> build/lib/unitxt/catalog/cards/global_mmlu/lt 2026-01-06T13:30:14,991 copying src/unitxt/catalog/cards/global_mmlu/lt/moral_disputes.json -> build/lib/unitxt/catalog/cards/global_mmlu/lt 2026-01-06T13:30:14,993 copying src/unitxt/catalog/cards/global_mmlu/lt/college_chemistry.json -> build/lib/unitxt/catalog/cards/global_mmlu/lt 2026-01-06T13:30:14,996 copying src/unitxt/catalog/cards/global_mmlu/lt/high_school_geography.json -> build/lib/unitxt/catalog/cards/global_mmlu/lt 2026-01-06T13:30:14,998 copying src/unitxt/catalog/cards/global_mmlu/lt/jurisprudence.json -> build/lib/unitxt/catalog/cards/global_mmlu/lt 2026-01-06T13:30:15,000 copying src/unitxt/catalog/cards/global_mmlu/lt/high_school_statistics.json -> build/lib/unitxt/catalog/cards/global_mmlu/lt 2026-01-06T13:30:15,003 copying src/unitxt/catalog/cards/global_mmlu/lt/professional_accounting.json -> build/lib/unitxt/catalog/cards/global_mmlu/lt 2026-01-06T13:30:15,005 copying src/unitxt/catalog/cards/global_mmlu/lt/us_foreign_policy.json -> build/lib/unitxt/catalog/cards/global_mmlu/lt 2026-01-06T13:30:15,007 copying src/unitxt/catalog/cards/global_mmlu/lt/professional_psychology.json -> build/lib/unitxt/catalog/cards/global_mmlu/lt 2026-01-06T13:30:15,009 copying src/unitxt/catalog/cards/global_mmlu/lt/public_relations.json -> build/lib/unitxt/catalog/cards/global_mmlu/lt 2026-01-06T13:30:15,011 copying src/unitxt/catalog/cards/global_mmlu/lt/computer_security.json -> build/lib/unitxt/catalog/cards/global_mmlu/lt 2026-01-06T13:30:15,013 copying src/unitxt/catalog/cards/global_mmlu/lt/philosophy.json -> build/lib/unitxt/catalog/cards/global_mmlu/lt 2026-01-06T13:30:15,016 copying src/unitxt/catalog/cards/global_mmlu/lt/virology.json -> build/lib/unitxt/catalog/cards/global_mmlu/lt 2026-01-06T13:30:15,018 copying src/unitxt/catalog/cards/global_mmlu/lt/marketing.json -> build/lib/unitxt/catalog/cards/global_mmlu/lt 2026-01-06T13:30:15,020 copying src/unitxt/catalog/cards/global_mmlu/lt/high_school_world_history.json -> build/lib/unitxt/catalog/cards/global_mmlu/lt 2026-01-06T13:30:15,022 copying src/unitxt/catalog/cards/global_mmlu/lt/machine_learning.json -> build/lib/unitxt/catalog/cards/global_mmlu/lt 2026-01-06T13:30:15,024 copying src/unitxt/catalog/cards/global_mmlu/lt/high_school_government_and_politics.json -> build/lib/unitxt/catalog/cards/global_mmlu/lt 2026-01-06T13:30:15,027 copying src/unitxt/catalog/cards/global_mmlu/lt/conceptual_physics.json -> build/lib/unitxt/catalog/cards/global_mmlu/lt 2026-01-06T13:30:15,029 copying src/unitxt/catalog/cards/global_mmlu/lt/college_biology.json -> build/lib/unitxt/catalog/cards/global_mmlu/lt 2026-01-06T13:30:15,031 copying src/unitxt/catalog/cards/global_mmlu/lt/high_school_mathematics.json -> build/lib/unitxt/catalog/cards/global_mmlu/lt 2026-01-06T13:30:15,033 creating build/lib/unitxt/catalog/cards/global_mmlu/ky 2026-01-06T13:30:15,034 copying src/unitxt/catalog/cards/global_mmlu/ky/elementary_mathematics.json -> build/lib/unitxt/catalog/cards/global_mmlu/ky 2026-01-06T13:30:15,037 copying src/unitxt/catalog/cards/global_mmlu/ky/human_aging.json -> build/lib/unitxt/catalog/cards/global_mmlu/ky 2026-01-06T13:30:15,039 copying src/unitxt/catalog/cards/global_mmlu/ky/high_school_computer_science.json -> build/lib/unitxt/catalog/cards/global_mmlu/ky 2026-01-06T13:30:15,041 copying src/unitxt/catalog/cards/global_mmlu/ky/college_physics.json -> build/lib/unitxt/catalog/cards/global_mmlu/ky 2026-01-06T13:30:15,043 copying src/unitxt/catalog/cards/global_mmlu/ky/college_medicine.json -> build/lib/unitxt/catalog/cards/global_mmlu/ky 2026-01-06T13:30:15,046 copying src/unitxt/catalog/cards/global_mmlu/ky/college_mathematics.json -> build/lib/unitxt/catalog/cards/global_mmlu/ky 2026-01-06T13:30:15,048 copying src/unitxt/catalog/cards/global_mmlu/ky/high_school_microeconomics.json -> build/lib/unitxt/catalog/cards/global_mmlu/ky 2026-01-06T13:30:15,050 copying src/unitxt/catalog/cards/global_mmlu/ky/anatomy.json -> build/lib/unitxt/catalog/cards/global_mmlu/ky 2026-01-06T13:30:15,053 copying src/unitxt/catalog/cards/global_mmlu/ky/world_religions.json -> build/lib/unitxt/catalog/cards/global_mmlu/ky 2026-01-06T13:30:15,055 copying src/unitxt/catalog/cards/global_mmlu/ky/management.json -> build/lib/unitxt/catalog/cards/global_mmlu/ky 2026-01-06T13:30:15,057 copying src/unitxt/catalog/cards/global_mmlu/ky/moral_scenarios.json -> build/lib/unitxt/catalog/cards/global_mmlu/ky 2026-01-06T13:30:15,059 copying src/unitxt/catalog/cards/global_mmlu/ky/global_facts.json -> build/lib/unitxt/catalog/cards/global_mmlu/ky 2026-01-06T13:30:15,062 copying src/unitxt/catalog/cards/global_mmlu/ky/miscellaneous.json -> build/lib/unitxt/catalog/cards/global_mmlu/ky 2026-01-06T13:30:15,064 copying src/unitxt/catalog/cards/global_mmlu/ky/clinical_knowledge.json -> build/lib/unitxt/catalog/cards/global_mmlu/ky 2026-01-06T13:30:15,066 copying src/unitxt/catalog/cards/global_mmlu/ky/high_school_biology.json -> build/lib/unitxt/catalog/cards/global_mmlu/ky 2026-01-06T13:30:15,068 copying src/unitxt/catalog/cards/global_mmlu/ky/prehistory.json -> build/lib/unitxt/catalog/cards/global_mmlu/ky 2026-01-06T13:30:15,071 copying src/unitxt/catalog/cards/global_mmlu/ky/high_school_us_history.json -> build/lib/unitxt/catalog/cards/global_mmlu/ky 2026-01-06T13:30:15,073 copying src/unitxt/catalog/cards/global_mmlu/ky/international_law.json -> build/lib/unitxt/catalog/cards/global_mmlu/ky 2026-01-06T13:30:15,076 copying src/unitxt/catalog/cards/global_mmlu/ky/college_computer_science.json -> build/lib/unitxt/catalog/cards/global_mmlu/ky 2026-01-06T13:30:15,078 copying src/unitxt/catalog/cards/global_mmlu/ky/astronomy.json -> build/lib/unitxt/catalog/cards/global_mmlu/ky 2026-01-06T13:30:15,080 copying src/unitxt/catalog/cards/global_mmlu/ky/high_school_european_history.json -> build/lib/unitxt/catalog/cards/global_mmlu/ky 2026-01-06T13:30:15,082 copying src/unitxt/catalog/cards/global_mmlu/ky/electrical_engineering.json -> build/lib/unitxt/catalog/cards/global_mmlu/ky 2026-01-06T13:30:15,084 copying src/unitxt/catalog/cards/global_mmlu/ky/nutrition.json -> build/lib/unitxt/catalog/cards/global_mmlu/ky 2026-01-06T13:30:15,086 copying src/unitxt/catalog/cards/global_mmlu/ky/abstract_algebra.json -> build/lib/unitxt/catalog/cards/global_mmlu/ky 2026-01-06T13:30:15,089 copying src/unitxt/catalog/cards/global_mmlu/ky/professional_medicine.json -> build/lib/unitxt/catalog/cards/global_mmlu/ky 2026-01-06T13:30:15,091 copying src/unitxt/catalog/cards/global_mmlu/ky/human_sexuality.json -> build/lib/unitxt/catalog/cards/global_mmlu/ky 2026-01-06T13:30:15,093 copying src/unitxt/catalog/cards/global_mmlu/ky/business_ethics.json -> build/lib/unitxt/catalog/cards/global_mmlu/ky 2026-01-06T13:30:15,095 copying src/unitxt/catalog/cards/global_mmlu/ky/high_school_chemistry.json -> build/lib/unitxt/catalog/cards/global_mmlu/ky 2026-01-06T13:30:15,097 copying src/unitxt/catalog/cards/global_mmlu/ky/logical_fallacies.json -> build/lib/unitxt/catalog/cards/global_mmlu/ky 2026-01-06T13:30:15,100 copying src/unitxt/catalog/cards/global_mmlu/ky/formal_logic.json -> build/lib/unitxt/catalog/cards/global_mmlu/ky 2026-01-06T13:30:15,102 copying src/unitxt/catalog/cards/global_mmlu/ky/high_school_psychology.json -> build/lib/unitxt/catalog/cards/global_mmlu/ky 2026-01-06T13:30:15,104 copying src/unitxt/catalog/cards/global_mmlu/ky/medical_genetics.json -> build/lib/unitxt/catalog/cards/global_mmlu/ky 2026-01-06T13:30:15,106 copying src/unitxt/catalog/cards/global_mmlu/ky/security_studies.json -> build/lib/unitxt/catalog/cards/global_mmlu/ky 2026-01-06T13:30:15,108 copying src/unitxt/catalog/cards/global_mmlu/ky/high_school_macroeconomics.json -> build/lib/unitxt/catalog/cards/global_mmlu/ky 2026-01-06T13:30:15,111 copying src/unitxt/catalog/cards/global_mmlu/ky/professional_law.json -> build/lib/unitxt/catalog/cards/global_mmlu/ky 2026-01-06T13:30:15,113 copying src/unitxt/catalog/cards/global_mmlu/ky/high_school_physics.json -> build/lib/unitxt/catalog/cards/global_mmlu/ky 2026-01-06T13:30:15,115 copying src/unitxt/catalog/cards/global_mmlu/ky/econometrics.json -> build/lib/unitxt/catalog/cards/global_mmlu/ky 2026-01-06T13:30:15,117 copying src/unitxt/catalog/cards/global_mmlu/ky/sociology.json -> build/lib/unitxt/catalog/cards/global_mmlu/ky 2026-01-06T13:30:15,119 copying src/unitxt/catalog/cards/global_mmlu/ky/moral_disputes.json -> build/lib/unitxt/catalog/cards/global_mmlu/ky 2026-01-06T13:30:15,122 copying src/unitxt/catalog/cards/global_mmlu/ky/college_chemistry.json -> build/lib/unitxt/catalog/cards/global_mmlu/ky 2026-01-06T13:30:15,124 copying src/unitxt/catalog/cards/global_mmlu/ky/high_school_geography.json -> build/lib/unitxt/catalog/cards/global_mmlu/ky 2026-01-06T13:30:15,126 copying src/unitxt/catalog/cards/global_mmlu/ky/jurisprudence.json -> build/lib/unitxt/catalog/cards/global_mmlu/ky 2026-01-06T13:30:15,129 copying src/unitxt/catalog/cards/global_mmlu/ky/high_school_statistics.json -> build/lib/unitxt/catalog/cards/global_mmlu/ky 2026-01-06T13:30:15,131 copying src/unitxt/catalog/cards/global_mmlu/ky/professional_accounting.json -> build/lib/unitxt/catalog/cards/global_mmlu/ky 2026-01-06T13:30:15,133 copying src/unitxt/catalog/cards/global_mmlu/ky/us_foreign_policy.json -> build/lib/unitxt/catalog/cards/global_mmlu/ky 2026-01-06T13:30:15,135 copying src/unitxt/catalog/cards/global_mmlu/ky/professional_psychology.json -> build/lib/unitxt/catalog/cards/global_mmlu/ky 2026-01-06T13:30:15,137 copying src/unitxt/catalog/cards/global_mmlu/ky/public_relations.json -> build/lib/unitxt/catalog/cards/global_mmlu/ky 2026-01-06T13:30:15,139 copying src/unitxt/catalog/cards/global_mmlu/ky/computer_security.json -> build/lib/unitxt/catalog/cards/global_mmlu/ky 2026-01-06T13:30:15,141 copying src/unitxt/catalog/cards/global_mmlu/ky/philosophy.json -> build/lib/unitxt/catalog/cards/global_mmlu/ky 2026-01-06T13:30:15,143 copying src/unitxt/catalog/cards/global_mmlu/ky/virology.json -> build/lib/unitxt/catalog/cards/global_mmlu/ky 2026-01-06T13:30:15,146 copying src/unitxt/catalog/cards/global_mmlu/ky/marketing.json -> build/lib/unitxt/catalog/cards/global_mmlu/ky 2026-01-06T13:30:15,148 copying src/unitxt/catalog/cards/global_mmlu/ky/high_school_world_history.json -> build/lib/unitxt/catalog/cards/global_mmlu/ky 2026-01-06T13:30:15,150 copying src/unitxt/catalog/cards/global_mmlu/ky/machine_learning.json -> build/lib/unitxt/catalog/cards/global_mmlu/ky 2026-01-06T13:30:15,152 copying src/unitxt/catalog/cards/global_mmlu/ky/high_school_government_and_politics.json -> build/lib/unitxt/catalog/cards/global_mmlu/ky 2026-01-06T13:30:15,155 copying src/unitxt/catalog/cards/global_mmlu/ky/conceptual_physics.json -> build/lib/unitxt/catalog/cards/global_mmlu/ky 2026-01-06T13:30:15,157 copying src/unitxt/catalog/cards/global_mmlu/ky/college_biology.json -> build/lib/unitxt/catalog/cards/global_mmlu/ky 2026-01-06T13:30:15,159 copying src/unitxt/catalog/cards/global_mmlu/ky/high_school_mathematics.json -> build/lib/unitxt/catalog/cards/global_mmlu/ky 2026-01-06T13:30:15,161 creating build/lib/unitxt/catalog/cards/global_mmlu/cs 2026-01-06T13:30:15,162 copying src/unitxt/catalog/cards/global_mmlu/cs/elementary_mathematics.json -> build/lib/unitxt/catalog/cards/global_mmlu/cs 2026-01-06T13:30:15,165 copying src/unitxt/catalog/cards/global_mmlu/cs/human_aging.json -> build/lib/unitxt/catalog/cards/global_mmlu/cs 2026-01-06T13:30:15,167 copying src/unitxt/catalog/cards/global_mmlu/cs/high_school_computer_science.json -> build/lib/unitxt/catalog/cards/global_mmlu/cs 2026-01-06T13:30:15,169 copying src/unitxt/catalog/cards/global_mmlu/cs/college_physics.json -> build/lib/unitxt/catalog/cards/global_mmlu/cs 2026-01-06T13:30:15,171 copying src/unitxt/catalog/cards/global_mmlu/cs/college_medicine.json -> build/lib/unitxt/catalog/cards/global_mmlu/cs 2026-01-06T13:30:15,174 copying src/unitxt/catalog/cards/global_mmlu/cs/college_mathematics.json -> build/lib/unitxt/catalog/cards/global_mmlu/cs 2026-01-06T13:30:15,176 copying src/unitxt/catalog/cards/global_mmlu/cs/high_school_microeconomics.json -> build/lib/unitxt/catalog/cards/global_mmlu/cs 2026-01-06T13:30:15,178 copying src/unitxt/catalog/cards/global_mmlu/cs/anatomy.json -> build/lib/unitxt/catalog/cards/global_mmlu/cs 2026-01-06T13:30:15,180 copying src/unitxt/catalog/cards/global_mmlu/cs/world_religions.json -> build/lib/unitxt/catalog/cards/global_mmlu/cs 2026-01-06T13:30:15,183 copying src/unitxt/catalog/cards/global_mmlu/cs/management.json -> build/lib/unitxt/catalog/cards/global_mmlu/cs 2026-01-06T13:30:15,185 copying src/unitxt/catalog/cards/global_mmlu/cs/moral_scenarios.json -> build/lib/unitxt/catalog/cards/global_mmlu/cs 2026-01-06T13:30:15,187 copying src/unitxt/catalog/cards/global_mmlu/cs/global_facts.json -> build/lib/unitxt/catalog/cards/global_mmlu/cs 2026-01-06T13:30:15,189 copying src/unitxt/catalog/cards/global_mmlu/cs/miscellaneous.json -> build/lib/unitxt/catalog/cards/global_mmlu/cs 2026-01-06T13:30:15,192 copying src/unitxt/catalog/cards/global_mmlu/cs/clinical_knowledge.json -> build/lib/unitxt/catalog/cards/global_mmlu/cs 2026-01-06T13:30:15,194 copying src/unitxt/catalog/cards/global_mmlu/cs/high_school_biology.json -> build/lib/unitxt/catalog/cards/global_mmlu/cs 2026-01-06T13:30:15,196 copying src/unitxt/catalog/cards/global_mmlu/cs/prehistory.json -> build/lib/unitxt/catalog/cards/global_mmlu/cs 2026-01-06T13:30:15,198 copying src/unitxt/catalog/cards/global_mmlu/cs/high_school_us_history.json -> build/lib/unitxt/catalog/cards/global_mmlu/cs 2026-01-06T13:30:15,201 copying src/unitxt/catalog/cards/global_mmlu/cs/international_law.json -> build/lib/unitxt/catalog/cards/global_mmlu/cs 2026-01-06T13:30:15,203 copying src/unitxt/catalog/cards/global_mmlu/cs/college_computer_science.json -> build/lib/unitxt/catalog/cards/global_mmlu/cs 2026-01-06T13:30:15,205 copying src/unitxt/catalog/cards/global_mmlu/cs/astronomy.json -> build/lib/unitxt/catalog/cards/global_mmlu/cs 2026-01-06T13:30:15,207 copying src/unitxt/catalog/cards/global_mmlu/cs/high_school_european_history.json -> build/lib/unitxt/catalog/cards/global_mmlu/cs 2026-01-06T13:30:15,209 copying src/unitxt/catalog/cards/global_mmlu/cs/electrical_engineering.json -> build/lib/unitxt/catalog/cards/global_mmlu/cs 2026-01-06T13:30:15,211 copying src/unitxt/catalog/cards/global_mmlu/cs/nutrition.json -> build/lib/unitxt/catalog/cards/global_mmlu/cs 2026-01-06T13:30:15,214 copying src/unitxt/catalog/cards/global_mmlu/cs/abstract_algebra.json -> build/lib/unitxt/catalog/cards/global_mmlu/cs 2026-01-06T13:30:15,216 copying src/unitxt/catalog/cards/global_mmlu/cs/professional_medicine.json -> build/lib/unitxt/catalog/cards/global_mmlu/cs 2026-01-06T13:30:15,218 copying src/unitxt/catalog/cards/global_mmlu/cs/human_sexuality.json -> build/lib/unitxt/catalog/cards/global_mmlu/cs 2026-01-06T13:30:15,221 copying src/unitxt/catalog/cards/global_mmlu/cs/business_ethics.json -> build/lib/unitxt/catalog/cards/global_mmlu/cs 2026-01-06T13:30:15,223 copying src/unitxt/catalog/cards/global_mmlu/cs/high_school_chemistry.json -> build/lib/unitxt/catalog/cards/global_mmlu/cs 2026-01-06T13:30:15,225 copying src/unitxt/catalog/cards/global_mmlu/cs/logical_fallacies.json -> build/lib/unitxt/catalog/cards/global_mmlu/cs 2026-01-06T13:30:15,227 copying src/unitxt/catalog/cards/global_mmlu/cs/formal_logic.json -> build/lib/unitxt/catalog/cards/global_mmlu/cs 2026-01-06T13:30:15,229 copying src/unitxt/catalog/cards/global_mmlu/cs/high_school_psychology.json -> build/lib/unitxt/catalog/cards/global_mmlu/cs 2026-01-06T13:30:15,232 copying src/unitxt/catalog/cards/global_mmlu/cs/medical_genetics.json -> build/lib/unitxt/catalog/cards/global_mmlu/cs 2026-01-06T13:30:15,234 copying src/unitxt/catalog/cards/global_mmlu/cs/security_studies.json -> build/lib/unitxt/catalog/cards/global_mmlu/cs 2026-01-06T13:30:15,236 copying src/unitxt/catalog/cards/global_mmlu/cs/high_school_macroeconomics.json -> build/lib/unitxt/catalog/cards/global_mmlu/cs 2026-01-06T13:30:15,239 copying src/unitxt/catalog/cards/global_mmlu/cs/professional_law.json -> build/lib/unitxt/catalog/cards/global_mmlu/cs 2026-01-06T13:30:15,241 copying src/unitxt/catalog/cards/global_mmlu/cs/high_school_physics.json -> build/lib/unitxt/catalog/cards/global_mmlu/cs 2026-01-06T13:30:15,243 copying src/unitxt/catalog/cards/global_mmlu/cs/econometrics.json -> build/lib/unitxt/catalog/cards/global_mmlu/cs 2026-01-06T13:30:15,245 copying src/unitxt/catalog/cards/global_mmlu/cs/sociology.json -> build/lib/unitxt/catalog/cards/global_mmlu/cs 2026-01-06T13:30:15,247 copying src/unitxt/catalog/cards/global_mmlu/cs/moral_disputes.json -> build/lib/unitxt/catalog/cards/global_mmlu/cs 2026-01-06T13:30:15,250 copying src/unitxt/catalog/cards/global_mmlu/cs/college_chemistry.json -> build/lib/unitxt/catalog/cards/global_mmlu/cs 2026-01-06T13:30:15,252 copying src/unitxt/catalog/cards/global_mmlu/cs/high_school_geography.json -> build/lib/unitxt/catalog/cards/global_mmlu/cs 2026-01-06T13:30:15,254 copying src/unitxt/catalog/cards/global_mmlu/cs/jurisprudence.json -> build/lib/unitxt/catalog/cards/global_mmlu/cs 2026-01-06T13:30:15,256 copying src/unitxt/catalog/cards/global_mmlu/cs/high_school_statistics.json -> build/lib/unitxt/catalog/cards/global_mmlu/cs 2026-01-06T13:30:15,258 copying src/unitxt/catalog/cards/global_mmlu/cs/professional_accounting.json -> build/lib/unitxt/catalog/cards/global_mmlu/cs 2026-01-06T13:30:15,260 copying src/unitxt/catalog/cards/global_mmlu/cs/us_foreign_policy.json -> build/lib/unitxt/catalog/cards/global_mmlu/cs 2026-01-06T13:30:15,263 copying src/unitxt/catalog/cards/global_mmlu/cs/professional_psychology.json -> build/lib/unitxt/catalog/cards/global_mmlu/cs 2026-01-06T13:30:15,265 copying src/unitxt/catalog/cards/global_mmlu/cs/public_relations.json -> build/lib/unitxt/catalog/cards/global_mmlu/cs 2026-01-06T13:30:15,267 copying src/unitxt/catalog/cards/global_mmlu/cs/computer_security.json -> build/lib/unitxt/catalog/cards/global_mmlu/cs 2026-01-06T13:30:15,269 copying src/unitxt/catalog/cards/global_mmlu/cs/philosophy.json -> build/lib/unitxt/catalog/cards/global_mmlu/cs 2026-01-06T13:30:15,271 copying src/unitxt/catalog/cards/global_mmlu/cs/virology.json -> build/lib/unitxt/catalog/cards/global_mmlu/cs 2026-01-06T13:30:15,273 copying src/unitxt/catalog/cards/global_mmlu/cs/marketing.json -> build/lib/unitxt/catalog/cards/global_mmlu/cs 2026-01-06T13:30:15,275 copying src/unitxt/catalog/cards/global_mmlu/cs/high_school_world_history.json -> build/lib/unitxt/catalog/cards/global_mmlu/cs 2026-01-06T13:30:15,278 copying src/unitxt/catalog/cards/global_mmlu/cs/machine_learning.json -> build/lib/unitxt/catalog/cards/global_mmlu/cs 2026-01-06T13:30:15,280 copying src/unitxt/catalog/cards/global_mmlu/cs/high_school_government_and_politics.json -> build/lib/unitxt/catalog/cards/global_mmlu/cs 2026-01-06T13:30:15,282 copying src/unitxt/catalog/cards/global_mmlu/cs/conceptual_physics.json -> build/lib/unitxt/catalog/cards/global_mmlu/cs 2026-01-06T13:30:15,285 copying src/unitxt/catalog/cards/global_mmlu/cs/college_biology.json -> build/lib/unitxt/catalog/cards/global_mmlu/cs 2026-01-06T13:30:15,287 copying src/unitxt/catalog/cards/global_mmlu/cs/high_school_mathematics.json -> build/lib/unitxt/catalog/cards/global_mmlu/cs 2026-01-06T13:30:15,289 creating build/lib/unitxt/catalog/cards/global_mmlu/ms 2026-01-06T13:30:15,290 copying src/unitxt/catalog/cards/global_mmlu/ms/elementary_mathematics.json -> build/lib/unitxt/catalog/cards/global_mmlu/ms 2026-01-06T13:30:15,293 copying src/unitxt/catalog/cards/global_mmlu/ms/human_aging.json -> build/lib/unitxt/catalog/cards/global_mmlu/ms 2026-01-06T13:30:15,295 copying src/unitxt/catalog/cards/global_mmlu/ms/high_school_computer_science.json -> build/lib/unitxt/catalog/cards/global_mmlu/ms 2026-01-06T13:30:15,297 copying src/unitxt/catalog/cards/global_mmlu/ms/college_physics.json -> build/lib/unitxt/catalog/cards/global_mmlu/ms 2026-01-06T13:30:15,299 copying src/unitxt/catalog/cards/global_mmlu/ms/college_medicine.json -> build/lib/unitxt/catalog/cards/global_mmlu/ms 2026-01-06T13:30:15,302 copying src/unitxt/catalog/cards/global_mmlu/ms/college_mathematics.json -> build/lib/unitxt/catalog/cards/global_mmlu/ms 2026-01-06T13:30:15,304 copying src/unitxt/catalog/cards/global_mmlu/ms/high_school_microeconomics.json -> build/lib/unitxt/catalog/cards/global_mmlu/ms 2026-01-06T13:30:15,306 copying src/unitxt/catalog/cards/global_mmlu/ms/anatomy.json -> build/lib/unitxt/catalog/cards/global_mmlu/ms 2026-01-06T13:30:15,308 copying src/unitxt/catalog/cards/global_mmlu/ms/world_religions.json -> build/lib/unitxt/catalog/cards/global_mmlu/ms 2026-01-06T13:30:15,311 copying src/unitxt/catalog/cards/global_mmlu/ms/management.json -> build/lib/unitxt/catalog/cards/global_mmlu/ms 2026-01-06T13:30:15,313 copying src/unitxt/catalog/cards/global_mmlu/ms/moral_scenarios.json -> build/lib/unitxt/catalog/cards/global_mmlu/ms 2026-01-06T13:30:15,315 copying src/unitxt/catalog/cards/global_mmlu/ms/global_facts.json -> build/lib/unitxt/catalog/cards/global_mmlu/ms 2026-01-06T13:30:15,317 copying src/unitxt/catalog/cards/global_mmlu/ms/miscellaneous.json -> build/lib/unitxt/catalog/cards/global_mmlu/ms 2026-01-06T13:30:15,320 copying src/unitxt/catalog/cards/global_mmlu/ms/clinical_knowledge.json -> build/lib/unitxt/catalog/cards/global_mmlu/ms 2026-01-06T13:30:15,322 copying src/unitxt/catalog/cards/global_mmlu/ms/high_school_biology.json -> build/lib/unitxt/catalog/cards/global_mmlu/ms 2026-01-06T13:30:15,324 copying src/unitxt/catalog/cards/global_mmlu/ms/prehistory.json -> build/lib/unitxt/catalog/cards/global_mmlu/ms 2026-01-06T13:30:15,326 copying src/unitxt/catalog/cards/global_mmlu/ms/high_school_us_history.json -> build/lib/unitxt/catalog/cards/global_mmlu/ms 2026-01-06T13:30:15,328 copying src/unitxt/catalog/cards/global_mmlu/ms/international_law.json -> build/lib/unitxt/catalog/cards/global_mmlu/ms 2026-01-06T13:30:15,331 copying src/unitxt/catalog/cards/global_mmlu/ms/college_computer_science.json -> build/lib/unitxt/catalog/cards/global_mmlu/ms 2026-01-06T13:30:15,333 copying src/unitxt/catalog/cards/global_mmlu/ms/astronomy.json -> build/lib/unitxt/catalog/cards/global_mmlu/ms 2026-01-06T13:30:15,335 copying src/unitxt/catalog/cards/global_mmlu/ms/high_school_european_history.json -> build/lib/unitxt/catalog/cards/global_mmlu/ms 2026-01-06T13:30:15,337 copying src/unitxt/catalog/cards/global_mmlu/ms/electrical_engineering.json -> build/lib/unitxt/catalog/cards/global_mmlu/ms 2026-01-06T13:30:15,340 copying src/unitxt/catalog/cards/global_mmlu/ms/nutrition.json -> build/lib/unitxt/catalog/cards/global_mmlu/ms 2026-01-06T13:30:15,342 copying src/unitxt/catalog/cards/global_mmlu/ms/abstract_algebra.json -> build/lib/unitxt/catalog/cards/global_mmlu/ms 2026-01-06T13:30:15,344 copying src/unitxt/catalog/cards/global_mmlu/ms/professional_medicine.json -> build/lib/unitxt/catalog/cards/global_mmlu/ms 2026-01-06T13:30:15,346 copying src/unitxt/catalog/cards/global_mmlu/ms/human_sexuality.json -> build/lib/unitxt/catalog/cards/global_mmlu/ms 2026-01-06T13:30:15,349 copying src/unitxt/catalog/cards/global_mmlu/ms/business_ethics.json -> build/lib/unitxt/catalog/cards/global_mmlu/ms 2026-01-06T13:30:15,351 copying src/unitxt/catalog/cards/global_mmlu/ms/high_school_chemistry.json -> build/lib/unitxt/catalog/cards/global_mmlu/ms 2026-01-06T13:30:15,353 copying src/unitxt/catalog/cards/global_mmlu/ms/logical_fallacies.json -> build/lib/unitxt/catalog/cards/global_mmlu/ms 2026-01-06T13:30:15,355 copying src/unitxt/catalog/cards/global_mmlu/ms/formal_logic.json -> build/lib/unitxt/catalog/cards/global_mmlu/ms 2026-01-06T13:30:15,358 copying src/unitxt/catalog/cards/global_mmlu/ms/high_school_psychology.json -> build/lib/unitxt/catalog/cards/global_mmlu/ms 2026-01-06T13:30:15,360 copying src/unitxt/catalog/cards/global_mmlu/ms/medical_genetics.json -> build/lib/unitxt/catalog/cards/global_mmlu/ms 2026-01-06T13:30:15,362 copying src/unitxt/catalog/cards/global_mmlu/ms/security_studies.json -> build/lib/unitxt/catalog/cards/global_mmlu/ms 2026-01-06T13:30:15,364 copying src/unitxt/catalog/cards/global_mmlu/ms/high_school_macroeconomics.json -> build/lib/unitxt/catalog/cards/global_mmlu/ms 2026-01-06T13:30:15,367 copying src/unitxt/catalog/cards/global_mmlu/ms/professional_law.json -> build/lib/unitxt/catalog/cards/global_mmlu/ms 2026-01-06T13:30:15,369 copying src/unitxt/catalog/cards/global_mmlu/ms/high_school_physics.json -> build/lib/unitxt/catalog/cards/global_mmlu/ms 2026-01-06T13:30:15,371 copying src/unitxt/catalog/cards/global_mmlu/ms/econometrics.json -> build/lib/unitxt/catalog/cards/global_mmlu/ms 2026-01-06T13:30:15,373 copying src/unitxt/catalog/cards/global_mmlu/ms/sociology.json -> build/lib/unitxt/catalog/cards/global_mmlu/ms 2026-01-06T13:30:15,376 copying src/unitxt/catalog/cards/global_mmlu/ms/moral_disputes.json -> build/lib/unitxt/catalog/cards/global_mmlu/ms 2026-01-06T13:30:15,378 copying src/unitxt/catalog/cards/global_mmlu/ms/college_chemistry.json -> build/lib/unitxt/catalog/cards/global_mmlu/ms 2026-01-06T13:30:15,380 copying src/unitxt/catalog/cards/global_mmlu/ms/high_school_geography.json -> build/lib/unitxt/catalog/cards/global_mmlu/ms 2026-01-06T13:30:15,382 copying src/unitxt/catalog/cards/global_mmlu/ms/jurisprudence.json -> build/lib/unitxt/catalog/cards/global_mmlu/ms 2026-01-06T13:30:15,385 copying src/unitxt/catalog/cards/global_mmlu/ms/high_school_statistics.json -> build/lib/unitxt/catalog/cards/global_mmlu/ms 2026-01-06T13:30:15,387 copying src/unitxt/catalog/cards/global_mmlu/ms/professional_accounting.json -> build/lib/unitxt/catalog/cards/global_mmlu/ms 2026-01-06T13:30:15,389 copying src/unitxt/catalog/cards/global_mmlu/ms/us_foreign_policy.json -> build/lib/unitxt/catalog/cards/global_mmlu/ms 2026-01-06T13:30:15,391 copying src/unitxt/catalog/cards/global_mmlu/ms/professional_psychology.json -> build/lib/unitxt/catalog/cards/global_mmlu/ms 2026-01-06T13:30:15,393 copying src/unitxt/catalog/cards/global_mmlu/ms/public_relations.json -> build/lib/unitxt/catalog/cards/global_mmlu/ms 2026-01-06T13:30:15,395 copying src/unitxt/catalog/cards/global_mmlu/ms/computer_security.json -> build/lib/unitxt/catalog/cards/global_mmlu/ms 2026-01-06T13:30:15,397 copying src/unitxt/catalog/cards/global_mmlu/ms/philosophy.json -> build/lib/unitxt/catalog/cards/global_mmlu/ms 2026-01-06T13:30:15,400 copying src/unitxt/catalog/cards/global_mmlu/ms/virology.json -> build/lib/unitxt/catalog/cards/global_mmlu/ms 2026-01-06T13:30:15,402 copying src/unitxt/catalog/cards/global_mmlu/ms/marketing.json -> build/lib/unitxt/catalog/cards/global_mmlu/ms 2026-01-06T13:30:15,404 copying src/unitxt/catalog/cards/global_mmlu/ms/high_school_world_history.json -> build/lib/unitxt/catalog/cards/global_mmlu/ms 2026-01-06T13:30:15,406 copying src/unitxt/catalog/cards/global_mmlu/ms/machine_learning.json -> build/lib/unitxt/catalog/cards/global_mmlu/ms 2026-01-06T13:30:15,409 copying src/unitxt/catalog/cards/global_mmlu/ms/high_school_government_and_politics.json -> build/lib/unitxt/catalog/cards/global_mmlu/ms 2026-01-06T13:30:15,411 copying src/unitxt/catalog/cards/global_mmlu/ms/conceptual_physics.json -> build/lib/unitxt/catalog/cards/global_mmlu/ms 2026-01-06T13:30:15,413 copying src/unitxt/catalog/cards/global_mmlu/ms/college_biology.json -> build/lib/unitxt/catalog/cards/global_mmlu/ms 2026-01-06T13:30:15,415 copying src/unitxt/catalog/cards/global_mmlu/ms/high_school_mathematics.json -> build/lib/unitxt/catalog/cards/global_mmlu/ms 2026-01-06T13:30:15,417 creating build/lib/unitxt/catalog/cards/global_mmlu/ha 2026-01-06T13:30:15,418 copying src/unitxt/catalog/cards/global_mmlu/ha/elementary_mathematics.json -> build/lib/unitxt/catalog/cards/global_mmlu/ha 2026-01-06T13:30:15,421 copying src/unitxt/catalog/cards/global_mmlu/ha/human_aging.json -> build/lib/unitxt/catalog/cards/global_mmlu/ha 2026-01-06T13:30:15,423 copying src/unitxt/catalog/cards/global_mmlu/ha/high_school_computer_science.json -> build/lib/unitxt/catalog/cards/global_mmlu/ha 2026-01-06T13:30:15,425 copying src/unitxt/catalog/cards/global_mmlu/ha/college_physics.json -> build/lib/unitxt/catalog/cards/global_mmlu/ha 2026-01-06T13:30:15,427 copying src/unitxt/catalog/cards/global_mmlu/ha/college_medicine.json -> build/lib/unitxt/catalog/cards/global_mmlu/ha 2026-01-06T13:30:15,430 copying src/unitxt/catalog/cards/global_mmlu/ha/college_mathematics.json -> build/lib/unitxt/catalog/cards/global_mmlu/ha 2026-01-06T13:30:15,432 copying src/unitxt/catalog/cards/global_mmlu/ha/high_school_microeconomics.json -> build/lib/unitxt/catalog/cards/global_mmlu/ha 2026-01-06T13:30:15,434 copying src/unitxt/catalog/cards/global_mmlu/ha/anatomy.json -> build/lib/unitxt/catalog/cards/global_mmlu/ha 2026-01-06T13:30:15,436 copying src/unitxt/catalog/cards/global_mmlu/ha/world_religions.json -> build/lib/unitxt/catalog/cards/global_mmlu/ha 2026-01-06T13:30:15,439 copying src/unitxt/catalog/cards/global_mmlu/ha/management.json -> build/lib/unitxt/catalog/cards/global_mmlu/ha 2026-01-06T13:30:15,441 copying src/unitxt/catalog/cards/global_mmlu/ha/moral_scenarios.json -> build/lib/unitxt/catalog/cards/global_mmlu/ha 2026-01-06T13:30:15,443 copying src/unitxt/catalog/cards/global_mmlu/ha/global_facts.json -> build/lib/unitxt/catalog/cards/global_mmlu/ha 2026-01-06T13:30:15,445 copying src/unitxt/catalog/cards/global_mmlu/ha/miscellaneous.json -> build/lib/unitxt/catalog/cards/global_mmlu/ha 2026-01-06T13:30:15,447 copying src/unitxt/catalog/cards/global_mmlu/ha/clinical_knowledge.json -> build/lib/unitxt/catalog/cards/global_mmlu/ha 2026-01-06T13:30:15,449 copying src/unitxt/catalog/cards/global_mmlu/ha/high_school_biology.json -> build/lib/unitxt/catalog/cards/global_mmlu/ha 2026-01-06T13:30:15,451 copying src/unitxt/catalog/cards/global_mmlu/ha/prehistory.json -> build/lib/unitxt/catalog/cards/global_mmlu/ha 2026-01-06T13:30:15,454 copying src/unitxt/catalog/cards/global_mmlu/ha/high_school_us_history.json -> build/lib/unitxt/catalog/cards/global_mmlu/ha 2026-01-06T13:30:15,456 copying src/unitxt/catalog/cards/global_mmlu/ha/international_law.json -> build/lib/unitxt/catalog/cards/global_mmlu/ha 2026-01-06T13:30:15,458 copying src/unitxt/catalog/cards/global_mmlu/ha/college_computer_science.json -> build/lib/unitxt/catalog/cards/global_mmlu/ha 2026-01-06T13:30:15,460 copying src/unitxt/catalog/cards/global_mmlu/ha/astronomy.json -> build/lib/unitxt/catalog/cards/global_mmlu/ha 2026-01-06T13:30:15,462 copying src/unitxt/catalog/cards/global_mmlu/ha/high_school_european_history.json -> build/lib/unitxt/catalog/cards/global_mmlu/ha 2026-01-06T13:30:15,465 copying src/unitxt/catalog/cards/global_mmlu/ha/electrical_engineering.json -> build/lib/unitxt/catalog/cards/global_mmlu/ha 2026-01-06T13:30:15,467 copying src/unitxt/catalog/cards/global_mmlu/ha/nutrition.json -> build/lib/unitxt/catalog/cards/global_mmlu/ha 2026-01-06T13:30:15,470 copying src/unitxt/catalog/cards/global_mmlu/ha/abstract_algebra.json -> build/lib/unitxt/catalog/cards/global_mmlu/ha 2026-01-06T13:30:15,472 copying src/unitxt/catalog/cards/global_mmlu/ha/professional_medicine.json -> build/lib/unitxt/catalog/cards/global_mmlu/ha 2026-01-06T13:30:15,474 copying src/unitxt/catalog/cards/global_mmlu/ha/human_sexuality.json -> build/lib/unitxt/catalog/cards/global_mmlu/ha 2026-01-06T13:30:15,477 copying src/unitxt/catalog/cards/global_mmlu/ha/business_ethics.json -> build/lib/unitxt/catalog/cards/global_mmlu/ha 2026-01-06T13:30:15,480 copying src/unitxt/catalog/cards/global_mmlu/ha/high_school_chemistry.json -> build/lib/unitxt/catalog/cards/global_mmlu/ha 2026-01-06T13:30:15,482 copying src/unitxt/catalog/cards/global_mmlu/ha/logical_fallacies.json -> build/lib/unitxt/catalog/cards/global_mmlu/ha 2026-01-06T13:30:15,484 copying src/unitxt/catalog/cards/global_mmlu/ha/formal_logic.json -> build/lib/unitxt/catalog/cards/global_mmlu/ha 2026-01-06T13:30:15,487 copying src/unitxt/catalog/cards/global_mmlu/ha/high_school_psychology.json -> build/lib/unitxt/catalog/cards/global_mmlu/ha 2026-01-06T13:30:15,489 copying src/unitxt/catalog/cards/global_mmlu/ha/medical_genetics.json -> build/lib/unitxt/catalog/cards/global_mmlu/ha 2026-01-06T13:30:15,491 copying src/unitxt/catalog/cards/global_mmlu/ha/security_studies.json -> build/lib/unitxt/catalog/cards/global_mmlu/ha 2026-01-06T13:30:15,494 copying src/unitxt/catalog/cards/global_mmlu/ha/high_school_macroeconomics.json -> build/lib/unitxt/catalog/cards/global_mmlu/ha 2026-01-06T13:30:15,496 copying src/unitxt/catalog/cards/global_mmlu/ha/professional_law.json -> build/lib/unitxt/catalog/cards/global_mmlu/ha 2026-01-06T13:30:15,498 copying src/unitxt/catalog/cards/global_mmlu/ha/high_school_physics.json -> build/lib/unitxt/catalog/cards/global_mmlu/ha 2026-01-06T13:30:15,501 copying src/unitxt/catalog/cards/global_mmlu/ha/econometrics.json -> build/lib/unitxt/catalog/cards/global_mmlu/ha 2026-01-06T13:30:15,503 copying src/unitxt/catalog/cards/global_mmlu/ha/sociology.json -> build/lib/unitxt/catalog/cards/global_mmlu/ha 2026-01-06T13:30:15,505 copying src/unitxt/catalog/cards/global_mmlu/ha/moral_disputes.json -> build/lib/unitxt/catalog/cards/global_mmlu/ha 2026-01-06T13:30:15,508 copying src/unitxt/catalog/cards/global_mmlu/ha/college_chemistry.json -> build/lib/unitxt/catalog/cards/global_mmlu/ha 2026-01-06T13:30:15,510 copying src/unitxt/catalog/cards/global_mmlu/ha/high_school_geography.json -> build/lib/unitxt/catalog/cards/global_mmlu/ha 2026-01-06T13:30:15,512 copying src/unitxt/catalog/cards/global_mmlu/ha/jurisprudence.json -> build/lib/unitxt/catalog/cards/global_mmlu/ha 2026-01-06T13:30:15,516 copying src/unitxt/catalog/cards/global_mmlu/ha/high_school_statistics.json -> build/lib/unitxt/catalog/cards/global_mmlu/ha 2026-01-06T13:30:15,519 copying src/unitxt/catalog/cards/global_mmlu/ha/professional_accounting.json -> build/lib/unitxt/catalog/cards/global_mmlu/ha 2026-01-06T13:30:15,521 copying src/unitxt/catalog/cards/global_mmlu/ha/us_foreign_policy.json -> build/lib/unitxt/catalog/cards/global_mmlu/ha 2026-01-06T13:30:15,524 copying src/unitxt/catalog/cards/global_mmlu/ha/professional_psychology.json -> build/lib/unitxt/catalog/cards/global_mmlu/ha 2026-01-06T13:30:15,526 copying src/unitxt/catalog/cards/global_mmlu/ha/public_relations.json -> build/lib/unitxt/catalog/cards/global_mmlu/ha 2026-01-06T13:30:15,528 copying src/unitxt/catalog/cards/global_mmlu/ha/computer_security.json -> build/lib/unitxt/catalog/cards/global_mmlu/ha 2026-01-06T13:30:15,531 copying src/unitxt/catalog/cards/global_mmlu/ha/philosophy.json -> build/lib/unitxt/catalog/cards/global_mmlu/ha 2026-01-06T13:30:15,533 copying src/unitxt/catalog/cards/global_mmlu/ha/virology.json -> build/lib/unitxt/catalog/cards/global_mmlu/ha 2026-01-06T13:30:15,535 copying src/unitxt/catalog/cards/global_mmlu/ha/marketing.json -> build/lib/unitxt/catalog/cards/global_mmlu/ha 2026-01-06T13:30:15,538 copying src/unitxt/catalog/cards/global_mmlu/ha/high_school_world_history.json -> build/lib/unitxt/catalog/cards/global_mmlu/ha 2026-01-06T13:30:15,540 copying src/unitxt/catalog/cards/global_mmlu/ha/machine_learning.json -> build/lib/unitxt/catalog/cards/global_mmlu/ha 2026-01-06T13:30:15,542 copying src/unitxt/catalog/cards/global_mmlu/ha/high_school_government_and_politics.json -> build/lib/unitxt/catalog/cards/global_mmlu/ha 2026-01-06T13:30:15,545 copying src/unitxt/catalog/cards/global_mmlu/ha/conceptual_physics.json -> build/lib/unitxt/catalog/cards/global_mmlu/ha 2026-01-06T13:30:15,547 copying src/unitxt/catalog/cards/global_mmlu/ha/college_biology.json -> build/lib/unitxt/catalog/cards/global_mmlu/ha 2026-01-06T13:30:15,549 copying src/unitxt/catalog/cards/global_mmlu/ha/high_school_mathematics.json -> build/lib/unitxt/catalog/cards/global_mmlu/ha 2026-01-06T13:30:15,551 creating build/lib/unitxt/catalog/cards/global_mmlu/ru 2026-01-06T13:30:15,552 copying src/unitxt/catalog/cards/global_mmlu/ru/elementary_mathematics.json -> build/lib/unitxt/catalog/cards/global_mmlu/ru 2026-01-06T13:30:15,555 copying src/unitxt/catalog/cards/global_mmlu/ru/human_aging.json -> build/lib/unitxt/catalog/cards/global_mmlu/ru 2026-01-06T13:30:15,557 copying src/unitxt/catalog/cards/global_mmlu/ru/high_school_computer_science.json -> build/lib/unitxt/catalog/cards/global_mmlu/ru 2026-01-06T13:30:15,559 copying src/unitxt/catalog/cards/global_mmlu/ru/college_physics.json -> build/lib/unitxt/catalog/cards/global_mmlu/ru 2026-01-06T13:30:15,562 copying src/unitxt/catalog/cards/global_mmlu/ru/college_medicine.json -> build/lib/unitxt/catalog/cards/global_mmlu/ru 2026-01-06T13:30:15,564 copying src/unitxt/catalog/cards/global_mmlu/ru/college_mathematics.json -> build/lib/unitxt/catalog/cards/global_mmlu/ru 2026-01-06T13:30:15,566 copying src/unitxt/catalog/cards/global_mmlu/ru/high_school_microeconomics.json -> build/lib/unitxt/catalog/cards/global_mmlu/ru 2026-01-06T13:30:15,569 copying src/unitxt/catalog/cards/global_mmlu/ru/anatomy.json -> build/lib/unitxt/catalog/cards/global_mmlu/ru 2026-01-06T13:30:15,571 copying src/unitxt/catalog/cards/global_mmlu/ru/world_religions.json -> build/lib/unitxt/catalog/cards/global_mmlu/ru 2026-01-06T13:30:15,573 copying src/unitxt/catalog/cards/global_mmlu/ru/management.json -> build/lib/unitxt/catalog/cards/global_mmlu/ru 2026-01-06T13:30:15,575 copying src/unitxt/catalog/cards/global_mmlu/ru/moral_scenarios.json -> build/lib/unitxt/catalog/cards/global_mmlu/ru 2026-01-06T13:30:15,577 copying src/unitxt/catalog/cards/global_mmlu/ru/global_facts.json -> build/lib/unitxt/catalog/cards/global_mmlu/ru 2026-01-06T13:30:15,580 copying src/unitxt/catalog/cards/global_mmlu/ru/miscellaneous.json -> build/lib/unitxt/catalog/cards/global_mmlu/ru 2026-01-06T13:30:15,582 copying src/unitxt/catalog/cards/global_mmlu/ru/clinical_knowledge.json -> build/lib/unitxt/catalog/cards/global_mmlu/ru 2026-01-06T13:30:15,584 copying src/unitxt/catalog/cards/global_mmlu/ru/high_school_biology.json -> build/lib/unitxt/catalog/cards/global_mmlu/ru 2026-01-06T13:30:15,586 copying src/unitxt/catalog/cards/global_mmlu/ru/prehistory.json -> build/lib/unitxt/catalog/cards/global_mmlu/ru 2026-01-06T13:30:15,589 copying src/unitxt/catalog/cards/global_mmlu/ru/high_school_us_history.json -> build/lib/unitxt/catalog/cards/global_mmlu/ru 2026-01-06T13:30:15,591 copying src/unitxt/catalog/cards/global_mmlu/ru/international_law.json -> build/lib/unitxt/catalog/cards/global_mmlu/ru 2026-01-06T13:30:15,593 copying src/unitxt/catalog/cards/global_mmlu/ru/college_computer_science.json -> build/lib/unitxt/catalog/cards/global_mmlu/ru 2026-01-06T13:30:15,595 copying src/unitxt/catalog/cards/global_mmlu/ru/astronomy.json -> build/lib/unitxt/catalog/cards/global_mmlu/ru 2026-01-06T13:30:15,597 copying src/unitxt/catalog/cards/global_mmlu/ru/high_school_european_history.json -> build/lib/unitxt/catalog/cards/global_mmlu/ru 2026-01-06T13:30:15,600 copying src/unitxt/catalog/cards/global_mmlu/ru/electrical_engineering.json -> build/lib/unitxt/catalog/cards/global_mmlu/ru 2026-01-06T13:30:15,602 copying src/unitxt/catalog/cards/global_mmlu/ru/nutrition.json -> build/lib/unitxt/catalog/cards/global_mmlu/ru 2026-01-06T13:30:15,604 copying src/unitxt/catalog/cards/global_mmlu/ru/abstract_algebra.json -> build/lib/unitxt/catalog/cards/global_mmlu/ru 2026-01-06T13:30:15,606 copying src/unitxt/catalog/cards/global_mmlu/ru/professional_medicine.json -> build/lib/unitxt/catalog/cards/global_mmlu/ru 2026-01-06T13:30:15,609 copying src/unitxt/catalog/cards/global_mmlu/ru/human_sexuality.json -> build/lib/unitxt/catalog/cards/global_mmlu/ru 2026-01-06T13:30:15,611 copying src/unitxt/catalog/cards/global_mmlu/ru/business_ethics.json -> build/lib/unitxt/catalog/cards/global_mmlu/ru 2026-01-06T13:30:15,613 copying src/unitxt/catalog/cards/global_mmlu/ru/high_school_chemistry.json -> build/lib/unitxt/catalog/cards/global_mmlu/ru 2026-01-06T13:30:15,615 copying src/unitxt/catalog/cards/global_mmlu/ru/logical_fallacies.json -> build/lib/unitxt/catalog/cards/global_mmlu/ru 2026-01-06T13:30:15,618 copying src/unitxt/catalog/cards/global_mmlu/ru/formal_logic.json -> build/lib/unitxt/catalog/cards/global_mmlu/ru 2026-01-06T13:30:15,620 copying src/unitxt/catalog/cards/global_mmlu/ru/high_school_psychology.json -> build/lib/unitxt/catalog/cards/global_mmlu/ru 2026-01-06T13:30:15,622 copying src/unitxt/catalog/cards/global_mmlu/ru/medical_genetics.json -> build/lib/unitxt/catalog/cards/global_mmlu/ru 2026-01-06T13:30:15,625 copying src/unitxt/catalog/cards/global_mmlu/ru/security_studies.json -> build/lib/unitxt/catalog/cards/global_mmlu/ru 2026-01-06T13:30:15,627 copying src/unitxt/catalog/cards/global_mmlu/ru/high_school_macroeconomics.json -> build/lib/unitxt/catalog/cards/global_mmlu/ru 2026-01-06T13:30:15,629 copying src/unitxt/catalog/cards/global_mmlu/ru/professional_law.json -> build/lib/unitxt/catalog/cards/global_mmlu/ru 2026-01-06T13:30:15,632 copying src/unitxt/catalog/cards/global_mmlu/ru/high_school_physics.json -> build/lib/unitxt/catalog/cards/global_mmlu/ru 2026-01-06T13:30:15,634 copying src/unitxt/catalog/cards/global_mmlu/ru/econometrics.json -> build/lib/unitxt/catalog/cards/global_mmlu/ru 2026-01-06T13:30:15,636 copying src/unitxt/catalog/cards/global_mmlu/ru/sociology.json -> build/lib/unitxt/catalog/cards/global_mmlu/ru 2026-01-06T13:30:15,638 copying src/unitxt/catalog/cards/global_mmlu/ru/moral_disputes.json -> build/lib/unitxt/catalog/cards/global_mmlu/ru 2026-01-06T13:30:15,640 copying src/unitxt/catalog/cards/global_mmlu/ru/college_chemistry.json -> build/lib/unitxt/catalog/cards/global_mmlu/ru 2026-01-06T13:30:15,643 copying src/unitxt/catalog/cards/global_mmlu/ru/high_school_geography.json -> build/lib/unitxt/catalog/cards/global_mmlu/ru 2026-01-06T13:30:15,645 copying src/unitxt/catalog/cards/global_mmlu/ru/jurisprudence.json -> build/lib/unitxt/catalog/cards/global_mmlu/ru 2026-01-06T13:30:15,647 copying src/unitxt/catalog/cards/global_mmlu/ru/high_school_statistics.json -> build/lib/unitxt/catalog/cards/global_mmlu/ru 2026-01-06T13:30:15,649 copying src/unitxt/catalog/cards/global_mmlu/ru/professional_accounting.json -> build/lib/unitxt/catalog/cards/global_mmlu/ru 2026-01-06T13:30:15,651 copying src/unitxt/catalog/cards/global_mmlu/ru/us_foreign_policy.json -> build/lib/unitxt/catalog/cards/global_mmlu/ru 2026-01-06T13:30:15,653 copying src/unitxt/catalog/cards/global_mmlu/ru/professional_psychology.json -> build/lib/unitxt/catalog/cards/global_mmlu/ru 2026-01-06T13:30:15,655 copying src/unitxt/catalog/cards/global_mmlu/ru/public_relations.json -> build/lib/unitxt/catalog/cards/global_mmlu/ru 2026-01-06T13:30:15,658 copying src/unitxt/catalog/cards/global_mmlu/ru/computer_security.json -> build/lib/unitxt/catalog/cards/global_mmlu/ru 2026-01-06T13:30:15,660 copying src/unitxt/catalog/cards/global_mmlu/ru/philosophy.json -> build/lib/unitxt/catalog/cards/global_mmlu/ru 2026-01-06T13:30:15,662 copying src/unitxt/catalog/cards/global_mmlu/ru/virology.json -> build/lib/unitxt/catalog/cards/global_mmlu/ru 2026-01-06T13:30:15,665 copying src/unitxt/catalog/cards/global_mmlu/ru/marketing.json -> build/lib/unitxt/catalog/cards/global_mmlu/ru 2026-01-06T13:30:15,667 copying src/unitxt/catalog/cards/global_mmlu/ru/high_school_world_history.json -> build/lib/unitxt/catalog/cards/global_mmlu/ru 2026-01-06T13:30:15,669 copying src/unitxt/catalog/cards/global_mmlu/ru/machine_learning.json -> build/lib/unitxt/catalog/cards/global_mmlu/ru 2026-01-06T13:30:15,672 copying src/unitxt/catalog/cards/global_mmlu/ru/high_school_government_and_politics.json -> build/lib/unitxt/catalog/cards/global_mmlu/ru 2026-01-06T13:30:15,674 copying src/unitxt/catalog/cards/global_mmlu/ru/conceptual_physics.json -> build/lib/unitxt/catalog/cards/global_mmlu/ru 2026-01-06T13:30:15,676 copying src/unitxt/catalog/cards/global_mmlu/ru/college_biology.json -> build/lib/unitxt/catalog/cards/global_mmlu/ru 2026-01-06T13:30:15,678 copying src/unitxt/catalog/cards/global_mmlu/ru/high_school_mathematics.json -> build/lib/unitxt/catalog/cards/global_mmlu/ru 2026-01-06T13:30:15,680 creating build/lib/unitxt/catalog/cards/global_mmlu/yo 2026-01-06T13:30:15,681 copying src/unitxt/catalog/cards/global_mmlu/yo/elementary_mathematics.json -> build/lib/unitxt/catalog/cards/global_mmlu/yo 2026-01-06T13:30:15,684 copying src/unitxt/catalog/cards/global_mmlu/yo/human_aging.json -> build/lib/unitxt/catalog/cards/global_mmlu/yo 2026-01-06T13:30:15,686 copying src/unitxt/catalog/cards/global_mmlu/yo/high_school_computer_science.json -> build/lib/unitxt/catalog/cards/global_mmlu/yo 2026-01-06T13:30:15,688 copying src/unitxt/catalog/cards/global_mmlu/yo/college_physics.json -> build/lib/unitxt/catalog/cards/global_mmlu/yo 2026-01-06T13:30:15,691 copying src/unitxt/catalog/cards/global_mmlu/yo/college_medicine.json -> build/lib/unitxt/catalog/cards/global_mmlu/yo 2026-01-06T13:30:15,693 copying src/unitxt/catalog/cards/global_mmlu/yo/college_mathematics.json -> build/lib/unitxt/catalog/cards/global_mmlu/yo 2026-01-06T13:30:15,695 copying src/unitxt/catalog/cards/global_mmlu/yo/high_school_microeconomics.json -> build/lib/unitxt/catalog/cards/global_mmlu/yo 2026-01-06T13:30:15,698 copying src/unitxt/catalog/cards/global_mmlu/yo/anatomy.json -> build/lib/unitxt/catalog/cards/global_mmlu/yo 2026-01-06T13:30:15,700 copying src/unitxt/catalog/cards/global_mmlu/yo/world_religions.json -> build/lib/unitxt/catalog/cards/global_mmlu/yo 2026-01-06T13:30:15,702 copying src/unitxt/catalog/cards/global_mmlu/yo/management.json -> build/lib/unitxt/catalog/cards/global_mmlu/yo 2026-01-06T13:30:15,704 copying src/unitxt/catalog/cards/global_mmlu/yo/moral_scenarios.json -> build/lib/unitxt/catalog/cards/global_mmlu/yo 2026-01-06T13:30:15,707 copying src/unitxt/catalog/cards/global_mmlu/yo/global_facts.json -> build/lib/unitxt/catalog/cards/global_mmlu/yo 2026-01-06T13:30:15,709 copying src/unitxt/catalog/cards/global_mmlu/yo/miscellaneous.json -> build/lib/unitxt/catalog/cards/global_mmlu/yo 2026-01-06T13:30:15,711 copying src/unitxt/catalog/cards/global_mmlu/yo/clinical_knowledge.json -> build/lib/unitxt/catalog/cards/global_mmlu/yo 2026-01-06T13:30:15,714 copying src/unitxt/catalog/cards/global_mmlu/yo/high_school_biology.json -> build/lib/unitxt/catalog/cards/global_mmlu/yo 2026-01-06T13:30:15,716 copying src/unitxt/catalog/cards/global_mmlu/yo/prehistory.json -> build/lib/unitxt/catalog/cards/global_mmlu/yo 2026-01-06T13:30:15,718 copying src/unitxt/catalog/cards/global_mmlu/yo/high_school_us_history.json -> build/lib/unitxt/catalog/cards/global_mmlu/yo 2026-01-06T13:30:15,720 copying src/unitxt/catalog/cards/global_mmlu/yo/international_law.json -> build/lib/unitxt/catalog/cards/global_mmlu/yo 2026-01-06T13:30:15,722 copying src/unitxt/catalog/cards/global_mmlu/yo/college_computer_science.json -> build/lib/unitxt/catalog/cards/global_mmlu/yo 2026-01-06T13:30:15,725 copying src/unitxt/catalog/cards/global_mmlu/yo/astronomy.json -> build/lib/unitxt/catalog/cards/global_mmlu/yo 2026-01-06T13:30:15,727 copying src/unitxt/catalog/cards/global_mmlu/yo/high_school_european_history.json -> build/lib/unitxt/catalog/cards/global_mmlu/yo 2026-01-06T13:30:15,729 copying src/unitxt/catalog/cards/global_mmlu/yo/electrical_engineering.json -> build/lib/unitxt/catalog/cards/global_mmlu/yo 2026-01-06T13:30:15,731 copying src/unitxt/catalog/cards/global_mmlu/yo/nutrition.json -> build/lib/unitxt/catalog/cards/global_mmlu/yo 2026-01-06T13:30:15,734 copying src/unitxt/catalog/cards/global_mmlu/yo/abstract_algebra.json -> build/lib/unitxt/catalog/cards/global_mmlu/yo 2026-01-06T13:30:15,737 copying src/unitxt/catalog/cards/global_mmlu/yo/professional_medicine.json -> build/lib/unitxt/catalog/cards/global_mmlu/yo 2026-01-06T13:30:15,739 copying src/unitxt/catalog/cards/global_mmlu/yo/human_sexuality.json -> build/lib/unitxt/catalog/cards/global_mmlu/yo 2026-01-06T13:30:15,742 copying src/unitxt/catalog/cards/global_mmlu/yo/business_ethics.json -> build/lib/unitxt/catalog/cards/global_mmlu/yo 2026-01-06T13:30:15,744 copying src/unitxt/catalog/cards/global_mmlu/yo/high_school_chemistry.json -> build/lib/unitxt/catalog/cards/global_mmlu/yo 2026-01-06T13:30:15,746 copying src/unitxt/catalog/cards/global_mmlu/yo/logical_fallacies.json -> build/lib/unitxt/catalog/cards/global_mmlu/yo 2026-01-06T13:30:15,749 copying src/unitxt/catalog/cards/global_mmlu/yo/formal_logic.json -> build/lib/unitxt/catalog/cards/global_mmlu/yo 2026-01-06T13:30:15,751 copying src/unitxt/catalog/cards/global_mmlu/yo/high_school_psychology.json -> build/lib/unitxt/catalog/cards/global_mmlu/yo 2026-01-06T13:30:15,753 copying src/unitxt/catalog/cards/global_mmlu/yo/medical_genetics.json -> build/lib/unitxt/catalog/cards/global_mmlu/yo 2026-01-06T13:30:15,756 copying src/unitxt/catalog/cards/global_mmlu/yo/security_studies.json -> build/lib/unitxt/catalog/cards/global_mmlu/yo 2026-01-06T13:30:15,758 copying src/unitxt/catalog/cards/global_mmlu/yo/high_school_macroeconomics.json -> build/lib/unitxt/catalog/cards/global_mmlu/yo 2026-01-06T13:30:15,760 copying src/unitxt/catalog/cards/global_mmlu/yo/professional_law.json -> build/lib/unitxt/catalog/cards/global_mmlu/yo 2026-01-06T13:30:15,763 copying src/unitxt/catalog/cards/global_mmlu/yo/high_school_physics.json -> build/lib/unitxt/catalog/cards/global_mmlu/yo 2026-01-06T13:30:15,765 copying src/unitxt/catalog/cards/global_mmlu/yo/econometrics.json -> build/lib/unitxt/catalog/cards/global_mmlu/yo 2026-01-06T13:30:15,767 copying src/unitxt/catalog/cards/global_mmlu/yo/sociology.json -> build/lib/unitxt/catalog/cards/global_mmlu/yo 2026-01-06T13:30:15,769 copying src/unitxt/catalog/cards/global_mmlu/yo/moral_disputes.json -> build/lib/unitxt/catalog/cards/global_mmlu/yo 2026-01-06T13:30:15,772 copying src/unitxt/catalog/cards/global_mmlu/yo/college_chemistry.json -> build/lib/unitxt/catalog/cards/global_mmlu/yo 2026-01-06T13:30:15,775 copying src/unitxt/catalog/cards/global_mmlu/yo/high_school_geography.json -> build/lib/unitxt/catalog/cards/global_mmlu/yo 2026-01-06T13:30:15,777 copying src/unitxt/catalog/cards/global_mmlu/yo/jurisprudence.json -> build/lib/unitxt/catalog/cards/global_mmlu/yo 2026-01-06T13:30:15,779 copying src/unitxt/catalog/cards/global_mmlu/yo/high_school_statistics.json -> build/lib/unitxt/catalog/cards/global_mmlu/yo 2026-01-06T13:30:15,781 copying src/unitxt/catalog/cards/global_mmlu/yo/professional_accounting.json -> build/lib/unitxt/catalog/cards/global_mmlu/yo 2026-01-06T13:30:15,784 copying src/unitxt/catalog/cards/global_mmlu/yo/us_foreign_policy.json -> build/lib/unitxt/catalog/cards/global_mmlu/yo 2026-01-06T13:30:15,786 copying src/unitxt/catalog/cards/global_mmlu/yo/professional_psychology.json -> build/lib/unitxt/catalog/cards/global_mmlu/yo 2026-01-06T13:30:15,788 copying src/unitxt/catalog/cards/global_mmlu/yo/public_relations.json -> build/lib/unitxt/catalog/cards/global_mmlu/yo 2026-01-06T13:30:15,790 copying src/unitxt/catalog/cards/global_mmlu/yo/computer_security.json -> build/lib/unitxt/catalog/cards/global_mmlu/yo 2026-01-06T13:30:15,793 copying src/unitxt/catalog/cards/global_mmlu/yo/philosophy.json -> build/lib/unitxt/catalog/cards/global_mmlu/yo 2026-01-06T13:30:15,795 copying src/unitxt/catalog/cards/global_mmlu/yo/virology.json -> build/lib/unitxt/catalog/cards/global_mmlu/yo 2026-01-06T13:30:15,797 copying src/unitxt/catalog/cards/global_mmlu/yo/marketing.json -> build/lib/unitxt/catalog/cards/global_mmlu/yo 2026-01-06T13:30:15,799 copying src/unitxt/catalog/cards/global_mmlu/yo/high_school_world_history.json -> build/lib/unitxt/catalog/cards/global_mmlu/yo 2026-01-06T13:30:15,801 copying src/unitxt/catalog/cards/global_mmlu/yo/machine_learning.json -> build/lib/unitxt/catalog/cards/global_mmlu/yo 2026-01-06T13:30:15,804 copying src/unitxt/catalog/cards/global_mmlu/yo/high_school_government_and_politics.json -> build/lib/unitxt/catalog/cards/global_mmlu/yo 2026-01-06T13:30:15,806 copying src/unitxt/catalog/cards/global_mmlu/yo/conceptual_physics.json -> build/lib/unitxt/catalog/cards/global_mmlu/yo 2026-01-06T13:30:15,808 copying src/unitxt/catalog/cards/global_mmlu/yo/college_biology.json -> build/lib/unitxt/catalog/cards/global_mmlu/yo 2026-01-06T13:30:15,810 copying src/unitxt/catalog/cards/global_mmlu/yo/high_school_mathematics.json -> build/lib/unitxt/catalog/cards/global_mmlu/yo 2026-01-06T13:30:15,813 creating build/lib/unitxt/catalog/cards/global_mmlu/zh 2026-01-06T13:30:15,813 copying src/unitxt/catalog/cards/global_mmlu/zh/elementary_mathematics.json -> build/lib/unitxt/catalog/cards/global_mmlu/zh 2026-01-06T13:30:15,816 copying src/unitxt/catalog/cards/global_mmlu/zh/human_aging.json -> build/lib/unitxt/catalog/cards/global_mmlu/zh 2026-01-06T13:30:15,819 copying src/unitxt/catalog/cards/global_mmlu/zh/high_school_computer_science.json -> build/lib/unitxt/catalog/cards/global_mmlu/zh 2026-01-06T13:30:15,821 copying src/unitxt/catalog/cards/global_mmlu/zh/college_physics.json -> build/lib/unitxt/catalog/cards/global_mmlu/zh 2026-01-06T13:30:15,823 copying src/unitxt/catalog/cards/global_mmlu/zh/college_medicine.json -> build/lib/unitxt/catalog/cards/global_mmlu/zh 2026-01-06T13:30:15,826 copying src/unitxt/catalog/cards/global_mmlu/zh/college_mathematics.json -> build/lib/unitxt/catalog/cards/global_mmlu/zh 2026-01-06T13:30:15,828 copying src/unitxt/catalog/cards/global_mmlu/zh/high_school_microeconomics.json -> build/lib/unitxt/catalog/cards/global_mmlu/zh 2026-01-06T13:30:15,830 copying src/unitxt/catalog/cards/global_mmlu/zh/anatomy.json -> build/lib/unitxt/catalog/cards/global_mmlu/zh 2026-01-06T13:30:15,832 copying src/unitxt/catalog/cards/global_mmlu/zh/world_religions.json -> build/lib/unitxt/catalog/cards/global_mmlu/zh 2026-01-06T13:30:15,834 copying src/unitxt/catalog/cards/global_mmlu/zh/management.json -> build/lib/unitxt/catalog/cards/global_mmlu/zh 2026-01-06T13:30:15,837 copying src/unitxt/catalog/cards/global_mmlu/zh/moral_scenarios.json -> build/lib/unitxt/catalog/cards/global_mmlu/zh 2026-01-06T13:30:15,839 copying src/unitxt/catalog/cards/global_mmlu/zh/global_facts.json -> build/lib/unitxt/catalog/cards/global_mmlu/zh 2026-01-06T13:30:15,841 copying src/unitxt/catalog/cards/global_mmlu/zh/miscellaneous.json -> build/lib/unitxt/catalog/cards/global_mmlu/zh 2026-01-06T13:30:15,843 copying src/unitxt/catalog/cards/global_mmlu/zh/clinical_knowledge.json -> build/lib/unitxt/catalog/cards/global_mmlu/zh 2026-01-06T13:30:15,846 copying src/unitxt/catalog/cards/global_mmlu/zh/high_school_biology.json -> build/lib/unitxt/catalog/cards/global_mmlu/zh 2026-01-06T13:30:15,848 copying src/unitxt/catalog/cards/global_mmlu/zh/prehistory.json -> build/lib/unitxt/catalog/cards/global_mmlu/zh 2026-01-06T13:30:15,850 copying src/unitxt/catalog/cards/global_mmlu/zh/high_school_us_history.json -> build/lib/unitxt/catalog/cards/global_mmlu/zh 2026-01-06T13:30:15,853 copying src/unitxt/catalog/cards/global_mmlu/zh/international_law.json -> build/lib/unitxt/catalog/cards/global_mmlu/zh 2026-01-06T13:30:15,855 copying src/unitxt/catalog/cards/global_mmlu/zh/college_computer_science.json -> build/lib/unitxt/catalog/cards/global_mmlu/zh 2026-01-06T13:30:15,857 copying src/unitxt/catalog/cards/global_mmlu/zh/astronomy.json -> build/lib/unitxt/catalog/cards/global_mmlu/zh 2026-01-06T13:30:15,859 copying src/unitxt/catalog/cards/global_mmlu/zh/high_school_european_history.json -> build/lib/unitxt/catalog/cards/global_mmlu/zh 2026-01-06T13:30:15,862 copying src/unitxt/catalog/cards/global_mmlu/zh/electrical_engineering.json -> build/lib/unitxt/catalog/cards/global_mmlu/zh 2026-01-06T13:30:15,864 copying src/unitxt/catalog/cards/global_mmlu/zh/nutrition.json -> build/lib/unitxt/catalog/cards/global_mmlu/zh 2026-01-06T13:30:15,866 copying src/unitxt/catalog/cards/global_mmlu/zh/abstract_algebra.json -> build/lib/unitxt/catalog/cards/global_mmlu/zh 2026-01-06T13:30:15,869 copying src/unitxt/catalog/cards/global_mmlu/zh/professional_medicine.json -> build/lib/unitxt/catalog/cards/global_mmlu/zh 2026-01-06T13:30:15,871 copying src/unitxt/catalog/cards/global_mmlu/zh/human_sexuality.json -> build/lib/unitxt/catalog/cards/global_mmlu/zh 2026-01-06T13:30:15,873 copying src/unitxt/catalog/cards/global_mmlu/zh/business_ethics.json -> build/lib/unitxt/catalog/cards/global_mmlu/zh 2026-01-06T13:30:15,876 copying src/unitxt/catalog/cards/global_mmlu/zh/high_school_chemistry.json -> build/lib/unitxt/catalog/cards/global_mmlu/zh 2026-01-06T13:30:15,878 copying src/unitxt/catalog/cards/global_mmlu/zh/logical_fallacies.json -> build/lib/unitxt/catalog/cards/global_mmlu/zh 2026-01-06T13:30:15,880 copying src/unitxt/catalog/cards/global_mmlu/zh/formal_logic.json -> build/lib/unitxt/catalog/cards/global_mmlu/zh 2026-01-06T13:30:15,883 copying src/unitxt/catalog/cards/global_mmlu/zh/high_school_psychology.json -> build/lib/unitxt/catalog/cards/global_mmlu/zh 2026-01-06T13:30:15,885 copying src/unitxt/catalog/cards/global_mmlu/zh/medical_genetics.json -> build/lib/unitxt/catalog/cards/global_mmlu/zh 2026-01-06T13:30:15,887 copying src/unitxt/catalog/cards/global_mmlu/zh/security_studies.json -> build/lib/unitxt/catalog/cards/global_mmlu/zh 2026-01-06T13:30:15,890 copying src/unitxt/catalog/cards/global_mmlu/zh/high_school_macroeconomics.json -> build/lib/unitxt/catalog/cards/global_mmlu/zh 2026-01-06T13:30:15,892 copying src/unitxt/catalog/cards/global_mmlu/zh/professional_law.json -> build/lib/unitxt/catalog/cards/global_mmlu/zh 2026-01-06T13:30:15,894 copying src/unitxt/catalog/cards/global_mmlu/zh/high_school_physics.json -> build/lib/unitxt/catalog/cards/global_mmlu/zh 2026-01-06T13:30:15,896 copying src/unitxt/catalog/cards/global_mmlu/zh/econometrics.json -> build/lib/unitxt/catalog/cards/global_mmlu/zh 2026-01-06T13:30:15,898 copying src/unitxt/catalog/cards/global_mmlu/zh/sociology.json -> build/lib/unitxt/catalog/cards/global_mmlu/zh 2026-01-06T13:30:15,901 copying src/unitxt/catalog/cards/global_mmlu/zh/moral_disputes.json -> build/lib/unitxt/catalog/cards/global_mmlu/zh 2026-01-06T13:30:15,903 copying src/unitxt/catalog/cards/global_mmlu/zh/college_chemistry.json -> build/lib/unitxt/catalog/cards/global_mmlu/zh 2026-01-06T13:30:15,905 copying src/unitxt/catalog/cards/global_mmlu/zh/high_school_geography.json -> build/lib/unitxt/catalog/cards/global_mmlu/zh 2026-01-06T13:30:15,907 copying src/unitxt/catalog/cards/global_mmlu/zh/jurisprudence.json -> build/lib/unitxt/catalog/cards/global_mmlu/zh 2026-01-06T13:30:15,910 copying src/unitxt/catalog/cards/global_mmlu/zh/high_school_statistics.json -> build/lib/unitxt/catalog/cards/global_mmlu/zh 2026-01-06T13:30:15,912 copying src/unitxt/catalog/cards/global_mmlu/zh/professional_accounting.json -> build/lib/unitxt/catalog/cards/global_mmlu/zh 2026-01-06T13:30:15,914 copying src/unitxt/catalog/cards/global_mmlu/zh/us_foreign_policy.json -> build/lib/unitxt/catalog/cards/global_mmlu/zh 2026-01-06T13:30:15,917 copying src/unitxt/catalog/cards/global_mmlu/zh/professional_psychology.json -> build/lib/unitxt/catalog/cards/global_mmlu/zh 2026-01-06T13:30:15,919 copying src/unitxt/catalog/cards/global_mmlu/zh/public_relations.json -> build/lib/unitxt/catalog/cards/global_mmlu/zh 2026-01-06T13:30:15,922 copying src/unitxt/catalog/cards/global_mmlu/zh/computer_security.json -> build/lib/unitxt/catalog/cards/global_mmlu/zh 2026-01-06T13:30:15,924 copying src/unitxt/catalog/cards/global_mmlu/zh/philosophy.json -> build/lib/unitxt/catalog/cards/global_mmlu/zh 2026-01-06T13:30:15,926 copying src/unitxt/catalog/cards/global_mmlu/zh/virology.json -> build/lib/unitxt/catalog/cards/global_mmlu/zh 2026-01-06T13:30:15,929 copying src/unitxt/catalog/cards/global_mmlu/zh/marketing.json -> build/lib/unitxt/catalog/cards/global_mmlu/zh 2026-01-06T13:30:15,931 copying src/unitxt/catalog/cards/global_mmlu/zh/high_school_world_history.json -> build/lib/unitxt/catalog/cards/global_mmlu/zh 2026-01-06T13:30:15,934 copying src/unitxt/catalog/cards/global_mmlu/zh/machine_learning.json -> build/lib/unitxt/catalog/cards/global_mmlu/zh 2026-01-06T13:30:15,936 copying src/unitxt/catalog/cards/global_mmlu/zh/high_school_government_and_politics.json -> build/lib/unitxt/catalog/cards/global_mmlu/zh 2026-01-06T13:30:15,938 copying src/unitxt/catalog/cards/global_mmlu/zh/conceptual_physics.json -> build/lib/unitxt/catalog/cards/global_mmlu/zh 2026-01-06T13:30:15,941 copying src/unitxt/catalog/cards/global_mmlu/zh/college_biology.json -> build/lib/unitxt/catalog/cards/global_mmlu/zh 2026-01-06T13:30:15,943 copying src/unitxt/catalog/cards/global_mmlu/zh/high_school_mathematics.json -> build/lib/unitxt/catalog/cards/global_mmlu/zh 2026-01-06T13:30:15,945 creating build/lib/unitxt/catalog/cards/global_mmlu/fa 2026-01-06T13:30:15,946 copying src/unitxt/catalog/cards/global_mmlu/fa/elementary_mathematics.json -> build/lib/unitxt/catalog/cards/global_mmlu/fa 2026-01-06T13:30:15,949 copying src/unitxt/catalog/cards/global_mmlu/fa/human_aging.json -> build/lib/unitxt/catalog/cards/global_mmlu/fa 2026-01-06T13:30:15,951 copying src/unitxt/catalog/cards/global_mmlu/fa/high_school_computer_science.json -> build/lib/unitxt/catalog/cards/global_mmlu/fa 2026-01-06T13:30:15,953 copying src/unitxt/catalog/cards/global_mmlu/fa/college_physics.json -> build/lib/unitxt/catalog/cards/global_mmlu/fa 2026-01-06T13:30:15,956 copying src/unitxt/catalog/cards/global_mmlu/fa/college_medicine.json -> build/lib/unitxt/catalog/cards/global_mmlu/fa 2026-01-06T13:30:15,958 copying src/unitxt/catalog/cards/global_mmlu/fa/college_mathematics.json -> build/lib/unitxt/catalog/cards/global_mmlu/fa 2026-01-06T13:30:15,960 copying src/unitxt/catalog/cards/global_mmlu/fa/high_school_microeconomics.json -> build/lib/unitxt/catalog/cards/global_mmlu/fa 2026-01-06T13:30:15,962 copying src/unitxt/catalog/cards/global_mmlu/fa/anatomy.json -> build/lib/unitxt/catalog/cards/global_mmlu/fa 2026-01-06T13:30:15,964 copying src/unitxt/catalog/cards/global_mmlu/fa/world_religions.json -> build/lib/unitxt/catalog/cards/global_mmlu/fa 2026-01-06T13:30:15,966 copying src/unitxt/catalog/cards/global_mmlu/fa/management.json -> build/lib/unitxt/catalog/cards/global_mmlu/fa 2026-01-06T13:30:15,969 copying src/unitxt/catalog/cards/global_mmlu/fa/moral_scenarios.json -> build/lib/unitxt/catalog/cards/global_mmlu/fa 2026-01-06T13:30:15,971 copying src/unitxt/catalog/cards/global_mmlu/fa/global_facts.json -> build/lib/unitxt/catalog/cards/global_mmlu/fa 2026-01-06T13:30:15,973 copying src/unitxt/catalog/cards/global_mmlu/fa/miscellaneous.json -> build/lib/unitxt/catalog/cards/global_mmlu/fa 2026-01-06T13:30:15,975 copying src/unitxt/catalog/cards/global_mmlu/fa/clinical_knowledge.json -> build/lib/unitxt/catalog/cards/global_mmlu/fa 2026-01-06T13:30:15,978 copying src/unitxt/catalog/cards/global_mmlu/fa/high_school_biology.json -> build/lib/unitxt/catalog/cards/global_mmlu/fa 2026-01-06T13:30:15,980 copying src/unitxt/catalog/cards/global_mmlu/fa/prehistory.json -> build/lib/unitxt/catalog/cards/global_mmlu/fa 2026-01-06T13:30:15,982 copying src/unitxt/catalog/cards/global_mmlu/fa/high_school_us_history.json -> build/lib/unitxt/catalog/cards/global_mmlu/fa 2026-01-06T13:30:15,984 copying src/unitxt/catalog/cards/global_mmlu/fa/international_law.json -> build/lib/unitxt/catalog/cards/global_mmlu/fa 2026-01-06T13:30:15,987 copying src/unitxt/catalog/cards/global_mmlu/fa/college_computer_science.json -> build/lib/unitxt/catalog/cards/global_mmlu/fa 2026-01-06T13:30:15,989 copying src/unitxt/catalog/cards/global_mmlu/fa/astronomy.json -> build/lib/unitxt/catalog/cards/global_mmlu/fa 2026-01-06T13:30:15,991 copying src/unitxt/catalog/cards/global_mmlu/fa/high_school_european_history.json -> build/lib/unitxt/catalog/cards/global_mmlu/fa 2026-01-06T13:30:15,994 copying src/unitxt/catalog/cards/global_mmlu/fa/electrical_engineering.json -> build/lib/unitxt/catalog/cards/global_mmlu/fa 2026-01-06T13:30:15,996 copying src/unitxt/catalog/cards/global_mmlu/fa/nutrition.json -> build/lib/unitxt/catalog/cards/global_mmlu/fa 2026-01-06T13:30:15,998 copying src/unitxt/catalog/cards/global_mmlu/fa/abstract_algebra.json -> build/lib/unitxt/catalog/cards/global_mmlu/fa 2026-01-06T13:30:16,000 copying src/unitxt/catalog/cards/global_mmlu/fa/professional_medicine.json -> build/lib/unitxt/catalog/cards/global_mmlu/fa 2026-01-06T13:30:16,003 copying src/unitxt/catalog/cards/global_mmlu/fa/human_sexuality.json -> build/lib/unitxt/catalog/cards/global_mmlu/fa 2026-01-06T13:30:16,005 copying src/unitxt/catalog/cards/global_mmlu/fa/business_ethics.json -> build/lib/unitxt/catalog/cards/global_mmlu/fa 2026-01-06T13:30:16,007 copying src/unitxt/catalog/cards/global_mmlu/fa/high_school_chemistry.json -> build/lib/unitxt/catalog/cards/global_mmlu/fa 2026-01-06T13:30:16,009 copying src/unitxt/catalog/cards/global_mmlu/fa/logical_fallacies.json -> build/lib/unitxt/catalog/cards/global_mmlu/fa 2026-01-06T13:30:16,012 copying src/unitxt/catalog/cards/global_mmlu/fa/formal_logic.json -> build/lib/unitxt/catalog/cards/global_mmlu/fa 2026-01-06T13:30:16,014 copying src/unitxt/catalog/cards/global_mmlu/fa/high_school_psychology.json -> build/lib/unitxt/catalog/cards/global_mmlu/fa 2026-01-06T13:30:16,016 copying src/unitxt/catalog/cards/global_mmlu/fa/medical_genetics.json -> build/lib/unitxt/catalog/cards/global_mmlu/fa 2026-01-06T13:30:16,018 copying src/unitxt/catalog/cards/global_mmlu/fa/security_studies.json -> build/lib/unitxt/catalog/cards/global_mmlu/fa 2026-01-06T13:30:16,021 copying src/unitxt/catalog/cards/global_mmlu/fa/high_school_macroeconomics.json -> build/lib/unitxt/catalog/cards/global_mmlu/fa 2026-01-06T13:30:16,023 copying src/unitxt/catalog/cards/global_mmlu/fa/professional_law.json -> build/lib/unitxt/catalog/cards/global_mmlu/fa 2026-01-06T13:30:16,025 copying src/unitxt/catalog/cards/global_mmlu/fa/high_school_physics.json -> build/lib/unitxt/catalog/cards/global_mmlu/fa 2026-01-06T13:30:16,027 copying src/unitxt/catalog/cards/global_mmlu/fa/econometrics.json -> build/lib/unitxt/catalog/cards/global_mmlu/fa 2026-01-06T13:30:16,029 copying src/unitxt/catalog/cards/global_mmlu/fa/sociology.json -> build/lib/unitxt/catalog/cards/global_mmlu/fa 2026-01-06T13:30:16,032 copying src/unitxt/catalog/cards/global_mmlu/fa/moral_disputes.json -> build/lib/unitxt/catalog/cards/global_mmlu/fa 2026-01-06T13:30:16,034 copying src/unitxt/catalog/cards/global_mmlu/fa/college_chemistry.json -> build/lib/unitxt/catalog/cards/global_mmlu/fa 2026-01-06T13:30:16,036 copying src/unitxt/catalog/cards/global_mmlu/fa/high_school_geography.json -> build/lib/unitxt/catalog/cards/global_mmlu/fa 2026-01-06T13:30:16,038 copying src/unitxt/catalog/cards/global_mmlu/fa/jurisprudence.json -> build/lib/unitxt/catalog/cards/global_mmlu/fa 2026-01-06T13:30:16,041 copying src/unitxt/catalog/cards/global_mmlu/fa/high_school_statistics.json -> build/lib/unitxt/catalog/cards/global_mmlu/fa 2026-01-06T13:30:16,043 copying src/unitxt/catalog/cards/global_mmlu/fa/professional_accounting.json -> build/lib/unitxt/catalog/cards/global_mmlu/fa 2026-01-06T13:30:16,046 copying src/unitxt/catalog/cards/global_mmlu/fa/us_foreign_policy.json -> build/lib/unitxt/catalog/cards/global_mmlu/fa 2026-01-06T13:30:16,048 copying src/unitxt/catalog/cards/global_mmlu/fa/professional_psychology.json -> build/lib/unitxt/catalog/cards/global_mmlu/fa 2026-01-06T13:30:16,050 copying src/unitxt/catalog/cards/global_mmlu/fa/public_relations.json -> build/lib/unitxt/catalog/cards/global_mmlu/fa 2026-01-06T13:30:16,052 copying src/unitxt/catalog/cards/global_mmlu/fa/computer_security.json -> build/lib/unitxt/catalog/cards/global_mmlu/fa 2026-01-06T13:30:16,055 copying src/unitxt/catalog/cards/global_mmlu/fa/philosophy.json -> build/lib/unitxt/catalog/cards/global_mmlu/fa 2026-01-06T13:30:16,057 copying src/unitxt/catalog/cards/global_mmlu/fa/virology.json -> build/lib/unitxt/catalog/cards/global_mmlu/fa 2026-01-06T13:30:16,059 copying src/unitxt/catalog/cards/global_mmlu/fa/marketing.json -> build/lib/unitxt/catalog/cards/global_mmlu/fa 2026-01-06T13:30:16,061 copying src/unitxt/catalog/cards/global_mmlu/fa/high_school_world_history.json -> build/lib/unitxt/catalog/cards/global_mmlu/fa 2026-01-06T13:30:16,063 copying src/unitxt/catalog/cards/global_mmlu/fa/machine_learning.json -> build/lib/unitxt/catalog/cards/global_mmlu/fa 2026-01-06T13:30:16,066 copying src/unitxt/catalog/cards/global_mmlu/fa/high_school_government_and_politics.json -> build/lib/unitxt/catalog/cards/global_mmlu/fa 2026-01-06T13:30:16,068 copying src/unitxt/catalog/cards/global_mmlu/fa/conceptual_physics.json -> build/lib/unitxt/catalog/cards/global_mmlu/fa 2026-01-06T13:30:16,070 copying src/unitxt/catalog/cards/global_mmlu/fa/college_biology.json -> build/lib/unitxt/catalog/cards/global_mmlu/fa 2026-01-06T13:30:16,073 copying src/unitxt/catalog/cards/global_mmlu/fa/high_school_mathematics.json -> build/lib/unitxt/catalog/cards/global_mmlu/fa 2026-01-06T13:30:16,076 creating build/lib/unitxt/catalog/cards/global_mmlu/ro 2026-01-06T13:30:16,077 copying src/unitxt/catalog/cards/global_mmlu/ro/elementary_mathematics.json -> build/lib/unitxt/catalog/cards/global_mmlu/ro 2026-01-06T13:30:16,079 copying src/unitxt/catalog/cards/global_mmlu/ro/human_aging.json -> build/lib/unitxt/catalog/cards/global_mmlu/ro 2026-01-06T13:30:16,081 copying src/unitxt/catalog/cards/global_mmlu/ro/high_school_computer_science.json -> build/lib/unitxt/catalog/cards/global_mmlu/ro 2026-01-06T13:30:16,083 copying src/unitxt/catalog/cards/global_mmlu/ro/college_physics.json -> build/lib/unitxt/catalog/cards/global_mmlu/ro 2026-01-06T13:30:16,086 copying src/unitxt/catalog/cards/global_mmlu/ro/college_medicine.json -> build/lib/unitxt/catalog/cards/global_mmlu/ro 2026-01-06T13:30:16,088 copying src/unitxt/catalog/cards/global_mmlu/ro/college_mathematics.json -> build/lib/unitxt/catalog/cards/global_mmlu/ro 2026-01-06T13:30:16,091 copying src/unitxt/catalog/cards/global_mmlu/ro/high_school_microeconomics.json -> build/lib/unitxt/catalog/cards/global_mmlu/ro 2026-01-06T13:30:16,093 copying src/unitxt/catalog/cards/global_mmlu/ro/anatomy.json -> build/lib/unitxt/catalog/cards/global_mmlu/ro 2026-01-06T13:30:16,095 copying src/unitxt/catalog/cards/global_mmlu/ro/world_religions.json -> build/lib/unitxt/catalog/cards/global_mmlu/ro 2026-01-06T13:30:16,097 copying src/unitxt/catalog/cards/global_mmlu/ro/management.json -> build/lib/unitxt/catalog/cards/global_mmlu/ro 2026-01-06T13:30:16,099 copying src/unitxt/catalog/cards/global_mmlu/ro/moral_scenarios.json -> build/lib/unitxt/catalog/cards/global_mmlu/ro 2026-01-06T13:30:16,102 copying src/unitxt/catalog/cards/global_mmlu/ro/global_facts.json -> build/lib/unitxt/catalog/cards/global_mmlu/ro 2026-01-06T13:30:16,104 copying src/unitxt/catalog/cards/global_mmlu/ro/miscellaneous.json -> build/lib/unitxt/catalog/cards/global_mmlu/ro 2026-01-06T13:30:16,106 copying src/unitxt/catalog/cards/global_mmlu/ro/clinical_knowledge.json -> build/lib/unitxt/catalog/cards/global_mmlu/ro 2026-01-06T13:30:16,108 copying src/unitxt/catalog/cards/global_mmlu/ro/high_school_biology.json -> build/lib/unitxt/catalog/cards/global_mmlu/ro 2026-01-06T13:30:16,111 copying src/unitxt/catalog/cards/global_mmlu/ro/prehistory.json -> build/lib/unitxt/catalog/cards/global_mmlu/ro 2026-01-06T13:30:16,113 copying src/unitxt/catalog/cards/global_mmlu/ro/high_school_us_history.json -> build/lib/unitxt/catalog/cards/global_mmlu/ro 2026-01-06T13:30:16,115 copying src/unitxt/catalog/cards/global_mmlu/ro/international_law.json -> build/lib/unitxt/catalog/cards/global_mmlu/ro 2026-01-06T13:30:16,117 copying src/unitxt/catalog/cards/global_mmlu/ro/college_computer_science.json -> build/lib/unitxt/catalog/cards/global_mmlu/ro 2026-01-06T13:30:16,120 copying src/unitxt/catalog/cards/global_mmlu/ro/astronomy.json -> build/lib/unitxt/catalog/cards/global_mmlu/ro 2026-01-06T13:30:16,122 copying src/unitxt/catalog/cards/global_mmlu/ro/high_school_european_history.json -> build/lib/unitxt/catalog/cards/global_mmlu/ro 2026-01-06T13:30:16,124 copying src/unitxt/catalog/cards/global_mmlu/ro/electrical_engineering.json -> build/lib/unitxt/catalog/cards/global_mmlu/ro 2026-01-06T13:30:16,126 copying src/unitxt/catalog/cards/global_mmlu/ro/nutrition.json -> build/lib/unitxt/catalog/cards/global_mmlu/ro 2026-01-06T13:30:16,129 copying src/unitxt/catalog/cards/global_mmlu/ro/abstract_algebra.json -> build/lib/unitxt/catalog/cards/global_mmlu/ro 2026-01-06T13:30:16,131 copying src/unitxt/catalog/cards/global_mmlu/ro/professional_medicine.json -> build/lib/unitxt/catalog/cards/global_mmlu/ro 2026-01-06T13:30:16,133 copying src/unitxt/catalog/cards/global_mmlu/ro/human_sexuality.json -> build/lib/unitxt/catalog/cards/global_mmlu/ro 2026-01-06T13:30:16,136 copying src/unitxt/catalog/cards/global_mmlu/ro/business_ethics.json -> build/lib/unitxt/catalog/cards/global_mmlu/ro 2026-01-06T13:30:16,138 copying src/unitxt/catalog/cards/global_mmlu/ro/high_school_chemistry.json -> build/lib/unitxt/catalog/cards/global_mmlu/ro 2026-01-06T13:30:16,140 copying src/unitxt/catalog/cards/global_mmlu/ro/logical_fallacies.json -> build/lib/unitxt/catalog/cards/global_mmlu/ro 2026-01-06T13:30:16,143 copying src/unitxt/catalog/cards/global_mmlu/ro/formal_logic.json -> build/lib/unitxt/catalog/cards/global_mmlu/ro 2026-01-06T13:30:16,145 copying src/unitxt/catalog/cards/global_mmlu/ro/high_school_psychology.json -> build/lib/unitxt/catalog/cards/global_mmlu/ro 2026-01-06T13:30:16,147 copying src/unitxt/catalog/cards/global_mmlu/ro/medical_genetics.json -> build/lib/unitxt/catalog/cards/global_mmlu/ro 2026-01-06T13:30:16,149 copying src/unitxt/catalog/cards/global_mmlu/ro/security_studies.json -> build/lib/unitxt/catalog/cards/global_mmlu/ro 2026-01-06T13:30:16,152 copying src/unitxt/catalog/cards/global_mmlu/ro/high_school_macroeconomics.json -> build/lib/unitxt/catalog/cards/global_mmlu/ro 2026-01-06T13:30:16,154 copying src/unitxt/catalog/cards/global_mmlu/ro/professional_law.json -> build/lib/unitxt/catalog/cards/global_mmlu/ro 2026-01-06T13:30:16,156 copying src/unitxt/catalog/cards/global_mmlu/ro/high_school_physics.json -> build/lib/unitxt/catalog/cards/global_mmlu/ro 2026-01-06T13:30:16,158 copying src/unitxt/catalog/cards/global_mmlu/ro/econometrics.json -> build/lib/unitxt/catalog/cards/global_mmlu/ro 2026-01-06T13:30:16,160 copying src/unitxt/catalog/cards/global_mmlu/ro/sociology.json -> build/lib/unitxt/catalog/cards/global_mmlu/ro 2026-01-06T13:30:16,163 copying src/unitxt/catalog/cards/global_mmlu/ro/moral_disputes.json -> build/lib/unitxt/catalog/cards/global_mmlu/ro 2026-01-06T13:30:16,165 copying src/unitxt/catalog/cards/global_mmlu/ro/college_chemistry.json -> build/lib/unitxt/catalog/cards/global_mmlu/ro 2026-01-06T13:30:16,167 copying src/unitxt/catalog/cards/global_mmlu/ro/high_school_geography.json -> build/lib/unitxt/catalog/cards/global_mmlu/ro 2026-01-06T13:30:16,169 copying src/unitxt/catalog/cards/global_mmlu/ro/jurisprudence.json -> build/lib/unitxt/catalog/cards/global_mmlu/ro 2026-01-06T13:30:16,172 copying src/unitxt/catalog/cards/global_mmlu/ro/high_school_statistics.json -> build/lib/unitxt/catalog/cards/global_mmlu/ro 2026-01-06T13:30:16,174 copying src/unitxt/catalog/cards/global_mmlu/ro/professional_accounting.json -> build/lib/unitxt/catalog/cards/global_mmlu/ro 2026-01-06T13:30:16,176 copying src/unitxt/catalog/cards/global_mmlu/ro/us_foreign_policy.json -> build/lib/unitxt/catalog/cards/global_mmlu/ro 2026-01-06T13:30:16,178 copying src/unitxt/catalog/cards/global_mmlu/ro/professional_psychology.json -> build/lib/unitxt/catalog/cards/global_mmlu/ro 2026-01-06T13:30:16,181 copying src/unitxt/catalog/cards/global_mmlu/ro/public_relations.json -> build/lib/unitxt/catalog/cards/global_mmlu/ro 2026-01-06T13:30:16,183 copying src/unitxt/catalog/cards/global_mmlu/ro/computer_security.json -> build/lib/unitxt/catalog/cards/global_mmlu/ro 2026-01-06T13:30:16,186 copying src/unitxt/catalog/cards/global_mmlu/ro/philosophy.json -> build/lib/unitxt/catalog/cards/global_mmlu/ro 2026-01-06T13:30:16,188 copying src/unitxt/catalog/cards/global_mmlu/ro/virology.json -> build/lib/unitxt/catalog/cards/global_mmlu/ro 2026-01-06T13:30:16,190 copying src/unitxt/catalog/cards/global_mmlu/ro/marketing.json -> build/lib/unitxt/catalog/cards/global_mmlu/ro 2026-01-06T13:30:16,192 copying src/unitxt/catalog/cards/global_mmlu/ro/high_school_world_history.json -> build/lib/unitxt/catalog/cards/global_mmlu/ro 2026-01-06T13:30:16,195 copying src/unitxt/catalog/cards/global_mmlu/ro/machine_learning.json -> build/lib/unitxt/catalog/cards/global_mmlu/ro 2026-01-06T13:30:16,197 copying src/unitxt/catalog/cards/global_mmlu/ro/high_school_government_and_politics.json -> build/lib/unitxt/catalog/cards/global_mmlu/ro 2026-01-06T13:30:16,199 copying src/unitxt/catalog/cards/global_mmlu/ro/conceptual_physics.json -> build/lib/unitxt/catalog/cards/global_mmlu/ro 2026-01-06T13:30:16,202 copying src/unitxt/catalog/cards/global_mmlu/ro/college_biology.json -> build/lib/unitxt/catalog/cards/global_mmlu/ro 2026-01-06T13:30:16,204 copying src/unitxt/catalog/cards/global_mmlu/ro/high_school_mathematics.json -> build/lib/unitxt/catalog/cards/global_mmlu/ro 2026-01-06T13:30:16,206 creating build/lib/unitxt/catalog/cards/global_mmlu/de 2026-01-06T13:30:16,207 copying src/unitxt/catalog/cards/global_mmlu/de/elementary_mathematics.json -> build/lib/unitxt/catalog/cards/global_mmlu/de 2026-01-06T13:30:16,209 copying src/unitxt/catalog/cards/global_mmlu/de/human_aging.json -> build/lib/unitxt/catalog/cards/global_mmlu/de 2026-01-06T13:30:16,211 copying src/unitxt/catalog/cards/global_mmlu/de/high_school_computer_science.json -> build/lib/unitxt/catalog/cards/global_mmlu/de 2026-01-06T13:30:16,213 copying src/unitxt/catalog/cards/global_mmlu/de/college_physics.json -> build/lib/unitxt/catalog/cards/global_mmlu/de 2026-01-06T13:30:16,216 copying src/unitxt/catalog/cards/global_mmlu/de/college_medicine.json -> build/lib/unitxt/catalog/cards/global_mmlu/de 2026-01-06T13:30:16,218 copying src/unitxt/catalog/cards/global_mmlu/de/college_mathematics.json -> build/lib/unitxt/catalog/cards/global_mmlu/de 2026-01-06T13:30:16,220 copying src/unitxt/catalog/cards/global_mmlu/de/high_school_microeconomics.json -> build/lib/unitxt/catalog/cards/global_mmlu/de 2026-01-06T13:30:16,222 copying src/unitxt/catalog/cards/global_mmlu/de/anatomy.json -> build/lib/unitxt/catalog/cards/global_mmlu/de 2026-01-06T13:30:16,225 copying src/unitxt/catalog/cards/global_mmlu/de/world_religions.json -> build/lib/unitxt/catalog/cards/global_mmlu/de 2026-01-06T13:30:16,227 copying src/unitxt/catalog/cards/global_mmlu/de/management.json -> build/lib/unitxt/catalog/cards/global_mmlu/de 2026-01-06T13:30:16,229 copying src/unitxt/catalog/cards/global_mmlu/de/moral_scenarios.json -> build/lib/unitxt/catalog/cards/global_mmlu/de 2026-01-06T13:30:16,231 copying src/unitxt/catalog/cards/global_mmlu/de/global_facts.json -> build/lib/unitxt/catalog/cards/global_mmlu/de 2026-01-06T13:30:16,233 copying src/unitxt/catalog/cards/global_mmlu/de/miscellaneous.json -> build/lib/unitxt/catalog/cards/global_mmlu/de 2026-01-06T13:30:16,236 copying src/unitxt/catalog/cards/global_mmlu/de/clinical_knowledge.json -> build/lib/unitxt/catalog/cards/global_mmlu/de 2026-01-06T13:30:16,238 copying src/unitxt/catalog/cards/global_mmlu/de/high_school_biology.json -> build/lib/unitxt/catalog/cards/global_mmlu/de 2026-01-06T13:30:16,240 copying src/unitxt/catalog/cards/global_mmlu/de/prehistory.json -> build/lib/unitxt/catalog/cards/global_mmlu/de 2026-01-06T13:30:16,242 copying src/unitxt/catalog/cards/global_mmlu/de/high_school_us_history.json -> build/lib/unitxt/catalog/cards/global_mmlu/de 2026-01-06T13:30:16,245 copying src/unitxt/catalog/cards/global_mmlu/de/international_law.json -> build/lib/unitxt/catalog/cards/global_mmlu/de 2026-01-06T13:30:16,247 copying src/unitxt/catalog/cards/global_mmlu/de/college_computer_science.json -> build/lib/unitxt/catalog/cards/global_mmlu/de 2026-01-06T13:30:16,249 copying src/unitxt/catalog/cards/global_mmlu/de/astronomy.json -> build/lib/unitxt/catalog/cards/global_mmlu/de 2026-01-06T13:30:16,251 copying src/unitxt/catalog/cards/global_mmlu/de/high_school_european_history.json -> build/lib/unitxt/catalog/cards/global_mmlu/de 2026-01-06T13:30:16,253 copying src/unitxt/catalog/cards/global_mmlu/de/electrical_engineering.json -> build/lib/unitxt/catalog/cards/global_mmlu/de 2026-01-06T13:30:16,256 copying src/unitxt/catalog/cards/global_mmlu/de/nutrition.json -> build/lib/unitxt/catalog/cards/global_mmlu/de 2026-01-06T13:30:16,258 copying src/unitxt/catalog/cards/global_mmlu/de/abstract_algebra.json -> build/lib/unitxt/catalog/cards/global_mmlu/de 2026-01-06T13:30:16,260 copying src/unitxt/catalog/cards/global_mmlu/de/professional_medicine.json -> build/lib/unitxt/catalog/cards/global_mmlu/de 2026-01-06T13:30:16,262 copying src/unitxt/catalog/cards/global_mmlu/de/human_sexuality.json -> build/lib/unitxt/catalog/cards/global_mmlu/de 2026-01-06T13:30:16,264 copying src/unitxt/catalog/cards/global_mmlu/de/business_ethics.json -> build/lib/unitxt/catalog/cards/global_mmlu/de 2026-01-06T13:30:16,267 copying src/unitxt/catalog/cards/global_mmlu/de/high_school_chemistry.json -> build/lib/unitxt/catalog/cards/global_mmlu/de 2026-01-06T13:30:16,269 copying src/unitxt/catalog/cards/global_mmlu/de/logical_fallacies.json -> build/lib/unitxt/catalog/cards/global_mmlu/de 2026-01-06T13:30:16,271 copying src/unitxt/catalog/cards/global_mmlu/de/formal_logic.json -> build/lib/unitxt/catalog/cards/global_mmlu/de 2026-01-06T13:30:16,273 copying src/unitxt/catalog/cards/global_mmlu/de/high_school_psychology.json -> build/lib/unitxt/catalog/cards/global_mmlu/de 2026-01-06T13:30:16,275 copying src/unitxt/catalog/cards/global_mmlu/de/medical_genetics.json -> build/lib/unitxt/catalog/cards/global_mmlu/de 2026-01-06T13:30:16,277 copying src/unitxt/catalog/cards/global_mmlu/de/security_studies.json -> build/lib/unitxt/catalog/cards/global_mmlu/de 2026-01-06T13:30:16,280 copying src/unitxt/catalog/cards/global_mmlu/de/high_school_macroeconomics.json -> build/lib/unitxt/catalog/cards/global_mmlu/de 2026-01-06T13:30:16,282 copying src/unitxt/catalog/cards/global_mmlu/de/professional_law.json -> build/lib/unitxt/catalog/cards/global_mmlu/de 2026-01-06T13:30:16,284 copying src/unitxt/catalog/cards/global_mmlu/de/high_school_physics.json -> build/lib/unitxt/catalog/cards/global_mmlu/de 2026-01-06T13:30:16,286 copying src/unitxt/catalog/cards/global_mmlu/de/econometrics.json -> build/lib/unitxt/catalog/cards/global_mmlu/de 2026-01-06T13:30:16,288 copying src/unitxt/catalog/cards/global_mmlu/de/sociology.json -> build/lib/unitxt/catalog/cards/global_mmlu/de 2026-01-06T13:30:16,290 copying src/unitxt/catalog/cards/global_mmlu/de/moral_disputes.json -> build/lib/unitxt/catalog/cards/global_mmlu/de 2026-01-06T13:30:16,293 copying src/unitxt/catalog/cards/global_mmlu/de/college_chemistry.json -> build/lib/unitxt/catalog/cards/global_mmlu/de 2026-01-06T13:30:16,295 copying src/unitxt/catalog/cards/global_mmlu/de/high_school_geography.json -> build/lib/unitxt/catalog/cards/global_mmlu/de 2026-01-06T13:30:16,297 copying src/unitxt/catalog/cards/global_mmlu/de/jurisprudence.json -> build/lib/unitxt/catalog/cards/global_mmlu/de 2026-01-06T13:30:16,299 copying src/unitxt/catalog/cards/global_mmlu/de/high_school_statistics.json -> build/lib/unitxt/catalog/cards/global_mmlu/de 2026-01-06T13:30:16,301 copying src/unitxt/catalog/cards/global_mmlu/de/professional_accounting.json -> build/lib/unitxt/catalog/cards/global_mmlu/de 2026-01-06T13:30:16,303 copying src/unitxt/catalog/cards/global_mmlu/de/us_foreign_policy.json -> build/lib/unitxt/catalog/cards/global_mmlu/de 2026-01-06T13:30:16,306 copying src/unitxt/catalog/cards/global_mmlu/de/professional_psychology.json -> build/lib/unitxt/catalog/cards/global_mmlu/de 2026-01-06T13:30:16,308 copying src/unitxt/catalog/cards/global_mmlu/de/public_relations.json -> build/lib/unitxt/catalog/cards/global_mmlu/de 2026-01-06T13:30:16,310 copying src/unitxt/catalog/cards/global_mmlu/de/computer_security.json -> build/lib/unitxt/catalog/cards/global_mmlu/de 2026-01-06T13:30:16,312 copying src/unitxt/catalog/cards/global_mmlu/de/philosophy.json -> build/lib/unitxt/catalog/cards/global_mmlu/de 2026-01-06T13:30:16,315 copying src/unitxt/catalog/cards/global_mmlu/de/virology.json -> build/lib/unitxt/catalog/cards/global_mmlu/de 2026-01-06T13:30:16,317 copying src/unitxt/catalog/cards/global_mmlu/de/marketing.json -> build/lib/unitxt/catalog/cards/global_mmlu/de 2026-01-06T13:30:16,319 copying src/unitxt/catalog/cards/global_mmlu/de/high_school_world_history.json -> build/lib/unitxt/catalog/cards/global_mmlu/de 2026-01-06T13:30:16,321 copying src/unitxt/catalog/cards/global_mmlu/de/machine_learning.json -> build/lib/unitxt/catalog/cards/global_mmlu/de 2026-01-06T13:30:16,324 copying src/unitxt/catalog/cards/global_mmlu/de/high_school_government_and_politics.json -> build/lib/unitxt/catalog/cards/global_mmlu/de 2026-01-06T13:30:16,326 copying src/unitxt/catalog/cards/global_mmlu/de/conceptual_physics.json -> build/lib/unitxt/catalog/cards/global_mmlu/de 2026-01-06T13:30:16,328 copying src/unitxt/catalog/cards/global_mmlu/de/college_biology.json -> build/lib/unitxt/catalog/cards/global_mmlu/de 2026-01-06T13:30:16,331 copying src/unitxt/catalog/cards/global_mmlu/de/high_school_mathematics.json -> build/lib/unitxt/catalog/cards/global_mmlu/de 2026-01-06T13:30:16,332 creating build/lib/unitxt/catalog/cards/global_mmlu/pl 2026-01-06T13:30:16,333 copying src/unitxt/catalog/cards/global_mmlu/pl/elementary_mathematics.json -> build/lib/unitxt/catalog/cards/global_mmlu/pl 2026-01-06T13:30:16,336 copying src/unitxt/catalog/cards/global_mmlu/pl/human_aging.json -> build/lib/unitxt/catalog/cards/global_mmlu/pl 2026-01-06T13:30:16,338 copying src/unitxt/catalog/cards/global_mmlu/pl/high_school_computer_science.json -> build/lib/unitxt/catalog/cards/global_mmlu/pl 2026-01-06T13:30:16,340 copying src/unitxt/catalog/cards/global_mmlu/pl/college_physics.json -> build/lib/unitxt/catalog/cards/global_mmlu/pl 2026-01-06T13:30:16,342 copying src/unitxt/catalog/cards/global_mmlu/pl/college_medicine.json -> build/lib/unitxt/catalog/cards/global_mmlu/pl 2026-01-06T13:30:16,344 copying src/unitxt/catalog/cards/global_mmlu/pl/college_mathematics.json -> build/lib/unitxt/catalog/cards/global_mmlu/pl 2026-01-06T13:30:16,347 copying src/unitxt/catalog/cards/global_mmlu/pl/high_school_microeconomics.json -> build/lib/unitxt/catalog/cards/global_mmlu/pl 2026-01-06T13:30:16,349 copying src/unitxt/catalog/cards/global_mmlu/pl/anatomy.json -> build/lib/unitxt/catalog/cards/global_mmlu/pl 2026-01-06T13:30:16,351 copying src/unitxt/catalog/cards/global_mmlu/pl/world_religions.json -> build/lib/unitxt/catalog/cards/global_mmlu/pl 2026-01-06T13:30:16,353 copying src/unitxt/catalog/cards/global_mmlu/pl/management.json -> build/lib/unitxt/catalog/cards/global_mmlu/pl 2026-01-06T13:30:16,355 copying src/unitxt/catalog/cards/global_mmlu/pl/moral_scenarios.json -> build/lib/unitxt/catalog/cards/global_mmlu/pl 2026-01-06T13:30:16,358 copying src/unitxt/catalog/cards/global_mmlu/pl/global_facts.json -> build/lib/unitxt/catalog/cards/global_mmlu/pl 2026-01-06T13:30:16,360 copying src/unitxt/catalog/cards/global_mmlu/pl/miscellaneous.json -> build/lib/unitxt/catalog/cards/global_mmlu/pl 2026-01-06T13:30:16,362 copying src/unitxt/catalog/cards/global_mmlu/pl/clinical_knowledge.json -> build/lib/unitxt/catalog/cards/global_mmlu/pl 2026-01-06T13:30:16,364 copying src/unitxt/catalog/cards/global_mmlu/pl/high_school_biology.json -> build/lib/unitxt/catalog/cards/global_mmlu/pl 2026-01-06T13:30:16,367 copying src/unitxt/catalog/cards/global_mmlu/pl/prehistory.json -> build/lib/unitxt/catalog/cards/global_mmlu/pl 2026-01-06T13:30:16,369 copying src/unitxt/catalog/cards/global_mmlu/pl/high_school_us_history.json -> build/lib/unitxt/catalog/cards/global_mmlu/pl 2026-01-06T13:30:16,371 copying src/unitxt/catalog/cards/global_mmlu/pl/international_law.json -> build/lib/unitxt/catalog/cards/global_mmlu/pl 2026-01-06T13:30:16,373 copying src/unitxt/catalog/cards/global_mmlu/pl/college_computer_science.json -> build/lib/unitxt/catalog/cards/global_mmlu/pl 2026-01-06T13:30:16,375 copying src/unitxt/catalog/cards/global_mmlu/pl/astronomy.json -> build/lib/unitxt/catalog/cards/global_mmlu/pl 2026-01-06T13:30:16,378 copying src/unitxt/catalog/cards/global_mmlu/pl/high_school_european_history.json -> build/lib/unitxt/catalog/cards/global_mmlu/pl 2026-01-06T13:30:16,380 copying src/unitxt/catalog/cards/global_mmlu/pl/electrical_engineering.json -> build/lib/unitxt/catalog/cards/global_mmlu/pl 2026-01-06T13:30:16,382 copying src/unitxt/catalog/cards/global_mmlu/pl/nutrition.json -> build/lib/unitxt/catalog/cards/global_mmlu/pl 2026-01-06T13:30:16,384 copying src/unitxt/catalog/cards/global_mmlu/pl/abstract_algebra.json -> build/lib/unitxt/catalog/cards/global_mmlu/pl 2026-01-06T13:30:16,387 copying src/unitxt/catalog/cards/global_mmlu/pl/professional_medicine.json -> build/lib/unitxt/catalog/cards/global_mmlu/pl 2026-01-06T13:30:16,389 copying src/unitxt/catalog/cards/global_mmlu/pl/human_sexuality.json -> build/lib/unitxt/catalog/cards/global_mmlu/pl 2026-01-06T13:30:16,391 copying src/unitxt/catalog/cards/global_mmlu/pl/business_ethics.json -> build/lib/unitxt/catalog/cards/global_mmlu/pl 2026-01-06T13:30:16,393 copying src/unitxt/catalog/cards/global_mmlu/pl/high_school_chemistry.json -> build/lib/unitxt/catalog/cards/global_mmlu/pl 2026-01-06T13:30:16,396 copying src/unitxt/catalog/cards/global_mmlu/pl/logical_fallacies.json -> build/lib/unitxt/catalog/cards/global_mmlu/pl 2026-01-06T13:30:16,398 copying src/unitxt/catalog/cards/global_mmlu/pl/formal_logic.json -> build/lib/unitxt/catalog/cards/global_mmlu/pl 2026-01-06T13:30:16,400 copying src/unitxt/catalog/cards/global_mmlu/pl/high_school_psychology.json -> build/lib/unitxt/catalog/cards/global_mmlu/pl 2026-01-06T13:30:16,403 copying src/unitxt/catalog/cards/global_mmlu/pl/medical_genetics.json -> build/lib/unitxt/catalog/cards/global_mmlu/pl 2026-01-06T13:30:16,405 copying src/unitxt/catalog/cards/global_mmlu/pl/security_studies.json -> build/lib/unitxt/catalog/cards/global_mmlu/pl 2026-01-06T13:30:16,407 copying src/unitxt/catalog/cards/global_mmlu/pl/high_school_macroeconomics.json -> build/lib/unitxt/catalog/cards/global_mmlu/pl 2026-01-06T13:30:16,411 copying src/unitxt/catalog/cards/global_mmlu/pl/professional_law.json -> build/lib/unitxt/catalog/cards/global_mmlu/pl 2026-01-06T13:30:16,414 copying src/unitxt/catalog/cards/global_mmlu/pl/high_school_physics.json -> build/lib/unitxt/catalog/cards/global_mmlu/pl 2026-01-06T13:30:16,416 copying src/unitxt/catalog/cards/global_mmlu/pl/econometrics.json -> build/lib/unitxt/catalog/cards/global_mmlu/pl 2026-01-06T13:30:16,418 copying src/unitxt/catalog/cards/global_mmlu/pl/sociology.json -> build/lib/unitxt/catalog/cards/global_mmlu/pl 2026-01-06T13:30:16,420 copying src/unitxt/catalog/cards/global_mmlu/pl/moral_disputes.json -> build/lib/unitxt/catalog/cards/global_mmlu/pl 2026-01-06T13:30:16,423 copying src/unitxt/catalog/cards/global_mmlu/pl/college_chemistry.json -> build/lib/unitxt/catalog/cards/global_mmlu/pl 2026-01-06T13:30:16,425 copying src/unitxt/catalog/cards/global_mmlu/pl/high_school_geography.json -> build/lib/unitxt/catalog/cards/global_mmlu/pl 2026-01-06T13:30:16,427 copying src/unitxt/catalog/cards/global_mmlu/pl/jurisprudence.json -> build/lib/unitxt/catalog/cards/global_mmlu/pl 2026-01-06T13:30:16,430 copying src/unitxt/catalog/cards/global_mmlu/pl/high_school_statistics.json -> build/lib/unitxt/catalog/cards/global_mmlu/pl 2026-01-06T13:30:16,432 copying src/unitxt/catalog/cards/global_mmlu/pl/professional_accounting.json -> build/lib/unitxt/catalog/cards/global_mmlu/pl 2026-01-06T13:30:16,434 copying src/unitxt/catalog/cards/global_mmlu/pl/us_foreign_policy.json -> build/lib/unitxt/catalog/cards/global_mmlu/pl 2026-01-06T13:30:16,437 copying src/unitxt/catalog/cards/global_mmlu/pl/professional_psychology.json -> build/lib/unitxt/catalog/cards/global_mmlu/pl 2026-01-06T13:30:16,439 copying src/unitxt/catalog/cards/global_mmlu/pl/public_relations.json -> build/lib/unitxt/catalog/cards/global_mmlu/pl 2026-01-06T13:30:16,442 copying src/unitxt/catalog/cards/global_mmlu/pl/computer_security.json -> build/lib/unitxt/catalog/cards/global_mmlu/pl 2026-01-06T13:30:16,444 copying src/unitxt/catalog/cards/global_mmlu/pl/philosophy.json -> build/lib/unitxt/catalog/cards/global_mmlu/pl 2026-01-06T13:30:16,446 copying src/unitxt/catalog/cards/global_mmlu/pl/virology.json -> build/lib/unitxt/catalog/cards/global_mmlu/pl 2026-01-06T13:30:16,449 copying src/unitxt/catalog/cards/global_mmlu/pl/marketing.json -> build/lib/unitxt/catalog/cards/global_mmlu/pl 2026-01-06T13:30:16,451 copying src/unitxt/catalog/cards/global_mmlu/pl/high_school_world_history.json -> build/lib/unitxt/catalog/cards/global_mmlu/pl 2026-01-06T13:30:16,453 copying src/unitxt/catalog/cards/global_mmlu/pl/machine_learning.json -> build/lib/unitxt/catalog/cards/global_mmlu/pl 2026-01-06T13:30:16,455 copying src/unitxt/catalog/cards/global_mmlu/pl/high_school_government_and_politics.json -> build/lib/unitxt/catalog/cards/global_mmlu/pl 2026-01-06T13:30:16,458 copying src/unitxt/catalog/cards/global_mmlu/pl/conceptual_physics.json -> build/lib/unitxt/catalog/cards/global_mmlu/pl 2026-01-06T13:30:16,460 copying src/unitxt/catalog/cards/global_mmlu/pl/college_biology.json -> build/lib/unitxt/catalog/cards/global_mmlu/pl 2026-01-06T13:30:16,462 copying src/unitxt/catalog/cards/global_mmlu/pl/high_school_mathematics.json -> build/lib/unitxt/catalog/cards/global_mmlu/pl 2026-01-06T13:30:16,464 creating build/lib/unitxt/catalog/cards/global_mmlu/ja 2026-01-06T13:30:16,465 copying src/unitxt/catalog/cards/global_mmlu/ja/elementary_mathematics.json -> build/lib/unitxt/catalog/cards/global_mmlu/ja 2026-01-06T13:30:16,468 copying src/unitxt/catalog/cards/global_mmlu/ja/human_aging.json -> build/lib/unitxt/catalog/cards/global_mmlu/ja 2026-01-06T13:30:16,470 copying src/unitxt/catalog/cards/global_mmlu/ja/high_school_computer_science.json -> build/lib/unitxt/catalog/cards/global_mmlu/ja 2026-01-06T13:30:16,473 copying src/unitxt/catalog/cards/global_mmlu/ja/college_physics.json -> build/lib/unitxt/catalog/cards/global_mmlu/ja 2026-01-06T13:30:16,475 copying src/unitxt/catalog/cards/global_mmlu/ja/college_medicine.json -> build/lib/unitxt/catalog/cards/global_mmlu/ja 2026-01-06T13:30:16,477 copying src/unitxt/catalog/cards/global_mmlu/ja/college_mathematics.json -> build/lib/unitxt/catalog/cards/global_mmlu/ja 2026-01-06T13:30:16,479 copying src/unitxt/catalog/cards/global_mmlu/ja/high_school_microeconomics.json -> build/lib/unitxt/catalog/cards/global_mmlu/ja 2026-01-06T13:30:16,482 copying src/unitxt/catalog/cards/global_mmlu/ja/anatomy.json -> build/lib/unitxt/catalog/cards/global_mmlu/ja 2026-01-06T13:30:16,484 copying src/unitxt/catalog/cards/global_mmlu/ja/world_religions.json -> build/lib/unitxt/catalog/cards/global_mmlu/ja 2026-01-06T13:30:16,486 copying src/unitxt/catalog/cards/global_mmlu/ja/management.json -> build/lib/unitxt/catalog/cards/global_mmlu/ja 2026-01-06T13:30:16,489 copying src/unitxt/catalog/cards/global_mmlu/ja/moral_scenarios.json -> build/lib/unitxt/catalog/cards/global_mmlu/ja 2026-01-06T13:30:16,491 copying src/unitxt/catalog/cards/global_mmlu/ja/global_facts.json -> build/lib/unitxt/catalog/cards/global_mmlu/ja 2026-01-06T13:30:16,493 copying src/unitxt/catalog/cards/global_mmlu/ja/miscellaneous.json -> build/lib/unitxt/catalog/cards/global_mmlu/ja 2026-01-06T13:30:16,495 copying src/unitxt/catalog/cards/global_mmlu/ja/clinical_knowledge.json -> build/lib/unitxt/catalog/cards/global_mmlu/ja 2026-01-06T13:30:16,498 copying src/unitxt/catalog/cards/global_mmlu/ja/high_school_biology.json -> build/lib/unitxt/catalog/cards/global_mmlu/ja 2026-01-06T13:30:16,500 copying src/unitxt/catalog/cards/global_mmlu/ja/prehistory.json -> build/lib/unitxt/catalog/cards/global_mmlu/ja 2026-01-06T13:30:16,502 copying src/unitxt/catalog/cards/global_mmlu/ja/high_school_us_history.json -> build/lib/unitxt/catalog/cards/global_mmlu/ja 2026-01-06T13:30:16,504 copying src/unitxt/catalog/cards/global_mmlu/ja/international_law.json -> build/lib/unitxt/catalog/cards/global_mmlu/ja 2026-01-06T13:30:16,507 copying src/unitxt/catalog/cards/global_mmlu/ja/college_computer_science.json -> build/lib/unitxt/catalog/cards/global_mmlu/ja 2026-01-06T13:30:16,509 copying src/unitxt/catalog/cards/global_mmlu/ja/astronomy.json -> build/lib/unitxt/catalog/cards/global_mmlu/ja 2026-01-06T13:30:16,512 copying src/unitxt/catalog/cards/global_mmlu/ja/high_school_european_history.json -> build/lib/unitxt/catalog/cards/global_mmlu/ja 2026-01-06T13:30:16,514 copying src/unitxt/catalog/cards/global_mmlu/ja/electrical_engineering.json -> build/lib/unitxt/catalog/cards/global_mmlu/ja 2026-01-06T13:30:16,516 copying src/unitxt/catalog/cards/global_mmlu/ja/nutrition.json -> build/lib/unitxt/catalog/cards/global_mmlu/ja 2026-01-06T13:30:16,519 copying src/unitxt/catalog/cards/global_mmlu/ja/abstract_algebra.json -> build/lib/unitxt/catalog/cards/global_mmlu/ja 2026-01-06T13:30:16,521 copying src/unitxt/catalog/cards/global_mmlu/ja/professional_medicine.json -> build/lib/unitxt/catalog/cards/global_mmlu/ja 2026-01-06T13:30:16,523 copying src/unitxt/catalog/cards/global_mmlu/ja/human_sexuality.json -> build/lib/unitxt/catalog/cards/global_mmlu/ja 2026-01-06T13:30:16,525 copying src/unitxt/catalog/cards/global_mmlu/ja/business_ethics.json -> build/lib/unitxt/catalog/cards/global_mmlu/ja 2026-01-06T13:30:16,527 copying src/unitxt/catalog/cards/global_mmlu/ja/high_school_chemistry.json -> build/lib/unitxt/catalog/cards/global_mmlu/ja 2026-01-06T13:30:16,530 copying src/unitxt/catalog/cards/global_mmlu/ja/logical_fallacies.json -> build/lib/unitxt/catalog/cards/global_mmlu/ja 2026-01-06T13:30:16,532 copying src/unitxt/catalog/cards/global_mmlu/ja/formal_logic.json -> build/lib/unitxt/catalog/cards/global_mmlu/ja 2026-01-06T13:30:16,534 copying src/unitxt/catalog/cards/global_mmlu/ja/high_school_psychology.json -> build/lib/unitxt/catalog/cards/global_mmlu/ja 2026-01-06T13:30:16,537 copying src/unitxt/catalog/cards/global_mmlu/ja/medical_genetics.json -> build/lib/unitxt/catalog/cards/global_mmlu/ja 2026-01-06T13:30:16,539 copying src/unitxt/catalog/cards/global_mmlu/ja/security_studies.json -> build/lib/unitxt/catalog/cards/global_mmlu/ja 2026-01-06T13:30:16,541 copying src/unitxt/catalog/cards/global_mmlu/ja/high_school_macroeconomics.json -> build/lib/unitxt/catalog/cards/global_mmlu/ja 2026-01-06T13:30:16,544 copying src/unitxt/catalog/cards/global_mmlu/ja/professional_law.json -> build/lib/unitxt/catalog/cards/global_mmlu/ja 2026-01-06T13:30:16,546 copying src/unitxt/catalog/cards/global_mmlu/ja/high_school_physics.json -> build/lib/unitxt/catalog/cards/global_mmlu/ja 2026-01-06T13:30:16,548 copying src/unitxt/catalog/cards/global_mmlu/ja/econometrics.json -> build/lib/unitxt/catalog/cards/global_mmlu/ja 2026-01-06T13:30:16,550 copying src/unitxt/catalog/cards/global_mmlu/ja/sociology.json -> build/lib/unitxt/catalog/cards/global_mmlu/ja 2026-01-06T13:30:16,552 copying src/unitxt/catalog/cards/global_mmlu/ja/moral_disputes.json -> build/lib/unitxt/catalog/cards/global_mmlu/ja 2026-01-06T13:30:16,555 copying src/unitxt/catalog/cards/global_mmlu/ja/college_chemistry.json -> build/lib/unitxt/catalog/cards/global_mmlu/ja 2026-01-06T13:30:16,557 copying src/unitxt/catalog/cards/global_mmlu/ja/high_school_geography.json -> build/lib/unitxt/catalog/cards/global_mmlu/ja 2026-01-06T13:30:16,559 copying src/unitxt/catalog/cards/global_mmlu/ja/jurisprudence.json -> build/lib/unitxt/catalog/cards/global_mmlu/ja 2026-01-06T13:30:16,561 copying src/unitxt/catalog/cards/global_mmlu/ja/high_school_statistics.json -> build/lib/unitxt/catalog/cards/global_mmlu/ja 2026-01-06T13:30:16,564 copying src/unitxt/catalog/cards/global_mmlu/ja/professional_accounting.json -> build/lib/unitxt/catalog/cards/global_mmlu/ja 2026-01-06T13:30:16,566 copying src/unitxt/catalog/cards/global_mmlu/ja/us_foreign_policy.json -> build/lib/unitxt/catalog/cards/global_mmlu/ja 2026-01-06T13:30:16,568 copying src/unitxt/catalog/cards/global_mmlu/ja/professional_psychology.json -> build/lib/unitxt/catalog/cards/global_mmlu/ja 2026-01-06T13:30:16,571 copying src/unitxt/catalog/cards/global_mmlu/ja/public_relations.json -> build/lib/unitxt/catalog/cards/global_mmlu/ja 2026-01-06T13:30:16,573 copying src/unitxt/catalog/cards/global_mmlu/ja/computer_security.json -> build/lib/unitxt/catalog/cards/global_mmlu/ja 2026-01-06T13:30:16,575 copying src/unitxt/catalog/cards/global_mmlu/ja/philosophy.json -> build/lib/unitxt/catalog/cards/global_mmlu/ja 2026-01-06T13:30:16,577 copying src/unitxt/catalog/cards/global_mmlu/ja/virology.json -> build/lib/unitxt/catalog/cards/global_mmlu/ja 2026-01-06T13:30:16,580 copying src/unitxt/catalog/cards/global_mmlu/ja/marketing.json -> build/lib/unitxt/catalog/cards/global_mmlu/ja 2026-01-06T13:30:16,582 copying src/unitxt/catalog/cards/global_mmlu/ja/high_school_world_history.json -> build/lib/unitxt/catalog/cards/global_mmlu/ja 2026-01-06T13:30:16,584 copying src/unitxt/catalog/cards/global_mmlu/ja/machine_learning.json -> build/lib/unitxt/catalog/cards/global_mmlu/ja 2026-01-06T13:30:16,587 copying src/unitxt/catalog/cards/global_mmlu/ja/high_school_government_and_politics.json -> build/lib/unitxt/catalog/cards/global_mmlu/ja 2026-01-06T13:30:16,589 copying src/unitxt/catalog/cards/global_mmlu/ja/conceptual_physics.json -> build/lib/unitxt/catalog/cards/global_mmlu/ja 2026-01-06T13:30:16,591 copying src/unitxt/catalog/cards/global_mmlu/ja/college_biology.json -> build/lib/unitxt/catalog/cards/global_mmlu/ja 2026-01-06T13:30:16,593 copying src/unitxt/catalog/cards/global_mmlu/ja/high_school_mathematics.json -> build/lib/unitxt/catalog/cards/global_mmlu/ja 2026-01-06T13:30:16,595 creating build/lib/unitxt/catalog/cards/global_mmlu/mg 2026-01-06T13:30:16,596 copying src/unitxt/catalog/cards/global_mmlu/mg/elementary_mathematics.json -> build/lib/unitxt/catalog/cards/global_mmlu/mg 2026-01-06T13:30:16,598 copying src/unitxt/catalog/cards/global_mmlu/mg/human_aging.json -> build/lib/unitxt/catalog/cards/global_mmlu/mg 2026-01-06T13:30:16,601 copying src/unitxt/catalog/cards/global_mmlu/mg/high_school_computer_science.json -> build/lib/unitxt/catalog/cards/global_mmlu/mg 2026-01-06T13:30:16,603 copying src/unitxt/catalog/cards/global_mmlu/mg/college_physics.json -> build/lib/unitxt/catalog/cards/global_mmlu/mg 2026-01-06T13:30:16,605 copying src/unitxt/catalog/cards/global_mmlu/mg/college_medicine.json -> build/lib/unitxt/catalog/cards/global_mmlu/mg 2026-01-06T13:30:16,607 copying src/unitxt/catalog/cards/global_mmlu/mg/college_mathematics.json -> build/lib/unitxt/catalog/cards/global_mmlu/mg 2026-01-06T13:30:16,609 copying src/unitxt/catalog/cards/global_mmlu/mg/high_school_microeconomics.json -> build/lib/unitxt/catalog/cards/global_mmlu/mg 2026-01-06T13:30:16,612 copying src/unitxt/catalog/cards/global_mmlu/mg/anatomy.json -> build/lib/unitxt/catalog/cards/global_mmlu/mg 2026-01-06T13:30:16,614 copying src/unitxt/catalog/cards/global_mmlu/mg/world_religions.json -> build/lib/unitxt/catalog/cards/global_mmlu/mg 2026-01-06T13:30:16,616 copying src/unitxt/catalog/cards/global_mmlu/mg/management.json -> build/lib/unitxt/catalog/cards/global_mmlu/mg 2026-01-06T13:30:16,619 copying src/unitxt/catalog/cards/global_mmlu/mg/moral_scenarios.json -> build/lib/unitxt/catalog/cards/global_mmlu/mg 2026-01-06T13:30:16,621 copying src/unitxt/catalog/cards/global_mmlu/mg/global_facts.json -> build/lib/unitxt/catalog/cards/global_mmlu/mg 2026-01-06T13:30:16,623 copying src/unitxt/catalog/cards/global_mmlu/mg/miscellaneous.json -> build/lib/unitxt/catalog/cards/global_mmlu/mg 2026-01-06T13:30:16,625 copying src/unitxt/catalog/cards/global_mmlu/mg/clinical_knowledge.json -> build/lib/unitxt/catalog/cards/global_mmlu/mg 2026-01-06T13:30:16,627 copying src/unitxt/catalog/cards/global_mmlu/mg/high_school_biology.json -> build/lib/unitxt/catalog/cards/global_mmlu/mg 2026-01-06T13:30:16,630 copying src/unitxt/catalog/cards/global_mmlu/mg/prehistory.json -> build/lib/unitxt/catalog/cards/global_mmlu/mg 2026-01-06T13:30:16,632 copying src/unitxt/catalog/cards/global_mmlu/mg/high_school_us_history.json -> build/lib/unitxt/catalog/cards/global_mmlu/mg 2026-01-06T13:30:16,635 copying src/unitxt/catalog/cards/global_mmlu/mg/international_law.json -> build/lib/unitxt/catalog/cards/global_mmlu/mg 2026-01-06T13:30:16,637 copying src/unitxt/catalog/cards/global_mmlu/mg/college_computer_science.json -> build/lib/unitxt/catalog/cards/global_mmlu/mg 2026-01-06T13:30:16,639 copying src/unitxt/catalog/cards/global_mmlu/mg/astronomy.json -> build/lib/unitxt/catalog/cards/global_mmlu/mg 2026-01-06T13:30:16,641 copying src/unitxt/catalog/cards/global_mmlu/mg/high_school_european_history.json -> build/lib/unitxt/catalog/cards/global_mmlu/mg 2026-01-06T13:30:16,644 copying src/unitxt/catalog/cards/global_mmlu/mg/electrical_engineering.json -> build/lib/unitxt/catalog/cards/global_mmlu/mg 2026-01-06T13:30:16,646 copying src/unitxt/catalog/cards/global_mmlu/mg/nutrition.json -> build/lib/unitxt/catalog/cards/global_mmlu/mg 2026-01-06T13:30:16,648 copying src/unitxt/catalog/cards/global_mmlu/mg/abstract_algebra.json -> build/lib/unitxt/catalog/cards/global_mmlu/mg 2026-01-06T13:30:16,650 copying src/unitxt/catalog/cards/global_mmlu/mg/professional_medicine.json -> build/lib/unitxt/catalog/cards/global_mmlu/mg 2026-01-06T13:30:16,653 copying src/unitxt/catalog/cards/global_mmlu/mg/human_sexuality.json -> build/lib/unitxt/catalog/cards/global_mmlu/mg 2026-01-06T13:30:16,655 copying src/unitxt/catalog/cards/global_mmlu/mg/business_ethics.json -> build/lib/unitxt/catalog/cards/global_mmlu/mg 2026-01-06T13:30:16,657 copying src/unitxt/catalog/cards/global_mmlu/mg/high_school_chemistry.json -> build/lib/unitxt/catalog/cards/global_mmlu/mg 2026-01-06T13:30:16,659 copying src/unitxt/catalog/cards/global_mmlu/mg/logical_fallacies.json -> build/lib/unitxt/catalog/cards/global_mmlu/mg 2026-01-06T13:30:16,661 copying src/unitxt/catalog/cards/global_mmlu/mg/formal_logic.json -> build/lib/unitxt/catalog/cards/global_mmlu/mg 2026-01-06T13:30:16,663 copying src/unitxt/catalog/cards/global_mmlu/mg/high_school_psychology.json -> build/lib/unitxt/catalog/cards/global_mmlu/mg 2026-01-06T13:30:16,665 copying src/unitxt/catalog/cards/global_mmlu/mg/medical_genetics.json -> build/lib/unitxt/catalog/cards/global_mmlu/mg 2026-01-06T13:30:16,667 copying src/unitxt/catalog/cards/global_mmlu/mg/security_studies.json -> build/lib/unitxt/catalog/cards/global_mmlu/mg 2026-01-06T13:30:16,670 copying src/unitxt/catalog/cards/global_mmlu/mg/high_school_macroeconomics.json -> build/lib/unitxt/catalog/cards/global_mmlu/mg 2026-01-06T13:30:16,672 copying src/unitxt/catalog/cards/global_mmlu/mg/professional_law.json -> build/lib/unitxt/catalog/cards/global_mmlu/mg 2026-01-06T13:30:16,674 copying src/unitxt/catalog/cards/global_mmlu/mg/high_school_physics.json -> build/lib/unitxt/catalog/cards/global_mmlu/mg 2026-01-06T13:30:16,677 copying src/unitxt/catalog/cards/global_mmlu/mg/econometrics.json -> build/lib/unitxt/catalog/cards/global_mmlu/mg 2026-01-06T13:30:16,679 copying src/unitxt/catalog/cards/global_mmlu/mg/sociology.json -> build/lib/unitxt/catalog/cards/global_mmlu/mg 2026-01-06T13:30:16,681 copying src/unitxt/catalog/cards/global_mmlu/mg/moral_disputes.json -> build/lib/unitxt/catalog/cards/global_mmlu/mg 2026-01-06T13:30:16,684 copying src/unitxt/catalog/cards/global_mmlu/mg/college_chemistry.json -> build/lib/unitxt/catalog/cards/global_mmlu/mg 2026-01-06T13:30:16,686 copying src/unitxt/catalog/cards/global_mmlu/mg/high_school_geography.json -> build/lib/unitxt/catalog/cards/global_mmlu/mg 2026-01-06T13:30:16,688 copying src/unitxt/catalog/cards/global_mmlu/mg/jurisprudence.json -> build/lib/unitxt/catalog/cards/global_mmlu/mg 2026-01-06T13:30:16,691 copying src/unitxt/catalog/cards/global_mmlu/mg/high_school_statistics.json -> build/lib/unitxt/catalog/cards/global_mmlu/mg 2026-01-06T13:30:16,693 copying src/unitxt/catalog/cards/global_mmlu/mg/professional_accounting.json -> build/lib/unitxt/catalog/cards/global_mmlu/mg 2026-01-06T13:30:16,695 copying src/unitxt/catalog/cards/global_mmlu/mg/us_foreign_policy.json -> build/lib/unitxt/catalog/cards/global_mmlu/mg 2026-01-06T13:30:16,697 copying src/unitxt/catalog/cards/global_mmlu/mg/professional_psychology.json -> build/lib/unitxt/catalog/cards/global_mmlu/mg 2026-01-06T13:30:16,699 copying src/unitxt/catalog/cards/global_mmlu/mg/public_relations.json -> build/lib/unitxt/catalog/cards/global_mmlu/mg 2026-01-06T13:30:16,702 copying src/unitxt/catalog/cards/global_mmlu/mg/computer_security.json -> build/lib/unitxt/catalog/cards/global_mmlu/mg 2026-01-06T13:30:16,704 copying src/unitxt/catalog/cards/global_mmlu/mg/philosophy.json -> build/lib/unitxt/catalog/cards/global_mmlu/mg 2026-01-06T13:30:16,706 copying src/unitxt/catalog/cards/global_mmlu/mg/virology.json -> build/lib/unitxt/catalog/cards/global_mmlu/mg 2026-01-06T13:30:16,708 copying src/unitxt/catalog/cards/global_mmlu/mg/marketing.json -> build/lib/unitxt/catalog/cards/global_mmlu/mg 2026-01-06T13:30:16,711 copying src/unitxt/catalog/cards/global_mmlu/mg/high_school_world_history.json -> build/lib/unitxt/catalog/cards/global_mmlu/mg 2026-01-06T13:30:16,713 copying src/unitxt/catalog/cards/global_mmlu/mg/machine_learning.json -> build/lib/unitxt/catalog/cards/global_mmlu/mg 2026-01-06T13:30:16,715 copying src/unitxt/catalog/cards/global_mmlu/mg/high_school_government_and_politics.json -> build/lib/unitxt/catalog/cards/global_mmlu/mg 2026-01-06T13:30:16,717 copying src/unitxt/catalog/cards/global_mmlu/mg/conceptual_physics.json -> build/lib/unitxt/catalog/cards/global_mmlu/mg 2026-01-06T13:30:16,719 copying src/unitxt/catalog/cards/global_mmlu/mg/college_biology.json -> build/lib/unitxt/catalog/cards/global_mmlu/mg 2026-01-06T13:30:16,721 copying src/unitxt/catalog/cards/global_mmlu/mg/high_school_mathematics.json -> build/lib/unitxt/catalog/cards/global_mmlu/mg 2026-01-06T13:30:16,723 creating build/lib/unitxt/catalog/cards/global_mmlu/fil 2026-01-06T13:30:16,724 copying src/unitxt/catalog/cards/global_mmlu/fil/elementary_mathematics.json -> build/lib/unitxt/catalog/cards/global_mmlu/fil 2026-01-06T13:30:16,726 copying src/unitxt/catalog/cards/global_mmlu/fil/human_aging.json -> build/lib/unitxt/catalog/cards/global_mmlu/fil 2026-01-06T13:30:16,728 copying src/unitxt/catalog/cards/global_mmlu/fil/high_school_computer_science.json -> build/lib/unitxt/catalog/cards/global_mmlu/fil 2026-01-06T13:30:16,731 copying src/unitxt/catalog/cards/global_mmlu/fil/college_physics.json -> build/lib/unitxt/catalog/cards/global_mmlu/fil 2026-01-06T13:30:16,733 copying src/unitxt/catalog/cards/global_mmlu/fil/college_medicine.json -> build/lib/unitxt/catalog/cards/global_mmlu/fil 2026-01-06T13:30:16,735 copying src/unitxt/catalog/cards/global_mmlu/fil/college_mathematics.json -> build/lib/unitxt/catalog/cards/global_mmlu/fil 2026-01-06T13:30:16,737 copying src/unitxt/catalog/cards/global_mmlu/fil/high_school_microeconomics.json -> build/lib/unitxt/catalog/cards/global_mmlu/fil 2026-01-06T13:30:16,739 copying src/unitxt/catalog/cards/global_mmlu/fil/anatomy.json -> build/lib/unitxt/catalog/cards/global_mmlu/fil 2026-01-06T13:30:16,742 copying src/unitxt/catalog/cards/global_mmlu/fil/world_religions.json -> build/lib/unitxt/catalog/cards/global_mmlu/fil 2026-01-06T13:30:16,744 copying src/unitxt/catalog/cards/global_mmlu/fil/management.json -> build/lib/unitxt/catalog/cards/global_mmlu/fil 2026-01-06T13:30:16,746 copying src/unitxt/catalog/cards/global_mmlu/fil/moral_scenarios.json -> build/lib/unitxt/catalog/cards/global_mmlu/fil 2026-01-06T13:30:16,748 copying src/unitxt/catalog/cards/global_mmlu/fil/global_facts.json -> build/lib/unitxt/catalog/cards/global_mmlu/fil 2026-01-06T13:30:16,750 copying src/unitxt/catalog/cards/global_mmlu/fil/miscellaneous.json -> build/lib/unitxt/catalog/cards/global_mmlu/fil 2026-01-06T13:30:16,753 copying src/unitxt/catalog/cards/global_mmlu/fil/clinical_knowledge.json -> build/lib/unitxt/catalog/cards/global_mmlu/fil 2026-01-06T13:30:16,755 copying src/unitxt/catalog/cards/global_mmlu/fil/high_school_biology.json -> build/lib/unitxt/catalog/cards/global_mmlu/fil 2026-01-06T13:30:16,757 copying src/unitxt/catalog/cards/global_mmlu/fil/prehistory.json -> build/lib/unitxt/catalog/cards/global_mmlu/fil 2026-01-06T13:30:16,759 copying src/unitxt/catalog/cards/global_mmlu/fil/high_school_us_history.json -> build/lib/unitxt/catalog/cards/global_mmlu/fil 2026-01-06T13:30:16,761 copying src/unitxt/catalog/cards/global_mmlu/fil/international_law.json -> build/lib/unitxt/catalog/cards/global_mmlu/fil 2026-01-06T13:30:16,764 copying src/unitxt/catalog/cards/global_mmlu/fil/college_computer_science.json -> build/lib/unitxt/catalog/cards/global_mmlu/fil 2026-01-06T13:30:16,766 copying src/unitxt/catalog/cards/global_mmlu/fil/astronomy.json -> build/lib/unitxt/catalog/cards/global_mmlu/fil 2026-01-06T13:30:16,768 copying src/unitxt/catalog/cards/global_mmlu/fil/high_school_european_history.json -> build/lib/unitxt/catalog/cards/global_mmlu/fil 2026-01-06T13:30:16,771 copying src/unitxt/catalog/cards/global_mmlu/fil/electrical_engineering.json -> build/lib/unitxt/catalog/cards/global_mmlu/fil 2026-01-06T13:30:16,773 copying src/unitxt/catalog/cards/global_mmlu/fil/nutrition.json -> build/lib/unitxt/catalog/cards/global_mmlu/fil 2026-01-06T13:30:16,775 copying src/unitxt/catalog/cards/global_mmlu/fil/abstract_algebra.json -> build/lib/unitxt/catalog/cards/global_mmlu/fil 2026-01-06T13:30:16,777 copying src/unitxt/catalog/cards/global_mmlu/fil/professional_medicine.json -> build/lib/unitxt/catalog/cards/global_mmlu/fil 2026-01-06T13:30:16,779 copying src/unitxt/catalog/cards/global_mmlu/fil/human_sexuality.json -> build/lib/unitxt/catalog/cards/global_mmlu/fil 2026-01-06T13:30:16,781 copying src/unitxt/catalog/cards/global_mmlu/fil/business_ethics.json -> build/lib/unitxt/catalog/cards/global_mmlu/fil 2026-01-06T13:30:16,784 copying src/unitxt/catalog/cards/global_mmlu/fil/high_school_chemistry.json -> build/lib/unitxt/catalog/cards/global_mmlu/fil 2026-01-06T13:30:16,786 copying src/unitxt/catalog/cards/global_mmlu/fil/logical_fallacies.json -> build/lib/unitxt/catalog/cards/global_mmlu/fil 2026-01-06T13:30:16,788 copying src/unitxt/catalog/cards/global_mmlu/fil/formal_logic.json -> build/lib/unitxt/catalog/cards/global_mmlu/fil 2026-01-06T13:30:16,790 copying src/unitxt/catalog/cards/global_mmlu/fil/high_school_psychology.json -> build/lib/unitxt/catalog/cards/global_mmlu/fil 2026-01-06T13:30:16,792 copying src/unitxt/catalog/cards/global_mmlu/fil/medical_genetics.json -> build/lib/unitxt/catalog/cards/global_mmlu/fil 2026-01-06T13:30:16,795 copying src/unitxt/catalog/cards/global_mmlu/fil/security_studies.json -> build/lib/unitxt/catalog/cards/global_mmlu/fil 2026-01-06T13:30:16,797 copying src/unitxt/catalog/cards/global_mmlu/fil/high_school_macroeconomics.json -> build/lib/unitxt/catalog/cards/global_mmlu/fil 2026-01-06T13:30:16,799 copying src/unitxt/catalog/cards/global_mmlu/fil/professional_law.json -> build/lib/unitxt/catalog/cards/global_mmlu/fil 2026-01-06T13:30:16,801 copying src/unitxt/catalog/cards/global_mmlu/fil/high_school_physics.json -> build/lib/unitxt/catalog/cards/global_mmlu/fil 2026-01-06T13:30:16,803 copying src/unitxt/catalog/cards/global_mmlu/fil/econometrics.json -> build/lib/unitxt/catalog/cards/global_mmlu/fil 2026-01-06T13:30:16,806 copying src/unitxt/catalog/cards/global_mmlu/fil/sociology.json -> build/lib/unitxt/catalog/cards/global_mmlu/fil 2026-01-06T13:30:16,808 copying src/unitxt/catalog/cards/global_mmlu/fil/moral_disputes.json -> build/lib/unitxt/catalog/cards/global_mmlu/fil 2026-01-06T13:30:16,810 copying src/unitxt/catalog/cards/global_mmlu/fil/college_chemistry.json -> build/lib/unitxt/catalog/cards/global_mmlu/fil 2026-01-06T13:30:16,812 copying src/unitxt/catalog/cards/global_mmlu/fil/high_school_geography.json -> build/lib/unitxt/catalog/cards/global_mmlu/fil 2026-01-06T13:30:16,814 copying src/unitxt/catalog/cards/global_mmlu/fil/jurisprudence.json -> build/lib/unitxt/catalog/cards/global_mmlu/fil 2026-01-06T13:30:16,817 copying src/unitxt/catalog/cards/global_mmlu/fil/high_school_statistics.json -> build/lib/unitxt/catalog/cards/global_mmlu/fil 2026-01-06T13:30:16,819 copying src/unitxt/catalog/cards/global_mmlu/fil/professional_accounting.json -> build/lib/unitxt/catalog/cards/global_mmlu/fil 2026-01-06T13:30:16,821 copying src/unitxt/catalog/cards/global_mmlu/fil/us_foreign_policy.json -> build/lib/unitxt/catalog/cards/global_mmlu/fil 2026-01-06T13:30:16,823 copying src/unitxt/catalog/cards/global_mmlu/fil/professional_psychology.json -> build/lib/unitxt/catalog/cards/global_mmlu/fil 2026-01-06T13:30:16,826 copying src/unitxt/catalog/cards/global_mmlu/fil/public_relations.json -> build/lib/unitxt/catalog/cards/global_mmlu/fil 2026-01-06T13:30:16,828 copying src/unitxt/catalog/cards/global_mmlu/fil/computer_security.json -> build/lib/unitxt/catalog/cards/global_mmlu/fil 2026-01-06T13:30:16,830 copying src/unitxt/catalog/cards/global_mmlu/fil/philosophy.json -> build/lib/unitxt/catalog/cards/global_mmlu/fil 2026-01-06T13:30:16,832 copying src/unitxt/catalog/cards/global_mmlu/fil/virology.json -> build/lib/unitxt/catalog/cards/global_mmlu/fil 2026-01-06T13:30:16,835 copying src/unitxt/catalog/cards/global_mmlu/fil/marketing.json -> build/lib/unitxt/catalog/cards/global_mmlu/fil 2026-01-06T13:30:16,837 copying src/unitxt/catalog/cards/global_mmlu/fil/high_school_world_history.json -> build/lib/unitxt/catalog/cards/global_mmlu/fil 2026-01-06T13:30:16,839 copying src/unitxt/catalog/cards/global_mmlu/fil/machine_learning.json -> build/lib/unitxt/catalog/cards/global_mmlu/fil 2026-01-06T13:30:16,841 copying src/unitxt/catalog/cards/global_mmlu/fil/high_school_government_and_politics.json -> build/lib/unitxt/catalog/cards/global_mmlu/fil 2026-01-06T13:30:16,843 copying src/unitxt/catalog/cards/global_mmlu/fil/conceptual_physics.json -> build/lib/unitxt/catalog/cards/global_mmlu/fil 2026-01-06T13:30:16,845 copying src/unitxt/catalog/cards/global_mmlu/fil/college_biology.json -> build/lib/unitxt/catalog/cards/global_mmlu/fil 2026-01-06T13:30:16,847 copying src/unitxt/catalog/cards/global_mmlu/fil/high_school_mathematics.json -> build/lib/unitxt/catalog/cards/global_mmlu/fil 2026-01-06T13:30:16,849 creating build/lib/unitxt/catalog/cards/global_mmlu/ar 2026-01-06T13:30:16,850 copying src/unitxt/catalog/cards/global_mmlu/ar/elementary_mathematics.json -> build/lib/unitxt/catalog/cards/global_mmlu/ar 2026-01-06T13:30:16,853 copying src/unitxt/catalog/cards/global_mmlu/ar/human_aging.json -> build/lib/unitxt/catalog/cards/global_mmlu/ar 2026-01-06T13:30:16,855 copying src/unitxt/catalog/cards/global_mmlu/ar/high_school_computer_science.json -> build/lib/unitxt/catalog/cards/global_mmlu/ar 2026-01-06T13:30:16,857 copying src/unitxt/catalog/cards/global_mmlu/ar/college_physics.json -> build/lib/unitxt/catalog/cards/global_mmlu/ar 2026-01-06T13:30:16,859 copying src/unitxt/catalog/cards/global_mmlu/ar/college_medicine.json -> build/lib/unitxt/catalog/cards/global_mmlu/ar 2026-01-06T13:30:16,862 copying src/unitxt/catalog/cards/global_mmlu/ar/college_mathematics.json -> build/lib/unitxt/catalog/cards/global_mmlu/ar 2026-01-06T13:30:16,864 copying src/unitxt/catalog/cards/global_mmlu/ar/high_school_microeconomics.json -> build/lib/unitxt/catalog/cards/global_mmlu/ar 2026-01-06T13:30:16,866 copying src/unitxt/catalog/cards/global_mmlu/ar/anatomy.json -> build/lib/unitxt/catalog/cards/global_mmlu/ar 2026-01-06T13:30:16,868 copying src/unitxt/catalog/cards/global_mmlu/ar/world_religions.json -> build/lib/unitxt/catalog/cards/global_mmlu/ar 2026-01-06T13:30:16,870 copying src/unitxt/catalog/cards/global_mmlu/ar/management.json -> build/lib/unitxt/catalog/cards/global_mmlu/ar 2026-01-06T13:30:16,872 copying src/unitxt/catalog/cards/global_mmlu/ar/moral_scenarios.json -> build/lib/unitxt/catalog/cards/global_mmlu/ar 2026-01-06T13:30:16,874 copying src/unitxt/catalog/cards/global_mmlu/ar/global_facts.json -> build/lib/unitxt/catalog/cards/global_mmlu/ar 2026-01-06T13:30:16,877 copying src/unitxt/catalog/cards/global_mmlu/ar/miscellaneous.json -> build/lib/unitxt/catalog/cards/global_mmlu/ar 2026-01-06T13:30:16,879 copying src/unitxt/catalog/cards/global_mmlu/ar/clinical_knowledge.json -> build/lib/unitxt/catalog/cards/global_mmlu/ar 2026-01-06T13:30:16,881 copying src/unitxt/catalog/cards/global_mmlu/ar/high_school_biology.json -> build/lib/unitxt/catalog/cards/global_mmlu/ar 2026-01-06T13:30:16,883 copying src/unitxt/catalog/cards/global_mmlu/ar/prehistory.json -> build/lib/unitxt/catalog/cards/global_mmlu/ar 2026-01-06T13:30:16,885 copying src/unitxt/catalog/cards/global_mmlu/ar/high_school_us_history.json -> build/lib/unitxt/catalog/cards/global_mmlu/ar 2026-01-06T13:30:16,888 copying src/unitxt/catalog/cards/global_mmlu/ar/international_law.json -> build/lib/unitxt/catalog/cards/global_mmlu/ar 2026-01-06T13:30:16,890 copying src/unitxt/catalog/cards/global_mmlu/ar/college_computer_science.json -> build/lib/unitxt/catalog/cards/global_mmlu/ar 2026-01-06T13:30:16,892 copying src/unitxt/catalog/cards/global_mmlu/ar/astronomy.json -> build/lib/unitxt/catalog/cards/global_mmlu/ar 2026-01-06T13:30:16,894 copying src/unitxt/catalog/cards/global_mmlu/ar/high_school_european_history.json -> build/lib/unitxt/catalog/cards/global_mmlu/ar 2026-01-06T13:30:16,896 copying src/unitxt/catalog/cards/global_mmlu/ar/electrical_engineering.json -> build/lib/unitxt/catalog/cards/global_mmlu/ar 2026-01-06T13:30:16,899 copying src/unitxt/catalog/cards/global_mmlu/ar/nutrition.json -> build/lib/unitxt/catalog/cards/global_mmlu/ar 2026-01-06T13:30:16,901 copying src/unitxt/catalog/cards/global_mmlu/ar/abstract_algebra.json -> build/lib/unitxt/catalog/cards/global_mmlu/ar 2026-01-06T13:30:16,903 copying src/unitxt/catalog/cards/global_mmlu/ar/professional_medicine.json -> build/lib/unitxt/catalog/cards/global_mmlu/ar 2026-01-06T13:30:16,905 copying src/unitxt/catalog/cards/global_mmlu/ar/human_sexuality.json -> build/lib/unitxt/catalog/cards/global_mmlu/ar 2026-01-06T13:30:16,907 copying src/unitxt/catalog/cards/global_mmlu/ar/business_ethics.json -> build/lib/unitxt/catalog/cards/global_mmlu/ar 2026-01-06T13:30:16,909 copying src/unitxt/catalog/cards/global_mmlu/ar/high_school_chemistry.json -> build/lib/unitxt/catalog/cards/global_mmlu/ar 2026-01-06T13:30:16,912 copying src/unitxt/catalog/cards/global_mmlu/ar/logical_fallacies.json -> build/lib/unitxt/catalog/cards/global_mmlu/ar 2026-01-06T13:30:16,914 copying src/unitxt/catalog/cards/global_mmlu/ar/formal_logic.json -> build/lib/unitxt/catalog/cards/global_mmlu/ar 2026-01-06T13:30:16,916 copying src/unitxt/catalog/cards/global_mmlu/ar/high_school_psychology.json -> build/lib/unitxt/catalog/cards/global_mmlu/ar 2026-01-06T13:30:16,918 copying src/unitxt/catalog/cards/global_mmlu/ar/medical_genetics.json -> build/lib/unitxt/catalog/cards/global_mmlu/ar 2026-01-06T13:30:16,921 copying src/unitxt/catalog/cards/global_mmlu/ar/security_studies.json -> build/lib/unitxt/catalog/cards/global_mmlu/ar 2026-01-06T13:30:16,923 copying src/unitxt/catalog/cards/global_mmlu/ar/high_school_macroeconomics.json -> build/lib/unitxt/catalog/cards/global_mmlu/ar 2026-01-06T13:30:16,925 copying src/unitxt/catalog/cards/global_mmlu/ar/professional_law.json -> build/lib/unitxt/catalog/cards/global_mmlu/ar 2026-01-06T13:30:16,927 copying src/unitxt/catalog/cards/global_mmlu/ar/high_school_physics.json -> build/lib/unitxt/catalog/cards/global_mmlu/ar 2026-01-06T13:30:16,929 copying src/unitxt/catalog/cards/global_mmlu/ar/econometrics.json -> build/lib/unitxt/catalog/cards/global_mmlu/ar 2026-01-06T13:30:16,931 copying src/unitxt/catalog/cards/global_mmlu/ar/sociology.json -> build/lib/unitxt/catalog/cards/global_mmlu/ar 2026-01-06T13:30:16,934 copying src/unitxt/catalog/cards/global_mmlu/ar/moral_disputes.json -> build/lib/unitxt/catalog/cards/global_mmlu/ar 2026-01-06T13:30:16,936 copying src/unitxt/catalog/cards/global_mmlu/ar/college_chemistry.json -> build/lib/unitxt/catalog/cards/global_mmlu/ar 2026-01-06T13:30:16,938 copying src/unitxt/catalog/cards/global_mmlu/ar/high_school_geography.json -> build/lib/unitxt/catalog/cards/global_mmlu/ar 2026-01-06T13:30:16,940 copying src/unitxt/catalog/cards/global_mmlu/ar/jurisprudence.json -> build/lib/unitxt/catalog/cards/global_mmlu/ar 2026-01-06T13:30:16,942 copying src/unitxt/catalog/cards/global_mmlu/ar/high_school_statistics.json -> build/lib/unitxt/catalog/cards/global_mmlu/ar 2026-01-06T13:30:16,945 copying src/unitxt/catalog/cards/global_mmlu/ar/professional_accounting.json -> build/lib/unitxt/catalog/cards/global_mmlu/ar 2026-01-06T13:30:16,947 copying src/unitxt/catalog/cards/global_mmlu/ar/us_foreign_policy.json -> build/lib/unitxt/catalog/cards/global_mmlu/ar 2026-01-06T13:30:16,949 copying src/unitxt/catalog/cards/global_mmlu/ar/professional_psychology.json -> build/lib/unitxt/catalog/cards/global_mmlu/ar 2026-01-06T13:30:16,952 copying src/unitxt/catalog/cards/global_mmlu/ar/public_relations.json -> build/lib/unitxt/catalog/cards/global_mmlu/ar 2026-01-06T13:30:16,954 copying src/unitxt/catalog/cards/global_mmlu/ar/computer_security.json -> build/lib/unitxt/catalog/cards/global_mmlu/ar 2026-01-06T13:30:16,956 copying src/unitxt/catalog/cards/global_mmlu/ar/philosophy.json -> build/lib/unitxt/catalog/cards/global_mmlu/ar 2026-01-06T13:30:16,959 copying src/unitxt/catalog/cards/global_mmlu/ar/virology.json -> build/lib/unitxt/catalog/cards/global_mmlu/ar 2026-01-06T13:30:16,961 copying src/unitxt/catalog/cards/global_mmlu/ar/marketing.json -> build/lib/unitxt/catalog/cards/global_mmlu/ar 2026-01-06T13:30:16,963 copying src/unitxt/catalog/cards/global_mmlu/ar/high_school_world_history.json -> build/lib/unitxt/catalog/cards/global_mmlu/ar 2026-01-06T13:30:16,965 copying src/unitxt/catalog/cards/global_mmlu/ar/machine_learning.json -> build/lib/unitxt/catalog/cards/global_mmlu/ar 2026-01-06T13:30:16,967 copying src/unitxt/catalog/cards/global_mmlu/ar/high_school_government_and_politics.json -> build/lib/unitxt/catalog/cards/global_mmlu/ar 2026-01-06T13:30:16,969 copying src/unitxt/catalog/cards/global_mmlu/ar/conceptual_physics.json -> build/lib/unitxt/catalog/cards/global_mmlu/ar 2026-01-06T13:30:16,971 copying src/unitxt/catalog/cards/global_mmlu/ar/college_biology.json -> build/lib/unitxt/catalog/cards/global_mmlu/ar 2026-01-06T13:30:16,973 copying src/unitxt/catalog/cards/global_mmlu/ar/high_school_mathematics.json -> build/lib/unitxt/catalog/cards/global_mmlu/ar 2026-01-06T13:30:16,976 creating build/lib/unitxt/catalog/cards/global_mmlu/pt 2026-01-06T13:30:16,977 copying src/unitxt/catalog/cards/global_mmlu/pt/elementary_mathematics.json -> build/lib/unitxt/catalog/cards/global_mmlu/pt 2026-01-06T13:30:16,979 copying src/unitxt/catalog/cards/global_mmlu/pt/human_aging.json -> build/lib/unitxt/catalog/cards/global_mmlu/pt 2026-01-06T13:30:16,981 copying src/unitxt/catalog/cards/global_mmlu/pt/high_school_computer_science.json -> build/lib/unitxt/catalog/cards/global_mmlu/pt 2026-01-06T13:30:16,984 copying src/unitxt/catalog/cards/global_mmlu/pt/college_physics.json -> build/lib/unitxt/catalog/cards/global_mmlu/pt 2026-01-06T13:30:16,986 copying src/unitxt/catalog/cards/global_mmlu/pt/college_medicine.json -> build/lib/unitxt/catalog/cards/global_mmlu/pt 2026-01-06T13:30:16,989 copying src/unitxt/catalog/cards/global_mmlu/pt/college_mathematics.json -> build/lib/unitxt/catalog/cards/global_mmlu/pt 2026-01-06T13:30:16,991 copying src/unitxt/catalog/cards/global_mmlu/pt/high_school_microeconomics.json -> build/lib/unitxt/catalog/cards/global_mmlu/pt 2026-01-06T13:30:16,993 copying src/unitxt/catalog/cards/global_mmlu/pt/anatomy.json -> build/lib/unitxt/catalog/cards/global_mmlu/pt 2026-01-06T13:30:16,995 copying src/unitxt/catalog/cards/global_mmlu/pt/world_religions.json -> build/lib/unitxt/catalog/cards/global_mmlu/pt 2026-01-06T13:30:16,997 copying src/unitxt/catalog/cards/global_mmlu/pt/management.json -> build/lib/unitxt/catalog/cards/global_mmlu/pt 2026-01-06T13:30:17,001 copying src/unitxt/catalog/cards/global_mmlu/pt/moral_scenarios.json -> build/lib/unitxt/catalog/cards/global_mmlu/pt 2026-01-06T13:30:17,003 copying src/unitxt/catalog/cards/global_mmlu/pt/global_facts.json -> build/lib/unitxt/catalog/cards/global_mmlu/pt 2026-01-06T13:30:17,005 copying src/unitxt/catalog/cards/global_mmlu/pt/miscellaneous.json -> build/lib/unitxt/catalog/cards/global_mmlu/pt 2026-01-06T13:30:17,007 copying src/unitxt/catalog/cards/global_mmlu/pt/clinical_knowledge.json -> build/lib/unitxt/catalog/cards/global_mmlu/pt 2026-01-06T13:30:17,010 copying src/unitxt/catalog/cards/global_mmlu/pt/high_school_biology.json -> build/lib/unitxt/catalog/cards/global_mmlu/pt 2026-01-06T13:30:17,012 copying src/unitxt/catalog/cards/global_mmlu/pt/prehistory.json -> build/lib/unitxt/catalog/cards/global_mmlu/pt 2026-01-06T13:30:17,014 copying src/unitxt/catalog/cards/global_mmlu/pt/high_school_us_history.json -> build/lib/unitxt/catalog/cards/global_mmlu/pt 2026-01-06T13:30:17,017 copying src/unitxt/catalog/cards/global_mmlu/pt/international_law.json -> build/lib/unitxt/catalog/cards/global_mmlu/pt 2026-01-06T13:30:17,019 copying src/unitxt/catalog/cards/global_mmlu/pt/college_computer_science.json -> build/lib/unitxt/catalog/cards/global_mmlu/pt 2026-01-06T13:30:17,021 copying src/unitxt/catalog/cards/global_mmlu/pt/astronomy.json -> build/lib/unitxt/catalog/cards/global_mmlu/pt 2026-01-06T13:30:17,023 copying src/unitxt/catalog/cards/global_mmlu/pt/high_school_european_history.json -> build/lib/unitxt/catalog/cards/global_mmlu/pt 2026-01-06T13:30:17,025 copying src/unitxt/catalog/cards/global_mmlu/pt/electrical_engineering.json -> build/lib/unitxt/catalog/cards/global_mmlu/pt 2026-01-06T13:30:17,027 copying src/unitxt/catalog/cards/global_mmlu/pt/nutrition.json -> build/lib/unitxt/catalog/cards/global_mmlu/pt 2026-01-06T13:30:17,030 copying src/unitxt/catalog/cards/global_mmlu/pt/abstract_algebra.json -> build/lib/unitxt/catalog/cards/global_mmlu/pt 2026-01-06T13:30:17,032 copying src/unitxt/catalog/cards/global_mmlu/pt/professional_medicine.json -> build/lib/unitxt/catalog/cards/global_mmlu/pt 2026-01-06T13:30:17,034 copying src/unitxt/catalog/cards/global_mmlu/pt/human_sexuality.json -> build/lib/unitxt/catalog/cards/global_mmlu/pt 2026-01-06T13:30:17,036 copying src/unitxt/catalog/cards/global_mmlu/pt/business_ethics.json -> build/lib/unitxt/catalog/cards/global_mmlu/pt 2026-01-06T13:30:17,038 copying src/unitxt/catalog/cards/global_mmlu/pt/high_school_chemistry.json -> build/lib/unitxt/catalog/cards/global_mmlu/pt 2026-01-06T13:30:17,041 copying src/unitxt/catalog/cards/global_mmlu/pt/logical_fallacies.json -> build/lib/unitxt/catalog/cards/global_mmlu/pt 2026-01-06T13:30:17,043 copying src/unitxt/catalog/cards/global_mmlu/pt/formal_logic.json -> build/lib/unitxt/catalog/cards/global_mmlu/pt 2026-01-06T13:30:17,045 copying src/unitxt/catalog/cards/global_mmlu/pt/high_school_psychology.json -> build/lib/unitxt/catalog/cards/global_mmlu/pt 2026-01-06T13:30:17,047 copying src/unitxt/catalog/cards/global_mmlu/pt/medical_genetics.json -> build/lib/unitxt/catalog/cards/global_mmlu/pt 2026-01-06T13:30:17,050 copying src/unitxt/catalog/cards/global_mmlu/pt/security_studies.json -> build/lib/unitxt/catalog/cards/global_mmlu/pt 2026-01-06T13:30:17,052 copying src/unitxt/catalog/cards/global_mmlu/pt/high_school_macroeconomics.json -> build/lib/unitxt/catalog/cards/global_mmlu/pt 2026-01-06T13:30:17,057 copying src/unitxt/catalog/cards/global_mmlu/pt/professional_law.json -> build/lib/unitxt/catalog/cards/global_mmlu/pt 2026-01-06T13:30:17,059 copying src/unitxt/catalog/cards/global_mmlu/pt/high_school_physics.json -> build/lib/unitxt/catalog/cards/global_mmlu/pt 2026-01-06T13:30:17,061 copying src/unitxt/catalog/cards/global_mmlu/pt/econometrics.json -> build/lib/unitxt/catalog/cards/global_mmlu/pt 2026-01-06T13:30:17,064 copying src/unitxt/catalog/cards/global_mmlu/pt/sociology.json -> build/lib/unitxt/catalog/cards/global_mmlu/pt 2026-01-06T13:30:17,066 copying src/unitxt/catalog/cards/global_mmlu/pt/moral_disputes.json -> build/lib/unitxt/catalog/cards/global_mmlu/pt 2026-01-06T13:30:17,068 copying src/unitxt/catalog/cards/global_mmlu/pt/college_chemistry.json -> build/lib/unitxt/catalog/cards/global_mmlu/pt 2026-01-06T13:30:17,071 copying src/unitxt/catalog/cards/global_mmlu/pt/high_school_geography.json -> build/lib/unitxt/catalog/cards/global_mmlu/pt 2026-01-06T13:30:17,073 copying src/unitxt/catalog/cards/global_mmlu/pt/jurisprudence.json -> build/lib/unitxt/catalog/cards/global_mmlu/pt 2026-01-06T13:30:17,075 copying src/unitxt/catalog/cards/global_mmlu/pt/high_school_statistics.json -> build/lib/unitxt/catalog/cards/global_mmlu/pt 2026-01-06T13:30:17,077 copying src/unitxt/catalog/cards/global_mmlu/pt/professional_accounting.json -> build/lib/unitxt/catalog/cards/global_mmlu/pt 2026-01-06T13:30:17,080 copying src/unitxt/catalog/cards/global_mmlu/pt/us_foreign_policy.json -> build/lib/unitxt/catalog/cards/global_mmlu/pt 2026-01-06T13:30:17,082 copying src/unitxt/catalog/cards/global_mmlu/pt/professional_psychology.json -> build/lib/unitxt/catalog/cards/global_mmlu/pt 2026-01-06T13:30:17,084 copying src/unitxt/catalog/cards/global_mmlu/pt/public_relations.json -> build/lib/unitxt/catalog/cards/global_mmlu/pt 2026-01-06T13:30:17,086 copying src/unitxt/catalog/cards/global_mmlu/pt/computer_security.json -> build/lib/unitxt/catalog/cards/global_mmlu/pt 2026-01-06T13:30:17,088 copying src/unitxt/catalog/cards/global_mmlu/pt/philosophy.json -> build/lib/unitxt/catalog/cards/global_mmlu/pt 2026-01-06T13:30:17,090 copying src/unitxt/catalog/cards/global_mmlu/pt/virology.json -> build/lib/unitxt/catalog/cards/global_mmlu/pt 2026-01-06T13:30:17,092 copying src/unitxt/catalog/cards/global_mmlu/pt/marketing.json -> build/lib/unitxt/catalog/cards/global_mmlu/pt 2026-01-06T13:30:17,095 copying src/unitxt/catalog/cards/global_mmlu/pt/high_school_world_history.json -> build/lib/unitxt/catalog/cards/global_mmlu/pt 2026-01-06T13:30:17,097 copying src/unitxt/catalog/cards/global_mmlu/pt/machine_learning.json -> build/lib/unitxt/catalog/cards/global_mmlu/pt 2026-01-06T13:30:17,099 copying src/unitxt/catalog/cards/global_mmlu/pt/high_school_government_and_politics.json -> build/lib/unitxt/catalog/cards/global_mmlu/pt 2026-01-06T13:30:17,101 copying src/unitxt/catalog/cards/global_mmlu/pt/conceptual_physics.json -> build/lib/unitxt/catalog/cards/global_mmlu/pt 2026-01-06T13:30:17,103 copying src/unitxt/catalog/cards/global_mmlu/pt/college_biology.json -> build/lib/unitxt/catalog/cards/global_mmlu/pt 2026-01-06T13:30:17,105 copying src/unitxt/catalog/cards/global_mmlu/pt/high_school_mathematics.json -> build/lib/unitxt/catalog/cards/global_mmlu/pt 2026-01-06T13:30:17,108 creating build/lib/unitxt/catalog/cards/global_mmlu/el 2026-01-06T13:30:17,109 copying src/unitxt/catalog/cards/global_mmlu/el/elementary_mathematics.json -> build/lib/unitxt/catalog/cards/global_mmlu/el 2026-01-06T13:30:17,111 copying src/unitxt/catalog/cards/global_mmlu/el/human_aging.json -> build/lib/unitxt/catalog/cards/global_mmlu/el 2026-01-06T13:30:17,113 copying src/unitxt/catalog/cards/global_mmlu/el/high_school_computer_science.json -> build/lib/unitxt/catalog/cards/global_mmlu/el 2026-01-06T13:30:17,115 copying src/unitxt/catalog/cards/global_mmlu/el/college_physics.json -> build/lib/unitxt/catalog/cards/global_mmlu/el 2026-01-06T13:30:17,118 copying src/unitxt/catalog/cards/global_mmlu/el/college_medicine.json -> build/lib/unitxt/catalog/cards/global_mmlu/el 2026-01-06T13:30:17,121 copying src/unitxt/catalog/cards/global_mmlu/el/college_mathematics.json -> build/lib/unitxt/catalog/cards/global_mmlu/el 2026-01-06T13:30:17,124 copying src/unitxt/catalog/cards/global_mmlu/el/high_school_microeconomics.json -> build/lib/unitxt/catalog/cards/global_mmlu/el 2026-01-06T13:30:17,126 copying src/unitxt/catalog/cards/global_mmlu/el/anatomy.json -> build/lib/unitxt/catalog/cards/global_mmlu/el 2026-01-06T13:30:17,128 copying src/unitxt/catalog/cards/global_mmlu/el/world_religions.json -> build/lib/unitxt/catalog/cards/global_mmlu/el 2026-01-06T13:30:17,131 copying src/unitxt/catalog/cards/global_mmlu/el/management.json -> build/lib/unitxt/catalog/cards/global_mmlu/el 2026-01-06T13:30:17,133 copying src/unitxt/catalog/cards/global_mmlu/el/moral_scenarios.json -> build/lib/unitxt/catalog/cards/global_mmlu/el 2026-01-06T13:30:17,135 copying src/unitxt/catalog/cards/global_mmlu/el/global_facts.json -> build/lib/unitxt/catalog/cards/global_mmlu/el 2026-01-06T13:30:17,138 copying src/unitxt/catalog/cards/global_mmlu/el/miscellaneous.json -> build/lib/unitxt/catalog/cards/global_mmlu/el 2026-01-06T13:30:17,140 copying src/unitxt/catalog/cards/global_mmlu/el/clinical_knowledge.json -> build/lib/unitxt/catalog/cards/global_mmlu/el 2026-01-06T13:30:17,142 copying src/unitxt/catalog/cards/global_mmlu/el/high_school_biology.json -> build/lib/unitxt/catalog/cards/global_mmlu/el 2026-01-06T13:30:17,144 copying src/unitxt/catalog/cards/global_mmlu/el/prehistory.json -> build/lib/unitxt/catalog/cards/global_mmlu/el 2026-01-06T13:30:17,147 copying src/unitxt/catalog/cards/global_mmlu/el/high_school_us_history.json -> build/lib/unitxt/catalog/cards/global_mmlu/el 2026-01-06T13:30:17,149 copying src/unitxt/catalog/cards/global_mmlu/el/international_law.json -> build/lib/unitxt/catalog/cards/global_mmlu/el 2026-01-06T13:30:17,151 copying src/unitxt/catalog/cards/global_mmlu/el/college_computer_science.json -> build/lib/unitxt/catalog/cards/global_mmlu/el 2026-01-06T13:30:17,154 copying src/unitxt/catalog/cards/global_mmlu/el/astronomy.json -> build/lib/unitxt/catalog/cards/global_mmlu/el 2026-01-06T13:30:17,156 copying src/unitxt/catalog/cards/global_mmlu/el/high_school_european_history.json -> build/lib/unitxt/catalog/cards/global_mmlu/el 2026-01-06T13:30:17,158 copying src/unitxt/catalog/cards/global_mmlu/el/electrical_engineering.json -> build/lib/unitxt/catalog/cards/global_mmlu/el 2026-01-06T13:30:17,161 copying src/unitxt/catalog/cards/global_mmlu/el/nutrition.json -> build/lib/unitxt/catalog/cards/global_mmlu/el 2026-01-06T13:30:17,163 copying src/unitxt/catalog/cards/global_mmlu/el/abstract_algebra.json -> build/lib/unitxt/catalog/cards/global_mmlu/el 2026-01-06T13:30:17,165 copying src/unitxt/catalog/cards/global_mmlu/el/professional_medicine.json -> build/lib/unitxt/catalog/cards/global_mmlu/el 2026-01-06T13:30:17,167 copying src/unitxt/catalog/cards/global_mmlu/el/human_sexuality.json -> build/lib/unitxt/catalog/cards/global_mmlu/el 2026-01-06T13:30:17,170 copying src/unitxt/catalog/cards/global_mmlu/el/business_ethics.json -> build/lib/unitxt/catalog/cards/global_mmlu/el 2026-01-06T13:30:17,172 copying src/unitxt/catalog/cards/global_mmlu/el/high_school_chemistry.json -> build/lib/unitxt/catalog/cards/global_mmlu/el 2026-01-06T13:30:17,174 copying src/unitxt/catalog/cards/global_mmlu/el/logical_fallacies.json -> build/lib/unitxt/catalog/cards/global_mmlu/el 2026-01-06T13:30:17,176 copying src/unitxt/catalog/cards/global_mmlu/el/formal_logic.json -> build/lib/unitxt/catalog/cards/global_mmlu/el 2026-01-06T13:30:17,179 copying src/unitxt/catalog/cards/global_mmlu/el/high_school_psychology.json -> build/lib/unitxt/catalog/cards/global_mmlu/el 2026-01-06T13:30:17,181 copying src/unitxt/catalog/cards/global_mmlu/el/medical_genetics.json -> build/lib/unitxt/catalog/cards/global_mmlu/el 2026-01-06T13:30:17,183 copying src/unitxt/catalog/cards/global_mmlu/el/security_studies.json -> build/lib/unitxt/catalog/cards/global_mmlu/el 2026-01-06T13:30:17,186 copying src/unitxt/catalog/cards/global_mmlu/el/high_school_macroeconomics.json -> build/lib/unitxt/catalog/cards/global_mmlu/el 2026-01-06T13:30:17,188 copying src/unitxt/catalog/cards/global_mmlu/el/professional_law.json -> build/lib/unitxt/catalog/cards/global_mmlu/el 2026-01-06T13:30:17,190 copying src/unitxt/catalog/cards/global_mmlu/el/high_school_physics.json -> build/lib/unitxt/catalog/cards/global_mmlu/el 2026-01-06T13:30:17,193 copying src/unitxt/catalog/cards/global_mmlu/el/econometrics.json -> build/lib/unitxt/catalog/cards/global_mmlu/el 2026-01-06T13:30:17,195 copying src/unitxt/catalog/cards/global_mmlu/el/sociology.json -> build/lib/unitxt/catalog/cards/global_mmlu/el 2026-01-06T13:30:17,197 copying src/unitxt/catalog/cards/global_mmlu/el/moral_disputes.json -> build/lib/unitxt/catalog/cards/global_mmlu/el 2026-01-06T13:30:17,200 copying src/unitxt/catalog/cards/global_mmlu/el/college_chemistry.json -> build/lib/unitxt/catalog/cards/global_mmlu/el 2026-01-06T13:30:17,202 copying src/unitxt/catalog/cards/global_mmlu/el/high_school_geography.json -> build/lib/unitxt/catalog/cards/global_mmlu/el 2026-01-06T13:30:17,204 copying src/unitxt/catalog/cards/global_mmlu/el/jurisprudence.json -> build/lib/unitxt/catalog/cards/global_mmlu/el 2026-01-06T13:30:17,206 copying src/unitxt/catalog/cards/global_mmlu/el/high_school_statistics.json -> build/lib/unitxt/catalog/cards/global_mmlu/el 2026-01-06T13:30:17,208 copying src/unitxt/catalog/cards/global_mmlu/el/professional_accounting.json -> build/lib/unitxt/catalog/cards/global_mmlu/el 2026-01-06T13:30:17,211 copying src/unitxt/catalog/cards/global_mmlu/el/us_foreign_policy.json -> build/lib/unitxt/catalog/cards/global_mmlu/el 2026-01-06T13:30:17,214 copying src/unitxt/catalog/cards/global_mmlu/el/professional_psychology.json -> build/lib/unitxt/catalog/cards/global_mmlu/el 2026-01-06T13:30:17,216 copying src/unitxt/catalog/cards/global_mmlu/el/public_relations.json -> build/lib/unitxt/catalog/cards/global_mmlu/el 2026-01-06T13:30:17,218 copying src/unitxt/catalog/cards/global_mmlu/el/computer_security.json -> build/lib/unitxt/catalog/cards/global_mmlu/el 2026-01-06T13:30:17,220 copying src/unitxt/catalog/cards/global_mmlu/el/philosophy.json -> build/lib/unitxt/catalog/cards/global_mmlu/el 2026-01-06T13:30:17,223 copying src/unitxt/catalog/cards/global_mmlu/el/virology.json -> build/lib/unitxt/catalog/cards/global_mmlu/el 2026-01-06T13:30:17,225 copying src/unitxt/catalog/cards/global_mmlu/el/marketing.json -> build/lib/unitxt/catalog/cards/global_mmlu/el 2026-01-06T13:30:17,227 copying src/unitxt/catalog/cards/global_mmlu/el/high_school_world_history.json -> build/lib/unitxt/catalog/cards/global_mmlu/el 2026-01-06T13:30:17,229 copying src/unitxt/catalog/cards/global_mmlu/el/machine_learning.json -> build/lib/unitxt/catalog/cards/global_mmlu/el 2026-01-06T13:30:17,232 copying src/unitxt/catalog/cards/global_mmlu/el/high_school_government_and_politics.json -> build/lib/unitxt/catalog/cards/global_mmlu/el 2026-01-06T13:30:17,234 copying src/unitxt/catalog/cards/global_mmlu/el/conceptual_physics.json -> build/lib/unitxt/catalog/cards/global_mmlu/el 2026-01-06T13:30:17,236 copying src/unitxt/catalog/cards/global_mmlu/el/college_biology.json -> build/lib/unitxt/catalog/cards/global_mmlu/el 2026-01-06T13:30:17,238 copying src/unitxt/catalog/cards/global_mmlu/el/high_school_mathematics.json -> build/lib/unitxt/catalog/cards/global_mmlu/el 2026-01-06T13:30:17,240 creating build/lib/unitxt/catalog/cards/global_mmlu/ko 2026-01-06T13:30:17,241 copying src/unitxt/catalog/cards/global_mmlu/ko/elementary_mathematics.json -> build/lib/unitxt/catalog/cards/global_mmlu/ko 2026-01-06T13:30:17,243 copying src/unitxt/catalog/cards/global_mmlu/ko/human_aging.json -> build/lib/unitxt/catalog/cards/global_mmlu/ko 2026-01-06T13:30:17,245 copying src/unitxt/catalog/cards/global_mmlu/ko/high_school_computer_science.json -> build/lib/unitxt/catalog/cards/global_mmlu/ko 2026-01-06T13:30:17,248 copying src/unitxt/catalog/cards/global_mmlu/ko/college_physics.json -> build/lib/unitxt/catalog/cards/global_mmlu/ko 2026-01-06T13:30:17,250 copying src/unitxt/catalog/cards/global_mmlu/ko/college_medicine.json -> build/lib/unitxt/catalog/cards/global_mmlu/ko 2026-01-06T13:30:17,252 copying src/unitxt/catalog/cards/global_mmlu/ko/college_mathematics.json -> build/lib/unitxt/catalog/cards/global_mmlu/ko 2026-01-06T13:30:17,254 copying src/unitxt/catalog/cards/global_mmlu/ko/high_school_microeconomics.json -> build/lib/unitxt/catalog/cards/global_mmlu/ko 2026-01-06T13:30:17,256 copying src/unitxt/catalog/cards/global_mmlu/ko/anatomy.json -> build/lib/unitxt/catalog/cards/global_mmlu/ko 2026-01-06T13:30:17,259 copying src/unitxt/catalog/cards/global_mmlu/ko/world_religions.json -> build/lib/unitxt/catalog/cards/global_mmlu/ko 2026-01-06T13:30:17,261 copying src/unitxt/catalog/cards/global_mmlu/ko/management.json -> build/lib/unitxt/catalog/cards/global_mmlu/ko 2026-01-06T13:30:17,263 copying src/unitxt/catalog/cards/global_mmlu/ko/moral_scenarios.json -> build/lib/unitxt/catalog/cards/global_mmlu/ko 2026-01-06T13:30:17,266 copying src/unitxt/catalog/cards/global_mmlu/ko/global_facts.json -> build/lib/unitxt/catalog/cards/global_mmlu/ko 2026-01-06T13:30:17,268 copying src/unitxt/catalog/cards/global_mmlu/ko/miscellaneous.json -> build/lib/unitxt/catalog/cards/global_mmlu/ko 2026-01-06T13:30:17,270 copying src/unitxt/catalog/cards/global_mmlu/ko/clinical_knowledge.json -> build/lib/unitxt/catalog/cards/global_mmlu/ko 2026-01-06T13:30:17,272 copying src/unitxt/catalog/cards/global_mmlu/ko/high_school_biology.json -> build/lib/unitxt/catalog/cards/global_mmlu/ko 2026-01-06T13:30:17,275 copying src/unitxt/catalog/cards/global_mmlu/ko/prehistory.json -> build/lib/unitxt/catalog/cards/global_mmlu/ko 2026-01-06T13:30:17,277 copying src/unitxt/catalog/cards/global_mmlu/ko/high_school_us_history.json -> build/lib/unitxt/catalog/cards/global_mmlu/ko 2026-01-06T13:30:17,279 copying src/unitxt/catalog/cards/global_mmlu/ko/international_law.json -> build/lib/unitxt/catalog/cards/global_mmlu/ko 2026-01-06T13:30:17,281 copying src/unitxt/catalog/cards/global_mmlu/ko/college_computer_science.json -> build/lib/unitxt/catalog/cards/global_mmlu/ko 2026-01-06T13:30:17,283 copying src/unitxt/catalog/cards/global_mmlu/ko/astronomy.json -> build/lib/unitxt/catalog/cards/global_mmlu/ko 2026-01-06T13:30:17,285 copying src/unitxt/catalog/cards/global_mmlu/ko/high_school_european_history.json -> build/lib/unitxt/catalog/cards/global_mmlu/ko 2026-01-06T13:30:17,288 copying src/unitxt/catalog/cards/global_mmlu/ko/electrical_engineering.json -> build/lib/unitxt/catalog/cards/global_mmlu/ko 2026-01-06T13:30:17,290 copying src/unitxt/catalog/cards/global_mmlu/ko/nutrition.json -> build/lib/unitxt/catalog/cards/global_mmlu/ko 2026-01-06T13:30:17,292 copying src/unitxt/catalog/cards/global_mmlu/ko/abstract_algebra.json -> build/lib/unitxt/catalog/cards/global_mmlu/ko 2026-01-06T13:30:17,294 copying src/unitxt/catalog/cards/global_mmlu/ko/professional_medicine.json -> build/lib/unitxt/catalog/cards/global_mmlu/ko 2026-01-06T13:30:17,296 copying src/unitxt/catalog/cards/global_mmlu/ko/human_sexuality.json -> build/lib/unitxt/catalog/cards/global_mmlu/ko 2026-01-06T13:30:17,298 copying src/unitxt/catalog/cards/global_mmlu/ko/business_ethics.json -> build/lib/unitxt/catalog/cards/global_mmlu/ko 2026-01-06T13:30:17,300 copying src/unitxt/catalog/cards/global_mmlu/ko/high_school_chemistry.json -> build/lib/unitxt/catalog/cards/global_mmlu/ko 2026-01-06T13:30:17,303 copying src/unitxt/catalog/cards/global_mmlu/ko/logical_fallacies.json -> build/lib/unitxt/catalog/cards/global_mmlu/ko 2026-01-06T13:30:17,305 copying src/unitxt/catalog/cards/global_mmlu/ko/formal_logic.json -> build/lib/unitxt/catalog/cards/global_mmlu/ko 2026-01-06T13:30:17,307 copying src/unitxt/catalog/cards/global_mmlu/ko/high_school_psychology.json -> build/lib/unitxt/catalog/cards/global_mmlu/ko 2026-01-06T13:30:17,309 copying src/unitxt/catalog/cards/global_mmlu/ko/medical_genetics.json -> build/lib/unitxt/catalog/cards/global_mmlu/ko 2026-01-06T13:30:17,311 copying src/unitxt/catalog/cards/global_mmlu/ko/security_studies.json -> build/lib/unitxt/catalog/cards/global_mmlu/ko 2026-01-06T13:30:17,314 copying src/unitxt/catalog/cards/global_mmlu/ko/high_school_macroeconomics.json -> build/lib/unitxt/catalog/cards/global_mmlu/ko 2026-01-06T13:30:17,316 copying src/unitxt/catalog/cards/global_mmlu/ko/professional_law.json -> build/lib/unitxt/catalog/cards/global_mmlu/ko 2026-01-06T13:30:17,318 copying src/unitxt/catalog/cards/global_mmlu/ko/high_school_physics.json -> build/lib/unitxt/catalog/cards/global_mmlu/ko 2026-01-06T13:30:17,320 copying src/unitxt/catalog/cards/global_mmlu/ko/econometrics.json -> build/lib/unitxt/catalog/cards/global_mmlu/ko 2026-01-06T13:30:17,323 copying src/unitxt/catalog/cards/global_mmlu/ko/sociology.json -> build/lib/unitxt/catalog/cards/global_mmlu/ko 2026-01-06T13:30:17,326 copying src/unitxt/catalog/cards/global_mmlu/ko/moral_disputes.json -> build/lib/unitxt/catalog/cards/global_mmlu/ko 2026-01-06T13:30:17,328 copying src/unitxt/catalog/cards/global_mmlu/ko/college_chemistry.json -> build/lib/unitxt/catalog/cards/global_mmlu/ko 2026-01-06T13:30:17,330 copying src/unitxt/catalog/cards/global_mmlu/ko/high_school_geography.json -> build/lib/unitxt/catalog/cards/global_mmlu/ko 2026-01-06T13:30:17,332 copying src/unitxt/catalog/cards/global_mmlu/ko/jurisprudence.json -> build/lib/unitxt/catalog/cards/global_mmlu/ko 2026-01-06T13:30:17,334 copying src/unitxt/catalog/cards/global_mmlu/ko/high_school_statistics.json -> build/lib/unitxt/catalog/cards/global_mmlu/ko 2026-01-06T13:30:17,337 copying src/unitxt/catalog/cards/global_mmlu/ko/professional_accounting.json -> build/lib/unitxt/catalog/cards/global_mmlu/ko 2026-01-06T13:30:17,339 copying src/unitxt/catalog/cards/global_mmlu/ko/us_foreign_policy.json -> build/lib/unitxt/catalog/cards/global_mmlu/ko 2026-01-06T13:30:17,341 copying src/unitxt/catalog/cards/global_mmlu/ko/professional_psychology.json -> build/lib/unitxt/catalog/cards/global_mmlu/ko 2026-01-06T13:30:17,343 copying src/unitxt/catalog/cards/global_mmlu/ko/public_relations.json -> build/lib/unitxt/catalog/cards/global_mmlu/ko 2026-01-06T13:30:17,345 copying src/unitxt/catalog/cards/global_mmlu/ko/computer_security.json -> build/lib/unitxt/catalog/cards/global_mmlu/ko 2026-01-06T13:30:17,347 copying src/unitxt/catalog/cards/global_mmlu/ko/philosophy.json -> build/lib/unitxt/catalog/cards/global_mmlu/ko 2026-01-06T13:30:17,350 copying src/unitxt/catalog/cards/global_mmlu/ko/virology.json -> build/lib/unitxt/catalog/cards/global_mmlu/ko 2026-01-06T13:30:17,352 copying src/unitxt/catalog/cards/global_mmlu/ko/marketing.json -> build/lib/unitxt/catalog/cards/global_mmlu/ko 2026-01-06T13:30:17,354 copying src/unitxt/catalog/cards/global_mmlu/ko/high_school_world_history.json -> build/lib/unitxt/catalog/cards/global_mmlu/ko 2026-01-06T13:30:17,356 copying src/unitxt/catalog/cards/global_mmlu/ko/machine_learning.json -> build/lib/unitxt/catalog/cards/global_mmlu/ko 2026-01-06T13:30:17,358 copying src/unitxt/catalog/cards/global_mmlu/ko/high_school_government_and_politics.json -> build/lib/unitxt/catalog/cards/global_mmlu/ko 2026-01-06T13:30:17,360 copying src/unitxt/catalog/cards/global_mmlu/ko/conceptual_physics.json -> build/lib/unitxt/catalog/cards/global_mmlu/ko 2026-01-06T13:30:17,362 copying src/unitxt/catalog/cards/global_mmlu/ko/college_biology.json -> build/lib/unitxt/catalog/cards/global_mmlu/ko 2026-01-06T13:30:17,364 copying src/unitxt/catalog/cards/global_mmlu/ko/high_school_mathematics.json -> build/lib/unitxt/catalog/cards/global_mmlu/ko 2026-01-06T13:30:17,367 creating build/lib/unitxt/catalog/cards/global_mmlu/ne 2026-01-06T13:30:17,368 copying src/unitxt/catalog/cards/global_mmlu/ne/elementary_mathematics.json -> build/lib/unitxt/catalog/cards/global_mmlu/ne 2026-01-06T13:30:17,370 copying src/unitxt/catalog/cards/global_mmlu/ne/human_aging.json -> build/lib/unitxt/catalog/cards/global_mmlu/ne 2026-01-06T13:30:17,372 copying src/unitxt/catalog/cards/global_mmlu/ne/high_school_computer_science.json -> build/lib/unitxt/catalog/cards/global_mmlu/ne 2026-01-06T13:30:17,374 copying src/unitxt/catalog/cards/global_mmlu/ne/college_physics.json -> build/lib/unitxt/catalog/cards/global_mmlu/ne 2026-01-06T13:30:17,377 copying src/unitxt/catalog/cards/global_mmlu/ne/college_medicine.json -> build/lib/unitxt/catalog/cards/global_mmlu/ne 2026-01-06T13:30:17,379 copying src/unitxt/catalog/cards/global_mmlu/ne/college_mathematics.json -> build/lib/unitxt/catalog/cards/global_mmlu/ne 2026-01-06T13:30:17,381 copying src/unitxt/catalog/cards/global_mmlu/ne/high_school_microeconomics.json -> build/lib/unitxt/catalog/cards/global_mmlu/ne 2026-01-06T13:30:17,383 copying src/unitxt/catalog/cards/global_mmlu/ne/anatomy.json -> build/lib/unitxt/catalog/cards/global_mmlu/ne 2026-01-06T13:30:17,386 copying src/unitxt/catalog/cards/global_mmlu/ne/world_religions.json -> build/lib/unitxt/catalog/cards/global_mmlu/ne 2026-01-06T13:30:17,388 copying src/unitxt/catalog/cards/global_mmlu/ne/management.json -> build/lib/unitxt/catalog/cards/global_mmlu/ne 2026-01-06T13:30:17,390 copying src/unitxt/catalog/cards/global_mmlu/ne/moral_scenarios.json -> build/lib/unitxt/catalog/cards/global_mmlu/ne 2026-01-06T13:30:17,392 copying src/unitxt/catalog/cards/global_mmlu/ne/global_facts.json -> build/lib/unitxt/catalog/cards/global_mmlu/ne 2026-01-06T13:30:17,394 copying src/unitxt/catalog/cards/global_mmlu/ne/miscellaneous.json -> build/lib/unitxt/catalog/cards/global_mmlu/ne 2026-01-06T13:30:17,397 copying src/unitxt/catalog/cards/global_mmlu/ne/clinical_knowledge.json -> build/lib/unitxt/catalog/cards/global_mmlu/ne 2026-01-06T13:30:17,399 copying src/unitxt/catalog/cards/global_mmlu/ne/high_school_biology.json -> build/lib/unitxt/catalog/cards/global_mmlu/ne 2026-01-06T13:30:17,401 copying src/unitxt/catalog/cards/global_mmlu/ne/prehistory.json -> build/lib/unitxt/catalog/cards/global_mmlu/ne 2026-01-06T13:30:17,403 copying src/unitxt/catalog/cards/global_mmlu/ne/high_school_us_history.json -> build/lib/unitxt/catalog/cards/global_mmlu/ne 2026-01-06T13:30:17,405 copying src/unitxt/catalog/cards/global_mmlu/ne/international_law.json -> build/lib/unitxt/catalog/cards/global_mmlu/ne 2026-01-06T13:30:17,407 copying src/unitxt/catalog/cards/global_mmlu/ne/college_computer_science.json -> build/lib/unitxt/catalog/cards/global_mmlu/ne 2026-01-06T13:30:17,409 copying src/unitxt/catalog/cards/global_mmlu/ne/astronomy.json -> build/lib/unitxt/catalog/cards/global_mmlu/ne 2026-01-06T13:30:17,411 copying src/unitxt/catalog/cards/global_mmlu/ne/high_school_european_history.json -> build/lib/unitxt/catalog/cards/global_mmlu/ne 2026-01-06T13:30:17,414 copying src/unitxt/catalog/cards/global_mmlu/ne/electrical_engineering.json -> build/lib/unitxt/catalog/cards/global_mmlu/ne 2026-01-06T13:30:17,416 copying src/unitxt/catalog/cards/global_mmlu/ne/nutrition.json -> build/lib/unitxt/catalog/cards/global_mmlu/ne 2026-01-06T13:30:17,418 copying src/unitxt/catalog/cards/global_mmlu/ne/abstract_algebra.json -> build/lib/unitxt/catalog/cards/global_mmlu/ne 2026-01-06T13:30:17,420 copying src/unitxt/catalog/cards/global_mmlu/ne/professional_medicine.json -> build/lib/unitxt/catalog/cards/global_mmlu/ne 2026-01-06T13:30:17,422 copying src/unitxt/catalog/cards/global_mmlu/ne/human_sexuality.json -> build/lib/unitxt/catalog/cards/global_mmlu/ne 2026-01-06T13:30:17,424 copying src/unitxt/catalog/cards/global_mmlu/ne/business_ethics.json -> build/lib/unitxt/catalog/cards/global_mmlu/ne 2026-01-06T13:30:17,426 copying src/unitxt/catalog/cards/global_mmlu/ne/high_school_chemistry.json -> build/lib/unitxt/catalog/cards/global_mmlu/ne 2026-01-06T13:30:17,429 copying src/unitxt/catalog/cards/global_mmlu/ne/logical_fallacies.json -> build/lib/unitxt/catalog/cards/global_mmlu/ne 2026-01-06T13:30:17,431 copying src/unitxt/catalog/cards/global_mmlu/ne/formal_logic.json -> build/lib/unitxt/catalog/cards/global_mmlu/ne 2026-01-06T13:30:17,433 copying src/unitxt/catalog/cards/global_mmlu/ne/high_school_psychology.json -> build/lib/unitxt/catalog/cards/global_mmlu/ne 2026-01-06T13:30:17,435 copying src/unitxt/catalog/cards/global_mmlu/ne/medical_genetics.json -> build/lib/unitxt/catalog/cards/global_mmlu/ne 2026-01-06T13:30:17,438 copying src/unitxt/catalog/cards/global_mmlu/ne/security_studies.json -> build/lib/unitxt/catalog/cards/global_mmlu/ne 2026-01-06T13:30:17,440 copying src/unitxt/catalog/cards/global_mmlu/ne/high_school_macroeconomics.json -> build/lib/unitxt/catalog/cards/global_mmlu/ne 2026-01-06T13:30:17,442 copying src/unitxt/catalog/cards/global_mmlu/ne/professional_law.json -> build/lib/unitxt/catalog/cards/global_mmlu/ne 2026-01-06T13:30:17,444 copying src/unitxt/catalog/cards/global_mmlu/ne/high_school_physics.json -> build/lib/unitxt/catalog/cards/global_mmlu/ne 2026-01-06T13:30:17,446 copying src/unitxt/catalog/cards/global_mmlu/ne/econometrics.json -> build/lib/unitxt/catalog/cards/global_mmlu/ne 2026-01-06T13:30:17,449 copying src/unitxt/catalog/cards/global_mmlu/ne/sociology.json -> build/lib/unitxt/catalog/cards/global_mmlu/ne 2026-01-06T13:30:17,451 copying src/unitxt/catalog/cards/global_mmlu/ne/moral_disputes.json -> build/lib/unitxt/catalog/cards/global_mmlu/ne 2026-01-06T13:30:17,453 copying src/unitxt/catalog/cards/global_mmlu/ne/college_chemistry.json -> build/lib/unitxt/catalog/cards/global_mmlu/ne 2026-01-06T13:30:17,455 copying src/unitxt/catalog/cards/global_mmlu/ne/high_school_geography.json -> build/lib/unitxt/catalog/cards/global_mmlu/ne 2026-01-06T13:30:17,457 copying src/unitxt/catalog/cards/global_mmlu/ne/jurisprudence.json -> build/lib/unitxt/catalog/cards/global_mmlu/ne 2026-01-06T13:30:17,459 copying src/unitxt/catalog/cards/global_mmlu/ne/high_school_statistics.json -> build/lib/unitxt/catalog/cards/global_mmlu/ne 2026-01-06T13:30:17,462 copying src/unitxt/catalog/cards/global_mmlu/ne/professional_accounting.json -> build/lib/unitxt/catalog/cards/global_mmlu/ne 2026-01-06T13:30:17,464 copying src/unitxt/catalog/cards/global_mmlu/ne/us_foreign_policy.json -> build/lib/unitxt/catalog/cards/global_mmlu/ne 2026-01-06T13:30:17,466 copying src/unitxt/catalog/cards/global_mmlu/ne/professional_psychology.json -> build/lib/unitxt/catalog/cards/global_mmlu/ne 2026-01-06T13:30:17,468 copying src/unitxt/catalog/cards/global_mmlu/ne/public_relations.json -> build/lib/unitxt/catalog/cards/global_mmlu/ne 2026-01-06T13:30:17,470 copying src/unitxt/catalog/cards/global_mmlu/ne/computer_security.json -> build/lib/unitxt/catalog/cards/global_mmlu/ne 2026-01-06T13:30:17,472 copying src/unitxt/catalog/cards/global_mmlu/ne/philosophy.json -> build/lib/unitxt/catalog/cards/global_mmlu/ne 2026-01-06T13:30:17,474 copying src/unitxt/catalog/cards/global_mmlu/ne/virology.json -> build/lib/unitxt/catalog/cards/global_mmlu/ne 2026-01-06T13:30:17,476 copying src/unitxt/catalog/cards/global_mmlu/ne/marketing.json -> build/lib/unitxt/catalog/cards/global_mmlu/ne 2026-01-06T13:30:17,478 copying src/unitxt/catalog/cards/global_mmlu/ne/high_school_world_history.json -> build/lib/unitxt/catalog/cards/global_mmlu/ne 2026-01-06T13:30:17,481 copying src/unitxt/catalog/cards/global_mmlu/ne/machine_learning.json -> build/lib/unitxt/catalog/cards/global_mmlu/ne 2026-01-06T13:30:17,483 copying src/unitxt/catalog/cards/global_mmlu/ne/high_school_government_and_politics.json -> build/lib/unitxt/catalog/cards/global_mmlu/ne 2026-01-06T13:30:17,485 copying src/unitxt/catalog/cards/global_mmlu/ne/conceptual_physics.json -> build/lib/unitxt/catalog/cards/global_mmlu/ne 2026-01-06T13:30:17,487 copying src/unitxt/catalog/cards/global_mmlu/ne/college_biology.json -> build/lib/unitxt/catalog/cards/global_mmlu/ne 2026-01-06T13:30:17,489 copying src/unitxt/catalog/cards/global_mmlu/ne/high_school_mathematics.json -> build/lib/unitxt/catalog/cards/global_mmlu/ne 2026-01-06T13:30:17,491 creating build/lib/unitxt/catalog/cards/global_mmlu/it 2026-01-06T13:30:17,492 copying src/unitxt/catalog/cards/global_mmlu/it/elementary_mathematics.json -> build/lib/unitxt/catalog/cards/global_mmlu/it 2026-01-06T13:30:17,495 copying src/unitxt/catalog/cards/global_mmlu/it/human_aging.json -> build/lib/unitxt/catalog/cards/global_mmlu/it 2026-01-06T13:30:17,497 copying src/unitxt/catalog/cards/global_mmlu/it/high_school_computer_science.json -> build/lib/unitxt/catalog/cards/global_mmlu/it 2026-01-06T13:30:17,499 copying src/unitxt/catalog/cards/global_mmlu/it/college_physics.json -> build/lib/unitxt/catalog/cards/global_mmlu/it 2026-01-06T13:30:17,501 copying src/unitxt/catalog/cards/global_mmlu/it/college_medicine.json -> build/lib/unitxt/catalog/cards/global_mmlu/it 2026-01-06T13:30:17,504 copying src/unitxt/catalog/cards/global_mmlu/it/college_mathematics.json -> build/lib/unitxt/catalog/cards/global_mmlu/it 2026-01-06T13:30:17,506 copying src/unitxt/catalog/cards/global_mmlu/it/high_school_microeconomics.json -> build/lib/unitxt/catalog/cards/global_mmlu/it 2026-01-06T13:30:17,508 copying src/unitxt/catalog/cards/global_mmlu/it/anatomy.json -> build/lib/unitxt/catalog/cards/global_mmlu/it 2026-01-06T13:30:17,510 copying src/unitxt/catalog/cards/global_mmlu/it/world_religions.json -> build/lib/unitxt/catalog/cards/global_mmlu/it 2026-01-06T13:30:17,512 copying src/unitxt/catalog/cards/global_mmlu/it/management.json -> build/lib/unitxt/catalog/cards/global_mmlu/it 2026-01-06T13:30:17,515 copying src/unitxt/catalog/cards/global_mmlu/it/moral_scenarios.json -> build/lib/unitxt/catalog/cards/global_mmlu/it 2026-01-06T13:30:17,517 copying src/unitxt/catalog/cards/global_mmlu/it/global_facts.json -> build/lib/unitxt/catalog/cards/global_mmlu/it 2026-01-06T13:30:17,519 copying src/unitxt/catalog/cards/global_mmlu/it/miscellaneous.json -> build/lib/unitxt/catalog/cards/global_mmlu/it 2026-01-06T13:30:17,521 copying src/unitxt/catalog/cards/global_mmlu/it/clinical_knowledge.json -> build/lib/unitxt/catalog/cards/global_mmlu/it 2026-01-06T13:30:17,523 copying src/unitxt/catalog/cards/global_mmlu/it/high_school_biology.json -> build/lib/unitxt/catalog/cards/global_mmlu/it 2026-01-06T13:30:17,525 copying src/unitxt/catalog/cards/global_mmlu/it/prehistory.json -> build/lib/unitxt/catalog/cards/global_mmlu/it 2026-01-06T13:30:17,528 copying src/unitxt/catalog/cards/global_mmlu/it/high_school_us_history.json -> build/lib/unitxt/catalog/cards/global_mmlu/it 2026-01-06T13:30:17,530 copying src/unitxt/catalog/cards/global_mmlu/it/international_law.json -> build/lib/unitxt/catalog/cards/global_mmlu/it 2026-01-06T13:30:17,532 copying src/unitxt/catalog/cards/global_mmlu/it/college_computer_science.json -> build/lib/unitxt/catalog/cards/global_mmlu/it 2026-01-06T13:30:17,534 copying src/unitxt/catalog/cards/global_mmlu/it/astronomy.json -> build/lib/unitxt/catalog/cards/global_mmlu/it 2026-01-06T13:30:17,536 copying src/unitxt/catalog/cards/global_mmlu/it/high_school_european_history.json -> build/lib/unitxt/catalog/cards/global_mmlu/it 2026-01-06T13:30:17,538 copying src/unitxt/catalog/cards/global_mmlu/it/electrical_engineering.json -> build/lib/unitxt/catalog/cards/global_mmlu/it 2026-01-06T13:30:17,541 copying src/unitxt/catalog/cards/global_mmlu/it/nutrition.json -> build/lib/unitxt/catalog/cards/global_mmlu/it 2026-01-06T13:30:17,543 copying src/unitxt/catalog/cards/global_mmlu/it/abstract_algebra.json -> build/lib/unitxt/catalog/cards/global_mmlu/it 2026-01-06T13:30:17,545 copying src/unitxt/catalog/cards/global_mmlu/it/professional_medicine.json -> build/lib/unitxt/catalog/cards/global_mmlu/it 2026-01-06T13:30:17,547 copying src/unitxt/catalog/cards/global_mmlu/it/human_sexuality.json -> build/lib/unitxt/catalog/cards/global_mmlu/it 2026-01-06T13:30:17,549 copying src/unitxt/catalog/cards/global_mmlu/it/business_ethics.json -> build/lib/unitxt/catalog/cards/global_mmlu/it 2026-01-06T13:30:17,552 copying src/unitxt/catalog/cards/global_mmlu/it/high_school_chemistry.json -> build/lib/unitxt/catalog/cards/global_mmlu/it 2026-01-06T13:30:17,554 copying src/unitxt/catalog/cards/global_mmlu/it/logical_fallacies.json -> build/lib/unitxt/catalog/cards/global_mmlu/it 2026-01-06T13:30:17,556 copying src/unitxt/catalog/cards/global_mmlu/it/formal_logic.json -> build/lib/unitxt/catalog/cards/global_mmlu/it 2026-01-06T13:30:17,558 copying src/unitxt/catalog/cards/global_mmlu/it/high_school_psychology.json -> build/lib/unitxt/catalog/cards/global_mmlu/it 2026-01-06T13:30:17,561 copying src/unitxt/catalog/cards/global_mmlu/it/medical_genetics.json -> build/lib/unitxt/catalog/cards/global_mmlu/it 2026-01-06T13:30:17,563 copying src/unitxt/catalog/cards/global_mmlu/it/security_studies.json -> build/lib/unitxt/catalog/cards/global_mmlu/it 2026-01-06T13:30:17,565 copying src/unitxt/catalog/cards/global_mmlu/it/high_school_macroeconomics.json -> build/lib/unitxt/catalog/cards/global_mmlu/it 2026-01-06T13:30:17,567 copying src/unitxt/catalog/cards/global_mmlu/it/professional_law.json -> build/lib/unitxt/catalog/cards/global_mmlu/it 2026-01-06T13:30:17,570 copying src/unitxt/catalog/cards/global_mmlu/it/high_school_physics.json -> build/lib/unitxt/catalog/cards/global_mmlu/it 2026-01-06T13:30:17,572 copying src/unitxt/catalog/cards/global_mmlu/it/econometrics.json -> build/lib/unitxt/catalog/cards/global_mmlu/it 2026-01-06T13:30:17,574 copying src/unitxt/catalog/cards/global_mmlu/it/sociology.json -> build/lib/unitxt/catalog/cards/global_mmlu/it 2026-01-06T13:30:17,576 copying src/unitxt/catalog/cards/global_mmlu/it/moral_disputes.json -> build/lib/unitxt/catalog/cards/global_mmlu/it 2026-01-06T13:30:17,578 copying src/unitxt/catalog/cards/global_mmlu/it/college_chemistry.json -> build/lib/unitxt/catalog/cards/global_mmlu/it 2026-01-06T13:30:17,581 copying src/unitxt/catalog/cards/global_mmlu/it/high_school_geography.json -> build/lib/unitxt/catalog/cards/global_mmlu/it 2026-01-06T13:30:17,583 copying src/unitxt/catalog/cards/global_mmlu/it/jurisprudence.json -> build/lib/unitxt/catalog/cards/global_mmlu/it 2026-01-06T13:30:17,585 copying src/unitxt/catalog/cards/global_mmlu/it/high_school_statistics.json -> build/lib/unitxt/catalog/cards/global_mmlu/it 2026-01-06T13:30:17,587 copying src/unitxt/catalog/cards/global_mmlu/it/professional_accounting.json -> build/lib/unitxt/catalog/cards/global_mmlu/it 2026-01-06T13:30:17,589 copying src/unitxt/catalog/cards/global_mmlu/it/us_foreign_policy.json -> build/lib/unitxt/catalog/cards/global_mmlu/it 2026-01-06T13:30:17,591 copying src/unitxt/catalog/cards/global_mmlu/it/professional_psychology.json -> build/lib/unitxt/catalog/cards/global_mmlu/it 2026-01-06T13:30:17,593 copying src/unitxt/catalog/cards/global_mmlu/it/public_relations.json -> build/lib/unitxt/catalog/cards/global_mmlu/it 2026-01-06T13:30:17,595 copying src/unitxt/catalog/cards/global_mmlu/it/computer_security.json -> build/lib/unitxt/catalog/cards/global_mmlu/it 2026-01-06T13:30:17,597 copying src/unitxt/catalog/cards/global_mmlu/it/philosophy.json -> build/lib/unitxt/catalog/cards/global_mmlu/it 2026-01-06T13:30:17,600 copying src/unitxt/catalog/cards/global_mmlu/it/virology.json -> build/lib/unitxt/catalog/cards/global_mmlu/it 2026-01-06T13:30:17,602 copying src/unitxt/catalog/cards/global_mmlu/it/marketing.json -> build/lib/unitxt/catalog/cards/global_mmlu/it 2026-01-06T13:30:17,605 copying src/unitxt/catalog/cards/global_mmlu/it/high_school_world_history.json -> build/lib/unitxt/catalog/cards/global_mmlu/it 2026-01-06T13:30:17,607 copying src/unitxt/catalog/cards/global_mmlu/it/machine_learning.json -> build/lib/unitxt/catalog/cards/global_mmlu/it 2026-01-06T13:30:17,609 copying src/unitxt/catalog/cards/global_mmlu/it/high_school_government_and_politics.json -> build/lib/unitxt/catalog/cards/global_mmlu/it 2026-01-06T13:30:17,611 copying src/unitxt/catalog/cards/global_mmlu/it/conceptual_physics.json -> build/lib/unitxt/catalog/cards/global_mmlu/it 2026-01-06T13:30:17,614 copying src/unitxt/catalog/cards/global_mmlu/it/college_biology.json -> build/lib/unitxt/catalog/cards/global_mmlu/it 2026-01-06T13:30:17,616 copying src/unitxt/catalog/cards/global_mmlu/it/high_school_mathematics.json -> build/lib/unitxt/catalog/cards/global_mmlu/it 2026-01-06T13:30:17,618 creating build/lib/unitxt/catalog/cards/global_mmlu/sv 2026-01-06T13:30:17,619 copying src/unitxt/catalog/cards/global_mmlu/sv/elementary_mathematics.json -> build/lib/unitxt/catalog/cards/global_mmlu/sv 2026-01-06T13:30:17,621 copying src/unitxt/catalog/cards/global_mmlu/sv/human_aging.json -> build/lib/unitxt/catalog/cards/global_mmlu/sv 2026-01-06T13:30:17,623 copying src/unitxt/catalog/cards/global_mmlu/sv/high_school_computer_science.json -> build/lib/unitxt/catalog/cards/global_mmlu/sv 2026-01-06T13:30:17,626 copying src/unitxt/catalog/cards/global_mmlu/sv/college_physics.json -> build/lib/unitxt/catalog/cards/global_mmlu/sv 2026-01-06T13:30:17,628 copying src/unitxt/catalog/cards/global_mmlu/sv/college_medicine.json -> build/lib/unitxt/catalog/cards/global_mmlu/sv 2026-01-06T13:30:17,630 copying src/unitxt/catalog/cards/global_mmlu/sv/college_mathematics.json -> build/lib/unitxt/catalog/cards/global_mmlu/sv 2026-01-06T13:30:17,632 copying src/unitxt/catalog/cards/global_mmlu/sv/high_school_microeconomics.json -> build/lib/unitxt/catalog/cards/global_mmlu/sv 2026-01-06T13:30:17,635 copying src/unitxt/catalog/cards/global_mmlu/sv/anatomy.json -> build/lib/unitxt/catalog/cards/global_mmlu/sv 2026-01-06T13:30:17,637 copying src/unitxt/catalog/cards/global_mmlu/sv/world_religions.json -> build/lib/unitxt/catalog/cards/global_mmlu/sv 2026-01-06T13:30:17,639 copying src/unitxt/catalog/cards/global_mmlu/sv/management.json -> build/lib/unitxt/catalog/cards/global_mmlu/sv 2026-01-06T13:30:17,642 copying src/unitxt/catalog/cards/global_mmlu/sv/moral_scenarios.json -> build/lib/unitxt/catalog/cards/global_mmlu/sv 2026-01-06T13:30:17,644 copying src/unitxt/catalog/cards/global_mmlu/sv/global_facts.json -> build/lib/unitxt/catalog/cards/global_mmlu/sv 2026-01-06T13:30:17,646 copying src/unitxt/catalog/cards/global_mmlu/sv/miscellaneous.json -> build/lib/unitxt/catalog/cards/global_mmlu/sv 2026-01-06T13:30:17,648 copying src/unitxt/catalog/cards/global_mmlu/sv/clinical_knowledge.json -> build/lib/unitxt/catalog/cards/global_mmlu/sv 2026-01-06T13:30:17,651 copying src/unitxt/catalog/cards/global_mmlu/sv/high_school_biology.json -> build/lib/unitxt/catalog/cards/global_mmlu/sv 2026-01-06T13:30:17,653 copying src/unitxt/catalog/cards/global_mmlu/sv/prehistory.json -> build/lib/unitxt/catalog/cards/global_mmlu/sv 2026-01-06T13:30:17,655 copying src/unitxt/catalog/cards/global_mmlu/sv/high_school_us_history.json -> build/lib/unitxt/catalog/cards/global_mmlu/sv 2026-01-06T13:30:17,657 copying src/unitxt/catalog/cards/global_mmlu/sv/international_law.json -> build/lib/unitxt/catalog/cards/global_mmlu/sv 2026-01-06T13:30:17,659 copying src/unitxt/catalog/cards/global_mmlu/sv/college_computer_science.json -> build/lib/unitxt/catalog/cards/global_mmlu/sv 2026-01-06T13:30:17,661 copying src/unitxt/catalog/cards/global_mmlu/sv/astronomy.json -> build/lib/unitxt/catalog/cards/global_mmlu/sv 2026-01-06T13:30:17,663 copying src/unitxt/catalog/cards/global_mmlu/sv/high_school_european_history.json -> build/lib/unitxt/catalog/cards/global_mmlu/sv 2026-01-06T13:30:17,665 copying src/unitxt/catalog/cards/global_mmlu/sv/electrical_engineering.json -> build/lib/unitxt/catalog/cards/global_mmlu/sv 2026-01-06T13:30:17,667 copying src/unitxt/catalog/cards/global_mmlu/sv/nutrition.json -> build/lib/unitxt/catalog/cards/global_mmlu/sv 2026-01-06T13:30:17,670 copying src/unitxt/catalog/cards/global_mmlu/sv/abstract_algebra.json -> build/lib/unitxt/catalog/cards/global_mmlu/sv 2026-01-06T13:30:17,672 copying src/unitxt/catalog/cards/global_mmlu/sv/professional_medicine.json -> build/lib/unitxt/catalog/cards/global_mmlu/sv 2026-01-06T13:30:17,674 copying src/unitxt/catalog/cards/global_mmlu/sv/human_sexuality.json -> build/lib/unitxt/catalog/cards/global_mmlu/sv 2026-01-06T13:30:17,676 copying src/unitxt/catalog/cards/global_mmlu/sv/business_ethics.json -> build/lib/unitxt/catalog/cards/global_mmlu/sv 2026-01-06T13:30:17,679 copying src/unitxt/catalog/cards/global_mmlu/sv/high_school_chemistry.json -> build/lib/unitxt/catalog/cards/global_mmlu/sv 2026-01-06T13:30:17,681 copying src/unitxt/catalog/cards/global_mmlu/sv/logical_fallacies.json -> build/lib/unitxt/catalog/cards/global_mmlu/sv 2026-01-06T13:30:17,683 copying src/unitxt/catalog/cards/global_mmlu/sv/formal_logic.json -> build/lib/unitxt/catalog/cards/global_mmlu/sv 2026-01-06T13:30:17,685 copying src/unitxt/catalog/cards/global_mmlu/sv/high_school_psychology.json -> build/lib/unitxt/catalog/cards/global_mmlu/sv 2026-01-06T13:30:17,687 copying src/unitxt/catalog/cards/global_mmlu/sv/medical_genetics.json -> build/lib/unitxt/catalog/cards/global_mmlu/sv 2026-01-06T13:30:17,690 copying src/unitxt/catalog/cards/global_mmlu/sv/security_studies.json -> build/lib/unitxt/catalog/cards/global_mmlu/sv 2026-01-06T13:30:17,692 copying src/unitxt/catalog/cards/global_mmlu/sv/high_school_macroeconomics.json -> build/lib/unitxt/catalog/cards/global_mmlu/sv 2026-01-06T13:30:17,694 copying src/unitxt/catalog/cards/global_mmlu/sv/professional_law.json -> build/lib/unitxt/catalog/cards/global_mmlu/sv 2026-01-06T13:30:17,696 copying src/unitxt/catalog/cards/global_mmlu/sv/high_school_physics.json -> build/lib/unitxt/catalog/cards/global_mmlu/sv 2026-01-06T13:30:17,698 copying src/unitxt/catalog/cards/global_mmlu/sv/econometrics.json -> build/lib/unitxt/catalog/cards/global_mmlu/sv 2026-01-06T13:30:17,701 copying src/unitxt/catalog/cards/global_mmlu/sv/sociology.json -> build/lib/unitxt/catalog/cards/global_mmlu/sv 2026-01-06T13:30:17,703 copying src/unitxt/catalog/cards/global_mmlu/sv/moral_disputes.json -> build/lib/unitxt/catalog/cards/global_mmlu/sv 2026-01-06T13:30:17,705 copying src/unitxt/catalog/cards/global_mmlu/sv/college_chemistry.json -> build/lib/unitxt/catalog/cards/global_mmlu/sv 2026-01-06T13:30:17,707 copying src/unitxt/catalog/cards/global_mmlu/sv/high_school_geography.json -> build/lib/unitxt/catalog/cards/global_mmlu/sv 2026-01-06T13:30:17,709 copying src/unitxt/catalog/cards/global_mmlu/sv/jurisprudence.json -> build/lib/unitxt/catalog/cards/global_mmlu/sv 2026-01-06T13:30:17,711 copying src/unitxt/catalog/cards/global_mmlu/sv/high_school_statistics.json -> build/lib/unitxt/catalog/cards/global_mmlu/sv 2026-01-06T13:30:17,713 copying src/unitxt/catalog/cards/global_mmlu/sv/professional_accounting.json -> build/lib/unitxt/catalog/cards/global_mmlu/sv 2026-01-06T13:30:17,715 copying src/unitxt/catalog/cards/global_mmlu/sv/us_foreign_policy.json -> build/lib/unitxt/catalog/cards/global_mmlu/sv 2026-01-06T13:30:17,718 copying src/unitxt/catalog/cards/global_mmlu/sv/professional_psychology.json -> build/lib/unitxt/catalog/cards/global_mmlu/sv 2026-01-06T13:30:17,720 copying src/unitxt/catalog/cards/global_mmlu/sv/public_relations.json -> build/lib/unitxt/catalog/cards/global_mmlu/sv 2026-01-06T13:30:17,722 copying src/unitxt/catalog/cards/global_mmlu/sv/computer_security.json -> build/lib/unitxt/catalog/cards/global_mmlu/sv 2026-01-06T13:30:17,724 copying src/unitxt/catalog/cards/global_mmlu/sv/philosophy.json -> build/lib/unitxt/catalog/cards/global_mmlu/sv 2026-01-06T13:30:17,726 copying src/unitxt/catalog/cards/global_mmlu/sv/virology.json -> build/lib/unitxt/catalog/cards/global_mmlu/sv 2026-01-06T13:30:17,729 copying src/unitxt/catalog/cards/global_mmlu/sv/marketing.json -> build/lib/unitxt/catalog/cards/global_mmlu/sv 2026-01-06T13:30:17,731 copying src/unitxt/catalog/cards/global_mmlu/sv/high_school_world_history.json -> build/lib/unitxt/catalog/cards/global_mmlu/sv 2026-01-06T13:30:17,733 copying src/unitxt/catalog/cards/global_mmlu/sv/machine_learning.json -> build/lib/unitxt/catalog/cards/global_mmlu/sv 2026-01-06T13:30:17,735 copying src/unitxt/catalog/cards/global_mmlu/sv/high_school_government_and_politics.json -> build/lib/unitxt/catalog/cards/global_mmlu/sv 2026-01-06T13:30:17,738 copying src/unitxt/catalog/cards/global_mmlu/sv/conceptual_physics.json -> build/lib/unitxt/catalog/cards/global_mmlu/sv 2026-01-06T13:30:17,740 copying src/unitxt/catalog/cards/global_mmlu/sv/college_biology.json -> build/lib/unitxt/catalog/cards/global_mmlu/sv 2026-01-06T13:30:17,742 copying src/unitxt/catalog/cards/global_mmlu/sv/high_school_mathematics.json -> build/lib/unitxt/catalog/cards/global_mmlu/sv 2026-01-06T13:30:17,744 creating build/lib/unitxt/catalog/cards/global_mmlu/id 2026-01-06T13:30:17,745 copying src/unitxt/catalog/cards/global_mmlu/id/elementary_mathematics.json -> build/lib/unitxt/catalog/cards/global_mmlu/id 2026-01-06T13:30:17,748 copying src/unitxt/catalog/cards/global_mmlu/id/human_aging.json -> build/lib/unitxt/catalog/cards/global_mmlu/id 2026-01-06T13:30:17,750 copying src/unitxt/catalog/cards/global_mmlu/id/high_school_computer_science.json -> build/lib/unitxt/catalog/cards/global_mmlu/id 2026-01-06T13:30:17,752 copying src/unitxt/catalog/cards/global_mmlu/id/college_physics.json -> build/lib/unitxt/catalog/cards/global_mmlu/id 2026-01-06T13:30:17,754 copying src/unitxt/catalog/cards/global_mmlu/id/college_medicine.json -> build/lib/unitxt/catalog/cards/global_mmlu/id 2026-01-06T13:30:17,757 copying src/unitxt/catalog/cards/global_mmlu/id/college_mathematics.json -> build/lib/unitxt/catalog/cards/global_mmlu/id 2026-01-06T13:30:17,759 copying src/unitxt/catalog/cards/global_mmlu/id/high_school_microeconomics.json -> build/lib/unitxt/catalog/cards/global_mmlu/id 2026-01-06T13:30:17,761 copying src/unitxt/catalog/cards/global_mmlu/id/anatomy.json -> build/lib/unitxt/catalog/cards/global_mmlu/id 2026-01-06T13:30:17,763 copying src/unitxt/catalog/cards/global_mmlu/id/world_religions.json -> build/lib/unitxt/catalog/cards/global_mmlu/id 2026-01-06T13:30:17,766 copying src/unitxt/catalog/cards/global_mmlu/id/management.json -> build/lib/unitxt/catalog/cards/global_mmlu/id 2026-01-06T13:30:17,768 copying src/unitxt/catalog/cards/global_mmlu/id/moral_scenarios.json -> build/lib/unitxt/catalog/cards/global_mmlu/id 2026-01-06T13:30:17,770 copying src/unitxt/catalog/cards/global_mmlu/id/global_facts.json -> build/lib/unitxt/catalog/cards/global_mmlu/id 2026-01-06T13:30:17,772 copying src/unitxt/catalog/cards/global_mmlu/id/miscellaneous.json -> build/lib/unitxt/catalog/cards/global_mmlu/id 2026-01-06T13:30:17,774 copying src/unitxt/catalog/cards/global_mmlu/id/clinical_knowledge.json -> build/lib/unitxt/catalog/cards/global_mmlu/id 2026-01-06T13:30:17,776 copying src/unitxt/catalog/cards/global_mmlu/id/high_school_biology.json -> build/lib/unitxt/catalog/cards/global_mmlu/id 2026-01-06T13:30:17,778 copying src/unitxt/catalog/cards/global_mmlu/id/prehistory.json -> build/lib/unitxt/catalog/cards/global_mmlu/id 2026-01-06T13:30:17,780 copying src/unitxt/catalog/cards/global_mmlu/id/high_school_us_history.json -> build/lib/unitxt/catalog/cards/global_mmlu/id 2026-01-06T13:30:17,783 copying src/unitxt/catalog/cards/global_mmlu/id/international_law.json -> build/lib/unitxt/catalog/cards/global_mmlu/id 2026-01-06T13:30:17,785 copying src/unitxt/catalog/cards/global_mmlu/id/college_computer_science.json -> build/lib/unitxt/catalog/cards/global_mmlu/id 2026-01-06T13:30:17,787 copying src/unitxt/catalog/cards/global_mmlu/id/astronomy.json -> build/lib/unitxt/catalog/cards/global_mmlu/id 2026-01-06T13:30:17,789 copying src/unitxt/catalog/cards/global_mmlu/id/high_school_european_history.json -> build/lib/unitxt/catalog/cards/global_mmlu/id 2026-01-06T13:30:17,791 copying src/unitxt/catalog/cards/global_mmlu/id/electrical_engineering.json -> build/lib/unitxt/catalog/cards/global_mmlu/id 2026-01-06T13:30:17,794 copying src/unitxt/catalog/cards/global_mmlu/id/nutrition.json -> build/lib/unitxt/catalog/cards/global_mmlu/id 2026-01-06T13:30:17,796 copying src/unitxt/catalog/cards/global_mmlu/id/abstract_algebra.json -> build/lib/unitxt/catalog/cards/global_mmlu/id 2026-01-06T13:30:17,798 copying src/unitxt/catalog/cards/global_mmlu/id/professional_medicine.json -> build/lib/unitxt/catalog/cards/global_mmlu/id 2026-01-06T13:30:17,800 copying src/unitxt/catalog/cards/global_mmlu/id/human_sexuality.json -> build/lib/unitxt/catalog/cards/global_mmlu/id 2026-01-06T13:30:17,802 copying src/unitxt/catalog/cards/global_mmlu/id/business_ethics.json -> build/lib/unitxt/catalog/cards/global_mmlu/id 2026-01-06T13:30:17,805 copying src/unitxt/catalog/cards/global_mmlu/id/high_school_chemistry.json -> build/lib/unitxt/catalog/cards/global_mmlu/id 2026-01-06T13:30:17,807 copying src/unitxt/catalog/cards/global_mmlu/id/logical_fallacies.json -> build/lib/unitxt/catalog/cards/global_mmlu/id 2026-01-06T13:30:17,809 copying src/unitxt/catalog/cards/global_mmlu/id/formal_logic.json -> build/lib/unitxt/catalog/cards/global_mmlu/id 2026-01-06T13:30:17,811 copying src/unitxt/catalog/cards/global_mmlu/id/high_school_psychology.json -> build/lib/unitxt/catalog/cards/global_mmlu/id 2026-01-06T13:30:17,813 copying src/unitxt/catalog/cards/global_mmlu/id/medical_genetics.json -> build/lib/unitxt/catalog/cards/global_mmlu/id 2026-01-06T13:30:17,816 copying src/unitxt/catalog/cards/global_mmlu/id/security_studies.json -> build/lib/unitxt/catalog/cards/global_mmlu/id 2026-01-06T13:30:17,818 copying src/unitxt/catalog/cards/global_mmlu/id/high_school_macroeconomics.json -> build/lib/unitxt/catalog/cards/global_mmlu/id 2026-01-06T13:30:17,820 copying src/unitxt/catalog/cards/global_mmlu/id/professional_law.json -> build/lib/unitxt/catalog/cards/global_mmlu/id 2026-01-06T13:30:17,822 copying src/unitxt/catalog/cards/global_mmlu/id/high_school_physics.json -> build/lib/unitxt/catalog/cards/global_mmlu/id 2026-01-06T13:30:17,824 copying src/unitxt/catalog/cards/global_mmlu/id/econometrics.json -> build/lib/unitxt/catalog/cards/global_mmlu/id 2026-01-06T13:30:17,827 copying src/unitxt/catalog/cards/global_mmlu/id/sociology.json -> build/lib/unitxt/catalog/cards/global_mmlu/id 2026-01-06T13:30:17,829 copying src/unitxt/catalog/cards/global_mmlu/id/moral_disputes.json -> build/lib/unitxt/catalog/cards/global_mmlu/id 2026-01-06T13:30:17,831 copying src/unitxt/catalog/cards/global_mmlu/id/college_chemistry.json -> build/lib/unitxt/catalog/cards/global_mmlu/id 2026-01-06T13:30:17,833 copying src/unitxt/catalog/cards/global_mmlu/id/high_school_geography.json -> build/lib/unitxt/catalog/cards/global_mmlu/id 2026-01-06T13:30:17,835 copying src/unitxt/catalog/cards/global_mmlu/id/jurisprudence.json -> build/lib/unitxt/catalog/cards/global_mmlu/id 2026-01-06T13:30:17,837 copying src/unitxt/catalog/cards/global_mmlu/id/high_school_statistics.json -> build/lib/unitxt/catalog/cards/global_mmlu/id 2026-01-06T13:30:17,839 copying src/unitxt/catalog/cards/global_mmlu/id/professional_accounting.json -> build/lib/unitxt/catalog/cards/global_mmlu/id 2026-01-06T13:30:17,842 copying src/unitxt/catalog/cards/global_mmlu/id/us_foreign_policy.json -> build/lib/unitxt/catalog/cards/global_mmlu/id 2026-01-06T13:30:17,844 copying src/unitxt/catalog/cards/global_mmlu/id/professional_psychology.json -> build/lib/unitxt/catalog/cards/global_mmlu/id 2026-01-06T13:30:17,846 copying src/unitxt/catalog/cards/global_mmlu/id/public_relations.json -> build/lib/unitxt/catalog/cards/global_mmlu/id 2026-01-06T13:30:17,848 copying src/unitxt/catalog/cards/global_mmlu/id/computer_security.json -> build/lib/unitxt/catalog/cards/global_mmlu/id 2026-01-06T13:30:17,850 copying src/unitxt/catalog/cards/global_mmlu/id/philosophy.json -> build/lib/unitxt/catalog/cards/global_mmlu/id 2026-01-06T13:30:17,852 copying src/unitxt/catalog/cards/global_mmlu/id/virology.json -> build/lib/unitxt/catalog/cards/global_mmlu/id 2026-01-06T13:30:17,855 copying src/unitxt/catalog/cards/global_mmlu/id/marketing.json -> build/lib/unitxt/catalog/cards/global_mmlu/id 2026-01-06T13:30:17,857 copying src/unitxt/catalog/cards/global_mmlu/id/high_school_world_history.json -> build/lib/unitxt/catalog/cards/global_mmlu/id 2026-01-06T13:30:17,859 copying src/unitxt/catalog/cards/global_mmlu/id/machine_learning.json -> build/lib/unitxt/catalog/cards/global_mmlu/id 2026-01-06T13:30:17,861 copying src/unitxt/catalog/cards/global_mmlu/id/high_school_government_and_politics.json -> build/lib/unitxt/catalog/cards/global_mmlu/id 2026-01-06T13:30:17,863 copying src/unitxt/catalog/cards/global_mmlu/id/conceptual_physics.json -> build/lib/unitxt/catalog/cards/global_mmlu/id 2026-01-06T13:30:17,866 copying src/unitxt/catalog/cards/global_mmlu/id/college_biology.json -> build/lib/unitxt/catalog/cards/global_mmlu/id 2026-01-06T13:30:17,868 copying src/unitxt/catalog/cards/global_mmlu/id/high_school_mathematics.json -> build/lib/unitxt/catalog/cards/global_mmlu/id 2026-01-06T13:30:17,870 creating build/lib/unitxt/catalog/cards/global_mmlu/tr 2026-01-06T13:30:17,871 copying src/unitxt/catalog/cards/global_mmlu/tr/elementary_mathematics.json -> build/lib/unitxt/catalog/cards/global_mmlu/tr 2026-01-06T13:30:17,873 copying src/unitxt/catalog/cards/global_mmlu/tr/human_aging.json -> build/lib/unitxt/catalog/cards/global_mmlu/tr 2026-01-06T13:30:17,876 copying src/unitxt/catalog/cards/global_mmlu/tr/high_school_computer_science.json -> build/lib/unitxt/catalog/cards/global_mmlu/tr 2026-01-06T13:30:17,878 copying src/unitxt/catalog/cards/global_mmlu/tr/college_physics.json -> build/lib/unitxt/catalog/cards/global_mmlu/tr 2026-01-06T13:30:17,880 copying src/unitxt/catalog/cards/global_mmlu/tr/college_medicine.json -> build/lib/unitxt/catalog/cards/global_mmlu/tr 2026-01-06T13:30:17,882 copying src/unitxt/catalog/cards/global_mmlu/tr/college_mathematics.json -> build/lib/unitxt/catalog/cards/global_mmlu/tr 2026-01-06T13:30:17,885 copying src/unitxt/catalog/cards/global_mmlu/tr/high_school_microeconomics.json -> build/lib/unitxt/catalog/cards/global_mmlu/tr 2026-01-06T13:30:17,887 copying src/unitxt/catalog/cards/global_mmlu/tr/anatomy.json -> build/lib/unitxt/catalog/cards/global_mmlu/tr 2026-01-06T13:30:17,889 copying src/unitxt/catalog/cards/global_mmlu/tr/world_religions.json -> build/lib/unitxt/catalog/cards/global_mmlu/tr 2026-01-06T13:30:17,891 copying src/unitxt/catalog/cards/global_mmlu/tr/management.json -> build/lib/unitxt/catalog/cards/global_mmlu/tr 2026-01-06T13:30:17,893 copying src/unitxt/catalog/cards/global_mmlu/tr/moral_scenarios.json -> build/lib/unitxt/catalog/cards/global_mmlu/tr 2026-01-06T13:30:17,895 copying src/unitxt/catalog/cards/global_mmlu/tr/global_facts.json -> build/lib/unitxt/catalog/cards/global_mmlu/tr 2026-01-06T13:30:17,897 copying src/unitxt/catalog/cards/global_mmlu/tr/miscellaneous.json -> build/lib/unitxt/catalog/cards/global_mmlu/tr 2026-01-06T13:30:17,900 copying src/unitxt/catalog/cards/global_mmlu/tr/clinical_knowledge.json -> build/lib/unitxt/catalog/cards/global_mmlu/tr 2026-01-06T13:30:17,902 copying src/unitxt/catalog/cards/global_mmlu/tr/high_school_biology.json -> build/lib/unitxt/catalog/cards/global_mmlu/tr 2026-01-06T13:30:17,904 copying src/unitxt/catalog/cards/global_mmlu/tr/prehistory.json -> build/lib/unitxt/catalog/cards/global_mmlu/tr 2026-01-06T13:30:17,906 copying src/unitxt/catalog/cards/global_mmlu/tr/high_school_us_history.json -> build/lib/unitxt/catalog/cards/global_mmlu/tr 2026-01-06T13:30:17,908 copying src/unitxt/catalog/cards/global_mmlu/tr/international_law.json -> build/lib/unitxt/catalog/cards/global_mmlu/tr 2026-01-06T13:30:17,911 copying src/unitxt/catalog/cards/global_mmlu/tr/college_computer_science.json -> build/lib/unitxt/catalog/cards/global_mmlu/tr 2026-01-06T13:30:17,913 copying src/unitxt/catalog/cards/global_mmlu/tr/astronomy.json -> build/lib/unitxt/catalog/cards/global_mmlu/tr 2026-01-06T13:30:17,916 copying src/unitxt/catalog/cards/global_mmlu/tr/high_school_european_history.json -> build/lib/unitxt/catalog/cards/global_mmlu/tr 2026-01-06T13:30:17,918 copying src/unitxt/catalog/cards/global_mmlu/tr/electrical_engineering.json -> build/lib/unitxt/catalog/cards/global_mmlu/tr 2026-01-06T13:30:17,920 copying src/unitxt/catalog/cards/global_mmlu/tr/nutrition.json -> build/lib/unitxt/catalog/cards/global_mmlu/tr 2026-01-06T13:30:17,923 copying src/unitxt/catalog/cards/global_mmlu/tr/abstract_algebra.json -> build/lib/unitxt/catalog/cards/global_mmlu/tr 2026-01-06T13:30:17,925 copying src/unitxt/catalog/cards/global_mmlu/tr/professional_medicine.json -> build/lib/unitxt/catalog/cards/global_mmlu/tr 2026-01-06T13:30:17,927 copying src/unitxt/catalog/cards/global_mmlu/tr/human_sexuality.json -> build/lib/unitxt/catalog/cards/global_mmlu/tr 2026-01-06T13:30:17,929 copying src/unitxt/catalog/cards/global_mmlu/tr/business_ethics.json -> build/lib/unitxt/catalog/cards/global_mmlu/tr 2026-01-06T13:30:17,932 copying src/unitxt/catalog/cards/global_mmlu/tr/high_school_chemistry.json -> build/lib/unitxt/catalog/cards/global_mmlu/tr 2026-01-06T13:30:17,934 copying src/unitxt/catalog/cards/global_mmlu/tr/logical_fallacies.json -> build/lib/unitxt/catalog/cards/global_mmlu/tr 2026-01-06T13:30:17,936 copying src/unitxt/catalog/cards/global_mmlu/tr/formal_logic.json -> build/lib/unitxt/catalog/cards/global_mmlu/tr 2026-01-06T13:30:17,938 copying src/unitxt/catalog/cards/global_mmlu/tr/high_school_psychology.json -> build/lib/unitxt/catalog/cards/global_mmlu/tr 2026-01-06T13:30:17,941 copying src/unitxt/catalog/cards/global_mmlu/tr/medical_genetics.json -> build/lib/unitxt/catalog/cards/global_mmlu/tr 2026-01-06T13:30:17,943 copying src/unitxt/catalog/cards/global_mmlu/tr/security_studies.json -> build/lib/unitxt/catalog/cards/global_mmlu/tr 2026-01-06T13:30:17,945 copying src/unitxt/catalog/cards/global_mmlu/tr/high_school_macroeconomics.json -> build/lib/unitxt/catalog/cards/global_mmlu/tr 2026-01-06T13:30:17,947 copying src/unitxt/catalog/cards/global_mmlu/tr/professional_law.json -> build/lib/unitxt/catalog/cards/global_mmlu/tr 2026-01-06T13:30:17,950 copying src/unitxt/catalog/cards/global_mmlu/tr/high_school_physics.json -> build/lib/unitxt/catalog/cards/global_mmlu/tr 2026-01-06T13:30:17,952 copying src/unitxt/catalog/cards/global_mmlu/tr/econometrics.json -> build/lib/unitxt/catalog/cards/global_mmlu/tr 2026-01-06T13:30:17,954 copying src/unitxt/catalog/cards/global_mmlu/tr/sociology.json -> build/lib/unitxt/catalog/cards/global_mmlu/tr 2026-01-06T13:30:17,956 copying src/unitxt/catalog/cards/global_mmlu/tr/moral_disputes.json -> build/lib/unitxt/catalog/cards/global_mmlu/tr 2026-01-06T13:30:17,958 copying src/unitxt/catalog/cards/global_mmlu/tr/college_chemistry.json -> build/lib/unitxt/catalog/cards/global_mmlu/tr 2026-01-06T13:30:17,960 copying src/unitxt/catalog/cards/global_mmlu/tr/high_school_geography.json -> build/lib/unitxt/catalog/cards/global_mmlu/tr 2026-01-06T13:30:17,962 copying src/unitxt/catalog/cards/global_mmlu/tr/jurisprudence.json -> build/lib/unitxt/catalog/cards/global_mmlu/tr 2026-01-06T13:30:17,964 copying src/unitxt/catalog/cards/global_mmlu/tr/high_school_statistics.json -> build/lib/unitxt/catalog/cards/global_mmlu/tr 2026-01-06T13:30:17,967 copying src/unitxt/catalog/cards/global_mmlu/tr/professional_accounting.json -> build/lib/unitxt/catalog/cards/global_mmlu/tr 2026-01-06T13:30:17,969 copying src/unitxt/catalog/cards/global_mmlu/tr/us_foreign_policy.json -> build/lib/unitxt/catalog/cards/global_mmlu/tr 2026-01-06T13:30:17,971 copying src/unitxt/catalog/cards/global_mmlu/tr/professional_psychology.json -> build/lib/unitxt/catalog/cards/global_mmlu/tr 2026-01-06T13:30:17,973 copying src/unitxt/catalog/cards/global_mmlu/tr/public_relations.json -> build/lib/unitxt/catalog/cards/global_mmlu/tr 2026-01-06T13:30:17,976 copying src/unitxt/catalog/cards/global_mmlu/tr/computer_security.json -> build/lib/unitxt/catalog/cards/global_mmlu/tr 2026-01-06T13:30:17,978 copying src/unitxt/catalog/cards/global_mmlu/tr/philosophy.json -> build/lib/unitxt/catalog/cards/global_mmlu/tr 2026-01-06T13:30:17,980 copying src/unitxt/catalog/cards/global_mmlu/tr/virology.json -> build/lib/unitxt/catalog/cards/global_mmlu/tr 2026-01-06T13:30:17,983 copying src/unitxt/catalog/cards/global_mmlu/tr/marketing.json -> build/lib/unitxt/catalog/cards/global_mmlu/tr 2026-01-06T13:30:17,985 copying src/unitxt/catalog/cards/global_mmlu/tr/high_school_world_history.json -> build/lib/unitxt/catalog/cards/global_mmlu/tr 2026-01-06T13:30:17,987 copying src/unitxt/catalog/cards/global_mmlu/tr/machine_learning.json -> build/lib/unitxt/catalog/cards/global_mmlu/tr 2026-01-06T13:30:17,989 copying src/unitxt/catalog/cards/global_mmlu/tr/high_school_government_and_politics.json -> build/lib/unitxt/catalog/cards/global_mmlu/tr 2026-01-06T13:30:17,992 copying src/unitxt/catalog/cards/global_mmlu/tr/conceptual_physics.json -> build/lib/unitxt/catalog/cards/global_mmlu/tr 2026-01-06T13:30:17,994 copying src/unitxt/catalog/cards/global_mmlu/tr/college_biology.json -> build/lib/unitxt/catalog/cards/global_mmlu/tr 2026-01-06T13:30:17,996 copying src/unitxt/catalog/cards/global_mmlu/tr/high_school_mathematics.json -> build/lib/unitxt/catalog/cards/global_mmlu/tr 2026-01-06T13:30:17,998 creating build/lib/unitxt/catalog/cards/global_mmlu/nl 2026-01-06T13:30:17,999 copying src/unitxt/catalog/cards/global_mmlu/nl/elementary_mathematics.json -> build/lib/unitxt/catalog/cards/global_mmlu/nl 2026-01-06T13:30:18,001 copying src/unitxt/catalog/cards/global_mmlu/nl/human_aging.json -> build/lib/unitxt/catalog/cards/global_mmlu/nl 2026-01-06T13:30:18,004 copying src/unitxt/catalog/cards/global_mmlu/nl/high_school_computer_science.json -> build/lib/unitxt/catalog/cards/global_mmlu/nl 2026-01-06T13:30:18,006 copying src/unitxt/catalog/cards/global_mmlu/nl/college_physics.json -> build/lib/unitxt/catalog/cards/global_mmlu/nl 2026-01-06T13:30:18,008 copying src/unitxt/catalog/cards/global_mmlu/nl/college_medicine.json -> build/lib/unitxt/catalog/cards/global_mmlu/nl 2026-01-06T13:30:18,010 copying src/unitxt/catalog/cards/global_mmlu/nl/college_mathematics.json -> build/lib/unitxt/catalog/cards/global_mmlu/nl 2026-01-06T13:30:18,013 copying src/unitxt/catalog/cards/global_mmlu/nl/high_school_microeconomics.json -> build/lib/unitxt/catalog/cards/global_mmlu/nl 2026-01-06T13:30:18,015 copying src/unitxt/catalog/cards/global_mmlu/nl/anatomy.json -> build/lib/unitxt/catalog/cards/global_mmlu/nl 2026-01-06T13:30:18,017 copying src/unitxt/catalog/cards/global_mmlu/nl/world_religions.json -> build/lib/unitxt/catalog/cards/global_mmlu/nl 2026-01-06T13:30:18,019 copying src/unitxt/catalog/cards/global_mmlu/nl/management.json -> build/lib/unitxt/catalog/cards/global_mmlu/nl 2026-01-06T13:30:18,021 copying src/unitxt/catalog/cards/global_mmlu/nl/moral_scenarios.json -> build/lib/unitxt/catalog/cards/global_mmlu/nl 2026-01-06T13:30:18,023 copying src/unitxt/catalog/cards/global_mmlu/nl/global_facts.json -> build/lib/unitxt/catalog/cards/global_mmlu/nl 2026-01-06T13:30:18,025 copying src/unitxt/catalog/cards/global_mmlu/nl/miscellaneous.json -> build/lib/unitxt/catalog/cards/global_mmlu/nl 2026-01-06T13:30:18,027 copying src/unitxt/catalog/cards/global_mmlu/nl/clinical_knowledge.json -> build/lib/unitxt/catalog/cards/global_mmlu/nl 2026-01-06T13:30:18,030 copying src/unitxt/catalog/cards/global_mmlu/nl/high_school_biology.json -> build/lib/unitxt/catalog/cards/global_mmlu/nl 2026-01-06T13:30:18,032 copying src/unitxt/catalog/cards/global_mmlu/nl/prehistory.json -> build/lib/unitxt/catalog/cards/global_mmlu/nl 2026-01-06T13:30:18,034 copying src/unitxt/catalog/cards/global_mmlu/nl/high_school_us_history.json -> build/lib/unitxt/catalog/cards/global_mmlu/nl 2026-01-06T13:30:18,036 copying src/unitxt/catalog/cards/global_mmlu/nl/international_law.json -> build/lib/unitxt/catalog/cards/global_mmlu/nl 2026-01-06T13:30:18,038 copying src/unitxt/catalog/cards/global_mmlu/nl/college_computer_science.json -> build/lib/unitxt/catalog/cards/global_mmlu/nl 2026-01-06T13:30:18,040 copying src/unitxt/catalog/cards/global_mmlu/nl/astronomy.json -> build/lib/unitxt/catalog/cards/global_mmlu/nl 2026-01-06T13:30:18,043 copying src/unitxt/catalog/cards/global_mmlu/nl/high_school_european_history.json -> build/lib/unitxt/catalog/cards/global_mmlu/nl 2026-01-06T13:30:18,045 copying src/unitxt/catalog/cards/global_mmlu/nl/electrical_engineering.json -> build/lib/unitxt/catalog/cards/global_mmlu/nl 2026-01-06T13:30:18,048 copying src/unitxt/catalog/cards/global_mmlu/nl/nutrition.json -> build/lib/unitxt/catalog/cards/global_mmlu/nl 2026-01-06T13:30:18,050 copying src/unitxt/catalog/cards/global_mmlu/nl/abstract_algebra.json -> build/lib/unitxt/catalog/cards/global_mmlu/nl 2026-01-06T13:30:18,052 copying src/unitxt/catalog/cards/global_mmlu/nl/professional_medicine.json -> build/lib/unitxt/catalog/cards/global_mmlu/nl 2026-01-06T13:30:18,055 copying src/unitxt/catalog/cards/global_mmlu/nl/human_sexuality.json -> build/lib/unitxt/catalog/cards/global_mmlu/nl 2026-01-06T13:30:18,057 copying src/unitxt/catalog/cards/global_mmlu/nl/business_ethics.json -> build/lib/unitxt/catalog/cards/global_mmlu/nl 2026-01-06T13:30:18,060 copying src/unitxt/catalog/cards/global_mmlu/nl/high_school_chemistry.json -> build/lib/unitxt/catalog/cards/global_mmlu/nl 2026-01-06T13:30:18,062 copying src/unitxt/catalog/cards/global_mmlu/nl/logical_fallacies.json -> build/lib/unitxt/catalog/cards/global_mmlu/nl 2026-01-06T13:30:18,064 copying src/unitxt/catalog/cards/global_mmlu/nl/formal_logic.json -> build/lib/unitxt/catalog/cards/global_mmlu/nl 2026-01-06T13:30:18,066 copying src/unitxt/catalog/cards/global_mmlu/nl/high_school_psychology.json -> build/lib/unitxt/catalog/cards/global_mmlu/nl 2026-01-06T13:30:18,069 copying src/unitxt/catalog/cards/global_mmlu/nl/medical_genetics.json -> build/lib/unitxt/catalog/cards/global_mmlu/nl 2026-01-06T13:30:18,071 copying src/unitxt/catalog/cards/global_mmlu/nl/security_studies.json -> build/lib/unitxt/catalog/cards/global_mmlu/nl 2026-01-06T13:30:18,073 copying src/unitxt/catalog/cards/global_mmlu/nl/high_school_macroeconomics.json -> build/lib/unitxt/catalog/cards/global_mmlu/nl 2026-01-06T13:30:18,076 copying src/unitxt/catalog/cards/global_mmlu/nl/professional_law.json -> build/lib/unitxt/catalog/cards/global_mmlu/nl 2026-01-06T13:30:18,078 copying src/unitxt/catalog/cards/global_mmlu/nl/high_school_physics.json -> build/lib/unitxt/catalog/cards/global_mmlu/nl 2026-01-06T13:30:18,081 copying src/unitxt/catalog/cards/global_mmlu/nl/econometrics.json -> build/lib/unitxt/catalog/cards/global_mmlu/nl 2026-01-06T13:30:18,084 copying src/unitxt/catalog/cards/global_mmlu/nl/sociology.json -> build/lib/unitxt/catalog/cards/global_mmlu/nl 2026-01-06T13:30:18,086 copying src/unitxt/catalog/cards/global_mmlu/nl/moral_disputes.json -> build/lib/unitxt/catalog/cards/global_mmlu/nl 2026-01-06T13:30:18,089 copying src/unitxt/catalog/cards/global_mmlu/nl/college_chemistry.json -> build/lib/unitxt/catalog/cards/global_mmlu/nl 2026-01-06T13:30:18,091 copying src/unitxt/catalog/cards/global_mmlu/nl/high_school_geography.json -> build/lib/unitxt/catalog/cards/global_mmlu/nl 2026-01-06T13:30:18,093 copying src/unitxt/catalog/cards/global_mmlu/nl/jurisprudence.json -> build/lib/unitxt/catalog/cards/global_mmlu/nl 2026-01-06T13:30:18,096 copying src/unitxt/catalog/cards/global_mmlu/nl/high_school_statistics.json -> build/lib/unitxt/catalog/cards/global_mmlu/nl 2026-01-06T13:30:18,098 copying src/unitxt/catalog/cards/global_mmlu/nl/professional_accounting.json -> build/lib/unitxt/catalog/cards/global_mmlu/nl 2026-01-06T13:30:18,100 copying src/unitxt/catalog/cards/global_mmlu/nl/us_foreign_policy.json -> build/lib/unitxt/catalog/cards/global_mmlu/nl 2026-01-06T13:30:18,102 copying src/unitxt/catalog/cards/global_mmlu/nl/professional_psychology.json -> build/lib/unitxt/catalog/cards/global_mmlu/nl 2026-01-06T13:30:18,104 copying src/unitxt/catalog/cards/global_mmlu/nl/public_relations.json -> build/lib/unitxt/catalog/cards/global_mmlu/nl 2026-01-06T13:30:18,107 copying src/unitxt/catalog/cards/global_mmlu/nl/computer_security.json -> build/lib/unitxt/catalog/cards/global_mmlu/nl 2026-01-06T13:30:18,109 copying src/unitxt/catalog/cards/global_mmlu/nl/philosophy.json -> build/lib/unitxt/catalog/cards/global_mmlu/nl 2026-01-06T13:30:18,111 copying src/unitxt/catalog/cards/global_mmlu/nl/virology.json -> build/lib/unitxt/catalog/cards/global_mmlu/nl 2026-01-06T13:30:18,113 copying src/unitxt/catalog/cards/global_mmlu/nl/marketing.json -> build/lib/unitxt/catalog/cards/global_mmlu/nl 2026-01-06T13:30:18,115 copying src/unitxt/catalog/cards/global_mmlu/nl/high_school_world_history.json -> build/lib/unitxt/catalog/cards/global_mmlu/nl 2026-01-06T13:30:18,117 copying src/unitxt/catalog/cards/global_mmlu/nl/machine_learning.json -> build/lib/unitxt/catalog/cards/global_mmlu/nl 2026-01-06T13:30:18,120 copying src/unitxt/catalog/cards/global_mmlu/nl/high_school_government_and_politics.json -> build/lib/unitxt/catalog/cards/global_mmlu/nl 2026-01-06T13:30:18,122 copying src/unitxt/catalog/cards/global_mmlu/nl/conceptual_physics.json -> build/lib/unitxt/catalog/cards/global_mmlu/nl 2026-01-06T13:30:18,124 copying src/unitxt/catalog/cards/global_mmlu/nl/college_biology.json -> build/lib/unitxt/catalog/cards/global_mmlu/nl 2026-01-06T13:30:18,126 copying src/unitxt/catalog/cards/global_mmlu/nl/high_school_mathematics.json -> build/lib/unitxt/catalog/cards/global_mmlu/nl 2026-01-06T13:30:18,128 creating build/lib/unitxt/catalog/cards/global_mmlu/bn 2026-01-06T13:30:18,129 copying src/unitxt/catalog/cards/global_mmlu/bn/elementary_mathematics.json -> build/lib/unitxt/catalog/cards/global_mmlu/bn 2026-01-06T13:30:18,132 copying src/unitxt/catalog/cards/global_mmlu/bn/human_aging.json -> build/lib/unitxt/catalog/cards/global_mmlu/bn 2026-01-06T13:30:18,134 copying src/unitxt/catalog/cards/global_mmlu/bn/high_school_computer_science.json -> build/lib/unitxt/catalog/cards/global_mmlu/bn 2026-01-06T13:30:18,137 copying src/unitxt/catalog/cards/global_mmlu/bn/college_physics.json -> build/lib/unitxt/catalog/cards/global_mmlu/bn 2026-01-06T13:30:18,139 copying src/unitxt/catalog/cards/global_mmlu/bn/college_medicine.json -> build/lib/unitxt/catalog/cards/global_mmlu/bn 2026-01-06T13:30:18,141 copying src/unitxt/catalog/cards/global_mmlu/bn/college_mathematics.json -> build/lib/unitxt/catalog/cards/global_mmlu/bn 2026-01-06T13:30:18,143 copying src/unitxt/catalog/cards/global_mmlu/bn/high_school_microeconomics.json -> build/lib/unitxt/catalog/cards/global_mmlu/bn 2026-01-06T13:30:18,145 copying src/unitxt/catalog/cards/global_mmlu/bn/anatomy.json -> build/lib/unitxt/catalog/cards/global_mmlu/bn 2026-01-06T13:30:18,147 copying src/unitxt/catalog/cards/global_mmlu/bn/world_religions.json -> build/lib/unitxt/catalog/cards/global_mmlu/bn 2026-01-06T13:30:18,149 copying src/unitxt/catalog/cards/global_mmlu/bn/management.json -> build/lib/unitxt/catalog/cards/global_mmlu/bn 2026-01-06T13:30:18,151 copying src/unitxt/catalog/cards/global_mmlu/bn/moral_scenarios.json -> build/lib/unitxt/catalog/cards/global_mmlu/bn 2026-01-06T13:30:18,154 copying src/unitxt/catalog/cards/global_mmlu/bn/global_facts.json -> build/lib/unitxt/catalog/cards/global_mmlu/bn 2026-01-06T13:30:18,156 copying src/unitxt/catalog/cards/global_mmlu/bn/miscellaneous.json -> build/lib/unitxt/catalog/cards/global_mmlu/bn 2026-01-06T13:30:18,158 copying src/unitxt/catalog/cards/global_mmlu/bn/clinical_knowledge.json -> build/lib/unitxt/catalog/cards/global_mmlu/bn 2026-01-06T13:30:18,160 copying src/unitxt/catalog/cards/global_mmlu/bn/high_school_biology.json -> build/lib/unitxt/catalog/cards/global_mmlu/bn 2026-01-06T13:30:18,162 copying src/unitxt/catalog/cards/global_mmlu/bn/prehistory.json -> build/lib/unitxt/catalog/cards/global_mmlu/bn 2026-01-06T13:30:18,164 copying src/unitxt/catalog/cards/global_mmlu/bn/high_school_us_history.json -> build/lib/unitxt/catalog/cards/global_mmlu/bn 2026-01-06T13:30:18,167 copying src/unitxt/catalog/cards/global_mmlu/bn/international_law.json -> build/lib/unitxt/catalog/cards/global_mmlu/bn 2026-01-06T13:30:18,169 copying src/unitxt/catalog/cards/global_mmlu/bn/college_computer_science.json -> build/lib/unitxt/catalog/cards/global_mmlu/bn 2026-01-06T13:30:18,171 copying src/unitxt/catalog/cards/global_mmlu/bn/astronomy.json -> build/lib/unitxt/catalog/cards/global_mmlu/bn 2026-01-06T13:30:18,173 copying src/unitxt/catalog/cards/global_mmlu/bn/high_school_european_history.json -> build/lib/unitxt/catalog/cards/global_mmlu/bn 2026-01-06T13:30:18,175 copying src/unitxt/catalog/cards/global_mmlu/bn/electrical_engineering.json -> build/lib/unitxt/catalog/cards/global_mmlu/bn 2026-01-06T13:30:18,178 copying src/unitxt/catalog/cards/global_mmlu/bn/nutrition.json -> build/lib/unitxt/catalog/cards/global_mmlu/bn 2026-01-06T13:30:18,180 copying src/unitxt/catalog/cards/global_mmlu/bn/abstract_algebra.json -> build/lib/unitxt/catalog/cards/global_mmlu/bn 2026-01-06T13:30:18,182 copying src/unitxt/catalog/cards/global_mmlu/bn/professional_medicine.json -> build/lib/unitxt/catalog/cards/global_mmlu/bn 2026-01-06T13:30:18,184 copying src/unitxt/catalog/cards/global_mmlu/bn/human_sexuality.json -> build/lib/unitxt/catalog/cards/global_mmlu/bn 2026-01-06T13:30:18,187 copying src/unitxt/catalog/cards/global_mmlu/bn/business_ethics.json -> build/lib/unitxt/catalog/cards/global_mmlu/bn 2026-01-06T13:30:18,189 copying src/unitxt/catalog/cards/global_mmlu/bn/high_school_chemistry.json -> build/lib/unitxt/catalog/cards/global_mmlu/bn 2026-01-06T13:30:18,191 copying src/unitxt/catalog/cards/global_mmlu/bn/logical_fallacies.json -> build/lib/unitxt/catalog/cards/global_mmlu/bn 2026-01-06T13:30:18,193 copying src/unitxt/catalog/cards/global_mmlu/bn/formal_logic.json -> build/lib/unitxt/catalog/cards/global_mmlu/bn 2026-01-06T13:30:18,196 copying src/unitxt/catalog/cards/global_mmlu/bn/high_school_psychology.json -> build/lib/unitxt/catalog/cards/global_mmlu/bn 2026-01-06T13:30:18,198 copying src/unitxt/catalog/cards/global_mmlu/bn/medical_genetics.json -> build/lib/unitxt/catalog/cards/global_mmlu/bn 2026-01-06T13:30:18,200 copying src/unitxt/catalog/cards/global_mmlu/bn/security_studies.json -> build/lib/unitxt/catalog/cards/global_mmlu/bn 2026-01-06T13:30:18,202 copying src/unitxt/catalog/cards/global_mmlu/bn/high_school_macroeconomics.json -> build/lib/unitxt/catalog/cards/global_mmlu/bn 2026-01-06T13:30:18,205 copying src/unitxt/catalog/cards/global_mmlu/bn/professional_law.json -> build/lib/unitxt/catalog/cards/global_mmlu/bn 2026-01-06T13:30:18,207 copying src/unitxt/catalog/cards/global_mmlu/bn/high_school_physics.json -> build/lib/unitxt/catalog/cards/global_mmlu/bn 2026-01-06T13:30:18,209 copying src/unitxt/catalog/cards/global_mmlu/bn/econometrics.json -> build/lib/unitxt/catalog/cards/global_mmlu/bn 2026-01-06T13:30:18,211 copying src/unitxt/catalog/cards/global_mmlu/bn/sociology.json -> build/lib/unitxt/catalog/cards/global_mmlu/bn 2026-01-06T13:30:18,213 copying src/unitxt/catalog/cards/global_mmlu/bn/moral_disputes.json -> build/lib/unitxt/catalog/cards/global_mmlu/bn 2026-01-06T13:30:18,215 copying src/unitxt/catalog/cards/global_mmlu/bn/college_chemistry.json -> build/lib/unitxt/catalog/cards/global_mmlu/bn 2026-01-06T13:30:18,217 copying src/unitxt/catalog/cards/global_mmlu/bn/high_school_geography.json -> build/lib/unitxt/catalog/cards/global_mmlu/bn 2026-01-06T13:30:18,219 copying src/unitxt/catalog/cards/global_mmlu/bn/jurisprudence.json -> build/lib/unitxt/catalog/cards/global_mmlu/bn 2026-01-06T13:30:18,221 copying src/unitxt/catalog/cards/global_mmlu/bn/high_school_statistics.json -> build/lib/unitxt/catalog/cards/global_mmlu/bn 2026-01-06T13:30:18,224 copying src/unitxt/catalog/cards/global_mmlu/bn/professional_accounting.json -> build/lib/unitxt/catalog/cards/global_mmlu/bn 2026-01-06T13:30:18,226 copying src/unitxt/catalog/cards/global_mmlu/bn/us_foreign_policy.json -> build/lib/unitxt/catalog/cards/global_mmlu/bn 2026-01-06T13:30:18,228 copying src/unitxt/catalog/cards/global_mmlu/bn/professional_psychology.json -> build/lib/unitxt/catalog/cards/global_mmlu/bn 2026-01-06T13:30:18,230 copying src/unitxt/catalog/cards/global_mmlu/bn/public_relations.json -> build/lib/unitxt/catalog/cards/global_mmlu/bn 2026-01-06T13:30:18,233 copying src/unitxt/catalog/cards/global_mmlu/bn/computer_security.json -> build/lib/unitxt/catalog/cards/global_mmlu/bn 2026-01-06T13:30:18,235 copying src/unitxt/catalog/cards/global_mmlu/bn/philosophy.json -> build/lib/unitxt/catalog/cards/global_mmlu/bn 2026-01-06T13:30:18,237 copying src/unitxt/catalog/cards/global_mmlu/bn/virology.json -> build/lib/unitxt/catalog/cards/global_mmlu/bn 2026-01-06T13:30:18,239 copying src/unitxt/catalog/cards/global_mmlu/bn/marketing.json -> build/lib/unitxt/catalog/cards/global_mmlu/bn 2026-01-06T13:30:18,241 copying src/unitxt/catalog/cards/global_mmlu/bn/high_school_world_history.json -> build/lib/unitxt/catalog/cards/global_mmlu/bn 2026-01-06T13:30:18,243 copying src/unitxt/catalog/cards/global_mmlu/bn/machine_learning.json -> build/lib/unitxt/catalog/cards/global_mmlu/bn 2026-01-06T13:30:18,246 copying src/unitxt/catalog/cards/global_mmlu/bn/high_school_government_and_politics.json -> build/lib/unitxt/catalog/cards/global_mmlu/bn 2026-01-06T13:30:18,248 copying src/unitxt/catalog/cards/global_mmlu/bn/conceptual_physics.json -> build/lib/unitxt/catalog/cards/global_mmlu/bn 2026-01-06T13:30:18,250 copying src/unitxt/catalog/cards/global_mmlu/bn/college_biology.json -> build/lib/unitxt/catalog/cards/global_mmlu/bn 2026-01-06T13:30:18,252 copying src/unitxt/catalog/cards/global_mmlu/bn/high_school_mathematics.json -> build/lib/unitxt/catalog/cards/global_mmlu/bn 2026-01-06T13:30:18,254 creating build/lib/unitxt/catalog/cards/global_mmlu/sr 2026-01-06T13:30:18,255 copying src/unitxt/catalog/cards/global_mmlu/sr/elementary_mathematics.json -> build/lib/unitxt/catalog/cards/global_mmlu/sr 2026-01-06T13:30:18,258 copying src/unitxt/catalog/cards/global_mmlu/sr/human_aging.json -> build/lib/unitxt/catalog/cards/global_mmlu/sr 2026-01-06T13:30:18,260 copying src/unitxt/catalog/cards/global_mmlu/sr/high_school_computer_science.json -> build/lib/unitxt/catalog/cards/global_mmlu/sr 2026-01-06T13:30:18,262 copying src/unitxt/catalog/cards/global_mmlu/sr/college_physics.json -> build/lib/unitxt/catalog/cards/global_mmlu/sr 2026-01-06T13:30:18,264 copying src/unitxt/catalog/cards/global_mmlu/sr/college_medicine.json -> build/lib/unitxt/catalog/cards/global_mmlu/sr 2026-01-06T13:30:18,266 copying src/unitxt/catalog/cards/global_mmlu/sr/college_mathematics.json -> build/lib/unitxt/catalog/cards/global_mmlu/sr 2026-01-06T13:30:18,269 copying src/unitxt/catalog/cards/global_mmlu/sr/high_school_microeconomics.json -> build/lib/unitxt/catalog/cards/global_mmlu/sr 2026-01-06T13:30:18,271 copying src/unitxt/catalog/cards/global_mmlu/sr/anatomy.json -> build/lib/unitxt/catalog/cards/global_mmlu/sr 2026-01-06T13:30:18,273 copying src/unitxt/catalog/cards/global_mmlu/sr/world_religions.json -> build/lib/unitxt/catalog/cards/global_mmlu/sr 2026-01-06T13:30:18,275 copying src/unitxt/catalog/cards/global_mmlu/sr/management.json -> build/lib/unitxt/catalog/cards/global_mmlu/sr 2026-01-06T13:30:18,277 copying src/unitxt/catalog/cards/global_mmlu/sr/moral_scenarios.json -> build/lib/unitxt/catalog/cards/global_mmlu/sr 2026-01-06T13:30:18,279 copying src/unitxt/catalog/cards/global_mmlu/sr/global_facts.json -> build/lib/unitxt/catalog/cards/global_mmlu/sr 2026-01-06T13:30:18,281 copying src/unitxt/catalog/cards/global_mmlu/sr/miscellaneous.json -> build/lib/unitxt/catalog/cards/global_mmlu/sr 2026-01-06T13:30:18,283 copying src/unitxt/catalog/cards/global_mmlu/sr/clinical_knowledge.json -> build/lib/unitxt/catalog/cards/global_mmlu/sr 2026-01-06T13:30:18,285 copying src/unitxt/catalog/cards/global_mmlu/sr/high_school_biology.json -> build/lib/unitxt/catalog/cards/global_mmlu/sr 2026-01-06T13:30:18,288 copying src/unitxt/catalog/cards/global_mmlu/sr/prehistory.json -> build/lib/unitxt/catalog/cards/global_mmlu/sr 2026-01-06T13:30:18,290 copying src/unitxt/catalog/cards/global_mmlu/sr/high_school_us_history.json -> build/lib/unitxt/catalog/cards/global_mmlu/sr 2026-01-06T13:30:18,292 copying src/unitxt/catalog/cards/global_mmlu/sr/international_law.json -> build/lib/unitxt/catalog/cards/global_mmlu/sr 2026-01-06T13:30:18,294 copying src/unitxt/catalog/cards/global_mmlu/sr/college_computer_science.json -> build/lib/unitxt/catalog/cards/global_mmlu/sr 2026-01-06T13:30:18,297 copying src/unitxt/catalog/cards/global_mmlu/sr/astronomy.json -> build/lib/unitxt/catalog/cards/global_mmlu/sr 2026-01-06T13:30:18,299 copying src/unitxt/catalog/cards/global_mmlu/sr/high_school_european_history.json -> build/lib/unitxt/catalog/cards/global_mmlu/sr 2026-01-06T13:30:18,301 copying src/unitxt/catalog/cards/global_mmlu/sr/electrical_engineering.json -> build/lib/unitxt/catalog/cards/global_mmlu/sr 2026-01-06T13:30:18,303 copying src/unitxt/catalog/cards/global_mmlu/sr/nutrition.json -> build/lib/unitxt/catalog/cards/global_mmlu/sr 2026-01-06T13:30:18,306 copying src/unitxt/catalog/cards/global_mmlu/sr/abstract_algebra.json -> build/lib/unitxt/catalog/cards/global_mmlu/sr 2026-01-06T13:30:18,308 copying src/unitxt/catalog/cards/global_mmlu/sr/professional_medicine.json -> build/lib/unitxt/catalog/cards/global_mmlu/sr 2026-01-06T13:30:18,310 copying src/unitxt/catalog/cards/global_mmlu/sr/human_sexuality.json -> build/lib/unitxt/catalog/cards/global_mmlu/sr 2026-01-06T13:30:18,312 copying src/unitxt/catalog/cards/global_mmlu/sr/business_ethics.json -> build/lib/unitxt/catalog/cards/global_mmlu/sr 2026-01-06T13:30:18,315 copying src/unitxt/catalog/cards/global_mmlu/sr/high_school_chemistry.json -> build/lib/unitxt/catalog/cards/global_mmlu/sr 2026-01-06T13:30:18,317 copying src/unitxt/catalog/cards/global_mmlu/sr/logical_fallacies.json -> build/lib/unitxt/catalog/cards/global_mmlu/sr 2026-01-06T13:30:18,319 copying src/unitxt/catalog/cards/global_mmlu/sr/formal_logic.json -> build/lib/unitxt/catalog/cards/global_mmlu/sr 2026-01-06T13:30:18,321 copying src/unitxt/catalog/cards/global_mmlu/sr/high_school_psychology.json -> build/lib/unitxt/catalog/cards/global_mmlu/sr 2026-01-06T13:30:18,323 copying src/unitxt/catalog/cards/global_mmlu/sr/medical_genetics.json -> build/lib/unitxt/catalog/cards/global_mmlu/sr 2026-01-06T13:30:18,325 copying src/unitxt/catalog/cards/global_mmlu/sr/security_studies.json -> build/lib/unitxt/catalog/cards/global_mmlu/sr 2026-01-06T13:30:18,328 copying src/unitxt/catalog/cards/global_mmlu/sr/high_school_macroeconomics.json -> build/lib/unitxt/catalog/cards/global_mmlu/sr 2026-01-06T13:30:18,330 copying src/unitxt/catalog/cards/global_mmlu/sr/professional_law.json -> build/lib/unitxt/catalog/cards/global_mmlu/sr 2026-01-06T13:30:18,332 copying src/unitxt/catalog/cards/global_mmlu/sr/high_school_physics.json -> build/lib/unitxt/catalog/cards/global_mmlu/sr 2026-01-06T13:30:18,334 copying src/unitxt/catalog/cards/global_mmlu/sr/econometrics.json -> build/lib/unitxt/catalog/cards/global_mmlu/sr 2026-01-06T13:30:18,336 copying src/unitxt/catalog/cards/global_mmlu/sr/sociology.json -> build/lib/unitxt/catalog/cards/global_mmlu/sr 2026-01-06T13:30:18,338 copying src/unitxt/catalog/cards/global_mmlu/sr/moral_disputes.json -> build/lib/unitxt/catalog/cards/global_mmlu/sr 2026-01-06T13:30:18,340 copying src/unitxt/catalog/cards/global_mmlu/sr/college_chemistry.json -> build/lib/unitxt/catalog/cards/global_mmlu/sr 2026-01-06T13:30:18,342 copying src/unitxt/catalog/cards/global_mmlu/sr/high_school_geography.json -> build/lib/unitxt/catalog/cards/global_mmlu/sr 2026-01-06T13:30:18,344 copying src/unitxt/catalog/cards/global_mmlu/sr/jurisprudence.json -> build/lib/unitxt/catalog/cards/global_mmlu/sr 2026-01-06T13:30:18,347 copying src/unitxt/catalog/cards/global_mmlu/sr/high_school_statistics.json -> build/lib/unitxt/catalog/cards/global_mmlu/sr 2026-01-06T13:30:18,349 copying src/unitxt/catalog/cards/global_mmlu/sr/professional_accounting.json -> build/lib/unitxt/catalog/cards/global_mmlu/sr 2026-01-06T13:30:18,351 copying src/unitxt/catalog/cards/global_mmlu/sr/us_foreign_policy.json -> build/lib/unitxt/catalog/cards/global_mmlu/sr 2026-01-06T13:30:18,353 copying src/unitxt/catalog/cards/global_mmlu/sr/professional_psychology.json -> build/lib/unitxt/catalog/cards/global_mmlu/sr 2026-01-06T13:30:18,355 copying src/unitxt/catalog/cards/global_mmlu/sr/public_relations.json -> build/lib/unitxt/catalog/cards/global_mmlu/sr 2026-01-06T13:30:18,358 copying src/unitxt/catalog/cards/global_mmlu/sr/computer_security.json -> build/lib/unitxt/catalog/cards/global_mmlu/sr 2026-01-06T13:30:18,360 copying src/unitxt/catalog/cards/global_mmlu/sr/philosophy.json -> build/lib/unitxt/catalog/cards/global_mmlu/sr 2026-01-06T13:30:18,362 copying src/unitxt/catalog/cards/global_mmlu/sr/virology.json -> build/lib/unitxt/catalog/cards/global_mmlu/sr 2026-01-06T13:30:18,365 copying src/unitxt/catalog/cards/global_mmlu/sr/marketing.json -> build/lib/unitxt/catalog/cards/global_mmlu/sr 2026-01-06T13:30:18,367 copying src/unitxt/catalog/cards/global_mmlu/sr/high_school_world_history.json -> build/lib/unitxt/catalog/cards/global_mmlu/sr 2026-01-06T13:30:18,369 copying src/unitxt/catalog/cards/global_mmlu/sr/machine_learning.json -> build/lib/unitxt/catalog/cards/global_mmlu/sr 2026-01-06T13:30:18,371 copying src/unitxt/catalog/cards/global_mmlu/sr/high_school_government_and_politics.json -> build/lib/unitxt/catalog/cards/global_mmlu/sr 2026-01-06T13:30:18,373 copying src/unitxt/catalog/cards/global_mmlu/sr/conceptual_physics.json -> build/lib/unitxt/catalog/cards/global_mmlu/sr 2026-01-06T13:30:18,376 copying src/unitxt/catalog/cards/global_mmlu/sr/college_biology.json -> build/lib/unitxt/catalog/cards/global_mmlu/sr 2026-01-06T13:30:18,378 copying src/unitxt/catalog/cards/global_mmlu/sr/high_school_mathematics.json -> build/lib/unitxt/catalog/cards/global_mmlu/sr 2026-01-06T13:30:18,380 creating build/lib/unitxt/catalog/cards/global_mmlu/vi 2026-01-06T13:30:18,381 copying src/unitxt/catalog/cards/global_mmlu/vi/elementary_mathematics.json -> build/lib/unitxt/catalog/cards/global_mmlu/vi 2026-01-06T13:30:18,384 copying src/unitxt/catalog/cards/global_mmlu/vi/human_aging.json -> build/lib/unitxt/catalog/cards/global_mmlu/vi 2026-01-06T13:30:18,386 copying src/unitxt/catalog/cards/global_mmlu/vi/high_school_computer_science.json -> build/lib/unitxt/catalog/cards/global_mmlu/vi 2026-01-06T13:30:18,388 copying src/unitxt/catalog/cards/global_mmlu/vi/college_physics.json -> build/lib/unitxt/catalog/cards/global_mmlu/vi 2026-01-06T13:30:18,390 copying src/unitxt/catalog/cards/global_mmlu/vi/college_medicine.json -> build/lib/unitxt/catalog/cards/global_mmlu/vi 2026-01-06T13:30:18,392 copying src/unitxt/catalog/cards/global_mmlu/vi/college_mathematics.json -> build/lib/unitxt/catalog/cards/global_mmlu/vi 2026-01-06T13:30:18,394 copying src/unitxt/catalog/cards/global_mmlu/vi/high_school_microeconomics.json -> build/lib/unitxt/catalog/cards/global_mmlu/vi 2026-01-06T13:30:18,397 copying src/unitxt/catalog/cards/global_mmlu/vi/anatomy.json -> build/lib/unitxt/catalog/cards/global_mmlu/vi 2026-01-06T13:30:18,399 copying src/unitxt/catalog/cards/global_mmlu/vi/world_religions.json -> build/lib/unitxt/catalog/cards/global_mmlu/vi 2026-01-06T13:30:18,401 copying src/unitxt/catalog/cards/global_mmlu/vi/management.json -> build/lib/unitxt/catalog/cards/global_mmlu/vi 2026-01-06T13:30:18,403 copying src/unitxt/catalog/cards/global_mmlu/vi/moral_scenarios.json -> build/lib/unitxt/catalog/cards/global_mmlu/vi 2026-01-06T13:30:18,406 copying src/unitxt/catalog/cards/global_mmlu/vi/global_facts.json -> build/lib/unitxt/catalog/cards/global_mmlu/vi 2026-01-06T13:30:18,408 copying src/unitxt/catalog/cards/global_mmlu/vi/miscellaneous.json -> build/lib/unitxt/catalog/cards/global_mmlu/vi 2026-01-06T13:30:18,410 copying src/unitxt/catalog/cards/global_mmlu/vi/clinical_knowledge.json -> build/lib/unitxt/catalog/cards/global_mmlu/vi 2026-01-06T13:30:18,412 copying src/unitxt/catalog/cards/global_mmlu/vi/high_school_biology.json -> build/lib/unitxt/catalog/cards/global_mmlu/vi 2026-01-06T13:30:18,414 copying src/unitxt/catalog/cards/global_mmlu/vi/prehistory.json -> build/lib/unitxt/catalog/cards/global_mmlu/vi 2026-01-06T13:30:18,417 copying src/unitxt/catalog/cards/global_mmlu/vi/high_school_us_history.json -> build/lib/unitxt/catalog/cards/global_mmlu/vi 2026-01-06T13:30:18,419 copying src/unitxt/catalog/cards/global_mmlu/vi/international_law.json -> build/lib/unitxt/catalog/cards/global_mmlu/vi 2026-01-06T13:30:18,421 copying src/unitxt/catalog/cards/global_mmlu/vi/college_computer_science.json -> build/lib/unitxt/catalog/cards/global_mmlu/vi 2026-01-06T13:30:18,423 copying src/unitxt/catalog/cards/global_mmlu/vi/astronomy.json -> build/lib/unitxt/catalog/cards/global_mmlu/vi 2026-01-06T13:30:18,425 copying src/unitxt/catalog/cards/global_mmlu/vi/high_school_european_history.json -> build/lib/unitxt/catalog/cards/global_mmlu/vi 2026-01-06T13:30:18,428 copying src/unitxt/catalog/cards/global_mmlu/vi/electrical_engineering.json -> build/lib/unitxt/catalog/cards/global_mmlu/vi 2026-01-06T13:30:18,430 copying src/unitxt/catalog/cards/global_mmlu/vi/nutrition.json -> build/lib/unitxt/catalog/cards/global_mmlu/vi 2026-01-06T13:30:18,432 copying src/unitxt/catalog/cards/global_mmlu/vi/abstract_algebra.json -> build/lib/unitxt/catalog/cards/global_mmlu/vi 2026-01-06T13:30:18,434 copying src/unitxt/catalog/cards/global_mmlu/vi/professional_medicine.json -> build/lib/unitxt/catalog/cards/global_mmlu/vi 2026-01-06T13:30:18,436 copying src/unitxt/catalog/cards/global_mmlu/vi/human_sexuality.json -> build/lib/unitxt/catalog/cards/global_mmlu/vi 2026-01-06T13:30:18,439 copying src/unitxt/catalog/cards/global_mmlu/vi/business_ethics.json -> build/lib/unitxt/catalog/cards/global_mmlu/vi 2026-01-06T13:30:18,441 copying src/unitxt/catalog/cards/global_mmlu/vi/high_school_chemistry.json -> build/lib/unitxt/catalog/cards/global_mmlu/vi 2026-01-06T13:30:18,443 copying src/unitxt/catalog/cards/global_mmlu/vi/logical_fallacies.json -> build/lib/unitxt/catalog/cards/global_mmlu/vi 2026-01-06T13:30:18,446 copying src/unitxt/catalog/cards/global_mmlu/vi/formal_logic.json -> build/lib/unitxt/catalog/cards/global_mmlu/vi 2026-01-06T13:30:18,448 copying src/unitxt/catalog/cards/global_mmlu/vi/high_school_psychology.json -> build/lib/unitxt/catalog/cards/global_mmlu/vi 2026-01-06T13:30:18,450 copying src/unitxt/catalog/cards/global_mmlu/vi/medical_genetics.json -> build/lib/unitxt/catalog/cards/global_mmlu/vi 2026-01-06T13:30:18,452 copying src/unitxt/catalog/cards/global_mmlu/vi/security_studies.json -> build/lib/unitxt/catalog/cards/global_mmlu/vi 2026-01-06T13:30:18,454 copying src/unitxt/catalog/cards/global_mmlu/vi/high_school_macroeconomics.json -> build/lib/unitxt/catalog/cards/global_mmlu/vi 2026-01-06T13:30:18,456 copying src/unitxt/catalog/cards/global_mmlu/vi/professional_law.json -> build/lib/unitxt/catalog/cards/global_mmlu/vi 2026-01-06T13:30:18,458 copying src/unitxt/catalog/cards/global_mmlu/vi/high_school_physics.json -> build/lib/unitxt/catalog/cards/global_mmlu/vi 2026-01-06T13:30:18,460 copying src/unitxt/catalog/cards/global_mmlu/vi/econometrics.json -> build/lib/unitxt/catalog/cards/global_mmlu/vi 2026-01-06T13:30:18,463 copying src/unitxt/catalog/cards/global_mmlu/vi/sociology.json -> build/lib/unitxt/catalog/cards/global_mmlu/vi 2026-01-06T13:30:18,465 copying src/unitxt/catalog/cards/global_mmlu/vi/moral_disputes.json -> build/lib/unitxt/catalog/cards/global_mmlu/vi 2026-01-06T13:30:18,467 copying src/unitxt/catalog/cards/global_mmlu/vi/college_chemistry.json -> build/lib/unitxt/catalog/cards/global_mmlu/vi 2026-01-06T13:30:18,469 copying src/unitxt/catalog/cards/global_mmlu/vi/high_school_geography.json -> build/lib/unitxt/catalog/cards/global_mmlu/vi 2026-01-06T13:30:18,471 copying src/unitxt/catalog/cards/global_mmlu/vi/jurisprudence.json -> build/lib/unitxt/catalog/cards/global_mmlu/vi 2026-01-06T13:30:18,473 copying src/unitxt/catalog/cards/global_mmlu/vi/high_school_statistics.json -> build/lib/unitxt/catalog/cards/global_mmlu/vi 2026-01-06T13:30:18,476 copying src/unitxt/catalog/cards/global_mmlu/vi/professional_accounting.json -> build/lib/unitxt/catalog/cards/global_mmlu/vi 2026-01-06T13:30:18,478 copying src/unitxt/catalog/cards/global_mmlu/vi/us_foreign_policy.json -> build/lib/unitxt/catalog/cards/global_mmlu/vi 2026-01-06T13:30:18,480 copying src/unitxt/catalog/cards/global_mmlu/vi/professional_psychology.json -> build/lib/unitxt/catalog/cards/global_mmlu/vi 2026-01-06T13:30:18,482 copying src/unitxt/catalog/cards/global_mmlu/vi/public_relations.json -> build/lib/unitxt/catalog/cards/global_mmlu/vi 2026-01-06T13:30:18,484 copying src/unitxt/catalog/cards/global_mmlu/vi/computer_security.json -> build/lib/unitxt/catalog/cards/global_mmlu/vi 2026-01-06T13:30:18,487 copying src/unitxt/catalog/cards/global_mmlu/vi/philosophy.json -> build/lib/unitxt/catalog/cards/global_mmlu/vi 2026-01-06T13:30:18,489 copying src/unitxt/catalog/cards/global_mmlu/vi/virology.json -> build/lib/unitxt/catalog/cards/global_mmlu/vi 2026-01-06T13:30:18,491 copying src/unitxt/catalog/cards/global_mmlu/vi/marketing.json -> build/lib/unitxt/catalog/cards/global_mmlu/vi 2026-01-06T13:30:18,493 copying src/unitxt/catalog/cards/global_mmlu/vi/high_school_world_history.json -> build/lib/unitxt/catalog/cards/global_mmlu/vi 2026-01-06T13:30:18,496 copying src/unitxt/catalog/cards/global_mmlu/vi/machine_learning.json -> build/lib/unitxt/catalog/cards/global_mmlu/vi 2026-01-06T13:30:18,498 copying src/unitxt/catalog/cards/global_mmlu/vi/high_school_government_and_politics.json -> build/lib/unitxt/catalog/cards/global_mmlu/vi 2026-01-06T13:30:18,500 copying src/unitxt/catalog/cards/global_mmlu/vi/conceptual_physics.json -> build/lib/unitxt/catalog/cards/global_mmlu/vi 2026-01-06T13:30:18,503 copying src/unitxt/catalog/cards/global_mmlu/vi/college_biology.json -> build/lib/unitxt/catalog/cards/global_mmlu/vi 2026-01-06T13:30:18,505 copying src/unitxt/catalog/cards/global_mmlu/vi/high_school_mathematics.json -> build/lib/unitxt/catalog/cards/global_mmlu/vi 2026-01-06T13:30:18,507 creating build/lib/unitxt/catalog/cards/global_mmlu/fr 2026-01-06T13:30:18,508 copying src/unitxt/catalog/cards/global_mmlu/fr/elementary_mathematics.json -> build/lib/unitxt/catalog/cards/global_mmlu/fr 2026-01-06T13:30:18,510 copying src/unitxt/catalog/cards/global_mmlu/fr/human_aging.json -> build/lib/unitxt/catalog/cards/global_mmlu/fr 2026-01-06T13:30:18,512 copying src/unitxt/catalog/cards/global_mmlu/fr/high_school_computer_science.json -> build/lib/unitxt/catalog/cards/global_mmlu/fr 2026-01-06T13:30:18,515 copying src/unitxt/catalog/cards/global_mmlu/fr/college_physics.json -> build/lib/unitxt/catalog/cards/global_mmlu/fr 2026-01-06T13:30:18,517 copying src/unitxt/catalog/cards/global_mmlu/fr/college_medicine.json -> build/lib/unitxt/catalog/cards/global_mmlu/fr 2026-01-06T13:30:18,519 copying src/unitxt/catalog/cards/global_mmlu/fr/college_mathematics.json -> build/lib/unitxt/catalog/cards/global_mmlu/fr 2026-01-06T13:30:18,521 copying src/unitxt/catalog/cards/global_mmlu/fr/high_school_microeconomics.json -> build/lib/unitxt/catalog/cards/global_mmlu/fr 2026-01-06T13:30:18,523 copying src/unitxt/catalog/cards/global_mmlu/fr/anatomy.json -> build/lib/unitxt/catalog/cards/global_mmlu/fr 2026-01-06T13:30:18,525 copying src/unitxt/catalog/cards/global_mmlu/fr/world_religions.json -> build/lib/unitxt/catalog/cards/global_mmlu/fr 2026-01-06T13:30:18,527 copying src/unitxt/catalog/cards/global_mmlu/fr/management.json -> build/lib/unitxt/catalog/cards/global_mmlu/fr 2026-01-06T13:30:18,530 copying src/unitxt/catalog/cards/global_mmlu/fr/moral_scenarios.json -> build/lib/unitxt/catalog/cards/global_mmlu/fr 2026-01-06T13:30:18,532 copying src/unitxt/catalog/cards/global_mmlu/fr/global_facts.json -> build/lib/unitxt/catalog/cards/global_mmlu/fr 2026-01-06T13:30:18,534 copying src/unitxt/catalog/cards/global_mmlu/fr/miscellaneous.json -> build/lib/unitxt/catalog/cards/global_mmlu/fr 2026-01-06T13:30:18,536 copying src/unitxt/catalog/cards/global_mmlu/fr/clinical_knowledge.json -> build/lib/unitxt/catalog/cards/global_mmlu/fr 2026-01-06T13:30:18,538 copying src/unitxt/catalog/cards/global_mmlu/fr/high_school_biology.json -> build/lib/unitxt/catalog/cards/global_mmlu/fr 2026-01-06T13:30:18,541 copying src/unitxt/catalog/cards/global_mmlu/fr/prehistory.json -> build/lib/unitxt/catalog/cards/global_mmlu/fr 2026-01-06T13:30:18,543 copying src/unitxt/catalog/cards/global_mmlu/fr/high_school_us_history.json -> build/lib/unitxt/catalog/cards/global_mmlu/fr 2026-01-06T13:30:18,545 copying src/unitxt/catalog/cards/global_mmlu/fr/international_law.json -> build/lib/unitxt/catalog/cards/global_mmlu/fr 2026-01-06T13:30:18,547 copying src/unitxt/catalog/cards/global_mmlu/fr/college_computer_science.json -> build/lib/unitxt/catalog/cards/global_mmlu/fr 2026-01-06T13:30:18,549 copying src/unitxt/catalog/cards/global_mmlu/fr/astronomy.json -> build/lib/unitxt/catalog/cards/global_mmlu/fr 2026-01-06T13:30:18,551 copying src/unitxt/catalog/cards/global_mmlu/fr/high_school_european_history.json -> build/lib/unitxt/catalog/cards/global_mmlu/fr 2026-01-06T13:30:18,554 copying src/unitxt/catalog/cards/global_mmlu/fr/electrical_engineering.json -> build/lib/unitxt/catalog/cards/global_mmlu/fr 2026-01-06T13:30:18,556 copying src/unitxt/catalog/cards/global_mmlu/fr/nutrition.json -> build/lib/unitxt/catalog/cards/global_mmlu/fr 2026-01-06T13:30:18,558 copying src/unitxt/catalog/cards/global_mmlu/fr/abstract_algebra.json -> build/lib/unitxt/catalog/cards/global_mmlu/fr 2026-01-06T13:30:18,560 copying src/unitxt/catalog/cards/global_mmlu/fr/professional_medicine.json -> build/lib/unitxt/catalog/cards/global_mmlu/fr 2026-01-06T13:30:18,563 copying src/unitxt/catalog/cards/global_mmlu/fr/human_sexuality.json -> build/lib/unitxt/catalog/cards/global_mmlu/fr 2026-01-06T13:30:18,565 copying src/unitxt/catalog/cards/global_mmlu/fr/business_ethics.json -> build/lib/unitxt/catalog/cards/global_mmlu/fr 2026-01-06T13:30:18,567 copying src/unitxt/catalog/cards/global_mmlu/fr/high_school_chemistry.json -> build/lib/unitxt/catalog/cards/global_mmlu/fr 2026-01-06T13:30:18,569 copying src/unitxt/catalog/cards/global_mmlu/fr/logical_fallacies.json -> build/lib/unitxt/catalog/cards/global_mmlu/fr 2026-01-06T13:30:18,571 copying src/unitxt/catalog/cards/global_mmlu/fr/formal_logic.json -> build/lib/unitxt/catalog/cards/global_mmlu/fr 2026-01-06T13:30:18,574 copying src/unitxt/catalog/cards/global_mmlu/fr/high_school_psychology.json -> build/lib/unitxt/catalog/cards/global_mmlu/fr 2026-01-06T13:30:18,576 copying src/unitxt/catalog/cards/global_mmlu/fr/medical_genetics.json -> build/lib/unitxt/catalog/cards/global_mmlu/fr 2026-01-06T13:30:18,578 copying src/unitxt/catalog/cards/global_mmlu/fr/security_studies.json -> build/lib/unitxt/catalog/cards/global_mmlu/fr 2026-01-06T13:30:18,580 copying src/unitxt/catalog/cards/global_mmlu/fr/high_school_macroeconomics.json -> build/lib/unitxt/catalog/cards/global_mmlu/fr 2026-01-06T13:30:18,583 copying src/unitxt/catalog/cards/global_mmlu/fr/professional_law.json -> build/lib/unitxt/catalog/cards/global_mmlu/fr 2026-01-06T13:30:18,585 copying src/unitxt/catalog/cards/global_mmlu/fr/high_school_physics.json -> build/lib/unitxt/catalog/cards/global_mmlu/fr 2026-01-06T13:30:18,587 copying src/unitxt/catalog/cards/global_mmlu/fr/econometrics.json -> build/lib/unitxt/catalog/cards/global_mmlu/fr 2026-01-06T13:30:18,589 copying src/unitxt/catalog/cards/global_mmlu/fr/sociology.json -> build/lib/unitxt/catalog/cards/global_mmlu/fr 2026-01-06T13:30:18,591 copying src/unitxt/catalog/cards/global_mmlu/fr/moral_disputes.json -> build/lib/unitxt/catalog/cards/global_mmlu/fr 2026-01-06T13:30:18,593 copying src/unitxt/catalog/cards/global_mmlu/fr/college_chemistry.json -> build/lib/unitxt/catalog/cards/global_mmlu/fr 2026-01-06T13:30:18,596 copying src/unitxt/catalog/cards/global_mmlu/fr/high_school_geography.json -> build/lib/unitxt/catalog/cards/global_mmlu/fr 2026-01-06T13:30:18,598 copying src/unitxt/catalog/cards/global_mmlu/fr/jurisprudence.json -> build/lib/unitxt/catalog/cards/global_mmlu/fr 2026-01-06T13:30:18,600 copying src/unitxt/catalog/cards/global_mmlu/fr/high_school_statistics.json -> build/lib/unitxt/catalog/cards/global_mmlu/fr 2026-01-06T13:30:18,602 copying src/unitxt/catalog/cards/global_mmlu/fr/professional_accounting.json -> build/lib/unitxt/catalog/cards/global_mmlu/fr 2026-01-06T13:30:18,604 copying src/unitxt/catalog/cards/global_mmlu/fr/us_foreign_policy.json -> build/lib/unitxt/catalog/cards/global_mmlu/fr 2026-01-06T13:30:18,607 copying src/unitxt/catalog/cards/global_mmlu/fr/professional_psychology.json -> build/lib/unitxt/catalog/cards/global_mmlu/fr 2026-01-06T13:30:18,609 copying src/unitxt/catalog/cards/global_mmlu/fr/public_relations.json -> build/lib/unitxt/catalog/cards/global_mmlu/fr 2026-01-06T13:30:18,611 copying src/unitxt/catalog/cards/global_mmlu/fr/computer_security.json -> build/lib/unitxt/catalog/cards/global_mmlu/fr 2026-01-06T13:30:18,613 copying src/unitxt/catalog/cards/global_mmlu/fr/philosophy.json -> build/lib/unitxt/catalog/cards/global_mmlu/fr 2026-01-06T13:30:18,615 copying src/unitxt/catalog/cards/global_mmlu/fr/virology.json -> build/lib/unitxt/catalog/cards/global_mmlu/fr 2026-01-06T13:30:18,618 copying src/unitxt/catalog/cards/global_mmlu/fr/marketing.json -> build/lib/unitxt/catalog/cards/global_mmlu/fr 2026-01-06T13:30:18,620 copying src/unitxt/catalog/cards/global_mmlu/fr/high_school_world_history.json -> build/lib/unitxt/catalog/cards/global_mmlu/fr 2026-01-06T13:30:18,622 copying src/unitxt/catalog/cards/global_mmlu/fr/machine_learning.json -> build/lib/unitxt/catalog/cards/global_mmlu/fr 2026-01-06T13:30:18,625 copying src/unitxt/catalog/cards/global_mmlu/fr/high_school_government_and_politics.json -> build/lib/unitxt/catalog/cards/global_mmlu/fr 2026-01-06T13:30:18,627 copying src/unitxt/catalog/cards/global_mmlu/fr/conceptual_physics.json -> build/lib/unitxt/catalog/cards/global_mmlu/fr 2026-01-06T13:30:18,629 copying src/unitxt/catalog/cards/global_mmlu/fr/college_biology.json -> build/lib/unitxt/catalog/cards/global_mmlu/fr 2026-01-06T13:30:18,631 copying src/unitxt/catalog/cards/global_mmlu/fr/high_school_mathematics.json -> build/lib/unitxt/catalog/cards/global_mmlu/fr 2026-01-06T13:30:18,633 creating build/lib/unitxt/catalog/cards/global_mmlu/ig 2026-01-06T13:30:18,634 copying src/unitxt/catalog/cards/global_mmlu/ig/elementary_mathematics.json -> build/lib/unitxt/catalog/cards/global_mmlu/ig 2026-01-06T13:30:18,636 copying src/unitxt/catalog/cards/global_mmlu/ig/human_aging.json -> build/lib/unitxt/catalog/cards/global_mmlu/ig 2026-01-06T13:30:18,639 copying src/unitxt/catalog/cards/global_mmlu/ig/high_school_computer_science.json -> build/lib/unitxt/catalog/cards/global_mmlu/ig 2026-01-06T13:30:18,641 copying src/unitxt/catalog/cards/global_mmlu/ig/college_physics.json -> build/lib/unitxt/catalog/cards/global_mmlu/ig 2026-01-06T13:30:18,643 copying src/unitxt/catalog/cards/global_mmlu/ig/college_medicine.json -> build/lib/unitxt/catalog/cards/global_mmlu/ig 2026-01-06T13:30:18,645 copying src/unitxt/catalog/cards/global_mmlu/ig/college_mathematics.json -> build/lib/unitxt/catalog/cards/global_mmlu/ig 2026-01-06T13:30:18,648 copying src/unitxt/catalog/cards/global_mmlu/ig/high_school_microeconomics.json -> build/lib/unitxt/catalog/cards/global_mmlu/ig 2026-01-06T13:30:18,650 copying src/unitxt/catalog/cards/global_mmlu/ig/anatomy.json -> build/lib/unitxt/catalog/cards/global_mmlu/ig 2026-01-06T13:30:18,652 copying src/unitxt/catalog/cards/global_mmlu/ig/world_religions.json -> build/lib/unitxt/catalog/cards/global_mmlu/ig 2026-01-06T13:30:18,654 copying src/unitxt/catalog/cards/global_mmlu/ig/management.json -> build/lib/unitxt/catalog/cards/global_mmlu/ig 2026-01-06T13:30:18,656 copying src/unitxt/catalog/cards/global_mmlu/ig/moral_scenarios.json -> build/lib/unitxt/catalog/cards/global_mmlu/ig 2026-01-06T13:30:18,658 copying src/unitxt/catalog/cards/global_mmlu/ig/global_facts.json -> build/lib/unitxt/catalog/cards/global_mmlu/ig 2026-01-06T13:30:18,661 copying src/unitxt/catalog/cards/global_mmlu/ig/miscellaneous.json -> build/lib/unitxt/catalog/cards/global_mmlu/ig 2026-01-06T13:30:18,663 copying src/unitxt/catalog/cards/global_mmlu/ig/clinical_knowledge.json -> build/lib/unitxt/catalog/cards/global_mmlu/ig 2026-01-06T13:30:18,665 copying src/unitxt/catalog/cards/global_mmlu/ig/high_school_biology.json -> build/lib/unitxt/catalog/cards/global_mmlu/ig 2026-01-06T13:30:18,667 copying src/unitxt/catalog/cards/global_mmlu/ig/prehistory.json -> build/lib/unitxt/catalog/cards/global_mmlu/ig 2026-01-06T13:30:18,670 copying src/unitxt/catalog/cards/global_mmlu/ig/high_school_us_history.json -> build/lib/unitxt/catalog/cards/global_mmlu/ig 2026-01-06T13:30:18,672 copying src/unitxt/catalog/cards/global_mmlu/ig/international_law.json -> build/lib/unitxt/catalog/cards/global_mmlu/ig 2026-01-06T13:30:18,674 copying src/unitxt/catalog/cards/global_mmlu/ig/college_computer_science.json -> build/lib/unitxt/catalog/cards/global_mmlu/ig 2026-01-06T13:30:18,677 copying src/unitxt/catalog/cards/global_mmlu/ig/astronomy.json -> build/lib/unitxt/catalog/cards/global_mmlu/ig 2026-01-06T13:30:18,679 copying src/unitxt/catalog/cards/global_mmlu/ig/high_school_european_history.json -> build/lib/unitxt/catalog/cards/global_mmlu/ig 2026-01-06T13:30:18,681 copying src/unitxt/catalog/cards/global_mmlu/ig/electrical_engineering.json -> build/lib/unitxt/catalog/cards/global_mmlu/ig 2026-01-06T13:30:18,683 copying src/unitxt/catalog/cards/global_mmlu/ig/nutrition.json -> build/lib/unitxt/catalog/cards/global_mmlu/ig 2026-01-06T13:30:18,686 copying src/unitxt/catalog/cards/global_mmlu/ig/abstract_algebra.json -> build/lib/unitxt/catalog/cards/global_mmlu/ig 2026-01-06T13:30:18,688 copying src/unitxt/catalog/cards/global_mmlu/ig/professional_medicine.json -> build/lib/unitxt/catalog/cards/global_mmlu/ig 2026-01-06T13:30:18,690 copying src/unitxt/catalog/cards/global_mmlu/ig/human_sexuality.json -> build/lib/unitxt/catalog/cards/global_mmlu/ig 2026-01-06T13:30:18,692 copying src/unitxt/catalog/cards/global_mmlu/ig/business_ethics.json -> build/lib/unitxt/catalog/cards/global_mmlu/ig 2026-01-06T13:30:18,694 copying src/unitxt/catalog/cards/global_mmlu/ig/high_school_chemistry.json -> build/lib/unitxt/catalog/cards/global_mmlu/ig 2026-01-06T13:30:18,696 copying src/unitxt/catalog/cards/global_mmlu/ig/logical_fallacies.json -> build/lib/unitxt/catalog/cards/global_mmlu/ig 2026-01-06T13:30:18,699 copying src/unitxt/catalog/cards/global_mmlu/ig/formal_logic.json -> build/lib/unitxt/catalog/cards/global_mmlu/ig 2026-01-06T13:30:18,701 copying src/unitxt/catalog/cards/global_mmlu/ig/high_school_psychology.json -> build/lib/unitxt/catalog/cards/global_mmlu/ig 2026-01-06T13:30:18,703 copying src/unitxt/catalog/cards/global_mmlu/ig/medical_genetics.json -> build/lib/unitxt/catalog/cards/global_mmlu/ig 2026-01-06T13:30:18,705 copying src/unitxt/catalog/cards/global_mmlu/ig/security_studies.json -> build/lib/unitxt/catalog/cards/global_mmlu/ig 2026-01-06T13:30:18,707 copying src/unitxt/catalog/cards/global_mmlu/ig/high_school_macroeconomics.json -> build/lib/unitxt/catalog/cards/global_mmlu/ig 2026-01-06T13:30:18,709 copying src/unitxt/catalog/cards/global_mmlu/ig/professional_law.json -> build/lib/unitxt/catalog/cards/global_mmlu/ig 2026-01-06T13:30:18,711 copying src/unitxt/catalog/cards/global_mmlu/ig/high_school_physics.json -> build/lib/unitxt/catalog/cards/global_mmlu/ig 2026-01-06T13:30:18,714 copying src/unitxt/catalog/cards/global_mmlu/ig/econometrics.json -> build/lib/unitxt/catalog/cards/global_mmlu/ig 2026-01-06T13:30:18,716 copying src/unitxt/catalog/cards/global_mmlu/ig/sociology.json -> build/lib/unitxt/catalog/cards/global_mmlu/ig 2026-01-06T13:30:18,718 copying src/unitxt/catalog/cards/global_mmlu/ig/moral_disputes.json -> build/lib/unitxt/catalog/cards/global_mmlu/ig 2026-01-06T13:30:18,720 copying src/unitxt/catalog/cards/global_mmlu/ig/college_chemistry.json -> build/lib/unitxt/catalog/cards/global_mmlu/ig 2026-01-06T13:30:18,722 copying src/unitxt/catalog/cards/global_mmlu/ig/high_school_geography.json -> build/lib/unitxt/catalog/cards/global_mmlu/ig 2026-01-06T13:30:18,725 copying src/unitxt/catalog/cards/global_mmlu/ig/jurisprudence.json -> build/lib/unitxt/catalog/cards/global_mmlu/ig 2026-01-06T13:30:18,727 copying src/unitxt/catalog/cards/global_mmlu/ig/high_school_statistics.json -> build/lib/unitxt/catalog/cards/global_mmlu/ig 2026-01-06T13:30:18,729 copying src/unitxt/catalog/cards/global_mmlu/ig/professional_accounting.json -> build/lib/unitxt/catalog/cards/global_mmlu/ig 2026-01-06T13:30:18,731 copying src/unitxt/catalog/cards/global_mmlu/ig/us_foreign_policy.json -> build/lib/unitxt/catalog/cards/global_mmlu/ig 2026-01-06T13:30:18,733 copying src/unitxt/catalog/cards/global_mmlu/ig/professional_psychology.json -> build/lib/unitxt/catalog/cards/global_mmlu/ig 2026-01-06T13:30:18,736 copying src/unitxt/catalog/cards/global_mmlu/ig/public_relations.json -> build/lib/unitxt/catalog/cards/global_mmlu/ig 2026-01-06T13:30:18,738 copying src/unitxt/catalog/cards/global_mmlu/ig/computer_security.json -> build/lib/unitxt/catalog/cards/global_mmlu/ig 2026-01-06T13:30:18,740 copying src/unitxt/catalog/cards/global_mmlu/ig/philosophy.json -> build/lib/unitxt/catalog/cards/global_mmlu/ig 2026-01-06T13:30:18,742 copying src/unitxt/catalog/cards/global_mmlu/ig/virology.json -> build/lib/unitxt/catalog/cards/global_mmlu/ig 2026-01-06T13:30:18,744 copying src/unitxt/catalog/cards/global_mmlu/ig/marketing.json -> build/lib/unitxt/catalog/cards/global_mmlu/ig 2026-01-06T13:30:18,747 copying src/unitxt/catalog/cards/global_mmlu/ig/high_school_world_history.json -> build/lib/unitxt/catalog/cards/global_mmlu/ig 2026-01-06T13:30:18,749 copying src/unitxt/catalog/cards/global_mmlu/ig/machine_learning.json -> build/lib/unitxt/catalog/cards/global_mmlu/ig 2026-01-06T13:30:18,751 copying src/unitxt/catalog/cards/global_mmlu/ig/high_school_government_and_politics.json -> build/lib/unitxt/catalog/cards/global_mmlu/ig 2026-01-06T13:30:18,753 copying src/unitxt/catalog/cards/global_mmlu/ig/conceptual_physics.json -> build/lib/unitxt/catalog/cards/global_mmlu/ig 2026-01-06T13:30:18,755 copying src/unitxt/catalog/cards/global_mmlu/ig/college_biology.json -> build/lib/unitxt/catalog/cards/global_mmlu/ig 2026-01-06T13:30:18,757 copying src/unitxt/catalog/cards/global_mmlu/ig/high_school_mathematics.json -> build/lib/unitxt/catalog/cards/global_mmlu/ig 2026-01-06T13:30:18,759 creating build/lib/unitxt/catalog/cards/global_mmlu/te 2026-01-06T13:30:18,760 copying src/unitxt/catalog/cards/global_mmlu/te/elementary_mathematics.json -> build/lib/unitxt/catalog/cards/global_mmlu/te 2026-01-06T13:30:18,763 copying src/unitxt/catalog/cards/global_mmlu/te/human_aging.json -> build/lib/unitxt/catalog/cards/global_mmlu/te 2026-01-06T13:30:18,765 copying src/unitxt/catalog/cards/global_mmlu/te/high_school_computer_science.json -> build/lib/unitxt/catalog/cards/global_mmlu/te 2026-01-06T13:30:18,767 copying src/unitxt/catalog/cards/global_mmlu/te/college_physics.json -> build/lib/unitxt/catalog/cards/global_mmlu/te 2026-01-06T13:30:18,770 copying src/unitxt/catalog/cards/global_mmlu/te/college_medicine.json -> build/lib/unitxt/catalog/cards/global_mmlu/te 2026-01-06T13:30:18,772 copying src/unitxt/catalog/cards/global_mmlu/te/college_mathematics.json -> build/lib/unitxt/catalog/cards/global_mmlu/te 2026-01-06T13:30:18,774 copying src/unitxt/catalog/cards/global_mmlu/te/high_school_microeconomics.json -> build/lib/unitxt/catalog/cards/global_mmlu/te 2026-01-06T13:30:18,776 copying src/unitxt/catalog/cards/global_mmlu/te/anatomy.json -> build/lib/unitxt/catalog/cards/global_mmlu/te 2026-01-06T13:30:18,779 copying src/unitxt/catalog/cards/global_mmlu/te/world_religions.json -> build/lib/unitxt/catalog/cards/global_mmlu/te 2026-01-06T13:30:18,781 copying src/unitxt/catalog/cards/global_mmlu/te/management.json -> build/lib/unitxt/catalog/cards/global_mmlu/te 2026-01-06T13:30:18,783 copying src/unitxt/catalog/cards/global_mmlu/te/moral_scenarios.json -> build/lib/unitxt/catalog/cards/global_mmlu/te 2026-01-06T13:30:18,785 copying src/unitxt/catalog/cards/global_mmlu/te/global_facts.json -> build/lib/unitxt/catalog/cards/global_mmlu/te 2026-01-06T13:30:18,787 copying src/unitxt/catalog/cards/global_mmlu/te/miscellaneous.json -> build/lib/unitxt/catalog/cards/global_mmlu/te 2026-01-06T13:30:18,790 copying src/unitxt/catalog/cards/global_mmlu/te/clinical_knowledge.json -> build/lib/unitxt/catalog/cards/global_mmlu/te 2026-01-06T13:30:18,792 copying src/unitxt/catalog/cards/global_mmlu/te/high_school_biology.json -> build/lib/unitxt/catalog/cards/global_mmlu/te 2026-01-06T13:30:18,794 copying src/unitxt/catalog/cards/global_mmlu/te/prehistory.json -> build/lib/unitxt/catalog/cards/global_mmlu/te 2026-01-06T13:30:18,797 copying src/unitxt/catalog/cards/global_mmlu/te/high_school_us_history.json -> build/lib/unitxt/catalog/cards/global_mmlu/te 2026-01-06T13:30:18,799 copying src/unitxt/catalog/cards/global_mmlu/te/international_law.json -> build/lib/unitxt/catalog/cards/global_mmlu/te 2026-01-06T13:30:18,801 copying src/unitxt/catalog/cards/global_mmlu/te/college_computer_science.json -> build/lib/unitxt/catalog/cards/global_mmlu/te 2026-01-06T13:30:18,803 copying src/unitxt/catalog/cards/global_mmlu/te/astronomy.json -> build/lib/unitxt/catalog/cards/global_mmlu/te 2026-01-06T13:30:18,806 copying src/unitxt/catalog/cards/global_mmlu/te/high_school_european_history.json -> build/lib/unitxt/catalog/cards/global_mmlu/te 2026-01-06T13:30:18,808 copying src/unitxt/catalog/cards/global_mmlu/te/electrical_engineering.json -> build/lib/unitxt/catalog/cards/global_mmlu/te 2026-01-06T13:30:18,811 copying src/unitxt/catalog/cards/global_mmlu/te/nutrition.json -> build/lib/unitxt/catalog/cards/global_mmlu/te 2026-01-06T13:30:18,814 copying src/unitxt/catalog/cards/global_mmlu/te/abstract_algebra.json -> build/lib/unitxt/catalog/cards/global_mmlu/te 2026-01-06T13:30:18,816 copying src/unitxt/catalog/cards/global_mmlu/te/professional_medicine.json -> build/lib/unitxt/catalog/cards/global_mmlu/te 2026-01-06T13:30:18,818 copying src/unitxt/catalog/cards/global_mmlu/te/human_sexuality.json -> build/lib/unitxt/catalog/cards/global_mmlu/te 2026-01-06T13:30:18,820 copying src/unitxt/catalog/cards/global_mmlu/te/business_ethics.json -> build/lib/unitxt/catalog/cards/global_mmlu/te 2026-01-06T13:30:18,822 copying src/unitxt/catalog/cards/global_mmlu/te/high_school_chemistry.json -> build/lib/unitxt/catalog/cards/global_mmlu/te 2026-01-06T13:30:18,824 copying src/unitxt/catalog/cards/global_mmlu/te/logical_fallacies.json -> build/lib/unitxt/catalog/cards/global_mmlu/te 2026-01-06T13:30:18,827 copying src/unitxt/catalog/cards/global_mmlu/te/formal_logic.json -> build/lib/unitxt/catalog/cards/global_mmlu/te 2026-01-06T13:30:18,829 copying src/unitxt/catalog/cards/global_mmlu/te/high_school_psychology.json -> build/lib/unitxt/catalog/cards/global_mmlu/te 2026-01-06T13:30:18,831 copying src/unitxt/catalog/cards/global_mmlu/te/medical_genetics.json -> build/lib/unitxt/catalog/cards/global_mmlu/te 2026-01-06T13:30:18,833 copying src/unitxt/catalog/cards/global_mmlu/te/security_studies.json -> build/lib/unitxt/catalog/cards/global_mmlu/te 2026-01-06T13:30:18,835 copying src/unitxt/catalog/cards/global_mmlu/te/high_school_macroeconomics.json -> build/lib/unitxt/catalog/cards/global_mmlu/te 2026-01-06T13:30:18,837 copying src/unitxt/catalog/cards/global_mmlu/te/professional_law.json -> build/lib/unitxt/catalog/cards/global_mmlu/te 2026-01-06T13:30:18,840 copying src/unitxt/catalog/cards/global_mmlu/te/high_school_physics.json -> build/lib/unitxt/catalog/cards/global_mmlu/te 2026-01-06T13:30:18,842 copying src/unitxt/catalog/cards/global_mmlu/te/econometrics.json -> build/lib/unitxt/catalog/cards/global_mmlu/te 2026-01-06T13:30:18,844 copying src/unitxt/catalog/cards/global_mmlu/te/sociology.json -> build/lib/unitxt/catalog/cards/global_mmlu/te 2026-01-06T13:30:18,846 copying src/unitxt/catalog/cards/global_mmlu/te/moral_disputes.json -> build/lib/unitxt/catalog/cards/global_mmlu/te 2026-01-06T13:30:18,848 copying src/unitxt/catalog/cards/global_mmlu/te/college_chemistry.json -> build/lib/unitxt/catalog/cards/global_mmlu/te 2026-01-06T13:30:18,851 copying src/unitxt/catalog/cards/global_mmlu/te/high_school_geography.json -> build/lib/unitxt/catalog/cards/global_mmlu/te 2026-01-06T13:30:18,853 copying src/unitxt/catalog/cards/global_mmlu/te/jurisprudence.json -> build/lib/unitxt/catalog/cards/global_mmlu/te 2026-01-06T13:30:18,855 copying src/unitxt/catalog/cards/global_mmlu/te/high_school_statistics.json -> build/lib/unitxt/catalog/cards/global_mmlu/te 2026-01-06T13:30:18,858 copying src/unitxt/catalog/cards/global_mmlu/te/professional_accounting.json -> build/lib/unitxt/catalog/cards/global_mmlu/te 2026-01-06T13:30:18,860 copying src/unitxt/catalog/cards/global_mmlu/te/us_foreign_policy.json -> build/lib/unitxt/catalog/cards/global_mmlu/te 2026-01-06T13:30:18,862 copying src/unitxt/catalog/cards/global_mmlu/te/professional_psychology.json -> build/lib/unitxt/catalog/cards/global_mmlu/te 2026-01-06T13:30:18,865 copying src/unitxt/catalog/cards/global_mmlu/te/public_relations.json -> build/lib/unitxt/catalog/cards/global_mmlu/te 2026-01-06T13:30:18,867 copying src/unitxt/catalog/cards/global_mmlu/te/computer_security.json -> build/lib/unitxt/catalog/cards/global_mmlu/te 2026-01-06T13:30:18,869 copying src/unitxt/catalog/cards/global_mmlu/te/philosophy.json -> build/lib/unitxt/catalog/cards/global_mmlu/te 2026-01-06T13:30:18,871 copying src/unitxt/catalog/cards/global_mmlu/te/virology.json -> build/lib/unitxt/catalog/cards/global_mmlu/te 2026-01-06T13:30:18,873 copying src/unitxt/catalog/cards/global_mmlu/te/marketing.json -> build/lib/unitxt/catalog/cards/global_mmlu/te 2026-01-06T13:30:18,876 copying src/unitxt/catalog/cards/global_mmlu/te/high_school_world_history.json -> build/lib/unitxt/catalog/cards/global_mmlu/te 2026-01-06T13:30:18,878 copying src/unitxt/catalog/cards/global_mmlu/te/machine_learning.json -> build/lib/unitxt/catalog/cards/global_mmlu/te 2026-01-06T13:30:18,880 copying src/unitxt/catalog/cards/global_mmlu/te/high_school_government_and_politics.json -> build/lib/unitxt/catalog/cards/global_mmlu/te 2026-01-06T13:30:18,882 copying src/unitxt/catalog/cards/global_mmlu/te/conceptual_physics.json -> build/lib/unitxt/catalog/cards/global_mmlu/te 2026-01-06T13:30:18,884 copying src/unitxt/catalog/cards/global_mmlu/te/college_biology.json -> build/lib/unitxt/catalog/cards/global_mmlu/te 2026-01-06T13:30:18,886 copying src/unitxt/catalog/cards/global_mmlu/te/high_school_mathematics.json -> build/lib/unitxt/catalog/cards/global_mmlu/te 2026-01-06T13:30:18,888 creating build/lib/unitxt/catalog/cards/global_mmlu/si 2026-01-06T13:30:18,889 copying src/unitxt/catalog/cards/global_mmlu/si/elementary_mathematics.json -> build/lib/unitxt/catalog/cards/global_mmlu/si 2026-01-06T13:30:18,892 copying src/unitxt/catalog/cards/global_mmlu/si/human_aging.json -> build/lib/unitxt/catalog/cards/global_mmlu/si 2026-01-06T13:30:18,894 copying src/unitxt/catalog/cards/global_mmlu/si/high_school_computer_science.json -> build/lib/unitxt/catalog/cards/global_mmlu/si 2026-01-06T13:30:18,896 copying src/unitxt/catalog/cards/global_mmlu/si/college_physics.json -> build/lib/unitxt/catalog/cards/global_mmlu/si 2026-01-06T13:30:18,898 copying src/unitxt/catalog/cards/global_mmlu/si/college_medicine.json -> build/lib/unitxt/catalog/cards/global_mmlu/si 2026-01-06T13:30:18,900 copying src/unitxt/catalog/cards/global_mmlu/si/college_mathematics.json -> build/lib/unitxt/catalog/cards/global_mmlu/si 2026-01-06T13:30:18,902 copying src/unitxt/catalog/cards/global_mmlu/si/high_school_microeconomics.json -> build/lib/unitxt/catalog/cards/global_mmlu/si 2026-01-06T13:30:18,904 copying src/unitxt/catalog/cards/global_mmlu/si/anatomy.json -> build/lib/unitxt/catalog/cards/global_mmlu/si 2026-01-06T13:30:18,906 copying src/unitxt/catalog/cards/global_mmlu/si/world_religions.json -> build/lib/unitxt/catalog/cards/global_mmlu/si 2026-01-06T13:30:18,909 copying src/unitxt/catalog/cards/global_mmlu/si/management.json -> build/lib/unitxt/catalog/cards/global_mmlu/si 2026-01-06T13:30:18,911 copying src/unitxt/catalog/cards/global_mmlu/si/moral_scenarios.json -> build/lib/unitxt/catalog/cards/global_mmlu/si 2026-01-06T13:30:18,913 copying src/unitxt/catalog/cards/global_mmlu/si/global_facts.json -> build/lib/unitxt/catalog/cards/global_mmlu/si 2026-01-06T13:30:18,916 copying src/unitxt/catalog/cards/global_mmlu/si/miscellaneous.json -> build/lib/unitxt/catalog/cards/global_mmlu/si 2026-01-06T13:30:18,918 copying src/unitxt/catalog/cards/global_mmlu/si/clinical_knowledge.json -> build/lib/unitxt/catalog/cards/global_mmlu/si 2026-01-06T13:30:18,920 copying src/unitxt/catalog/cards/global_mmlu/si/high_school_biology.json -> build/lib/unitxt/catalog/cards/global_mmlu/si 2026-01-06T13:30:18,922 copying src/unitxt/catalog/cards/global_mmlu/si/prehistory.json -> build/lib/unitxt/catalog/cards/global_mmlu/si 2026-01-06T13:30:18,924 copying src/unitxt/catalog/cards/global_mmlu/si/high_school_us_history.json -> build/lib/unitxt/catalog/cards/global_mmlu/si 2026-01-06T13:30:18,927 copying src/unitxt/catalog/cards/global_mmlu/si/international_law.json -> build/lib/unitxt/catalog/cards/global_mmlu/si 2026-01-06T13:30:18,929 copying src/unitxt/catalog/cards/global_mmlu/si/college_computer_science.json -> build/lib/unitxt/catalog/cards/global_mmlu/si 2026-01-06T13:30:18,931 copying src/unitxt/catalog/cards/global_mmlu/si/astronomy.json -> build/lib/unitxt/catalog/cards/global_mmlu/si 2026-01-06T13:30:18,933 copying src/unitxt/catalog/cards/global_mmlu/si/high_school_european_history.json -> build/lib/unitxt/catalog/cards/global_mmlu/si 2026-01-06T13:30:18,936 copying src/unitxt/catalog/cards/global_mmlu/si/electrical_engineering.json -> build/lib/unitxt/catalog/cards/global_mmlu/si 2026-01-06T13:30:18,938 copying src/unitxt/catalog/cards/global_mmlu/si/nutrition.json -> build/lib/unitxt/catalog/cards/global_mmlu/si 2026-01-06T13:30:18,940 copying src/unitxt/catalog/cards/global_mmlu/si/abstract_algebra.json -> build/lib/unitxt/catalog/cards/global_mmlu/si 2026-01-06T13:30:18,942 copying src/unitxt/catalog/cards/global_mmlu/si/professional_medicine.json -> build/lib/unitxt/catalog/cards/global_mmlu/si 2026-01-06T13:30:18,944 copying src/unitxt/catalog/cards/global_mmlu/si/human_sexuality.json -> build/lib/unitxt/catalog/cards/global_mmlu/si 2026-01-06T13:30:18,947 copying src/unitxt/catalog/cards/global_mmlu/si/business_ethics.json -> build/lib/unitxt/catalog/cards/global_mmlu/si 2026-01-06T13:30:18,949 copying src/unitxt/catalog/cards/global_mmlu/si/high_school_chemistry.json -> build/lib/unitxt/catalog/cards/global_mmlu/si 2026-01-06T13:30:18,951 copying src/unitxt/catalog/cards/global_mmlu/si/logical_fallacies.json -> build/lib/unitxt/catalog/cards/global_mmlu/si 2026-01-06T13:30:18,953 copying src/unitxt/catalog/cards/global_mmlu/si/formal_logic.json -> build/lib/unitxt/catalog/cards/global_mmlu/si 2026-01-06T13:30:18,955 copying src/unitxt/catalog/cards/global_mmlu/si/high_school_psychology.json -> build/lib/unitxt/catalog/cards/global_mmlu/si 2026-01-06T13:30:18,958 copying src/unitxt/catalog/cards/global_mmlu/si/medical_genetics.json -> build/lib/unitxt/catalog/cards/global_mmlu/si 2026-01-06T13:30:18,960 copying src/unitxt/catalog/cards/global_mmlu/si/security_studies.json -> build/lib/unitxt/catalog/cards/global_mmlu/si 2026-01-06T13:30:18,962 copying src/unitxt/catalog/cards/global_mmlu/si/high_school_macroeconomics.json -> build/lib/unitxt/catalog/cards/global_mmlu/si 2026-01-06T13:30:18,964 copying src/unitxt/catalog/cards/global_mmlu/si/professional_law.json -> build/lib/unitxt/catalog/cards/global_mmlu/si 2026-01-06T13:30:18,966 copying src/unitxt/catalog/cards/global_mmlu/si/high_school_physics.json -> build/lib/unitxt/catalog/cards/global_mmlu/si 2026-01-06T13:30:18,968 copying src/unitxt/catalog/cards/global_mmlu/si/econometrics.json -> build/lib/unitxt/catalog/cards/global_mmlu/si 2026-01-06T13:30:18,971 copying src/unitxt/catalog/cards/global_mmlu/si/sociology.json -> build/lib/unitxt/catalog/cards/global_mmlu/si 2026-01-06T13:30:18,973 copying src/unitxt/catalog/cards/global_mmlu/si/moral_disputes.json -> build/lib/unitxt/catalog/cards/global_mmlu/si 2026-01-06T13:30:18,975 copying src/unitxt/catalog/cards/global_mmlu/si/college_chemistry.json -> build/lib/unitxt/catalog/cards/global_mmlu/si 2026-01-06T13:30:18,977 copying src/unitxt/catalog/cards/global_mmlu/si/high_school_geography.json -> build/lib/unitxt/catalog/cards/global_mmlu/si 2026-01-06T13:30:18,979 copying src/unitxt/catalog/cards/global_mmlu/si/jurisprudence.json -> build/lib/unitxt/catalog/cards/global_mmlu/si 2026-01-06T13:30:18,982 copying src/unitxt/catalog/cards/global_mmlu/si/high_school_statistics.json -> build/lib/unitxt/catalog/cards/global_mmlu/si 2026-01-06T13:30:18,984 copying src/unitxt/catalog/cards/global_mmlu/si/professional_accounting.json -> build/lib/unitxt/catalog/cards/global_mmlu/si 2026-01-06T13:30:18,986 copying src/unitxt/catalog/cards/global_mmlu/si/us_foreign_policy.json -> build/lib/unitxt/catalog/cards/global_mmlu/si 2026-01-06T13:30:18,988 copying src/unitxt/catalog/cards/global_mmlu/si/professional_psychology.json -> build/lib/unitxt/catalog/cards/global_mmlu/si 2026-01-06T13:30:18,991 copying src/unitxt/catalog/cards/global_mmlu/si/public_relations.json -> build/lib/unitxt/catalog/cards/global_mmlu/si 2026-01-06T13:30:18,993 copying src/unitxt/catalog/cards/global_mmlu/si/computer_security.json -> build/lib/unitxt/catalog/cards/global_mmlu/si 2026-01-06T13:30:18,995 copying src/unitxt/catalog/cards/global_mmlu/si/philosophy.json -> build/lib/unitxt/catalog/cards/global_mmlu/si 2026-01-06T13:30:18,997 copying src/unitxt/catalog/cards/global_mmlu/si/virology.json -> build/lib/unitxt/catalog/cards/global_mmlu/si 2026-01-06T13:30:18,999 copying src/unitxt/catalog/cards/global_mmlu/si/marketing.json -> build/lib/unitxt/catalog/cards/global_mmlu/si 2026-01-06T13:30:19,002 copying src/unitxt/catalog/cards/global_mmlu/si/high_school_world_history.json -> build/lib/unitxt/catalog/cards/global_mmlu/si 2026-01-06T13:30:19,004 copying src/unitxt/catalog/cards/global_mmlu/si/machine_learning.json -> build/lib/unitxt/catalog/cards/global_mmlu/si 2026-01-06T13:30:19,006 copying src/unitxt/catalog/cards/global_mmlu/si/high_school_government_and_politics.json -> build/lib/unitxt/catalog/cards/global_mmlu/si 2026-01-06T13:30:19,008 copying src/unitxt/catalog/cards/global_mmlu/si/conceptual_physics.json -> build/lib/unitxt/catalog/cards/global_mmlu/si 2026-01-06T13:30:19,010 copying src/unitxt/catalog/cards/global_mmlu/si/college_biology.json -> build/lib/unitxt/catalog/cards/global_mmlu/si 2026-01-06T13:30:19,013 copying src/unitxt/catalog/cards/global_mmlu/si/high_school_mathematics.json -> build/lib/unitxt/catalog/cards/global_mmlu/si 2026-01-06T13:30:19,015 creating build/lib/unitxt/catalog/cards/global_mmlu/am 2026-01-06T13:30:19,016 copying src/unitxt/catalog/cards/global_mmlu/am/elementary_mathematics.json -> build/lib/unitxt/catalog/cards/global_mmlu/am 2026-01-06T13:30:19,018 copying src/unitxt/catalog/cards/global_mmlu/am/human_aging.json -> build/lib/unitxt/catalog/cards/global_mmlu/am 2026-01-06T13:30:19,020 copying src/unitxt/catalog/cards/global_mmlu/am/high_school_computer_science.json -> build/lib/unitxt/catalog/cards/global_mmlu/am 2026-01-06T13:30:19,022 copying src/unitxt/catalog/cards/global_mmlu/am/college_physics.json -> build/lib/unitxt/catalog/cards/global_mmlu/am 2026-01-06T13:30:19,024 copying src/unitxt/catalog/cards/global_mmlu/am/college_medicine.json -> build/lib/unitxt/catalog/cards/global_mmlu/am 2026-01-06T13:30:19,027 copying src/unitxt/catalog/cards/global_mmlu/am/college_mathematics.json -> build/lib/unitxt/catalog/cards/global_mmlu/am 2026-01-06T13:30:19,029 copying src/unitxt/catalog/cards/global_mmlu/am/high_school_microeconomics.json -> build/lib/unitxt/catalog/cards/global_mmlu/am 2026-01-06T13:30:19,031 copying src/unitxt/catalog/cards/global_mmlu/am/anatomy.json -> build/lib/unitxt/catalog/cards/global_mmlu/am 2026-01-06T13:30:19,034 copying src/unitxt/catalog/cards/global_mmlu/am/world_religions.json -> build/lib/unitxt/catalog/cards/global_mmlu/am 2026-01-06T13:30:19,036 copying src/unitxt/catalog/cards/global_mmlu/am/management.json -> build/lib/unitxt/catalog/cards/global_mmlu/am 2026-01-06T13:30:19,039 copying src/unitxt/catalog/cards/global_mmlu/am/moral_scenarios.json -> build/lib/unitxt/catalog/cards/global_mmlu/am 2026-01-06T13:30:19,041 copying src/unitxt/catalog/cards/global_mmlu/am/global_facts.json -> build/lib/unitxt/catalog/cards/global_mmlu/am 2026-01-06T13:30:19,043 copying src/unitxt/catalog/cards/global_mmlu/am/miscellaneous.json -> build/lib/unitxt/catalog/cards/global_mmlu/am 2026-01-06T13:30:19,045 copying src/unitxt/catalog/cards/global_mmlu/am/clinical_knowledge.json -> build/lib/unitxt/catalog/cards/global_mmlu/am 2026-01-06T13:30:19,048 copying src/unitxt/catalog/cards/global_mmlu/am/high_school_biology.json -> build/lib/unitxt/catalog/cards/global_mmlu/am 2026-01-06T13:30:19,050 copying src/unitxt/catalog/cards/global_mmlu/am/prehistory.json -> build/lib/unitxt/catalog/cards/global_mmlu/am 2026-01-06T13:30:19,053 copying src/unitxt/catalog/cards/global_mmlu/am/high_school_us_history.json -> build/lib/unitxt/catalog/cards/global_mmlu/am 2026-01-06T13:30:19,055 copying src/unitxt/catalog/cards/global_mmlu/am/international_law.json -> build/lib/unitxt/catalog/cards/global_mmlu/am 2026-01-06T13:30:19,057 copying src/unitxt/catalog/cards/global_mmlu/am/college_computer_science.json -> build/lib/unitxt/catalog/cards/global_mmlu/am 2026-01-06T13:30:19,059 copying src/unitxt/catalog/cards/global_mmlu/am/astronomy.json -> build/lib/unitxt/catalog/cards/global_mmlu/am 2026-01-06T13:30:19,061 copying src/unitxt/catalog/cards/global_mmlu/am/high_school_european_history.json -> build/lib/unitxt/catalog/cards/global_mmlu/am 2026-01-06T13:30:19,064 copying src/unitxt/catalog/cards/global_mmlu/am/electrical_engineering.json -> build/lib/unitxt/catalog/cards/global_mmlu/am 2026-01-06T13:30:19,066 copying src/unitxt/catalog/cards/global_mmlu/am/nutrition.json -> build/lib/unitxt/catalog/cards/global_mmlu/am 2026-01-06T13:30:19,068 copying src/unitxt/catalog/cards/global_mmlu/am/abstract_algebra.json -> build/lib/unitxt/catalog/cards/global_mmlu/am 2026-01-06T13:30:19,070 copying src/unitxt/catalog/cards/global_mmlu/am/professional_medicine.json -> build/lib/unitxt/catalog/cards/global_mmlu/am 2026-01-06T13:30:19,072 copying src/unitxt/catalog/cards/global_mmlu/am/human_sexuality.json -> build/lib/unitxt/catalog/cards/global_mmlu/am 2026-01-06T13:30:19,075 copying src/unitxt/catalog/cards/global_mmlu/am/business_ethics.json -> build/lib/unitxt/catalog/cards/global_mmlu/am 2026-01-06T13:30:19,077 copying src/unitxt/catalog/cards/global_mmlu/am/high_school_chemistry.json -> build/lib/unitxt/catalog/cards/global_mmlu/am 2026-01-06T13:30:19,079 copying src/unitxt/catalog/cards/global_mmlu/am/logical_fallacies.json -> build/lib/unitxt/catalog/cards/global_mmlu/am 2026-01-06T13:30:19,081 copying src/unitxt/catalog/cards/global_mmlu/am/formal_logic.json -> build/lib/unitxt/catalog/cards/global_mmlu/am 2026-01-06T13:30:19,083 copying src/unitxt/catalog/cards/global_mmlu/am/high_school_psychology.json -> build/lib/unitxt/catalog/cards/global_mmlu/am 2026-01-06T13:30:19,085 copying src/unitxt/catalog/cards/global_mmlu/am/medical_genetics.json -> build/lib/unitxt/catalog/cards/global_mmlu/am 2026-01-06T13:30:19,088 copying src/unitxt/catalog/cards/global_mmlu/am/security_studies.json -> build/lib/unitxt/catalog/cards/global_mmlu/am 2026-01-06T13:30:19,090 copying src/unitxt/catalog/cards/global_mmlu/am/high_school_macroeconomics.json -> build/lib/unitxt/catalog/cards/global_mmlu/am 2026-01-06T13:30:19,092 copying src/unitxt/catalog/cards/global_mmlu/am/professional_law.json -> build/lib/unitxt/catalog/cards/global_mmlu/am 2026-01-06T13:30:19,094 copying src/unitxt/catalog/cards/global_mmlu/am/high_school_physics.json -> build/lib/unitxt/catalog/cards/global_mmlu/am 2026-01-06T13:30:19,097 copying src/unitxt/catalog/cards/global_mmlu/am/econometrics.json -> build/lib/unitxt/catalog/cards/global_mmlu/am 2026-01-06T13:30:19,099 copying src/unitxt/catalog/cards/global_mmlu/am/sociology.json -> build/lib/unitxt/catalog/cards/global_mmlu/am 2026-01-06T13:30:19,101 copying src/unitxt/catalog/cards/global_mmlu/am/moral_disputes.json -> build/lib/unitxt/catalog/cards/global_mmlu/am 2026-01-06T13:30:19,104 copying src/unitxt/catalog/cards/global_mmlu/am/college_chemistry.json -> build/lib/unitxt/catalog/cards/global_mmlu/am 2026-01-06T13:30:19,106 copying src/unitxt/catalog/cards/global_mmlu/am/high_school_geography.json -> build/lib/unitxt/catalog/cards/global_mmlu/am 2026-01-06T13:30:19,108 copying src/unitxt/catalog/cards/global_mmlu/am/jurisprudence.json -> build/lib/unitxt/catalog/cards/global_mmlu/am 2026-01-06T13:30:19,110 copying src/unitxt/catalog/cards/global_mmlu/am/high_school_statistics.json -> build/lib/unitxt/catalog/cards/global_mmlu/am 2026-01-06T13:30:19,113 copying src/unitxt/catalog/cards/global_mmlu/am/professional_accounting.json -> build/lib/unitxt/catalog/cards/global_mmlu/am 2026-01-06T13:30:19,115 copying src/unitxt/catalog/cards/global_mmlu/am/us_foreign_policy.json -> build/lib/unitxt/catalog/cards/global_mmlu/am 2026-01-06T13:30:19,117 copying src/unitxt/catalog/cards/global_mmlu/am/professional_psychology.json -> build/lib/unitxt/catalog/cards/global_mmlu/am 2026-01-06T13:30:19,120 copying src/unitxt/catalog/cards/global_mmlu/am/public_relations.json -> build/lib/unitxt/catalog/cards/global_mmlu/am 2026-01-06T13:30:19,122 copying src/unitxt/catalog/cards/global_mmlu/am/computer_security.json -> build/lib/unitxt/catalog/cards/global_mmlu/am 2026-01-06T13:30:19,124 copying src/unitxt/catalog/cards/global_mmlu/am/philosophy.json -> build/lib/unitxt/catalog/cards/global_mmlu/am 2026-01-06T13:30:19,126 copying src/unitxt/catalog/cards/global_mmlu/am/virology.json -> build/lib/unitxt/catalog/cards/global_mmlu/am 2026-01-06T13:30:19,128 copying src/unitxt/catalog/cards/global_mmlu/am/marketing.json -> build/lib/unitxt/catalog/cards/global_mmlu/am 2026-01-06T13:30:19,130 copying src/unitxt/catalog/cards/global_mmlu/am/high_school_world_history.json -> build/lib/unitxt/catalog/cards/global_mmlu/am 2026-01-06T13:30:19,133 copying src/unitxt/catalog/cards/global_mmlu/am/machine_learning.json -> build/lib/unitxt/catalog/cards/global_mmlu/am 2026-01-06T13:30:19,135 copying src/unitxt/catalog/cards/global_mmlu/am/high_school_government_and_politics.json -> build/lib/unitxt/catalog/cards/global_mmlu/am 2026-01-06T13:30:19,137 copying src/unitxt/catalog/cards/global_mmlu/am/conceptual_physics.json -> build/lib/unitxt/catalog/cards/global_mmlu/am 2026-01-06T13:30:19,139 copying src/unitxt/catalog/cards/global_mmlu/am/college_biology.json -> build/lib/unitxt/catalog/cards/global_mmlu/am 2026-01-06T13:30:19,141 copying src/unitxt/catalog/cards/global_mmlu/am/high_school_mathematics.json -> build/lib/unitxt/catalog/cards/global_mmlu/am 2026-01-06T13:30:19,143 creating build/lib/unitxt/catalog/cards/global_mmlu/sn 2026-01-06T13:30:19,144 copying src/unitxt/catalog/cards/global_mmlu/sn/elementary_mathematics.json -> build/lib/unitxt/catalog/cards/global_mmlu/sn 2026-01-06T13:30:19,146 copying src/unitxt/catalog/cards/global_mmlu/sn/human_aging.json -> build/lib/unitxt/catalog/cards/global_mmlu/sn 2026-01-06T13:30:19,148 copying src/unitxt/catalog/cards/global_mmlu/sn/high_school_computer_science.json -> build/lib/unitxt/catalog/cards/global_mmlu/sn 2026-01-06T13:30:19,151 copying src/unitxt/catalog/cards/global_mmlu/sn/college_physics.json -> build/lib/unitxt/catalog/cards/global_mmlu/sn 2026-01-06T13:30:19,153 copying src/unitxt/catalog/cards/global_mmlu/sn/college_medicine.json -> build/lib/unitxt/catalog/cards/global_mmlu/sn 2026-01-06T13:30:19,155 copying src/unitxt/catalog/cards/global_mmlu/sn/college_mathematics.json -> build/lib/unitxt/catalog/cards/global_mmlu/sn 2026-01-06T13:30:19,157 copying src/unitxt/catalog/cards/global_mmlu/sn/high_school_microeconomics.json -> build/lib/unitxt/catalog/cards/global_mmlu/sn 2026-01-06T13:30:19,159 copying src/unitxt/catalog/cards/global_mmlu/sn/anatomy.json -> build/lib/unitxt/catalog/cards/global_mmlu/sn 2026-01-06T13:30:19,162 copying src/unitxt/catalog/cards/global_mmlu/sn/world_religions.json -> build/lib/unitxt/catalog/cards/global_mmlu/sn 2026-01-06T13:30:19,164 copying src/unitxt/catalog/cards/global_mmlu/sn/management.json -> build/lib/unitxt/catalog/cards/global_mmlu/sn 2026-01-06T13:30:19,166 copying src/unitxt/catalog/cards/global_mmlu/sn/moral_scenarios.json -> build/lib/unitxt/catalog/cards/global_mmlu/sn 2026-01-06T13:30:19,169 copying src/unitxt/catalog/cards/global_mmlu/sn/global_facts.json -> build/lib/unitxt/catalog/cards/global_mmlu/sn 2026-01-06T13:30:19,171 copying src/unitxt/catalog/cards/global_mmlu/sn/miscellaneous.json -> build/lib/unitxt/catalog/cards/global_mmlu/sn 2026-01-06T13:30:19,173 copying src/unitxt/catalog/cards/global_mmlu/sn/clinical_knowledge.json -> build/lib/unitxt/catalog/cards/global_mmlu/sn 2026-01-06T13:30:19,176 copying src/unitxt/catalog/cards/global_mmlu/sn/high_school_biology.json -> build/lib/unitxt/catalog/cards/global_mmlu/sn 2026-01-06T13:30:19,178 copying src/unitxt/catalog/cards/global_mmlu/sn/prehistory.json -> build/lib/unitxt/catalog/cards/global_mmlu/sn 2026-01-06T13:30:19,180 copying src/unitxt/catalog/cards/global_mmlu/sn/high_school_us_history.json -> build/lib/unitxt/catalog/cards/global_mmlu/sn 2026-01-06T13:30:19,183 copying src/unitxt/catalog/cards/global_mmlu/sn/international_law.json -> build/lib/unitxt/catalog/cards/global_mmlu/sn 2026-01-06T13:30:19,185 copying src/unitxt/catalog/cards/global_mmlu/sn/college_computer_science.json -> build/lib/unitxt/catalog/cards/global_mmlu/sn 2026-01-06T13:30:19,187 copying src/unitxt/catalog/cards/global_mmlu/sn/astronomy.json -> build/lib/unitxt/catalog/cards/global_mmlu/sn 2026-01-06T13:30:19,190 copying src/unitxt/catalog/cards/global_mmlu/sn/high_school_european_history.json -> build/lib/unitxt/catalog/cards/global_mmlu/sn 2026-01-06T13:30:19,192 copying src/unitxt/catalog/cards/global_mmlu/sn/electrical_engineering.json -> build/lib/unitxt/catalog/cards/global_mmlu/sn 2026-01-06T13:30:19,194 copying src/unitxt/catalog/cards/global_mmlu/sn/nutrition.json -> build/lib/unitxt/catalog/cards/global_mmlu/sn 2026-01-06T13:30:19,196 copying src/unitxt/catalog/cards/global_mmlu/sn/abstract_algebra.json -> build/lib/unitxt/catalog/cards/global_mmlu/sn 2026-01-06T13:30:19,198 copying src/unitxt/catalog/cards/global_mmlu/sn/professional_medicine.json -> build/lib/unitxt/catalog/cards/global_mmlu/sn 2026-01-06T13:30:19,200 copying src/unitxt/catalog/cards/global_mmlu/sn/human_sexuality.json -> build/lib/unitxt/catalog/cards/global_mmlu/sn 2026-01-06T13:30:19,202 copying src/unitxt/catalog/cards/global_mmlu/sn/business_ethics.json -> build/lib/unitxt/catalog/cards/global_mmlu/sn 2026-01-06T13:30:19,205 copying src/unitxt/catalog/cards/global_mmlu/sn/high_school_chemistry.json -> build/lib/unitxt/catalog/cards/global_mmlu/sn 2026-01-06T13:30:19,207 copying src/unitxt/catalog/cards/global_mmlu/sn/logical_fallacies.json -> build/lib/unitxt/catalog/cards/global_mmlu/sn 2026-01-06T13:30:19,209 copying src/unitxt/catalog/cards/global_mmlu/sn/formal_logic.json -> build/lib/unitxt/catalog/cards/global_mmlu/sn 2026-01-06T13:30:19,211 copying src/unitxt/catalog/cards/global_mmlu/sn/high_school_psychology.json -> build/lib/unitxt/catalog/cards/global_mmlu/sn 2026-01-06T13:30:19,214 copying src/unitxt/catalog/cards/global_mmlu/sn/medical_genetics.json -> build/lib/unitxt/catalog/cards/global_mmlu/sn 2026-01-06T13:30:19,217 copying src/unitxt/catalog/cards/global_mmlu/sn/security_studies.json -> build/lib/unitxt/catalog/cards/global_mmlu/sn 2026-01-06T13:30:19,219 copying src/unitxt/catalog/cards/global_mmlu/sn/high_school_macroeconomics.json -> build/lib/unitxt/catalog/cards/global_mmlu/sn 2026-01-06T13:30:19,221 copying src/unitxt/catalog/cards/global_mmlu/sn/professional_law.json -> build/lib/unitxt/catalog/cards/global_mmlu/sn 2026-01-06T13:30:19,224 copying src/unitxt/catalog/cards/global_mmlu/sn/high_school_physics.json -> build/lib/unitxt/catalog/cards/global_mmlu/sn 2026-01-06T13:30:19,226 copying src/unitxt/catalog/cards/global_mmlu/sn/econometrics.json -> build/lib/unitxt/catalog/cards/global_mmlu/sn 2026-01-06T13:30:19,228 copying src/unitxt/catalog/cards/global_mmlu/sn/sociology.json -> build/lib/unitxt/catalog/cards/global_mmlu/sn 2026-01-06T13:30:19,231 copying src/unitxt/catalog/cards/global_mmlu/sn/moral_disputes.json -> build/lib/unitxt/catalog/cards/global_mmlu/sn 2026-01-06T13:30:19,233 copying src/unitxt/catalog/cards/global_mmlu/sn/college_chemistry.json -> build/lib/unitxt/catalog/cards/global_mmlu/sn 2026-01-06T13:30:19,235 copying src/unitxt/catalog/cards/global_mmlu/sn/high_school_geography.json -> build/lib/unitxt/catalog/cards/global_mmlu/sn 2026-01-06T13:30:19,237 copying src/unitxt/catalog/cards/global_mmlu/sn/jurisprudence.json -> build/lib/unitxt/catalog/cards/global_mmlu/sn 2026-01-06T13:30:19,240 copying src/unitxt/catalog/cards/global_mmlu/sn/high_school_statistics.json -> build/lib/unitxt/catalog/cards/global_mmlu/sn 2026-01-06T13:30:19,242 copying src/unitxt/catalog/cards/global_mmlu/sn/professional_accounting.json -> build/lib/unitxt/catalog/cards/global_mmlu/sn 2026-01-06T13:30:19,245 copying src/unitxt/catalog/cards/global_mmlu/sn/us_foreign_policy.json -> build/lib/unitxt/catalog/cards/global_mmlu/sn 2026-01-06T13:30:19,247 copying src/unitxt/catalog/cards/global_mmlu/sn/professional_psychology.json -> build/lib/unitxt/catalog/cards/global_mmlu/sn 2026-01-06T13:30:19,250 copying src/unitxt/catalog/cards/global_mmlu/sn/public_relations.json -> build/lib/unitxt/catalog/cards/global_mmlu/sn 2026-01-06T13:30:19,252 copying src/unitxt/catalog/cards/global_mmlu/sn/computer_security.json -> build/lib/unitxt/catalog/cards/global_mmlu/sn 2026-01-06T13:30:19,255 copying src/unitxt/catalog/cards/global_mmlu/sn/philosophy.json -> build/lib/unitxt/catalog/cards/global_mmlu/sn 2026-01-06T13:30:19,257 copying src/unitxt/catalog/cards/global_mmlu/sn/virology.json -> build/lib/unitxt/catalog/cards/global_mmlu/sn 2026-01-06T13:30:19,259 copying src/unitxt/catalog/cards/global_mmlu/sn/marketing.json -> build/lib/unitxt/catalog/cards/global_mmlu/sn 2026-01-06T13:30:19,261 copying src/unitxt/catalog/cards/global_mmlu/sn/high_school_world_history.json -> build/lib/unitxt/catalog/cards/global_mmlu/sn 2026-01-06T13:30:19,263 copying src/unitxt/catalog/cards/global_mmlu/sn/machine_learning.json -> build/lib/unitxt/catalog/cards/global_mmlu/sn 2026-01-06T13:30:19,266 copying src/unitxt/catalog/cards/global_mmlu/sn/high_school_government_and_politics.json -> build/lib/unitxt/catalog/cards/global_mmlu/sn 2026-01-06T13:30:19,268 copying src/unitxt/catalog/cards/global_mmlu/sn/conceptual_physics.json -> build/lib/unitxt/catalog/cards/global_mmlu/sn 2026-01-06T13:30:19,270 copying src/unitxt/catalog/cards/global_mmlu/sn/college_biology.json -> build/lib/unitxt/catalog/cards/global_mmlu/sn 2026-01-06T13:30:19,272 copying src/unitxt/catalog/cards/global_mmlu/sn/high_school_mathematics.json -> build/lib/unitxt/catalog/cards/global_mmlu/sn 2026-01-06T13:30:19,275 creating build/lib/unitxt/catalog/cards/global_mmlu/sw 2026-01-06T13:30:19,275 copying src/unitxt/catalog/cards/global_mmlu/sw/elementary_mathematics.json -> build/lib/unitxt/catalog/cards/global_mmlu/sw 2026-01-06T13:30:19,278 copying src/unitxt/catalog/cards/global_mmlu/sw/human_aging.json -> build/lib/unitxt/catalog/cards/global_mmlu/sw 2026-01-06T13:30:19,280 copying src/unitxt/catalog/cards/global_mmlu/sw/high_school_computer_science.json -> build/lib/unitxt/catalog/cards/global_mmlu/sw 2026-01-06T13:30:19,282 copying src/unitxt/catalog/cards/global_mmlu/sw/college_physics.json -> build/lib/unitxt/catalog/cards/global_mmlu/sw 2026-01-06T13:30:19,284 copying src/unitxt/catalog/cards/global_mmlu/sw/college_medicine.json -> build/lib/unitxt/catalog/cards/global_mmlu/sw 2026-01-06T13:30:19,287 copying src/unitxt/catalog/cards/global_mmlu/sw/college_mathematics.json -> build/lib/unitxt/catalog/cards/global_mmlu/sw 2026-01-06T13:30:19,289 copying src/unitxt/catalog/cards/global_mmlu/sw/high_school_microeconomics.json -> build/lib/unitxt/catalog/cards/global_mmlu/sw 2026-01-06T13:30:19,291 copying src/unitxt/catalog/cards/global_mmlu/sw/anatomy.json -> build/lib/unitxt/catalog/cards/global_mmlu/sw 2026-01-06T13:30:19,293 copying src/unitxt/catalog/cards/global_mmlu/sw/world_religions.json -> build/lib/unitxt/catalog/cards/global_mmlu/sw 2026-01-06T13:30:19,296 copying src/unitxt/catalog/cards/global_mmlu/sw/management.json -> build/lib/unitxt/catalog/cards/global_mmlu/sw 2026-01-06T13:30:19,298 copying src/unitxt/catalog/cards/global_mmlu/sw/moral_scenarios.json -> build/lib/unitxt/catalog/cards/global_mmlu/sw 2026-01-06T13:30:19,300 copying src/unitxt/catalog/cards/global_mmlu/sw/global_facts.json -> build/lib/unitxt/catalog/cards/global_mmlu/sw 2026-01-06T13:30:19,303 copying src/unitxt/catalog/cards/global_mmlu/sw/miscellaneous.json -> build/lib/unitxt/catalog/cards/global_mmlu/sw 2026-01-06T13:30:19,305 copying src/unitxt/catalog/cards/global_mmlu/sw/clinical_knowledge.json -> build/lib/unitxt/catalog/cards/global_mmlu/sw 2026-01-06T13:30:19,307 copying src/unitxt/catalog/cards/global_mmlu/sw/high_school_biology.json -> build/lib/unitxt/catalog/cards/global_mmlu/sw 2026-01-06T13:30:19,309 copying src/unitxt/catalog/cards/global_mmlu/sw/prehistory.json -> build/lib/unitxt/catalog/cards/global_mmlu/sw 2026-01-06T13:30:19,312 copying src/unitxt/catalog/cards/global_mmlu/sw/high_school_us_history.json -> build/lib/unitxt/catalog/cards/global_mmlu/sw 2026-01-06T13:30:19,314 copying src/unitxt/catalog/cards/global_mmlu/sw/international_law.json -> build/lib/unitxt/catalog/cards/global_mmlu/sw 2026-01-06T13:30:19,316 copying src/unitxt/catalog/cards/global_mmlu/sw/college_computer_science.json -> build/lib/unitxt/catalog/cards/global_mmlu/sw 2026-01-06T13:30:19,318 copying src/unitxt/catalog/cards/global_mmlu/sw/astronomy.json -> build/lib/unitxt/catalog/cards/global_mmlu/sw 2026-01-06T13:30:19,321 copying src/unitxt/catalog/cards/global_mmlu/sw/high_school_european_history.json -> build/lib/unitxt/catalog/cards/global_mmlu/sw 2026-01-06T13:30:19,323 copying src/unitxt/catalog/cards/global_mmlu/sw/electrical_engineering.json -> build/lib/unitxt/catalog/cards/global_mmlu/sw 2026-01-06T13:30:19,326 copying src/unitxt/catalog/cards/global_mmlu/sw/nutrition.json -> build/lib/unitxt/catalog/cards/global_mmlu/sw 2026-01-06T13:30:19,329 copying src/unitxt/catalog/cards/global_mmlu/sw/abstract_algebra.json -> build/lib/unitxt/catalog/cards/global_mmlu/sw 2026-01-06T13:30:19,331 copying src/unitxt/catalog/cards/global_mmlu/sw/professional_medicine.json -> build/lib/unitxt/catalog/cards/global_mmlu/sw 2026-01-06T13:30:19,333 copying src/unitxt/catalog/cards/global_mmlu/sw/human_sexuality.json -> build/lib/unitxt/catalog/cards/global_mmlu/sw 2026-01-06T13:30:19,336 copying src/unitxt/catalog/cards/global_mmlu/sw/business_ethics.json -> build/lib/unitxt/catalog/cards/global_mmlu/sw 2026-01-06T13:30:19,338 copying src/unitxt/catalog/cards/global_mmlu/sw/high_school_chemistry.json -> build/lib/unitxt/catalog/cards/global_mmlu/sw 2026-01-06T13:30:19,340 copying src/unitxt/catalog/cards/global_mmlu/sw/logical_fallacies.json -> build/lib/unitxt/catalog/cards/global_mmlu/sw 2026-01-06T13:30:19,343 copying src/unitxt/catalog/cards/global_mmlu/sw/formal_logic.json -> build/lib/unitxt/catalog/cards/global_mmlu/sw 2026-01-06T13:30:19,345 copying src/unitxt/catalog/cards/global_mmlu/sw/high_school_psychology.json -> build/lib/unitxt/catalog/cards/global_mmlu/sw 2026-01-06T13:30:19,347 copying src/unitxt/catalog/cards/global_mmlu/sw/medical_genetics.json -> build/lib/unitxt/catalog/cards/global_mmlu/sw 2026-01-06T13:30:19,349 copying src/unitxt/catalog/cards/global_mmlu/sw/security_studies.json -> build/lib/unitxt/catalog/cards/global_mmlu/sw 2026-01-06T13:30:19,352 copying src/unitxt/catalog/cards/global_mmlu/sw/high_school_macroeconomics.json -> build/lib/unitxt/catalog/cards/global_mmlu/sw 2026-01-06T13:30:19,354 copying src/unitxt/catalog/cards/global_mmlu/sw/professional_law.json -> build/lib/unitxt/catalog/cards/global_mmlu/sw 2026-01-06T13:30:19,356 copying src/unitxt/catalog/cards/global_mmlu/sw/high_school_physics.json -> build/lib/unitxt/catalog/cards/global_mmlu/sw 2026-01-06T13:30:19,358 copying src/unitxt/catalog/cards/global_mmlu/sw/econometrics.json -> build/lib/unitxt/catalog/cards/global_mmlu/sw 2026-01-06T13:30:19,361 copying src/unitxt/catalog/cards/global_mmlu/sw/sociology.json -> build/lib/unitxt/catalog/cards/global_mmlu/sw 2026-01-06T13:30:19,363 copying src/unitxt/catalog/cards/global_mmlu/sw/moral_disputes.json -> build/lib/unitxt/catalog/cards/global_mmlu/sw 2026-01-06T13:30:19,365 copying src/unitxt/catalog/cards/global_mmlu/sw/college_chemistry.json -> build/lib/unitxt/catalog/cards/global_mmlu/sw 2026-01-06T13:30:19,368 copying src/unitxt/catalog/cards/global_mmlu/sw/high_school_geography.json -> build/lib/unitxt/catalog/cards/global_mmlu/sw 2026-01-06T13:30:19,370 copying src/unitxt/catalog/cards/global_mmlu/sw/jurisprudence.json -> build/lib/unitxt/catalog/cards/global_mmlu/sw 2026-01-06T13:30:19,372 copying src/unitxt/catalog/cards/global_mmlu/sw/high_school_statistics.json -> build/lib/unitxt/catalog/cards/global_mmlu/sw 2026-01-06T13:30:19,374 copying src/unitxt/catalog/cards/global_mmlu/sw/professional_accounting.json -> build/lib/unitxt/catalog/cards/global_mmlu/sw 2026-01-06T13:30:19,377 copying src/unitxt/catalog/cards/global_mmlu/sw/us_foreign_policy.json -> build/lib/unitxt/catalog/cards/global_mmlu/sw 2026-01-06T13:30:19,379 copying src/unitxt/catalog/cards/global_mmlu/sw/professional_psychology.json -> build/lib/unitxt/catalog/cards/global_mmlu/sw 2026-01-06T13:30:19,381 copying src/unitxt/catalog/cards/global_mmlu/sw/public_relations.json -> build/lib/unitxt/catalog/cards/global_mmlu/sw 2026-01-06T13:30:19,383 copying src/unitxt/catalog/cards/global_mmlu/sw/computer_security.json -> build/lib/unitxt/catalog/cards/global_mmlu/sw 2026-01-06T13:30:19,385 copying src/unitxt/catalog/cards/global_mmlu/sw/philosophy.json -> build/lib/unitxt/catalog/cards/global_mmlu/sw 2026-01-06T13:30:19,387 copying src/unitxt/catalog/cards/global_mmlu/sw/virology.json -> build/lib/unitxt/catalog/cards/global_mmlu/sw 2026-01-06T13:30:19,390 copying src/unitxt/catalog/cards/global_mmlu/sw/marketing.json -> build/lib/unitxt/catalog/cards/global_mmlu/sw 2026-01-06T13:30:19,392 copying src/unitxt/catalog/cards/global_mmlu/sw/high_school_world_history.json -> build/lib/unitxt/catalog/cards/global_mmlu/sw 2026-01-06T13:30:19,394 copying src/unitxt/catalog/cards/global_mmlu/sw/machine_learning.json -> build/lib/unitxt/catalog/cards/global_mmlu/sw 2026-01-06T13:30:19,396 copying src/unitxt/catalog/cards/global_mmlu/sw/high_school_government_and_politics.json -> build/lib/unitxt/catalog/cards/global_mmlu/sw 2026-01-06T13:30:19,398 copying src/unitxt/catalog/cards/global_mmlu/sw/conceptual_physics.json -> build/lib/unitxt/catalog/cards/global_mmlu/sw 2026-01-06T13:30:19,401 copying src/unitxt/catalog/cards/global_mmlu/sw/college_biology.json -> build/lib/unitxt/catalog/cards/global_mmlu/sw 2026-01-06T13:30:19,403 copying src/unitxt/catalog/cards/global_mmlu/sw/high_school_mathematics.json -> build/lib/unitxt/catalog/cards/global_mmlu/sw 2026-01-06T13:30:19,405 creating build/lib/unitxt/catalog/cards/tablebench_numerical_reasoning 2026-01-06T13:30:19,406 copying src/unitxt/catalog/cards/tablebench_numerical_reasoning/legacy.json -> build/lib/unitxt/catalog/cards/tablebench_numerical_reasoning 2026-01-06T13:30:19,408 creating build/lib/unitxt/catalog/cards/20_newsgroups 2026-01-06T13:30:19,409 copying src/unitxt/catalog/cards/20_newsgroups/sklearn.json -> build/lib/unitxt/catalog/cards/20_newsgroups 2026-01-06T13:30:19,411 creating build/lib/unitxt/catalog/cards/boolq 2026-01-06T13:30:19,412 copying src/unitxt/catalog/cards/boolq/classification.json -> build/lib/unitxt/catalog/cards/boolq 2026-01-06T13:30:19,415 copying src/unitxt/catalog/cards/boolq/multiple_choice.json -> build/lib/unitxt/catalog/cards/boolq 2026-01-06T13:30:19,417 creating build/lib/unitxt/catalog/cards/reuters21578 2026-01-06T13:30:19,418 copying src/unitxt/catalog/cards/reuters21578/ModApte.json -> build/lib/unitxt/catalog/cards/reuters21578 2026-01-06T13:30:19,420 copying src/unitxt/catalog/cards/reuters21578/ModHayes.json -> build/lib/unitxt/catalog/cards/reuters21578 2026-01-06T13:30:19,423 copying src/unitxt/catalog/cards/reuters21578/ModLewis.json -> build/lib/unitxt/catalog/cards/reuters21578 2026-01-06T13:30:19,425 creating build/lib/unitxt/catalog/cards/ai2_arc 2026-01-06T13:30:19,426 copying src/unitxt/catalog/cards/ai2_arc/arc_challenge.json -> build/lib/unitxt/catalog/cards/ai2_arc 2026-01-06T13:30:19,429 copying src/unitxt/catalog/cards/ai2_arc/arc_easy.json -> build/lib/unitxt/catalog/cards/ai2_arc 2026-01-06T13:30:19,431 creating build/lib/unitxt/catalog/cards/global_mmlu_lite_ca 2026-01-06T13:30:19,432 copying src/unitxt/catalog/cards/global_mmlu_lite_ca/zh.json -> build/lib/unitxt/catalog/cards/global_mmlu_lite_ca 2026-01-06T13:30:19,435 copying src/unitxt/catalog/cards/global_mmlu_lite_ca/it.json -> build/lib/unitxt/catalog/cards/global_mmlu_lite_ca 2026-01-06T13:30:19,437 copying src/unitxt/catalog/cards/global_mmlu_lite_ca/ar.json -> build/lib/unitxt/catalog/cards/global_mmlu_lite_ca 2026-01-06T13:30:19,440 copying src/unitxt/catalog/cards/global_mmlu_lite_ca/bn.json -> build/lib/unitxt/catalog/cards/global_mmlu_lite_ca 2026-01-06T13:30:19,442 copying src/unitxt/catalog/cards/global_mmlu_lite_ca/yo.json -> build/lib/unitxt/catalog/cards/global_mmlu_lite_ca 2026-01-06T13:30:19,445 copying src/unitxt/catalog/cards/global_mmlu_lite_ca/es.json -> build/lib/unitxt/catalog/cards/global_mmlu_lite_ca 2026-01-06T13:30:19,447 copying src/unitxt/catalog/cards/global_mmlu_lite_ca/ja.json -> build/lib/unitxt/catalog/cards/global_mmlu_lite_ca 2026-01-06T13:30:19,450 copying src/unitxt/catalog/cards/global_mmlu_lite_ca/ko.json -> build/lib/unitxt/catalog/cards/global_mmlu_lite_ca 2026-01-06T13:30:19,452 copying src/unitxt/catalog/cards/global_mmlu_lite_ca/pt.json -> build/lib/unitxt/catalog/cards/global_mmlu_lite_ca 2026-01-06T13:30:19,455 copying src/unitxt/catalog/cards/global_mmlu_lite_ca/id.json -> build/lib/unitxt/catalog/cards/global_mmlu_lite_ca 2026-01-06T13:30:19,457 copying src/unitxt/catalog/cards/global_mmlu_lite_ca/de.json -> build/lib/unitxt/catalog/cards/global_mmlu_lite_ca 2026-01-06T13:30:19,460 copying src/unitxt/catalog/cards/global_mmlu_lite_ca/fr.json -> build/lib/unitxt/catalog/cards/global_mmlu_lite_ca 2026-01-06T13:30:19,462 copying src/unitxt/catalog/cards/global_mmlu_lite_ca/sw.json -> build/lib/unitxt/catalog/cards/global_mmlu_lite_ca 2026-01-06T13:30:19,465 copying src/unitxt/catalog/cards/global_mmlu_lite_ca/hi.json -> build/lib/unitxt/catalog/cards/global_mmlu_lite_ca 2026-01-06T13:30:19,467 creating build/lib/unitxt/catalog/cards/babi 2026-01-06T13:30:19,468 copying src/unitxt/catalog/cards/babi/qa.json -> build/lib/unitxt/catalog/cards/babi 2026-01-06T13:30:19,470 creating build/lib/unitxt/catalog/cards/tablebench_data_analysis 2026-01-06T13:30:19,471 copying src/unitxt/catalog/cards/tablebench_data_analysis/legacy.json -> build/lib/unitxt/catalog/cards/tablebench_data_analysis 2026-01-06T13:30:19,474 creating build/lib/unitxt/catalog/cards/tot 2026-01-06T13:30:19,475 copying src/unitxt/catalog/cards/tot/semantic.json -> build/lib/unitxt/catalog/cards/tot 2026-01-06T13:30:19,477 copying src/unitxt/catalog/cards/tot/arithmetic.json -> build/lib/unitxt/catalog/cards/tot 2026-01-06T13:30:19,479 creating build/lib/unitxt/catalog/cards/legalbench 2026-01-06T13:30:19,480 copying src/unitxt/catalog/cards/legalbench/proa.json -> build/lib/unitxt/catalog/cards/legalbench 2026-01-06T13:30:19,483 copying src/unitxt/catalog/cards/legalbench/function_of_decision_section.json -> build/lib/unitxt/catalog/cards/legalbench 2026-01-06T13:30:19,485 copying src/unitxt/catalog/cards/legalbench/international_citizenship_questions.json -> build/lib/unitxt/catalog/cards/legalbench 2026-01-06T13:30:19,487 copying src/unitxt/catalog/cards/legalbench/corporate_lobbying.json -> build/lib/unitxt/catalog/cards/legalbench 2026-01-06T13:30:19,490 copying src/unitxt/catalog/cards/legalbench/abercrombie.json -> build/lib/unitxt/catalog/cards/legalbench 2026-01-06T13:30:19,492 creating build/lib/unitxt/catalog/cards/go_emotions 2026-01-06T13:30:19,493 copying src/unitxt/catalog/cards/go_emotions/simplified.json -> build/lib/unitxt/catalog/cards/go_emotions 2026-01-06T13:30:19,495 creating build/lib/unitxt/catalog/cards/ffqa_filtered 2026-01-06T13:30:19,496 copying src/unitxt/catalog/cards/ffqa_filtered/8k.json -> build/lib/unitxt/catalog/cards/ffqa_filtered 2026-01-06T13:30:19,499 copying src/unitxt/catalog/cards/ffqa_filtered/16k.json -> build/lib/unitxt/catalog/cards/ffqa_filtered 2026-01-06T13:30:19,501 copying src/unitxt/catalog/cards/ffqa_filtered/4k.json -> build/lib/unitxt/catalog/cards/ffqa_filtered 2026-01-06T13:30:19,503 copying src/unitxt/catalog/cards/ffqa_filtered/2k.json -> build/lib/unitxt/catalog/cards/ffqa_filtered 2026-01-06T13:30:19,505 creating build/lib/unitxt/catalog/cards/coedit 2026-01-06T13:30:19,507 copying src/unitxt/catalog/cards/coedit/rewriting.json -> build/lib/unitxt/catalog/cards/coedit 2026-01-06T13:30:19,509 copying src/unitxt/catalog/cards/coedit/selection.json -> build/lib/unitxt/catalog/cards/coedit 2026-01-06T13:30:19,512 copying src/unitxt/catalog/cards/coedit/preference.json -> build/lib/unitxt/catalog/cards/coedit 2026-01-06T13:30:19,514 copying src/unitxt/catalog/cards/coedit/paraphrase.json -> build/lib/unitxt/catalog/cards/coedit 2026-01-06T13:30:19,516 creating build/lib/unitxt/catalog/cards/universal_ner/en 2026-01-06T13:30:19,517 copying src/unitxt/catalog/cards/universal_ner/en/pud.json -> build/lib/unitxt/catalog/cards/universal_ner/en 2026-01-06T13:30:19,520 copying src/unitxt/catalog/cards/universal_ner/en/ewt.json -> build/lib/unitxt/catalog/cards/universal_ner/en 2026-01-06T13:30:19,522 creating build/lib/unitxt/catalog/cards/universal_ner/da 2026-01-06T13:30:19,523 copying src/unitxt/catalog/cards/universal_ner/da/ddt.json -> build/lib/unitxt/catalog/cards/universal_ner/da 2026-01-06T13:30:19,525 creating build/lib/unitxt/catalog/cards/universal_ner/ceb 2026-01-06T13:30:19,526 copying src/unitxt/catalog/cards/universal_ner/ceb/gja.json -> build/lib/unitxt/catalog/cards/universal_ner/ceb 2026-01-06T13:30:19,528 creating build/lib/unitxt/catalog/cards/universal_ner/tl 2026-01-06T13:30:19,529 copying src/unitxt/catalog/cards/universal_ner/tl/trg.json -> build/lib/unitxt/catalog/cards/universal_ner/tl 2026-01-06T13:30:19,532 copying src/unitxt/catalog/cards/universal_ner/tl/ugnayan.json -> build/lib/unitxt/catalog/cards/universal_ner/tl 2026-01-06T13:30:19,534 creating build/lib/unitxt/catalog/cards/universal_ner/ru 2026-01-06T13:30:19,535 copying src/unitxt/catalog/cards/universal_ner/ru/pud.json -> build/lib/unitxt/catalog/cards/universal_ner/ru 2026-01-06T13:30:19,537 creating build/lib/unitxt/catalog/cards/universal_ner/zh 2026-01-06T13:30:19,539 copying src/unitxt/catalog/cards/universal_ner/zh/gsdsimp.json -> build/lib/unitxt/catalog/cards/universal_ner/zh 2026-01-06T13:30:19,541 copying src/unitxt/catalog/cards/universal_ner/zh/gsd.json -> build/lib/unitxt/catalog/cards/universal_ner/zh 2026-01-06T13:30:19,544 copying src/unitxt/catalog/cards/universal_ner/zh/pud.json -> build/lib/unitxt/catalog/cards/universal_ner/zh 2026-01-06T13:30:19,546 creating build/lib/unitxt/catalog/cards/universal_ner/de 2026-01-06T13:30:19,547 copying src/unitxt/catalog/cards/universal_ner/de/pud.json -> build/lib/unitxt/catalog/cards/universal_ner/de 2026-01-06T13:30:19,550 creating build/lib/unitxt/catalog/cards/universal_ner/pt 2026-01-06T13:30:19,551 copying src/unitxt/catalog/cards/universal_ner/pt/bosque.json -> build/lib/unitxt/catalog/cards/universal_ner/pt 2026-01-06T13:30:19,553 copying src/unitxt/catalog/cards/universal_ner/pt/pud.json -> build/lib/unitxt/catalog/cards/universal_ner/pt 2026-01-06T13:30:19,556 creating build/lib/unitxt/catalog/cards/universal_ner/sk 2026-01-06T13:30:19,557 copying src/unitxt/catalog/cards/universal_ner/sk/snk.json -> build/lib/unitxt/catalog/cards/universal_ner/sk 2026-01-06T13:30:19,559 creating build/lib/unitxt/catalog/cards/universal_ner/sv 2026-01-06T13:30:19,560 copying src/unitxt/catalog/cards/universal_ner/sv/talbanken.json -> build/lib/unitxt/catalog/cards/universal_ner/sv 2026-01-06T13:30:19,563 copying src/unitxt/catalog/cards/universal_ner/sv/pud.json -> build/lib/unitxt/catalog/cards/universal_ner/sv 2026-01-06T13:30:19,565 creating build/lib/unitxt/catalog/cards/universal_ner/sr 2026-01-06T13:30:19,566 copying src/unitxt/catalog/cards/universal_ner/sr/set.json -> build/lib/unitxt/catalog/cards/universal_ner/sr 2026-01-06T13:30:19,569 creating build/lib/unitxt/catalog/cards/universal_ner/hr 2026-01-06T13:30:19,570 copying src/unitxt/catalog/cards/universal_ner/hr/set.json -> build/lib/unitxt/catalog/cards/universal_ner/hr 2026-01-06T13:30:19,572 creating build/lib/unitxt/catalog/cards/cohere_for_ai/aya_human_annotated 2026-01-06T13:30:19,574 copying src/unitxt/catalog/cards/cohere_for_ai/aya_human_annotated/eng.json -> build/lib/unitxt/catalog/cards/cohere_for_ai/aya_human_annotated 2026-01-06T13:30:19,577 copying src/unitxt/catalog/cards/cohere_for_ai/aya_human_annotated/tur.json -> build/lib/unitxt/catalog/cards/cohere_for_ai/aya_human_annotated 2026-01-06T13:30:19,579 copying src/unitxt/catalog/cards/cohere_for_ai/aya_human_annotated/arb.json -> build/lib/unitxt/catalog/cards/cohere_for_ai/aya_human_annotated 2026-01-06T13:30:19,582 copying src/unitxt/catalog/cards/cohere_for_ai/aya_human_annotated/tel.json -> build/lib/unitxt/catalog/cards/cohere_for_ai/aya_human_annotated 2026-01-06T13:30:19,584 copying src/unitxt/catalog/cards/cohere_for_ai/aya_human_annotated/yor.json -> build/lib/unitxt/catalog/cards/cohere_for_ai/aya_human_annotated 2026-01-06T13:30:19,586 copying src/unitxt/catalog/cards/cohere_for_ai/aya_human_annotated/zho.json -> build/lib/unitxt/catalog/cards/cohere_for_ai/aya_human_annotated 2026-01-06T13:30:19,589 copying src/unitxt/catalog/cards/cohere_for_ai/aya_human_annotated/por.json -> build/lib/unitxt/catalog/cards/cohere_for_ai/aya_human_annotated 2026-01-06T13:30:19,591 creating build/lib/unitxt/catalog/cards/cohere_for_ai/dolly_machine_translated 2026-01-06T13:30:19,592 copying src/unitxt/catalog/cards/cohere_for_ai/dolly_machine_translated/fra.json -> build/lib/unitxt/catalog/cards/cohere_for_ai/dolly_machine_translated 2026-01-06T13:30:19,594 copying src/unitxt/catalog/cards/cohere_for_ai/dolly_machine_translated/eng.json -> build/lib/unitxt/catalog/cards/cohere_for_ai/dolly_machine_translated 2026-01-06T13:30:19,596 copying src/unitxt/catalog/cards/cohere_for_ai/dolly_machine_translated/deu.json -> build/lib/unitxt/catalog/cards/cohere_for_ai/dolly_machine_translated 2026-01-06T13:30:19,599 copying src/unitxt/catalog/cards/cohere_for_ai/dolly_machine_translated/spa.json -> build/lib/unitxt/catalog/cards/cohere_for_ai/dolly_machine_translated 2026-01-06T13:30:19,601 copying src/unitxt/catalog/cards/cohere_for_ai/dolly_machine_translated/jpn.json -> build/lib/unitxt/catalog/cards/cohere_for_ai/dolly_machine_translated 2026-01-06T13:30:19,603 copying src/unitxt/catalog/cards/cohere_for_ai/dolly_machine_translated/por.json -> build/lib/unitxt/catalog/cards/cohere_for_ai/dolly_machine_translated 2026-01-06T13:30:19,605 creating build/lib/unitxt/catalog/cards/cohere_for_ai/dolly_human_edited 2026-01-06T13:30:19,606 copying src/unitxt/catalog/cards/cohere_for_ai/dolly_human_edited/fra.json -> build/lib/unitxt/catalog/cards/cohere_for_ai/dolly_human_edited 2026-01-06T13:30:19,609 copying src/unitxt/catalog/cards/cohere_for_ai/dolly_human_edited/spa.json -> build/lib/unitxt/catalog/cards/cohere_for_ai/dolly_human_edited 2026-01-06T13:30:19,611 creating build/lib/unitxt/catalog/cards/mmlu_pro 2026-01-06T13:30:19,612 copying src/unitxt/catalog/cards/mmlu_pro/law.json -> build/lib/unitxt/catalog/cards/mmlu_pro 2026-01-06T13:30:19,614 copying src/unitxt/catalog/cards/mmlu_pro/health.json -> build/lib/unitxt/catalog/cards/mmlu_pro 2026-01-06T13:30:19,617 copying src/unitxt/catalog/cards/mmlu_pro/engineering.json -> build/lib/unitxt/catalog/cards/mmlu_pro 2026-01-06T13:30:19,619 copying src/unitxt/catalog/cards/mmlu_pro/computer_science.json -> build/lib/unitxt/catalog/cards/mmlu_pro 2026-01-06T13:30:19,622 copying src/unitxt/catalog/cards/mmlu_pro/math.json -> build/lib/unitxt/catalog/cards/mmlu_pro 2026-01-06T13:30:19,624 copying src/unitxt/catalog/cards/mmlu_pro/physics.json -> build/lib/unitxt/catalog/cards/mmlu_pro 2026-01-06T13:30:19,626 copying src/unitxt/catalog/cards/mmlu_pro/economics.json -> build/lib/unitxt/catalog/cards/mmlu_pro 2026-01-06T13:30:19,628 copying src/unitxt/catalog/cards/mmlu_pro/business.json -> build/lib/unitxt/catalog/cards/mmlu_pro 2026-01-06T13:30:19,631 copying src/unitxt/catalog/cards/mmlu_pro/psychology.json -> build/lib/unitxt/catalog/cards/mmlu_pro 2026-01-06T13:30:19,633 copying src/unitxt/catalog/cards/mmlu_pro/history.json -> build/lib/unitxt/catalog/cards/mmlu_pro 2026-01-06T13:30:19,635 copying src/unitxt/catalog/cards/mmlu_pro/biology.json -> build/lib/unitxt/catalog/cards/mmlu_pro 2026-01-06T13:30:19,638 copying src/unitxt/catalog/cards/mmlu_pro/other.json -> build/lib/unitxt/catalog/cards/mmlu_pro 2026-01-06T13:30:19,640 copying src/unitxt/catalog/cards/mmlu_pro/philosophy.json -> build/lib/unitxt/catalog/cards/mmlu_pro 2026-01-06T13:30:19,642 copying src/unitxt/catalog/cards/mmlu_pro/chemistry.json -> build/lib/unitxt/catalog/cards/mmlu_pro 2026-01-06T13:30:19,644 creating build/lib/unitxt/catalog/cards/text2sql 2026-01-06T13:30:19,645 copying src/unitxt/catalog/cards/text2sql/bird.json -> build/lib/unitxt/catalog/cards/text2sql 2026-01-06T13:30:19,647 creating build/lib/unitxt/catalog/cards/xlsum 2026-01-06T13:30:19,649 copying src/unitxt/catalog/cards/xlsum/thai.json -> build/lib/unitxt/catalog/cards/xlsum 2026-01-06T13:30:19,651 copying src/unitxt/catalog/cards/xlsum/scottish_gaelic.json -> build/lib/unitxt/catalog/cards/xlsum 2026-01-06T13:30:19,653 copying src/unitxt/catalog/cards/xlsum/french.json -> build/lib/unitxt/catalog/cards/xlsum 2026-01-06T13:30:19,655 copying src/unitxt/catalog/cards/xlsum/igbo.json -> build/lib/unitxt/catalog/cards/xlsum 2026-01-06T13:30:19,657 copying src/unitxt/catalog/cards/xlsum/gujarati.json -> build/lib/unitxt/catalog/cards/xlsum 2026-01-06T13:30:19,660 copying src/unitxt/catalog/cards/xlsum/turkish.json -> build/lib/unitxt/catalog/cards/xlsum 2026-01-06T13:30:19,662 copying src/unitxt/catalog/cards/xlsum/burmese.json -> build/lib/unitxt/catalog/cards/xlsum 2026-01-06T13:30:19,664 copying src/unitxt/catalog/cards/xlsum/arabic.json -> build/lib/unitxt/catalog/cards/xlsum 2026-01-06T13:30:19,666 copying src/unitxt/catalog/cards/xlsum/japanese.json -> build/lib/unitxt/catalog/cards/xlsum 2026-01-06T13:30:19,668 copying src/unitxt/catalog/cards/xlsum/amharic.json -> build/lib/unitxt/catalog/cards/xlsum 2026-01-06T13:30:19,671 copying src/unitxt/catalog/cards/xlsum/ukrainian.json -> build/lib/unitxt/catalog/cards/xlsum 2026-01-06T13:30:19,673 copying src/unitxt/catalog/cards/xlsum/indonesian.json -> build/lib/unitxt/catalog/cards/xlsum 2026-01-06T13:30:19,675 copying src/unitxt/catalog/cards/xlsum/tamil.json -> build/lib/unitxt/catalog/cards/xlsum 2026-01-06T13:30:19,677 copying src/unitxt/catalog/cards/xlsum/spanish.json -> build/lib/unitxt/catalog/cards/xlsum 2026-01-06T13:30:19,680 copying src/unitxt/catalog/cards/xlsum/tigrinya.json -> build/lib/unitxt/catalog/cards/xlsum 2026-01-06T13:30:19,682 copying src/unitxt/catalog/cards/xlsum/welsh.json -> build/lib/unitxt/catalog/cards/xlsum 2026-01-06T13:30:19,684 copying src/unitxt/catalog/cards/xlsum/vietnamese.json -> build/lib/unitxt/catalog/cards/xlsum 2026-01-06T13:30:19,686 copying src/unitxt/catalog/cards/xlsum/urdu.json -> build/lib/unitxt/catalog/cards/xlsum 2026-01-06T13:30:19,689 copying src/unitxt/catalog/cards/xlsum/yoruba.json -> build/lib/unitxt/catalog/cards/xlsum 2026-01-06T13:30:19,691 copying src/unitxt/catalog/cards/xlsum/chinese_traditional.json -> build/lib/unitxt/catalog/cards/xlsum 2026-01-06T13:30:19,693 copying src/unitxt/catalog/cards/xlsum/portuguese.json -> build/lib/unitxt/catalog/cards/xlsum 2026-01-06T13:30:19,695 copying src/unitxt/catalog/cards/xlsum/pashto.json -> build/lib/unitxt/catalog/cards/xlsum 2026-01-06T13:30:19,698 copying src/unitxt/catalog/cards/xlsum/persian.json -> build/lib/unitxt/catalog/cards/xlsum 2026-01-06T13:30:19,700 copying src/unitxt/catalog/cards/xlsum/sinhala.json -> build/lib/unitxt/catalog/cards/xlsum 2026-01-06T13:30:19,702 copying src/unitxt/catalog/cards/xlsum/serbian_cyrillic.json -> build/lib/unitxt/catalog/cards/xlsum 2026-01-06T13:30:19,704 copying src/unitxt/catalog/cards/xlsum/nepali.json -> build/lib/unitxt/catalog/cards/xlsum 2026-01-06T13:30:19,707 copying src/unitxt/catalog/cards/xlsum/somali.json -> build/lib/unitxt/catalog/cards/xlsum 2026-01-06T13:30:19,709 copying src/unitxt/catalog/cards/xlsum/hausa.json -> build/lib/unitxt/catalog/cards/xlsum 2026-01-06T13:30:19,711 copying src/unitxt/catalog/cards/xlsum/punjabi.json -> build/lib/unitxt/catalog/cards/xlsum 2026-01-06T13:30:19,714 copying src/unitxt/catalog/cards/xlsum/kirundi.json -> build/lib/unitxt/catalog/cards/xlsum 2026-01-06T13:30:19,716 copying src/unitxt/catalog/cards/xlsum/english.json -> build/lib/unitxt/catalog/cards/xlsum 2026-01-06T13:30:19,718 copying src/unitxt/catalog/cards/xlsum/russian.json -> build/lib/unitxt/catalog/cards/xlsum 2026-01-06T13:30:19,721 copying src/unitxt/catalog/cards/xlsum/uzbek.json -> build/lib/unitxt/catalog/cards/xlsum 2026-01-06T13:30:19,723 copying src/unitxt/catalog/cards/xlsum/oromo.json -> build/lib/unitxt/catalog/cards/xlsum 2026-01-06T13:30:19,725 copying src/unitxt/catalog/cards/xlsum/telugu.json -> build/lib/unitxt/catalog/cards/xlsum 2026-01-06T13:30:19,727 copying src/unitxt/catalog/cards/xlsum/korean.json -> build/lib/unitxt/catalog/cards/xlsum 2026-01-06T13:30:19,730 copying src/unitxt/catalog/cards/xlsum/bengali.json -> build/lib/unitxt/catalog/cards/xlsum 2026-01-06T13:30:19,732 copying src/unitxt/catalog/cards/xlsum/pidgin.json -> build/lib/unitxt/catalog/cards/xlsum 2026-01-06T13:30:19,734 copying src/unitxt/catalog/cards/xlsum/marathi.json -> build/lib/unitxt/catalog/cards/xlsum 2026-01-06T13:30:19,736 copying src/unitxt/catalog/cards/xlsum/swahili.json -> build/lib/unitxt/catalog/cards/xlsum 2026-01-06T13:30:19,738 copying src/unitxt/catalog/cards/xlsum/hindi.json -> build/lib/unitxt/catalog/cards/xlsum 2026-01-06T13:30:19,740 copying src/unitxt/catalog/cards/xlsum/serbian_latin.json -> build/lib/unitxt/catalog/cards/xlsum 2026-01-06T13:30:19,743 copying src/unitxt/catalog/cards/xlsum/chinese_simplified.json -> build/lib/unitxt/catalog/cards/xlsum 2026-01-06T13:30:19,745 copying src/unitxt/catalog/cards/xlsum/azerbaijani.json -> build/lib/unitxt/catalog/cards/xlsum 2026-01-06T13:30:19,747 copying src/unitxt/catalog/cards/xlsum/kyrgyz.json -> build/lib/unitxt/catalog/cards/xlsum 2026-01-06T13:30:19,749 creating build/lib/unitxt/catalog/cards/milu/Hindi 2026-01-06T13:30:19,750 copying src/unitxt/catalog/cards/milu/Hindi/Science.json -> build/lib/unitxt/catalog/cards/milu/Hindi 2026-01-06T13:30:19,753 copying src/unitxt/catalog/cards/milu/Hindi/Arts_and_Humanities.json -> build/lib/unitxt/catalog/cards/milu/Hindi 2026-01-06T13:30:19,755 copying src/unitxt/catalog/cards/milu/Hindi/Law_and_Governance.json -> build/lib/unitxt/catalog/cards/milu/Hindi 2026-01-06T13:30:19,757 copying src/unitxt/catalog/cards/milu/Hindi/Business_Studies.json -> build/lib/unitxt/catalog/cards/milu/Hindi 2026-01-06T13:30:19,760 copying src/unitxt/catalog/cards/milu/Hindi/Environmental_Sciences.json -> build/lib/unitxt/catalog/cards/milu/Hindi 2026-01-06T13:30:19,762 copying src/unitxt/catalog/cards/milu/Hindi/Engineering_and_Tech.json -> build/lib/unitxt/catalog/cards/milu/Hindi 2026-01-06T13:30:19,764 copying src/unitxt/catalog/cards/milu/Hindi/Health_and_Medicine.json -> build/lib/unitxt/catalog/cards/milu/Hindi 2026-01-06T13:30:19,767 copying src/unitxt/catalog/cards/milu/Hindi/Social_Sciences.json -> build/lib/unitxt/catalog/cards/milu/Hindi 2026-01-06T13:30:19,769 creating build/lib/unitxt/catalog/cards/milu/English 2026-01-06T13:30:19,770 copying src/unitxt/catalog/cards/milu/English/Science.json -> build/lib/unitxt/catalog/cards/milu/English 2026-01-06T13:30:19,772 copying src/unitxt/catalog/cards/milu/English/Arts_and_Humanities.json -> build/lib/unitxt/catalog/cards/milu/English 2026-01-06T13:30:19,775 copying src/unitxt/catalog/cards/milu/English/Law_and_Governance.json -> build/lib/unitxt/catalog/cards/milu/English 2026-01-06T13:30:19,777 copying src/unitxt/catalog/cards/milu/English/Business_Studies.json -> build/lib/unitxt/catalog/cards/milu/English 2026-01-06T13:30:19,779 copying src/unitxt/catalog/cards/milu/English/Environmental_Sciences.json -> build/lib/unitxt/catalog/cards/milu/English 2026-01-06T13:30:19,781 copying src/unitxt/catalog/cards/milu/English/Engineering_and_Tech.json -> build/lib/unitxt/catalog/cards/milu/English 2026-01-06T13:30:19,784 copying src/unitxt/catalog/cards/milu/English/Health_and_Medicine.json -> build/lib/unitxt/catalog/cards/milu/English 2026-01-06T13:30:19,786 copying src/unitxt/catalog/cards/milu/English/Social_Sciences.json -> build/lib/unitxt/catalog/cards/milu/English 2026-01-06T13:30:19,789 creating build/lib/unitxt/catalog/cards/milu/Tamil 2026-01-06T13:30:19,790 copying src/unitxt/catalog/cards/milu/Tamil/Science.json -> build/lib/unitxt/catalog/cards/milu/Tamil 2026-01-06T13:30:19,793 copying src/unitxt/catalog/cards/milu/Tamil/Arts_and_Humanities.json -> build/lib/unitxt/catalog/cards/milu/Tamil 2026-01-06T13:30:19,795 copying src/unitxt/catalog/cards/milu/Tamil/Law_and_Governance.json -> build/lib/unitxt/catalog/cards/milu/Tamil 2026-01-06T13:30:19,797 copying src/unitxt/catalog/cards/milu/Tamil/Business_Studies.json -> build/lib/unitxt/catalog/cards/milu/Tamil 2026-01-06T13:30:19,799 copying src/unitxt/catalog/cards/milu/Tamil/Environmental_Sciences.json -> build/lib/unitxt/catalog/cards/milu/Tamil 2026-01-06T13:30:19,802 copying src/unitxt/catalog/cards/milu/Tamil/Engineering_and_Tech.json -> build/lib/unitxt/catalog/cards/milu/Tamil 2026-01-06T13:30:19,804 copying src/unitxt/catalog/cards/milu/Tamil/Health_and_Medicine.json -> build/lib/unitxt/catalog/cards/milu/Tamil 2026-01-06T13:30:19,806 copying src/unitxt/catalog/cards/milu/Tamil/Social_Sciences.json -> build/lib/unitxt/catalog/cards/milu/Tamil 2026-01-06T13:30:19,808 creating build/lib/unitxt/catalog/cards/milu/Telugu 2026-01-06T13:30:19,809 copying src/unitxt/catalog/cards/milu/Telugu/Science.json -> build/lib/unitxt/catalog/cards/milu/Telugu 2026-01-06T13:30:19,812 copying src/unitxt/catalog/cards/milu/Telugu/Arts_and_Humanities.json -> build/lib/unitxt/catalog/cards/milu/Telugu 2026-01-06T13:30:19,814 copying src/unitxt/catalog/cards/milu/Telugu/Law_and_Governance.json -> build/lib/unitxt/catalog/cards/milu/Telugu 2026-01-06T13:30:19,816 copying src/unitxt/catalog/cards/milu/Telugu/Business_Studies.json -> build/lib/unitxt/catalog/cards/milu/Telugu 2026-01-06T13:30:19,819 copying src/unitxt/catalog/cards/milu/Telugu/Environmental_Sciences.json -> build/lib/unitxt/catalog/cards/milu/Telugu 2026-01-06T13:30:19,821 copying src/unitxt/catalog/cards/milu/Telugu/Engineering_and_Tech.json -> build/lib/unitxt/catalog/cards/milu/Telugu 2026-01-06T13:30:19,823 copying src/unitxt/catalog/cards/milu/Telugu/Health_and_Medicine.json -> build/lib/unitxt/catalog/cards/milu/Telugu 2026-01-06T13:30:19,826 copying src/unitxt/catalog/cards/milu/Telugu/Social_Sciences.json -> build/lib/unitxt/catalog/cards/milu/Telugu 2026-01-06T13:30:19,828 creating build/lib/unitxt/catalog/cards/milu/Malayalam 2026-01-06T13:30:19,829 copying src/unitxt/catalog/cards/milu/Malayalam/Science.json -> build/lib/unitxt/catalog/cards/milu/Malayalam 2026-01-06T13:30:19,831 copying src/unitxt/catalog/cards/milu/Malayalam/Arts_and_Humanities.json -> build/lib/unitxt/catalog/cards/milu/Malayalam 2026-01-06T13:30:19,834 copying src/unitxt/catalog/cards/milu/Malayalam/Law_and_Governance.json -> build/lib/unitxt/catalog/cards/milu/Malayalam 2026-01-06T13:30:19,836 copying src/unitxt/catalog/cards/milu/Malayalam/Business_Studies.json -> build/lib/unitxt/catalog/cards/milu/Malayalam 2026-01-06T13:30:19,839 copying src/unitxt/catalog/cards/milu/Malayalam/Environmental_Sciences.json -> build/lib/unitxt/catalog/cards/milu/Malayalam 2026-01-06T13:30:19,841 copying src/unitxt/catalog/cards/milu/Malayalam/Engineering_and_Tech.json -> build/lib/unitxt/catalog/cards/milu/Malayalam 2026-01-06T13:30:19,844 copying src/unitxt/catalog/cards/milu/Malayalam/Health_and_Medicine.json -> build/lib/unitxt/catalog/cards/milu/Malayalam 2026-01-06T13:30:19,846 copying src/unitxt/catalog/cards/milu/Malayalam/Social_Sciences.json -> build/lib/unitxt/catalog/cards/milu/Malayalam 2026-01-06T13:30:19,848 creating build/lib/unitxt/catalog/cards/milu/Kannada 2026-01-06T13:30:19,849 copying src/unitxt/catalog/cards/milu/Kannada/Science.json -> build/lib/unitxt/catalog/cards/milu/Kannada 2026-01-06T13:30:19,852 copying src/unitxt/catalog/cards/milu/Kannada/Arts_and_Humanities.json -> build/lib/unitxt/catalog/cards/milu/Kannada 2026-01-06T13:30:19,854 copying src/unitxt/catalog/cards/milu/Kannada/Law_and_Governance.json -> build/lib/unitxt/catalog/cards/milu/Kannada 2026-01-06T13:30:19,856 copying src/unitxt/catalog/cards/milu/Kannada/Business_Studies.json -> build/lib/unitxt/catalog/cards/milu/Kannada 2026-01-06T13:30:19,859 copying src/unitxt/catalog/cards/milu/Kannada/Environmental_Sciences.json -> build/lib/unitxt/catalog/cards/milu/Kannada 2026-01-06T13:30:19,861 copying src/unitxt/catalog/cards/milu/Kannada/Engineering_and_Tech.json -> build/lib/unitxt/catalog/cards/milu/Kannada 2026-01-06T13:30:19,864 copying src/unitxt/catalog/cards/milu/Kannada/Health_and_Medicine.json -> build/lib/unitxt/catalog/cards/milu/Kannada 2026-01-06T13:30:19,866 copying src/unitxt/catalog/cards/milu/Kannada/Social_Sciences.json -> build/lib/unitxt/catalog/cards/milu/Kannada 2026-01-06T13:30:19,868 creating build/lib/unitxt/catalog/cards/milu/Odia 2026-01-06T13:30:19,869 copying src/unitxt/catalog/cards/milu/Odia/Science.json -> build/lib/unitxt/catalog/cards/milu/Odia 2026-01-06T13:30:19,871 copying src/unitxt/catalog/cards/milu/Odia/Arts_and_Humanities.json -> build/lib/unitxt/catalog/cards/milu/Odia 2026-01-06T13:30:19,873 copying src/unitxt/catalog/cards/milu/Odia/Law_and_Governance.json -> build/lib/unitxt/catalog/cards/milu/Odia 2026-01-06T13:30:19,876 copying src/unitxt/catalog/cards/milu/Odia/Business_Studies.json -> build/lib/unitxt/catalog/cards/milu/Odia 2026-01-06T13:30:19,878 copying src/unitxt/catalog/cards/milu/Odia/Environmental_Sciences.json -> build/lib/unitxt/catalog/cards/milu/Odia 2026-01-06T13:30:19,880 copying src/unitxt/catalog/cards/milu/Odia/Engineering_and_Tech.json -> build/lib/unitxt/catalog/cards/milu/Odia 2026-01-06T13:30:19,882 copying src/unitxt/catalog/cards/milu/Odia/Health_and_Medicine.json -> build/lib/unitxt/catalog/cards/milu/Odia 2026-01-06T13:30:19,885 copying src/unitxt/catalog/cards/milu/Odia/Social_Sciences.json -> build/lib/unitxt/catalog/cards/milu/Odia 2026-01-06T13:30:19,887 creating build/lib/unitxt/catalog/cards/milu/Bengali 2026-01-06T13:30:19,888 copying src/unitxt/catalog/cards/milu/Bengali/Science.json -> build/lib/unitxt/catalog/cards/milu/Bengali 2026-01-06T13:30:19,891 copying src/unitxt/catalog/cards/milu/Bengali/Arts_and_Humanities.json -> build/lib/unitxt/catalog/cards/milu/Bengali 2026-01-06T13:30:19,893 copying src/unitxt/catalog/cards/milu/Bengali/Law_and_Governance.json -> build/lib/unitxt/catalog/cards/milu/Bengali 2026-01-06T13:30:19,895 copying src/unitxt/catalog/cards/milu/Bengali/Business_Studies.json -> build/lib/unitxt/catalog/cards/milu/Bengali 2026-01-06T13:30:19,898 copying src/unitxt/catalog/cards/milu/Bengali/Environmental_Sciences.json -> build/lib/unitxt/catalog/cards/milu/Bengali 2026-01-06T13:30:19,900 copying src/unitxt/catalog/cards/milu/Bengali/Engineering_and_Tech.json -> build/lib/unitxt/catalog/cards/milu/Bengali 2026-01-06T13:30:19,903 copying src/unitxt/catalog/cards/milu/Bengali/Health_and_Medicine.json -> build/lib/unitxt/catalog/cards/milu/Bengali 2026-01-06T13:30:19,905 copying src/unitxt/catalog/cards/milu/Bengali/Social_Sciences.json -> build/lib/unitxt/catalog/cards/milu/Bengali 2026-01-06T13:30:19,908 creating build/lib/unitxt/catalog/cards/milu/Punjabi 2026-01-06T13:30:19,909 copying src/unitxt/catalog/cards/milu/Punjabi/Science.json -> build/lib/unitxt/catalog/cards/milu/Punjabi 2026-01-06T13:30:19,911 copying src/unitxt/catalog/cards/milu/Punjabi/Arts_and_Humanities.json -> build/lib/unitxt/catalog/cards/milu/Punjabi 2026-01-06T13:30:19,914 copying src/unitxt/catalog/cards/milu/Punjabi/Law_and_Governance.json -> build/lib/unitxt/catalog/cards/milu/Punjabi 2026-01-06T13:30:19,916 copying src/unitxt/catalog/cards/milu/Punjabi/Business_Studies.json -> build/lib/unitxt/catalog/cards/milu/Punjabi 2026-01-06T13:30:19,919 copying src/unitxt/catalog/cards/milu/Punjabi/Environmental_Sciences.json -> build/lib/unitxt/catalog/cards/milu/Punjabi 2026-01-06T13:30:19,921 copying src/unitxt/catalog/cards/milu/Punjabi/Engineering_and_Tech.json -> build/lib/unitxt/catalog/cards/milu/Punjabi 2026-01-06T13:30:19,924 copying src/unitxt/catalog/cards/milu/Punjabi/Health_and_Medicine.json -> build/lib/unitxt/catalog/cards/milu/Punjabi 2026-01-06T13:30:19,926 copying src/unitxt/catalog/cards/milu/Punjabi/Social_Sciences.json -> build/lib/unitxt/catalog/cards/milu/Punjabi 2026-01-06T13:30:19,928 creating build/lib/unitxt/catalog/cards/milu/Marathi 2026-01-06T13:30:19,929 copying src/unitxt/catalog/cards/milu/Marathi/Science.json -> build/lib/unitxt/catalog/cards/milu/Marathi 2026-01-06T13:30:19,932 copying src/unitxt/catalog/cards/milu/Marathi/Arts_and_Humanities.json -> build/lib/unitxt/catalog/cards/milu/Marathi 2026-01-06T13:30:19,934 copying src/unitxt/catalog/cards/milu/Marathi/Law_and_Governance.json -> build/lib/unitxt/catalog/cards/milu/Marathi 2026-01-06T13:30:19,936 copying src/unitxt/catalog/cards/milu/Marathi/Business_Studies.json -> build/lib/unitxt/catalog/cards/milu/Marathi 2026-01-06T13:30:19,938 copying src/unitxt/catalog/cards/milu/Marathi/Environmental_Sciences.json -> build/lib/unitxt/catalog/cards/milu/Marathi 2026-01-06T13:30:19,941 copying src/unitxt/catalog/cards/milu/Marathi/Engineering_and_Tech.json -> build/lib/unitxt/catalog/cards/milu/Marathi 2026-01-06T13:30:19,943 copying src/unitxt/catalog/cards/milu/Marathi/Health_and_Medicine.json -> build/lib/unitxt/catalog/cards/milu/Marathi 2026-01-06T13:30:19,945 copying src/unitxt/catalog/cards/milu/Marathi/Social_Sciences.json -> build/lib/unitxt/catalog/cards/milu/Marathi 2026-01-06T13:30:19,947 creating build/lib/unitxt/catalog/cards/milu/Gujarati 2026-01-06T13:30:19,948 copying src/unitxt/catalog/cards/milu/Gujarati/Science.json -> build/lib/unitxt/catalog/cards/milu/Gujarati 2026-01-06T13:30:19,951 copying src/unitxt/catalog/cards/milu/Gujarati/Arts_and_Humanities.json -> build/lib/unitxt/catalog/cards/milu/Gujarati 2026-01-06T13:30:19,953 copying src/unitxt/catalog/cards/milu/Gujarati/Law_and_Governance.json -> build/lib/unitxt/catalog/cards/milu/Gujarati 2026-01-06T13:30:19,955 copying src/unitxt/catalog/cards/milu/Gujarati/Business_Studies.json -> build/lib/unitxt/catalog/cards/milu/Gujarati 2026-01-06T13:30:19,958 copying src/unitxt/catalog/cards/milu/Gujarati/Environmental_Sciences.json -> build/lib/unitxt/catalog/cards/milu/Gujarati 2026-01-06T13:30:19,960 copying src/unitxt/catalog/cards/milu/Gujarati/Engineering_and_Tech.json -> build/lib/unitxt/catalog/cards/milu/Gujarati 2026-01-06T13:30:19,963 copying src/unitxt/catalog/cards/milu/Gujarati/Health_and_Medicine.json -> build/lib/unitxt/catalog/cards/milu/Gujarati 2026-01-06T13:30:19,965 copying src/unitxt/catalog/cards/milu/Gujarati/Social_Sciences.json -> build/lib/unitxt/catalog/cards/milu/Gujarati 2026-01-06T13:30:19,967 creating build/lib/unitxt/catalog/cards/coqa 2026-01-06T13:30:19,968 copying src/unitxt/catalog/cards/coqa/multi_turn.json -> build/lib/unitxt/catalog/cards/coqa 2026-01-06T13:30:19,971 copying src/unitxt/catalog/cards/coqa/qa.json -> build/lib/unitxt/catalog/cards/coqa 2026-01-06T13:30:19,973 copying src/unitxt/catalog/cards/coqa/completion.json -> build/lib/unitxt/catalog/cards/coqa 2026-01-06T13:30:19,975 creating build/lib/unitxt/catalog/cards/doc_vqa 2026-01-06T13:30:19,976 copying src/unitxt/catalog/cards/doc_vqa/en.json -> build/lib/unitxt/catalog/cards/doc_vqa 2026-01-06T13:30:19,979 copying src/unitxt/catalog/cards/doc_vqa/lmms_eval.json -> build/lib/unitxt/catalog/cards/doc_vqa 2026-01-06T13:30:19,981 copying src/unitxt/catalog/cards/doc_vqa/fr.json -> build/lib/unitxt/catalog/cards/doc_vqa 2026-01-06T13:30:19,983 creating build/lib/unitxt/catalog/cards/clinc_oos 2026-01-06T13:30:19,984 copying src/unitxt/catalog/cards/clinc_oos/small.json -> build/lib/unitxt/catalog/cards/clinc_oos 2026-01-06T13:30:19,988 copying src/unitxt/catalog/cards/clinc_oos/plus.json -> build/lib/unitxt/catalog/cards/clinc_oos 2026-01-06T13:30:19,990 copying src/unitxt/catalog/cards/clinc_oos/imbalanced.json -> build/lib/unitxt/catalog/cards/clinc_oos 2026-01-06T13:30:19,993 creating build/lib/unitxt/catalog/cards/safety 2026-01-06T13:30:19,994 copying src/unitxt/catalog/cards/safety/simple_safety_tests.json -> build/lib/unitxt/catalog/cards/safety 2026-01-06T13:30:19,996 copying src/unitxt/catalog/cards/safety/xstest.json -> build/lib/unitxt/catalog/cards/safety 2026-01-06T13:30:19,999 copying src/unitxt/catalog/cards/safety/airbench2024.json -> build/lib/unitxt/catalog/cards/safety 2026-01-06T13:30:20,001 copying src/unitxt/catalog/cards/safety/mlcommons_ailuminate.json -> build/lib/unitxt/catalog/cards/safety 2026-01-06T13:30:20,003 copying src/unitxt/catalog/cards/safety/provoq.json -> build/lib/unitxt/catalog/cards/safety 2026-01-06T13:30:20,005 copying src/unitxt/catalog/cards/safety/truthful_qa.json -> build/lib/unitxt/catalog/cards/safety 2026-01-06T13:30:20,008 creating build/lib/unitxt/catalog/cards/safety/bbq 2026-01-06T13:30:20,009 copying src/unitxt/catalog/cards/safety/bbq/Race_x_gender.json -> build/lib/unitxt/catalog/cards/safety/bbq 2026-01-06T13:30:20,011 copying src/unitxt/catalog/cards/safety/bbq/Gender_identity.json -> build/lib/unitxt/catalog/cards/safety/bbq 2026-01-06T13:30:20,013 copying src/unitxt/catalog/cards/safety/bbq/Sexual_orientation.json -> build/lib/unitxt/catalog/cards/safety/bbq 2026-01-06T13:30:20,016 copying src/unitxt/catalog/cards/safety/bbq/Religion.json -> build/lib/unitxt/catalog/cards/safety/bbq 2026-01-06T13:30:20,018 copying src/unitxt/catalog/cards/safety/bbq/Race_ethnicity.json -> build/lib/unitxt/catalog/cards/safety/bbq 2026-01-06T13:30:20,020 copying src/unitxt/catalog/cards/safety/bbq/Age.json -> build/lib/unitxt/catalog/cards/safety/bbq 2026-01-06T13:30:20,022 copying src/unitxt/catalog/cards/safety/bbq/Nationality.json -> build/lib/unitxt/catalog/cards/safety/bbq 2026-01-06T13:30:20,024 copying src/unitxt/catalog/cards/safety/bbq/Physical_appearance.json -> build/lib/unitxt/catalog/cards/safety/bbq 2026-01-06T13:30:20,026 copying src/unitxt/catalog/cards/safety/bbq/Disability_status.json -> build/lib/unitxt/catalog/cards/safety/bbq 2026-01-06T13:30:20,029 copying src/unitxt/catalog/cards/safety/bbq/SES.json -> build/lib/unitxt/catalog/cards/safety/bbq 2026-01-06T13:30:20,031 copying src/unitxt/catalog/cards/safety/bbq/Race_x_SES.json -> build/lib/unitxt/catalog/cards/safety/bbq 2026-01-06T13:30:20,033 creating build/lib/unitxt/catalog/cards/safety/discrim_eval 2026-01-06T13:30:20,034 copying src/unitxt/catalog/cards/safety/discrim_eval/implicit.json -> build/lib/unitxt/catalog/cards/safety/discrim_eval 2026-01-06T13:30:20,037 copying src/unitxt/catalog/cards/safety/discrim_eval/explicit.json -> build/lib/unitxt/catalog/cards/safety/discrim_eval 2026-01-06T13:30:20,039 creating build/lib/unitxt/catalog/cards/rag_eval/faithfulness/ragbench 2026-01-06T13:30:20,041 copying src/unitxt/catalog/cards/rag_eval/faithfulness/ragbench/cuad.json -> build/lib/unitxt/catalog/cards/rag_eval/faithfulness/ragbench 2026-01-06T13:30:20,044 copying src/unitxt/catalog/cards/rag_eval/faithfulness/ragbench/tatqa.json -> build/lib/unitxt/catalog/cards/rag_eval/faithfulness/ragbench 2026-01-06T13:30:20,046 copying src/unitxt/catalog/cards/rag_eval/faithfulness/ragbench/msmarco.json -> build/lib/unitxt/catalog/cards/rag_eval/faithfulness/ragbench 2026-01-06T13:30:20,048 copying src/unitxt/catalog/cards/rag_eval/faithfulness/ragbench/delucionqa.json -> build/lib/unitxt/catalog/cards/rag_eval/faithfulness/ragbench 2026-01-06T13:30:20,051 copying src/unitxt/catalog/cards/rag_eval/faithfulness/ragbench/covidqa.json -> build/lib/unitxt/catalog/cards/rag_eval/faithfulness/ragbench 2026-01-06T13:30:20,053 copying src/unitxt/catalog/cards/rag_eval/faithfulness/ragbench/techqa.json -> build/lib/unitxt/catalog/cards/rag_eval/faithfulness/ragbench 2026-01-06T13:30:20,055 copying src/unitxt/catalog/cards/rag_eval/faithfulness/ragbench/expertqa.json -> build/lib/unitxt/catalog/cards/rag_eval/faithfulness/ragbench 2026-01-06T13:30:20,058 copying src/unitxt/catalog/cards/rag_eval/faithfulness/ragbench/finqa.json -> build/lib/unitxt/catalog/cards/rag_eval/faithfulness/ragbench 2026-01-06T13:30:20,060 copying src/unitxt/catalog/cards/rag_eval/faithfulness/ragbench/emanual.json -> build/lib/unitxt/catalog/cards/rag_eval/faithfulness/ragbench 2026-01-06T13:30:20,062 copying src/unitxt/catalog/cards/rag_eval/faithfulness/ragbench/pubmedqa.json -> build/lib/unitxt/catalog/cards/rag_eval/faithfulness/ragbench 2026-01-06T13:30:20,065 copying src/unitxt/catalog/cards/rag_eval/faithfulness/ragbench/hotpotqa.json -> build/lib/unitxt/catalog/cards/rag_eval/faithfulness/ragbench 2026-01-06T13:30:20,067 copying src/unitxt/catalog/cards/rag_eval/faithfulness/ragbench/hagrid.json -> build/lib/unitxt/catalog/cards/rag_eval/faithfulness/ragbench 2026-01-06T13:30:20,069 creating build/lib/unitxt/catalog/cards/reward_bench 2026-01-06T13:30:20,070 copying src/unitxt/catalog/cards/reward_bench/reasoning.json -> build/lib/unitxt/catalog/cards/reward_bench 2026-01-06T13:30:20,072 copying src/unitxt/catalog/cards/reward_bench/chat_hard.json -> build/lib/unitxt/catalog/cards/reward_bench 2026-01-06T13:30:20,074 copying src/unitxt/catalog/cards/reward_bench/safety.json -> build/lib/unitxt/catalog/cards/reward_bench 2026-01-06T13:30:20,077 copying src/unitxt/catalog/cards/reward_bench/chat.json -> build/lib/unitxt/catalog/cards/reward_bench 2026-01-06T13:30:20,079 creating build/lib/unitxt/catalog/cards/belebele 2026-01-06T13:30:20,080 copying src/unitxt/catalog/cards/belebele/ory_orya.json -> build/lib/unitxt/catalog/cards/belebele 2026-01-06T13:30:20,082 copying src/unitxt/catalog/cards/belebele/nso_latn.json -> build/lib/unitxt/catalog/cards/belebele 2026-01-06T13:30:20,084 copying src/unitxt/catalog/cards/belebele/est_latn.json -> build/lib/unitxt/catalog/cards/belebele 2026-01-06T13:30:20,087 copying src/unitxt/catalog/cards/belebele/urd_latn.json -> build/lib/unitxt/catalog/cards/belebele 2026-01-06T13:30:20,089 copying src/unitxt/catalog/cards/belebele/jpn_jpan.json -> build/lib/unitxt/catalog/cards/belebele 2026-01-06T13:30:20,091 copying src/unitxt/catalog/cards/belebele/kor_hang.json -> build/lib/unitxt/catalog/cards/belebele 2026-01-06T13:30:20,094 copying src/unitxt/catalog/cards/belebele/ron_latn.json -> build/lib/unitxt/catalog/cards/belebele 2026-01-06T13:30:20,096 copying src/unitxt/catalog/cards/belebele/war_latn.json -> build/lib/unitxt/catalog/cards/belebele 2026-01-06T13:30:20,098 copying src/unitxt/catalog/cards/belebele/slk_latn.json -> build/lib/unitxt/catalog/cards/belebele 2026-01-06T13:30:20,101 copying src/unitxt/catalog/cards/belebele/hin_latn.json -> build/lib/unitxt/catalog/cards/belebele 2026-01-06T13:30:20,103 copying src/unitxt/catalog/cards/belebele/lit_latn.json -> build/lib/unitxt/catalog/cards/belebele 2026-01-06T13:30:20,105 copying src/unitxt/catalog/cards/belebele/als_latn.json -> build/lib/unitxt/catalog/cards/belebele 2026-01-06T13:30:20,108 copying src/unitxt/catalog/cards/belebele/dan_latn.json -> build/lib/unitxt/catalog/cards/belebele 2026-01-06T13:30:20,110 copying src/unitxt/catalog/cards/belebele/kir_cyrl.json -> build/lib/unitxt/catalog/cards/belebele 2026-01-06T13:30:20,112 copying src/unitxt/catalog/cards/belebele/uzn_latn.json -> build/lib/unitxt/catalog/cards/belebele 2026-01-06T13:30:20,115 copying src/unitxt/catalog/cards/belebele/pol_latn.json -> build/lib/unitxt/catalog/cards/belebele 2026-01-06T13:30:20,117 copying src/unitxt/catalog/cards/belebele/jav_latn.json -> build/lib/unitxt/catalog/cards/belebele 2026-01-06T13:30:20,119 copying src/unitxt/catalog/cards/belebele/ceb_latn.json -> build/lib/unitxt/catalog/cards/belebele 2026-01-06T13:30:20,122 copying src/unitxt/catalog/cards/belebele/isl_latn.json -> build/lib/unitxt/catalog/cards/belebele 2026-01-06T13:30:20,124 copying src/unitxt/catalog/cards/belebele/fuv_latn.json -> build/lib/unitxt/catalog/cards/belebele 2026-01-06T13:30:20,126 copying src/unitxt/catalog/cards/belebele/yor_latn.json -> build/lib/unitxt/catalog/cards/belebele 2026-01-06T13:30:20,129 copying src/unitxt/catalog/cards/belebele/mal_mlym.json -> build/lib/unitxt/catalog/cards/belebele 2026-01-06T13:30:20,131 copying src/unitxt/catalog/cards/belebele/hrv_latn.json -> build/lib/unitxt/catalog/cards/belebele 2026-01-06T13:30:20,133 copying src/unitxt/catalog/cards/belebele/mri_latn.json -> build/lib/unitxt/catalog/cards/belebele 2026-01-06T13:30:20,136 copying src/unitxt/catalog/cards/belebele/kin_latn.json -> build/lib/unitxt/catalog/cards/belebele 2026-01-06T13:30:20,138 copying src/unitxt/catalog/cards/belebele/mlt_latn.json -> build/lib/unitxt/catalog/cards/belebele 2026-01-06T13:30:20,141 copying src/unitxt/catalog/cards/belebele/khm_khmr.json -> build/lib/unitxt/catalog/cards/belebele 2026-01-06T13:30:20,143 copying src/unitxt/catalog/cards/belebele/swe_latn.json -> build/lib/unitxt/catalog/cards/belebele 2026-01-06T13:30:20,145 copying src/unitxt/catalog/cards/belebele/spa_latn.json -> build/lib/unitxt/catalog/cards/belebele 2026-01-06T13:30:20,147 copying src/unitxt/catalog/cards/belebele/sin_sinh.json -> build/lib/unitxt/catalog/cards/belebele 2026-01-06T13:30:20,149 copying src/unitxt/catalog/cards/belebele/shn_mymr.json -> build/lib/unitxt/catalog/cards/belebele 2026-01-06T13:30:20,151 copying src/unitxt/catalog/cards/belebele/zsm_latn.json -> build/lib/unitxt/catalog/cards/belebele 2026-01-06T13:30:20,154 copying src/unitxt/catalog/cards/belebele/por_latn.json -> build/lib/unitxt/catalog/cards/belebele 2026-01-06T13:30:20,156 copying src/unitxt/catalog/cards/belebele/sot_latn.json -> build/lib/unitxt/catalog/cards/belebele 2026-01-06T13:30:20,158 copying src/unitxt/catalog/cards/belebele/lvs_latn.json -> build/lib/unitxt/catalog/cards/belebele 2026-01-06T13:30:20,160 copying src/unitxt/catalog/cards/belebele/nya_latn.json -> build/lib/unitxt/catalog/cards/belebele 2026-01-06T13:30:20,163 copying src/unitxt/catalog/cards/belebele/hau_latn.json -> build/lib/unitxt/catalog/cards/belebele 2026-01-06T13:30:20,165 copying src/unitxt/catalog/cards/belebele/snd_arab.json -> build/lib/unitxt/catalog/cards/belebele 2026-01-06T13:30:20,167 copying src/unitxt/catalog/cards/belebele/hun_latn.json -> build/lib/unitxt/catalog/cards/belebele 2026-01-06T13:30:20,170 copying src/unitxt/catalog/cards/belebele/azj_latn.json -> build/lib/unitxt/catalog/cards/belebele 2026-01-06T13:30:20,172 copying src/unitxt/catalog/cards/belebele/tam_taml.json -> build/lib/unitxt/catalog/cards/belebele 2026-01-06T13:30:20,174 copying src/unitxt/catalog/cards/belebele/srp_cyrl.json -> build/lib/unitxt/catalog/cards/belebele 2026-01-06T13:30:20,177 copying src/unitxt/catalog/cards/belebele/bul_cyrl.json -> build/lib/unitxt/catalog/cards/belebele 2026-01-06T13:30:20,179 copying src/unitxt/catalog/cards/belebele/tsn_latn.json -> build/lib/unitxt/catalog/cards/belebele 2026-01-06T13:30:20,181 copying src/unitxt/catalog/cards/belebele/mar_deva.json -> build/lib/unitxt/catalog/cards/belebele 2026-01-06T13:30:20,184 copying src/unitxt/catalog/cards/belebele/tir_ethi.json -> build/lib/unitxt/catalog/cards/belebele 2026-01-06T13:30:20,186 copying src/unitxt/catalog/cards/belebele/xho_latn.json -> build/lib/unitxt/catalog/cards/belebele 2026-01-06T13:30:20,189 copying src/unitxt/catalog/cards/belebele/kac_latn.json -> build/lib/unitxt/catalog/cards/belebele 2026-01-06T13:30:20,191 copying src/unitxt/catalog/cards/belebele/zho_hans.json -> build/lib/unitxt/catalog/cards/belebele 2026-01-06T13:30:20,193 copying src/unitxt/catalog/cards/belebele/pes_arab.json -> build/lib/unitxt/catalog/cards/belebele 2026-01-06T13:30:20,195 copying src/unitxt/catalog/cards/belebele/pbt_arab.json -> build/lib/unitxt/catalog/cards/belebele 2026-01-06T13:30:20,198 copying src/unitxt/catalog/cards/belebele/ukr_cyrl.json -> build/lib/unitxt/catalog/cards/belebele 2026-01-06T13:30:20,200 copying src/unitxt/catalog/cards/belebele/amh_ethi.json -> build/lib/unitxt/catalog/cards/belebele 2026-01-06T13:30:20,202 copying src/unitxt/catalog/cards/belebele/asm_beng.json -> build/lib/unitxt/catalog/cards/belebele 2026-01-06T13:30:20,205 copying src/unitxt/catalog/cards/belebele/tur_latn.json -> build/lib/unitxt/catalog/cards/belebele 2026-01-06T13:30:20,207 copying src/unitxt/catalog/cards/belebele/ilo_latn.json -> build/lib/unitxt/catalog/cards/belebele 2026-01-06T13:30:20,209 copying src/unitxt/catalog/cards/belebele/arb_arab.json -> build/lib/unitxt/catalog/cards/belebele 2026-01-06T13:30:20,212 copying src/unitxt/catalog/cards/belebele/cat_latn.json -> build/lib/unitxt/catalog/cards/belebele 2026-01-06T13:30:20,214 copying src/unitxt/catalog/cards/belebele/acm_arab.json -> build/lib/unitxt/catalog/cards/belebele 2026-01-06T13:30:20,216 copying src/unitxt/catalog/cards/belebele/mkd_cyrl.json -> build/lib/unitxt/catalog/cards/belebele 2026-01-06T13:30:20,218 copying src/unitxt/catalog/cards/belebele/tso_latn.json -> build/lib/unitxt/catalog/cards/belebele 2026-01-06T13:30:20,221 copying src/unitxt/catalog/cards/belebele/ben_latn.json -> build/lib/unitxt/catalog/cards/belebele 2026-01-06T13:30:20,223 copying src/unitxt/catalog/cards/belebele/grn_latn.json -> build/lib/unitxt/catalog/cards/belebele 2026-01-06T13:30:20,225 copying src/unitxt/catalog/cards/belebele/kaz_cyrl.json -> build/lib/unitxt/catalog/cards/belebele 2026-01-06T13:30:20,227 copying src/unitxt/catalog/cards/belebele/ary_arab.json -> build/lib/unitxt/catalog/cards/belebele 2026-01-06T13:30:20,230 copying src/unitxt/catalog/cards/belebele/rus_cyrl.json -> build/lib/unitxt/catalog/cards/belebele 2026-01-06T13:30:20,232 copying src/unitxt/catalog/cards/belebele/gaz_latn.json -> build/lib/unitxt/catalog/cards/belebele 2026-01-06T13:30:20,234 copying src/unitxt/catalog/cards/belebele/ind_latn.json -> build/lib/unitxt/catalog/cards/belebele 2026-01-06T13:30:20,236 copying src/unitxt/catalog/cards/belebele/tha_thai.json -> build/lib/unitxt/catalog/cards/belebele 2026-01-06T13:30:20,239 copying src/unitxt/catalog/cards/belebele/pan_guru.json -> build/lib/unitxt/catalog/cards/belebele 2026-01-06T13:30:20,241 copying src/unitxt/catalog/cards/belebele/tgl_latn.json -> build/lib/unitxt/catalog/cards/belebele 2026-01-06T13:30:20,244 copying src/unitxt/catalog/cards/belebele/kat_geor.json -> build/lib/unitxt/catalog/cards/belebele 2026-01-06T13:30:20,246 copying src/unitxt/catalog/cards/belebele/hin_deva.json -> build/lib/unitxt/catalog/cards/belebele 2026-01-06T13:30:20,248 copying src/unitxt/catalog/cards/belebele/plt_latn.json -> build/lib/unitxt/catalog/cards/belebele 2026-01-06T13:30:20,251 copying src/unitxt/catalog/cards/belebele/ell_grek.json -> build/lib/unitxt/catalog/cards/belebele 2026-01-06T13:30:20,253 copying src/unitxt/catalog/cards/belebele/ckb_arab.json -> build/lib/unitxt/catalog/cards/belebele 2026-01-06T13:30:20,255 copying src/unitxt/catalog/cards/belebele/slv_latn.json -> build/lib/unitxt/catalog/cards/belebele 2026-01-06T13:30:20,258 copying src/unitxt/catalog/cards/belebele/sun_latn.json -> build/lib/unitxt/catalog/cards/belebele 2026-01-06T13:30:20,260 copying src/unitxt/catalog/cards/belebele/eus_latn.json -> build/lib/unitxt/catalog/cards/belebele 2026-01-06T13:30:20,262 copying src/unitxt/catalog/cards/belebele/tgk_cyrl.json -> build/lib/unitxt/catalog/cards/belebele 2026-01-06T13:30:20,265 copying src/unitxt/catalog/cards/belebele/khk_cyrl.json -> build/lib/unitxt/catalog/cards/belebele 2026-01-06T13:30:20,267 copying src/unitxt/catalog/cards/belebele/heb_hebr.json -> build/lib/unitxt/catalog/cards/belebele 2026-01-06T13:30:20,270 copying src/unitxt/catalog/cards/belebele/sna_latn.json -> build/lib/unitxt/catalog/cards/belebele 2026-01-06T13:30:20,272 copying src/unitxt/catalog/cards/belebele/guj_gujr.json -> build/lib/unitxt/catalog/cards/belebele 2026-01-06T13:30:20,274 copying src/unitxt/catalog/cards/belebele/nob_latn.json -> build/lib/unitxt/catalog/cards/belebele 2026-01-06T13:30:20,277 copying src/unitxt/catalog/cards/belebele/fra_latn.json -> build/lib/unitxt/catalog/cards/belebele 2026-01-06T13:30:20,279 copying src/unitxt/catalog/cards/belebele/ibo_latn.json -> build/lib/unitxt/catalog/cards/belebele 2026-01-06T13:30:20,281 copying src/unitxt/catalog/cards/belebele/npi_latn.json -> build/lib/unitxt/catalog/cards/belebele 2026-01-06T13:30:20,284 copying src/unitxt/catalog/cards/belebele/arz_arab.json -> build/lib/unitxt/catalog/cards/belebele 2026-01-06T13:30:20,286 copying src/unitxt/catalog/cards/belebele/vie_latn.json -> build/lib/unitxt/catalog/cards/belebele 2026-01-06T13:30:20,289 copying src/unitxt/catalog/cards/belebele/som_latn.json -> build/lib/unitxt/catalog/cards/belebele 2026-01-06T13:30:20,291 copying src/unitxt/catalog/cards/belebele/ben_beng.json -> build/lib/unitxt/catalog/cards/belebele 2026-01-06T13:30:20,293 copying src/unitxt/catalog/cards/belebele/zho_hant.json -> build/lib/unitxt/catalog/cards/belebele 2026-01-06T13:30:20,295 copying src/unitxt/catalog/cards/belebele/bod_tibt.json -> build/lib/unitxt/catalog/cards/belebele 2026-01-06T13:30:20,298 copying src/unitxt/catalog/cards/belebele/ces_latn.json -> build/lib/unitxt/catalog/cards/belebele 2026-01-06T13:30:20,300 copying src/unitxt/catalog/cards/belebele/lug_latn.json -> build/lib/unitxt/catalog/cards/belebele 2026-01-06T13:30:20,302 copying src/unitxt/catalog/cards/belebele/kea_latn.json -> build/lib/unitxt/catalog/cards/belebele 2026-01-06T13:30:20,304 copying src/unitxt/catalog/cards/belebele/lin_latn.json -> build/lib/unitxt/catalog/cards/belebele 2026-01-06T13:30:20,306 copying src/unitxt/catalog/cards/belebele/mya_mymr.json -> build/lib/unitxt/catalog/cards/belebele 2026-01-06T13:30:20,309 copying src/unitxt/catalog/cards/belebele/ita_latn.json -> build/lib/unitxt/catalog/cards/belebele 2026-01-06T13:30:20,311 copying src/unitxt/catalog/cards/belebele/npi_deva.json -> build/lib/unitxt/catalog/cards/belebele 2026-01-06T13:30:20,313 copying src/unitxt/catalog/cards/belebele/ssw_latn.json -> build/lib/unitxt/catalog/cards/belebele 2026-01-06T13:30:20,316 copying src/unitxt/catalog/cards/belebele/fin_latn.json -> build/lib/unitxt/catalog/cards/belebele 2026-01-06T13:30:20,318 copying src/unitxt/catalog/cards/belebele/tel_telu.json -> build/lib/unitxt/catalog/cards/belebele 2026-01-06T13:30:20,321 copying src/unitxt/catalog/cards/belebele/arb_latn.json -> build/lib/unitxt/catalog/cards/belebele 2026-01-06T13:30:20,324 copying src/unitxt/catalog/cards/belebele/lao_laoo.json -> build/lib/unitxt/catalog/cards/belebele 2026-01-06T13:30:20,326 copying src/unitxt/catalog/cards/belebele/afr_latn.json -> build/lib/unitxt/catalog/cards/belebele 2026-01-06T13:30:20,329 copying src/unitxt/catalog/cards/belebele/ars_arab.json -> build/lib/unitxt/catalog/cards/belebele 2026-01-06T13:30:20,331 copying src/unitxt/catalog/cards/belebele/nld_latn.json -> build/lib/unitxt/catalog/cards/belebele 2026-01-06T13:30:20,333 copying src/unitxt/catalog/cards/belebele/wol_latn.json -> build/lib/unitxt/catalog/cards/belebele 2026-01-06T13:30:20,336 copying src/unitxt/catalog/cards/belebele/kan_knda.json -> build/lib/unitxt/catalog/cards/belebele 2026-01-06T13:30:20,338 copying src/unitxt/catalog/cards/belebele/luo_latn.json -> build/lib/unitxt/catalog/cards/belebele 2026-01-06T13:30:20,340 copying src/unitxt/catalog/cards/belebele/hat_latn.json -> build/lib/unitxt/catalog/cards/belebele 2026-01-06T13:30:20,343 copying src/unitxt/catalog/cards/belebele/zul_latn.json -> build/lib/unitxt/catalog/cards/belebele 2026-01-06T13:30:20,345 copying src/unitxt/catalog/cards/belebele/deu_latn.json -> build/lib/unitxt/catalog/cards/belebele 2026-01-06T13:30:20,347 copying src/unitxt/catalog/cards/belebele/bam_latn.json -> build/lib/unitxt/catalog/cards/belebele 2026-01-06T13:30:20,349 copying src/unitxt/catalog/cards/belebele/swh_latn.json -> build/lib/unitxt/catalog/cards/belebele 2026-01-06T13:30:20,352 copying src/unitxt/catalog/cards/belebele/apc_arab.json -> build/lib/unitxt/catalog/cards/belebele 2026-01-06T13:30:20,354 copying src/unitxt/catalog/cards/belebele/eng_latn.json -> build/lib/unitxt/catalog/cards/belebele 2026-01-06T13:30:20,356 copying src/unitxt/catalog/cards/belebele/sin_latn.json -> build/lib/unitxt/catalog/cards/belebele 2026-01-06T13:30:20,359 copying src/unitxt/catalog/cards/belebele/hye_armn.json -> build/lib/unitxt/catalog/cards/belebele 2026-01-06T13:30:20,361 copying src/unitxt/catalog/cards/belebele/urd_arab.json -> build/lib/unitxt/catalog/cards/belebele 2026-01-06T13:30:20,364 creating build/lib/unitxt/catalog/cards/mt_bench/response_assessment/pairwise_comparison 2026-01-06T13:30:20,366 copying src/unitxt/catalog/cards/mt_bench/response_assessment/pairwise_comparison/single_turn_gpt4_judgement.json -> build/lib/unitxt/catalog/cards/mt_bench/response_assessment/pairwise_comparison 2026-01-06T13:30:20,368 copying src/unitxt/catalog/cards/mt_bench/response_assessment/pairwise_comparison/single_turn_with_reference_gpt4_judgement.json -> build/lib/unitxt/catalog/cards/mt_bench/response_assessment/pairwise_comparison 2026-01-06T13:30:20,370 copying src/unitxt/catalog/cards/mt_bench/response_assessment/pairwise_comparison/multi_turn_gpt4_judgement.json -> build/lib/unitxt/catalog/cards/mt_bench/response_assessment/pairwise_comparison 2026-01-06T13:30:20,372 copying src/unitxt/catalog/cards/mt_bench/response_assessment/pairwise_comparison/multi_turn_with_reference_gpt4_judgement.json -> build/lib/unitxt/catalog/cards/mt_bench/response_assessment/pairwise_comparison 2026-01-06T13:30:20,374 creating build/lib/unitxt/catalog/cards/mt_bench/response_assessment/rating 2026-01-06T13:30:20,376 copying src/unitxt/catalog/cards/mt_bench/response_assessment/rating/single_turn_gpt4_judgement.json -> build/lib/unitxt/catalog/cards/mt_bench/response_assessment/rating 2026-01-06T13:30:20,379 copying src/unitxt/catalog/cards/mt_bench/response_assessment/rating/single_turn_with_reference_gpt4_judgement.json -> build/lib/unitxt/catalog/cards/mt_bench/response_assessment/rating 2026-01-06T13:30:20,381 copying src/unitxt/catalog/cards/mt_bench/response_assessment/rating/multi_turn_gpt4_judgement.json -> build/lib/unitxt/catalog/cards/mt_bench/response_assessment/rating 2026-01-06T13:30:20,383 copying src/unitxt/catalog/cards/mt_bench/response_assessment/rating/multi_turn_with_reference_gpt4_judgement.json -> build/lib/unitxt/catalog/cards/mt_bench/response_assessment/rating 2026-01-06T13:30:20,385 creating build/lib/unitxt/catalog/cards/mt_bench/generation 2026-01-06T13:30:20,386 copying src/unitxt/catalog/cards/mt_bench/generation/english_single_turn.json -> build/lib/unitxt/catalog/cards/mt_bench/generation 2026-01-06T13:30:20,389 copying src/unitxt/catalog/cards/mt_bench/generation/japanese_single_turn.json -> build/lib/unitxt/catalog/cards/mt_bench/generation 2026-01-06T13:30:20,391 creating build/lib/unitxt/catalog/cards/CFPB/product 2026-01-06T13:30:20,392 copying src/unitxt/catalog/cards/CFPB/product/watsonx.json -> build/lib/unitxt/catalog/cards/CFPB/product 2026-01-06T13:30:20,395 copying src/unitxt/catalog/cards/CFPB/product/2023.json -> build/lib/unitxt/catalog/cards/CFPB/product 2026-01-06T13:30:20,397 creating build/lib/unitxt/catalog/cards/dynamic_cards_for_llm_judges/rating 2026-01-06T13:30:20,399 copying src/unitxt/catalog/cards/dynamic_cards_for_llm_judges/rating/single_turn.json -> build/lib/unitxt/catalog/cards/dynamic_cards_for_llm_judges/rating 2026-01-06T13:30:20,401 copying src/unitxt/catalog/cards/dynamic_cards_for_llm_judges/rating/single_turn_with_reference.json -> build/lib/unitxt/catalog/cards/dynamic_cards_for_llm_judges/rating 2026-01-06T13:30:20,403 creating build/lib/unitxt/catalog/cards/dynamic_cards_for_llm_judges/pairwise_comparative_rating 2026-01-06T13:30:20,404 copying src/unitxt/catalog/cards/dynamic_cards_for_llm_judges/pairwise_comparative_rating/single_turn.json -> build/lib/unitxt/catalog/cards/dynamic_cards_for_llm_judges/pairwise_comparative_rating 2026-01-06T13:30:20,406 creating build/lib/unitxt/catalog/cards/mt/flores_101 2026-01-06T13:30:20,408 copying src/unitxt/catalog/cards/mt/flores_101/ara_eng.json -> build/lib/unitxt/catalog/cards/mt/flores_101 2026-01-06T13:30:20,412 copying src/unitxt/catalog/cards/mt/flores_101/kor_eng.json -> build/lib/unitxt/catalog/cards/mt/flores_101 2026-01-06T13:30:20,414 copying src/unitxt/catalog/cards/mt/flores_101/deu_eng.json -> build/lib/unitxt/catalog/cards/mt/flores_101 2026-01-06T13:30:20,417 copying src/unitxt/catalog/cards/mt/flores_101/eng_ara.json -> build/lib/unitxt/catalog/cards/mt/flores_101 2026-01-06T13:30:20,419 copying src/unitxt/catalog/cards/mt/flores_101/eng_ron.json -> build/lib/unitxt/catalog/cards/mt/flores_101 2026-01-06T13:30:20,421 copying src/unitxt/catalog/cards/mt/flores_101/eng_fra.json -> build/lib/unitxt/catalog/cards/mt/flores_101 2026-01-06T13:30:20,423 copying src/unitxt/catalog/cards/mt/flores_101/fra_eng.json -> build/lib/unitxt/catalog/cards/mt/flores_101 2026-01-06T13:30:20,425 copying src/unitxt/catalog/cards/mt/flores_101/spa_eng.json -> build/lib/unitxt/catalog/cards/mt/flores_101 2026-01-06T13:30:20,428 copying src/unitxt/catalog/cards/mt/flores_101/jpn_eng.json -> build/lib/unitxt/catalog/cards/mt/flores_101 2026-01-06T13:30:20,430 copying src/unitxt/catalog/cards/mt/flores_101/ron_eng.json -> build/lib/unitxt/catalog/cards/mt/flores_101 2026-01-06T13:30:20,432 copying src/unitxt/catalog/cards/mt/flores_101/eng_spa.json -> build/lib/unitxt/catalog/cards/mt/flores_101 2026-01-06T13:30:20,434 copying src/unitxt/catalog/cards/mt/flores_101/eng_jpn.json -> build/lib/unitxt/catalog/cards/mt/flores_101 2026-01-06T13:30:20,436 copying src/unitxt/catalog/cards/mt/flores_101/eng_deu.json -> build/lib/unitxt/catalog/cards/mt/flores_101 2026-01-06T13:30:20,438 copying src/unitxt/catalog/cards/mt/flores_101/eng_kor.json -> build/lib/unitxt/catalog/cards/mt/flores_101 2026-01-06T13:30:20,441 copying src/unitxt/catalog/cards/mt/flores_101/por_eng.json -> build/lib/unitxt/catalog/cards/mt/flores_101 2026-01-06T13:30:20,443 copying src/unitxt/catalog/cards/mt/flores_101/eng_por.json -> build/lib/unitxt/catalog/cards/mt/flores_101 2026-01-06T13:30:20,445 creating build/lib/unitxt/catalog/cards/mmmu 2026-01-06T13:30:20,446 copying src/unitxt/catalog/cards/mmmu/architecture_and_engineering.json -> build/lib/unitxt/catalog/cards/mmmu 2026-01-06T13:30:20,449 copying src/unitxt/catalog/cards/mmmu/agriculture.json -> build/lib/unitxt/catalog/cards/mmmu 2026-01-06T13:30:20,451 copying src/unitxt/catalog/cards/mmmu/manage.json -> build/lib/unitxt/catalog/cards/mmmu 2026-01-06T13:30:20,453 copying src/unitxt/catalog/cards/mmmu/computer_science.json -> build/lib/unitxt/catalog/cards/mmmu 2026-01-06T13:30:20,456 copying src/unitxt/catalog/cards/mmmu/art_theory.json -> build/lib/unitxt/catalog/cards/mmmu 2026-01-06T13:30:20,458 copying src/unitxt/catalog/cards/mmmu/math.json -> build/lib/unitxt/catalog/cards/mmmu 2026-01-06T13:30:20,460 copying src/unitxt/catalog/cards/mmmu/physics.json -> build/lib/unitxt/catalog/cards/mmmu 2026-01-06T13:30:20,463 copying src/unitxt/catalog/cards/mmmu/economics.json -> build/lib/unitxt/catalog/cards/mmmu 2026-01-06T13:30:20,465 copying src/unitxt/catalog/cards/mmmu/design.json -> build/lib/unitxt/catalog/cards/mmmu 2026-01-06T13:30:20,467 copying src/unitxt/catalog/cards/mmmu/materials.json -> build/lib/unitxt/catalog/cards/mmmu 2026-01-06T13:30:20,470 copying src/unitxt/catalog/cards/mmmu/public_health.json -> build/lib/unitxt/catalog/cards/mmmu 2026-01-06T13:30:20,472 copying src/unitxt/catalog/cards/mmmu/finance.json -> build/lib/unitxt/catalog/cards/mmmu 2026-01-06T13:30:20,474 copying src/unitxt/catalog/cards/mmmu/clinical_medicine.json -> build/lib/unitxt/catalog/cards/mmmu 2026-01-06T13:30:20,477 copying src/unitxt/catalog/cards/mmmu/pharmacy.json -> build/lib/unitxt/catalog/cards/mmmu 2026-01-06T13:30:20,479 copying src/unitxt/catalog/cards/mmmu/basic_medical_science.json -> build/lib/unitxt/catalog/cards/mmmu 2026-01-06T13:30:20,481 copying src/unitxt/catalog/cards/mmmu/geography.json -> build/lib/unitxt/catalog/cards/mmmu 2026-01-06T13:30:20,483 copying src/unitxt/catalog/cards/mmmu/energy_and_power.json -> build/lib/unitxt/catalog/cards/mmmu 2026-01-06T13:30:20,486 copying src/unitxt/catalog/cards/mmmu/psychology.json -> build/lib/unitxt/catalog/cards/mmmu 2026-01-06T13:30:20,488 copying src/unitxt/catalog/cards/mmmu/sociology.json -> build/lib/unitxt/catalog/cards/mmmu 2026-01-06T13:30:20,490 copying src/unitxt/catalog/cards/mmmu/history.json -> build/lib/unitxt/catalog/cards/mmmu 2026-01-06T13:30:20,493 copying src/unitxt/catalog/cards/mmmu/art.json -> build/lib/unitxt/catalog/cards/mmmu 2026-01-06T13:30:20,495 copying src/unitxt/catalog/cards/mmmu/accounting.json -> build/lib/unitxt/catalog/cards/mmmu 2026-01-06T13:30:20,497 copying src/unitxt/catalog/cards/mmmu/biology.json -> build/lib/unitxt/catalog/cards/mmmu 2026-01-06T13:30:20,499 copying src/unitxt/catalog/cards/mmmu/music.json -> build/lib/unitxt/catalog/cards/mmmu 2026-01-06T13:30:20,501 copying src/unitxt/catalog/cards/mmmu/literature.json -> build/lib/unitxt/catalog/cards/mmmu 2026-01-06T13:30:20,504 copying src/unitxt/catalog/cards/mmmu/marketing.json -> build/lib/unitxt/catalog/cards/mmmu 2026-01-06T13:30:20,506 copying src/unitxt/catalog/cards/mmmu/mechanical_engineering.json -> build/lib/unitxt/catalog/cards/mmmu 2026-01-06T13:30:20,508 copying src/unitxt/catalog/cards/mmmu/electronics.json -> build/lib/unitxt/catalog/cards/mmmu 2026-01-06T13:30:20,510 copying src/unitxt/catalog/cards/mmmu/diagnostics_and_laboratory_medicine.json -> build/lib/unitxt/catalog/cards/mmmu 2026-01-06T13:30:20,512 copying src/unitxt/catalog/cards/mmmu/chemistry.json -> build/lib/unitxt/catalog/cards/mmmu 2026-01-06T13:30:20,514 creating build/lib/unitxt/catalog/cards/global_mmlu_lite_cs 2026-01-06T13:30:20,515 copying src/unitxt/catalog/cards/global_mmlu_lite_cs/zh.json -> build/lib/unitxt/catalog/cards/global_mmlu_lite_cs 2026-01-06T13:30:20,518 copying src/unitxt/catalog/cards/global_mmlu_lite_cs/it.json -> build/lib/unitxt/catalog/cards/global_mmlu_lite_cs 2026-01-06T13:30:20,521 copying src/unitxt/catalog/cards/global_mmlu_lite_cs/ar.json -> build/lib/unitxt/catalog/cards/global_mmlu_lite_cs 2026-01-06T13:30:20,524 copying src/unitxt/catalog/cards/global_mmlu_lite_cs/bn.json -> build/lib/unitxt/catalog/cards/global_mmlu_lite_cs 2026-01-06T13:30:20,526 copying src/unitxt/catalog/cards/global_mmlu_lite_cs/yo.json -> build/lib/unitxt/catalog/cards/global_mmlu_lite_cs 2026-01-06T13:30:20,529 copying src/unitxt/catalog/cards/global_mmlu_lite_cs/es.json -> build/lib/unitxt/catalog/cards/global_mmlu_lite_cs 2026-01-06T13:30:20,532 copying src/unitxt/catalog/cards/global_mmlu_lite_cs/ja.json -> build/lib/unitxt/catalog/cards/global_mmlu_lite_cs 2026-01-06T13:30:20,534 copying src/unitxt/catalog/cards/global_mmlu_lite_cs/ko.json -> build/lib/unitxt/catalog/cards/global_mmlu_lite_cs 2026-01-06T13:30:20,537 copying src/unitxt/catalog/cards/global_mmlu_lite_cs/pt.json -> build/lib/unitxt/catalog/cards/global_mmlu_lite_cs 2026-01-06T13:30:20,540 copying src/unitxt/catalog/cards/global_mmlu_lite_cs/id.json -> build/lib/unitxt/catalog/cards/global_mmlu_lite_cs 2026-01-06T13:30:20,542 copying src/unitxt/catalog/cards/global_mmlu_lite_cs/de.json -> build/lib/unitxt/catalog/cards/global_mmlu_lite_cs 2026-01-06T13:30:20,545 copying src/unitxt/catalog/cards/global_mmlu_lite_cs/fr.json -> build/lib/unitxt/catalog/cards/global_mmlu_lite_cs 2026-01-06T13:30:20,548 copying src/unitxt/catalog/cards/global_mmlu_lite_cs/sw.json -> build/lib/unitxt/catalog/cards/global_mmlu_lite_cs 2026-01-06T13:30:20,551 copying src/unitxt/catalog/cards/global_mmlu_lite_cs/hi.json -> build/lib/unitxt/catalog/cards/global_mmlu_lite_cs 2026-01-06T13:30:20,553 creating build/lib/unitxt/catalog/cards/rag 2026-01-06T13:30:20,554 copying src/unitxt/catalog/cards/rag/mtrag.json -> build/lib/unitxt/catalog/cards/rag 2026-01-06T13:30:20,556 creating build/lib/unitxt/catalog/cards/rag/mtrag/documents 2026-01-06T13:30:20,558 copying src/unitxt/catalog/cards/rag/mtrag/documents/fiqa.json -> build/lib/unitxt/catalog/cards/rag/mtrag/documents 2026-01-06T13:30:20,561 copying src/unitxt/catalog/cards/rag/mtrag/documents/clapnq.json -> build/lib/unitxt/catalog/cards/rag/mtrag/documents 2026-01-06T13:30:20,563 copying src/unitxt/catalog/cards/rag/mtrag/documents/govt.json -> build/lib/unitxt/catalog/cards/rag/mtrag/documents 2026-01-06T13:30:20,565 copying src/unitxt/catalog/cards/rag/mtrag/documents/cloud.json -> build/lib/unitxt/catalog/cards/rag/mtrag/documents 2026-01-06T13:30:20,567 creating build/lib/unitxt/catalog/cards/rag/response_generation 2026-01-06T13:30:20,569 copying src/unitxt/catalog/cards/rag/response_generation/clapnq.json -> build/lib/unitxt/catalog/cards/rag/response_generation 2026-01-06T13:30:20,572 creating build/lib/unitxt/catalog/cards/rag/response_generation/train 2026-01-06T13:30:20,573 copying src/unitxt/catalog/cards/rag/response_generation/train/clapnq.json -> build/lib/unitxt/catalog/cards/rag/response_generation/train 2026-01-06T13:30:20,575 copying src/unitxt/catalog/cards/rag/response_generation/train/open_australian_legal_qa.json -> build/lib/unitxt/catalog/cards/rag/response_generation/train 2026-01-06T13:30:20,577 creating build/lib/unitxt/catalog/cards/rag/response_generation/ragbench 2026-01-06T13:30:20,578 copying src/unitxt/catalog/cards/rag/response_generation/ragbench/cuad.json -> build/lib/unitxt/catalog/cards/rag/response_generation/ragbench 2026-01-06T13:30:20,580 copying src/unitxt/catalog/cards/rag/response_generation/ragbench/tatqa.json -> build/lib/unitxt/catalog/cards/rag/response_generation/ragbench 2026-01-06T13:30:20,582 copying src/unitxt/catalog/cards/rag/response_generation/ragbench/msmarco.json -> build/lib/unitxt/catalog/cards/rag/response_generation/ragbench 2026-01-06T13:30:20,584 copying src/unitxt/catalog/cards/rag/response_generation/ragbench/delucionqa.json -> build/lib/unitxt/catalog/cards/rag/response_generation/ragbench 2026-01-06T13:30:20,586 copying src/unitxt/catalog/cards/rag/response_generation/ragbench/covidqa.json -> build/lib/unitxt/catalog/cards/rag/response_generation/ragbench 2026-01-06T13:30:20,589 copying src/unitxt/catalog/cards/rag/response_generation/ragbench/techqa.json -> build/lib/unitxt/catalog/cards/rag/response_generation/ragbench 2026-01-06T13:30:20,591 copying src/unitxt/catalog/cards/rag/response_generation/ragbench/expertqa.json -> build/lib/unitxt/catalog/cards/rag/response_generation/ragbench 2026-01-06T13:30:20,594 copying src/unitxt/catalog/cards/rag/response_generation/ragbench/finqa.json -> build/lib/unitxt/catalog/cards/rag/response_generation/ragbench 2026-01-06T13:30:20,597 copying src/unitxt/catalog/cards/rag/response_generation/ragbench/emanual.json -> build/lib/unitxt/catalog/cards/rag/response_generation/ragbench 2026-01-06T13:30:20,600 copying src/unitxt/catalog/cards/rag/response_generation/ragbench/pubmedqa.json -> build/lib/unitxt/catalog/cards/rag/response_generation/ragbench 2026-01-06T13:30:20,602 copying src/unitxt/catalog/cards/rag/response_generation/ragbench/hotpotqa.json -> build/lib/unitxt/catalog/cards/rag/response_generation/ragbench 2026-01-06T13:30:20,605 copying src/unitxt/catalog/cards/rag/response_generation/ragbench/hagrid.json -> build/lib/unitxt/catalog/cards/rag/response_generation/ragbench 2026-01-06T13:30:20,608 creating build/lib/unitxt/catalog/cards/rag/response_generation/chat_rag_bench/user_assistant_format 2026-01-06T13:30:20,610 copying src/unitxt/catalog/cards/rag/response_generation/chat_rag_bench/user_assistant_format/doqa_cooking.json -> build/lib/unitxt/catalog/cards/rag/response_generation/chat_rag_bench/user_assistant_format 2026-01-06T13:30:20,613 copying src/unitxt/catalog/cards/rag/response_generation/chat_rag_bench/user_assistant_format/doqa_movies.json -> build/lib/unitxt/catalog/cards/rag/response_generation/chat_rag_bench/user_assistant_format 2026-01-06T13:30:20,616 copying src/unitxt/catalog/cards/rag/response_generation/chat_rag_bench/user_assistant_format/hybridial.json -> build/lib/unitxt/catalog/cards/rag/response_generation/chat_rag_bench/user_assistant_format 2026-01-06T13:30:20,619 copying src/unitxt/catalog/cards/rag/response_generation/chat_rag_bench/user_assistant_format/doqa_travel.json -> build/lib/unitxt/catalog/cards/rag/response_generation/chat_rag_bench/user_assistant_format 2026-01-06T13:30:20,622 copying src/unitxt/catalog/cards/rag/response_generation/chat_rag_bench/user_assistant_format/doc2dial.json -> build/lib/unitxt/catalog/cards/rag/response_generation/chat_rag_bench/user_assistant_format 2026-01-06T13:30:20,625 creating build/lib/unitxt/catalog/cards/rag/response_generation/chat_rag_bench/train/user_assistant_format 2026-01-06T13:30:20,627 copying src/unitxt/catalog/cards/rag/response_generation/chat_rag_bench/train/user_assistant_format/doqa_cooking.json -> build/lib/unitxt/catalog/cards/rag/response_generation/chat_rag_bench/train/user_assistant_format 2026-01-06T13:30:20,630 copying src/unitxt/catalog/cards/rag/response_generation/chat_rag_bench/train/user_assistant_format/doqa_movies.json -> build/lib/unitxt/catalog/cards/rag/response_generation/chat_rag_bench/train/user_assistant_format 2026-01-06T13:30:20,633 copying src/unitxt/catalog/cards/rag/response_generation/chat_rag_bench/train/user_assistant_format/hybridial.json -> build/lib/unitxt/catalog/cards/rag/response_generation/chat_rag_bench/train/user_assistant_format 2026-01-06T13:30:20,636 copying src/unitxt/catalog/cards/rag/response_generation/chat_rag_bench/train/user_assistant_format/doqa_travel.json -> build/lib/unitxt/catalog/cards/rag/response_generation/chat_rag_bench/train/user_assistant_format 2026-01-06T13:30:20,639 copying src/unitxt/catalog/cards/rag/response_generation/chat_rag_bench/train/user_assistant_format/doc2dial.json -> build/lib/unitxt/catalog/cards/rag/response_generation/chat_rag_bench/train/user_assistant_format 2026-01-06T13:30:20,641 creating build/lib/unitxt/catalog/cards/rag/benchmark/clap_nq 2026-01-06T13:30:20,643 copying src/unitxt/catalog/cards/rag/benchmark/clap_nq/en.json -> build/lib/unitxt/catalog/cards/rag/benchmark/clap_nq 2026-01-06T13:30:20,645 creating build/lib/unitxt/catalog/cards/rag/benchmark/hotpotqa 2026-01-06T13:30:20,646 copying src/unitxt/catalog/cards/rag/benchmark/hotpotqa/en.json -> build/lib/unitxt/catalog/cards/rag/benchmark/hotpotqa 2026-01-06T13:30:20,649 creating build/lib/unitxt/catalog/cards/rag/benchmark/real_mm_rag_tech_slides 2026-01-06T13:30:20,651 copying src/unitxt/catalog/cards/rag/benchmark/real_mm_rag_tech_slides/en.json -> build/lib/unitxt/catalog/cards/rag/benchmark/real_mm_rag_tech_slides 2026-01-06T13:30:20,653 creating build/lib/unitxt/catalog/cards/rag/benchmark/real_mm_rag_fin_report 2026-01-06T13:30:20,655 copying src/unitxt/catalog/cards/rag/benchmark/real_mm_rag_fin_report/en.json -> build/lib/unitxt/catalog/cards/rag/benchmark/real_mm_rag_fin_report 2026-01-06T13:30:20,657 creating build/lib/unitxt/catalog/cards/rag/benchmark/watsonxqa 2026-01-06T13:30:20,659 copying src/unitxt/catalog/cards/rag/benchmark/watsonxqa/en.json -> build/lib/unitxt/catalog/cards/rag/benchmark/watsonxqa 2026-01-06T13:30:20,661 creating build/lib/unitxt/catalog/cards/rag/benchmark/real_mm_rag_tech_report 2026-01-06T13:30:20,663 copying src/unitxt/catalog/cards/rag/benchmark/real_mm_rag_tech_report/en.json -> build/lib/unitxt/catalog/cards/rag/benchmark/real_mm_rag_tech_report 2026-01-06T13:30:20,666 creating build/lib/unitxt/catalog/cards/rag/benchmark/real_mm_rag_fin_slides 2026-01-06T13:30:20,667 copying src/unitxt/catalog/cards/rag/benchmark/real_mm_rag_fin_slides/en.json -> build/lib/unitxt/catalog/cards/rag/benchmark/real_mm_rag_fin_slides 2026-01-06T13:30:20,669 creating build/lib/unitxt/catalog/cards/rag/benchmark/bioasq 2026-01-06T13:30:20,670 copying src/unitxt/catalog/cards/rag/benchmark/bioasq/en.json -> build/lib/unitxt/catalog/cards/rag/benchmark/bioasq 2026-01-06T13:30:20,673 creating build/lib/unitxt/catalog/cards/rag/benchmark/miniwiki 2026-01-06T13:30:20,674 copying src/unitxt/catalog/cards/rag/benchmark/miniwiki/en.json -> build/lib/unitxt/catalog/cards/rag/benchmark/miniwiki 2026-01-06T13:30:20,677 creating build/lib/unitxt/catalog/cards/rag/documents/clap_nq 2026-01-06T13:30:20,679 copying src/unitxt/catalog/cards/rag/documents/clap_nq/en.json -> build/lib/unitxt/catalog/cards/rag/documents/clap_nq 2026-01-06T13:30:20,682 creating build/lib/unitxt/catalog/cards/rag/documents/hotpotqa 2026-01-06T13:30:20,683 copying src/unitxt/catalog/cards/rag/documents/hotpotqa/en.json -> build/lib/unitxt/catalog/cards/rag/documents/hotpotqa 2026-01-06T13:30:20,686 creating build/lib/unitxt/catalog/cards/rag/documents/real_mm_rag_tech_slides 2026-01-06T13:30:20,687 copying src/unitxt/catalog/cards/rag/documents/real_mm_rag_tech_slides/en.json -> build/lib/unitxt/catalog/cards/rag/documents/real_mm_rag_tech_slides 2026-01-06T13:30:20,690 creating build/lib/unitxt/catalog/cards/rag/documents/real_mm_rag_fin_report 2026-01-06T13:30:20,692 copying src/unitxt/catalog/cards/rag/documents/real_mm_rag_fin_report/en.json -> build/lib/unitxt/catalog/cards/rag/documents/real_mm_rag_fin_report 2026-01-06T13:30:20,694 creating build/lib/unitxt/catalog/cards/rag/documents/watsonxqa 2026-01-06T13:30:20,696 copying src/unitxt/catalog/cards/rag/documents/watsonxqa/en.json -> build/lib/unitxt/catalog/cards/rag/documents/watsonxqa 2026-01-06T13:30:20,699 creating build/lib/unitxt/catalog/cards/rag/documents/real_mm_rag_tech_report 2026-01-06T13:30:20,700 copying src/unitxt/catalog/cards/rag/documents/real_mm_rag_tech_report/en.json -> build/lib/unitxt/catalog/cards/rag/documents/real_mm_rag_tech_report 2026-01-06T13:30:20,703 creating build/lib/unitxt/catalog/cards/rag/documents/real_mm_rag_fin_slides 2026-01-06T13:30:20,704 copying src/unitxt/catalog/cards/rag/documents/real_mm_rag_fin_slides/en.json -> build/lib/unitxt/catalog/cards/rag/documents/real_mm_rag_fin_slides 2026-01-06T13:30:20,707 creating build/lib/unitxt/catalog/cards/rag/documents/bioasq 2026-01-06T13:30:20,708 copying src/unitxt/catalog/cards/rag/documents/bioasq/en.json -> build/lib/unitxt/catalog/cards/rag/documents/bioasq 2026-01-06T13:30:20,711 creating build/lib/unitxt/catalog/cards/rag/documents/miniwiki 2026-01-06T13:30:20,712 copying src/unitxt/catalog/cards/rag/documents/miniwiki/en.json -> build/lib/unitxt/catalog/cards/rag/documents/miniwiki 2026-01-06T13:30:20,715 creating build/lib/unitxt/catalog/cards/xnli 2026-01-06T13:30:20,716 copying src/unitxt/catalog/cards/xnli/zh.json -> build/lib/unitxt/catalog/cards/xnli 2026-01-06T13:30:20,719 copying src/unitxt/catalog/cards/xnli/vi.json -> build/lib/unitxt/catalog/cards/xnli 2026-01-06T13:30:20,722 copying src/unitxt/catalog/cards/xnli/ur.json -> build/lib/unitxt/catalog/cards/xnli 2026-01-06T13:30:20,724 copying src/unitxt/catalog/cards/xnli/ru.json -> build/lib/unitxt/catalog/cards/xnli 2026-01-06T13:30:20,726 copying src/unitxt/catalog/cards/xnli/en.json -> build/lib/unitxt/catalog/cards/xnli 2026-01-06T13:30:20,728 copying src/unitxt/catalog/cards/xnli/ar.json -> build/lib/unitxt/catalog/cards/xnli 2026-01-06T13:30:20,731 copying src/unitxt/catalog/cards/xnli/es.json -> build/lib/unitxt/catalog/cards/xnli 2026-01-06T13:30:20,734 copying src/unitxt/catalog/cards/xnli/th.json -> build/lib/unitxt/catalog/cards/xnli 2026-01-06T13:30:20,737 copying src/unitxt/catalog/cards/xnli/tr.json -> build/lib/unitxt/catalog/cards/xnli 2026-01-06T13:30:20,740 copying src/unitxt/catalog/cards/xnli/el.json -> build/lib/unitxt/catalog/cards/xnli 2026-01-06T13:30:20,742 copying src/unitxt/catalog/cards/xnli/de.json -> build/lib/unitxt/catalog/cards/xnli 2026-01-06T13:30:20,744 copying src/unitxt/catalog/cards/xnli/fr.json -> build/lib/unitxt/catalog/cards/xnli 2026-01-06T13:30:20,747 copying src/unitxt/catalog/cards/xnli/sw.json -> build/lib/unitxt/catalog/cards/xnli 2026-01-06T13:30:20,749 copying src/unitxt/catalog/cards/xnli/hi.json -> build/lib/unitxt/catalog/cards/xnli 2026-01-06T13:30:20,751 copying src/unitxt/catalog/cards/xnli/bg.json -> build/lib/unitxt/catalog/cards/xnli 2026-01-06T13:30:20,753 creating build/lib/unitxt/catalog/cards/mlsum 2026-01-06T13:30:20,754 copying src/unitxt/catalog/cards/mlsum/ru.json -> build/lib/unitxt/catalog/cards/mlsum 2026-01-06T13:30:20,757 copying src/unitxt/catalog/cards/mlsum/tu.json -> build/lib/unitxt/catalog/cards/mlsum 2026-01-06T13:30:20,759 copying src/unitxt/catalog/cards/mlsum/es.json -> build/lib/unitxt/catalog/cards/mlsum 2026-01-06T13:30:20,761 copying src/unitxt/catalog/cards/mlsum/de.json -> build/lib/unitxt/catalog/cards/mlsum 2026-01-06T13:30:20,764 copying src/unitxt/catalog/cards/mlsum/fr.json -> build/lib/unitxt/catalog/cards/mlsum 2026-01-06T13:30:20,766 creating build/lib/unitxt/catalog/cards/multidoc2dial 2026-01-06T13:30:20,767 copying src/unitxt/catalog/cards/multidoc2dial/extractive.json -> build/lib/unitxt/catalog/cards/multidoc2dial 2026-01-06T13:30:20,769 copying src/unitxt/catalog/cards/multidoc2dial/abstractive.json -> build/lib/unitxt/catalog/cards/multidoc2dial 2026-01-06T13:30:20,771 creating build/lib/unitxt/catalog/cards/judge_bench/newswoom 2026-01-06T13:30:20,773 copying src/unitxt/catalog/cards/judge_bench/newswoom/coherence.json -> build/lib/unitxt/catalog/cards/judge_bench/newswoom 2026-01-06T13:30:20,775 copying src/unitxt/catalog/cards/judge_bench/newswoom/relevance.json -> build/lib/unitxt/catalog/cards/judge_bench/newswoom 2026-01-06T13:30:20,777 copying src/unitxt/catalog/cards/judge_bench/newswoom/informativeness.json -> build/lib/unitxt/catalog/cards/judge_bench/newswoom 2026-01-06T13:30:20,780 copying src/unitxt/catalog/cards/judge_bench/newswoom/fluency.json -> build/lib/unitxt/catalog/cards/judge_bench/newswoom 2026-01-06T13:30:20,782 creating build/lib/unitxt/catalog/cards/judge_bench/roscoe/overall/cosmos 2026-01-06T13:30:20,784 copying src/unitxt/catalog/cards/judge_bench/roscoe/overall/cosmos/contradiction.json -> build/lib/unitxt/catalog/cards/judge_bench/roscoe/overall/cosmos 2026-01-06T13:30:20,786 copying src/unitxt/catalog/cards/judge_bench/roscoe/overall/cosmos/coherence.json -> build/lib/unitxt/catalog/cards/judge_bench/roscoe/overall/cosmos 2026-01-06T13:30:20,788 copying src/unitxt/catalog/cards/judge_bench/roscoe/overall/cosmos/missing_steps.json -> build/lib/unitxt/catalog/cards/judge_bench/roscoe/overall/cosmos 2026-01-06T13:30:20,791 copying src/unitxt/catalog/cards/judge_bench/roscoe/overall/cosmos/overall_quality.json -> build/lib/unitxt/catalog/cards/judge_bench/roscoe/overall/cosmos 2026-01-06T13:30:20,793 creating build/lib/unitxt/catalog/cards/judge_bench/roscoe/overall/esnli 2026-01-06T13:30:20,794 copying src/unitxt/catalog/cards/judge_bench/roscoe/overall/esnli/contradiction.json -> build/lib/unitxt/catalog/cards/judge_bench/roscoe/overall/esnli 2026-01-06T13:30:20,797 copying src/unitxt/catalog/cards/judge_bench/roscoe/overall/esnli/coherence.json -> build/lib/unitxt/catalog/cards/judge_bench/roscoe/overall/esnli 2026-01-06T13:30:20,799 copying src/unitxt/catalog/cards/judge_bench/roscoe/overall/esnli/missing_steps.json -> build/lib/unitxt/catalog/cards/judge_bench/roscoe/overall/esnli 2026-01-06T13:30:20,801 copying src/unitxt/catalog/cards/judge_bench/roscoe/overall/esnli/overall_quality.json -> build/lib/unitxt/catalog/cards/judge_bench/roscoe/overall/esnli 2026-01-06T13:30:20,804 creating build/lib/unitxt/catalog/cards/judge_bench/roscoe/overall/drop 2026-01-06T13:30:20,805 copying src/unitxt/catalog/cards/judge_bench/roscoe/overall/drop/contradiction.json -> build/lib/unitxt/catalog/cards/judge_bench/roscoe/overall/drop 2026-01-06T13:30:20,807 copying src/unitxt/catalog/cards/judge_bench/roscoe/overall/drop/coherence.json -> build/lib/unitxt/catalog/cards/judge_bench/roscoe/overall/drop 2026-01-06T13:30:20,809 copying src/unitxt/catalog/cards/judge_bench/roscoe/overall/drop/missing_steps.json -> build/lib/unitxt/catalog/cards/judge_bench/roscoe/overall/drop 2026-01-06T13:30:20,812 copying src/unitxt/catalog/cards/judge_bench/roscoe/overall/drop/overall_quality.json -> build/lib/unitxt/catalog/cards/judge_bench/roscoe/overall/drop 2026-01-06T13:30:20,814 creating build/lib/unitxt/catalog/cards/judge_bench/roscoe/stepwise/cosmos 2026-01-06T13:30:20,816 copying src/unitxt/catalog/cards/judge_bench/roscoe/stepwise/cosmos/coherency_and_logic.json -> build/lib/unitxt/catalog/cards/judge_bench/roscoe/stepwise/cosmos 2026-01-06T13:30:20,819 copying src/unitxt/catalog/cards/judge_bench/roscoe/stepwise/cosmos/grammar.json -> build/lib/unitxt/catalog/cards/judge_bench/roscoe/stepwise/cosmos 2026-01-06T13:30:20,821 copying src/unitxt/catalog/cards/judge_bench/roscoe/stepwise/cosmos/final_answer.json -> build/lib/unitxt/catalog/cards/judge_bench/roscoe/stepwise/cosmos 2026-01-06T13:30:20,824 copying src/unitxt/catalog/cards/judge_bench/roscoe/stepwise/cosmos/repetition.json -> build/lib/unitxt/catalog/cards/judge_bench/roscoe/stepwise/cosmos 2026-01-06T13:30:20,826 copying src/unitxt/catalog/cards/judge_bench/roscoe/stepwise/cosmos/commonsense.json -> build/lib/unitxt/catalog/cards/judge_bench/roscoe/stepwise/cosmos 2026-01-06T13:30:20,828 copying src/unitxt/catalog/cards/judge_bench/roscoe/stepwise/cosmos/factuality.json -> build/lib/unitxt/catalog/cards/judge_bench/roscoe/stepwise/cosmos 2026-01-06T13:30:20,831 copying src/unitxt/catalog/cards/judge_bench/roscoe/stepwise/cosmos/arithmetic.json -> build/lib/unitxt/catalog/cards/judge_bench/roscoe/stepwise/cosmos 2026-01-06T13:30:20,833 copying src/unitxt/catalog/cards/judge_bench/roscoe/stepwise/cosmos/hallucination.json -> build/lib/unitxt/catalog/cards/judge_bench/roscoe/stepwise/cosmos 2026-01-06T13:30:20,835 copying src/unitxt/catalog/cards/judge_bench/roscoe/stepwise/cosmos/redundancy.json -> build/lib/unitxt/catalog/cards/judge_bench/roscoe/stepwise/cosmos 2026-01-06T13:30:20,838 creating build/lib/unitxt/catalog/cards/judge_bench/roscoe/stepwise/esnli 2026-01-06T13:30:20,839 copying src/unitxt/catalog/cards/judge_bench/roscoe/stepwise/esnli/coherency_and_logic.json -> build/lib/unitxt/catalog/cards/judge_bench/roscoe/stepwise/esnli 2026-01-06T13:30:20,841 copying src/unitxt/catalog/cards/judge_bench/roscoe/stepwise/esnli/grammar.json -> build/lib/unitxt/catalog/cards/judge_bench/roscoe/stepwise/esnli 2026-01-06T13:30:20,844 copying src/unitxt/catalog/cards/judge_bench/roscoe/stepwise/esnli/final_answer.json -> build/lib/unitxt/catalog/cards/judge_bench/roscoe/stepwise/esnli 2026-01-06T13:30:20,846 copying src/unitxt/catalog/cards/judge_bench/roscoe/stepwise/esnli/repetition.json -> build/lib/unitxt/catalog/cards/judge_bench/roscoe/stepwise/esnli 2026-01-06T13:30:20,849 copying src/unitxt/catalog/cards/judge_bench/roscoe/stepwise/esnli/commonsense.json -> build/lib/unitxt/catalog/cards/judge_bench/roscoe/stepwise/esnli 2026-01-06T13:30:20,851 copying src/unitxt/catalog/cards/judge_bench/roscoe/stepwise/esnli/factuality.json -> build/lib/unitxt/catalog/cards/judge_bench/roscoe/stepwise/esnli 2026-01-06T13:30:20,853 copying src/unitxt/catalog/cards/judge_bench/roscoe/stepwise/esnli/arithmetic.json -> build/lib/unitxt/catalog/cards/judge_bench/roscoe/stepwise/esnli 2026-01-06T13:30:20,856 copying src/unitxt/catalog/cards/judge_bench/roscoe/stepwise/esnli/hallucination.json -> build/lib/unitxt/catalog/cards/judge_bench/roscoe/stepwise/esnli 2026-01-06T13:30:20,858 copying src/unitxt/catalog/cards/judge_bench/roscoe/stepwise/esnli/redundancy.json -> build/lib/unitxt/catalog/cards/judge_bench/roscoe/stepwise/esnli 2026-01-06T13:30:20,860 creating build/lib/unitxt/catalog/cards/judge_bench/roscoe/stepwise/drop 2026-01-06T13:30:20,861 copying src/unitxt/catalog/cards/judge_bench/roscoe/stepwise/drop/coherency_and_logic.json -> build/lib/unitxt/catalog/cards/judge_bench/roscoe/stepwise/drop 2026-01-06T13:30:20,864 copying src/unitxt/catalog/cards/judge_bench/roscoe/stepwise/drop/grammar.json -> build/lib/unitxt/catalog/cards/judge_bench/roscoe/stepwise/drop 2026-01-06T13:30:20,866 copying src/unitxt/catalog/cards/judge_bench/roscoe/stepwise/drop/final_answer.json -> build/lib/unitxt/catalog/cards/judge_bench/roscoe/stepwise/drop 2026-01-06T13:30:20,869 copying src/unitxt/catalog/cards/judge_bench/roscoe/stepwise/drop/repetition.json -> build/lib/unitxt/catalog/cards/judge_bench/roscoe/stepwise/drop 2026-01-06T13:30:20,871 copying src/unitxt/catalog/cards/judge_bench/roscoe/stepwise/drop/commonsense.json -> build/lib/unitxt/catalog/cards/judge_bench/roscoe/stepwise/drop 2026-01-06T13:30:20,874 copying src/unitxt/catalog/cards/judge_bench/roscoe/stepwise/drop/factuality.json -> build/lib/unitxt/catalog/cards/judge_bench/roscoe/stepwise/drop 2026-01-06T13:30:20,876 copying src/unitxt/catalog/cards/judge_bench/roscoe/stepwise/drop/arithmetic.json -> build/lib/unitxt/catalog/cards/judge_bench/roscoe/stepwise/drop 2026-01-06T13:30:20,879 copying src/unitxt/catalog/cards/judge_bench/roscoe/stepwise/drop/hallucination.json -> build/lib/unitxt/catalog/cards/judge_bench/roscoe/stepwise/drop 2026-01-06T13:30:20,881 copying src/unitxt/catalog/cards/judge_bench/roscoe/stepwise/drop/redundancy.json -> build/lib/unitxt/catalog/cards/judge_bench/roscoe/stepwise/drop 2026-01-06T13:30:20,883 creating build/lib/unitxt/catalog/cards/judge_bench/inferential_strategies 2026-01-06T13:30:20,884 copying src/unitxt/catalog/cards/judge_bench/inferential_strategies/sound_reasoning.json -> build/lib/unitxt/catalog/cards/judge_bench/inferential_strategies 2026-01-06T13:30:20,886 creating build/lib/unitxt/catalog/cards/judge_bench/wmt_human/chinese_to_english 2026-01-06T13:30:20,888 copying src/unitxt/catalog/cards/judge_bench/wmt_human/chinese_to_english/quality.json -> build/lib/unitxt/catalog/cards/judge_bench/wmt_human/chinese_to_english 2026-01-06T13:30:20,890 creating build/lib/unitxt/catalog/cards/judge_bench/wmt_human/english_to_german 2026-01-06T13:30:20,891 copying src/unitxt/catalog/cards/judge_bench/wmt_human/english_to_german/quality.json -> build/lib/unitxt/catalog/cards/judge_bench/wmt_human/english_to_german 2026-01-06T13:30:20,893 creating build/lib/unitxt/catalog/cards/judge_bench/cola 2026-01-06T13:30:20,894 copying src/unitxt/catalog/cards/judge_bench/cola/grammaticality.json -> build/lib/unitxt/catalog/cards/judge_bench/cola 2026-01-06T13:30:20,897 creating build/lib/unitxt/catalog/cards/judge_bench/toxic_chat 2026-01-06T13:30:20,898 copying src/unitxt/catalog/cards/judge_bench/toxic_chat/toxicity.json -> build/lib/unitxt/catalog/cards/judge_bench/toxic_chat 2026-01-06T13:30:20,900 copying src/unitxt/catalog/cards/judge_bench/toxic_chat/jailbreaking.json -> build/lib/unitxt/catalog/cards/judge_bench/toxic_chat 2026-01-06T13:30:20,902 creating build/lib/unitxt/catalog/cards/judge_bench/dices 2026-01-06T13:30:20,903 copying src/unitxt/catalog/cards/judge_bench/dices/safety.json -> build/lib/unitxt/catalog/cards/judge_bench/dices 2026-01-06T13:30:20,906 creating build/lib/unitxt/catalog/cards/ragbench 2026-01-06T13:30:20,907 copying src/unitxt/catalog/cards/ragbench/cuad.json -> build/lib/unitxt/catalog/cards/ragbench 2026-01-06T13:30:20,909 copying src/unitxt/catalog/cards/ragbench/tatqa.json -> build/lib/unitxt/catalog/cards/ragbench 2026-01-06T13:30:20,911 copying src/unitxt/catalog/cards/ragbench/msmarco.json -> build/lib/unitxt/catalog/cards/ragbench 2026-01-06T13:30:20,914 copying src/unitxt/catalog/cards/ragbench/delucionqa.json -> build/lib/unitxt/catalog/cards/ragbench 2026-01-06T13:30:20,916 copying src/unitxt/catalog/cards/ragbench/covidqa.json -> build/lib/unitxt/catalog/cards/ragbench 2026-01-06T13:30:20,918 copying src/unitxt/catalog/cards/ragbench/techqa.json -> build/lib/unitxt/catalog/cards/ragbench 2026-01-06T13:30:20,921 copying src/unitxt/catalog/cards/ragbench/expertqa.json -> build/lib/unitxt/catalog/cards/ragbench 2026-01-06T13:30:20,923 copying src/unitxt/catalog/cards/ragbench/finqa.json -> build/lib/unitxt/catalog/cards/ragbench 2026-01-06T13:30:20,925 copying src/unitxt/catalog/cards/ragbench/emanual.json -> build/lib/unitxt/catalog/cards/ragbench 2026-01-06T13:30:20,927 copying src/unitxt/catalog/cards/ragbench/pubmedqa.json -> build/lib/unitxt/catalog/cards/ragbench 2026-01-06T13:30:20,930 copying src/unitxt/catalog/cards/ragbench/hotpotqa.json -> build/lib/unitxt/catalog/cards/ragbench 2026-01-06T13:30:20,932 copying src/unitxt/catalog/cards/ragbench/hagrid.json -> build/lib/unitxt/catalog/cards/ragbench 2026-01-06T13:30:20,934 creating build/lib/unitxt/catalog/cards/gpqa 2026-01-06T13:30:20,935 copying src/unitxt/catalog/cards/gpqa/main.json -> build/lib/unitxt/catalog/cards/gpqa 2026-01-06T13:30:20,938 copying src/unitxt/catalog/cards/gpqa/extended.json -> build/lib/unitxt/catalog/cards/gpqa 2026-01-06T13:30:20,940 copying src/unitxt/catalog/cards/gpqa/diamond.json -> build/lib/unitxt/catalog/cards/gpqa 2026-01-06T13:30:20,942 creating build/lib/unitxt/catalog/cards/arena_hard/response_assessment/pairwise_comparative_rating 2026-01-06T13:30:20,944 copying src/unitxt/catalog/cards/arena_hard/response_assessment/pairwise_comparative_rating/first_game_only_gpt_4_judge.json -> build/lib/unitxt/catalog/cards/arena_hard/response_assessment/pairwise_comparative_rating 2026-01-06T13:30:20,946 copying src/unitxt/catalog/cards/arena_hard/response_assessment/pairwise_comparative_rating/both_games_mean_judgment_gpt4_judge.json -> build/lib/unitxt/catalog/cards/arena_hard/response_assessment/pairwise_comparative_rating 2026-01-06T13:30:20,948 copying src/unitxt/catalog/cards/arena_hard/response_assessment/pairwise_comparative_rating/both_games_gpt_4_judge.json -> build/lib/unitxt/catalog/cards/arena_hard/response_assessment/pairwise_comparative_rating 2026-01-06T13:30:20,951 creating build/lib/unitxt/catalog/cards/arena_hard/generation 2026-01-06T13:30:20,952 copying src/unitxt/catalog/cards/arena_hard/generation/english_gpt_4_0314_reference.json -> build/lib/unitxt/catalog/cards/arena_hard/generation 2026-01-06T13:30:20,954 creating build/lib/unitxt/catalog/cards/boolq_indic/hi 2026-01-06T13:30:20,955 copying src/unitxt/catalog/cards/boolq_indic/hi/classification.json -> build/lib/unitxt/catalog/cards/boolq_indic/hi 2026-01-06T13:30:20,958 copying src/unitxt/catalog/cards/boolq_indic/hi/multiple_choice.json -> build/lib/unitxt/catalog/cards/boolq_indic/hi 2026-01-06T13:30:20,960 creating build/lib/unitxt/catalog/cards/boolq_indic/or 2026-01-06T13:30:20,961 copying src/unitxt/catalog/cards/boolq_indic/or/classification.json -> build/lib/unitxt/catalog/cards/boolq_indic/or 2026-01-06T13:30:20,963 copying src/unitxt/catalog/cards/boolq_indic/or/multiple_choice.json -> build/lib/unitxt/catalog/cards/boolq_indic/or 2026-01-06T13:30:20,965 creating build/lib/unitxt/catalog/cards/boolq_indic/bn 2026-01-06T13:30:20,967 copying src/unitxt/catalog/cards/boolq_indic/bn/classification.json -> build/lib/unitxt/catalog/cards/boolq_indic/bn 2026-01-06T13:30:20,969 copying src/unitxt/catalog/cards/boolq_indic/bn/multiple_choice.json -> build/lib/unitxt/catalog/cards/boolq_indic/bn 2026-01-06T13:30:20,971 creating build/lib/unitxt/catalog/cards/boolq_indic/ta 2026-01-06T13:30:20,972 copying src/unitxt/catalog/cards/boolq_indic/ta/classification.json -> build/lib/unitxt/catalog/cards/boolq_indic/ta 2026-01-06T13:30:20,975 copying src/unitxt/catalog/cards/boolq_indic/ta/multiple_choice.json -> build/lib/unitxt/catalog/cards/boolq_indic/ta 2026-01-06T13:30:20,977 creating build/lib/unitxt/catalog/cards/boolq_indic/mr 2026-01-06T13:30:20,978 copying src/unitxt/catalog/cards/boolq_indic/mr/classification.json -> build/lib/unitxt/catalog/cards/boolq_indic/mr 2026-01-06T13:30:20,981 copying src/unitxt/catalog/cards/boolq_indic/mr/multiple_choice.json -> build/lib/unitxt/catalog/cards/boolq_indic/mr 2026-01-06T13:30:20,982 creating build/lib/unitxt/catalog/cards/boolq_indic/ml 2026-01-06T13:30:20,984 copying src/unitxt/catalog/cards/boolq_indic/ml/classification.json -> build/lib/unitxt/catalog/cards/boolq_indic/ml 2026-01-06T13:30:20,986 copying src/unitxt/catalog/cards/boolq_indic/ml/multiple_choice.json -> build/lib/unitxt/catalog/cards/boolq_indic/ml 2026-01-06T13:30:20,988 creating build/lib/unitxt/catalog/cards/boolq_indic/pa 2026-01-06T13:30:20,989 copying src/unitxt/catalog/cards/boolq_indic/pa/classification.json -> build/lib/unitxt/catalog/cards/boolq_indic/pa 2026-01-06T13:30:20,992 copying src/unitxt/catalog/cards/boolq_indic/pa/multiple_choice.json -> build/lib/unitxt/catalog/cards/boolq_indic/pa 2026-01-06T13:30:20,994 creating build/lib/unitxt/catalog/cards/boolq_indic/kn 2026-01-06T13:30:20,995 copying src/unitxt/catalog/cards/boolq_indic/kn/classification.json -> build/lib/unitxt/catalog/cards/boolq_indic/kn 2026-01-06T13:30:20,997 copying src/unitxt/catalog/cards/boolq_indic/kn/multiple_choice.json -> build/lib/unitxt/catalog/cards/boolq_indic/kn 2026-01-06T13:30:20,999 creating build/lib/unitxt/catalog/cards/boolq_indic/gu 2026-01-06T13:30:21,000 copying src/unitxt/catalog/cards/boolq_indic/gu/classification.json -> build/lib/unitxt/catalog/cards/boolq_indic/gu 2026-01-06T13:30:21,003 copying src/unitxt/catalog/cards/boolq_indic/gu/multiple_choice.json -> build/lib/unitxt/catalog/cards/boolq_indic/gu 2026-01-06T13:30:21,005 creating build/lib/unitxt/catalog/cards/boolq_indic/te 2026-01-06T13:30:21,006 copying src/unitxt/catalog/cards/boolq_indic/te/classification.json -> build/lib/unitxt/catalog/cards/boolq_indic/te 2026-01-06T13:30:21,008 copying src/unitxt/catalog/cards/boolq_indic/te/multiple_choice.json -> build/lib/unitxt/catalog/cards/boolq_indic/te 2026-01-06T13:30:21,010 creating build/lib/unitxt/catalog/serializers/text2sql 2026-01-06T13:30:21,011 copying src/unitxt/catalog/serializers/text2sql/schema.json -> build/lib/unitxt/catalog/serializers/text2sql 2026-01-06T13:30:21,013 creating build/lib/unitxt/catalog/serializers/table 2026-01-06T13:30:21,014 copying src/unitxt/catalog/serializers/table/markdown.json -> build/lib/unitxt/catalog/serializers/table 2026-01-06T13:30:21,017 copying src/unitxt/catalog/serializers/table/concat.json -> build/lib/unitxt/catalog/serializers/table 2026-01-06T13:30:21,019 copying src/unitxt/catalog/serializers/table/indexed_row_major.json -> build/lib/unitxt/catalog/serializers/table 2026-01-06T13:30:21,021 copying src/unitxt/catalog/serializers/table/df.json -> build/lib/unitxt/catalog/serializers/table 2026-01-06T13:30:21,023 copying src/unitxt/catalog/serializers/table/json.json -> build/lib/unitxt/catalog/serializers/table 2026-01-06T13:30:21,025 copying src/unitxt/catalog/serializers/table/image.json -> build/lib/unitxt/catalog/serializers/table 2026-01-06T13:30:21,027 copying src/unitxt/catalog/serializers/table/html.json -> build/lib/unitxt/catalog/serializers/table 2026-01-06T13:30:21,029 creating build/lib/unitxt/catalog/operators 2026-01-06T13:30:21,030 copying src/unitxt/catalog/operators/extract_mt_bench_label_judgment.json -> build/lib/unitxt/catalog/operators 2026-01-06T13:30:21,033 copying src/unitxt/catalog/operators/regex_parser.json -> build/lib/unitxt/catalog/operators 2026-01-06T13:30:21,035 copying src/unitxt/catalog/operators/upper_case.json -> build/lib/unitxt/catalog/operators 2026-01-06T13:30:21,037 copying src/unitxt/catalog/operators/hate_speech_or_not_hate_speech.json -> build/lib/unitxt/catalog/operators 2026-01-06T13:30:21,039 copying src/unitxt/catalog/operators/extract_harm_rating_judgment.json -> build/lib/unitxt/catalog/operators 2026-01-06T13:30:21,041 copying src/unitxt/catalog/operators/extract_from_double_brackets.json -> build/lib/unitxt/catalog/operators 2026-01-06T13:30:21,043 copying src/unitxt/catalog/operators/take_first_non_empty_line.json -> build/lib/unitxt/catalog/operators 2026-01-06T13:30:21,045 copying src/unitxt/catalog/operators/remove_articles.json -> build/lib/unitxt/catalog/operators 2026-01-06T13:30:21,048 copying src/unitxt/catalog/operators/extract_arena_hard_numerical_judgment.json -> build/lib/unitxt/catalog/operators 2026-01-06T13:30:21,050 copying src/unitxt/catalog/operators/lower_case.json -> build/lib/unitxt/catalog/operators 2026-01-06T13:30:21,052 copying src/unitxt/catalog/operators/toxic_or_not_toxic.json -> build/lib/unitxt/catalog/operators 2026-01-06T13:30:21,054 copying src/unitxt/catalog/operators/arena_hard_hf_space_processing_steps.json -> build/lib/unitxt/catalog/operators 2026-01-06T13:30:21,057 copying src/unitxt/catalog/operators/cast_to_float_return_nan_if_failed.json -> build/lib/unitxt/catalog/operators 2026-01-06T13:30:21,059 copying src/unitxt/catalog/operators/take_first_word.json -> build/lib/unitxt/catalog/operators 2026-01-06T13:30:21,061 copying src/unitxt/catalog/operators/remove_punctuations.json -> build/lib/unitxt/catalog/operators 2026-01-06T13:30:21,063 copying src/unitxt/catalog/operators/convert_to_boolean.json -> build/lib/unitxt/catalog/operators 2026-01-06T13:30:21,065 copying src/unitxt/catalog/operators/lower_case_till_punc.json -> build/lib/unitxt/catalog/operators 2026-01-06T13:30:21,067 copying src/unitxt/catalog/operators/yes_no_to_int.json -> build/lib/unitxt/catalog/operators 2026-01-06T13:30:21,069 copying src/unitxt/catalog/operators/extract_mt_bench_rating_judgment.json -> build/lib/unitxt/catalog/operators 2026-01-06T13:30:21,071 copying src/unitxt/catalog/operators/literal_eval.json -> build/lib/unitxt/catalog/operators 2026-01-06T13:30:21,073 copying src/unitxt/catalog/operators/extract_verbal_judgement.json -> build/lib/unitxt/catalog/operators 2026-01-06T13:30:21,075 copying src/unitxt/catalog/operators/predictions_yes_1_else_0.json -> build/lib/unitxt/catalog/operators 2026-01-06T13:30:21,077 copying src/unitxt/catalog/operators/fix_whitespace.json -> build/lib/unitxt/catalog/operators 2026-01-06T13:30:21,079 copying src/unitxt/catalog/operators/take_last_non_empty_line.json -> build/lib/unitxt/catalog/operators 2026-01-06T13:30:21,081 copying src/unitxt/catalog/operators/extract_verbal_judgement_bad_good.json -> build/lib/unitxt/catalog/operators 2026-01-06T13:30:21,083 copying src/unitxt/catalog/operators/substring.json -> build/lib/unitxt/catalog/operators 2026-01-06T13:30:21,085 copying src/unitxt/catalog/operators/match_closest_option.json -> build/lib/unitxt/catalog/operators 2026-01-06T13:30:21,088 copying src/unitxt/catalog/operators/cast_to_float_return_0_5_if_failed.json -> build/lib/unitxt/catalog/operators 2026-01-06T13:30:21,090 copying src/unitxt/catalog/operators/cast_to_float_return_zero_if_failed.json -> build/lib/unitxt/catalog/operators 2026-01-06T13:30:21,092 copying src/unitxt/catalog/operators/capitalize.json -> build/lib/unitxt/catalog/operators 2026-01-06T13:30:21,094 copying src/unitxt/catalog/operators/get_string_after_colon.json -> build/lib/unitxt/catalog/operators 2026-01-06T13:30:21,096 copying src/unitxt/catalog/operators/fix_json_schema.json -> build/lib/unitxt/catalog/operators 2026-01-06T13:30:21,098 copying src/unitxt/catalog/operators/remove_none_from_list.json -> build/lib/unitxt/catalog/operators 2026-01-06T13:30:21,101 copying src/unitxt/catalog/operators/to_yes_or_none.json -> build/lib/unitxt/catalog/operators 2026-01-06T13:30:21,103 copying src/unitxt/catalog/operators/str_to_float_format.json -> build/lib/unitxt/catalog/operators 2026-01-06T13:30:21,105 copying src/unitxt/catalog/operators/scale_0_10_to_0_1.json -> build/lib/unitxt/catalog/operators 2026-01-06T13:30:21,107 copying src/unitxt/catalog/operators/stance_to_pro_con.json -> build/lib/unitxt/catalog/operators 2026-01-06T13:30:21,109 copying src/unitxt/catalog/operators/first_character.json -> build/lib/unitxt/catalog/operators 2026-01-06T13:30:21,111 creating build/lib/unitxt/catalog/operators/balancers/qa 2026-01-06T13:30:21,113 copying src/unitxt/catalog/operators/balancers/qa/by_answer.json -> build/lib/unitxt/catalog/operators/balancers/qa 2026-01-06T13:30:21,115 creating build/lib/unitxt/catalog/operators/balancers/ner 2026-01-06T13:30:21,116 copying src/unitxt/catalog/operators/balancers/ner/zero_vs_many_entities.json -> build/lib/unitxt/catalog/operators/balancers/ner 2026-01-06T13:30:21,119 creating build/lib/unitxt/catalog/operators/balancers/multi_label 2026-01-06T13:30:21,120 copying src/unitxt/catalog/operators/balancers/multi_label/zero_vs_many_labels.json -> build/lib/unitxt/catalog/operators/balancers/multi_label 2026-01-06T13:30:21,122 creating build/lib/unitxt/catalog/operators/balancers/classification 2026-01-06T13:30:21,123 copying src/unitxt/catalog/operators/balancers/classification/minimum_one_example_per_class.json -> build/lib/unitxt/catalog/operators/balancers/classification 2026-01-06T13:30:21,125 copying src/unitxt/catalog/operators/balancers/classification/by_label.json -> build/lib/unitxt/catalog/operators/balancers/classification 2026-01-06T13:30:21,127 creating build/lib/unitxt/catalog/operators/mt_bench 2026-01-06T13:30:21,128 copying src/unitxt/catalog/operators/mt_bench/pairwise_hf_space_processing_steps.json -> build/lib/unitxt/catalog/operators/mt_bench 2026-01-06T13:30:21,131 copying src/unitxt/catalog/operators/mt_bench/rating_hf_space_processing_steps.json -> build/lib/unitxt/catalog/operators/mt_bench 2026-01-06T13:30:21,133 creating build/lib/unitxt/catalog/splitters 2026-01-06T13:30:21,134 copying src/unitxt/catalog/splitters/large_no_dev.json -> build/lib/unitxt/catalog/splitters 2026-01-06T13:30:21,136 copying src/unitxt/catalog/splitters/diverse_labels_sampler.json -> build/lib/unitxt/catalog/splitters 2026-01-06T13:30:21,139 copying src/unitxt/catalog/splitters/small_no_test.json -> build/lib/unitxt/catalog/splitters 2026-01-06T13:30:21,141 copying src/unitxt/catalog/splitters/small_no_dev.json -> build/lib/unitxt/catalog/splitters 2026-01-06T13:30:21,143 copying src/unitxt/catalog/splitters/test_only.json -> build/lib/unitxt/catalog/splitters 2026-01-06T13:30:21,145 copying src/unitxt/catalog/splitters/large_no_test.json -> build/lib/unitxt/catalog/splitters 2026-01-06T13:30:21,147 creating build/lib/unitxt/catalog/processors 2026-01-06T13:30:21,148 copying src/unitxt/catalog/processors/to_list_by_comma_from_references.json -> build/lib/unitxt/catalog/processors 2026-01-06T13:30:21,151 copying src/unitxt/catalog/processors/extract_mt_bench_label_judgment.json -> build/lib/unitxt/catalog/processors 2026-01-06T13:30:21,153 copying src/unitxt/catalog/processors/upper_case.json -> build/lib/unitxt/catalog/processors 2026-01-06T13:30:21,155 copying src/unitxt/catalog/processors/hate_speech_or_not_hate_speech.json -> build/lib/unitxt/catalog/processors 2026-01-06T13:30:21,157 copying src/unitxt/catalog/processors/extract_harm_rating_judgment.json -> build/lib/unitxt/catalog/processors 2026-01-06T13:30:21,159 copying src/unitxt/catalog/processors/regex_parser_from_prediction.json -> build/lib/unitxt/catalog/processors 2026-01-06T13:30:21,162 copying src/unitxt/catalog/processors/extract_from_double_brackets.json -> build/lib/unitxt/catalog/processors 2026-01-06T13:30:21,164 copying src/unitxt/catalog/processors/take_first_non_empty_line.json -> build/lib/unitxt/catalog/processors 2026-01-06T13:30:21,166 copying src/unitxt/catalog/processors/to_list_by_comma.json -> build/lib/unitxt/catalog/processors 2026-01-06T13:30:21,168 copying src/unitxt/catalog/processors/load_json_from_predictions.json -> build/lib/unitxt/catalog/processors 2026-01-06T13:30:21,171 copying src/unitxt/catalog/processors/remove_articles.json -> build/lib/unitxt/catalog/processors 2026-01-06T13:30:21,173 copying src/unitxt/catalog/processors/to_list_by_hyphen_space_from_references.json -> build/lib/unitxt/catalog/processors 2026-01-06T13:30:21,175 copying src/unitxt/catalog/processors/to_string_stripped.json -> build/lib/unitxt/catalog/processors 2026-01-06T13:30:21,177 copying src/unitxt/catalog/processors/to_list_by_comma_space.json -> build/lib/unitxt/catalog/processors 2026-01-06T13:30:21,179 copying src/unitxt/catalog/processors/extract_arena_hard_numerical_judgment.json -> build/lib/unitxt/catalog/processors 2026-01-06T13:30:21,182 copying src/unitxt/catalog/processors/to_list_by_hyphen_space.json -> build/lib/unitxt/catalog/processors 2026-01-06T13:30:21,184 copying src/unitxt/catalog/processors/lower_case.json -> build/lib/unitxt/catalog/processors 2026-01-06T13:30:21,186 copying src/unitxt/catalog/processors/toxic_or_not_toxic.json -> build/lib/unitxt/catalog/processors 2026-01-06T13:30:21,188 copying src/unitxt/catalog/processors/list_to_empty_entity_tuples.json -> build/lib/unitxt/catalog/processors 2026-01-06T13:30:21,190 copying src/unitxt/catalog/processors/cast_to_float_return_nan_if_failed.json -> build/lib/unitxt/catalog/processors 2026-01-06T13:30:21,193 copying src/unitxt/catalog/processors/take_first_word.json -> build/lib/unitxt/catalog/processors 2026-01-06T13:30:21,195 copying src/unitxt/catalog/processors/infer_last_token_logprobs_to_yes_no_probs.json -> build/lib/unitxt/catalog/processors 2026-01-06T13:30:21,197 copying src/unitxt/catalog/processors/to_span_label_pairs.json -> build/lib/unitxt/catalog/processors 2026-01-06T13:30:21,200 copying src/unitxt/catalog/processors/remove_punctuations.json -> build/lib/unitxt/catalog/processors 2026-01-06T13:30:21,202 copying src/unitxt/catalog/processors/to_string.json -> build/lib/unitxt/catalog/processors 2026-01-06T13:30:21,204 copying src/unitxt/catalog/processors/multi_tool_call.json -> build/lib/unitxt/catalog/processors 2026-01-06T13:30:21,206 copying src/unitxt/catalog/processors/convert_to_boolean.json -> build/lib/unitxt/catalog/processors 2026-01-06T13:30:21,208 copying src/unitxt/catalog/processors/lower_case_till_punc.json -> build/lib/unitxt/catalog/processors 2026-01-06T13:30:21,211 copying src/unitxt/catalog/processors/yes_no_to_int.json -> build/lib/unitxt/catalog/processors 2026-01-06T13:30:21,213 copying src/unitxt/catalog/processors/to_span_label_pairs_surface_only.json -> build/lib/unitxt/catalog/processors 2026-01-06T13:30:21,215 copying src/unitxt/catalog/processors/extract_mt_bench_rating_judgment.json -> build/lib/unitxt/catalog/processors 2026-01-06T13:30:21,217 copying src/unitxt/catalog/processors/literal_eval.json -> build/lib/unitxt/catalog/processors 2026-01-06T13:30:21,219 copying src/unitxt/catalog/processors/extract_verbal_judgement.json -> build/lib/unitxt/catalog/processors 2026-01-06T13:30:21,221 copying src/unitxt/catalog/processors/predictions_yes_1_else_0.json -> build/lib/unitxt/catalog/processors 2026-01-06T13:30:21,224 copying src/unitxt/catalog/processors/fix_whitespace.json -> build/lib/unitxt/catalog/processors 2026-01-06T13:30:21,226 copying src/unitxt/catalog/processors/load_json_predictions.json -> build/lib/unitxt/catalog/processors 2026-01-06T13:30:21,228 copying src/unitxt/catalog/processors/take_last_non_empty_line.json -> build/lib/unitxt/catalog/processors 2026-01-06T13:30:21,230 copying src/unitxt/catalog/processors/extract_verbal_judgement_bad_good.json -> build/lib/unitxt/catalog/processors 2026-01-06T13:30:21,232 copying src/unitxt/catalog/processors/substring.json -> build/lib/unitxt/catalog/processors 2026-01-06T13:30:21,234 copying src/unitxt/catalog/processors/match_closest_option.json -> build/lib/unitxt/catalog/processors 2026-01-06T13:30:21,237 copying src/unitxt/catalog/processors/cast_to_float_return_0_5_if_failed.json -> build/lib/unitxt/catalog/processors 2026-01-06T13:30:21,239 copying src/unitxt/catalog/processors/load_json.json -> build/lib/unitxt/catalog/processors 2026-01-06T13:30:21,241 copying src/unitxt/catalog/processors/cast_to_float_return_zero_if_failed.json -> build/lib/unitxt/catalog/processors 2026-01-06T13:30:21,243 copying src/unitxt/catalog/processors/capitalize.json -> build/lib/unitxt/catalog/processors 2026-01-06T13:30:21,246 copying src/unitxt/catalog/processors/get_string_after_colon.json -> build/lib/unitxt/catalog/processors 2026-01-06T13:30:21,248 copying src/unitxt/catalog/processors/remove_none_from_list.json -> build/lib/unitxt/catalog/processors 2026-01-06T13:30:21,250 copying src/unitxt/catalog/processors/load_json_or_empty_tool_call.json -> build/lib/unitxt/catalog/processors 2026-01-06T13:30:21,252 copying src/unitxt/catalog/processors/safe_unsafe.json -> build/lib/unitxt/catalog/processors 2026-01-06T13:30:21,255 copying src/unitxt/catalog/processors/to_yes_or_none.json -> build/lib/unitxt/catalog/processors 2026-01-06T13:30:21,257 copying src/unitxt/catalog/processors/str_to_float_format.json -> build/lib/unitxt/catalog/processors 2026-01-06T13:30:21,259 copying src/unitxt/catalog/processors/scale_0_10_to_0_1.json -> build/lib/unitxt/catalog/processors 2026-01-06T13:30:21,261 copying src/unitxt/catalog/processors/infer_logprobs_to_yes_no_probs.json -> build/lib/unitxt/catalog/processors 2026-01-06T13:30:21,263 copying src/unitxt/catalog/processors/stance_to_pro_con.json -> build/lib/unitxt/catalog/processors 2026-01-06T13:30:21,266 copying src/unitxt/catalog/processors/first_character.json -> build/lib/unitxt/catalog/processors 2026-01-06T13:30:21,268 copying src/unitxt/catalog/processors/dict_of_lists_to_value_key_pairs.json -> build/lib/unitxt/catalog/processors 2026-01-06T13:30:21,270 creating build/lib/unitxt/catalog/processors/text2sql 2026-01-06T13:30:21,271 copying src/unitxt/catalog/processors/text2sql/get_sql.json -> build/lib/unitxt/catalog/processors/text2sql 2026-01-06T13:30:21,273 creating build/lib/unitxt/catalog/benchmarks 2026-01-06T13:30:21,274 copying src/unitxt/catalog/benchmarks/vision_full.json -> build/lib/unitxt/catalog/benchmarks 2026-01-06T13:30:21,276 copying src/unitxt/catalog/benchmarks/tool_calling.json -> build/lib/unitxt/catalog/benchmarks 2026-01-06T13:30:21,279 copying src/unitxt/catalog/benchmarks/glue.json -> build/lib/unitxt/catalog/benchmarks 2026-01-06T13:30:21,281 copying src/unitxt/catalog/benchmarks/llama_vision.json -> build/lib/unitxt/catalog/benchmarks 2026-01-06T13:30:21,283 copying src/unitxt/catalog/benchmarks/vision_default.json -> build/lib/unitxt/catalog/benchmarks 2026-01-06T13:30:21,285 copying src/unitxt/catalog/benchmarks/torr.json -> build/lib/unitxt/catalog/benchmarks 2026-01-06T13:30:21,289 copying src/unitxt/catalog/benchmarks/bluebench.json -> build/lib/unitxt/catalog/benchmarks 2026-01-06T13:30:21,291 creating build/lib/unitxt/catalog/formats 2026-01-06T13:30:21,292 copying src/unitxt/catalog/formats/human_assistant.json -> build/lib/unitxt/catalog/formats 2026-01-06T13:30:21,294 copying src/unitxt/catalog/formats/empty.json -> build/lib/unitxt/catalog/formats 2026-01-06T13:30:21,297 copying src/unitxt/catalog/formats/llamaguard2.json -> build/lib/unitxt/catalog/formats 2026-01-06T13:30:21,299 copying src/unitxt/catalog/formats/chat_api.json -> build/lib/unitxt/catalog/formats 2026-01-06T13:30:21,301 copying src/unitxt/catalog/formats/llama3_instruct.json -> build/lib/unitxt/catalog/formats 2026-01-06T13:30:21,303 copying src/unitxt/catalog/formats/llama3_instruct_all_demos_in_one_turn.json -> build/lib/unitxt/catalog/formats 2026-01-06T13:30:21,307 copying src/unitxt/catalog/formats/chat_api_with_tokenizer_chat_template.json -> build/lib/unitxt/catalog/formats 2026-01-06T13:30:21,309 copying src/unitxt/catalog/formats/llama2.json -> build/lib/unitxt/catalog/formats 2026-01-06T13:30:21,311 copying src/unitxt/catalog/formats/deepseek_coder.json -> build/lib/unitxt/catalog/formats 2026-01-06T13:30:21,313 copying src/unitxt/catalog/formats/textual_assistant.json -> build/lib/unitxt/catalog/formats 2026-01-06T13:30:21,315 copying src/unitxt/catalog/formats/user_agent.json -> build/lib/unitxt/catalog/formats 2026-01-06T13:30:21,318 copying src/unitxt/catalog/formats/user_assistant.json -> build/lib/unitxt/catalog/formats 2026-01-06T13:30:21,320 copying src/unitxt/catalog/formats/llama.json -> build/lib/unitxt/catalog/formats 2026-01-06T13:30:21,322 copying src/unitxt/catalog/formats/empty_input_output_separator.json -> build/lib/unitxt/catalog/formats 2026-01-06T13:30:21,324 creating build/lib/unitxt/catalog/formats/models 2026-01-06T13:30:21,325 copying src/unitxt/catalog/formats/models/alpaca_instruct.json -> build/lib/unitxt/catalog/formats/models 2026-01-06T13:30:21,327 copying src/unitxt/catalog/formats/models/granite_3_1_documents.json -> build/lib/unitxt/catalog/formats/models 2026-01-06T13:30:21,329 copying src/unitxt/catalog/formats/models/phi_3.json -> build/lib/unitxt/catalog/formats/models 2026-01-06T13:30:21,332 copying src/unitxt/catalog/formats/models/llava.json -> build/lib/unitxt/catalog/formats/models 2026-01-06T13:30:21,334 copying src/unitxt/catalog/formats/models/starling.json -> build/lib/unitxt/catalog/formats/models 2026-01-06T13:30:21,336 copying src/unitxt/catalog/formats/models/llava_interleave.json -> build/lib/unitxt/catalog/formats/models 2026-01-06T13:30:21,338 creating build/lib/unitxt/catalog/formats/models/labradorite 2026-01-06T13:30:21,340 copying src/unitxt/catalog/formats/models/labradorite/zero_shot.json -> build/lib/unitxt/catalog/formats/models/labradorite 2026-01-06T13:30:21,342 copying src/unitxt/catalog/formats/models/labradorite/few_shot.json -> build/lib/unitxt/catalog/formats/models/labradorite 2026-01-06T13:30:21,344 creating build/lib/unitxt/catalog/formats/models/flan 2026-01-06T13:30:21,345 copying src/unitxt/catalog/formats/models/flan/exq_exa.json -> build/lib/unitxt/catalog/formats/models/flan 2026-01-06T13:30:21,347 copying src/unitxt/catalog/formats/models/flan/few_shot.json -> build/lib/unitxt/catalog/formats/models/flan 2026-01-06T13:30:21,349 creating build/lib/unitxt/catalog/formats/models/mistral 2026-01-06T13:30:21,350 copying src/unitxt/catalog/formats/models/mistral/instruction.json -> build/lib/unitxt/catalog/formats/models/mistral 2026-01-06T13:30:21,352 creating build/lib/unitxt/catalog/formats/models/mistral/instruction 2026-01-06T13:30:21,353 copying src/unitxt/catalog/formats/models/mistral/instruction/with_system_prompt.json -> build/lib/unitxt/catalog/formats/models/mistral/instruction 2026-01-06T13:30:21,356 copying src/unitxt/ui/banner.png -> build/lib/unitxt/ui 2026-01-06T13:30:21,361 copying src/unitxt/assistant/embeddings.npz -> build/lib/unitxt/assistant 2026-01-06T13:30:21,740 copying src/unitxt/assistant/metadata.parquet -> build/lib/unitxt/assistant 2026-01-06T13:30:21,769 copying src/unitxt/assistant/embeddings.npz -> build/lib/unitxt/assistant 2026-01-06T13:30:22,152 copying src/unitxt/assistant/metadata.parquet -> build/lib/unitxt/assistant 2026-01-06T13:30:25,087 installing to build/bdist.linux-armv7l/wheel 2026-01-06T13:30:25,087 running install 2026-01-06T13:30:25,110 running install_lib 2026-01-06T13:30:25,117 creating build/bdist.linux-armv7l/wheel 2026-01-06T13:30:25,119 creating build/bdist.linux-armv7l/wheel/unitxt 2026-01-06T13:30:25,121 copying build/lib/unitxt/llm_as_judge_utils.py -> build/bdist.linux-armv7l/wheel/./unitxt 2026-01-06T13:30:25,123 copying build/lib/unitxt/version.py -> build/bdist.linux-armv7l/wheel/./unitxt 2026-01-06T13:30:25,124 copying build/lib/unitxt/metric_utils.py -> build/bdist.linux-armv7l/wheel/./unitxt 2026-01-06T13:30:25,127 copying build/lib/unitxt/deprecation_utils.py -> build/bdist.linux-armv7l/wheel/./unitxt 2026-01-06T13:30:25,130 copying build/lib/unitxt/struct_data_operators.py -> build/bdist.linux-armv7l/wheel/./unitxt 2026-01-06T13:30:25,132 copying build/lib/unitxt/eval_utils.py -> build/bdist.linux-armv7l/wheel/./unitxt 2026-01-06T13:30:25,134 copying build/lib/unitxt/text2sql_utils.py -> build/bdist.linux-armv7l/wheel/./unitxt 2026-01-06T13:30:25,137 copying build/lib/unitxt/stream.py -> build/bdist.linux-armv7l/wheel/./unitxt 2026-01-06T13:30:25,139 copying build/lib/unitxt/benchmark.py -> build/bdist.linux-armv7l/wheel/./unitxt 2026-01-06T13:30:25,141 copying build/lib/unitxt/templates.py -> build/bdist.linux-armv7l/wheel/./unitxt 2026-01-06T13:30:25,144 copying build/lib/unitxt/evaluate_cli.py -> build/bdist.linux-armv7l/wheel/./unitxt 2026-01-06T13:30:25,147 copying build/lib/unitxt/llm_as_judge_operators.py -> build/bdist.linux-armv7l/wheel/./unitxt 2026-01-06T13:30:25,149 copying build/lib/unitxt/dataset_utils.py -> build/bdist.linux-armv7l/wheel/./unitxt 2026-01-06T13:30:25,151 copying build/lib/unitxt/augmentors.py -> build/bdist.linux-armv7l/wheel/./unitxt 2026-01-06T13:30:25,153 copying build/lib/unitxt/__init__.py -> build/bdist.linux-armv7l/wheel/./unitxt 2026-01-06T13:30:25,154 copying build/lib/unitxt/llm_as_judge_from_template.py -> build/bdist.linux-armv7l/wheel/./unitxt 2026-01-06T13:30:25,157 copying build/lib/unitxt/recipe.py -> build/bdist.linux-armv7l/wheel/./unitxt 2026-01-06T13:30:25,159 creating build/bdist.linux-armv7l/wheel/unitxt/ui 2026-01-06T13:30:25,160 copying build/lib/unitxt/ui/ui_utils.py -> build/bdist.linux-armv7l/wheel/./unitxt/ui 2026-01-06T13:30:25,163 copying build/lib/unitxt/ui/__init__.py -> build/bdist.linux-armv7l/wheel/./unitxt/ui 2026-01-06T13:30:25,165 copying build/lib/unitxt/ui/run.py -> build/bdist.linux-armv7l/wheel/./unitxt/ui 2026-01-06T13:30:25,167 copying build/lib/unitxt/ui/gradio_utils.py -> build/bdist.linux-armv7l/wheel/./unitxt/ui 2026-01-06T13:30:25,169 copying build/lib/unitxt/ui/ui_tester.py -> build/bdist.linux-armv7l/wheel/./unitxt/ui 2026-01-06T13:30:25,171 copying build/lib/unitxt/ui/settings.py -> build/bdist.linux-armv7l/wheel/./unitxt/ui 2026-01-06T13:30:25,172 copying build/lib/unitxt/ui/banner.png -> build/bdist.linux-armv7l/wheel/./unitxt/ui 2026-01-06T13:30:25,177 copying build/lib/unitxt/ui/load_catalog_data.py -> build/bdist.linux-armv7l/wheel/./unitxt/ui 2026-01-06T13:30:25,179 copying build/lib/unitxt/utils.py -> build/bdist.linux-armv7l/wheel/./unitxt 2026-01-06T13:30:25,181 copying build/lib/unitxt/file_utils.py -> build/bdist.linux-armv7l/wheel/./unitxt 2026-01-06T13:30:25,183 copying build/lib/unitxt/string_operators.py -> build/bdist.linux-armv7l/wheel/./unitxt 2026-01-06T13:30:25,185 copying build/lib/unitxt/standard.py -> build/bdist.linux-armv7l/wheel/./unitxt 2026-01-06T13:30:25,188 copying build/lib/unitxt/stream_operators.py -> build/bdist.linux-armv7l/wheel/./unitxt 2026-01-06T13:30:25,190 copying build/lib/unitxt/dataset.py -> build/bdist.linux-armv7l/wheel/./unitxt 2026-01-06T13:30:25,192 copying build/lib/unitxt/types.py -> build/bdist.linux-armv7l/wheel/./unitxt 2026-01-06T13:30:25,194 copying build/lib/unitxt/formats.py -> build/bdist.linux-armv7l/wheel/./unitxt 2026-01-06T13:30:25,197 copying build/lib/unitxt/operators.py -> build/bdist.linux-armv7l/wheel/./unitxt 2026-01-06T13:30:25,201 copying build/lib/unitxt/type_utils.py -> build/bdist.linux-armv7l/wheel/./unitxt 2026-01-06T13:30:25,204 copying build/lib/unitxt/task.py -> build/bdist.linux-armv7l/wheel/./unitxt 2026-01-06T13:30:25,206 copying build/lib/unitxt/validate.py -> build/bdist.linux-armv7l/wheel/./unitxt 2026-01-06T13:30:25,208 copying build/lib/unitxt/dataclass.py -> build/bdist.linux-armv7l/wheel/./unitxt 2026-01-06T13:30:25,211 copying build/lib/unitxt/schema.py -> build/bdist.linux-armv7l/wheel/./unitxt 2026-01-06T13:30:25,213 copying build/lib/unitxt/metric.py -> build/bdist.linux-armv7l/wheel/./unitxt 2026-01-06T13:30:25,215 copying build/lib/unitxt/blocks.py -> build/bdist.linux-armv7l/wheel/./unitxt 2026-01-06T13:30:25,217 copying build/lib/unitxt/collections_operators.py -> build/bdist.linux-armv7l/wheel/./unitxt 2026-01-06T13:30:25,219 copying build/lib/unitxt/metrics.py -> build/bdist.linux-armv7l/wheel/./unitxt 2026-01-06T13:30:25,225 creating build/bdist.linux-armv7l/wheel/unitxt/test_utils 2026-01-06T13:30:25,226 copying build/lib/unitxt/test_utils/__init__.py -> build/bdist.linux-armv7l/wheel/./unitxt/test_utils 2026-01-06T13:30:25,228 copying build/lib/unitxt/test_utils/operators.py -> build/bdist.linux-armv7l/wheel/./unitxt/test_utils 2026-01-06T13:30:25,230 copying build/lib/unitxt/test_utils/metrics.py -> build/bdist.linux-armv7l/wheel/./unitxt/test_utils 2026-01-06T13:30:25,232 copying build/lib/unitxt/test_utils/storage.py -> build/bdist.linux-armv7l/wheel/./unitxt/test_utils 2026-01-06T13:30:25,234 copying build/lib/unitxt/test_utils/card.py -> build/bdist.linux-armv7l/wheel/./unitxt/test_utils 2026-01-06T13:30:25,236 copying build/lib/unitxt/test_utils/artifact.py -> build/bdist.linux-armv7l/wheel/./unitxt/test_utils 2026-01-06T13:30:25,238 copying build/lib/unitxt/test_utils/catalog.py -> build/bdist.linux-armv7l/wheel/./unitxt/test_utils 2026-01-06T13:30:25,240 copying build/lib/unitxt/system_prompts.py -> build/bdist.linux-armv7l/wheel/./unitxt 2026-01-06T13:30:25,242 copying build/lib/unitxt/operator.py -> build/bdist.linux-armv7l/wheel/./unitxt 2026-01-06T13:30:25,244 copying build/lib/unitxt/split_utils.py -> build/bdist.linux-armv7l/wheel/./unitxt 2026-01-06T13:30:25,247 copying build/lib/unitxt/parsing_utils.py -> build/bdist.linux-armv7l/wheel/./unitxt 2026-01-06T13:30:25,249 copying build/lib/unitxt/register.py -> build/bdist.linux-armv7l/wheel/./unitxt 2026-01-06T13:30:25,251 copying build/lib/unitxt/llm_as_judge_chat_templates.py -> build/bdist.linux-armv7l/wheel/./unitxt 2026-01-06T13:30:25,254 creating build/bdist.linux-armv7l/wheel/unitxt/assistant 2026-01-06T13:30:25,255 copying build/lib/unitxt/assistant/__init__.py -> build/bdist.linux-armv7l/wheel/./unitxt/assistant 2026-01-06T13:30:25,257 creating build/bdist.linux-armv7l/wheel/unitxt/assistant/assessment 2026-01-06T13:30:25,258 copying build/lib/unitxt/assistant/assessment/my_pretty_table.py -> build/bdist.linux-armv7l/wheel/./unitxt/assistant/assessment 2026-01-06T13:30:25,260 copying build/lib/unitxt/assistant/assessment/__init__.py -> build/bdist.linux-armv7l/wheel/./unitxt/assistant/assessment 2026-01-06T13:30:25,262 copying build/lib/unitxt/assistant/assessment/assistant_inference_engine.py -> build/bdist.linux-armv7l/wheel/./unitxt/assistant/assessment 2026-01-06T13:30:25,263 copying build/lib/unitxt/assistant/embeddings.npz -> build/bdist.linux-armv7l/wheel/./unitxt/assistant 2026-01-06T13:30:25,642 copying build/lib/unitxt/assistant/index.py -> build/bdist.linux-armv7l/wheel/./unitxt/assistant 2026-01-06T13:30:25,644 copying build/lib/unitxt/assistant/app.py -> build/bdist.linux-armv7l/wheel/./unitxt/assistant 2026-01-06T13:30:25,646 copying build/lib/unitxt/assistant/metadata.parquet -> build/bdist.linux-armv7l/wheel/./unitxt/assistant 2026-01-06T13:30:25,677 copying build/lib/unitxt/settings_utils.py -> build/bdist.linux-armv7l/wheel/./unitxt 2026-01-06T13:30:25,680 creating build/bdist.linux-armv7l/wheel/unitxt/service 2026-01-06T13:30:25,681 copying build/lib/unitxt/service/__init__.py -> build/bdist.linux-armv7l/wheel/./unitxt/service 2026-01-06T13:30:25,684 creating build/bdist.linux-armv7l/wheel/unitxt/service/metrics 2026-01-06T13:30:25,685 copying build/lib/unitxt/service/metrics/__init__.py -> build/bdist.linux-armv7l/wheel/./unitxt/service/metrics 2026-01-06T13:30:25,687 copying build/lib/unitxt/service/metrics/main.py -> build/bdist.linux-armv7l/wheel/./unitxt/service/metrics 2026-01-06T13:30:25,689 copying build/lib/unitxt/service/metrics/tokens.py -> build/bdist.linux-armv7l/wheel/./unitxt/service/metrics 2026-01-06T13:30:25,691 copying build/lib/unitxt/llm_as_judge.py -> build/bdist.linux-armv7l/wheel/./unitxt 2026-01-06T13:30:25,695 copying build/lib/unitxt/logging_utils.py -> build/bdist.linux-armv7l/wheel/./unitxt 2026-01-06T13:30:25,697 copying build/lib/unitxt/collections.py -> build/bdist.linux-armv7l/wheel/./unitxt 2026-01-06T13:30:25,699 copying build/lib/unitxt/fusion.py -> build/bdist.linux-armv7l/wheel/./unitxt 2026-01-06T13:30:25,702 copying build/lib/unitxt/inference.py -> build/bdist.linux-armv7l/wheel/./unitxt 2026-01-06T13:30:25,707 copying build/lib/unitxt/normalizers.py -> build/bdist.linux-armv7l/wheel/./unitxt 2026-01-06T13:30:25,709 copying build/lib/unitxt/base_metric.py -> build/bdist.linux-armv7l/wheel/./unitxt 2026-01-06T13:30:25,712 copying build/lib/unitxt/splitters.py -> build/bdist.linux-armv7l/wheel/./unitxt 2026-01-06T13:30:25,715 copying build/lib/unitxt/span_lableing_operators.py -> build/bdist.linux-armv7l/wheel/./unitxt 2026-01-06T13:30:25,717 copying build/lib/unitxt/llm_as_judge_constants.py -> build/bdist.linux-armv7l/wheel/./unitxt 2026-01-06T13:30:25,721 copying build/lib/unitxt/random_utils.py -> build/bdist.linux-armv7l/wheel/./unitxt 2026-01-06T13:30:25,723 copying build/lib/unitxt/dict_utils.py -> build/bdist.linux-armv7l/wheel/./unitxt 2026-01-06T13:30:25,726 copying build/lib/unitxt/hf_utils.py -> build/bdist.linux-armv7l/wheel/./unitxt 2026-01-06T13:30:25,728 copying build/lib/unitxt/card.py -> build/bdist.linux-armv7l/wheel/./unitxt 2026-01-06T13:30:25,731 copying build/lib/unitxt/text_utils.py -> build/bdist.linux-armv7l/wheel/./unitxt 2026-01-06T13:30:25,733 copying build/lib/unitxt/image_operators.py -> build/bdist.linux-armv7l/wheel/./unitxt 2026-01-06T13:30:25,736 copying build/lib/unitxt/loaders.py -> build/bdist.linux-armv7l/wheel/./unitxt 2026-01-06T13:30:25,740 copying build/lib/unitxt/error_utils.py -> build/bdist.linux-armv7l/wheel/./unitxt 2026-01-06T13:30:25,743 copying build/lib/unitxt/artifact.py -> build/bdist.linux-armv7l/wheel/./unitxt 2026-01-06T13:30:25,746 creating build/bdist.linux-armv7l/wheel/unitxt/catalog 2026-01-06T13:30:25,748 creating build/bdist.linux-armv7l/wheel/unitxt/catalog/augmentors 2026-01-06T13:30:25,750 creating build/bdist.linux-armv7l/wheel/unitxt/catalog/augmentors/text 2026-01-06T13:30:25,752 copying build/lib/unitxt/catalog/augmentors/text/whitespace_prefix_suffix.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/augmentors/text 2026-01-06T13:30:25,754 copying build/lib/unitxt/catalog/augmentors/text/white_space.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/augmentors/text 2026-01-06T13:30:25,756 copying build/lib/unitxt/catalog/augmentors/augment_whitespace_task_input.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/augmentors 2026-01-06T13:30:25,758 copying build/lib/unitxt/catalog/augmentors/augment_whitespace_prefix_and_suffix_task_input.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/augmentors 2026-01-06T13:30:25,760 creating build/bdist.linux-armv7l/wheel/unitxt/catalog/augmentors/image 2026-01-06T13:30:25,762 copying build/lib/unitxt/catalog/augmentors/image/grid_lines.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/augmentors/image 2026-01-06T13:30:25,764 copying build/lib/unitxt/catalog/augmentors/image/white_noise.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/augmentors/image 2026-01-06T13:30:25,766 copying build/lib/unitxt/catalog/augmentors/image/grey_scale.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/augmentors/image 2026-01-06T13:30:25,768 copying build/lib/unitxt/catalog/augmentors/image/oldify.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/augmentors/image 2026-01-06T13:30:25,772 creating build/bdist.linux-armv7l/wheel/unitxt/catalog/augmentors/table 2026-01-06T13:30:25,773 copying build/lib/unitxt/catalog/augmentors/table/transpose.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/augmentors/table 2026-01-06T13:30:25,775 copying build/lib/unitxt/catalog/augmentors/table/duplicate_rows.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/augmentors/table 2026-01-06T13:30:25,777 copying build/lib/unitxt/catalog/augmentors/table/shuffle_rows.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/augmentors/table 2026-01-06T13:30:25,780 copying build/lib/unitxt/catalog/augmentors/table/mask_cols_names.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/augmentors/table 2026-01-06T13:30:25,782 copying build/lib/unitxt/catalog/augmentors/table/truncate_rows.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/augmentors/table 2026-01-06T13:30:25,784 copying build/lib/unitxt/catalog/augmentors/table/shuffle_cols.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/augmentors/table 2026-01-06T13:30:25,786 copying build/lib/unitxt/catalog/augmentors/table/shuffle_cols_names.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/augmentors/table 2026-01-06T13:30:25,788 copying build/lib/unitxt/catalog/augmentors/table/insert_empty_rows.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/augmentors/table 2026-01-06T13:30:25,790 copying build/lib/unitxt/catalog/augmentors/table/duplicate_columns.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/augmentors/table 2026-01-06T13:30:25,792 copying build/lib/unitxt/catalog/augmentors/no_augmentation.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/augmentors 2026-01-06T13:30:25,795 creating build/bdist.linux-armv7l/wheel/unitxt/catalog/engines 2026-01-06T13:30:25,797 creating build/bdist.linux-armv7l/wheel/unitxt/catalog/engines/openai 2026-01-06T13:30:25,798 copying build/lib/unitxt/catalog/engines/openai/gpt_4o.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/engines/openai 2026-01-06T13:30:25,801 creating build/bdist.linux-armv7l/wheel/unitxt/catalog/engines/cross_provider 2026-01-06T13:30:25,802 copying build/lib/unitxt/catalog/engines/cross_provider/llama_3_8b_instruct.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/engines/cross_provider 2026-01-06T13:30:25,805 copying build/lib/unitxt/catalog/engines/cross_provider/llama_3_70b_instruct.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/engines/cross_provider 2026-01-06T13:30:25,807 creating build/bdist.linux-armv7l/wheel/unitxt/catalog/engines/rits 2026-01-06T13:30:25,809 creating build/bdist.linux-armv7l/wheel/unitxt/catalog/engines/rits/llama_3 2026-01-06T13:30:25,811 copying build/lib/unitxt/catalog/engines/rits/llama_3/1_8b_instruct.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/engines/rits/llama_3 2026-01-06T13:30:25,813 copying build/lib/unitxt/catalog/engines/rits/llama_3_1_405b_instruct_fp8.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/engines/rits 2026-01-06T13:30:25,815 copying build/lib/unitxt/catalog/engines/rits/llama_3_1_70b_instruct.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/engines/rits 2026-01-06T13:30:25,817 creating build/bdist.linux-armv7l/wheel/unitxt/catalog/engines/ibm_wml 2026-01-06T13:30:25,819 copying build/lib/unitxt/catalog/engines/ibm_wml/llama_3_3_70b_instruct.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/engines/ibm_wml 2026-01-06T13:30:25,822 creating build/bdist.linux-armv7l/wheel/unitxt/catalog/engines/classification 2026-01-06T13:30:25,823 copying build/lib/unitxt/catalog/engines/classification/llama_3_405b_instruct_wml.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/engines/classification 2026-01-06T13:30:25,825 copying build/lib/unitxt/catalog/engines/classification/llama_3_3_70b_instruct_watsonx.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/engines/classification 2026-01-06T13:30:25,827 copying build/lib/unitxt/catalog/engines/classification/llama_3_3_70b_instruct_wml.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/engines/classification 2026-01-06T13:30:25,829 copying build/lib/unitxt/catalog/engines/classification/gpt_4_turbo_2024_04_09_azure_openai.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/engines/classification 2026-01-06T13:30:25,832 copying build/lib/unitxt/catalog/engines/classification/llama_4_maverick_17b_128e_instruct_fp8_watsonx.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/engines/classification 2026-01-06T13:30:25,834 copying build/lib/unitxt/catalog/engines/classification/llama_3_1_70b_instruct_watsonx.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/engines/classification 2026-01-06T13:30:25,836 copying build/lib/unitxt/catalog/engines/classification/gpt_oss_120b_watsonx.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/engines/classification 2026-01-06T13:30:25,838 copying build/lib/unitxt/catalog/engines/classification/mistral_large_watsonx.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/engines/classification 2026-01-06T13:30:25,840 copying build/lib/unitxt/catalog/engines/classification/gpt_oss_120b_rits.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/engines/classification 2026-01-06T13:30:25,843 copying build/lib/unitxt/catalog/engines/classification/mistral_large_instruct_2407_rits.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/engines/classification 2026-01-06T13:30:25,845 copying build/lib/unitxt/catalog/engines/classification/gpt_4o_open_ai.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/engines/classification 2026-01-06T13:30:25,847 copying build/lib/unitxt/catalog/engines/classification/llama_3_1_405b_instruct_fp8_rits.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/engines/classification 2026-01-06T13:30:25,849 copying build/lib/unitxt/catalog/engines/classification/gpt_4o_2024_08_06_azure_openai.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/engines/classification 2026-01-06T13:30:25,851 copying build/lib/unitxt/catalog/engines/classification/llama_3_3_70b_instruct_rits.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/engines/classification 2026-01-06T13:30:25,853 copying build/lib/unitxt/catalog/engines/classification/mixtral_8x7b_instruct_v01_wml.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/engines/classification 2026-01-06T13:30:25,855 copying build/lib/unitxt/catalog/engines/classification/mistral_small_3_1_24b_instruct_2503_wml.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/engines/classification 2026-01-06T13:30:25,857 copying build/lib/unitxt/catalog/engines/classification/llama3_3_ollama.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/engines/classification 2026-01-06T13:30:25,859 copying build/lib/unitxt/catalog/engines/classification/llama_3_1_70b_instruct_wml.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/engines/classification 2026-01-06T13:30:25,862 copying build/lib/unitxt/catalog/engines/classification/llama3_8b_ollama.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/engines/classification 2026-01-06T13:30:25,864 copying build/lib/unitxt/catalog/engines/classification/llama_3_1_70b_instruct_rits.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/engines/classification 2026-01-06T13:30:25,866 copying build/lib/unitxt/catalog/engines/classification/llama_4_maverick_17b_128e_instruct_fp8_rits.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/engines/classification 2026-01-06T13:30:25,868 copying build/lib/unitxt/catalog/engines/classification/gpt_4_turbo_open_ai.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/engines/classification 2026-01-06T13:30:25,870 creating build/bdist.linux-armv7l/wheel/unitxt/catalog/engines/ollama 2026-01-06T13:30:25,872 copying build/lib/unitxt/catalog/engines/ollama/llama2.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/engines/ollama 2026-01-06T13:30:25,874 creating build/bdist.linux-armv7l/wheel/unitxt/catalog/engines/model 2026-01-06T13:30:25,876 copying build/lib/unitxt/catalog/engines/model/llama_3_8b_instruct.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/engines/model 2026-01-06T13:30:25,878 creating build/bdist.linux-armv7l/wheel/unitxt/catalog/engines/model/flan 2026-01-06T13:30:25,880 creating build/bdist.linux-armv7l/wheel/unitxt/catalog/engines/model/flan/t5_small 2026-01-06T13:30:25,882 copying build/lib/unitxt/catalog/engines/model/flan/t5_small/hf.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/engines/model/flan/t5_small 2026-01-06T13:30:25,884 creating build/bdist.linux-armv7l/wheel/unitxt/catalog/system_prompts 2026-01-06T13:30:25,886 copying build/lib/unitxt/catalog/system_prompts/empty.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/system_prompts 2026-01-06T13:30:25,889 creating build/bdist.linux-armv7l/wheel/unitxt/catalog/system_prompts/models 2026-01-06T13:30:25,890 copying build/lib/unitxt/catalog/system_prompts/models/japanese_llama.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/system_prompts/models 2026-01-06T13:30:25,892 copying build/lib/unitxt/catalog/system_prompts/models/alpaca.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/system_prompts/models 2026-01-06T13:30:25,895 copying build/lib/unitxt/catalog/system_prompts/models/llama2.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/system_prompts/models 2026-01-06T13:30:25,897 copying build/lib/unitxt/catalog/system_prompts/models/deepseek_coder.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/system_prompts/models 2026-01-06T13:30:25,899 copying build/lib/unitxt/catalog/system_prompts/models/llava_next_llama3_8b.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/system_prompts/models 2026-01-06T13:30:25,901 copying build/lib/unitxt/catalog/system_prompts/models/labradorite.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/system_prompts/models 2026-01-06T13:30:25,903 copying build/lib/unitxt/catalog/system_prompts/models/llama.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/system_prompts/models 2026-01-06T13:30:25,906 creating build/bdist.linux-armv7l/wheel/unitxt/catalog/system_prompts/general 2026-01-06T13:30:25,907 copying build/lib/unitxt/catalog/system_prompts/general/be_concise.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/system_prompts/general 2026-01-06T13:30:25,910 creating build/bdist.linux-armv7l/wheel/unitxt/catalog/system_prompts/model 2026-01-06T13:30:25,912 copying build/lib/unitxt/catalog/system_prompts/model/granite.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/system_prompts/model 2026-01-06T13:30:25,914 copying build/lib/unitxt/catalog/system_prompts/boolqa.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/system_prompts 2026-01-06T13:30:25,917 creating build/bdist.linux-armv7l/wheel/unitxt/catalog/templates 2026-01-06T13:30:25,919 creating build/bdist.linux-armv7l/wheel/unitxt/catalog/templates/response_assessment 2026-01-06T13:30:25,921 creating build/bdist.linux-armv7l/wheel/unitxt/catalog/templates/response_assessment/pairwise_comparison 2026-01-06T13:30:25,922 copying build/lib/unitxt/catalog/templates/response_assessment/pairwise_comparison/mt_bench_multi_turn.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/templates/response_assessment/pairwise_comparison 2026-01-06T13:30:25,925 copying build/lib/unitxt/catalog/templates/response_assessment/pairwise_comparison/mt_bench_single_turn_with_reference_with_shuffling.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/templates/response_assessment/pairwise_comparison 2026-01-06T13:30:25,927 copying build/lib/unitxt/catalog/templates/response_assessment/pairwise_comparison/mt_bench_multi_turn_with_reference.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/templates/response_assessment/pairwise_comparison 2026-01-06T13:30:25,929 copying build/lib/unitxt/catalog/templates/response_assessment/pairwise_comparison/mt_bench_single_turn_with_shuffling.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/templates/response_assessment/pairwise_comparison 2026-01-06T13:30:25,931 copying build/lib/unitxt/catalog/templates/response_assessment/pairwise_comparison/mt_bench_single_turn_with_reference.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/templates/response_assessment/pairwise_comparison 2026-01-06T13:30:25,933 copying build/lib/unitxt/catalog/templates/response_assessment/pairwise_comparison/mt_bench_multi_turn_with_reference_with_shuffling.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/templates/response_assessment/pairwise_comparison 2026-01-06T13:30:25,935 copying build/lib/unitxt/catalog/templates/response_assessment/pairwise_comparison/mt_bench_multi_turn_with_shuffling.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/templates/response_assessment/pairwise_comparison 2026-01-06T13:30:25,938 copying build/lib/unitxt/catalog/templates/response_assessment/pairwise_comparison/mt_bench_single_turn.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/templates/response_assessment/pairwise_comparison 2026-01-06T13:30:25,941 creating build/bdist.linux-armv7l/wheel/unitxt/catalog/templates/response_assessment/rating 2026-01-06T13:30:25,942 copying build/lib/unitxt/catalog/templates/response_assessment/rating/mt_bench_multi_turn.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/templates/response_assessment/rating 2026-01-06T13:30:25,944 copying build/lib/unitxt/catalog/templates/response_assessment/rating/mt_bench_multi_turn_with_reference.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/templates/response_assessment/rating 2026-01-06T13:30:25,946 copying build/lib/unitxt/catalog/templates/response_assessment/rating/mt_bench_single_turn_with_reference.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/templates/response_assessment/rating 2026-01-06T13:30:25,949 copying build/lib/unitxt/catalog/templates/response_assessment/rating/generic_single_turn_with_reference.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/templates/response_assessment/rating 2026-01-06T13:30:25,951 copying build/lib/unitxt/catalog/templates/response_assessment/rating/mt_bench_single_turn.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/templates/response_assessment/rating 2026-01-06T13:30:25,953 copying build/lib/unitxt/catalog/templates/response_assessment/rating/generic_single_turn.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/templates/response_assessment/rating 2026-01-06T13:30:25,956 copying build/lib/unitxt/catalog/templates/response_assessment/rating/table2text_single_turn_with_reference.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/templates/response_assessment/rating 2026-01-06T13:30:25,959 creating build/bdist.linux-armv7l/wheel/unitxt/catalog/templates/response_assessment/pairwise_comparative_rating 2026-01-06T13:30:25,960 copying build/lib/unitxt/catalog/templates/response_assessment/pairwise_comparative_rating/arena_hard.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/templates/response_assessment/pairwise_comparative_rating 2026-01-06T13:30:25,962 copying build/lib/unitxt/catalog/templates/response_assessment/pairwise_comparative_rating/prometheus_arena_hard_with_shuffling.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/templates/response_assessment/pairwise_comparative_rating 2026-01-06T13:30:25,965 copying build/lib/unitxt/catalog/templates/response_assessment/pairwise_comparative_rating/prometheus_arena_hard.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/templates/response_assessment/pairwise_comparative_rating 2026-01-06T13:30:25,967 copying build/lib/unitxt/catalog/templates/response_assessment/pairwise_comparative_rating/arena_hard_with_shuffling.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/templates/response_assessment/pairwise_comparative_rating 2026-01-06T13:30:25,969 copying build/lib/unitxt/catalog/templates/empty.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/templates 2026-01-06T13:30:25,972 creating build/bdist.linux-armv7l/wheel/unitxt/catalog/templates/selection 2026-01-06T13:30:25,974 creating build/bdist.linux-armv7l/wheel/unitxt/catalog/templates/selection/by_attribute 2026-01-06T13:30:25,975 copying build/lib/unitxt/catalog/templates/selection/by_attribute/default.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/templates/selection/by_attribute 2026-01-06T13:30:25,977 copying build/lib/unitxt/catalog/templates/selection/by_attribute/all.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/templates/selection/by_attribute 2026-01-06T13:30:25,980 creating build/bdist.linux-armv7l/wheel/unitxt/catalog/templates/targeted_sentiment_extraction 2026-01-06T13:30:25,982 copying build/lib/unitxt/catalog/templates/targeted_sentiment_extraction/having_sentiment.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/templates/targeted_sentiment_extraction 2026-01-06T13:30:25,984 copying build/lib/unitxt/catalog/templates/targeted_sentiment_extraction/empty.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/templates/targeted_sentiment_extraction 2026-01-06T13:30:25,986 copying build/lib/unitxt/catalog/templates/targeted_sentiment_extraction/carry_sentiment.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/templates/targeted_sentiment_extraction 2026-01-06T13:30:25,989 creating build/bdist.linux-armv7l/wheel/unitxt/catalog/templates/targeted_sentiment_extraction/positive 2026-01-06T13:30:25,990 copying build/lib/unitxt/catalog/templates/targeted_sentiment_extraction/positive/having_sentiment.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/templates/targeted_sentiment_extraction/positive 2026-01-06T13:30:25,993 copying build/lib/unitxt/catalog/templates/targeted_sentiment_extraction/positive/empty.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/templates/targeted_sentiment_extraction/positive 2026-01-06T13:30:25,995 copying build/lib/unitxt/catalog/templates/targeted_sentiment_extraction/positive/sentiment_extracted.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/templates/targeted_sentiment_extraction/positive 2026-01-06T13:30:25,997 copying build/lib/unitxt/catalog/templates/targeted_sentiment_extraction/positive/all.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/templates/targeted_sentiment_extraction/positive 2026-01-06T13:30:26,000 creating build/bdist.linux-armv7l/wheel/unitxt/catalog/templates/targeted_sentiment_extraction/neutral 2026-01-06T13:30:26,001 copying build/lib/unitxt/catalog/templates/targeted_sentiment_extraction/neutral/having_sentiment.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/templates/targeted_sentiment_extraction/neutral 2026-01-06T13:30:26,004 copying build/lib/unitxt/catalog/templates/targeted_sentiment_extraction/neutral/empty.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/templates/targeted_sentiment_extraction/neutral 2026-01-06T13:30:26,006 copying build/lib/unitxt/catalog/templates/targeted_sentiment_extraction/neutral/sentiment_extracted.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/templates/targeted_sentiment_extraction/neutral 2026-01-06T13:30:26,008 copying build/lib/unitxt/catalog/templates/targeted_sentiment_extraction/neutral/all.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/templates/targeted_sentiment_extraction/neutral 2026-01-06T13:30:26,010 copying build/lib/unitxt/catalog/templates/targeted_sentiment_extraction/entities_sentiment.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/templates/targeted_sentiment_extraction 2026-01-06T13:30:26,013 creating build/bdist.linux-armv7l/wheel/unitxt/catalog/templates/targeted_sentiment_extraction/as_json 2026-01-06T13:30:26,014 copying build/lib/unitxt/catalog/templates/targeted_sentiment_extraction/as_json/empty.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/templates/targeted_sentiment_extraction/as_json 2026-01-06T13:30:26,016 copying build/lib/unitxt/catalog/templates/targeted_sentiment_extraction/as_json/convert_with_implicit_keys.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/templates/targeted_sentiment_extraction/as_json 2026-01-06T13:30:26,019 copying build/lib/unitxt/catalog/templates/targeted_sentiment_extraction/as_json/convert_with_explicit_keys.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/templates/targeted_sentiment_extraction/as_json 2026-01-06T13:30:26,021 creating build/bdist.linux-armv7l/wheel/unitxt/catalog/templates/targeted_sentiment_extraction/negative 2026-01-06T13:30:26,023 copying build/lib/unitxt/catalog/templates/targeted_sentiment_extraction/negative/having_sentiment.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/templates/targeted_sentiment_extraction/negative 2026-01-06T13:30:26,025 copying build/lib/unitxt/catalog/templates/targeted_sentiment_extraction/negative/empty.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/templates/targeted_sentiment_extraction/negative 2026-01-06T13:30:26,027 copying build/lib/unitxt/catalog/templates/targeted_sentiment_extraction/negative/sentiment_extracted.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/templates/targeted_sentiment_extraction/negative 2026-01-06T13:30:26,029 copying build/lib/unitxt/catalog/templates/targeted_sentiment_extraction/negative/all.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/templates/targeted_sentiment_extraction/negative 2026-01-06T13:30:26,032 copying build/lib/unitxt/catalog/templates/targeted_sentiment_extraction/all.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/templates/targeted_sentiment_extraction 2026-01-06T13:30:26,034 copying build/lib/unitxt/catalog/templates/targeted_sentiment_extraction/extract_sentiment.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/templates/targeted_sentiment_extraction 2026-01-06T13:30:26,036 creating build/bdist.linux-armv7l/wheel/unitxt/catalog/templates/regression 2026-01-06T13:30:26,039 creating build/bdist.linux-armv7l/wheel/unitxt/catalog/templates/regression/two_texts 2026-01-06T13:30:26,041 copying build/lib/unitxt/catalog/templates/regression/two_texts/simple.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/templates/regression/two_texts 2026-01-06T13:30:26,044 creating build/bdist.linux-armv7l/wheel/unitxt/catalog/templates/regression/two_texts/similarity 2026-01-06T13:30:26,046 copying build/lib/unitxt/catalog/templates/regression/two_texts/similarity/flan.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/templates/regression/two_texts/similarity 2026-01-06T13:30:26,048 copying build/lib/unitxt/catalog/templates/regression/two_texts/title.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/templates/regression/two_texts 2026-01-06T13:30:26,050 copying build/lib/unitxt/catalog/templates/regression/two_texts/all.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/templates/regression/two_texts 2026-01-06T13:30:26,053 creating build/bdist.linux-armv7l/wheel/unitxt/catalog/templates/regression/single_text 2026-01-06T13:30:26,054 copying build/lib/unitxt/catalog/templates/regression/single_text/simple.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/templates/regression/single_text 2026-01-06T13:30:26,056 copying build/lib/unitxt/catalog/templates/regression/single_text/title.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/templates/regression/single_text 2026-01-06T13:30:26,058 copying build/lib/unitxt/catalog/templates/regression/single_text/all.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/templates/regression/single_text 2026-01-06T13:30:26,060 creating build/bdist.linux-armv7l/wheel/unitxt/catalog/templates/grammatical_error_correction 2026-01-06T13:30:26,062 copying build/lib/unitxt/catalog/templates/grammatical_error_correction/simple.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/templates/grammatical_error_correction 2026-01-06T13:30:26,064 copying build/lib/unitxt/catalog/templates/grammatical_error_correction/all.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/templates/grammatical_error_correction 2026-01-06T13:30:26,067 creating build/bdist.linux-armv7l/wheel/unitxt/catalog/templates/generation 2026-01-06T13:30:26,068 copying build/lib/unitxt/catalog/templates/generation/empty.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/templates/generation 2026-01-06T13:30:26,071 creating build/bdist.linux-armv7l/wheel/unitxt/catalog/templates/generation/from_pair 2026-01-06T13:30:26,072 copying build/lib/unitxt/catalog/templates/generation/from_pair/default.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/templates/generation/from_pair 2026-01-06T13:30:26,074 copying build/lib/unitxt/catalog/templates/generation/from_pair/all.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/templates/generation/from_pair 2026-01-06T13:30:26,076 copying build/lib/unitxt/catalog/templates/generation/default.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/templates/generation 2026-01-06T13:30:26,078 copying build/lib/unitxt/catalog/templates/generation/all.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/templates/generation 2026-01-06T13:30:26,081 creating build/bdist.linux-armv7l/wheel/unitxt/catalog/templates/tool_calling 2026-01-06T13:30:26,082 copying build/lib/unitxt/catalog/templates/tool_calling/multi_turn.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/templates/tool_calling 2026-01-06T13:30:26,084 copying build/lib/unitxt/catalog/templates/tool_calling/base.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/templates/tool_calling 2026-01-06T13:30:26,087 creating build/bdist.linux-armv7l/wheel/unitxt/catalog/templates/translation 2026-01-06T13:30:26,089 creating build/bdist.linux-armv7l/wheel/unitxt/catalog/templates/translation/directed 2026-01-06T13:30:26,091 copying build/lib/unitxt/catalog/templates/translation/directed/formal.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/templates/translation/directed 2026-01-06T13:30:26,093 copying build/lib/unitxt/catalog/templates/translation/directed/casual.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/templates/translation/directed 2026-01-06T13:30:26,095 copying build/lib/unitxt/catalog/templates/translation/directed/playful.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/templates/translation/directed 2026-01-06T13:30:26,098 copying build/lib/unitxt/catalog/templates/translation/directed/simple.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/templates/translation/directed 2026-01-06T13:30:26,100 copying build/lib/unitxt/catalog/templates/translation/directed/bluebench.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/templates/translation/directed 2026-01-06T13:30:26,102 copying build/lib/unitxt/catalog/templates/translation/directed/instructional.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/templates/translation/directed 2026-01-06T13:30:26,104 copying build/lib/unitxt/catalog/templates/translation/directed/title.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/templates/translation/directed 2026-01-06T13:30:26,106 copying build/lib/unitxt/catalog/templates/translation/directed/all.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/templates/translation/directed 2026-01-06T13:30:26,108 copying build/lib/unitxt/catalog/templates/key_val_with_new_lines.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/templates 2026-01-06T13:30:26,110 copying build/lib/unitxt/catalog/templates/key_val.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/templates 2026-01-06T13:30:26,112 creating build/bdist.linux-armv7l/wheel/unitxt/catalog/templates/qa 2026-01-06T13:30:26,114 copying build/lib/unitxt/catalog/templates/qa/extractive.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/templates/qa 2026-01-06T13:30:26,116 creating build/bdist.linux-armv7l/wheel/unitxt/catalog/templates/qa/multi_turn 2026-01-06T13:30:26,118 creating build/bdist.linux-armv7l/wheel/unitxt/catalog/templates/qa/multi_turn/with_context 2026-01-06T13:30:26,119 copying build/lib/unitxt/catalog/templates/qa/multi_turn/with_context/simple.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/templates/qa/multi_turn/with_context 2026-01-06T13:30:26,122 copying build/lib/unitxt/catalog/templates/qa/with_context.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/templates/qa 2026-01-06T13:30:26,124 creating build/bdist.linux-armv7l/wheel/unitxt/catalog/templates/qa/llama_vision 2026-01-06T13:30:26,125 creating build/bdist.linux-armv7l/wheel/unitxt/catalog/templates/qa/llama_vision/multiple_choice 2026-01-06T13:30:26,127 creating build/bdist.linux-armv7l/wheel/unitxt/catalog/templates/qa/llama_vision/multiple_choice/with_context 2026-01-06T13:30:26,128 copying build/lib/unitxt/catalog/templates/qa/llama_vision/multiple_choice/with_context/ai2d.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/templates/qa/llama_vision/multiple_choice/with_context 2026-01-06T13:30:26,131 creating build/bdist.linux-armv7l/wheel/unitxt/catalog/templates/qa/llama_vision/with_context 2026-01-06T13:30:26,132 copying build/lib/unitxt/catalog/templates/qa/llama_vision/with_context/chart_qa.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/templates/qa/llama_vision/with_context 2026-01-06T13:30:26,134 copying build/lib/unitxt/catalog/templates/qa/llama_vision/with_context/doc_vqa.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/templates/qa/llama_vision/with_context 2026-01-06T13:30:26,136 copying build/lib/unitxt/catalog/templates/qa/llama_vision/with_context/info_vqa.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/templates/qa/llama_vision/with_context 2026-01-06T13:30:26,138 creating build/bdist.linux-armv7l/wheel/unitxt/catalog/templates/qa/multiple_choice 2026-01-06T13:30:26,139 copying build/lib/unitxt/catalog/templates/qa/multiple_choice/lm_eval_harness.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/templates/qa/multiple_choice 2026-01-06T13:30:26,141 copying build/lib/unitxt/catalog/templates/qa/multiple_choice/match.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/templates/qa/multiple_choice 2026-01-06T13:30:26,143 copying build/lib/unitxt/catalog/templates/qa/multiple_choice/helm.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/templates/qa/multiple_choice 2026-01-06T13:30:26,146 creating build/bdist.linux-armv7l/wheel/unitxt/catalog/templates/qa/multiple_choice/with_topic 2026-01-06T13:30:26,147 copying build/lib/unitxt/catalog/templates/qa/multiple_choice/with_topic/lm_eval_harness.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/templates/qa/multiple_choice/with_topic 2026-01-06T13:30:26,150 creating build/bdist.linux-armv7l/wheel/unitxt/catalog/templates/qa/multiple_choice/with_topic/es 2026-01-06T13:30:26,151 copying build/lib/unitxt/catalog/templates/qa/multiple_choice/with_topic/es/lm_eval_harness.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/templates/qa/multiple_choice/with_topic/es 2026-01-06T13:30:26,152 copying build/lib/unitxt/catalog/templates/qa/multiple_choice/with_topic/es/mmlu.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/templates/qa/multiple_choice/with_topic/es 2026-01-06T13:30:26,154 copying build/lib/unitxt/catalog/templates/qa/multiple_choice/with_topic/es/helm.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/templates/qa/multiple_choice/with_topic/es 2026-01-06T13:30:26,156 copying build/lib/unitxt/catalog/templates/qa/multiple_choice/with_topic/es/all.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/templates/qa/multiple_choice/with_topic/es 2026-01-06T13:30:26,158 copying build/lib/unitxt/catalog/templates/qa/multiple_choice/with_topic/mmlu.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/templates/qa/multiple_choice/with_topic 2026-01-06T13:30:26,159 copying build/lib/unitxt/catalog/templates/qa/multiple_choice/with_topic/match.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/templates/qa/multiple_choice/with_topic 2026-01-06T13:30:26,161 copying build/lib/unitxt/catalog/templates/qa/multiple_choice/with_topic/fm_eval.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/templates/qa/multiple_choice/with_topic 2026-01-06T13:30:26,164 creating build/bdist.linux-armv7l/wheel/unitxt/catalog/templates/qa/multiple_choice/with_topic/de 2026-01-06T13:30:26,165 copying build/lib/unitxt/catalog/templates/qa/multiple_choice/with_topic/de/lm_eval_harness.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/templates/qa/multiple_choice/with_topic/de 2026-01-06T13:30:26,167 copying build/lib/unitxt/catalog/templates/qa/multiple_choice/with_topic/de/mmlu.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/templates/qa/multiple_choice/with_topic/de 2026-01-06T13:30:26,169 copying build/lib/unitxt/catalog/templates/qa/multiple_choice/with_topic/de/helm.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/templates/qa/multiple_choice/with_topic/de 2026-01-06T13:30:26,171 copying build/lib/unitxt/catalog/templates/qa/multiple_choice/with_topic/de/all.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/templates/qa/multiple_choice/with_topic/de 2026-01-06T13:30:26,173 copying build/lib/unitxt/catalog/templates/qa/multiple_choice/with_topic/helm.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/templates/qa/multiple_choice/with_topic 2026-01-06T13:30:26,175 creating build/bdist.linux-armv7l/wheel/unitxt/catalog/templates/qa/multiple_choice/with_topic/ja 2026-01-06T13:30:26,176 copying build/lib/unitxt/catalog/templates/qa/multiple_choice/with_topic/ja/lm_eval_harness.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/templates/qa/multiple_choice/with_topic/ja 2026-01-06T13:30:26,178 copying build/lib/unitxt/catalog/templates/qa/multiple_choice/with_topic/ja/mmlu.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/templates/qa/multiple_choice/with_topic/ja 2026-01-06T13:30:26,181 copying build/lib/unitxt/catalog/templates/qa/multiple_choice/with_topic/ja/helm.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/templates/qa/multiple_choice/with_topic/ja 2026-01-06T13:30:26,182 copying build/lib/unitxt/catalog/templates/qa/multiple_choice/with_topic/ja/all.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/templates/qa/multiple_choice/with_topic/ja 2026-01-06T13:30:26,184 copying build/lib/unitxt/catalog/templates/qa/multiple_choice/with_topic/bluebench.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/templates/qa/multiple_choice/with_topic 2026-01-06T13:30:26,187 creating build/bdist.linux-armv7l/wheel/unitxt/catalog/templates/qa/multiple_choice/with_topic/pt 2026-01-06T13:30:26,188 copying build/lib/unitxt/catalog/templates/qa/multiple_choice/with_topic/pt/lm_eval_harness.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/templates/qa/multiple_choice/with_topic/pt 2026-01-06T13:30:26,190 copying build/lib/unitxt/catalog/templates/qa/multiple_choice/with_topic/pt/mmlu.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/templates/qa/multiple_choice/with_topic/pt 2026-01-06T13:30:26,192 copying build/lib/unitxt/catalog/templates/qa/multiple_choice/with_topic/pt/helm.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/templates/qa/multiple_choice/with_topic/pt 2026-01-06T13:30:26,194 copying build/lib/unitxt/catalog/templates/qa/multiple_choice/with_topic/pt/all.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/templates/qa/multiple_choice/with_topic/pt 2026-01-06T13:30:26,196 copying build/lib/unitxt/catalog/templates/qa/multiple_choice/with_topic/title.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/templates/qa/multiple_choice/with_topic 2026-01-06T13:30:26,198 creating build/bdist.linux-armv7l/wheel/unitxt/catalog/templates/qa/multiple_choice/with_topic/fr 2026-01-06T13:30:26,199 copying build/lib/unitxt/catalog/templates/qa/multiple_choice/with_topic/fr/lm_eval_harness.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/templates/qa/multiple_choice/with_topic/fr 2026-01-06T13:30:26,201 copying build/lib/unitxt/catalog/templates/qa/multiple_choice/with_topic/fr/mmlu.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/templates/qa/multiple_choice/with_topic/fr 2026-01-06T13:30:26,203 copying build/lib/unitxt/catalog/templates/qa/multiple_choice/with_topic/fr/helm.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/templates/qa/multiple_choice/with_topic/fr 2026-01-06T13:30:26,206 copying build/lib/unitxt/catalog/templates/qa/multiple_choice/with_topic/fr/all.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/templates/qa/multiple_choice/with_topic/fr 2026-01-06T13:30:26,207 copying build/lib/unitxt/catalog/templates/qa/multiple_choice/with_topic/all.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/templates/qa/multiple_choice/with_topic 2026-01-06T13:30:26,210 creating build/bdist.linux-armv7l/wheel/unitxt/catalog/templates/qa/multiple_choice/open 2026-01-06T13:30:26,211 copying build/lib/unitxt/catalog/templates/qa/multiple_choice/open/lm_eval_harness.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/templates/qa/multiple_choice/open 2026-01-06T13:30:26,214 creating build/bdist.linux-armv7l/wheel/unitxt/catalog/templates/qa/multiple_choice/open/es 2026-01-06T13:30:26,215 copying build/lib/unitxt/catalog/templates/qa/multiple_choice/open/es/lm_eval_harness.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/templates/qa/multiple_choice/open/es 2026-01-06T13:30:26,217 copying build/lib/unitxt/catalog/templates/qa/multiple_choice/open/es/mmlu.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/templates/qa/multiple_choice/open/es 2026-01-06T13:30:26,219 copying build/lib/unitxt/catalog/templates/qa/multiple_choice/open/es/helm.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/templates/qa/multiple_choice/open/es 2026-01-06T13:30:26,220 copying build/lib/unitxt/catalog/templates/qa/multiple_choice/open/es/all.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/templates/qa/multiple_choice/open/es 2026-01-06T13:30:26,222 copying build/lib/unitxt/catalog/templates/qa/multiple_choice/open/mmlu.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/templates/qa/multiple_choice/open 2026-01-06T13:30:26,225 creating build/bdist.linux-armv7l/wheel/unitxt/catalog/templates/qa/multiple_choice/open/de 2026-01-06T13:30:26,226 copying build/lib/unitxt/catalog/templates/qa/multiple_choice/open/de/lm_eval_harness.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/templates/qa/multiple_choice/open/de 2026-01-06T13:30:26,228 copying build/lib/unitxt/catalog/templates/qa/multiple_choice/open/de/mmlu.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/templates/qa/multiple_choice/open/de 2026-01-06T13:30:26,230 copying build/lib/unitxt/catalog/templates/qa/multiple_choice/open/de/helm.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/templates/qa/multiple_choice/open/de 2026-01-06T13:30:26,232 copying build/lib/unitxt/catalog/templates/qa/multiple_choice/open/de/all.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/templates/qa/multiple_choice/open/de 2026-01-06T13:30:26,233 copying build/lib/unitxt/catalog/templates/qa/multiple_choice/open/helm.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/templates/qa/multiple_choice/open 2026-01-06T13:30:26,236 creating build/bdist.linux-armv7l/wheel/unitxt/catalog/templates/qa/multiple_choice/open/ja 2026-01-06T13:30:26,237 copying build/lib/unitxt/catalog/templates/qa/multiple_choice/open/ja/lm_eval_harness.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/templates/qa/multiple_choice/open/ja 2026-01-06T13:30:26,239 copying build/lib/unitxt/catalog/templates/qa/multiple_choice/open/ja/mmlu.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/templates/qa/multiple_choice/open/ja 2026-01-06T13:30:26,241 copying build/lib/unitxt/catalog/templates/qa/multiple_choice/open/ja/helm.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/templates/qa/multiple_choice/open/ja 2026-01-06T13:30:26,242 copying build/lib/unitxt/catalog/templates/qa/multiple_choice/open/ja/all.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/templates/qa/multiple_choice/open/ja 2026-01-06T13:30:26,244 copying build/lib/unitxt/catalog/templates/qa/multiple_choice/open/bluebench.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/templates/qa/multiple_choice/open 2026-01-06T13:30:26,246 creating build/bdist.linux-armv7l/wheel/unitxt/catalog/templates/qa/multiple_choice/open/pt 2026-01-06T13:30:26,247 copying build/lib/unitxt/catalog/templates/qa/multiple_choice/open/pt/lm_eval_harness.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/templates/qa/multiple_choice/open/pt 2026-01-06T13:30:26,249 copying build/lib/unitxt/catalog/templates/qa/multiple_choice/open/pt/mmlu.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/templates/qa/multiple_choice/open/pt 2026-01-06T13:30:26,251 copying build/lib/unitxt/catalog/templates/qa/multiple_choice/open/pt/helm.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/templates/qa/multiple_choice/open/pt 2026-01-06T13:30:26,253 copying build/lib/unitxt/catalog/templates/qa/multiple_choice/open/pt/all.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/templates/qa/multiple_choice/open/pt 2026-01-06T13:30:26,256 creating build/bdist.linux-armv7l/wheel/unitxt/catalog/templates/qa/multiple_choice/open/fr 2026-01-06T13:30:26,257 copying build/lib/unitxt/catalog/templates/qa/multiple_choice/open/fr/lm_eval_harness.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/templates/qa/multiple_choice/open/fr 2026-01-06T13:30:26,259 copying build/lib/unitxt/catalog/templates/qa/multiple_choice/open/fr/mmlu.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/templates/qa/multiple_choice/open/fr 2026-01-06T13:30:26,261 copying build/lib/unitxt/catalog/templates/qa/multiple_choice/open/fr/helm.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/templates/qa/multiple_choice/open/fr 2026-01-06T13:30:26,263 copying build/lib/unitxt/catalog/templates/qa/multiple_choice/open/fr/all.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/templates/qa/multiple_choice/open/fr 2026-01-06T13:30:26,264 copying build/lib/unitxt/catalog/templates/qa/multiple_choice/open/all.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/templates/qa/multiple_choice/open 2026-01-06T13:30:26,269 creating build/bdist.linux-armv7l/wheel/unitxt/catalog/templates/qa/multiple_choice/with_context 2026-01-06T13:30:26,270 copying build/lib/unitxt/catalog/templates/qa/multiple_choice/with_context/lm_eval_harness.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/templates/qa/multiple_choice/with_context 2026-01-06T13:30:26,272 copying build/lib/unitxt/catalog/templates/qa/multiple_choice/with_context/match.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/templates/qa/multiple_choice/with_context 2026-01-06T13:30:26,274 creating build/bdist.linux-armv7l/wheel/unitxt/catalog/templates/qa/multiple_choice/with_context/no_intro 2026-01-06T13:30:26,275 copying build/lib/unitxt/catalog/templates/qa/multiple_choice/with_context/no_intro/lm_eval_harness.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/templates/qa/multiple_choice/with_context/no_intro 2026-01-06T13:30:26,278 creating build/bdist.linux-armv7l/wheel/unitxt/catalog/templates/qa/multiple_choice/with_context/no_intro/es 2026-01-06T13:30:26,279 copying build/lib/unitxt/catalog/templates/qa/multiple_choice/with_context/no_intro/es/lm_eval_harness.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/templates/qa/multiple_choice/with_context/no_intro/es 2026-01-06T13:30:26,280 copying build/lib/unitxt/catalog/templates/qa/multiple_choice/with_context/no_intro/es/mmlu.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/templates/qa/multiple_choice/with_context/no_intro/es 2026-01-06T13:30:26,282 copying build/lib/unitxt/catalog/templates/qa/multiple_choice/with_context/no_intro/es/helm.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/templates/qa/multiple_choice/with_context/no_intro/es 2026-01-06T13:30:26,284 copying build/lib/unitxt/catalog/templates/qa/multiple_choice/with_context/no_intro/es/all.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/templates/qa/multiple_choice/with_context/no_intro/es 2026-01-06T13:30:26,286 copying build/lib/unitxt/catalog/templates/qa/multiple_choice/with_context/no_intro/mmlu.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/templates/qa/multiple_choice/with_context/no_intro 2026-01-06T13:30:26,289 creating build/bdist.linux-armv7l/wheel/unitxt/catalog/templates/qa/multiple_choice/with_context/no_intro/de 2026-01-06T13:30:26,290 copying build/lib/unitxt/catalog/templates/qa/multiple_choice/with_context/no_intro/de/lm_eval_harness.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/templates/qa/multiple_choice/with_context/no_intro/de 2026-01-06T13:30:26,291 copying build/lib/unitxt/catalog/templates/qa/multiple_choice/with_context/no_intro/de/mmlu.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/templates/qa/multiple_choice/with_context/no_intro/de 2026-01-06T13:30:26,293 copying build/lib/unitxt/catalog/templates/qa/multiple_choice/with_context/no_intro/de/helm.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/templates/qa/multiple_choice/with_context/no_intro/de 2026-01-06T13:30:26,295 copying build/lib/unitxt/catalog/templates/qa/multiple_choice/with_context/no_intro/de/all.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/templates/qa/multiple_choice/with_context/no_intro/de 2026-01-06T13:30:26,297 copying build/lib/unitxt/catalog/templates/qa/multiple_choice/with_context/no_intro/helm.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/templates/qa/multiple_choice/with_context/no_intro 2026-01-06T13:30:26,299 creating build/bdist.linux-armv7l/wheel/unitxt/catalog/templates/qa/multiple_choice/with_context/no_intro/ja 2026-01-06T13:30:26,300 copying build/lib/unitxt/catalog/templates/qa/multiple_choice/with_context/no_intro/ja/lm_eval_harness.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/templates/qa/multiple_choice/with_context/no_intro/ja 2026-01-06T13:30:26,302 copying build/lib/unitxt/catalog/templates/qa/multiple_choice/with_context/no_intro/ja/mmlu.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/templates/qa/multiple_choice/with_context/no_intro/ja 2026-01-06T13:30:26,304 copying build/lib/unitxt/catalog/templates/qa/multiple_choice/with_context/no_intro/ja/helm.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/templates/qa/multiple_choice/with_context/no_intro/ja 2026-01-06T13:30:26,306 copying build/lib/unitxt/catalog/templates/qa/multiple_choice/with_context/no_intro/ja/all.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/templates/qa/multiple_choice/with_context/no_intro/ja 2026-01-06T13:30:26,308 creating build/bdist.linux-armv7l/wheel/unitxt/catalog/templates/qa/multiple_choice/with_context/no_intro/pt 2026-01-06T13:30:26,309 copying build/lib/unitxt/catalog/templates/qa/multiple_choice/with_context/no_intro/pt/lm_eval_harness.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/templates/qa/multiple_choice/with_context/no_intro/pt 2026-01-06T13:30:26,311 copying build/lib/unitxt/catalog/templates/qa/multiple_choice/with_context/no_intro/pt/mmlu.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/templates/qa/multiple_choice/with_context/no_intro/pt 2026-01-06T13:30:26,313 copying build/lib/unitxt/catalog/templates/qa/multiple_choice/with_context/no_intro/pt/helm.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/templates/qa/multiple_choice/with_context/no_intro/pt 2026-01-06T13:30:26,314 copying build/lib/unitxt/catalog/templates/qa/multiple_choice/with_context/no_intro/pt/all.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/templates/qa/multiple_choice/with_context/no_intro/pt 2026-01-06T13:30:26,317 creating build/bdist.linux-armv7l/wheel/unitxt/catalog/templates/qa/multiple_choice/with_context/no_intro/fr 2026-01-06T13:30:26,318 copying build/lib/unitxt/catalog/templates/qa/multiple_choice/with_context/no_intro/fr/lm_eval_harness.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/templates/qa/multiple_choice/with_context/no_intro/fr 2026-01-06T13:30:26,320 copying build/lib/unitxt/catalog/templates/qa/multiple_choice/with_context/no_intro/fr/mmlu.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/templates/qa/multiple_choice/with_context/no_intro/fr 2026-01-06T13:30:26,321 copying build/lib/unitxt/catalog/templates/qa/multiple_choice/with_context/no_intro/fr/helm.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/templates/qa/multiple_choice/with_context/no_intro/fr 2026-01-06T13:30:26,323 copying build/lib/unitxt/catalog/templates/qa/multiple_choice/with_context/no_intro/fr/all.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/templates/qa/multiple_choice/with_context/no_intro/fr 2026-01-06T13:30:26,325 copying build/lib/unitxt/catalog/templates/qa/multiple_choice/with_context/no_intro/all.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/templates/qa/multiple_choice/with_context/no_intro 2026-01-06T13:30:26,327 copying build/lib/unitxt/catalog/templates/qa/multiple_choice/with_context/ai2d.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/templates/qa/multiple_choice/with_context 2026-01-06T13:30:26,328 copying build/lib/unitxt/catalog/templates/qa/multiple_choice/with_context/lmms_eval.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/templates/qa/multiple_choice/with_context 2026-01-06T13:30:26,330 copying build/lib/unitxt/catalog/templates/qa/multiple_choice/with_context/bluebench.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/templates/qa/multiple_choice/with_context 2026-01-06T13:30:26,333 creating build/bdist.linux-armv7l/wheel/unitxt/catalog/templates/qa/multiple_choice/with_context/with_topic 2026-01-06T13:30:26,334 copying build/lib/unitxt/catalog/templates/qa/multiple_choice/with_context/with_topic/lm_eval_harness.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/templates/qa/multiple_choice/with_context/with_topic 2026-01-06T13:30:26,336 creating build/bdist.linux-armv7l/wheel/unitxt/catalog/templates/qa/multiple_choice/with_context/with_topic/es 2026-01-06T13:30:26,337 copying build/lib/unitxt/catalog/templates/qa/multiple_choice/with_context/with_topic/es/lm_eval_harness.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/templates/qa/multiple_choice/with_context/with_topic/es 2026-01-06T13:30:26,339 copying build/lib/unitxt/catalog/templates/qa/multiple_choice/with_context/with_topic/es/mmlu.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/templates/qa/multiple_choice/with_context/with_topic/es 2026-01-06T13:30:26,341 copying build/lib/unitxt/catalog/templates/qa/multiple_choice/with_context/with_topic/es/helm.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/templates/qa/multiple_choice/with_context/with_topic/es 2026-01-06T13:30:26,343 copying build/lib/unitxt/catalog/templates/qa/multiple_choice/with_context/with_topic/es/all.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/templates/qa/multiple_choice/with_context/with_topic/es 2026-01-06T13:30:26,345 copying build/lib/unitxt/catalog/templates/qa/multiple_choice/with_context/with_topic/mmlu.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/templates/qa/multiple_choice/with_context/with_topic 2026-01-06T13:30:26,346 copying build/lib/unitxt/catalog/templates/qa/multiple_choice/with_context/with_topic/match.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/templates/qa/multiple_choice/with_context/with_topic 2026-01-06T13:30:26,348 copying build/lib/unitxt/catalog/templates/qa/multiple_choice/with_context/with_topic/fm_eval.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/templates/qa/multiple_choice/with_context/with_topic 2026-01-06T13:30:26,350 creating build/bdist.linux-armv7l/wheel/unitxt/catalog/templates/qa/multiple_choice/with_context/with_topic/de 2026-01-06T13:30:26,351 copying build/lib/unitxt/catalog/templates/qa/multiple_choice/with_context/with_topic/de/lm_eval_harness.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/templates/qa/multiple_choice/with_context/with_topic/de 2026-01-06T13:30:26,353 copying build/lib/unitxt/catalog/templates/qa/multiple_choice/with_context/with_topic/de/mmlu.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/templates/qa/multiple_choice/with_context/with_topic/de 2026-01-06T13:30:26,355 copying build/lib/unitxt/catalog/templates/qa/multiple_choice/with_context/with_topic/de/helm.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/templates/qa/multiple_choice/with_context/with_topic/de 2026-01-06T13:30:26,357 copying build/lib/unitxt/catalog/templates/qa/multiple_choice/with_context/with_topic/de/all.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/templates/qa/multiple_choice/with_context/with_topic/de 2026-01-06T13:30:26,359 copying build/lib/unitxt/catalog/templates/qa/multiple_choice/with_context/with_topic/helm.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/templates/qa/multiple_choice/with_context/with_topic 2026-01-06T13:30:26,361 creating build/bdist.linux-armv7l/wheel/unitxt/catalog/templates/qa/multiple_choice/with_context/with_topic/ja 2026-01-06T13:30:26,362 copying build/lib/unitxt/catalog/templates/qa/multiple_choice/with_context/with_topic/ja/lm_eval_harness.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/templates/qa/multiple_choice/with_context/with_topic/ja 2026-01-06T13:30:26,364 copying build/lib/unitxt/catalog/templates/qa/multiple_choice/with_context/with_topic/ja/mmlu.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/templates/qa/multiple_choice/with_context/with_topic/ja 2026-01-06T13:30:26,366 copying build/lib/unitxt/catalog/templates/qa/multiple_choice/with_context/with_topic/ja/helm.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/templates/qa/multiple_choice/with_context/with_topic/ja 2026-01-06T13:30:26,367 copying build/lib/unitxt/catalog/templates/qa/multiple_choice/with_context/with_topic/ja/all.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/templates/qa/multiple_choice/with_context/with_topic/ja 2026-01-06T13:30:26,370 creating build/bdist.linux-armv7l/wheel/unitxt/catalog/templates/qa/multiple_choice/with_context/with_topic/pt 2026-01-06T13:30:26,371 copying build/lib/unitxt/catalog/templates/qa/multiple_choice/with_context/with_topic/pt/lm_eval_harness.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/templates/qa/multiple_choice/with_context/with_topic/pt 2026-01-06T13:30:26,373 copying build/lib/unitxt/catalog/templates/qa/multiple_choice/with_context/with_topic/pt/mmlu.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/templates/qa/multiple_choice/with_context/with_topic/pt 2026-01-06T13:30:26,375 copying build/lib/unitxt/catalog/templates/qa/multiple_choice/with_context/with_topic/pt/helm.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/templates/qa/multiple_choice/with_context/with_topic/pt 2026-01-06T13:30:26,377 copying build/lib/unitxt/catalog/templates/qa/multiple_choice/with_context/with_topic/pt/all.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/templates/qa/multiple_choice/with_context/with_topic/pt 2026-01-06T13:30:26,378 copying build/lib/unitxt/catalog/templates/qa/multiple_choice/with_context/with_topic/title.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/templates/qa/multiple_choice/with_context/with_topic 2026-01-06T13:30:26,381 creating build/bdist.linux-armv7l/wheel/unitxt/catalog/templates/qa/multiple_choice/with_context/with_topic/fr 2026-01-06T13:30:26,382 copying build/lib/unitxt/catalog/templates/qa/multiple_choice/with_context/with_topic/fr/lm_eval_harness.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/templates/qa/multiple_choice/with_context/with_topic/fr 2026-01-06T13:30:26,383 copying build/lib/unitxt/catalog/templates/qa/multiple_choice/with_context/with_topic/fr/mmlu.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/templates/qa/multiple_choice/with_context/with_topic/fr 2026-01-06T13:30:26,385 copying build/lib/unitxt/catalog/templates/qa/multiple_choice/with_context/with_topic/fr/helm.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/templates/qa/multiple_choice/with_context/with_topic/fr 2026-01-06T13:30:26,387 copying build/lib/unitxt/catalog/templates/qa/multiple_choice/with_context/with_topic/fr/all.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/templates/qa/multiple_choice/with_context/with_topic/fr 2026-01-06T13:30:26,389 copying build/lib/unitxt/catalog/templates/qa/multiple_choice/with_context/with_topic/all.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/templates/qa/multiple_choice/with_context/with_topic 2026-01-06T13:30:26,391 copying build/lib/unitxt/catalog/templates/qa/multiple_choice/with_context/exact_answer_instruct.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/templates/qa/multiple_choice/with_context 2026-01-06T13:30:26,392 copying build/lib/unitxt/catalog/templates/qa/multiple_choice/with_context/title.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/templates/qa/multiple_choice/with_context 2026-01-06T13:30:26,394 copying build/lib/unitxt/catalog/templates/qa/multiple_choice/with_context/all.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/templates/qa/multiple_choice/with_context 2026-01-06T13:30:26,396 copying build/lib/unitxt/catalog/templates/qa/multiple_choice/title.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/templates/qa/multiple_choice 2026-01-06T13:30:26,398 creating build/bdist.linux-armv7l/wheel/unitxt/catalog/templates/qa/open 2026-01-06T13:30:26,399 copying build/lib/unitxt/catalog/templates/qa/open/empty.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/templates/qa/open 2026-01-06T13:30:26,401 copying build/lib/unitxt/catalog/templates/qa/open/simple.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/templates/qa/open 2026-01-06T13:30:26,402 copying build/lib/unitxt/catalog/templates/qa/open/title.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/templates/qa/open 2026-01-06T13:30:26,404 copying build/lib/unitxt/catalog/templates/qa/open/simple2.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/templates/qa/open 2026-01-06T13:30:26,406 copying build/lib/unitxt/catalog/templates/qa/open/all.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/templates/qa/open 2026-01-06T13:30:26,408 creating build/bdist.linux-armv7l/wheel/unitxt/catalog/templates/qa/with_context 2026-01-06T13:30:26,409 copying build/lib/unitxt/catalog/templates/qa/with_context/with_type.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/templates/qa/with_context 2026-01-06T13:30:26,411 copying build/lib/unitxt/catalog/templates/qa/with_context/question_first.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/templates/qa/with_context 2026-01-06T13:30:26,413 copying build/lib/unitxt/catalog/templates/qa/with_context/ffqa.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/templates/qa/with_context 2026-01-06T13:30:26,415 copying build/lib/unitxt/catalog/templates/qa/with_context/chart_qa.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/templates/qa/with_context 2026-01-06T13:30:26,416 copying build/lib/unitxt/catalog/templates/qa/with_context/doc_vqa.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/templates/qa/with_context 2026-01-06T13:30:26,418 copying build/lib/unitxt/catalog/templates/qa/with_context/simple.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/templates/qa/with_context 2026-01-06T13:30:26,420 copying build/lib/unitxt/catalog/templates/qa/with_context/lmms_eval.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/templates/qa/with_context 2026-01-06T13:30:26,421 copying build/lib/unitxt/catalog/templates/qa/with_context/info_vqa.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/templates/qa/with_context 2026-01-06T13:30:26,423 copying build/lib/unitxt/catalog/templates/qa/with_context/websrc.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/templates/qa/with_context 2026-01-06T13:30:26,424 copying build/lib/unitxt/catalog/templates/qa/with_context/title.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/templates/qa/with_context 2026-01-06T13:30:26,426 copying build/lib/unitxt/catalog/templates/qa/with_context/simple2.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/templates/qa/with_context 2026-01-06T13:30:26,428 copying build/lib/unitxt/catalog/templates/qa/with_context/qtsumm.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/templates/qa/with_context 2026-01-06T13:30:26,429 copying build/lib/unitxt/catalog/templates/qa/with_context/all.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/templates/qa/with_context 2026-01-06T13:30:26,431 copying build/lib/unitxt/catalog/templates/qa/open.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/templates/qa 2026-01-06T13:30:26,434 creating build/bdist.linux-armv7l/wheel/unitxt/catalog/templates/summarization 2026-01-06T13:30:26,435 creating build/bdist.linux-armv7l/wheel/unitxt/catalog/templates/summarization/abstractive 2026-01-06T13:30:26,436 copying build/lib/unitxt/catalog/templates/summarization/abstractive/instructive.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/templates/summarization/abstractive 2026-01-06T13:30:26,438 copying build/lib/unitxt/catalog/templates/summarization/abstractive/instruct_passive.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/templates/summarization/abstractive 2026-01-06T13:30:26,440 copying build/lib/unitxt/catalog/templates/summarization/abstractive/instruct_tldr.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/templates/summarization/abstractive 2026-01-06T13:30:26,442 copying build/lib/unitxt/catalog/templates/summarization/abstractive/formal.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/templates/summarization/abstractive 2026-01-06T13:30:26,443 copying build/lib/unitxt/catalog/templates/summarization/abstractive/full.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/templates/summarization/abstractive 2026-01-06T13:30:26,445 copying build/lib/unitxt/catalog/templates/summarization/abstractive/professional.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/templates/summarization/abstractive 2026-01-06T13:30:26,447 copying build/lib/unitxt/catalog/templates/summarization/abstractive/casual.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/templates/summarization/abstractive 2026-01-06T13:30:26,449 copying build/lib/unitxt/catalog/templates/summarization/abstractive/formal_without_label.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/templates/summarization/abstractive 2026-01-06T13:30:26,450 copying build/lib/unitxt/catalog/templates/summarization/abstractive/instruct_write_succinct.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/templates/summarization/abstractive 2026-01-06T13:30:26,452 copying build/lib/unitxt/catalog/templates/summarization/abstractive/instruct_one_sentence.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/templates/summarization/abstractive 2026-01-06T13:30:26,454 copying build/lib/unitxt/catalog/templates/summarization/abstractive/bluebench.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/templates/summarization/abstractive 2026-01-06T13:30:26,456 copying build/lib/unitxt/catalog/templates/summarization/abstractive/write_succinct.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/templates/summarization/abstractive 2026-01-06T13:30:26,457 copying build/lib/unitxt/catalog/templates/summarization/abstractive/passive.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/templates/summarization/abstractive 2026-01-06T13:30:26,459 copying build/lib/unitxt/catalog/templates/summarization/abstractive/title.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/templates/summarization/abstractive 2026-01-06T13:30:26,461 copying build/lib/unitxt/catalog/templates/summarization/abstractive/one_sentence.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/templates/summarization/abstractive 2026-01-06T13:30:26,462 copying build/lib/unitxt/catalog/templates/summarization/abstractive/instruct_full.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/templates/summarization/abstractive 2026-01-06T13:30:26,464 copying build/lib/unitxt/catalog/templates/summarization/abstractive/all.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/templates/summarization/abstractive 2026-01-06T13:30:26,466 creating build/bdist.linux-armv7l/wheel/unitxt/catalog/templates/schema_linking 2026-01-06T13:30:26,467 copying build/lib/unitxt/catalog/templates/schema_linking/default.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/templates/schema_linking 2026-01-06T13:30:26,469 copying build/lib/unitxt/catalog/templates/schema_linking/with_hint.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/templates/schema_linking 2026-01-06T13:30:26,471 copying build/lib/unitxt/catalog/templates/schema_linking/all.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/templates/schema_linking 2026-01-06T13:30:26,473 creating build/bdist.linux-armv7l/wheel/unitxt/catalog/templates/completion 2026-01-06T13:30:26,475 creating build/bdist.linux-armv7l/wheel/unitxt/catalog/templates/completion/abstractive 2026-01-06T13:30:26,476 copying build/lib/unitxt/catalog/templates/completion/abstractive/empty.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/templates/completion/abstractive 2026-01-06T13:30:26,478 copying build/lib/unitxt/catalog/templates/completion/abstractive/standard.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/templates/completion/abstractive 2026-01-06T13:30:26,480 copying build/lib/unitxt/catalog/templates/completion/abstractive/all.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/templates/completion/abstractive 2026-01-06T13:30:26,483 creating build/bdist.linux-armv7l/wheel/unitxt/catalog/templates/completion/multiple_choice 2026-01-06T13:30:26,484 copying build/lib/unitxt/catalog/templates/completion/multiple_choice/simple.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/templates/completion/multiple_choice 2026-01-06T13:30:26,486 copying build/lib/unitxt/catalog/templates/completion/multiple_choice/enumerated.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/templates/completion/multiple_choice 2026-01-06T13:30:26,487 copying build/lib/unitxt/catalog/templates/completion/multiple_choice/bluebench.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/templates/completion/multiple_choice 2026-01-06T13:30:26,489 copying build/lib/unitxt/catalog/templates/completion/multiple_choice/title.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/templates/completion/multiple_choice 2026-01-06T13:30:26,491 copying build/lib/unitxt/catalog/templates/completion/multiple_choice/standard.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/templates/completion/multiple_choice 2026-01-06T13:30:26,493 copying build/lib/unitxt/catalog/templates/completion/multiple_choice/all.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/templates/completion/multiple_choice 2026-01-06T13:30:26,495 creating build/bdist.linux-armv7l/wheel/unitxt/catalog/templates/grammatical_error_detection 2026-01-06T13:30:26,496 copying build/lib/unitxt/catalog/templates/grammatical_error_detection/yes_no.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/templates/grammatical_error_detection 2026-01-06T13:30:26,498 copying build/lib/unitxt/catalog/templates/grammatical_error_detection/all.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/templates/grammatical_error_detection 2026-01-06T13:30:26,500 creating build/bdist.linux-armv7l/wheel/unitxt/catalog/templates/text2sql 2026-01-06T13:30:26,501 copying build/lib/unitxt/catalog/templates/text2sql/empty.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/templates/text2sql 2026-01-06T13:30:26,503 copying build/lib/unitxt/catalog/templates/text2sql/you_are_given.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/templates/text2sql 2026-01-06T13:30:26,505 copying build/lib/unitxt/catalog/templates/text2sql/you_are_given_with_sql_prefix.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/templates/text2sql 2026-01-06T13:30:26,507 copying build/lib/unitxt/catalog/templates/text2sql/you_are_given_with_hint_answer_sql_prefix_no_inst.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/templates/text2sql 2026-01-06T13:30:26,509 copying build/lib/unitxt/catalog/templates/text2sql/you_are_given_no_system.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/templates/text2sql 2026-01-06T13:30:26,510 copying build/lib/unitxt/catalog/templates/text2sql/you_are_given_with_hint_with_sql_prefix.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/templates/text2sql 2026-01-06T13:30:26,512 copying build/lib/unitxt/catalog/templates/text2sql/you_are_given_with_hint.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/templates/text2sql 2026-01-06T13:30:26,514 copying build/lib/unitxt/catalog/templates/text2sql/you_are_given_no_system_with_hint.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/templates/text2sql 2026-01-06T13:30:26,516 copying build/lib/unitxt/catalog/templates/text2sql/you_are_given_with_hint_with_out_sql_prefix.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/templates/text2sql 2026-01-06T13:30:26,517 copying build/lib/unitxt/catalog/templates/text2sql/all.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/templates/text2sql 2026-01-06T13:30:26,520 creating build/bdist.linux-armv7l/wheel/unitxt/catalog/templates/safety 2026-01-06T13:30:26,521 copying build/lib/unitxt/catalog/templates/safety/llamaguard.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/templates/safety 2026-01-06T13:30:26,523 copying build/lib/unitxt/catalog/templates/safety/harm_rating.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/templates/safety 2026-01-06T13:30:26,525 creating build/bdist.linux-armv7l/wheel/unitxt/catalog/templates/rag_eval 2026-01-06T13:30:26,527 creating build/bdist.linux-armv7l/wheel/unitxt/catalog/templates/rag_eval/faithfulness 2026-01-06T13:30:26,528 copying build/lib/unitxt/catalog/templates/rag_eval/faithfulness/judge_with_question_full.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/templates/rag_eval/faithfulness 2026-01-06T13:30:26,530 copying build/lib/unitxt/catalog/templates/rag_eval/faithfulness/judge_no_question_simplified_verbal_good_bad.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/templates/rag_eval/faithfulness 2026-01-06T13:30:26,532 copying build/lib/unitxt/catalog/templates/rag_eval/faithfulness/judge_no_question_simplified.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/templates/rag_eval/faithfulness 2026-01-06T13:30:26,534 copying build/lib/unitxt/catalog/templates/rag_eval/faithfulness/judge_with_question_simplified_verbal.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/templates/rag_eval/faithfulness 2026-01-06T13:30:26,536 copying build/lib/unitxt/catalog/templates/rag_eval/faithfulness/judge_with_question_simplified_logprobs.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/templates/rag_eval/faithfulness 2026-01-06T13:30:26,537 copying build/lib/unitxt/catalog/templates/rag_eval/faithfulness/judge_with_question_simplified_verbal_good_bad.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/templates/rag_eval/faithfulness 2026-01-06T13:30:26,539 copying build/lib/unitxt/catalog/templates/rag_eval/faithfulness/judge_with_question_full_logprobs.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/templates/rag_eval/faithfulness 2026-01-06T13:30:26,541 copying build/lib/unitxt/catalog/templates/rag_eval/faithfulness/judge_no_question_full_logprobs.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/templates/rag_eval/faithfulness 2026-01-06T13:30:26,543 copying build/lib/unitxt/catalog/templates/rag_eval/faithfulness/judge_no_question_simplified_explain_logprobs.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/templates/rag_eval/faithfulness 2026-01-06T13:30:26,544 copying build/lib/unitxt/catalog/templates/rag_eval/faithfulness/judge_no_question_simplified_numeric.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/templates/rag_eval/faithfulness 2026-01-06T13:30:26,546 copying build/lib/unitxt/catalog/templates/rag_eval/faithfulness/judge_no_question_full.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/templates/rag_eval/faithfulness 2026-01-06T13:30:26,548 copying build/lib/unitxt/catalog/templates/rag_eval/faithfulness/judge_with_question_simplified.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/templates/rag_eval/faithfulness 2026-01-06T13:30:26,549 copying build/lib/unitxt/catalog/templates/rag_eval/faithfulness/judge_with_question_simplified_numeric.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/templates/rag_eval/faithfulness 2026-01-06T13:30:26,551 copying build/lib/unitxt/catalog/templates/rag_eval/faithfulness/judge_no_question_simplified_logprobs.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/templates/rag_eval/faithfulness 2026-01-06T13:30:26,553 copying build/lib/unitxt/catalog/templates/rag_eval/faithfulness/judge_no_question_simplified_explain.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/templates/rag_eval/faithfulness 2026-01-06T13:30:26,555 copying build/lib/unitxt/catalog/templates/rag_eval/faithfulness/judge_no_question_simplified_verbal.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/templates/rag_eval/faithfulness 2026-01-06T13:30:26,556 copying build/lib/unitxt/catalog/templates/rag_eval/faithfulness/all.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/templates/rag_eval/faithfulness 2026-01-06T13:30:26,558 copying build/lib/unitxt/catalog/templates/rag_eval/faithfulness/metric_template.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/templates/rag_eval/faithfulness 2026-01-06T13:30:26,561 creating build/bdist.linux-armv7l/wheel/unitxt/catalog/templates/rag_eval/correctness_holistic 2026-01-06T13:30:26,562 copying build/lib/unitxt/catalog/templates/rag_eval/correctness_holistic/judge_correctness_explain_first_logprobs.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/templates/rag_eval/correctness_holistic 2026-01-06T13:30:26,563 copying build/lib/unitxt/catalog/templates/rag_eval/correctness_holistic/judge_correctness_simple.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/templates/rag_eval/correctness_holistic 2026-01-06T13:30:26,565 copying build/lib/unitxt/catalog/templates/rag_eval/correctness_holistic/judge_correctness_simple_numeric.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/templates/rag_eval/correctness_holistic 2026-01-06T13:30:26,567 copying build/lib/unitxt/catalog/templates/rag_eval/correctness_holistic/judge_correctness_explain_first.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/templates/rag_eval/correctness_holistic 2026-01-06T13:30:26,569 copying build/lib/unitxt/catalog/templates/rag_eval/correctness_holistic/all.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/templates/rag_eval/correctness_holistic 2026-01-06T13:30:26,571 copying build/lib/unitxt/catalog/templates/rag_eval/correctness_holistic/judge_correctness_simple_logprobs.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/templates/rag_eval/correctness_holistic 2026-01-06T13:30:26,572 copying build/lib/unitxt/catalog/templates/rag_eval/correctness_holistic/metric_template.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/templates/rag_eval/correctness_holistic 2026-01-06T13:30:26,575 creating build/bdist.linux-armv7l/wheel/unitxt/catalog/templates/rag_eval/context_relevance 2026-01-06T13:30:26,576 copying build/lib/unitxt/catalog/templates/rag_eval/context_relevance/judge_context_relevance_ares.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/templates/rag_eval/context_relevance 2026-01-06T13:30:26,577 copying build/lib/unitxt/catalog/templates/rag_eval/context_relevance/judge_context_relevance_ares_numeric.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/templates/rag_eval/context_relevance 2026-01-06T13:30:26,579 copying build/lib/unitxt/catalog/templates/rag_eval/context_relevance/judge_context_relevance_ares_verbal_good_bad.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/templates/rag_eval/context_relevance 2026-01-06T13:30:26,581 copying build/lib/unitxt/catalog/templates/rag_eval/context_relevance/judge_context_relevance.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/templates/rag_eval/context_relevance 2026-01-06T13:30:26,583 copying build/lib/unitxt/catalog/templates/rag_eval/context_relevance/judge_context_relevance_ares_verbal.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/templates/rag_eval/context_relevance 2026-01-06T13:30:26,585 copying build/lib/unitxt/catalog/templates/rag_eval/context_relevance/judge_context_relevance_logprobs.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/templates/rag_eval/context_relevance 2026-01-06T13:30:26,586 copying build/lib/unitxt/catalog/templates/rag_eval/context_relevance/judge_context_relevance_ares_logprobs.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/templates/rag_eval/context_relevance 2026-01-06T13:30:26,588 copying build/lib/unitxt/catalog/templates/rag_eval/context_relevance/all.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/templates/rag_eval/context_relevance 2026-01-06T13:30:26,591 copying build/lib/unitxt/catalog/templates/rag_eval/context_relevance/metric_template.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/templates/rag_eval/context_relevance 2026-01-06T13:30:26,594 creating build/bdist.linux-armv7l/wheel/unitxt/catalog/templates/rag_eval/answer_correctness 2026-01-06T13:30:26,595 copying build/lib/unitxt/catalog/templates/rag_eval/answer_correctness/judge_simplified_no_context.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/templates/rag_eval/answer_correctness 2026-01-06T13:30:26,598 copying build/lib/unitxt/catalog/templates/rag_eval/answer_correctness/judge_loose_match_no_context_verbal_good_bad.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/templates/rag_eval/answer_correctness 2026-01-06T13:30:26,600 copying build/lib/unitxt/catalog/templates/rag_eval/answer_correctness/judge_simplified_with_context.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/templates/rag_eval/answer_correctness 2026-01-06T13:30:26,602 copying build/lib/unitxt/catalog/templates/rag_eval/answer_correctness/judge_simplified_with_context_logprobs.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/templates/rag_eval/answer_correctness 2026-01-06T13:30:26,604 copying build/lib/unitxt/catalog/templates/rag_eval/answer_correctness/judge_instruct_qa_format.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/templates/rag_eval/answer_correctness 2026-01-06T13:30:26,606 copying build/lib/unitxt/catalog/templates/rag_eval/answer_correctness/judge_loose_match_no_context.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/templates/rag_eval/answer_correctness 2026-01-06T13:30:26,609 copying build/lib/unitxt/catalog/templates/rag_eval/answer_correctness/judge_simplified_format_logprobs.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/templates/rag_eval/answer_correctness 2026-01-06T13:30:26,611 copying build/lib/unitxt/catalog/templates/rag_eval/answer_correctness/judge_loose_match_no_context_numeric.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/templates/rag_eval/answer_correctness 2026-01-06T13:30:26,613 copying build/lib/unitxt/catalog/templates/rag_eval/answer_correctness/judge_loose_match_no_context_verbal.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/templates/rag_eval/answer_correctness 2026-01-06T13:30:26,615 copying build/lib/unitxt/catalog/templates/rag_eval/answer_correctness/judge_simplified_no_context_logprobs.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/templates/rag_eval/answer_correctness 2026-01-06T13:30:26,617 copying build/lib/unitxt/catalog/templates/rag_eval/answer_correctness/judge_loose_match_no_context_logprobs.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/templates/rag_eval/answer_correctness 2026-01-06T13:30:26,619 copying build/lib/unitxt/catalog/templates/rag_eval/answer_correctness/judge_instruct_qa_format_logprobs.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/templates/rag_eval/answer_correctness 2026-01-06T13:30:26,621 copying build/lib/unitxt/catalog/templates/rag_eval/answer_correctness/judge_simplified_format.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/templates/rag_eval/answer_correctness 2026-01-06T13:30:26,623 copying build/lib/unitxt/catalog/templates/rag_eval/answer_correctness/all.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/templates/rag_eval/answer_correctness 2026-01-06T13:30:26,624 copying build/lib/unitxt/catalog/templates/rag_eval/answer_correctness/metric_template.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/templates/rag_eval/answer_correctness 2026-01-06T13:30:26,627 creating build/bdist.linux-armv7l/wheel/unitxt/catalog/templates/rag_eval/answer_relevance 2026-01-06T13:30:26,628 copying build/lib/unitxt/catalog/templates/rag_eval/answer_relevance/judge_answer_relevance_logprobs.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/templates/rag_eval/answer_relevance 2026-01-06T13:30:26,630 copying build/lib/unitxt/catalog/templates/rag_eval/answer_relevance/judge_answer_relevance.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/templates/rag_eval/answer_relevance 2026-01-06T13:30:26,632 copying build/lib/unitxt/catalog/templates/rag_eval/answer_relevance/judge_answer_relevance_verbal_good_bad.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/templates/rag_eval/answer_relevance 2026-01-06T13:30:26,635 copying build/lib/unitxt/catalog/templates/rag_eval/answer_relevance/judge_answer_relevance_numeric.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/templates/rag_eval/answer_relevance 2026-01-06T13:30:26,637 copying build/lib/unitxt/catalog/templates/rag_eval/answer_relevance/all.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/templates/rag_eval/answer_relevance 2026-01-06T13:30:26,639 copying build/lib/unitxt/catalog/templates/rag_eval/answer_relevance/metric_template.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/templates/rag_eval/answer_relevance 2026-01-06T13:30:26,642 creating build/bdist.linux-armv7l/wheel/unitxt/catalog/templates/classification 2026-01-06T13:30:26,644 creating build/bdist.linux-armv7l/wheel/unitxt/catalog/templates/classification/multi_class 2026-01-06T13:30:26,646 creating build/bdist.linux-armv7l/wheel/unitxt/catalog/templates/classification/multi_class/relation 2026-01-06T13:30:26,648 creating build/bdist.linux-armv7l/wheel/unitxt/catalog/templates/classification/multi_class/relation/truthfulness 2026-01-06T13:30:26,650 copying build/lib/unitxt/catalog/templates/classification/multi_class/relation/truthfulness/flan_1.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/templates/classification/multi_class/relation/truthfulness 2026-01-06T13:30:26,652 copying build/lib/unitxt/catalog/templates/classification/multi_class/relation/truthfulness/flan_4.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/templates/classification/multi_class/relation/truthfulness 2026-01-06T13:30:26,654 copying build/lib/unitxt/catalog/templates/classification/multi_class/relation/truthfulness/flan_5.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/templates/classification/multi_class/relation/truthfulness 2026-01-06T13:30:26,656 copying build/lib/unitxt/catalog/templates/classification/multi_class/relation/truthfulness/flan_3.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/templates/classification/multi_class/relation/truthfulness 2026-01-06T13:30:26,659 copying build/lib/unitxt/catalog/templates/classification/multi_class/relation/truthfulness/flan_2.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/templates/classification/multi_class/relation/truthfulness 2026-01-06T13:30:26,661 copying build/lib/unitxt/catalog/templates/classification/multi_class/relation/truthfulness/flan_6.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/templates/classification/multi_class/relation/truthfulness 2026-01-06T13:30:26,663 copying build/lib/unitxt/catalog/templates/classification/multi_class/relation/truthfulness/all.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/templates/classification/multi_class/relation/truthfulness 2026-01-06T13:30:26,665 copying build/lib/unitxt/catalog/templates/classification/multi_class/relation/truthfulness/flan_7.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/templates/classification/multi_class/relation/truthfulness 2026-01-06T13:30:26,668 copying build/lib/unitxt/catalog/templates/classification/multi_class/relation/simple.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/templates/classification/multi_class/relation 2026-01-06T13:30:26,670 copying build/lib/unitxt/catalog/templates/classification/multi_class/relation/default.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/templates/classification/multi_class/relation 2026-01-06T13:30:26,672 copying build/lib/unitxt/catalog/templates/classification/multi_class/relation/all.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/templates/classification/multi_class/relation 2026-01-06T13:30:26,675 copying build/lib/unitxt/catalog/templates/classification/multi_class/empty.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/templates/classification/multi_class 2026-01-06T13:30:26,677 copying build/lib/unitxt/catalog/templates/classification/multi_class/instruct_question_selects.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/templates/classification/multi_class 2026-01-06T13:30:26,679 copying build/lib/unitxt/catalog/templates/classification/multi_class/instruct_question_select_i_think.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/templates/classification/multi_class 2026-01-06T13:30:26,681 copying build/lib/unitxt/catalog/templates/classification/multi_class/bluebench.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/templates/classification/multi_class 2026-01-06T13:30:26,684 copying build/lib/unitxt/catalog/templates/classification/multi_class/default.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/templates/classification/multi_class 2026-01-06T13:30:26,686 copying build/lib/unitxt/catalog/templates/classification/multi_class/instruction.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/templates/classification/multi_class 2026-01-06T13:30:26,688 copying build/lib/unitxt/catalog/templates/classification/multi_class/title.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/templates/classification/multi_class 2026-01-06T13:30:26,690 copying build/lib/unitxt/catalog/templates/classification/multi_class/instruct_select_question.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/templates/classification/multi_class 2026-01-06T13:30:26,693 copying build/lib/unitxt/catalog/templates/classification/multi_class/all.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/templates/classification/multi_class 2026-01-06T13:30:26,696 creating build/bdist.linux-armv7l/wheel/unitxt/catalog/templates/classification/multi_label 2026-01-06T13:30:26,697 copying build/lib/unitxt/catalog/templates/classification/multi_label/empty.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/templates/classification/multi_label 2026-01-06T13:30:26,699 copying build/lib/unitxt/catalog/templates/classification/multi_label/default.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/templates/classification/multi_label 2026-01-06T13:30:26,701 copying build/lib/unitxt/catalog/templates/classification/multi_label/instruction.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/templates/classification/multi_label 2026-01-06T13:30:26,702 copying build/lib/unitxt/catalog/templates/classification/multi_label/title.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/templates/classification/multi_label 2026-01-06T13:30:26,704 copying build/lib/unitxt/catalog/templates/classification/multi_label/all.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/templates/classification/multi_label 2026-01-06T13:30:26,706 creating build/bdist.linux-armv7l/wheel/unitxt/catalog/templates/key_value_extraction 2026-01-06T13:30:26,707 copying build/lib/unitxt/catalog/templates/key_value_extraction/extract_in_json_format.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/templates/key_value_extraction 2026-01-06T13:30:26,710 creating build/bdist.linux-armv7l/wheel/unitxt/catalog/templates/rewriting 2026-01-06T13:30:26,711 creating build/bdist.linux-armv7l/wheel/unitxt/catalog/templates/rewriting/paraphrase 2026-01-06T13:30:26,712 copying build/lib/unitxt/catalog/templates/rewriting/paraphrase/default.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/templates/rewriting/paraphrase 2026-01-06T13:30:26,714 copying build/lib/unitxt/catalog/templates/rewriting/paraphrase/all.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/templates/rewriting/paraphrase 2026-01-06T13:30:26,716 creating build/bdist.linux-armv7l/wheel/unitxt/catalog/templates/rewriting/by_attribute 2026-01-06T13:30:26,717 copying build/lib/unitxt/catalog/templates/rewriting/by_attribute/default.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/templates/rewriting/by_attribute 2026-01-06T13:30:26,719 copying build/lib/unitxt/catalog/templates/rewriting/by_attribute/all.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/templates/rewriting/by_attribute 2026-01-06T13:30:26,721 creating build/bdist.linux-armv7l/wheel/unitxt/catalog/templates/rag 2026-01-06T13:30:26,723 creating build/bdist.linux-armv7l/wheel/unitxt/catalog/templates/rag/response_generation 2026-01-06T13:30:26,724 copying build/lib/unitxt/catalog/templates/rag/response_generation/please_respond_chat.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/templates/rag/response_generation 2026-01-06T13:30:26,726 copying build/lib/unitxt/catalog/templates/rag/response_generation/answer_based_on_context_inverted.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/templates/rag/response_generation 2026-01-06T13:30:26,728 copying build/lib/unitxt/catalog/templates/rag/response_generation/bluebench.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/templates/rag/response_generation 2026-01-06T13:30:26,730 copying build/lib/unitxt/catalog/templates/rag/response_generation/answer_based_on_context.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/templates/rag/response_generation 2026-01-06T13:30:26,731 copying build/lib/unitxt/catalog/templates/rag/response_generation/please_respond.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/templates/rag/response_generation 2026-01-06T13:30:26,734 creating build/bdist.linux-armv7l/wheel/unitxt/catalog/templates/rag/end_to_end 2026-01-06T13:30:26,735 copying build/lib/unitxt/catalog/templates/rag/end_to_end/json_predictions.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/templates/rag/end_to_end 2026-01-06T13:30:26,737 creating build/bdist.linux-armv7l/wheel/unitxt/catalog/templates/span_labeling 2026-01-06T13:30:26,739 creating build/bdist.linux-armv7l/wheel/unitxt/catalog/templates/span_labeling/extraction 2026-01-06T13:30:26,740 copying build/lib/unitxt/catalog/templates/span_labeling/extraction/empty.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/templates/span_labeling/extraction 2026-01-06T13:30:26,742 copying build/lib/unitxt/catalog/templates/span_labeling/extraction/extract.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/templates/span_labeling/extraction 2026-01-06T13:30:26,744 copying build/lib/unitxt/catalog/templates/span_labeling/extraction/having.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/templates/span_labeling/extraction 2026-01-06T13:30:26,745 copying build/lib/unitxt/catalog/templates/span_labeling/extraction/identify.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/templates/span_labeling/extraction 2026-01-06T13:30:26,747 copying build/lib/unitxt/catalog/templates/span_labeling/extraction/title.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/templates/span_labeling/extraction 2026-01-06T13:30:26,749 copying build/lib/unitxt/catalog/templates/span_labeling/extraction/carry.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/templates/span_labeling/extraction 2026-01-06T13:30:26,750 copying build/lib/unitxt/catalog/templates/span_labeling/extraction/detailed.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/templates/span_labeling/extraction 2026-01-06T13:30:26,752 copying build/lib/unitxt/catalog/templates/span_labeling/extraction/all.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/templates/span_labeling/extraction 2026-01-06T13:30:26,754 creating build/bdist.linux-armv7l/wheel/unitxt/catalog/templates/evaluation 2026-01-06T13:30:26,756 creating build/bdist.linux-armv7l/wheel/unitxt/catalog/templates/evaluation/preference 2026-01-06T13:30:26,757 copying build/lib/unitxt/catalog/templates/evaluation/preference/default.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/templates/evaluation/preference 2026-01-06T13:30:26,759 copying build/lib/unitxt/catalog/templates/evaluation/preference/all.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/templates/evaluation/preference 2026-01-06T13:30:26,761 creating build/bdist.linux-armv7l/wheel/unitxt/catalog/templates/language_identification 2026-01-06T13:30:26,762 copying build/lib/unitxt/catalog/templates/language_identification/simple.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/templates/language_identification 2026-01-06T13:30:26,764 copying build/lib/unitxt/catalog/templates/language_identification/all.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/templates/language_identification 2026-01-06T13:30:26,766 creating build/bdist.linux-armv7l/wheel/unitxt/catalog/recipes 2026-01-06T13:30:26,768 creating build/bdist.linux-armv7l/wheel/unitxt/catalog/recipes/torr 2026-01-06T13:30:26,770 creating build/bdist.linux-armv7l/wheel/unitxt/catalog/recipes/torr/wikitq 2026-01-06T13:30:26,771 creating build/bdist.linux-armv7l/wheel/unitxt/catalog/recipes/torr/wikitq/df 2026-01-06T13:30:26,773 copying build/lib/unitxt/catalog/recipes/torr/wikitq/df/transpose_augmentation_1_demos.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/recipes/torr/wikitq/df 2026-01-06T13:30:26,775 copying build/lib/unitxt/catalog/recipes/torr/wikitq/df/shuffle_cols_augmentation_1_demos.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/recipes/torr/wikitq/df 2026-01-06T13:30:26,776 copying build/lib/unitxt/catalog/recipes/torr/wikitq/df/insert_empty_rows_augmentation_1_demos.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/recipes/torr/wikitq/df 2026-01-06T13:30:26,778 copying build/lib/unitxt/catalog/recipes/torr/wikitq/df/no_augmentation_1_demos.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/recipes/torr/wikitq/df 2026-01-06T13:30:26,780 copying build/lib/unitxt/catalog/recipes/torr/wikitq/df/shuffle_rows_augmentation_1_demos.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/recipes/torr/wikitq/df 2026-01-06T13:30:26,782 creating build/bdist.linux-armv7l/wheel/unitxt/catalog/recipes/torr/wikitq/csv 2026-01-06T13:30:26,783 copying build/lib/unitxt/catalog/recipes/torr/wikitq/csv/transpose_augmentation_1_demos.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/recipes/torr/wikitq/csv 2026-01-06T13:30:26,790 copying build/lib/unitxt/catalog/recipes/torr/wikitq/csv/shuffle_cols_augmentation_1_demos.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/recipes/torr/wikitq/csv 2026-01-06T13:30:26,792 copying build/lib/unitxt/catalog/recipes/torr/wikitq/csv/insert_empty_rows_augmentation_1_demos.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/recipes/torr/wikitq/csv 2026-01-06T13:30:26,793 copying build/lib/unitxt/catalog/recipes/torr/wikitq/csv/no_augmentation_1_demos.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/recipes/torr/wikitq/csv 2026-01-06T13:30:26,795 copying build/lib/unitxt/catalog/recipes/torr/wikitq/csv/shuffle_rows_augmentation_1_demos.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/recipes/torr/wikitq/csv 2026-01-06T13:30:26,797 creating build/bdist.linux-armv7l/wheel/unitxt/catalog/recipes/torr/wikitq/concat 2026-01-06T13:30:26,798 copying build/lib/unitxt/catalog/recipes/torr/wikitq/concat/transpose_augmentation_1_demos.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/recipes/torr/wikitq/concat 2026-01-06T13:30:26,800 copying build/lib/unitxt/catalog/recipes/torr/wikitq/concat/shuffle_cols_augmentation_1_demos.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/recipes/torr/wikitq/concat 2026-01-06T13:30:26,802 copying build/lib/unitxt/catalog/recipes/torr/wikitq/concat/insert_empty_rows_augmentation_1_demos.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/recipes/torr/wikitq/concat 2026-01-06T13:30:26,804 copying build/lib/unitxt/catalog/recipes/torr/wikitq/concat/no_augmentation_1_demos.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/recipes/torr/wikitq/concat 2026-01-06T13:30:26,806 copying build/lib/unitxt/catalog/recipes/torr/wikitq/concat/shuffle_rows_augmentation_1_demos.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/recipes/torr/wikitq/concat 2026-01-06T13:30:26,808 creating build/bdist.linux-armv7l/wheel/unitxt/catalog/recipes/torr/wikitq/html 2026-01-06T13:30:26,809 copying build/lib/unitxt/catalog/recipes/torr/wikitq/html/transpose_augmentation_1_demos.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/recipes/torr/wikitq/html 2026-01-06T13:30:26,811 copying build/lib/unitxt/catalog/recipes/torr/wikitq/html/shuffle_cols_augmentation_1_demos.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/recipes/torr/wikitq/html 2026-01-06T13:30:26,813 copying build/lib/unitxt/catalog/recipes/torr/wikitq/html/insert_empty_rows_augmentation_1_demos.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/recipes/torr/wikitq/html 2026-01-06T13:30:26,814 copying build/lib/unitxt/catalog/recipes/torr/wikitq/html/no_augmentation_1_demos.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/recipes/torr/wikitq/html 2026-01-06T13:30:26,816 copying build/lib/unitxt/catalog/recipes/torr/wikitq/html/shuffle_rows_augmentation_1_demos.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/recipes/torr/wikitq/html 2026-01-06T13:30:26,819 creating build/bdist.linux-armv7l/wheel/unitxt/catalog/recipes/torr/wikitq/json 2026-01-06T13:30:26,820 copying build/lib/unitxt/catalog/recipes/torr/wikitq/json/transpose_augmentation_1_demos.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/recipes/torr/wikitq/json 2026-01-06T13:30:26,822 copying build/lib/unitxt/catalog/recipes/torr/wikitq/json/shuffle_cols_augmentation_1_demos.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/recipes/torr/wikitq/json 2026-01-06T13:30:26,824 copying build/lib/unitxt/catalog/recipes/torr/wikitq/json/insert_empty_rows_augmentation_1_demos.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/recipes/torr/wikitq/json 2026-01-06T13:30:26,826 copying build/lib/unitxt/catalog/recipes/torr/wikitq/json/no_augmentation_1_demos.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/recipes/torr/wikitq/json 2026-01-06T13:30:26,828 copying build/lib/unitxt/catalog/recipes/torr/wikitq/json/shuffle_rows_augmentation_1_demos.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/recipes/torr/wikitq/json 2026-01-06T13:30:26,830 creating build/bdist.linux-armv7l/wheel/unitxt/catalog/recipes/torr/wikitq/markdown 2026-01-06T13:30:26,831 copying build/lib/unitxt/catalog/recipes/torr/wikitq/markdown/transpose_augmentation_1_demos.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/recipes/torr/wikitq/markdown 2026-01-06T13:30:26,833 copying build/lib/unitxt/catalog/recipes/torr/wikitq/markdown/shuffle_cols_augmentation_1_demos.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/recipes/torr/wikitq/markdown 2026-01-06T13:30:26,834 copying build/lib/unitxt/catalog/recipes/torr/wikitq/markdown/insert_empty_rows_augmentation_1_demos.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/recipes/torr/wikitq/markdown 2026-01-06T13:30:26,836 copying build/lib/unitxt/catalog/recipes/torr/wikitq/markdown/no_augmentation_1_demos.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/recipes/torr/wikitq/markdown 2026-01-06T13:30:26,838 copying build/lib/unitxt/catalog/recipes/torr/wikitq/markdown/shuffle_rows_augmentation_1_demos.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/recipes/torr/wikitq/markdown 2026-01-06T13:30:26,840 creating build/bdist.linux-armv7l/wheel/unitxt/catalog/recipes/torr/wikitq/indexed_row_major 2026-01-06T13:30:26,841 copying build/lib/unitxt/catalog/recipes/torr/wikitq/indexed_row_major/transpose_augmentation_1_demos.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/recipes/torr/wikitq/indexed_row_major 2026-01-06T13:30:26,843 copying build/lib/unitxt/catalog/recipes/torr/wikitq/indexed_row_major/shuffle_cols_augmentation_1_demos.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/recipes/torr/wikitq/indexed_row_major 2026-01-06T13:30:26,845 copying build/lib/unitxt/catalog/recipes/torr/wikitq/indexed_row_major/insert_empty_rows_augmentation_1_demos.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/recipes/torr/wikitq/indexed_row_major 2026-01-06T13:30:26,847 copying build/lib/unitxt/catalog/recipes/torr/wikitq/indexed_row_major/no_augmentation_1_demos.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/recipes/torr/wikitq/indexed_row_major 2026-01-06T13:30:26,849 copying build/lib/unitxt/catalog/recipes/torr/wikitq/indexed_row_major/shuffle_rows_augmentation_1_demos.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/recipes/torr/wikitq/indexed_row_major 2026-01-06T13:30:26,852 creating build/bdist.linux-armv7l/wheel/unitxt/catalog/recipes/torr/tablebench_fact_checking 2026-01-06T13:30:26,853 creating build/bdist.linux-armv7l/wheel/unitxt/catalog/recipes/torr/tablebench_fact_checking/df 2026-01-06T13:30:26,854 copying build/lib/unitxt/catalog/recipes/torr/tablebench_fact_checking/df/shuffle_rows_augmentation_5_demos.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/recipes/torr/tablebench_fact_checking/df 2026-01-06T13:30:26,856 copying build/lib/unitxt/catalog/recipes/torr/tablebench_fact_checking/df/no_augmentation_5_demos.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/recipes/torr/tablebench_fact_checking/df 2026-01-06T13:30:26,858 copying build/lib/unitxt/catalog/recipes/torr/tablebench_fact_checking/df/insert_empty_rows_augmentation_5_demos.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/recipes/torr/tablebench_fact_checking/df 2026-01-06T13:30:26,860 copying build/lib/unitxt/catalog/recipes/torr/tablebench_fact_checking/df/transpose_augmentation_5_demos.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/recipes/torr/tablebench_fact_checking/df 2026-01-06T13:30:26,862 copying build/lib/unitxt/catalog/recipes/torr/tablebench_fact_checking/df/shuffle_cols_augmentation_5_demos.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/recipes/torr/tablebench_fact_checking/df 2026-01-06T13:30:26,864 creating build/bdist.linux-armv7l/wheel/unitxt/catalog/recipes/torr/tablebench_fact_checking/csv 2026-01-06T13:30:26,865 copying build/lib/unitxt/catalog/recipes/torr/tablebench_fact_checking/csv/shuffle_rows_augmentation_5_demos.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/recipes/torr/tablebench_fact_checking/csv 2026-01-06T13:30:26,867 copying build/lib/unitxt/catalog/recipes/torr/tablebench_fact_checking/csv/no_augmentation_5_demos.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/recipes/torr/tablebench_fact_checking/csv 2026-01-06T13:30:26,869 copying build/lib/unitxt/catalog/recipes/torr/tablebench_fact_checking/csv/insert_empty_rows_augmentation_5_demos.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/recipes/torr/tablebench_fact_checking/csv 2026-01-06T13:30:26,871 copying build/lib/unitxt/catalog/recipes/torr/tablebench_fact_checking/csv/transpose_augmentation_5_demos.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/recipes/torr/tablebench_fact_checking/csv 2026-01-06T13:30:26,872 copying build/lib/unitxt/catalog/recipes/torr/tablebench_fact_checking/csv/shuffle_cols_augmentation_5_demos.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/recipes/torr/tablebench_fact_checking/csv 2026-01-06T13:30:26,875 creating build/bdist.linux-armv7l/wheel/unitxt/catalog/recipes/torr/tablebench_fact_checking/concat 2026-01-06T13:30:26,876 copying build/lib/unitxt/catalog/recipes/torr/tablebench_fact_checking/concat/shuffle_rows_augmentation_5_demos.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/recipes/torr/tablebench_fact_checking/concat 2026-01-06T13:30:26,878 copying build/lib/unitxt/catalog/recipes/torr/tablebench_fact_checking/concat/no_augmentation_5_demos.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/recipes/torr/tablebench_fact_checking/concat 2026-01-06T13:30:26,879 copying build/lib/unitxt/catalog/recipes/torr/tablebench_fact_checking/concat/insert_empty_rows_augmentation_5_demos.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/recipes/torr/tablebench_fact_checking/concat 2026-01-06T13:30:26,881 copying build/lib/unitxt/catalog/recipes/torr/tablebench_fact_checking/concat/transpose_augmentation_5_demos.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/recipes/torr/tablebench_fact_checking/concat 2026-01-06T13:30:26,883 copying build/lib/unitxt/catalog/recipes/torr/tablebench_fact_checking/concat/shuffle_cols_augmentation_5_demos.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/recipes/torr/tablebench_fact_checking/concat 2026-01-06T13:30:26,886 creating build/bdist.linux-armv7l/wheel/unitxt/catalog/recipes/torr/tablebench_fact_checking/html 2026-01-06T13:30:26,887 copying build/lib/unitxt/catalog/recipes/torr/tablebench_fact_checking/html/shuffle_rows_augmentation_5_demos.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/recipes/torr/tablebench_fact_checking/html 2026-01-06T13:30:26,889 copying build/lib/unitxt/catalog/recipes/torr/tablebench_fact_checking/html/no_augmentation_5_demos.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/recipes/torr/tablebench_fact_checking/html 2026-01-06T13:30:26,890 copying build/lib/unitxt/catalog/recipes/torr/tablebench_fact_checking/html/insert_empty_rows_augmentation_5_demos.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/recipes/torr/tablebench_fact_checking/html 2026-01-06T13:30:26,892 copying build/lib/unitxt/catalog/recipes/torr/tablebench_fact_checking/html/transpose_augmentation_5_demos.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/recipes/torr/tablebench_fact_checking/html 2026-01-06T13:30:26,894 copying build/lib/unitxt/catalog/recipes/torr/tablebench_fact_checking/html/shuffle_cols_augmentation_5_demos.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/recipes/torr/tablebench_fact_checking/html 2026-01-06T13:30:26,896 creating build/bdist.linux-armv7l/wheel/unitxt/catalog/recipes/torr/tablebench_fact_checking/json 2026-01-06T13:30:26,897 copying build/lib/unitxt/catalog/recipes/torr/tablebench_fact_checking/json/shuffle_rows_augmentation_5_demos.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/recipes/torr/tablebench_fact_checking/json 2026-01-06T13:30:26,899 copying build/lib/unitxt/catalog/recipes/torr/tablebench_fact_checking/json/no_augmentation_5_demos.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/recipes/torr/tablebench_fact_checking/json 2026-01-06T13:30:26,901 copying build/lib/unitxt/catalog/recipes/torr/tablebench_fact_checking/json/insert_empty_rows_augmentation_5_demos.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/recipes/torr/tablebench_fact_checking/json 2026-01-06T13:30:26,903 copying build/lib/unitxt/catalog/recipes/torr/tablebench_fact_checking/json/transpose_augmentation_5_demos.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/recipes/torr/tablebench_fact_checking/json 2026-01-06T13:30:26,905 copying build/lib/unitxt/catalog/recipes/torr/tablebench_fact_checking/json/shuffle_cols_augmentation_5_demos.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/recipes/torr/tablebench_fact_checking/json 2026-01-06T13:30:26,907 creating build/bdist.linux-armv7l/wheel/unitxt/catalog/recipes/torr/tablebench_fact_checking/markdown 2026-01-06T13:30:26,908 copying build/lib/unitxt/catalog/recipes/torr/tablebench_fact_checking/markdown/shuffle_rows_augmentation_5_demos.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/recipes/torr/tablebench_fact_checking/markdown 2026-01-06T13:30:26,910 copying build/lib/unitxt/catalog/recipes/torr/tablebench_fact_checking/markdown/no_augmentation_5_demos.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/recipes/torr/tablebench_fact_checking/markdown 2026-01-06T13:30:26,912 copying build/lib/unitxt/catalog/recipes/torr/tablebench_fact_checking/markdown/insert_empty_rows_augmentation_5_demos.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/recipes/torr/tablebench_fact_checking/markdown 2026-01-06T13:30:26,913 copying build/lib/unitxt/catalog/recipes/torr/tablebench_fact_checking/markdown/transpose_augmentation_5_demos.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/recipes/torr/tablebench_fact_checking/markdown 2026-01-06T13:30:26,915 copying build/lib/unitxt/catalog/recipes/torr/tablebench_fact_checking/markdown/shuffle_cols_augmentation_5_demos.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/recipes/torr/tablebench_fact_checking/markdown 2026-01-06T13:30:26,917 creating build/bdist.linux-armv7l/wheel/unitxt/catalog/recipes/torr/tablebench_fact_checking/indexed_row_major 2026-01-06T13:30:26,918 copying build/lib/unitxt/catalog/recipes/torr/tablebench_fact_checking/indexed_row_major/shuffle_rows_augmentation_5_demos.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/recipes/torr/tablebench_fact_checking/indexed_row_major 2026-01-06T13:30:26,920 copying build/lib/unitxt/catalog/recipes/torr/tablebench_fact_checking/indexed_row_major/no_augmentation_5_demos.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/recipes/torr/tablebench_fact_checking/indexed_row_major 2026-01-06T13:30:26,922 copying build/lib/unitxt/catalog/recipes/torr/tablebench_fact_checking/indexed_row_major/insert_empty_rows_augmentation_5_demos.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/recipes/torr/tablebench_fact_checking/indexed_row_major 2026-01-06T13:30:26,924 copying build/lib/unitxt/catalog/recipes/torr/tablebench_fact_checking/indexed_row_major/transpose_augmentation_5_demos.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/recipes/torr/tablebench_fact_checking/indexed_row_major 2026-01-06T13:30:26,926 copying build/lib/unitxt/catalog/recipes/torr/tablebench_fact_checking/indexed_row_major/shuffle_cols_augmentation_5_demos.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/recipes/torr/tablebench_fact_checking/indexed_row_major 2026-01-06T13:30:26,928 creating build/bdist.linux-armv7l/wheel/unitxt/catalog/recipes/torr/qtsumm 2026-01-06T13:30:26,930 creating build/bdist.linux-armv7l/wheel/unitxt/catalog/recipes/torr/qtsumm/df 2026-01-06T13:30:26,931 copying build/lib/unitxt/catalog/recipes/torr/qtsumm/df/shuffle_rows_augmentation_5_demos.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/recipes/torr/qtsumm/df 2026-01-06T13:30:26,933 copying build/lib/unitxt/catalog/recipes/torr/qtsumm/df/no_augmentation_5_demos.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/recipes/torr/qtsumm/df 2026-01-06T13:30:26,935 copying build/lib/unitxt/catalog/recipes/torr/qtsumm/df/insert_empty_rows_augmentation_5_demos.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/recipes/torr/qtsumm/df 2026-01-06T13:30:26,937 copying build/lib/unitxt/catalog/recipes/torr/qtsumm/df/transpose_augmentation_5_demos.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/recipes/torr/qtsumm/df 2026-01-06T13:30:26,938 copying build/lib/unitxt/catalog/recipes/torr/qtsumm/df/shuffle_cols_augmentation_5_demos.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/recipes/torr/qtsumm/df 2026-01-06T13:30:26,940 creating build/bdist.linux-armv7l/wheel/unitxt/catalog/recipes/torr/qtsumm/csv 2026-01-06T13:30:26,941 copying build/lib/unitxt/catalog/recipes/torr/qtsumm/csv/shuffle_rows_augmentation_5_demos.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/recipes/torr/qtsumm/csv 2026-01-06T13:30:26,943 copying build/lib/unitxt/catalog/recipes/torr/qtsumm/csv/no_augmentation_5_demos.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/recipes/torr/qtsumm/csv 2026-01-06T13:30:26,945 copying build/lib/unitxt/catalog/recipes/torr/qtsumm/csv/insert_empty_rows_augmentation_5_demos.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/recipes/torr/qtsumm/csv 2026-01-06T13:30:26,947 copying build/lib/unitxt/catalog/recipes/torr/qtsumm/csv/transpose_augmentation_5_demos.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/recipes/torr/qtsumm/csv 2026-01-06T13:30:26,949 copying build/lib/unitxt/catalog/recipes/torr/qtsumm/csv/shuffle_cols_augmentation_5_demos.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/recipes/torr/qtsumm/csv 2026-01-06T13:30:26,951 creating build/bdist.linux-armv7l/wheel/unitxt/catalog/recipes/torr/qtsumm/concat 2026-01-06T13:30:26,952 copying build/lib/unitxt/catalog/recipes/torr/qtsumm/concat/shuffle_rows_augmentation_5_demos.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/recipes/torr/qtsumm/concat 2026-01-06T13:30:26,954 copying build/lib/unitxt/catalog/recipes/torr/qtsumm/concat/no_augmentation_5_demos.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/recipes/torr/qtsumm/concat 2026-01-06T13:30:26,956 copying build/lib/unitxt/catalog/recipes/torr/qtsumm/concat/insert_empty_rows_augmentation_5_demos.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/recipes/torr/qtsumm/concat 2026-01-06T13:30:26,958 copying build/lib/unitxt/catalog/recipes/torr/qtsumm/concat/transpose_augmentation_5_demos.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/recipes/torr/qtsumm/concat 2026-01-06T13:30:26,960 copying build/lib/unitxt/catalog/recipes/torr/qtsumm/concat/shuffle_cols_augmentation_5_demos.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/recipes/torr/qtsumm/concat 2026-01-06T13:30:26,962 creating build/bdist.linux-armv7l/wheel/unitxt/catalog/recipes/torr/qtsumm/html 2026-01-06T13:30:26,963 copying build/lib/unitxt/catalog/recipes/torr/qtsumm/html/shuffle_rows_augmentation_5_demos.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/recipes/torr/qtsumm/html 2026-01-06T13:30:26,965 copying build/lib/unitxt/catalog/recipes/torr/qtsumm/html/no_augmentation_5_demos.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/recipes/torr/qtsumm/html 2026-01-06T13:30:26,967 copying build/lib/unitxt/catalog/recipes/torr/qtsumm/html/insert_empty_rows_augmentation_5_demos.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/recipes/torr/qtsumm/html 2026-01-06T13:30:26,969 copying build/lib/unitxt/catalog/recipes/torr/qtsumm/html/transpose_augmentation_5_demos.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/recipes/torr/qtsumm/html 2026-01-06T13:30:26,970 copying build/lib/unitxt/catalog/recipes/torr/qtsumm/html/shuffle_cols_augmentation_5_demos.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/recipes/torr/qtsumm/html 2026-01-06T13:30:26,973 creating build/bdist.linux-armv7l/wheel/unitxt/catalog/recipes/torr/qtsumm/json 2026-01-06T13:30:26,973 copying build/lib/unitxt/catalog/recipes/torr/qtsumm/json/shuffle_rows_augmentation_5_demos.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/recipes/torr/qtsumm/json 2026-01-06T13:30:26,975 copying build/lib/unitxt/catalog/recipes/torr/qtsumm/json/no_augmentation_5_demos.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/recipes/torr/qtsumm/json 2026-01-06T13:30:26,977 copying build/lib/unitxt/catalog/recipes/torr/qtsumm/json/insert_empty_rows_augmentation_5_demos.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/recipes/torr/qtsumm/json 2026-01-06T13:30:26,979 copying build/lib/unitxt/catalog/recipes/torr/qtsumm/json/transpose_augmentation_5_demos.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/recipes/torr/qtsumm/json 2026-01-06T13:30:26,981 copying build/lib/unitxt/catalog/recipes/torr/qtsumm/json/shuffle_cols_augmentation_5_demos.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/recipes/torr/qtsumm/json 2026-01-06T13:30:26,983 creating build/bdist.linux-armv7l/wheel/unitxt/catalog/recipes/torr/qtsumm/markdown 2026-01-06T13:30:26,984 copying build/lib/unitxt/catalog/recipes/torr/qtsumm/markdown/shuffle_rows_augmentation_5_demos.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/recipes/torr/qtsumm/markdown 2026-01-06T13:30:26,986 copying build/lib/unitxt/catalog/recipes/torr/qtsumm/markdown/no_augmentation_5_demos.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/recipes/torr/qtsumm/markdown 2026-01-06T13:30:26,988 copying build/lib/unitxt/catalog/recipes/torr/qtsumm/markdown/insert_empty_rows_augmentation_5_demos.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/recipes/torr/qtsumm/markdown 2026-01-06T13:30:26,989 copying build/lib/unitxt/catalog/recipes/torr/qtsumm/markdown/transpose_augmentation_5_demos.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/recipes/torr/qtsumm/markdown 2026-01-06T13:30:26,991 copying build/lib/unitxt/catalog/recipes/torr/qtsumm/markdown/shuffle_cols_augmentation_5_demos.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/recipes/torr/qtsumm/markdown 2026-01-06T13:30:26,993 creating build/bdist.linux-armv7l/wheel/unitxt/catalog/recipes/torr/qtsumm/indexed_row_major 2026-01-06T13:30:26,995 copying build/lib/unitxt/catalog/recipes/torr/qtsumm/indexed_row_major/shuffle_rows_augmentation_5_demos.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/recipes/torr/qtsumm/indexed_row_major 2026-01-06T13:30:26,996 copying build/lib/unitxt/catalog/recipes/torr/qtsumm/indexed_row_major/no_augmentation_5_demos.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/recipes/torr/qtsumm/indexed_row_major 2026-01-06T13:30:26,998 copying build/lib/unitxt/catalog/recipes/torr/qtsumm/indexed_row_major/insert_empty_rows_augmentation_5_demos.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/recipes/torr/qtsumm/indexed_row_major 2026-01-06T13:30:27,000 copying build/lib/unitxt/catalog/recipes/torr/qtsumm/indexed_row_major/transpose_augmentation_5_demos.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/recipes/torr/qtsumm/indexed_row_major 2026-01-06T13:30:27,002 copying build/lib/unitxt/catalog/recipes/torr/qtsumm/indexed_row_major/shuffle_cols_augmentation_5_demos.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/recipes/torr/qtsumm/indexed_row_major 2026-01-06T13:30:27,004 creating build/bdist.linux-armv7l/wheel/unitxt/catalog/recipes/torr/tablebench_numerical_reasoning 2026-01-06T13:30:27,006 creating build/bdist.linux-armv7l/wheel/unitxt/catalog/recipes/torr/tablebench_numerical_reasoning/df 2026-01-06T13:30:27,007 copying build/lib/unitxt/catalog/recipes/torr/tablebench_numerical_reasoning/df/shuffle_rows_augmentation_5_demos.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/recipes/torr/tablebench_numerical_reasoning/df 2026-01-06T13:30:27,009 copying build/lib/unitxt/catalog/recipes/torr/tablebench_numerical_reasoning/df/no_augmentation_5_demos.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/recipes/torr/tablebench_numerical_reasoning/df 2026-01-06T13:30:27,011 copying build/lib/unitxt/catalog/recipes/torr/tablebench_numerical_reasoning/df/insert_empty_rows_augmentation_5_demos.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/recipes/torr/tablebench_numerical_reasoning/df 2026-01-06T13:30:27,012 copying build/lib/unitxt/catalog/recipes/torr/tablebench_numerical_reasoning/df/transpose_augmentation_5_demos.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/recipes/torr/tablebench_numerical_reasoning/df 2026-01-06T13:30:27,014 copying build/lib/unitxt/catalog/recipes/torr/tablebench_numerical_reasoning/df/shuffle_cols_augmentation_5_demos.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/recipes/torr/tablebench_numerical_reasoning/df 2026-01-06T13:30:27,016 creating build/bdist.linux-armv7l/wheel/unitxt/catalog/recipes/torr/tablebench_numerical_reasoning/csv 2026-01-06T13:30:27,017 copying build/lib/unitxt/catalog/recipes/torr/tablebench_numerical_reasoning/csv/shuffle_rows_augmentation_5_demos.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/recipes/torr/tablebench_numerical_reasoning/csv 2026-01-06T13:30:27,019 copying build/lib/unitxt/catalog/recipes/torr/tablebench_numerical_reasoning/csv/no_augmentation_5_demos.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/recipes/torr/tablebench_numerical_reasoning/csv 2026-01-06T13:30:27,021 copying build/lib/unitxt/catalog/recipes/torr/tablebench_numerical_reasoning/csv/insert_empty_rows_augmentation_5_demos.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/recipes/torr/tablebench_numerical_reasoning/csv 2026-01-06T13:30:27,023 copying build/lib/unitxt/catalog/recipes/torr/tablebench_numerical_reasoning/csv/transpose_augmentation_5_demos.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/recipes/torr/tablebench_numerical_reasoning/csv 2026-01-06T13:30:27,025 copying build/lib/unitxt/catalog/recipes/torr/tablebench_numerical_reasoning/csv/shuffle_cols_augmentation_5_demos.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/recipes/torr/tablebench_numerical_reasoning/csv 2026-01-06T13:30:27,027 creating build/bdist.linux-armv7l/wheel/unitxt/catalog/recipes/torr/tablebench_numerical_reasoning/concat 2026-01-06T13:30:27,028 copying build/lib/unitxt/catalog/recipes/torr/tablebench_numerical_reasoning/concat/shuffle_rows_augmentation_5_demos.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/recipes/torr/tablebench_numerical_reasoning/concat 2026-01-06T13:30:27,030 copying build/lib/unitxt/catalog/recipes/torr/tablebench_numerical_reasoning/concat/no_augmentation_5_demos.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/recipes/torr/tablebench_numerical_reasoning/concat 2026-01-06T13:30:27,032 copying build/lib/unitxt/catalog/recipes/torr/tablebench_numerical_reasoning/concat/insert_empty_rows_augmentation_5_demos.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/recipes/torr/tablebench_numerical_reasoning/concat 2026-01-06T13:30:27,034 copying build/lib/unitxt/catalog/recipes/torr/tablebench_numerical_reasoning/concat/transpose_augmentation_5_demos.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/recipes/torr/tablebench_numerical_reasoning/concat 2026-01-06T13:30:27,035 copying build/lib/unitxt/catalog/recipes/torr/tablebench_numerical_reasoning/concat/shuffle_cols_augmentation_5_demos.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/recipes/torr/tablebench_numerical_reasoning/concat 2026-01-06T13:30:27,038 creating build/bdist.linux-armv7l/wheel/unitxt/catalog/recipes/torr/tablebench_numerical_reasoning/html 2026-01-06T13:30:27,039 copying build/lib/unitxt/catalog/recipes/torr/tablebench_numerical_reasoning/html/shuffle_rows_augmentation_5_demos.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/recipes/torr/tablebench_numerical_reasoning/html 2026-01-06T13:30:27,041 copying build/lib/unitxt/catalog/recipes/torr/tablebench_numerical_reasoning/html/no_augmentation_5_demos.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/recipes/torr/tablebench_numerical_reasoning/html 2026-01-06T13:30:27,043 copying build/lib/unitxt/catalog/recipes/torr/tablebench_numerical_reasoning/html/insert_empty_rows_augmentation_5_demos.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/recipes/torr/tablebench_numerical_reasoning/html 2026-01-06T13:30:27,044 copying build/lib/unitxt/catalog/recipes/torr/tablebench_numerical_reasoning/html/transpose_augmentation_5_demos.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/recipes/torr/tablebench_numerical_reasoning/html 2026-01-06T13:30:27,046 copying build/lib/unitxt/catalog/recipes/torr/tablebench_numerical_reasoning/html/shuffle_cols_augmentation_5_demos.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/recipes/torr/tablebench_numerical_reasoning/html 2026-01-06T13:30:27,048 creating build/bdist.linux-armv7l/wheel/unitxt/catalog/recipes/torr/tablebench_numerical_reasoning/json 2026-01-06T13:30:27,049 copying build/lib/unitxt/catalog/recipes/torr/tablebench_numerical_reasoning/json/shuffle_rows_augmentation_5_demos.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/recipes/torr/tablebench_numerical_reasoning/json 2026-01-06T13:30:27,051 copying build/lib/unitxt/catalog/recipes/torr/tablebench_numerical_reasoning/json/no_augmentation_5_demos.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/recipes/torr/tablebench_numerical_reasoning/json 2026-01-06T13:30:27,053 copying build/lib/unitxt/catalog/recipes/torr/tablebench_numerical_reasoning/json/insert_empty_rows_augmentation_5_demos.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/recipes/torr/tablebench_numerical_reasoning/json 2026-01-06T13:30:27,054 copying build/lib/unitxt/catalog/recipes/torr/tablebench_numerical_reasoning/json/transpose_augmentation_5_demos.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/recipes/torr/tablebench_numerical_reasoning/json 2026-01-06T13:30:27,056 copying build/lib/unitxt/catalog/recipes/torr/tablebench_numerical_reasoning/json/shuffle_cols_augmentation_5_demos.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/recipes/torr/tablebench_numerical_reasoning/json 2026-01-06T13:30:27,059 creating build/bdist.linux-armv7l/wheel/unitxt/catalog/recipes/torr/tablebench_numerical_reasoning/markdown 2026-01-06T13:30:27,060 copying build/lib/unitxt/catalog/recipes/torr/tablebench_numerical_reasoning/markdown/shuffle_rows_augmentation_5_demos.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/recipes/torr/tablebench_numerical_reasoning/markdown 2026-01-06T13:30:27,062 copying build/lib/unitxt/catalog/recipes/torr/tablebench_numerical_reasoning/markdown/no_augmentation_5_demos.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/recipes/torr/tablebench_numerical_reasoning/markdown 2026-01-06T13:30:27,064 copying build/lib/unitxt/catalog/recipes/torr/tablebench_numerical_reasoning/markdown/insert_empty_rows_augmentation_5_demos.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/recipes/torr/tablebench_numerical_reasoning/markdown 2026-01-06T13:30:27,066 copying build/lib/unitxt/catalog/recipes/torr/tablebench_numerical_reasoning/markdown/transpose_augmentation_5_demos.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/recipes/torr/tablebench_numerical_reasoning/markdown 2026-01-06T13:30:27,068 copying build/lib/unitxt/catalog/recipes/torr/tablebench_numerical_reasoning/markdown/shuffle_cols_augmentation_5_demos.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/recipes/torr/tablebench_numerical_reasoning/markdown 2026-01-06T13:30:27,070 creating build/bdist.linux-armv7l/wheel/unitxt/catalog/recipes/torr/tablebench_numerical_reasoning/indexed_row_major 2026-01-06T13:30:27,071 copying build/lib/unitxt/catalog/recipes/torr/tablebench_numerical_reasoning/indexed_row_major/shuffle_rows_augmentation_5_demos.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/recipes/torr/tablebench_numerical_reasoning/indexed_row_major 2026-01-06T13:30:27,073 copying build/lib/unitxt/catalog/recipes/torr/tablebench_numerical_reasoning/indexed_row_major/no_augmentation_5_demos.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/recipes/torr/tablebench_numerical_reasoning/indexed_row_major 2026-01-06T13:30:27,075 copying build/lib/unitxt/catalog/recipes/torr/tablebench_numerical_reasoning/indexed_row_major/insert_empty_rows_augmentation_5_demos.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/recipes/torr/tablebench_numerical_reasoning/indexed_row_major 2026-01-06T13:30:27,077 copying build/lib/unitxt/catalog/recipes/torr/tablebench_numerical_reasoning/indexed_row_major/transpose_augmentation_5_demos.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/recipes/torr/tablebench_numerical_reasoning/indexed_row_major 2026-01-06T13:30:27,079 copying build/lib/unitxt/catalog/recipes/torr/tablebench_numerical_reasoning/indexed_row_major/shuffle_cols_augmentation_5_demos.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/recipes/torr/tablebench_numerical_reasoning/indexed_row_major 2026-01-06T13:30:27,081 creating build/bdist.linux-armv7l/wheel/unitxt/catalog/recipes/torr/numeric_nlg 2026-01-06T13:30:27,083 creating build/bdist.linux-armv7l/wheel/unitxt/catalog/recipes/torr/numeric_nlg/df 2026-01-06T13:30:27,084 copying build/lib/unitxt/catalog/recipes/torr/numeric_nlg/df/shuffle_rows_augmentation_5_demos.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/recipes/torr/numeric_nlg/df 2026-01-06T13:30:27,086 copying build/lib/unitxt/catalog/recipes/torr/numeric_nlg/df/no_augmentation_5_demos.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/recipes/torr/numeric_nlg/df 2026-01-06T13:30:27,087 copying build/lib/unitxt/catalog/recipes/torr/numeric_nlg/df/insert_empty_rows_augmentation_5_demos.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/recipes/torr/numeric_nlg/df 2026-01-06T13:30:27,089 copying build/lib/unitxt/catalog/recipes/torr/numeric_nlg/df/transpose_augmentation_5_demos.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/recipes/torr/numeric_nlg/df 2026-01-06T13:30:27,091 copying build/lib/unitxt/catalog/recipes/torr/numeric_nlg/df/shuffle_cols_augmentation_5_demos.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/recipes/torr/numeric_nlg/df 2026-01-06T13:30:27,093 creating build/bdist.linux-armv7l/wheel/unitxt/catalog/recipes/torr/numeric_nlg/csv 2026-01-06T13:30:27,094 copying build/lib/unitxt/catalog/recipes/torr/numeric_nlg/csv/shuffle_rows_augmentation_5_demos.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/recipes/torr/numeric_nlg/csv 2026-01-06T13:30:27,096 copying build/lib/unitxt/catalog/recipes/torr/numeric_nlg/csv/no_augmentation_5_demos.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/recipes/torr/numeric_nlg/csv 2026-01-06T13:30:27,098 copying build/lib/unitxt/catalog/recipes/torr/numeric_nlg/csv/insert_empty_rows_augmentation_5_demos.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/recipes/torr/numeric_nlg/csv 2026-01-06T13:30:27,100 copying build/lib/unitxt/catalog/recipes/torr/numeric_nlg/csv/transpose_augmentation_5_demos.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/recipes/torr/numeric_nlg/csv 2026-01-06T13:30:27,102 copying build/lib/unitxt/catalog/recipes/torr/numeric_nlg/csv/shuffle_cols_augmentation_5_demos.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/recipes/torr/numeric_nlg/csv 2026-01-06T13:30:27,104 creating build/bdist.linux-armv7l/wheel/unitxt/catalog/recipes/torr/numeric_nlg/concat 2026-01-06T13:30:27,105 copying build/lib/unitxt/catalog/recipes/torr/numeric_nlg/concat/shuffle_rows_augmentation_5_demos.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/recipes/torr/numeric_nlg/concat 2026-01-06T13:30:27,107 copying build/lib/unitxt/catalog/recipes/torr/numeric_nlg/concat/no_augmentation_5_demos.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/recipes/torr/numeric_nlg/concat 2026-01-06T13:30:27,109 copying build/lib/unitxt/catalog/recipes/torr/numeric_nlg/concat/insert_empty_rows_augmentation_5_demos.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/recipes/torr/numeric_nlg/concat 2026-01-06T13:30:27,111 copying build/lib/unitxt/catalog/recipes/torr/numeric_nlg/concat/transpose_augmentation_5_demos.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/recipes/torr/numeric_nlg/concat 2026-01-06T13:30:27,113 copying build/lib/unitxt/catalog/recipes/torr/numeric_nlg/concat/shuffle_cols_augmentation_5_demos.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/recipes/torr/numeric_nlg/concat 2026-01-06T13:30:27,115 creating build/bdist.linux-armv7l/wheel/unitxt/catalog/recipes/torr/numeric_nlg/html 2026-01-06T13:30:27,116 copying build/lib/unitxt/catalog/recipes/torr/numeric_nlg/html/shuffle_rows_augmentation_5_demos.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/recipes/torr/numeric_nlg/html 2026-01-06T13:30:27,118 copying build/lib/unitxt/catalog/recipes/torr/numeric_nlg/html/no_augmentation_5_demos.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/recipes/torr/numeric_nlg/html 2026-01-06T13:30:27,119 copying build/lib/unitxt/catalog/recipes/torr/numeric_nlg/html/insert_empty_rows_augmentation_5_demos.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/recipes/torr/numeric_nlg/html 2026-01-06T13:30:27,121 copying build/lib/unitxt/catalog/recipes/torr/numeric_nlg/html/transpose_augmentation_5_demos.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/recipes/torr/numeric_nlg/html 2026-01-06T13:30:27,123 copying build/lib/unitxt/catalog/recipes/torr/numeric_nlg/html/shuffle_cols_augmentation_5_demos.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/recipes/torr/numeric_nlg/html 2026-01-06T13:30:27,125 creating build/bdist.linux-armv7l/wheel/unitxt/catalog/recipes/torr/numeric_nlg/json 2026-01-06T13:30:27,126 copying build/lib/unitxt/catalog/recipes/torr/numeric_nlg/json/shuffle_rows_augmentation_5_demos.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/recipes/torr/numeric_nlg/json 2026-01-06T13:30:27,128 copying build/lib/unitxt/catalog/recipes/torr/numeric_nlg/json/no_augmentation_5_demos.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/recipes/torr/numeric_nlg/json 2026-01-06T13:30:27,131 copying build/lib/unitxt/catalog/recipes/torr/numeric_nlg/json/insert_empty_rows_augmentation_5_demos.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/recipes/torr/numeric_nlg/json 2026-01-06T13:30:27,133 copying build/lib/unitxt/catalog/recipes/torr/numeric_nlg/json/transpose_augmentation_5_demos.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/recipes/torr/numeric_nlg/json 2026-01-06T13:30:27,135 copying build/lib/unitxt/catalog/recipes/torr/numeric_nlg/json/shuffle_cols_augmentation_5_demos.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/recipes/torr/numeric_nlg/json 2026-01-06T13:30:27,137 creating build/bdist.linux-armv7l/wheel/unitxt/catalog/recipes/torr/numeric_nlg/markdown 2026-01-06T13:30:27,139 copying build/lib/unitxt/catalog/recipes/torr/numeric_nlg/markdown/shuffle_rows_augmentation_5_demos.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/recipes/torr/numeric_nlg/markdown 2026-01-06T13:30:27,140 copying build/lib/unitxt/catalog/recipes/torr/numeric_nlg/markdown/no_augmentation_5_demos.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/recipes/torr/numeric_nlg/markdown 2026-01-06T13:30:27,142 copying build/lib/unitxt/catalog/recipes/torr/numeric_nlg/markdown/insert_empty_rows_augmentation_5_demos.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/recipes/torr/numeric_nlg/markdown 2026-01-06T13:30:27,144 copying build/lib/unitxt/catalog/recipes/torr/numeric_nlg/markdown/transpose_augmentation_5_demos.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/recipes/torr/numeric_nlg/markdown 2026-01-06T13:30:27,146 copying build/lib/unitxt/catalog/recipes/torr/numeric_nlg/markdown/shuffle_cols_augmentation_5_demos.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/recipes/torr/numeric_nlg/markdown 2026-01-06T13:30:27,148 creating build/bdist.linux-armv7l/wheel/unitxt/catalog/recipes/torr/numeric_nlg/indexed_row_major 2026-01-06T13:30:27,149 copying build/lib/unitxt/catalog/recipes/torr/numeric_nlg/indexed_row_major/shuffle_rows_augmentation_5_demos.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/recipes/torr/numeric_nlg/indexed_row_major 2026-01-06T13:30:27,151 copying build/lib/unitxt/catalog/recipes/torr/numeric_nlg/indexed_row_major/no_augmentation_5_demos.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/recipes/torr/numeric_nlg/indexed_row_major 2026-01-06T13:30:27,153 copying build/lib/unitxt/catalog/recipes/torr/numeric_nlg/indexed_row_major/insert_empty_rows_augmentation_5_demos.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/recipes/torr/numeric_nlg/indexed_row_major 2026-01-06T13:30:27,154 copying build/lib/unitxt/catalog/recipes/torr/numeric_nlg/indexed_row_major/transpose_augmentation_5_demos.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/recipes/torr/numeric_nlg/indexed_row_major 2026-01-06T13:30:27,156 copying build/lib/unitxt/catalog/recipes/torr/numeric_nlg/indexed_row_major/shuffle_cols_augmentation_5_demos.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/recipes/torr/numeric_nlg/indexed_row_major 2026-01-06T13:30:27,158 creating build/bdist.linux-armv7l/wheel/unitxt/catalog/recipes/torr/tab_fact 2026-01-06T13:30:27,160 creating build/bdist.linux-armv7l/wheel/unitxt/catalog/recipes/torr/tab_fact/df 2026-01-06T13:30:27,161 copying build/lib/unitxt/catalog/recipes/torr/tab_fact/df/shuffle_rows_augmentation_5_demos.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/recipes/torr/tab_fact/df 2026-01-06T13:30:27,163 copying build/lib/unitxt/catalog/recipes/torr/tab_fact/df/no_augmentation_5_demos.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/recipes/torr/tab_fact/df 2026-01-06T13:30:27,165 copying build/lib/unitxt/catalog/recipes/torr/tab_fact/df/insert_empty_rows_augmentation_5_demos.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/recipes/torr/tab_fact/df 2026-01-06T13:30:27,166 copying build/lib/unitxt/catalog/recipes/torr/tab_fact/df/transpose_augmentation_5_demos.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/recipes/torr/tab_fact/df 2026-01-06T13:30:27,168 copying build/lib/unitxt/catalog/recipes/torr/tab_fact/df/shuffle_cols_augmentation_5_demos.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/recipes/torr/tab_fact/df 2026-01-06T13:30:27,171 creating build/bdist.linux-armv7l/wheel/unitxt/catalog/recipes/torr/tab_fact/csv 2026-01-06T13:30:27,172 copying build/lib/unitxt/catalog/recipes/torr/tab_fact/csv/shuffle_rows_augmentation_5_demos.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/recipes/torr/tab_fact/csv 2026-01-06T13:30:27,174 copying build/lib/unitxt/catalog/recipes/torr/tab_fact/csv/no_augmentation_5_demos.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/recipes/torr/tab_fact/csv 2026-01-06T13:30:27,176 copying build/lib/unitxt/catalog/recipes/torr/tab_fact/csv/insert_empty_rows_augmentation_5_demos.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/recipes/torr/tab_fact/csv 2026-01-06T13:30:27,177 copying build/lib/unitxt/catalog/recipes/torr/tab_fact/csv/transpose_augmentation_5_demos.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/recipes/torr/tab_fact/csv 2026-01-06T13:30:27,179 copying build/lib/unitxt/catalog/recipes/torr/tab_fact/csv/shuffle_cols_augmentation_5_demos.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/recipes/torr/tab_fact/csv 2026-01-06T13:30:27,182 creating build/bdist.linux-armv7l/wheel/unitxt/catalog/recipes/torr/tab_fact/concat 2026-01-06T13:30:27,183 copying build/lib/unitxt/catalog/recipes/torr/tab_fact/concat/shuffle_rows_augmentation_5_demos.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/recipes/torr/tab_fact/concat 2026-01-06T13:30:27,185 copying build/lib/unitxt/catalog/recipes/torr/tab_fact/concat/no_augmentation_5_demos.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/recipes/torr/tab_fact/concat 2026-01-06T13:30:27,187 copying build/lib/unitxt/catalog/recipes/torr/tab_fact/concat/insert_empty_rows_augmentation_5_demos.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/recipes/torr/tab_fact/concat 2026-01-06T13:30:27,188 copying build/lib/unitxt/catalog/recipes/torr/tab_fact/concat/transpose_augmentation_5_demos.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/recipes/torr/tab_fact/concat 2026-01-06T13:30:27,190 copying build/lib/unitxt/catalog/recipes/torr/tab_fact/concat/shuffle_cols_augmentation_5_demos.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/recipes/torr/tab_fact/concat 2026-01-06T13:30:27,192 creating build/bdist.linux-armv7l/wheel/unitxt/catalog/recipes/torr/tab_fact/html 2026-01-06T13:30:27,193 copying build/lib/unitxt/catalog/recipes/torr/tab_fact/html/shuffle_rows_augmentation_5_demos.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/recipes/torr/tab_fact/html 2026-01-06T13:30:27,195 copying build/lib/unitxt/catalog/recipes/torr/tab_fact/html/no_augmentation_5_demos.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/recipes/torr/tab_fact/html 2026-01-06T13:30:27,197 copying build/lib/unitxt/catalog/recipes/torr/tab_fact/html/insert_empty_rows_augmentation_5_demos.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/recipes/torr/tab_fact/html 2026-01-06T13:30:27,199 copying build/lib/unitxt/catalog/recipes/torr/tab_fact/html/transpose_augmentation_5_demos.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/recipes/torr/tab_fact/html 2026-01-06T13:30:27,201 copying build/lib/unitxt/catalog/recipes/torr/tab_fact/html/shuffle_cols_augmentation_5_demos.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/recipes/torr/tab_fact/html 2026-01-06T13:30:27,203 creating build/bdist.linux-armv7l/wheel/unitxt/catalog/recipes/torr/tab_fact/json 2026-01-06T13:30:27,204 copying build/lib/unitxt/catalog/recipes/torr/tab_fact/json/shuffle_rows_augmentation_5_demos.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/recipes/torr/tab_fact/json 2026-01-06T13:30:27,206 copying build/lib/unitxt/catalog/recipes/torr/tab_fact/json/no_augmentation_5_demos.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/recipes/torr/tab_fact/json 2026-01-06T13:30:27,208 copying build/lib/unitxt/catalog/recipes/torr/tab_fact/json/insert_empty_rows_augmentation_5_demos.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/recipes/torr/tab_fact/json 2026-01-06T13:30:27,210 copying build/lib/unitxt/catalog/recipes/torr/tab_fact/json/transpose_augmentation_5_demos.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/recipes/torr/tab_fact/json 2026-01-06T13:30:27,211 copying build/lib/unitxt/catalog/recipes/torr/tab_fact/json/shuffle_cols_augmentation_5_demos.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/recipes/torr/tab_fact/json 2026-01-06T13:30:27,214 creating build/bdist.linux-armv7l/wheel/unitxt/catalog/recipes/torr/tab_fact/markdown 2026-01-06T13:30:27,215 copying build/lib/unitxt/catalog/recipes/torr/tab_fact/markdown/shuffle_rows_augmentation_5_demos.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/recipes/torr/tab_fact/markdown 2026-01-06T13:30:27,216 copying build/lib/unitxt/catalog/recipes/torr/tab_fact/markdown/no_augmentation_5_demos.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/recipes/torr/tab_fact/markdown 2026-01-06T13:30:27,218 copying build/lib/unitxt/catalog/recipes/torr/tab_fact/markdown/insert_empty_rows_augmentation_5_demos.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/recipes/torr/tab_fact/markdown 2026-01-06T13:30:27,220 copying build/lib/unitxt/catalog/recipes/torr/tab_fact/markdown/transpose_augmentation_5_demos.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/recipes/torr/tab_fact/markdown 2026-01-06T13:30:27,222 copying build/lib/unitxt/catalog/recipes/torr/tab_fact/markdown/shuffle_cols_augmentation_5_demos.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/recipes/torr/tab_fact/markdown 2026-01-06T13:30:27,224 creating build/bdist.linux-armv7l/wheel/unitxt/catalog/recipes/torr/tab_fact/indexed_row_major 2026-01-06T13:30:27,225 copying build/lib/unitxt/catalog/recipes/torr/tab_fact/indexed_row_major/shuffle_rows_augmentation_5_demos.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/recipes/torr/tab_fact/indexed_row_major 2026-01-06T13:30:27,227 copying build/lib/unitxt/catalog/recipes/torr/tab_fact/indexed_row_major/no_augmentation_5_demos.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/recipes/torr/tab_fact/indexed_row_major 2026-01-06T13:30:27,229 copying build/lib/unitxt/catalog/recipes/torr/tab_fact/indexed_row_major/insert_empty_rows_augmentation_5_demos.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/recipes/torr/tab_fact/indexed_row_major 2026-01-06T13:30:27,230 copying build/lib/unitxt/catalog/recipes/torr/tab_fact/indexed_row_major/transpose_augmentation_5_demos.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/recipes/torr/tab_fact/indexed_row_major 2026-01-06T13:30:27,232 copying build/lib/unitxt/catalog/recipes/torr/tab_fact/indexed_row_major/shuffle_cols_augmentation_5_demos.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/recipes/torr/tab_fact/indexed_row_major 2026-01-06T13:30:27,234 creating build/bdist.linux-armv7l/wheel/unitxt/catalog/recipes/torr/tablebench_data_analysis 2026-01-06T13:30:27,236 creating build/bdist.linux-armv7l/wheel/unitxt/catalog/recipes/torr/tablebench_data_analysis/df 2026-01-06T13:30:27,237 copying build/lib/unitxt/catalog/recipes/torr/tablebench_data_analysis/df/shuffle_rows_augmentation_5_demos.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/recipes/torr/tablebench_data_analysis/df 2026-01-06T13:30:27,239 copying build/lib/unitxt/catalog/recipes/torr/tablebench_data_analysis/df/no_augmentation_5_demos.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/recipes/torr/tablebench_data_analysis/df 2026-01-06T13:30:27,241 copying build/lib/unitxt/catalog/recipes/torr/tablebench_data_analysis/df/insert_empty_rows_augmentation_5_demos.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/recipes/torr/tablebench_data_analysis/df 2026-01-06T13:30:27,243 copying build/lib/unitxt/catalog/recipes/torr/tablebench_data_analysis/df/transpose_augmentation_5_demos.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/recipes/torr/tablebench_data_analysis/df 2026-01-06T13:30:27,244 copying build/lib/unitxt/catalog/recipes/torr/tablebench_data_analysis/df/shuffle_cols_augmentation_5_demos.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/recipes/torr/tablebench_data_analysis/df 2026-01-06T13:30:27,247 creating build/bdist.linux-armv7l/wheel/unitxt/catalog/recipes/torr/tablebench_data_analysis/csv 2026-01-06T13:30:27,248 copying build/lib/unitxt/catalog/recipes/torr/tablebench_data_analysis/csv/shuffle_rows_augmentation_5_demos.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/recipes/torr/tablebench_data_analysis/csv 2026-01-06T13:30:27,250 copying build/lib/unitxt/catalog/recipes/torr/tablebench_data_analysis/csv/no_augmentation_5_demos.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/recipes/torr/tablebench_data_analysis/csv 2026-01-06T13:30:27,251 copying build/lib/unitxt/catalog/recipes/torr/tablebench_data_analysis/csv/insert_empty_rows_augmentation_5_demos.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/recipes/torr/tablebench_data_analysis/csv 2026-01-06T13:30:27,253 copying build/lib/unitxt/catalog/recipes/torr/tablebench_data_analysis/csv/transpose_augmentation_5_demos.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/recipes/torr/tablebench_data_analysis/csv 2026-01-06T13:30:27,255 copying build/lib/unitxt/catalog/recipes/torr/tablebench_data_analysis/csv/shuffle_cols_augmentation_5_demos.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/recipes/torr/tablebench_data_analysis/csv 2026-01-06T13:30:27,257 creating build/bdist.linux-armv7l/wheel/unitxt/catalog/recipes/torr/tablebench_data_analysis/concat 2026-01-06T13:30:27,258 copying build/lib/unitxt/catalog/recipes/torr/tablebench_data_analysis/concat/shuffle_rows_augmentation_5_demos.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/recipes/torr/tablebench_data_analysis/concat 2026-01-06T13:30:27,260 copying build/lib/unitxt/catalog/recipes/torr/tablebench_data_analysis/concat/no_augmentation_5_demos.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/recipes/torr/tablebench_data_analysis/concat 2026-01-06T13:30:27,262 copying build/lib/unitxt/catalog/recipes/torr/tablebench_data_analysis/concat/insert_empty_rows_augmentation_5_demos.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/recipes/torr/tablebench_data_analysis/concat 2026-01-06T13:30:27,264 copying build/lib/unitxt/catalog/recipes/torr/tablebench_data_analysis/concat/transpose_augmentation_5_demos.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/recipes/torr/tablebench_data_analysis/concat 2026-01-06T13:30:27,265 copying build/lib/unitxt/catalog/recipes/torr/tablebench_data_analysis/concat/shuffle_cols_augmentation_5_demos.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/recipes/torr/tablebench_data_analysis/concat 2026-01-06T13:30:27,267 creating build/bdist.linux-armv7l/wheel/unitxt/catalog/recipes/torr/tablebench_data_analysis/html 2026-01-06T13:30:27,268 copying build/lib/unitxt/catalog/recipes/torr/tablebench_data_analysis/html/shuffle_rows_augmentation_5_demos.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/recipes/torr/tablebench_data_analysis/html 2026-01-06T13:30:27,270 copying build/lib/unitxt/catalog/recipes/torr/tablebench_data_analysis/html/no_augmentation_5_demos.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/recipes/torr/tablebench_data_analysis/html 2026-01-06T13:30:27,272 copying build/lib/unitxt/catalog/recipes/torr/tablebench_data_analysis/html/insert_empty_rows_augmentation_5_demos.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/recipes/torr/tablebench_data_analysis/html 2026-01-06T13:30:27,274 copying build/lib/unitxt/catalog/recipes/torr/tablebench_data_analysis/html/transpose_augmentation_5_demos.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/recipes/torr/tablebench_data_analysis/html 2026-01-06T13:30:27,275 copying build/lib/unitxt/catalog/recipes/torr/tablebench_data_analysis/html/shuffle_cols_augmentation_5_demos.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/recipes/torr/tablebench_data_analysis/html 2026-01-06T13:30:27,278 creating build/bdist.linux-armv7l/wheel/unitxt/catalog/recipes/torr/tablebench_data_analysis/json 2026-01-06T13:30:27,279 copying build/lib/unitxt/catalog/recipes/torr/tablebench_data_analysis/json/shuffle_rows_augmentation_5_demos.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/recipes/torr/tablebench_data_analysis/json 2026-01-06T13:30:27,281 copying build/lib/unitxt/catalog/recipes/torr/tablebench_data_analysis/json/no_augmentation_5_demos.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/recipes/torr/tablebench_data_analysis/json 2026-01-06T13:30:27,282 copying build/lib/unitxt/catalog/recipes/torr/tablebench_data_analysis/json/insert_empty_rows_augmentation_5_demos.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/recipes/torr/tablebench_data_analysis/json 2026-01-06T13:30:27,284 copying build/lib/unitxt/catalog/recipes/torr/tablebench_data_analysis/json/transpose_augmentation_5_demos.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/recipes/torr/tablebench_data_analysis/json 2026-01-06T13:30:27,286 copying build/lib/unitxt/catalog/recipes/torr/tablebench_data_analysis/json/shuffle_cols_augmentation_5_demos.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/recipes/torr/tablebench_data_analysis/json 2026-01-06T13:30:27,288 creating build/bdist.linux-armv7l/wheel/unitxt/catalog/recipes/torr/tablebench_data_analysis/markdown 2026-01-06T13:30:27,289 copying build/lib/unitxt/catalog/recipes/torr/tablebench_data_analysis/markdown/shuffle_rows_augmentation_5_demos.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/recipes/torr/tablebench_data_analysis/markdown 2026-01-06T13:30:27,291 copying build/lib/unitxt/catalog/recipes/torr/tablebench_data_analysis/markdown/no_augmentation_5_demos.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/recipes/torr/tablebench_data_analysis/markdown 2026-01-06T13:30:27,293 copying build/lib/unitxt/catalog/recipes/torr/tablebench_data_analysis/markdown/insert_empty_rows_augmentation_5_demos.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/recipes/torr/tablebench_data_analysis/markdown 2026-01-06T13:30:27,295 copying build/lib/unitxt/catalog/recipes/torr/tablebench_data_analysis/markdown/transpose_augmentation_5_demos.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/recipes/torr/tablebench_data_analysis/markdown 2026-01-06T13:30:27,296 copying build/lib/unitxt/catalog/recipes/torr/tablebench_data_analysis/markdown/shuffle_cols_augmentation_5_demos.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/recipes/torr/tablebench_data_analysis/markdown 2026-01-06T13:30:27,299 creating build/bdist.linux-armv7l/wheel/unitxt/catalog/recipes/torr/tablebench_data_analysis/indexed_row_major 2026-01-06T13:30:27,300 copying build/lib/unitxt/catalog/recipes/torr/tablebench_data_analysis/indexed_row_major/shuffle_rows_augmentation_5_demos.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/recipes/torr/tablebench_data_analysis/indexed_row_major 2026-01-06T13:30:27,301 copying build/lib/unitxt/catalog/recipes/torr/tablebench_data_analysis/indexed_row_major/no_augmentation_5_demos.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/recipes/torr/tablebench_data_analysis/indexed_row_major 2026-01-06T13:30:27,303 copying build/lib/unitxt/catalog/recipes/torr/tablebench_data_analysis/indexed_row_major/insert_empty_rows_augmentation_5_demos.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/recipes/torr/tablebench_data_analysis/indexed_row_major 2026-01-06T13:30:27,305 copying build/lib/unitxt/catalog/recipes/torr/tablebench_data_analysis/indexed_row_major/transpose_augmentation_5_demos.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/recipes/torr/tablebench_data_analysis/indexed_row_major 2026-01-06T13:30:27,307 copying build/lib/unitxt/catalog/recipes/torr/tablebench_data_analysis/indexed_row_major/shuffle_cols_augmentation_5_demos.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/recipes/torr/tablebench_data_analysis/indexed_row_major 2026-01-06T13:30:27,309 creating build/bdist.linux-armv7l/wheel/unitxt/catalog/recipes/torr/scigen 2026-01-06T13:30:27,310 creating build/bdist.linux-armv7l/wheel/unitxt/catalog/recipes/torr/scigen/df 2026-01-06T13:30:27,312 copying build/lib/unitxt/catalog/recipes/torr/scigen/df/shuffle_rows_augmentation_5_demos.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/recipes/torr/scigen/df 2026-01-06T13:30:27,313 copying build/lib/unitxt/catalog/recipes/torr/scigen/df/no_augmentation_5_demos.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/recipes/torr/scigen/df 2026-01-06T13:30:27,315 copying build/lib/unitxt/catalog/recipes/torr/scigen/df/insert_empty_rows_augmentation_5_demos.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/recipes/torr/scigen/df 2026-01-06T13:30:27,317 copying build/lib/unitxt/catalog/recipes/torr/scigen/df/transpose_augmentation_5_demos.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/recipes/torr/scigen/df 2026-01-06T13:30:27,319 copying build/lib/unitxt/catalog/recipes/torr/scigen/df/shuffle_cols_augmentation_5_demos.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/recipes/torr/scigen/df 2026-01-06T13:30:27,321 creating build/bdist.linux-armv7l/wheel/unitxt/catalog/recipes/torr/scigen/csv 2026-01-06T13:30:27,322 copying build/lib/unitxt/catalog/recipes/torr/scigen/csv/shuffle_rows_augmentation_5_demos.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/recipes/torr/scigen/csv 2026-01-06T13:30:27,324 copying build/lib/unitxt/catalog/recipes/torr/scigen/csv/no_augmentation_5_demos.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/recipes/torr/scigen/csv 2026-01-06T13:30:27,326 copying build/lib/unitxt/catalog/recipes/torr/scigen/csv/insert_empty_rows_augmentation_5_demos.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/recipes/torr/scigen/csv 2026-01-06T13:30:27,328 copying build/lib/unitxt/catalog/recipes/torr/scigen/csv/transpose_augmentation_5_demos.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/recipes/torr/scigen/csv 2026-01-06T13:30:27,329 copying build/lib/unitxt/catalog/recipes/torr/scigen/csv/shuffle_cols_augmentation_5_demos.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/recipes/torr/scigen/csv 2026-01-06T13:30:27,332 creating build/bdist.linux-armv7l/wheel/unitxt/catalog/recipes/torr/scigen/concat 2026-01-06T13:30:27,333 copying build/lib/unitxt/catalog/recipes/torr/scigen/concat/shuffle_rows_augmentation_5_demos.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/recipes/torr/scigen/concat 2026-01-06T13:30:27,334 copying build/lib/unitxt/catalog/recipes/torr/scigen/concat/no_augmentation_5_demos.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/recipes/torr/scigen/concat 2026-01-06T13:30:27,336 copying build/lib/unitxt/catalog/recipes/torr/scigen/concat/insert_empty_rows_augmentation_5_demos.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/recipes/torr/scigen/concat 2026-01-06T13:30:27,338 copying build/lib/unitxt/catalog/recipes/torr/scigen/concat/transpose_augmentation_5_demos.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/recipes/torr/scigen/concat 2026-01-06T13:30:27,339 copying build/lib/unitxt/catalog/recipes/torr/scigen/concat/shuffle_cols_augmentation_5_demos.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/recipes/torr/scigen/concat 2026-01-06T13:30:27,342 creating build/bdist.linux-armv7l/wheel/unitxt/catalog/recipes/torr/scigen/html 2026-01-06T13:30:27,343 copying build/lib/unitxt/catalog/recipes/torr/scigen/html/shuffle_rows_augmentation_5_demos.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/recipes/torr/scigen/html 2026-01-06T13:30:27,345 copying build/lib/unitxt/catalog/recipes/torr/scigen/html/no_augmentation_5_demos.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/recipes/torr/scigen/html 2026-01-06T13:30:27,346 copying build/lib/unitxt/catalog/recipes/torr/scigen/html/insert_empty_rows_augmentation_5_demos.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/recipes/torr/scigen/html 2026-01-06T13:30:27,348 copying build/lib/unitxt/catalog/recipes/torr/scigen/html/transpose_augmentation_5_demos.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/recipes/torr/scigen/html 2026-01-06T13:30:27,350 copying build/lib/unitxt/catalog/recipes/torr/scigen/html/shuffle_cols_augmentation_5_demos.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/recipes/torr/scigen/html 2026-01-06T13:30:27,352 creating build/bdist.linux-armv7l/wheel/unitxt/catalog/recipes/torr/scigen/json 2026-01-06T13:30:27,353 copying build/lib/unitxt/catalog/recipes/torr/scigen/json/shuffle_rows_augmentation_5_demos.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/recipes/torr/scigen/json 2026-01-06T13:30:27,355 copying build/lib/unitxt/catalog/recipes/torr/scigen/json/no_augmentation_5_demos.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/recipes/torr/scigen/json 2026-01-06T13:30:27,357 copying build/lib/unitxt/catalog/recipes/torr/scigen/json/insert_empty_rows_augmentation_5_demos.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/recipes/torr/scigen/json 2026-01-06T13:30:27,359 copying build/lib/unitxt/catalog/recipes/torr/scigen/json/transpose_augmentation_5_demos.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/recipes/torr/scigen/json 2026-01-06T13:30:27,361 copying build/lib/unitxt/catalog/recipes/torr/scigen/json/shuffle_cols_augmentation_5_demos.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/recipes/torr/scigen/json 2026-01-06T13:30:27,363 creating build/bdist.linux-armv7l/wheel/unitxt/catalog/recipes/torr/scigen/markdown 2026-01-06T13:30:27,364 copying build/lib/unitxt/catalog/recipes/torr/scigen/markdown/shuffle_rows_augmentation_5_demos.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/recipes/torr/scigen/markdown 2026-01-06T13:30:27,366 copying build/lib/unitxt/catalog/recipes/torr/scigen/markdown/no_augmentation_5_demos.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/recipes/torr/scigen/markdown 2026-01-06T13:30:27,368 copying build/lib/unitxt/catalog/recipes/torr/scigen/markdown/insert_empty_rows_augmentation_5_demos.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/recipes/torr/scigen/markdown 2026-01-06T13:30:27,369 copying build/lib/unitxt/catalog/recipes/torr/scigen/markdown/transpose_augmentation_5_demos.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/recipes/torr/scigen/markdown 2026-01-06T13:30:27,371 copying build/lib/unitxt/catalog/recipes/torr/scigen/markdown/shuffle_cols_augmentation_5_demos.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/recipes/torr/scigen/markdown 2026-01-06T13:30:27,373 creating build/bdist.linux-armv7l/wheel/unitxt/catalog/recipes/torr/scigen/indexed_row_major 2026-01-06T13:30:27,374 copying build/lib/unitxt/catalog/recipes/torr/scigen/indexed_row_major/shuffle_rows_augmentation_5_demos.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/recipes/torr/scigen/indexed_row_major 2026-01-06T13:30:27,376 copying build/lib/unitxt/catalog/recipes/torr/scigen/indexed_row_major/no_augmentation_5_demos.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/recipes/torr/scigen/indexed_row_major 2026-01-06T13:30:27,378 copying build/lib/unitxt/catalog/recipes/torr/scigen/indexed_row_major/insert_empty_rows_augmentation_5_demos.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/recipes/torr/scigen/indexed_row_major 2026-01-06T13:30:27,379 copying build/lib/unitxt/catalog/recipes/torr/scigen/indexed_row_major/transpose_augmentation_5_demos.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/recipes/torr/scigen/indexed_row_major 2026-01-06T13:30:27,381 copying build/lib/unitxt/catalog/recipes/torr/scigen/indexed_row_major/shuffle_cols_augmentation_5_demos.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/recipes/torr/scigen/indexed_row_major 2026-01-06T13:30:27,384 creating build/bdist.linux-armv7l/wheel/unitxt/catalog/recipes/torr/fin_qa 2026-01-06T13:30:27,385 creating build/bdist.linux-armv7l/wheel/unitxt/catalog/recipes/torr/fin_qa/df 2026-01-06T13:30:27,386 copying build/lib/unitxt/catalog/recipes/torr/fin_qa/df/shuffle_rows_augmentation_5_demos.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/recipes/torr/fin_qa/df 2026-01-06T13:30:27,389 copying build/lib/unitxt/catalog/recipes/torr/fin_qa/df/no_augmentation_5_demos.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/recipes/torr/fin_qa/df 2026-01-06T13:30:27,390 copying build/lib/unitxt/catalog/recipes/torr/fin_qa/df/insert_empty_rows_augmentation_5_demos.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/recipes/torr/fin_qa/df 2026-01-06T13:30:27,392 copying build/lib/unitxt/catalog/recipes/torr/fin_qa/df/transpose_augmentation_5_demos.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/recipes/torr/fin_qa/df 2026-01-06T13:30:27,394 copying build/lib/unitxt/catalog/recipes/torr/fin_qa/df/shuffle_cols_augmentation_5_demos.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/recipes/torr/fin_qa/df 2026-01-06T13:30:27,396 creating build/bdist.linux-armv7l/wheel/unitxt/catalog/recipes/torr/fin_qa/csv 2026-01-06T13:30:27,397 copying build/lib/unitxt/catalog/recipes/torr/fin_qa/csv/shuffle_rows_augmentation_5_demos.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/recipes/torr/fin_qa/csv 2026-01-06T13:30:27,399 copying build/lib/unitxt/catalog/recipes/torr/fin_qa/csv/no_augmentation_5_demos.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/recipes/torr/fin_qa/csv 2026-01-06T13:30:27,401 copying build/lib/unitxt/catalog/recipes/torr/fin_qa/csv/insert_empty_rows_augmentation_5_demos.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/recipes/torr/fin_qa/csv 2026-01-06T13:30:27,402 copying build/lib/unitxt/catalog/recipes/torr/fin_qa/csv/transpose_augmentation_5_demos.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/recipes/torr/fin_qa/csv 2026-01-06T13:30:27,404 copying build/lib/unitxt/catalog/recipes/torr/fin_qa/csv/shuffle_cols_augmentation_5_demos.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/recipes/torr/fin_qa/csv 2026-01-06T13:30:27,407 creating build/bdist.linux-armv7l/wheel/unitxt/catalog/recipes/torr/fin_qa/concat 2026-01-06T13:30:27,407 copying build/lib/unitxt/catalog/recipes/torr/fin_qa/concat/shuffle_rows_augmentation_5_demos.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/recipes/torr/fin_qa/concat 2026-01-06T13:30:27,409 copying build/lib/unitxt/catalog/recipes/torr/fin_qa/concat/no_augmentation_5_demos.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/recipes/torr/fin_qa/concat 2026-01-06T13:30:27,412 copying build/lib/unitxt/catalog/recipes/torr/fin_qa/concat/insert_empty_rows_augmentation_5_demos.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/recipes/torr/fin_qa/concat 2026-01-06T13:30:27,413 copying build/lib/unitxt/catalog/recipes/torr/fin_qa/concat/transpose_augmentation_5_demos.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/recipes/torr/fin_qa/concat 2026-01-06T13:30:27,415 copying build/lib/unitxt/catalog/recipes/torr/fin_qa/concat/shuffle_cols_augmentation_5_demos.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/recipes/torr/fin_qa/concat 2026-01-06T13:30:27,417 creating build/bdist.linux-armv7l/wheel/unitxt/catalog/recipes/torr/fin_qa/html 2026-01-06T13:30:27,418 copying build/lib/unitxt/catalog/recipes/torr/fin_qa/html/shuffle_rows_augmentation_5_demos.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/recipes/torr/fin_qa/html 2026-01-06T13:30:27,420 copying build/lib/unitxt/catalog/recipes/torr/fin_qa/html/no_augmentation_5_demos.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/recipes/torr/fin_qa/html 2026-01-06T13:30:27,422 copying build/lib/unitxt/catalog/recipes/torr/fin_qa/html/insert_empty_rows_augmentation_5_demos.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/recipes/torr/fin_qa/html 2026-01-06T13:30:27,424 copying build/lib/unitxt/catalog/recipes/torr/fin_qa/html/transpose_augmentation_5_demos.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/recipes/torr/fin_qa/html 2026-01-06T13:30:27,425 copying build/lib/unitxt/catalog/recipes/torr/fin_qa/html/shuffle_cols_augmentation_5_demos.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/recipes/torr/fin_qa/html 2026-01-06T13:30:27,428 creating build/bdist.linux-armv7l/wheel/unitxt/catalog/recipes/torr/fin_qa/json 2026-01-06T13:30:27,429 copying build/lib/unitxt/catalog/recipes/torr/fin_qa/json/shuffle_rows_augmentation_5_demos.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/recipes/torr/fin_qa/json 2026-01-06T13:30:27,431 copying build/lib/unitxt/catalog/recipes/torr/fin_qa/json/no_augmentation_5_demos.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/recipes/torr/fin_qa/json 2026-01-06T13:30:27,432 copying build/lib/unitxt/catalog/recipes/torr/fin_qa/json/insert_empty_rows_augmentation_5_demos.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/recipes/torr/fin_qa/json 2026-01-06T13:30:27,434 copying build/lib/unitxt/catalog/recipes/torr/fin_qa/json/transpose_augmentation_5_demos.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/recipes/torr/fin_qa/json 2026-01-06T13:30:27,436 copying build/lib/unitxt/catalog/recipes/torr/fin_qa/json/shuffle_cols_augmentation_5_demos.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/recipes/torr/fin_qa/json 2026-01-06T13:30:27,438 creating build/bdist.linux-armv7l/wheel/unitxt/catalog/recipes/torr/fin_qa/markdown 2026-01-06T13:30:27,439 copying build/lib/unitxt/catalog/recipes/torr/fin_qa/markdown/shuffle_rows_augmentation_5_demos.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/recipes/torr/fin_qa/markdown 2026-01-06T13:30:27,441 copying build/lib/unitxt/catalog/recipes/torr/fin_qa/markdown/no_augmentation_5_demos.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/recipes/torr/fin_qa/markdown 2026-01-06T13:30:27,443 copying build/lib/unitxt/catalog/recipes/torr/fin_qa/markdown/insert_empty_rows_augmentation_5_demos.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/recipes/torr/fin_qa/markdown 2026-01-06T13:30:27,445 copying build/lib/unitxt/catalog/recipes/torr/fin_qa/markdown/transpose_augmentation_5_demos.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/recipes/torr/fin_qa/markdown 2026-01-06T13:30:27,447 copying build/lib/unitxt/catalog/recipes/torr/fin_qa/markdown/shuffle_cols_augmentation_5_demos.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/recipes/torr/fin_qa/markdown 2026-01-06T13:30:27,449 creating build/bdist.linux-armv7l/wheel/unitxt/catalog/recipes/torr/fin_qa/indexed_row_major 2026-01-06T13:30:27,450 copying build/lib/unitxt/catalog/recipes/torr/fin_qa/indexed_row_major/shuffle_rows_augmentation_5_demos.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/recipes/torr/fin_qa/indexed_row_major 2026-01-06T13:30:27,452 copying build/lib/unitxt/catalog/recipes/torr/fin_qa/indexed_row_major/no_augmentation_5_demos.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/recipes/torr/fin_qa/indexed_row_major 2026-01-06T13:30:27,453 copying build/lib/unitxt/catalog/recipes/torr/fin_qa/indexed_row_major/insert_empty_rows_augmentation_5_demos.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/recipes/torr/fin_qa/indexed_row_major 2026-01-06T13:30:27,455 copying build/lib/unitxt/catalog/recipes/torr/fin_qa/indexed_row_major/transpose_augmentation_5_demos.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/recipes/torr/fin_qa/indexed_row_major 2026-01-06T13:30:27,457 copying build/lib/unitxt/catalog/recipes/torr/fin_qa/indexed_row_major/shuffle_cols_augmentation_5_demos.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/recipes/torr/fin_qa/indexed_row_major 2026-01-06T13:30:27,459 creating build/bdist.linux-armv7l/wheel/unitxt/catalog/recipes/torr/turl_col_type 2026-01-06T13:30:27,461 creating build/bdist.linux-armv7l/wheel/unitxt/catalog/recipes/torr/turl_col_type/df 2026-01-06T13:30:27,462 copying build/lib/unitxt/catalog/recipes/torr/turl_col_type/df/shuffle_rows_augmentation_5_demos.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/recipes/torr/turl_col_type/df 2026-01-06T13:30:27,464 copying build/lib/unitxt/catalog/recipes/torr/turl_col_type/df/no_augmentation_5_demos.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/recipes/torr/turl_col_type/df 2026-01-06T13:30:27,465 copying build/lib/unitxt/catalog/recipes/torr/turl_col_type/df/insert_empty_rows_augmentation_5_demos.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/recipes/torr/turl_col_type/df 2026-01-06T13:30:27,467 copying build/lib/unitxt/catalog/recipes/torr/turl_col_type/df/transpose_augmentation_5_demos.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/recipes/torr/turl_col_type/df 2026-01-06T13:30:27,469 copying build/lib/unitxt/catalog/recipes/torr/turl_col_type/df/shuffle_cols_augmentation_5_demos.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/recipes/torr/turl_col_type/df 2026-01-06T13:30:27,471 creating build/bdist.linux-armv7l/wheel/unitxt/catalog/recipes/torr/turl_col_type/csv 2026-01-06T13:30:27,472 copying build/lib/unitxt/catalog/recipes/torr/turl_col_type/csv/shuffle_rows_augmentation_5_demos.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/recipes/torr/turl_col_type/csv 2026-01-06T13:30:27,474 copying build/lib/unitxt/catalog/recipes/torr/turl_col_type/csv/no_augmentation_5_demos.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/recipes/torr/turl_col_type/csv 2026-01-06T13:30:27,476 copying build/lib/unitxt/catalog/recipes/torr/turl_col_type/csv/insert_empty_rows_augmentation_5_demos.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/recipes/torr/turl_col_type/csv 2026-01-06T13:30:27,478 copying build/lib/unitxt/catalog/recipes/torr/turl_col_type/csv/transpose_augmentation_5_demos.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/recipes/torr/turl_col_type/csv 2026-01-06T13:30:27,480 copying build/lib/unitxt/catalog/recipes/torr/turl_col_type/csv/shuffle_cols_augmentation_5_demos.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/recipes/torr/turl_col_type/csv 2026-01-06T13:30:27,482 creating build/bdist.linux-armv7l/wheel/unitxt/catalog/recipes/torr/turl_col_type/concat 2026-01-06T13:30:27,483 copying build/lib/unitxt/catalog/recipes/torr/turl_col_type/concat/shuffle_rows_augmentation_5_demos.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/recipes/torr/turl_col_type/concat 2026-01-06T13:30:27,485 copying build/lib/unitxt/catalog/recipes/torr/turl_col_type/concat/no_augmentation_5_demos.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/recipes/torr/turl_col_type/concat 2026-01-06T13:30:27,486 copying build/lib/unitxt/catalog/recipes/torr/turl_col_type/concat/insert_empty_rows_augmentation_5_demos.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/recipes/torr/turl_col_type/concat 2026-01-06T13:30:27,488 copying build/lib/unitxt/catalog/recipes/torr/turl_col_type/concat/transpose_augmentation_5_demos.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/recipes/torr/turl_col_type/concat 2026-01-06T13:30:27,490 copying build/lib/unitxt/catalog/recipes/torr/turl_col_type/concat/shuffle_cols_augmentation_5_demos.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/recipes/torr/turl_col_type/concat 2026-01-06T13:30:27,492 creating build/bdist.linux-armv7l/wheel/unitxt/catalog/recipes/torr/turl_col_type/html 2026-01-06T13:30:27,493 copying build/lib/unitxt/catalog/recipes/torr/turl_col_type/html/shuffle_rows_augmentation_5_demos.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/recipes/torr/turl_col_type/html 2026-01-06T13:30:27,495 copying build/lib/unitxt/catalog/recipes/torr/turl_col_type/html/no_augmentation_5_demos.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/recipes/torr/turl_col_type/html 2026-01-06T13:30:27,497 copying build/lib/unitxt/catalog/recipes/torr/turl_col_type/html/insert_empty_rows_augmentation_5_demos.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/recipes/torr/turl_col_type/html 2026-01-06T13:30:27,499 copying build/lib/unitxt/catalog/recipes/torr/turl_col_type/html/transpose_augmentation_5_demos.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/recipes/torr/turl_col_type/html 2026-01-06T13:30:27,500 copying build/lib/unitxt/catalog/recipes/torr/turl_col_type/html/shuffle_cols_augmentation_5_demos.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/recipes/torr/turl_col_type/html 2026-01-06T13:30:27,503 creating build/bdist.linux-armv7l/wheel/unitxt/catalog/recipes/torr/turl_col_type/json 2026-01-06T13:30:27,504 copying build/lib/unitxt/catalog/recipes/torr/turl_col_type/json/shuffle_rows_augmentation_5_demos.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/recipes/torr/turl_col_type/json 2026-01-06T13:30:27,506 copying build/lib/unitxt/catalog/recipes/torr/turl_col_type/json/no_augmentation_5_demos.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/recipes/torr/turl_col_type/json 2026-01-06T13:30:27,507 copying build/lib/unitxt/catalog/recipes/torr/turl_col_type/json/insert_empty_rows_augmentation_5_demos.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/recipes/torr/turl_col_type/json 2026-01-06T13:30:27,509 copying build/lib/unitxt/catalog/recipes/torr/turl_col_type/json/transpose_augmentation_5_demos.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/recipes/torr/turl_col_type/json 2026-01-06T13:30:27,511 copying build/lib/unitxt/catalog/recipes/torr/turl_col_type/json/shuffle_cols_augmentation_5_demos.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/recipes/torr/turl_col_type/json 2026-01-06T13:30:27,515 creating build/bdist.linux-armv7l/wheel/unitxt/catalog/recipes/torr/turl_col_type/markdown 2026-01-06T13:30:27,516 copying build/lib/unitxt/catalog/recipes/torr/turl_col_type/markdown/shuffle_rows_augmentation_5_demos.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/recipes/torr/turl_col_type/markdown 2026-01-06T13:30:27,518 copying build/lib/unitxt/catalog/recipes/torr/turl_col_type/markdown/no_augmentation_5_demos.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/recipes/torr/turl_col_type/markdown 2026-01-06T13:30:27,520 copying build/lib/unitxt/catalog/recipes/torr/turl_col_type/markdown/insert_empty_rows_augmentation_5_demos.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/recipes/torr/turl_col_type/markdown 2026-01-06T13:30:27,522 copying build/lib/unitxt/catalog/recipes/torr/turl_col_type/markdown/transpose_augmentation_5_demos.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/recipes/torr/turl_col_type/markdown 2026-01-06T13:30:27,524 copying build/lib/unitxt/catalog/recipes/torr/turl_col_type/markdown/shuffle_cols_augmentation_5_demos.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/recipes/torr/turl_col_type/markdown 2026-01-06T13:30:27,526 creating build/bdist.linux-armv7l/wheel/unitxt/catalog/recipes/torr/turl_col_type/indexed_row_major 2026-01-06T13:30:27,527 copying build/lib/unitxt/catalog/recipes/torr/turl_col_type/indexed_row_major/shuffle_rows_augmentation_5_demos.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/recipes/torr/turl_col_type/indexed_row_major 2026-01-06T13:30:27,529 copying build/lib/unitxt/catalog/recipes/torr/turl_col_type/indexed_row_major/no_augmentation_5_demos.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/recipes/torr/turl_col_type/indexed_row_major 2026-01-06T13:30:27,530 copying build/lib/unitxt/catalog/recipes/torr/turl_col_type/indexed_row_major/insert_empty_rows_augmentation_5_demos.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/recipes/torr/turl_col_type/indexed_row_major 2026-01-06T13:30:27,532 copying build/lib/unitxt/catalog/recipes/torr/turl_col_type/indexed_row_major/transpose_augmentation_5_demos.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/recipes/torr/turl_col_type/indexed_row_major 2026-01-06T13:30:27,534 copying build/lib/unitxt/catalog/recipes/torr/turl_col_type/indexed_row_major/shuffle_cols_augmentation_5_demos.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/recipes/torr/turl_col_type/indexed_row_major 2026-01-06T13:30:27,536 creating build/bdist.linux-armv7l/wheel/unitxt/catalog/recipes/bluebench 2026-01-06T13:30:27,538 creating build/bdist.linux-armv7l/wheel/unitxt/catalog/recipes/bluebench/news_classification 2026-01-06T13:30:27,539 copying build/lib/unitxt/catalog/recipes/bluebench/news_classification/20_newsgroups_short.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/recipes/bluebench/news_classification 2026-01-06T13:30:27,541 creating build/bdist.linux-armv7l/wheel/unitxt/catalog/recipes/bluebench/qa_finance 2026-01-06T13:30:27,542 copying build/lib/unitxt/catalog/recipes/bluebench/qa_finance/fin_qa.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/recipes/bluebench/qa_finance 2026-01-06T13:30:27,545 creating build/bdist.linux-armv7l/wheel/unitxt/catalog/recipes/bluebench/knowledge 2026-01-06T13:30:27,546 copying build/lib/unitxt/catalog/recipes/bluebench/knowledge/mmlu_pro_business.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/recipes/bluebench/knowledge 2026-01-06T13:30:27,547 copying build/lib/unitxt/catalog/recipes/bluebench/knowledge/mmlu_pro_engineering.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/recipes/bluebench/knowledge 2026-01-06T13:30:27,549 copying build/lib/unitxt/catalog/recipes/bluebench/knowledge/mmlu_pro_other.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/recipes/bluebench/knowledge 2026-01-06T13:30:27,551 copying build/lib/unitxt/catalog/recipes/bluebench/knowledge/mmlu_pro_law.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/recipes/bluebench/knowledge 2026-01-06T13:30:27,553 copying build/lib/unitxt/catalog/recipes/bluebench/knowledge/mmlu_pro_history.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/recipes/bluebench/knowledge 2026-01-06T13:30:27,555 copying build/lib/unitxt/catalog/recipes/bluebench/knowledge/mmlu_pro_health.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/recipes/bluebench/knowledge 2026-01-06T13:30:27,556 copying build/lib/unitxt/catalog/recipes/bluebench/knowledge/mmlu_pro_chemistry.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/recipes/bluebench/knowledge 2026-01-06T13:30:27,558 copying build/lib/unitxt/catalog/recipes/bluebench/knowledge/mmlu_pro_computer_science.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/recipes/bluebench/knowledge 2026-01-06T13:30:27,560 copying build/lib/unitxt/catalog/recipes/bluebench/knowledge/mmlu_pro_physics.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/recipes/bluebench/knowledge 2026-01-06T13:30:27,562 copying build/lib/unitxt/catalog/recipes/bluebench/knowledge/mmlu_pro_philosophy.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/recipes/bluebench/knowledge 2026-01-06T13:30:27,563 copying build/lib/unitxt/catalog/recipes/bluebench/knowledge/mmlu_pro_biology.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/recipes/bluebench/knowledge 2026-01-06T13:30:27,565 copying build/lib/unitxt/catalog/recipes/bluebench/knowledge/mmlu_pro_psychology.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/recipes/bluebench/knowledge 2026-01-06T13:30:27,567 copying build/lib/unitxt/catalog/recipes/bluebench/knowledge/mmlu_pro_economics.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/recipes/bluebench/knowledge 2026-01-06T13:30:27,568 copying build/lib/unitxt/catalog/recipes/bluebench/knowledge/mmlu_pro_math.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/recipes/bluebench/knowledge 2026-01-06T13:30:27,571 creating build/bdist.linux-armv7l/wheel/unitxt/catalog/recipes/bluebench/translation 2026-01-06T13:30:27,572 copying build/lib/unitxt/catalog/recipes/bluebench/translation/mt_flores_101_deu_eng.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/recipes/bluebench/translation 2026-01-06T13:30:27,574 copying build/lib/unitxt/catalog/recipes/bluebench/translation/mt_flores_101_por_eng.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/recipes/bluebench/translation 2026-01-06T13:30:27,575 copying build/lib/unitxt/catalog/recipes/bluebench/translation/mt_flores_101_eng_fra.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/recipes/bluebench/translation 2026-01-06T13:30:27,577 copying build/lib/unitxt/catalog/recipes/bluebench/translation/mt_flores_101_eng_spa.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/recipes/bluebench/translation 2026-01-06T13:30:27,579 copying build/lib/unitxt/catalog/recipes/bluebench/translation/mt_flores_101_eng_deu.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/recipes/bluebench/translation 2026-01-06T13:30:27,581 copying build/lib/unitxt/catalog/recipes/bluebench/translation/mt_flores_101_jpn_eng.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/recipes/bluebench/translation 2026-01-06T13:30:27,582 copying build/lib/unitxt/catalog/recipes/bluebench/translation/mt_flores_101_eng_por.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/recipes/bluebench/translation 2026-01-06T13:30:27,584 copying build/lib/unitxt/catalog/recipes/bluebench/translation/mt_flores_101_eng_ron.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/recipes/bluebench/translation 2026-01-06T13:30:27,586 copying build/lib/unitxt/catalog/recipes/bluebench/translation/mt_flores_101_ara_eng.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/recipes/bluebench/translation 2026-01-06T13:30:27,588 copying build/lib/unitxt/catalog/recipes/bluebench/translation/mt_flores_101_kor_eng.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/recipes/bluebench/translation 2026-01-06T13:30:27,589 copying build/lib/unitxt/catalog/recipes/bluebench/translation/mt_flores_101_eng_ara.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/recipes/bluebench/translation 2026-01-06T13:30:27,591 copying build/lib/unitxt/catalog/recipes/bluebench/translation/mt_flores_101_ron_eng.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/recipes/bluebench/translation 2026-01-06T13:30:27,593 copying build/lib/unitxt/catalog/recipes/bluebench/translation/mt_flores_101_spa_eng.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/recipes/bluebench/translation 2026-01-06T13:30:27,595 copying build/lib/unitxt/catalog/recipes/bluebench/translation/mt_flores_101_fra_eng.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/recipes/bluebench/translation 2026-01-06T13:30:27,596 copying build/lib/unitxt/catalog/recipes/bluebench/translation/mt_flores_101_eng_kor.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/recipes/bluebench/translation 2026-01-06T13:30:27,599 creating build/bdist.linux-armv7l/wheel/unitxt/catalog/recipes/bluebench/legal 2026-01-06T13:30:27,600 copying build/lib/unitxt/catalog/recipes/bluebench/legal/legalbench_function_of_decision_section.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/recipes/bluebench/legal 2026-01-06T13:30:27,601 copying build/lib/unitxt/catalog/recipes/bluebench/legal/legalbench_proa.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/recipes/bluebench/legal 2026-01-06T13:30:27,603 copying build/lib/unitxt/catalog/recipes/bluebench/legal/legalbench_corporate_lobbying.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/recipes/bluebench/legal 2026-01-06T13:30:27,605 copying build/lib/unitxt/catalog/recipes/bluebench/legal/legalbench_abercrombie.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/recipes/bluebench/legal 2026-01-06T13:30:27,606 copying build/lib/unitxt/catalog/recipes/bluebench/legal/legalbench_international_citizenship_questions.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/recipes/bluebench/legal 2026-01-06T13:30:27,608 creating build/bdist.linux-armv7l/wheel/unitxt/catalog/recipes/bluebench/summarization 2026-01-06T13:30:27,609 copying build/lib/unitxt/catalog/recipes/bluebench/summarization/billsum_document_filtered_to_6000_chars.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/recipes/bluebench/summarization 2026-01-06T13:30:27,611 copying build/lib/unitxt/catalog/recipes/bluebench/summarization/tldr_document_filtered_to_6000_chars.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/recipes/bluebench/summarization 2026-01-06T13:30:27,614 creating build/bdist.linux-armv7l/wheel/unitxt/catalog/recipes/bluebench/product_help 2026-01-06T13:30:27,615 copying build/lib/unitxt/catalog/recipes/bluebench/product_help/cfpb_product_2023.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/recipes/bluebench/product_help 2026-01-06T13:30:27,616 copying build/lib/unitxt/catalog/recipes/bluebench/product_help/cfpb_product_watsonx.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/recipes/bluebench/product_help 2026-01-06T13:30:27,619 creating build/bdist.linux-armv7l/wheel/unitxt/catalog/recipes/bluebench/reasoning 2026-01-06T13:30:27,620 copying build/lib/unitxt/catalog/recipes/bluebench/reasoning/openbook_qa.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/recipes/bluebench/reasoning 2026-01-06T13:30:27,622 copying build/lib/unitxt/catalog/recipes/bluebench/reasoning/hellaswag.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/recipes/bluebench/reasoning 2026-01-06T13:30:27,624 creating build/bdist.linux-armv7l/wheel/unitxt/catalog/recipes/bluebench/safety 2026-01-06T13:30:27,625 copying build/lib/unitxt/catalog/recipes/bluebench/safety/attaq_500.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/recipes/bluebench/safety 2026-01-06T13:30:27,627 creating build/bdist.linux-armv7l/wheel/unitxt/catalog/recipes/bluebench/rag_general 2026-01-06T13:30:27,628 copying build/lib/unitxt/catalog/recipes/bluebench/rag_general/rag_response_generation_clapnq.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/recipes/bluebench/rag_general 2026-01-06T13:30:27,631 creating build/bdist.linux-armv7l/wheel/unitxt/catalog/recipes/bluebench/bias 2026-01-06T13:30:27,632 copying build/lib/unitxt/catalog/recipes/bluebench/bias/safety_bbq_religion.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/recipes/bluebench/bias 2026-01-06T13:30:27,634 copying build/lib/unitxt/catalog/recipes/bluebench/bias/safety_bbq_ses.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/recipes/bluebench/bias 2026-01-06T13:30:27,635 copying build/lib/unitxt/catalog/recipes/bluebench/bias/safety_bbq_nationality.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/recipes/bluebench/bias 2026-01-06T13:30:27,637 copying build/lib/unitxt/catalog/recipes/bluebench/bias/safety_bbq_physical_appearance.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/recipes/bluebench/bias 2026-01-06T13:30:27,639 copying build/lib/unitxt/catalog/recipes/bluebench/bias/safety_bbq_gender_identity.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/recipes/bluebench/bias 2026-01-06T13:30:27,641 copying build/lib/unitxt/catalog/recipes/bluebench/bias/safety_bbq_age.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/recipes/bluebench/bias 2026-01-06T13:30:27,643 copying build/lib/unitxt/catalog/recipes/bluebench/bias/safety_bbq_race_x_ses.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/recipes/bluebench/bias 2026-01-06T13:30:27,644 copying build/lib/unitxt/catalog/recipes/bluebench/bias/safety_bbq_sexual_orientation.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/recipes/bluebench/bias 2026-01-06T13:30:27,647 copying build/lib/unitxt/catalog/recipes/bluebench/bias/safety_bbq_race_ethnicity.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/recipes/bluebench/bias 2026-01-06T13:30:27,649 copying build/lib/unitxt/catalog/recipes/bluebench/bias/safety_bbq_race_x_gender.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/recipes/bluebench/bias 2026-01-06T13:30:27,651 copying build/lib/unitxt/catalog/recipes/bluebench/bias/safety_bbq_disability_status.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/recipes/bluebench/bias 2026-01-06T13:30:27,653 creating build/bdist.linux-armv7l/wheel/unitxt/catalog/recipes/bluebench/entity_extraction 2026-01-06T13:30:27,654 copying build/lib/unitxt/catalog/recipes/bluebench/entity_extraction/universal_ner_en_ewt.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/recipes/bluebench/entity_extraction 2026-01-06T13:30:27,656 creating build/bdist.linux-armv7l/wheel/unitxt/catalog/recipes/bluebench/chatbot_abilities 2026-01-06T13:30:27,657 copying build/lib/unitxt/catalog/recipes/bluebench/chatbot_abilities/arena_hard_generation_english_gpt_4_0314_reference.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/recipes/bluebench/chatbot_abilities 2026-01-06T13:30:27,660 creating build/bdist.linux-armv7l/wheel/unitxt/catalog/tasks 2026-01-06T13:30:27,661 creating build/bdist.linux-armv7l/wheel/unitxt/catalog/tasks/response_assessment 2026-01-06T13:30:27,663 creating build/bdist.linux-armv7l/wheel/unitxt/catalog/tasks/response_assessment/pairwise_comparison 2026-01-06T13:30:27,664 copying build/lib/unitxt/catalog/tasks/response_assessment/pairwise_comparison/single_turn.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/tasks/response_assessment/pairwise_comparison 2026-01-06T13:30:27,666 copying build/lib/unitxt/catalog/tasks/response_assessment/pairwise_comparison/multi_turn_with_reference.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/tasks/response_assessment/pairwise_comparison 2026-01-06T13:30:27,668 copying build/lib/unitxt/catalog/tasks/response_assessment/pairwise_comparison/multi_turn.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/tasks/response_assessment/pairwise_comparison 2026-01-06T13:30:27,669 copying build/lib/unitxt/catalog/tasks/response_assessment/pairwise_comparison/single_turn_with_reference.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/tasks/response_assessment/pairwise_comparison 2026-01-06T13:30:27,672 creating build/bdist.linux-armv7l/wheel/unitxt/catalog/tasks/response_assessment/rating 2026-01-06T13:30:27,673 copying build/lib/unitxt/catalog/tasks/response_assessment/rating/single_turn.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/tasks/response_assessment/rating 2026-01-06T13:30:27,675 copying build/lib/unitxt/catalog/tasks/response_assessment/rating/multi_turn_with_reference.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/tasks/response_assessment/rating 2026-01-06T13:30:27,676 copying build/lib/unitxt/catalog/tasks/response_assessment/rating/multi_turn.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/tasks/response_assessment/rating 2026-01-06T13:30:27,678 copying build/lib/unitxt/catalog/tasks/response_assessment/rating/single_turn_with_reference.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/tasks/response_assessment/rating 2026-01-06T13:30:27,680 creating build/bdist.linux-armv7l/wheel/unitxt/catalog/tasks/response_assessment/pairwise_comparative_rating 2026-01-06T13:30:27,681 copying build/lib/unitxt/catalog/tasks/response_assessment/pairwise_comparative_rating/single_turn.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/tasks/response_assessment/pairwise_comparative_rating 2026-01-06T13:30:27,683 creating build/bdist.linux-armv7l/wheel/unitxt/catalog/tasks/selection 2026-01-06T13:30:27,684 copying build/lib/unitxt/catalog/tasks/selection/by_attribute.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/tasks/selection 2026-01-06T13:30:27,687 creating build/bdist.linux-armv7l/wheel/unitxt/catalog/tasks/targeted_sentiment_extraction 2026-01-06T13:30:27,688 copying build/lib/unitxt/catalog/tasks/targeted_sentiment_extraction/single_sentiment_class.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/tasks/targeted_sentiment_extraction 2026-01-06T13:30:27,689 copying build/lib/unitxt/catalog/tasks/targeted_sentiment_extraction/all_sentiment_classes.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/tasks/targeted_sentiment_extraction 2026-01-06T13:30:27,691 creating build/bdist.linux-armv7l/wheel/unitxt/catalog/tasks/regression 2026-01-06T13:30:27,693 creating build/bdist.linux-armv7l/wheel/unitxt/catalog/tasks/regression/two_texts 2026-01-06T13:30:27,694 copying build/lib/unitxt/catalog/tasks/regression/two_texts/similarity.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/tasks/regression/two_texts 2026-01-06T13:30:27,696 copying build/lib/unitxt/catalog/tasks/regression/single_text.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/tasks/regression 2026-01-06T13:30:27,698 copying build/lib/unitxt/catalog/tasks/regression/two_texts.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/tasks/regression 2026-01-06T13:30:27,699 copying build/lib/unitxt/catalog/tasks/text2sql.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/tasks 2026-01-06T13:30:27,702 creating build/bdist.linux-armv7l/wheel/unitxt/catalog/tasks/generation 2026-01-06T13:30:27,703 copying build/lib/unitxt/catalog/tasks/generation/from_pair.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/tasks/generation 2026-01-06T13:30:27,705 copying build/lib/unitxt/catalog/tasks/grammatical_error_correction.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/tasks 2026-01-06T13:30:27,707 creating build/bdist.linux-armv7l/wheel/unitxt/catalog/tasks/tool_calling 2026-01-06T13:30:27,708 copying build/lib/unitxt/catalog/tasks/tool_calling/multi_turn.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/tasks/tool_calling 2026-01-06T13:30:27,710 copying build/lib/unitxt/catalog/tasks/tool_calling/supervised.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/tasks/tool_calling 2026-01-06T13:30:27,712 creating build/bdist.linux-armv7l/wheel/unitxt/catalog/tasks/translation 2026-01-06T13:30:27,713 copying build/lib/unitxt/catalog/tasks/translation/directed.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/tasks/translation 2026-01-06T13:30:27,715 creating build/bdist.linux-armv7l/wheel/unitxt/catalog/tasks/qa 2026-01-06T13:30:27,716 copying build/lib/unitxt/catalog/tasks/qa/extractive.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/tasks/qa 2026-01-06T13:30:27,718 copying build/lib/unitxt/catalog/tasks/qa/with_context.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/tasks/qa 2026-01-06T13:30:27,721 creating build/bdist.linux-armv7l/wheel/unitxt/catalog/tasks/qa/extractive 2026-01-06T13:30:27,722 copying build/lib/unitxt/catalog/tasks/qa/extractive/multi_turn.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/tasks/qa/extractive 2026-01-06T13:30:27,724 creating build/bdist.linux-armv7l/wheel/unitxt/catalog/tasks/qa/multiple_choice 2026-01-06T13:30:27,725 copying build/lib/unitxt/catalog/tasks/qa/multiple_choice/with_context.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/tasks/qa/multiple_choice 2026-01-06T13:30:27,727 copying build/lib/unitxt/catalog/tasks/qa/multiple_choice/with_topic.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/tasks/qa/multiple_choice 2026-01-06T13:30:27,729 creating build/bdist.linux-armv7l/wheel/unitxt/catalog/tasks/qa/multiple_choice/with_context 2026-01-06T13:30:27,730 copying build/lib/unitxt/catalog/tasks/qa/multiple_choice/with_context/with_topic.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/tasks/qa/multiple_choice/with_context 2026-01-06T13:30:27,732 copying build/lib/unitxt/catalog/tasks/qa/multiple_choice/open.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/tasks/qa/multiple_choice 2026-01-06T13:30:27,734 creating build/bdist.linux-armv7l/wheel/unitxt/catalog/tasks/qa/with_context 2026-01-06T13:30:27,735 copying build/lib/unitxt/catalog/tasks/qa/with_context/with_type.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/tasks/qa/with_context 2026-01-06T13:30:27,737 copying build/lib/unitxt/catalog/tasks/qa/with_context/extractive.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/tasks/qa/with_context 2026-01-06T13:30:27,739 copying build/lib/unitxt/catalog/tasks/qa/with_context/with_domain.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/tasks/qa/with_context 2026-01-06T13:30:27,740 copying build/lib/unitxt/catalog/tasks/qa/with_context/abstractive.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/tasks/qa/with_context 2026-01-06T13:30:27,742 copying build/lib/unitxt/catalog/tasks/qa/open.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/tasks/qa 2026-01-06T13:30:27,744 creating build/bdist.linux-armv7l/wheel/unitxt/catalog/tasks/summarization 2026-01-06T13:30:27,745 copying build/lib/unitxt/catalog/tasks/summarization/abstractive.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/tasks/summarization 2026-01-06T13:30:27,748 creating build/bdist.linux-armv7l/wheel/unitxt/catalog/tasks/ner 2026-01-06T13:30:27,749 copying build/lib/unitxt/catalog/tasks/ner/single_entity_type.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/tasks/ner 2026-01-06T13:30:27,750 copying build/lib/unitxt/catalog/tasks/ner/all_entity_types.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/tasks/ner 2026-01-06T13:30:27,753 creating build/bdist.linux-armv7l/wheel/unitxt/catalog/tasks/completion 2026-01-06T13:30:27,754 copying build/lib/unitxt/catalog/tasks/completion/extractive.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/tasks/completion 2026-01-06T13:30:27,756 copying build/lib/unitxt/catalog/tasks/completion/multiple_choice.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/tasks/completion 2026-01-06T13:30:27,757 copying build/lib/unitxt/catalog/tasks/completion/abstractive.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/tasks/completion 2026-01-06T13:30:27,759 copying build/lib/unitxt/catalog/tasks/generation.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/tasks 2026-01-06T13:30:27,761 copying build/lib/unitxt/catalog/tasks/schema_linking.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/tasks 2026-01-06T13:30:27,762 copying build/lib/unitxt/catalog/tasks/language_identification.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/tasks 2026-01-06T13:30:27,765 creating build/bdist.linux-armv7l/wheel/unitxt/catalog/tasks/rag_eval 2026-01-06T13:30:27,766 creating build/bdist.linux-armv7l/wheel/unitxt/catalog/tasks/rag_eval/faithfulness 2026-01-06T13:30:27,767 copying build/lib/unitxt/catalog/tasks/rag_eval/faithfulness/non_binary.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/tasks/rag_eval/faithfulness 2026-01-06T13:30:27,769 copying build/lib/unitxt/catalog/tasks/rag_eval/faithfulness/binary.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/tasks/rag_eval/faithfulness 2026-01-06T13:30:27,771 creating build/bdist.linux-armv7l/wheel/unitxt/catalog/tasks/rag_eval/correctness_holistic 2026-01-06T13:30:27,773 copying build/lib/unitxt/catalog/tasks/rag_eval/correctness_holistic/non_binary.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/tasks/rag_eval/correctness_holistic 2026-01-06T13:30:27,774 copying build/lib/unitxt/catalog/tasks/rag_eval/correctness_holistic/binary.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/tasks/rag_eval/correctness_holistic 2026-01-06T13:30:27,777 creating build/bdist.linux-armv7l/wheel/unitxt/catalog/tasks/rag_eval/context_relevance 2026-01-06T13:30:27,778 copying build/lib/unitxt/catalog/tasks/rag_eval/context_relevance/non_binary.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/tasks/rag_eval/context_relevance 2026-01-06T13:30:27,779 copying build/lib/unitxt/catalog/tasks/rag_eval/context_relevance/binary.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/tasks/rag_eval/context_relevance 2026-01-06T13:30:27,781 creating build/bdist.linux-armv7l/wheel/unitxt/catalog/tasks/rag_eval/answer_correctness 2026-01-06T13:30:27,782 copying build/lib/unitxt/catalog/tasks/rag_eval/answer_correctness/non_binary.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/tasks/rag_eval/answer_correctness 2026-01-06T13:30:27,784 copying build/lib/unitxt/catalog/tasks/rag_eval/answer_correctness/binary.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/tasks/rag_eval/answer_correctness 2026-01-06T13:30:27,786 creating build/bdist.linux-armv7l/wheel/unitxt/catalog/tasks/rag_eval/answer_relevance 2026-01-06T13:30:27,787 copying build/lib/unitxt/catalog/tasks/rag_eval/answer_relevance/non_binary.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/tasks/rag_eval/answer_relevance 2026-01-06T13:30:27,789 copying build/lib/unitxt/catalog/tasks/rag_eval/answer_relevance/binary.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/tasks/rag_eval/answer_relevance 2026-01-06T13:30:27,792 creating build/bdist.linux-armv7l/wheel/unitxt/catalog/tasks/classification 2026-01-06T13:30:27,793 copying build/lib/unitxt/catalog/tasks/classification/binary.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/tasks/classification 2026-01-06T13:30:27,795 copying build/lib/unitxt/catalog/tasks/classification/multi_label.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/tasks/classification 2026-01-06T13:30:27,797 creating build/bdist.linux-armv7l/wheel/unitxt/catalog/tasks/classification/binary 2026-01-06T13:30:27,798 copying build/lib/unitxt/catalog/tasks/classification/binary/zero_or_one.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/tasks/classification/binary 2026-01-06T13:30:27,800 creating build/bdist.linux-armv7l/wheel/unitxt/catalog/tasks/classification/multi_class 2026-01-06T13:30:27,801 copying build/lib/unitxt/catalog/tasks/classification/multi_class/relation.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/tasks/classification/multi_class 2026-01-06T13:30:27,803 copying build/lib/unitxt/catalog/tasks/classification/multi_class/with_classes_descriptions.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/tasks/classification/multi_class 2026-01-06T13:30:27,805 copying build/lib/unitxt/catalog/tasks/classification/multi_class/topic_classification.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/tasks/classification/multi_class 2026-01-06T13:30:27,807 copying build/lib/unitxt/catalog/tasks/classification/multi_class.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/tasks/classification 2026-01-06T13:30:27,808 copying build/lib/unitxt/catalog/tasks/key_value_extraction.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/tasks 2026-01-06T13:30:27,811 creating build/bdist.linux-armv7l/wheel/unitxt/catalog/tasks/rewriting 2026-01-06T13:30:27,812 copying build/lib/unitxt/catalog/tasks/rewriting/by_attribute.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/tasks/rewriting 2026-01-06T13:30:27,814 copying build/lib/unitxt/catalog/tasks/rewriting/paraphrase.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/tasks/rewriting 2026-01-06T13:30:27,816 creating build/bdist.linux-armv7l/wheel/unitxt/catalog/tasks/rag 2026-01-06T13:30:27,817 copying build/lib/unitxt/catalog/tasks/rag/end_to_end.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/tasks/rag 2026-01-06T13:30:27,819 copying build/lib/unitxt/catalog/tasks/rag/corpora.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/tasks/rag 2026-01-06T13:30:27,821 copying build/lib/unitxt/catalog/tasks/rag/response_generation.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/tasks/rag 2026-01-06T13:30:27,823 creating build/bdist.linux-armv7l/wheel/unitxt/catalog/tasks/span_labeling 2026-01-06T13:30:27,824 copying build/lib/unitxt/catalog/tasks/span_labeling/extraction.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/tasks/span_labeling 2026-01-06T13:30:27,826 creating build/bdist.linux-armv7l/wheel/unitxt/catalog/tasks/evaluation 2026-01-06T13:30:27,827 copying build/lib/unitxt/catalog/tasks/evaluation/preference.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/tasks/evaluation 2026-01-06T13:30:27,829 copying build/lib/unitxt/catalog/tasks/text2sql_logic.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/tasks 2026-01-06T13:30:27,832 creating build/bdist.linux-armv7l/wheel/unitxt/catalog/metrics 2026-01-06T13:30:27,833 copying build/lib/unitxt/catalog/metrics/wer.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/metrics 2026-01-06T13:30:27,835 copying build/lib/unitxt/catalog/metrics/weighted_win_rate_correlation.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/metrics 2026-01-06T13:30:27,836 copying build/lib/unitxt/catalog/metrics/normalized_sacrebleu.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/metrics 2026-01-06T13:30:27,838 creating build/bdist.linux-armv7l/wheel/unitxt/catalog/metrics/perplexity_chat 2026-01-06T13:30:27,839 copying build/lib/unitxt/catalog/metrics/perplexity_chat/flan_t5_small.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/metrics/perplexity_chat 2026-01-06T13:30:27,841 copying build/lib/unitxt/catalog/metrics/f1_micro_multi_label.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/metrics 2026-01-06T13:30:27,843 copying build/lib/unitxt/catalog/metrics/sacrebleu.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/metrics 2026-01-06T13:30:27,845 creating build/bdist.linux-armv7l/wheel/unitxt/catalog/metrics/granite_guardian 2026-01-06T13:30:27,847 creating build/bdist.linux-armv7l/wheel/unitxt/catalog/metrics/granite_guardian/agentic_risk 2026-01-06T13:30:27,848 copying build/lib/unitxt/catalog/metrics/granite_guardian/agentic_risk/function_call.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/metrics/granite_guardian/agentic_risk 2026-01-06T13:30:27,858 creating build/bdist.linux-armv7l/wheel/unitxt/catalog/metrics/granite_guardian/user_risk 2026-01-06T13:30:27,859 copying build/lib/unitxt/catalog/metrics/granite_guardian/user_risk/unethical_behavior.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/metrics/granite_guardian/user_risk 2026-01-06T13:30:27,861 copying build/lib/unitxt/catalog/metrics/granite_guardian/user_risk/jailbreak.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/metrics/granite_guardian/user_risk 2026-01-06T13:30:27,863 copying build/lib/unitxt/catalog/metrics/granite_guardian/user_risk/social_bias.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/metrics/granite_guardian/user_risk 2026-01-06T13:30:27,864 copying build/lib/unitxt/catalog/metrics/granite_guardian/user_risk/violence.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/metrics/granite_guardian/user_risk 2026-01-06T13:30:27,866 copying build/lib/unitxt/catalog/metrics/granite_guardian/user_risk/profanity.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/metrics/granite_guardian/user_risk 2026-01-06T13:30:27,868 copying build/lib/unitxt/catalog/metrics/granite_guardian/user_risk/harm.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/metrics/granite_guardian/user_risk 2026-01-06T13:30:27,870 creating build/bdist.linux-armv7l/wheel/unitxt/catalog/metrics/granite_guardian/assistant_risk 2026-01-06T13:30:27,871 copying build/lib/unitxt/catalog/metrics/granite_guardian/assistant_risk/unethical_behavior.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/metrics/granite_guardian/assistant_risk 2026-01-06T13:30:27,873 copying build/lib/unitxt/catalog/metrics/granite_guardian/assistant_risk/social_bias.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/metrics/granite_guardian/assistant_risk 2026-01-06T13:30:27,875 copying build/lib/unitxt/catalog/metrics/granite_guardian/assistant_risk/violence.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/metrics/granite_guardian/assistant_risk 2026-01-06T13:30:27,876 copying build/lib/unitxt/catalog/metrics/granite_guardian/assistant_risk/profanity.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/metrics/granite_guardian/assistant_risk 2026-01-06T13:30:27,878 copying build/lib/unitxt/catalog/metrics/granite_guardian/assistant_risk/harm.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/metrics/granite_guardian/assistant_risk 2026-01-06T13:30:27,880 creating build/bdist.linux-armv7l/wheel/unitxt/catalog/metrics/granite_guardian/rag_risk 2026-01-06T13:30:27,885 copying build/lib/unitxt/catalog/metrics/granite_guardian/rag_risk/answer_relevance.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/metrics/granite_guardian/rag_risk 2026-01-06T13:30:27,887 copying build/lib/unitxt/catalog/metrics/granite_guardian/rag_risk/groundedness.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/metrics/granite_guardian/rag_risk 2026-01-06T13:30:27,889 copying build/lib/unitxt/catalog/metrics/granite_guardian/rag_risk/context_relevance.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/metrics/granite_guardian/rag_risk 2026-01-06T13:30:27,891 creating build/bdist.linux-armv7l/wheel/unitxt/catalog/metrics/perplexity_a 2026-01-06T13:30:27,892 copying build/lib/unitxt/catalog/metrics/perplexity_a/flan_t5_small.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/metrics/perplexity_a 2026-01-06T13:30:27,894 copying build/lib/unitxt/catalog/metrics/pearson.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/metrics 2026-01-06T13:30:27,895 copying build/lib/unitxt/catalog/metrics/fin_qa_metric.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/metrics 2026-01-06T13:30:27,897 copying build/lib/unitxt/catalog/metrics/ner.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/metrics 2026-01-06T13:30:27,899 copying build/lib/unitxt/catalog/metrics/mrr.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/metrics 2026-01-06T13:30:27,901 creating build/bdist.linux-armv7l/wheel/unitxt/catalog/metrics/sentence_bert 2026-01-06T13:30:27,902 copying build/lib/unitxt/catalog/metrics/sentence_bert/minilm_l12_v2.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/metrics/sentence_bert 2026-01-06T13:30:27,904 copying build/lib/unitxt/catalog/metrics/sentence_bert/mpnet_base_v2.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/metrics/sentence_bert 2026-01-06T13:30:27,906 copying build/lib/unitxt/catalog/metrics/sentence_bert/bge_large_en_1_5.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/metrics/sentence_bert 2026-01-06T13:30:27,907 copying build/lib/unitxt/catalog/metrics/root_mean_squared_error.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/metrics 2026-01-06T13:30:27,910 creating build/bdist.linux-armv7l/wheel/unitxt/catalog/metrics/multi_turn 2026-01-06T13:30:27,911 copying build/lib/unitxt/catalog/metrics/multi_turn/accuracy.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/metrics/multi_turn 2026-01-06T13:30:27,912 copying build/lib/unitxt/catalog/metrics/multi_turn/sequential_success_accuracy.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/metrics/multi_turn 2026-01-06T13:30:27,914 copying build/lib/unitxt/catalog/metrics/meteor.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/metrics 2026-01-06T13:30:27,916 copying build/lib/unitxt/catalog/metrics/recall_micro_multi_label.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/metrics 2026-01-06T13:30:27,918 copying build/lib/unitxt/catalog/metrics/tool_calling.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/metrics 2026-01-06T13:30:27,920 creating build/bdist.linux-armv7l/wheel/unitxt/catalog/metrics/tool_calling 2026-01-06T13:30:27,922 creating build/bdist.linux-armv7l/wheel/unitxt/catalog/metrics/tool_calling/multi_turn 2026-01-06T13:30:27,923 copying build/lib/unitxt/catalog/metrics/tool_calling/multi_turn/validity.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/metrics/tool_calling/multi_turn 2026-01-06T13:30:27,925 creating build/bdist.linux-armv7l/wheel/unitxt/catalog/metrics/tool_calling/multi_turn/correctness 2026-01-06T13:30:27,926 copying build/lib/unitxt/catalog/metrics/tool_calling/multi_turn/correctness/llama_3_3_70b_instruct_judge.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/metrics/tool_calling/multi_turn/correctness 2026-01-06T13:30:27,928 copying build/lib/unitxt/catalog/metrics/tool_calling/reflection.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/metrics/tool_calling 2026-01-06T13:30:27,930 creating build/bdist.linux-armv7l/wheel/unitxt/catalog/metrics/tool_calling/correctness 2026-01-06T13:30:27,931 copying build/lib/unitxt/catalog/metrics/tool_calling/correctness/llama_3_3_70b_instruct_judge.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/metrics/tool_calling/correctness 2026-01-06T13:30:27,934 creating build/bdist.linux-armv7l/wheel/unitxt/catalog/metrics/tool_calling/key_value 2026-01-06T13:30:27,935 copying build/lib/unitxt/catalog/metrics/tool_calling/key_value/token_overlap.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/metrics/tool_calling/key_value 2026-01-06T13:30:27,936 copying build/lib/unitxt/catalog/metrics/tool_calling/key_value/accuracy.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/metrics/tool_calling/key_value 2026-01-06T13:30:27,939 creating build/bdist.linux-armv7l/wheel/unitxt/catalog/metrics/tool_calling/reflection 2026-01-06T13:30:27,940 copying build/lib/unitxt/catalog/metrics/tool_calling/reflection/syntactic.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/metrics/tool_calling/reflection 2026-01-06T13:30:27,942 copying build/lib/unitxt/catalog/metrics/max_accuracy_binary.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/metrics 2026-01-06T13:30:27,944 copying build/lib/unitxt/catalog/metrics/retrieval_at_k.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/metrics 2026-01-06T13:30:27,946 creating build/bdist.linux-armv7l/wheel/unitxt/catalog/metrics/perplexity 2026-01-06T13:30:27,947 copying build/lib/unitxt/catalog/metrics/perplexity/flan_t5_small.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/metrics/perplexity 2026-01-06T13:30:27,949 copying build/lib/unitxt/catalog/metrics/f1_macro_multi_label.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/metrics 2026-01-06T13:30:27,951 creating build/bdist.linux-armv7l/wheel/unitxt/catalog/metrics/qa 2026-01-06T13:30:27,952 creating build/bdist.linux-armv7l/wheel/unitxt/catalog/metrics/qa/open 2026-01-06T13:30:27,954 copying build/lib/unitxt/catalog/metrics/qa/open/recommended_no_gpu.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/metrics/qa/open 2026-01-06T13:30:27,955 copying build/lib/unitxt/catalog/metrics/qa/open/recommended_local_gpu.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/metrics/qa/open 2026-01-06T13:30:27,957 copying build/lib/unitxt/catalog/metrics/qa/open/recommended_llm_as_judge.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/metrics/qa/open 2026-01-06T13:30:27,959 copying build/lib/unitxt/catalog/metrics/spearman.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/metrics 2026-01-06T13:30:27,961 copying build/lib/unitxt/catalog/metrics/string_containment.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/metrics 2026-01-06T13:30:27,963 copying build/lib/unitxt/catalog/metrics/jaccard_index.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/metrics 2026-01-06T13:30:27,965 creating build/bdist.linux-armv7l/wheel/unitxt/catalog/metrics/perplexity_nli 2026-01-06T13:30:27,966 copying build/lib/unitxt/catalog/metrics/perplexity_nli/t5_nli_mixture.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/metrics/perplexity_nli 2026-01-06T13:30:27,968 copying build/lib/unitxt/catalog/metrics/exact_match_mm.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/metrics 2026-01-06T13:30:27,969 copying build/lib/unitxt/catalog/metrics/matthews_correlation.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/metrics 2026-01-06T13:30:27,971 copying build/lib/unitxt/catalog/metrics/websrc_squad_f1.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/metrics 2026-01-06T13:30:27,973 copying build/lib/unitxt/catalog/metrics/f1_strings.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/metrics 2026-01-06T13:30:27,974 copying build/lib/unitxt/catalog/metrics/rerank_recall.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/metrics 2026-01-06T13:30:27,976 creating build/bdist.linux-armv7l/wheel/unitxt/catalog/metrics/bert_score 2026-01-06T13:30:27,977 copying build/lib/unitxt/catalog/metrics/bert_score/deberta_xlarge_mnli.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/metrics/bert_score 2026-01-06T13:30:27,979 copying build/lib/unitxt/catalog/metrics/bert_score/deberta_v3_base_mnli_xnli_ml.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/metrics/bert_score 2026-01-06T13:30:27,981 copying build/lib/unitxt/catalog/metrics/bert_score/bert_base_uncased.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/metrics/bert_score 2026-01-06T13:30:27,983 copying build/lib/unitxt/catalog/metrics/bert_score/distilbert_base_uncased.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/metrics/bert_score 2026-01-06T13:30:27,984 copying build/lib/unitxt/catalog/metrics/bert_score/deberta_base_mnli.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/metrics/bert_score 2026-01-06T13:30:27,986 copying build/lib/unitxt/catalog/metrics/bert_score/deberta_large_mnli.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/metrics/bert_score 2026-01-06T13:30:27,988 copying build/lib/unitxt/catalog/metrics/token_overlap.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/metrics 2026-01-06T13:30:27,990 copying build/lib/unitxt/catalog/metrics/f1_weighted.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/metrics 2026-01-06T13:30:27,991 copying build/lib/unitxt/catalog/metrics/rouge_with_confidence_intervals.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/metrics 2026-01-06T13:30:27,993 copying build/lib/unitxt/catalog/metrics/f1_micro.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/metrics 2026-01-06T13:30:27,995 copying build/lib/unitxt/catalog/metrics/ndcg.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/metrics 2026-01-06T13:30:27,998 copying build/lib/unitxt/catalog/metrics/bleu.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/metrics 2026-01-06T13:30:28,000 copying build/lib/unitxt/catalog/metrics/meteor_hf.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/metrics 2026-01-06T13:30:28,002 creating build/bdist.linux-armv7l/wheel/unitxt/catalog/metrics/text2sql 2026-01-06T13:30:28,003 copying build/lib/unitxt/catalog/metrics/text2sql/non_execution_accuracy.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/metrics/text2sql 2026-01-06T13:30:28,005 copying build/lib/unitxt/catalog/metrics/text2sql/execution_logic_accuracy.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/metrics/text2sql 2026-01-06T13:30:28,006 copying build/lib/unitxt/catalog/metrics/text2sql/execution_accuracy.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/metrics/text2sql 2026-01-06T13:30:28,008 copying build/lib/unitxt/catalog/metrics/regard_metric.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/metrics 2026-01-06T13:30:28,010 copying build/lib/unitxt/catalog/metrics/prediction_length.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/metrics 2026-01-06T13:30:28,012 copying build/lib/unitxt/catalog/metrics/recall_binary.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/metrics 2026-01-06T13:30:28,013 copying build/lib/unitxt/catalog/metrics/safety_metric.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/metrics 2026-01-06T13:30:28,016 creating build/bdist.linux-armv7l/wheel/unitxt/catalog/metrics/robustness 2026-01-06T13:30:28,017 copying build/lib/unitxt/catalog/metrics/robustness/fixed_group_absval_norm_hedges_g_paraphrase_string_containment.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/metrics/robustness 2026-01-06T13:30:28,019 copying build/lib/unitxt/catalog/metrics/robustness/fixed_group_pdr_paraphrase_string_containment.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/metrics/robustness 2026-01-06T13:30:28,020 copying build/lib/unitxt/catalog/metrics/robustness/fixed_group_norm_hedges_g_paraphrase_accuracy.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/metrics/robustness 2026-01-06T13:30:28,022 copying build/lib/unitxt/catalog/metrics/robustness/fixed_group_mean_baseline_accuracy.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/metrics/robustness 2026-01-06T13:30:28,024 copying build/lib/unitxt/catalog/metrics/robustness/group_mean_token_overlap.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/metrics/robustness 2026-01-06T13:30:28,026 copying build/lib/unitxt/catalog/metrics/robustness/fixed_group_absval_norm_cohens_h_paraphrase_accuracy.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/metrics/robustness 2026-01-06T13:30:28,027 copying build/lib/unitxt/catalog/metrics/robustness/fixed_group_norm_cohens_h_paraphrase_string_containment.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/metrics/robustness 2026-01-06T13:30:28,029 copying build/lib/unitxt/catalog/metrics/robustness/fixed_group_absval_norm_hedges_g_paraphrase_accuracy.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/metrics/robustness 2026-01-06T13:30:28,031 copying build/lib/unitxt/catalog/metrics/robustness/group_mean_accuracy.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/metrics/robustness 2026-01-06T13:30:28,033 copying build/lib/unitxt/catalog/metrics/robustness/fixed_group_norm_cohens_h_paraphrase_accuracy.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/metrics/robustness 2026-01-06T13:30:28,034 copying build/lib/unitxt/catalog/metrics/robustness/fixed_group_mean_baseline_string_containment.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/metrics/robustness 2026-01-06T13:30:28,036 copying build/lib/unitxt/catalog/metrics/robustness/fixed_group_mean_paraphrase_accuracy.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/metrics/robustness 2026-01-06T13:30:28,038 copying build/lib/unitxt/catalog/metrics/robustness/fixed_group_absval_norm_cohens_h_paraphrase_string_containment.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/metrics/robustness 2026-01-06T13:30:28,040 copying build/lib/unitxt/catalog/metrics/robustness/fixed_group_mean_paraphrase_string_containment.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/metrics/robustness 2026-01-06T13:30:28,041 copying build/lib/unitxt/catalog/metrics/robustness/group_mean_string_containment.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/metrics/robustness 2026-01-06T13:30:28,043 copying build/lib/unitxt/catalog/metrics/robustness/fixed_group_mean_accuracy.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/metrics/robustness 2026-01-06T13:30:28,045 copying build/lib/unitxt/catalog/metrics/robustness/fixed_group_pdr_paraphrase_accuracy.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/metrics/robustness 2026-01-06T13:30:28,047 copying build/lib/unitxt/catalog/metrics/robustness/fixed_group_mean_string_containment.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/metrics/robustness 2026-01-06T13:30:28,049 copying build/lib/unitxt/catalog/metrics/robustness/fixed_group_norm_hedges_g_paraphrase_string_containment.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/metrics/robustness 2026-01-06T13:30:28,050 copying build/lib/unitxt/catalog/metrics/rouge.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/metrics 2026-01-06T13:30:28,052 copying build/lib/unitxt/catalog/metrics/f1_macro.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/metrics 2026-01-06T13:30:28,054 copying build/lib/unitxt/catalog/metrics/roc_auc.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/metrics 2026-01-06T13:30:28,056 creating build/bdist.linux-armv7l/wheel/unitxt/catalog/metrics/llm_as_judge 2026-01-06T13:30:28,058 creating build/bdist.linux-armv7l/wheel/unitxt/catalog/metrics/llm_as_judge/binary 2026-01-06T13:30:28,059 copying build/lib/unitxt/catalog/metrics/llm_as_judge/binary/generic_inference_engine_answer_relevance_q_a.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/metrics/llm_as_judge/binary 2026-01-06T13:30:28,061 copying build/lib/unitxt/catalog/metrics/llm_as_judge/binary/generic_inference_engine_answer_correctness_q_a_gt_loose.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/metrics/llm_as_judge/binary 2026-01-06T13:30:28,062 copying build/lib/unitxt/catalog/metrics/llm_as_judge/binary/llama_3_3_70b_instruct_wml_answer_relevance_q_a.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/metrics/llm_as_judge/binary 2026-01-06T13:30:28,064 copying build/lib/unitxt/catalog/metrics/llm_as_judge/binary/llama_3_3_70b_instruct_wml_context_relevance_q_c_ares.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/metrics/llm_as_judge/binary 2026-01-06T13:30:28,066 copying build/lib/unitxt/catalog/metrics/llm_as_judge/binary/llama_3_3_70b_instruct_wml_faithfulness_q_c_a_logprobs.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/metrics/llm_as_judge/binary 2026-01-06T13:30:28,067 copying build/lib/unitxt/catalog/metrics/llm_as_judge/binary/llama_3_3_70b_instruct_wml_context_relevance_q_c_ares_logprobs.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/metrics/llm_as_judge/binary 2026-01-06T13:30:28,069 copying build/lib/unitxt/catalog/metrics/llm_as_judge/binary/generic_inference_engine_context_relevance_q_c_ares.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/metrics/llm_as_judge/binary 2026-01-06T13:30:28,071 copying build/lib/unitxt/catalog/metrics/llm_as_judge/binary/llama_3_3_70b_instruct_wml_faithfulness_c_a.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/metrics/llm_as_judge/binary 2026-01-06T13:30:28,072 copying build/lib/unitxt/catalog/metrics/llm_as_judge/binary/llama_3_3_70b_instruct_wml_correctness_holistic_q_c_a_logprobs.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/metrics/llm_as_judge/binary 2026-01-06T13:30:28,074 copying build/lib/unitxt/catalog/metrics/llm_as_judge/binary/llama_3_3_70b_instruct_wml_faithfulness_q_c_a.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/metrics/llm_as_judge/binary 2026-01-06T13:30:28,076 copying build/lib/unitxt/catalog/metrics/llm_as_judge/binary/llama_3_3_70b_instruct_wml_answer_relevance_q_a_logprobs.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/metrics/llm_as_judge/binary 2026-01-06T13:30:28,078 copying build/lib/unitxt/catalog/metrics/llm_as_judge/binary/generic_inference_engine_faithfulness_c_a.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/metrics/llm_as_judge/binary 2026-01-06T13:30:28,080 copying build/lib/unitxt/catalog/metrics/llm_as_judge/binary/generic_inference_engine_faithfulness_q_c_a.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/metrics/llm_as_judge/binary 2026-01-06T13:30:28,081 copying build/lib/unitxt/catalog/metrics/llm_as_judge/binary/llama_3_3_70b_instruct_wml_faithfulness_c_a_logprobs.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/metrics/llm_as_judge/binary 2026-01-06T13:30:28,083 copying build/lib/unitxt/catalog/metrics/llm_as_judge/binary/llama_3_3_70b_instruct_wml_answer_correctness_q_a_gt_loose.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/metrics/llm_as_judge/binary 2026-01-06T13:30:28,085 copying build/lib/unitxt/catalog/metrics/llm_as_judge/binary/llama_3_3_70b_instruct_wml_correctness_holistic_q_c_a.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/metrics/llm_as_judge/binary 2026-01-06T13:30:28,087 copying build/lib/unitxt/catalog/metrics/llm_as_judge/binary/llama_3_3_70b_instruct_wml_answer_correctness_q_a_gt_loose_logprobs.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/metrics/llm_as_judge/binary 2026-01-06T13:30:28,089 copying build/lib/unitxt/catalog/metrics/llm_as_judge/binary/generic_inference_engine_correctness_holistic_q_c_a.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/metrics/llm_as_judge/binary 2026-01-06T13:30:28,091 creating build/bdist.linux-armv7l/wheel/unitxt/catalog/metrics/llm_as_judge/rating 2026-01-06T13:30:28,092 creating build/bdist.linux-armv7l/wheel/unitxt/catalog/metrics/llm_as_judge/rating/llama_3_8b_instruct 2026-01-06T13:30:28,094 copying build/lib/unitxt/catalog/metrics/llm_as_judge/rating/llama_3_8b_instruct/mt_bench_single_turn.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/metrics/llm_as_judge/rating/llama_3_8b_instruct 2026-01-06T13:30:28,095 copying build/lib/unitxt/catalog/metrics/llm_as_judge/rating/llama_3_70b_instruct_template_table2text_single_turn_with_reference.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/metrics/llm_as_judge/rating 2026-01-06T13:30:28,097 copying build/lib/unitxt/catalog/metrics/llm_as_judge/rating/llama_3_1_70b_instruct_cross_provider_template_table2text_single_turn_with_reference.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/metrics/llm_as_judge/rating 2026-01-06T13:30:28,099 creating build/bdist.linux-armv7l/wheel/unitxt/catalog/metrics/llm_as_judge/rating/llama_3_70b_instruct 2026-01-06T13:30:28,100 copying build/lib/unitxt/catalog/metrics/llm_as_judge/rating/llama_3_70b_instruct/generic_single_turn_with_reference.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/metrics/llm_as_judge/rating/llama_3_70b_instruct 2026-01-06T13:30:28,102 copying build/lib/unitxt/catalog/metrics/llm_as_judge/rating/llama_3_70b_instruct/mt_bench_single_turn.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/metrics/llm_as_judge/rating/llama_3_70b_instruct 2026-01-06T13:30:28,104 copying build/lib/unitxt/catalog/metrics/llm_as_judge/rating/llama_3_70b_instruct/generic_single_turn.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/metrics/llm_as_judge/rating/llama_3_70b_instruct 2026-01-06T13:30:28,105 copying build/lib/unitxt/catalog/metrics/llm_as_judge/rating/mistral_7b_instruct_v0_2_huggingface_template_mt_bench_single_turn.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/metrics/llm_as_judge/rating 2026-01-06T13:30:28,108 creating build/bdist.linux-armv7l/wheel/unitxt/catalog/metrics/llm_as_judge/pairwise 2026-01-06T13:30:28,109 creating build/bdist.linux-armv7l/wheel/unitxt/catalog/metrics/llm_as_judge/pairwise/aws 2026-01-06T13:30:28,111 copying build/lib/unitxt/catalog/metrics/llm_as_judge/pairwise/aws/deepseek_v3.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/metrics/llm_as_judge/pairwise/aws 2026-01-06T13:30:28,112 copying build/lib/unitxt/catalog/metrics/llm_as_judge/pairwise/aws/llama4_maverick.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/metrics/llm_as_judge/pairwise/aws 2026-01-06T13:30:28,114 copying build/lib/unitxt/catalog/metrics/llm_as_judge/pairwise/aws/llama4_scout.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/metrics/llm_as_judge/pairwise/aws 2026-01-06T13:30:28,116 copying build/lib/unitxt/catalog/metrics/llm_as_judge/pairwise/aws/llama3_1_405b.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/metrics/llm_as_judge/pairwise/aws 2026-01-06T13:30:28,118 copying build/lib/unitxt/catalog/metrics/llm_as_judge/pairwise/aws/llama3_3_70b.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/metrics/llm_as_judge/pairwise/aws 2026-01-06T13:30:28,119 copying build/lib/unitxt/catalog/metrics/llm_as_judge/pairwise/aws/mixtral_large.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/metrics/llm_as_judge/pairwise/aws 2026-01-06T13:30:28,122 creating build/bdist.linux-armv7l/wheel/unitxt/catalog/metrics/llm_as_judge/pairwise/openai 2026-01-06T13:30:28,123 copying build/lib/unitxt/catalog/metrics/llm_as_judge/pairwise/openai/o1_preview.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/metrics/llm_as_judge/pairwise/openai 2026-01-06T13:30:28,125 copying build/lib/unitxt/catalog/metrics/llm_as_judge/pairwise/openai/o1_mini.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/metrics/llm_as_judge/pairwise/openai 2026-01-06T13:30:28,126 copying build/lib/unitxt/catalog/metrics/llm_as_judge/pairwise/openai/gpt_4_1_nano.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/metrics/llm_as_judge/pairwise/openai 2026-01-06T13:30:28,128 copying build/lib/unitxt/catalog/metrics/llm_as_judge/pairwise/openai/gpt_4_1.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/metrics/llm_as_judge/pairwise/openai 2026-01-06T13:30:28,129 copying build/lib/unitxt/catalog/metrics/llm_as_judge/pairwise/openai/gpt_4_1_mini.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/metrics/llm_as_judge/pairwise/openai 2026-01-06T13:30:28,131 copying build/lib/unitxt/catalog/metrics/llm_as_judge/pairwise/openai/gpt_4o.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/metrics/llm_as_judge/pairwise/openai 2026-01-06T13:30:28,133 creating build/bdist.linux-armv7l/wheel/unitxt/catalog/metrics/llm_as_judge/pairwise/replicate 2026-01-06T13:30:28,134 copying build/lib/unitxt/catalog/metrics/llm_as_judge/pairwise/replicate/llama4_maverick.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/metrics/llm_as_judge/pairwise/replicate 2026-01-06T13:30:28,136 copying build/lib/unitxt/catalog/metrics/llm_as_judge/pairwise/replicate/llama4_scout.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/metrics/llm_as_judge/pairwise/replicate 2026-01-06T13:30:28,138 copying build/lib/unitxt/catalog/metrics/llm_as_judge/pairwise/replicate/gpt_4_1.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/metrics/llm_as_judge/pairwise/replicate 2026-01-06T13:30:28,140 creating build/bdist.linux-armv7l/wheel/unitxt/catalog/metrics/llm_as_judge/pairwise/together_ai 2026-01-06T13:30:28,141 copying build/lib/unitxt/catalog/metrics/llm_as_judge/pairwise/together_ai/deepseek_v3.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/metrics/llm_as_judge/pairwise/together_ai 2026-01-06T13:30:28,143 copying build/lib/unitxt/catalog/metrics/llm_as_judge/pairwise/together_ai/llama4_maverick.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/metrics/llm_as_judge/pairwise/together_ai 2026-01-06T13:30:28,145 copying build/lib/unitxt/catalog/metrics/llm_as_judge/pairwise/together_ai/llama4_scout.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/metrics/llm_as_judge/pairwise/together_ai 2026-01-06T13:30:28,147 copying build/lib/unitxt/catalog/metrics/llm_as_judge/pairwise/together_ai/llama3_1_405b.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/metrics/llm_as_judge/pairwise/together_ai 2026-01-06T13:30:28,149 copying build/lib/unitxt/catalog/metrics/llm_as_judge/pairwise/together_ai/llama3_3_70b.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/metrics/llm_as_judge/pairwise/together_ai 2026-01-06T13:30:28,151 copying build/lib/unitxt/catalog/metrics/llm_as_judge/pairwise/together_ai/llama3_1_70b.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/metrics/llm_as_judge/pairwise/together_ai 2026-01-06T13:30:28,152 copying build/lib/unitxt/catalog/metrics/llm_as_judge/pairwise/together_ai/llama3_1_8b.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/metrics/llm_as_judge/pairwise/together_ai 2026-01-06T13:30:28,155 creating build/bdist.linux-armv7l/wheel/unitxt/catalog/metrics/llm_as_judge/pairwise/azure_openai 2026-01-06T13:30:28,156 copying build/lib/unitxt/catalog/metrics/llm_as_judge/pairwise/azure_openai/o1_preview.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/metrics/llm_as_judge/pairwise/azure_openai 2026-01-06T13:30:28,158 copying build/lib/unitxt/catalog/metrics/llm_as_judge/pairwise/azure_openai/llama4_maverick.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/metrics/llm_as_judge/pairwise/azure_openai 2026-01-06T13:30:28,160 copying build/lib/unitxt/catalog/metrics/llm_as_judge/pairwise/azure_openai/llama4_scout.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/metrics/llm_as_judge/pairwise/azure_openai 2026-01-06T13:30:28,162 copying build/lib/unitxt/catalog/metrics/llm_as_judge/pairwise/azure_openai/llama3_3_70b.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/metrics/llm_as_judge/pairwise/azure_openai 2026-01-06T13:30:28,163 copying build/lib/unitxt/catalog/metrics/llm_as_judge/pairwise/azure_openai/o1_mini.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/metrics/llm_as_judge/pairwise/azure_openai 2026-01-06T13:30:28,165 copying build/lib/unitxt/catalog/metrics/llm_as_judge/pairwise/azure_openai/gpt_4_1_nano.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/metrics/llm_as_judge/pairwise/azure_openai 2026-01-06T13:30:28,167 copying build/lib/unitxt/catalog/metrics/llm_as_judge/pairwise/azure_openai/gpt_4_1.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/metrics/llm_as_judge/pairwise/azure_openai 2026-01-06T13:30:28,168 copying build/lib/unitxt/catalog/metrics/llm_as_judge/pairwise/azure_openai/gpt_4_1_mini.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/metrics/llm_as_judge/pairwise/azure_openai 2026-01-06T13:30:28,170 copying build/lib/unitxt/catalog/metrics/llm_as_judge/pairwise/azure_openai/gpt_4o.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/metrics/llm_as_judge/pairwise/azure_openai 2026-01-06T13:30:28,172 creating build/bdist.linux-armv7l/wheel/unitxt/catalog/metrics/llm_as_judge/pairwise/rits 2026-01-06T13:30:28,173 copying build/lib/unitxt/catalog/metrics/llm_as_judge/pairwise/rits/deepseek_v3.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/metrics/llm_as_judge/pairwise/rits 2026-01-06T13:30:28,175 copying build/lib/unitxt/catalog/metrics/llm_as_judge/pairwise/rits/llama4_maverick.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/metrics/llm_as_judge/pairwise/rits 2026-01-06T13:30:28,177 copying build/lib/unitxt/catalog/metrics/llm_as_judge/pairwise/rits/llama4_scout.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/metrics/llm_as_judge/pairwise/rits 2026-01-06T13:30:28,179 copying build/lib/unitxt/catalog/metrics/llm_as_judge/pairwise/rits/granite3_3_8b.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/metrics/llm_as_judge/pairwise/rits 2026-01-06T13:30:28,181 copying build/lib/unitxt/catalog/metrics/llm_as_judge/pairwise/rits/llama3_1_405b.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/metrics/llm_as_judge/pairwise/rits 2026-01-06T13:30:28,182 copying build/lib/unitxt/catalog/metrics/llm_as_judge/pairwise/rits/llama3_3_70b.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/metrics/llm_as_judge/pairwise/rits 2026-01-06T13:30:28,184 copying build/lib/unitxt/catalog/metrics/llm_as_judge/pairwise/rits/mixtral8_7b.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/metrics/llm_as_judge/pairwise/rits 2026-01-06T13:30:28,186 copying build/lib/unitxt/catalog/metrics/llm_as_judge/pairwise/rits/llama3_1_8b.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/metrics/llm_as_judge/pairwise/rits 2026-01-06T13:30:28,188 copying build/lib/unitxt/catalog/metrics/llm_as_judge/pairwise/rits/granite3_2_8b.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/metrics/llm_as_judge/pairwise/rits 2026-01-06T13:30:28,189 copying build/lib/unitxt/catalog/metrics/llm_as_judge/pairwise/rits/mixtral_large.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/metrics/llm_as_judge/pairwise/rits 2026-01-06T13:30:28,191 copying build/lib/unitxt/catalog/metrics/llm_as_judge/pairwise/rits/granite3_0_8b.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/metrics/llm_as_judge/pairwise/rits 2026-01-06T13:30:28,193 copying build/lib/unitxt/catalog/metrics/llm_as_judge/pairwise/rits/granite3_1_8b.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/metrics/llm_as_judge/pairwise/rits 2026-01-06T13:30:28,195 creating build/bdist.linux-armv7l/wheel/unitxt/catalog/metrics/llm_as_judge/pairwise/watsonx 2026-01-06T13:30:28,197 copying build/lib/unitxt/catalog/metrics/llm_as_judge/pairwise/watsonx/granite3_3_8b.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/metrics/llm_as_judge/pairwise/watsonx 2026-01-06T13:30:28,199 copying build/lib/unitxt/catalog/metrics/llm_as_judge/pairwise/watsonx/llama3_1_405b.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/metrics/llm_as_judge/pairwise/watsonx 2026-01-06T13:30:28,200 copying build/lib/unitxt/catalog/metrics/llm_as_judge/pairwise/watsonx/llama3_3_70b.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/metrics/llm_as_judge/pairwise/watsonx 2026-01-06T13:30:28,202 copying build/lib/unitxt/catalog/metrics/llm_as_judge/pairwise/watsonx/llama3_1_70b.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/metrics/llm_as_judge/pairwise/watsonx 2026-01-06T13:30:28,204 copying build/lib/unitxt/catalog/metrics/llm_as_judge/pairwise/watsonx/mixtral8_7b.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/metrics/llm_as_judge/pairwise/watsonx 2026-01-06T13:30:28,205 copying build/lib/unitxt/catalog/metrics/llm_as_judge/pairwise/watsonx/llama3_1_8b.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/metrics/llm_as_judge/pairwise/watsonx 2026-01-06T13:30:28,207 copying build/lib/unitxt/catalog/metrics/llm_as_judge/pairwise/watsonx/granite3_2_8b.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/metrics/llm_as_judge/pairwise/watsonx 2026-01-06T13:30:28,209 copying build/lib/unitxt/catalog/metrics/llm_as_judge/pairwise/watsonx/mixtral_large.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/metrics/llm_as_judge/pairwise/watsonx 2026-01-06T13:30:28,210 copying build/lib/unitxt/catalog/metrics/llm_as_judge/pairwise/watsonx/granite3_0_8b.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/metrics/llm_as_judge/pairwise/watsonx 2026-01-06T13:30:28,213 creating build/bdist.linux-armv7l/wheel/unitxt/catalog/metrics/llm_as_judge/pairwise/vertex_ai 2026-01-06T13:30:28,214 copying build/lib/unitxt/catalog/metrics/llm_as_judge/pairwise/vertex_ai/gemini_2_5_flash.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/metrics/llm_as_judge/pairwise/vertex_ai 2026-01-06T13:30:28,215 copying build/lib/unitxt/catalog/metrics/llm_as_judge/pairwise/vertex_ai/gemmini_2_5_pro.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/metrics/llm_as_judge/pairwise/vertex_ai 2026-01-06T13:30:28,218 creating build/bdist.linux-armv7l/wheel/unitxt/catalog/metrics/llm_as_judge/pairwise/criteria 2026-01-06T13:30:28,219 copying build/lib/unitxt/catalog/metrics/llm_as_judge/pairwise/criteria/factually_consistent.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/metrics/llm_as_judge/pairwise/criteria 2026-01-06T13:30:28,221 copying build/lib/unitxt/catalog/metrics/llm_as_judge/pairwise/criteria/temperature_in_celsius_and_fahrenheit.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/metrics/llm_as_judge/pairwise/criteria 2026-01-06T13:30:28,223 copying build/lib/unitxt/catalog/metrics/llm_as_judge/pairwise/criteria/inclusivity.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/metrics/llm_as_judge/pairwise/criteria 2026-01-06T13:30:28,225 copying build/lib/unitxt/catalog/metrics/llm_as_judge/pairwise/criteria/reference_document_faithfulness.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/metrics/llm_as_judge/pairwise/criteria 2026-01-06T13:30:28,226 copying build/lib/unitxt/catalog/metrics/llm_as_judge/pairwise/criteria/funny_joke.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/metrics/llm_as_judge/pairwise/criteria 2026-01-06T13:30:28,228 copying build/lib/unitxt/catalog/metrics/llm_as_judge/pairwise/criteria/summarization_preference.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/metrics/llm_as_judge/pairwise/criteria 2026-01-06T13:30:28,230 copying build/lib/unitxt/catalog/metrics/llm_as_judge/pairwise/criteria/email_inclusivity.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/metrics/llm_as_judge/pairwise/criteria 2026-01-06T13:30:28,232 creating build/bdist.linux-armv7l/wheel/unitxt/catalog/metrics/llm_as_judge/pairwise/ollama 2026-01-06T13:30:28,233 copying build/lib/unitxt/catalog/metrics/llm_as_judge/pairwise/ollama/granite3_3_8b.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/metrics/llm_as_judge/pairwise/ollama 2026-01-06T13:30:28,235 copying build/lib/unitxt/catalog/metrics/llm_as_judge/pairwise/ollama/llama3_1_405b.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/metrics/llm_as_judge/pairwise/ollama 2026-01-06T13:30:28,237 copying build/lib/unitxt/catalog/metrics/llm_as_judge/pairwise/ollama/llama3_3_70b.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/metrics/llm_as_judge/pairwise/ollama 2026-01-06T13:30:28,239 copying build/lib/unitxt/catalog/metrics/llm_as_judge/pairwise/ollama/llama3_1_70b.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/metrics/llm_as_judge/pairwise/ollama 2026-01-06T13:30:28,240 copying build/lib/unitxt/catalog/metrics/llm_as_judge/pairwise/ollama/llama3_1_8b.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/metrics/llm_as_judge/pairwise/ollama 2026-01-06T13:30:28,243 creating build/bdist.linux-armv7l/wheel/unitxt/catalog/metrics/llm_as_judge/safety 2026-01-06T13:30:28,244 copying build/lib/unitxt/catalog/metrics/llm_as_judge/safety/llama_3_3_70b_instruct_ibm_watsonx_template_harm_rating.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/metrics/llm_as_judge/safety 2026-01-06T13:30:28,246 copying build/lib/unitxt/catalog/metrics/llm_as_judge/safety/llamaguard.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/metrics/llm_as_judge/safety 2026-01-06T13:30:28,248 creating build/bdist.linux-armv7l/wheel/unitxt/catalog/metrics/llm_as_judge/pairwise_comparative_rating 2026-01-06T13:30:28,249 copying build/lib/unitxt/catalog/metrics/llm_as_judge/pairwise_comparative_rating/llama_3_70b_instruct_generic_engine_template_arena_hard.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/metrics/llm_as_judge/pairwise_comparative_rating 2026-01-06T13:30:28,251 creating build/bdist.linux-armv7l/wheel/unitxt/catalog/metrics/llm_as_judge/pairwise_comparative_rating/llama_3_8b_instruct 2026-01-06T13:30:28,252 copying build/lib/unitxt/catalog/metrics/llm_as_judge/pairwise_comparative_rating/llama_3_8b_instruct/template_arena_hard.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/metrics/llm_as_judge/pairwise_comparative_rating/llama_3_8b_instruct 2026-01-06T13:30:28,254 copying build/lib/unitxt/catalog/metrics/llm_as_judge/pairwise_comparative_rating/llama_3_70b_instruct_ibm_wml_template_arena_hard.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/metrics/llm_as_judge/pairwise_comparative_rating 2026-01-06T13:30:28,256 copying build/lib/unitxt/catalog/metrics/llm_as_judge/pairwise_comparative_rating/llama_3_70b_instruct_ibm_wml_template_arena_hard_with_shuffling.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/metrics/llm_as_judge/pairwise_comparative_rating 2026-01-06T13:30:28,258 creating build/bdist.linux-armv7l/wheel/unitxt/catalog/metrics/llm_as_judge/pairwise_comparative_rating/llama_3_3_70b_instruct 2026-01-06T13:30:28,259 copying build/lib/unitxt/catalog/metrics/llm_as_judge/pairwise_comparative_rating/llama_3_3_70b_instruct/template_arena_hard.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/metrics/llm_as_judge/pairwise_comparative_rating/llama_3_3_70b_instruct 2026-01-06T13:30:28,262 creating build/bdist.linux-armv7l/wheel/unitxt/catalog/metrics/llm_as_judge/pairwise_comparative_rating/llama_3_70b_instruct 2026-01-06T13:30:28,263 copying build/lib/unitxt/catalog/metrics/llm_as_judge/pairwise_comparative_rating/llama_3_70b_instruct/template_arena_hard.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/metrics/llm_as_judge/pairwise_comparative_rating/llama_3_70b_instruct 2026-01-06T13:30:28,265 copying build/lib/unitxt/catalog/metrics/llm_as_judge/pairwise_comparative_rating/llama_3_70b_instruct_generic_engine_template_arena_hard_with_shuffling.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/metrics/llm_as_judge/pairwise_comparative_rating 2026-01-06T13:30:28,267 copying build/lib/unitxt/catalog/metrics/llm_as_judge/pairwise_comparative_rating/llama_3_8b_instruct_generic_engine_template_arena_hard_with_shuffling.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/metrics/llm_as_judge/pairwise_comparative_rating 2026-01-06T13:30:28,269 copying build/lib/unitxt/catalog/metrics/llm_as_judge/pairwise_comparative_rating/llama_3_8b_instruct_generic_engine_template_arena_hard.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/metrics/llm_as_judge/pairwise_comparative_rating 2026-01-06T13:30:28,271 creating build/bdist.linux-armv7l/wheel/unitxt/catalog/metrics/llm_as_judge/direct 2026-01-06T13:30:28,273 creating build/bdist.linux-armv7l/wheel/unitxt/catalog/metrics/llm_as_judge/direct/aws 2026-01-06T13:30:28,274 copying build/lib/unitxt/catalog/metrics/llm_as_judge/direct/aws/deepseek_v3.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/metrics/llm_as_judge/direct/aws 2026-01-06T13:30:28,276 copying build/lib/unitxt/catalog/metrics/llm_as_judge/direct/aws/llama4_maverick.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/metrics/llm_as_judge/direct/aws 2026-01-06T13:30:28,277 copying build/lib/unitxt/catalog/metrics/llm_as_judge/direct/aws/llama4_scout.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/metrics/llm_as_judge/direct/aws 2026-01-06T13:30:28,279 copying build/lib/unitxt/catalog/metrics/llm_as_judge/direct/aws/llama3_1_405b.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/metrics/llm_as_judge/direct/aws 2026-01-06T13:30:28,281 copying build/lib/unitxt/catalog/metrics/llm_as_judge/direct/aws/llama3_3_70b.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/metrics/llm_as_judge/direct/aws 2026-01-06T13:30:28,282 copying build/lib/unitxt/catalog/metrics/llm_as_judge/direct/aws/mixtral_large.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/metrics/llm_as_judge/direct/aws 2026-01-06T13:30:28,285 creating build/bdist.linux-armv7l/wheel/unitxt/catalog/metrics/llm_as_judge/direct/openai 2026-01-06T13:30:28,286 copying build/lib/unitxt/catalog/metrics/llm_as_judge/direct/openai/o1_preview.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/metrics/llm_as_judge/direct/openai 2026-01-06T13:30:28,288 copying build/lib/unitxt/catalog/metrics/llm_as_judge/direct/openai/o1_mini.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/metrics/llm_as_judge/direct/openai 2026-01-06T13:30:28,289 copying build/lib/unitxt/catalog/metrics/llm_as_judge/direct/openai/gpt_4_1_nano.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/metrics/llm_as_judge/direct/openai 2026-01-06T13:30:28,291 copying build/lib/unitxt/catalog/metrics/llm_as_judge/direct/openai/gpt_4_1.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/metrics/llm_as_judge/direct/openai 2026-01-06T13:30:28,293 copying build/lib/unitxt/catalog/metrics/llm_as_judge/direct/openai/gpt_4_1_mini.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/metrics/llm_as_judge/direct/openai 2026-01-06T13:30:28,295 copying build/lib/unitxt/catalog/metrics/llm_as_judge/direct/openai/gpt_4o.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/metrics/llm_as_judge/direct/openai 2026-01-06T13:30:28,297 creating build/bdist.linux-armv7l/wheel/unitxt/catalog/metrics/llm_as_judge/direct/replicate 2026-01-06T13:30:28,298 copying build/lib/unitxt/catalog/metrics/llm_as_judge/direct/replicate/llama4_maverick.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/metrics/llm_as_judge/direct/replicate 2026-01-06T13:30:28,300 copying build/lib/unitxt/catalog/metrics/llm_as_judge/direct/replicate/llama4_scout.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/metrics/llm_as_judge/direct/replicate 2026-01-06T13:30:28,302 copying build/lib/unitxt/catalog/metrics/llm_as_judge/direct/replicate/gpt_4_1.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/metrics/llm_as_judge/direct/replicate 2026-01-06T13:30:28,304 creating build/bdist.linux-armv7l/wheel/unitxt/catalog/metrics/llm_as_judge/direct/together_ai 2026-01-06T13:30:28,305 copying build/lib/unitxt/catalog/metrics/llm_as_judge/direct/together_ai/deepseek_v3.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/metrics/llm_as_judge/direct/together_ai 2026-01-06T13:30:28,307 copying build/lib/unitxt/catalog/metrics/llm_as_judge/direct/together_ai/llama4_maverick.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/metrics/llm_as_judge/direct/together_ai 2026-01-06T13:30:28,309 copying build/lib/unitxt/catalog/metrics/llm_as_judge/direct/together_ai/llama4_scout.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/metrics/llm_as_judge/direct/together_ai 2026-01-06T13:30:28,310 copying build/lib/unitxt/catalog/metrics/llm_as_judge/direct/together_ai/llama3_1_405b.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/metrics/llm_as_judge/direct/together_ai 2026-01-06T13:30:28,312 copying build/lib/unitxt/catalog/metrics/llm_as_judge/direct/together_ai/llama3_3_70b.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/metrics/llm_as_judge/direct/together_ai 2026-01-06T13:30:28,314 copying build/lib/unitxt/catalog/metrics/llm_as_judge/direct/together_ai/llama3_1_70b.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/metrics/llm_as_judge/direct/together_ai 2026-01-06T13:30:28,315 copying build/lib/unitxt/catalog/metrics/llm_as_judge/direct/together_ai/llama3_1_8b.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/metrics/llm_as_judge/direct/together_ai 2026-01-06T13:30:28,317 creating build/bdist.linux-armv7l/wheel/unitxt/catalog/metrics/llm_as_judge/direct/azure_openai 2026-01-06T13:30:28,319 copying build/lib/unitxt/catalog/metrics/llm_as_judge/direct/azure_openai/o1_preview.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/metrics/llm_as_judge/direct/azure_openai 2026-01-06T13:30:28,321 copying build/lib/unitxt/catalog/metrics/llm_as_judge/direct/azure_openai/llama4_maverick.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/metrics/llm_as_judge/direct/azure_openai 2026-01-06T13:30:28,322 copying build/lib/unitxt/catalog/metrics/llm_as_judge/direct/azure_openai/llama4_scout.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/metrics/llm_as_judge/direct/azure_openai 2026-01-06T13:30:28,324 copying build/lib/unitxt/catalog/metrics/llm_as_judge/direct/azure_openai/llama3_3_70b.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/metrics/llm_as_judge/direct/azure_openai 2026-01-06T13:30:28,326 copying build/lib/unitxt/catalog/metrics/llm_as_judge/direct/azure_openai/o1_mini.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/metrics/llm_as_judge/direct/azure_openai 2026-01-06T13:30:28,328 copying build/lib/unitxt/catalog/metrics/llm_as_judge/direct/azure_openai/gpt_4_1_nano.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/metrics/llm_as_judge/direct/azure_openai 2026-01-06T13:30:28,330 copying build/lib/unitxt/catalog/metrics/llm_as_judge/direct/azure_openai/gpt_4_1.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/metrics/llm_as_judge/direct/azure_openai 2026-01-06T13:30:28,331 copying build/lib/unitxt/catalog/metrics/llm_as_judge/direct/azure_openai/gpt_4_1_mini.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/metrics/llm_as_judge/direct/azure_openai 2026-01-06T13:30:28,333 copying build/lib/unitxt/catalog/metrics/llm_as_judge/direct/azure_openai/gpt_4o.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/metrics/llm_as_judge/direct/azure_openai 2026-01-06T13:30:28,336 creating build/bdist.linux-armv7l/wheel/unitxt/catalog/metrics/llm_as_judge/direct/rits 2026-01-06T13:30:28,337 copying build/lib/unitxt/catalog/metrics/llm_as_judge/direct/rits/deepseek_v3.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/metrics/llm_as_judge/direct/rits 2026-01-06T13:30:28,339 copying build/lib/unitxt/catalog/metrics/llm_as_judge/direct/rits/llama4_maverick.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/metrics/llm_as_judge/direct/rits 2026-01-06T13:30:28,340 copying build/lib/unitxt/catalog/metrics/llm_as_judge/direct/rits/llama4_scout.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/metrics/llm_as_judge/direct/rits 2026-01-06T13:30:28,342 copying build/lib/unitxt/catalog/metrics/llm_as_judge/direct/rits/granite3_3_8b.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/metrics/llm_as_judge/direct/rits 2026-01-06T13:30:28,344 copying build/lib/unitxt/catalog/metrics/llm_as_judge/direct/rits/llama3_1_405b.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/metrics/llm_as_judge/direct/rits 2026-01-06T13:30:28,347 copying build/lib/unitxt/catalog/metrics/llm_as_judge/direct/rits/llama3_3_70b.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/metrics/llm_as_judge/direct/rits 2026-01-06T13:30:28,349 copying build/lib/unitxt/catalog/metrics/llm_as_judge/direct/rits/mixtral8_7b.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/metrics/llm_as_judge/direct/rits 2026-01-06T13:30:28,350 copying build/lib/unitxt/catalog/metrics/llm_as_judge/direct/rits/llama3_1_8b.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/metrics/llm_as_judge/direct/rits 2026-01-06T13:30:28,352 copying build/lib/unitxt/catalog/metrics/llm_as_judge/direct/rits/granite3_2_8b.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/metrics/llm_as_judge/direct/rits 2026-01-06T13:30:28,354 copying build/lib/unitxt/catalog/metrics/llm_as_judge/direct/rits/mixtral_large.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/metrics/llm_as_judge/direct/rits 2026-01-06T13:30:28,356 copying build/lib/unitxt/catalog/metrics/llm_as_judge/direct/rits/granite3_0_8b.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/metrics/llm_as_judge/direct/rits 2026-01-06T13:30:28,358 copying build/lib/unitxt/catalog/metrics/llm_as_judge/direct/rits/granite3_1_8b.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/metrics/llm_as_judge/direct/rits 2026-01-06T13:30:28,360 creating build/bdist.linux-armv7l/wheel/unitxt/catalog/metrics/llm_as_judge/direct/watsonx 2026-01-06T13:30:28,361 copying build/lib/unitxt/catalog/metrics/llm_as_judge/direct/watsonx/granite3_3_8b.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/metrics/llm_as_judge/direct/watsonx 2026-01-06T13:30:28,364 copying build/lib/unitxt/catalog/metrics/llm_as_judge/direct/watsonx/llama3_1_405b.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/metrics/llm_as_judge/direct/watsonx 2026-01-06T13:30:28,365 copying build/lib/unitxt/catalog/metrics/llm_as_judge/direct/watsonx/llama3_3_70b.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/metrics/llm_as_judge/direct/watsonx 2026-01-06T13:30:28,367 copying build/lib/unitxt/catalog/metrics/llm_as_judge/direct/watsonx/llama3_1_70b.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/metrics/llm_as_judge/direct/watsonx 2026-01-06T13:30:28,369 copying build/lib/unitxt/catalog/metrics/llm_as_judge/direct/watsonx/mixtral8_7b.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/metrics/llm_as_judge/direct/watsonx 2026-01-06T13:30:28,371 copying build/lib/unitxt/catalog/metrics/llm_as_judge/direct/watsonx/llama3_1_8b.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/metrics/llm_as_judge/direct/watsonx 2026-01-06T13:30:28,373 copying build/lib/unitxt/catalog/metrics/llm_as_judge/direct/watsonx/granite3_2_8b.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/metrics/llm_as_judge/direct/watsonx 2026-01-06T13:30:28,375 copying build/lib/unitxt/catalog/metrics/llm_as_judge/direct/watsonx/mixtral_large.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/metrics/llm_as_judge/direct/watsonx 2026-01-06T13:30:28,376 copying build/lib/unitxt/catalog/metrics/llm_as_judge/direct/watsonx/granite3_0_8b.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/metrics/llm_as_judge/direct/watsonx 2026-01-06T13:30:28,379 creating build/bdist.linux-armv7l/wheel/unitxt/catalog/metrics/llm_as_judge/direct/vertex_ai 2026-01-06T13:30:28,380 copying build/lib/unitxt/catalog/metrics/llm_as_judge/direct/vertex_ai/gemini_2_5_flash.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/metrics/llm_as_judge/direct/vertex_ai 2026-01-06T13:30:28,382 copying build/lib/unitxt/catalog/metrics/llm_as_judge/direct/vertex_ai/gemmini_2_5_pro.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/metrics/llm_as_judge/direct/vertex_ai 2026-01-06T13:30:28,385 creating build/bdist.linux-armv7l/wheel/unitxt/catalog/metrics/llm_as_judge/direct/criteria 2026-01-06T13:30:28,386 copying build/lib/unitxt/catalog/metrics/llm_as_judge/direct/criteria/insensitivity.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/metrics/llm_as_judge/direct/criteria 2026-01-06T13:30:28,388 copying build/lib/unitxt/catalog/metrics/llm_as_judge/direct/criteria/user_message_unethical_behavior.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/metrics/llm_as_judge/direct/criteria 2026-01-06T13:30:28,390 copying build/lib/unitxt/catalog/metrics/llm_as_judge/direct/criteria/consistency.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/metrics/llm_as_judge/direct/criteria 2026-01-06T13:30:28,392 copying build/lib/unitxt/catalog/metrics/llm_as_judge/direct/criteria/manipulative_email.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/metrics/llm_as_judge/direct/criteria 2026-01-06T13:30:28,394 copying build/lib/unitxt/catalog/metrics/llm_as_judge/direct/criteria/naturalness.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/metrics/llm_as_judge/direct/criteria 2026-01-06T13:30:28,395 copying build/lib/unitxt/catalog/metrics/llm_as_judge/direct/criteria/user_message_general_harm.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/metrics/llm_as_judge/direct/criteria 2026-01-06T13:30:28,397 copying build/lib/unitxt/catalog/metrics/llm_as_judge/direct/criteria/assistant_message_groundedness.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/metrics/llm_as_judge/direct/criteria 2026-01-06T13:30:28,399 copying build/lib/unitxt/catalog/metrics/llm_as_judge/direct/criteria/assistant_message_unethical_behavior.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/metrics/llm_as_judge/direct/criteria 2026-01-06T13:30:28,401 copying build/lib/unitxt/catalog/metrics/llm_as_judge/direct/criteria/email_effectiveness.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/metrics/llm_as_judge/direct/criteria 2026-01-06T13:30:28,403 copying build/lib/unitxt/catalog/metrics/llm_as_judge/direct/criteria/irrelevant_information.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/metrics/llm_as_judge/direct/criteria 2026-01-06T13:30:28,405 copying build/lib/unitxt/catalog/metrics/llm_as_judge/direct/criteria/toxicity.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/metrics/llm_as_judge/direct/criteria 2026-01-06T13:30:28,407 copying build/lib/unitxt/catalog/metrics/llm_as_judge/direct/criteria/logical_validity_of_reasoning.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/metrics/llm_as_judge/direct/criteria 2026-01-06T13:30:28,409 copying build/lib/unitxt/catalog/metrics/llm_as_judge/direct/criteria/examples_and_details.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/metrics/llm_as_judge/direct/criteria 2026-01-06T13:30:28,411 copying build/lib/unitxt/catalog/metrics/llm_as_judge/direct/criteria/step_by_step_reasoning_bad_grammar.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/metrics/llm_as_judge/direct/criteria 2026-01-06T13:30:28,413 copying build/lib/unitxt/catalog/metrics/llm_as_judge/direct/criteria/grammar_and_punctuation.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/metrics/llm_as_judge/direct/criteria 2026-01-06T13:30:28,414 copying build/lib/unitxt/catalog/metrics/llm_as_judge/direct/criteria/harmfulness.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/metrics/llm_as_judge/direct/criteria 2026-01-06T13:30:28,416 copying build/lib/unitxt/catalog/metrics/llm_as_judge/direct/criteria/temperature_in_celsius_and_fahrenheit.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/metrics/llm_as_judge/direct/criteria 2026-01-06T13:30:28,418 copying build/lib/unitxt/catalog/metrics/llm_as_judge/direct/criteria/step_by_step_reasoning_contradiction.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/metrics/llm_as_judge/direct/criteria 2026-01-06T13:30:28,420 copying build/lib/unitxt/catalog/metrics/llm_as_judge/direct/criteria/step_by_step_reasoning_hallucination.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/metrics/llm_as_judge/direct/criteria 2026-01-06T13:30:28,422 copying build/lib/unitxt/catalog/metrics/llm_as_judge/direct/criteria/user_message_jailbreak.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/metrics/llm_as_judge/direct/criteria 2026-01-06T13:30:28,423 copying build/lib/unitxt/catalog/metrics/llm_as_judge/direct/criteria/information_outside_reference.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/metrics/llm_as_judge/direct/criteria 2026-01-06T13:30:28,425 copying build/lib/unitxt/catalog/metrics/llm_as_judge/direct/criteria/conversational.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/metrics/llm_as_judge/direct/criteria 2026-01-06T13:30:28,427 copying build/lib/unitxt/catalog/metrics/llm_as_judge/direct/criteria/answer_relevance.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/metrics/llm_as_judge/direct/criteria 2026-01-06T13:30:28,429 copying build/lib/unitxt/catalog/metrics/llm_as_judge/direct/criteria/user_message_profanity.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/metrics/llm_as_judge/direct/criteria 2026-01-06T13:30:28,430 copying build/lib/unitxt/catalog/metrics/llm_as_judge/direct/criteria/step_by_step_reasoning_arithmetic.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/metrics/llm_as_judge/direct/criteria 2026-01-06T13:30:28,432 copying build/lib/unitxt/catalog/metrics/llm_as_judge/direct/criteria/summarization_coherence.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/metrics/llm_as_judge/direct/criteria 2026-01-06T13:30:28,434 copying build/lib/unitxt/catalog/metrics/llm_as_judge/direct/criteria/answer_completeness.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/metrics/llm_as_judge/direct/criteria 2026-01-06T13:30:28,436 copying build/lib/unitxt/catalog/metrics/llm_as_judge/direct/criteria/engagement.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/metrics/llm_as_judge/direct/criteria 2026-01-06T13:30:28,438 copying build/lib/unitxt/catalog/metrics/llm_as_judge/direct/criteria/step_by_step_reasoning_coherency.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/metrics/llm_as_judge/direct/criteria 2026-01-06T13:30:28,440 copying build/lib/unitxt/catalog/metrics/llm_as_judge/direct/criteria/step_by_step_reasoning_commonsense.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/metrics/llm_as_judge/direct/criteria 2026-01-06T13:30:28,442 copying build/lib/unitxt/catalog/metrics/llm_as_judge/direct/criteria/reference_document_faithfulness.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/metrics/llm_as_judge/direct/criteria 2026-01-06T13:30:28,444 copying build/lib/unitxt/catalog/metrics/llm_as_judge/direct/criteria/assistant_message_compliance.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/metrics/llm_as_judge/direct/criteria 2026-01-06T13:30:28,445 copying build/lib/unitxt/catalog/metrics/llm_as_judge/direct/criteria/coherence.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/metrics/llm_as_judge/direct/criteria 2026-01-06T13:30:28,447 copying build/lib/unitxt/catalog/metrics/llm_as_judge/direct/criteria/summarization_relevance.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/metrics/llm_as_judge/direct/criteria 2026-01-06T13:30:28,449 copying build/lib/unitxt/catalog/metrics/llm_as_judge/direct/criteria/step_by_step_reasoning_non_coherent.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/metrics/llm_as_judge/direct/criteria 2026-01-06T13:30:28,451 copying build/lib/unitxt/catalog/metrics/llm_as_judge/direct/criteria/empathy.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/metrics/llm_as_judge/direct/criteria 2026-01-06T13:30:28,452 copying build/lib/unitxt/catalog/metrics/llm_as_judge/direct/criteria/summarization_fluency.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/metrics/llm_as_judge/direct/criteria 2026-01-06T13:30:28,454 copying build/lib/unitxt/catalog/metrics/llm_as_judge/direct/criteria/question_answer_quality.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/metrics/llm_as_judge/direct/criteria 2026-01-06T13:30:28,456 copying build/lib/unitxt/catalog/metrics/llm_as_judge/direct/criteria/relevance.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/metrics/llm_as_judge/direct/criteria 2026-01-06T13:30:28,458 copying build/lib/unitxt/catalog/metrics/llm_as_judge/direct/criteria/assistant_message_violence.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/metrics/llm_as_judge/direct/criteria 2026-01-06T13:30:28,460 copying build/lib/unitxt/catalog/metrics/llm_as_judge/direct/criteria/objectivity.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/metrics/llm_as_judge/direct/criteria 2026-01-06T13:30:28,461 copying build/lib/unitxt/catalog/metrics/llm_as_judge/direct/criteria/step_by_step_reasoning_overall_quality.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/metrics/llm_as_judge/direct/criteria 2026-01-06T13:30:28,463 copying build/lib/unitxt/catalog/metrics/llm_as_judge/direct/criteria/user_message_social_bias.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/metrics/llm_as_judge/direct/criteria 2026-01-06T13:30:28,465 copying build/lib/unitxt/catalog/metrics/llm_as_judge/direct/criteria/email_structure.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/metrics/llm_as_judge/direct/criteria 2026-01-06T13:30:28,466 copying build/lib/unitxt/catalog/metrics/llm_as_judge/direct/criteria/summarization_preference.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/metrics/llm_as_judge/direct/criteria 2026-01-06T13:30:28,468 copying build/lib/unitxt/catalog/metrics/llm_as_judge/direct/criteria/summarization_informativeness.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/metrics/llm_as_judge/direct/criteria 2026-01-06T13:30:28,470 copying build/lib/unitxt/catalog/metrics/llm_as_judge/direct/criteria/truthfulness.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/metrics/llm_as_judge/direct/criteria 2026-01-06T13:30:28,472 copying build/lib/unitxt/catalog/metrics/llm_as_judge/direct/criteria/fluency.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/metrics/llm_as_judge/direct/criteria 2026-01-06T13:30:28,474 copying build/lib/unitxt/catalog/metrics/llm_as_judge/direct/criteria/tool_calling_correctness.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/metrics/llm_as_judge/direct/criteria 2026-01-06T13:30:28,476 copying build/lib/unitxt/catalog/metrics/llm_as_judge/direct/criteria/step_by_step_reasoning_non_factual.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/metrics/llm_as_judge/direct/criteria 2026-01-06T13:30:28,477 copying build/lib/unitxt/catalog/metrics/llm_as_judge/direct/criteria/context_context_relevance.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/metrics/llm_as_judge/direct/criteria 2026-01-06T13:30:28,479 copying build/lib/unitxt/catalog/metrics/llm_as_judge/direct/criteria/adherence_with_format.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/metrics/llm_as_judge/direct/criteria 2026-01-06T13:30:28,481 copying build/lib/unitxt/catalog/metrics/llm_as_judge/direct/criteria/step_by_step_reasoning_redundancy.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/metrics/llm_as_judge/direct/criteria 2026-01-06T13:30:28,483 copying build/lib/unitxt/catalog/metrics/llm_as_judge/direct/criteria/assistant_message_social_bias.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/metrics/llm_as_judge/direct/criteria 2026-01-06T13:30:28,485 copying build/lib/unitxt/catalog/metrics/llm_as_judge/direct/criteria/step_by_step_reasoning_missing_steps.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/metrics/llm_as_judge/direct/criteria 2026-01-06T13:30:28,487 copying build/lib/unitxt/catalog/metrics/llm_as_judge/direct/criteria/assistant_message_answer_relevance.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/metrics/llm_as_judge/direct/criteria 2026-01-06T13:30:28,488 copying build/lib/unitxt/catalog/metrics/llm_as_judge/direct/criteria/professional_tone.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/metrics/llm_as_judge/direct/criteria 2026-01-06T13:30:28,490 copying build/lib/unitxt/catalog/metrics/llm_as_judge/direct/criteria/user_message_violence.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/metrics/llm_as_judge/direct/criteria 2026-01-06T13:30:28,492 copying build/lib/unitxt/catalog/metrics/llm_as_judge/direct/criteria/conciseness.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/metrics/llm_as_judge/direct/criteria 2026-01-06T13:30:28,493 copying build/lib/unitxt/catalog/metrics/llm_as_judge/direct/criteria/translation_quality.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/metrics/llm_as_judge/direct/criteria 2026-01-06T13:30:28,495 copying build/lib/unitxt/catalog/metrics/llm_as_judge/direct/criteria/information_from_reference.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/metrics/llm_as_judge/direct/criteria 2026-01-06T13:30:28,497 copying build/lib/unitxt/catalog/metrics/llm_as_judge/direct/criteria/step_by_step_reasoning_repetition.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/metrics/llm_as_judge/direct/criteria 2026-01-06T13:30:28,499 copying build/lib/unitxt/catalog/metrics/llm_as_judge/direct/criteria/assistant_message_general_harm.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/metrics/llm_as_judge/direct/criteria 2026-01-06T13:30:28,500 copying build/lib/unitxt/catalog/metrics/llm_as_judge/direct/criteria/assistant_message_profanity.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/metrics/llm_as_judge/direct/criteria 2026-01-06T13:30:28,502 copying build/lib/unitxt/catalog/metrics/llm_as_judge/direct/criteria/step_by_step_reasoning_bad_final_answer.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/metrics/llm_as_judge/direct/criteria 2026-01-06T13:30:28,504 copying build/lib/unitxt/catalog/metrics/llm_as_judge/direct/criteria/correctness_based_on_ground_truth.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/metrics/llm_as_judge/direct/criteria 2026-01-06T13:30:28,506 creating build/bdist.linux-armv7l/wheel/unitxt/catalog/metrics/llm_as_judge/direct/ollama 2026-01-06T13:30:28,510 copying build/lib/unitxt/catalog/metrics/llm_as_judge/direct/ollama/granite3_3_8b.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/metrics/llm_as_judge/direct/ollama 2026-01-06T13:30:28,511 copying build/lib/unitxt/catalog/metrics/llm_as_judge/direct/ollama/llama3_1_405b.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/metrics/llm_as_judge/direct/ollama 2026-01-06T13:30:28,513 copying build/lib/unitxt/catalog/metrics/llm_as_judge/direct/ollama/llama3_3_70b.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/metrics/llm_as_judge/direct/ollama 2026-01-06T13:30:28,515 copying build/lib/unitxt/catalog/metrics/llm_as_judge/direct/ollama/llama3_1_70b.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/metrics/llm_as_judge/direct/ollama 2026-01-06T13:30:28,517 copying build/lib/unitxt/catalog/metrics/llm_as_judge/direct/ollama/llama3_1_8b.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/metrics/llm_as_judge/direct/ollama 2026-01-06T13:30:28,519 copying build/lib/unitxt/catalog/metrics/relaxed_correctness.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/metrics 2026-01-06T13:30:28,521 copying build/lib/unitxt/catalog/metrics/is_code_mixed.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/metrics 2026-01-06T13:30:28,523 copying build/lib/unitxt/catalog/metrics/metric_based_ner.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/metrics 2026-01-06T13:30:28,524 copying build/lib/unitxt/catalog/metrics/precision_micro_multi_label.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/metrics 2026-01-06T13:30:28,526 copying build/lib/unitxt/catalog/metrics/char_edit_distance.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/metrics 2026-01-06T13:30:28,528 copying build/lib/unitxt/catalog/metrics/squad.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/metrics 2026-01-06T13:30:28,530 copying build/lib/unitxt/catalog/metrics/char_edit_dist_accuracy.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/metrics 2026-01-06T13:30:28,532 copying build/lib/unitxt/catalog/metrics/string_containment_ratio.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/metrics 2026-01-06T13:30:28,533 copying build/lib/unitxt/catalog/metrics/recall_macro_multi_label.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/metrics 2026-01-06T13:30:28,535 copying build/lib/unitxt/catalog/metrics/accuracy.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/metrics 2026-01-06T13:30:28,538 creating build/bdist.linux-armv7l/wheel/unitxt/catalog/metrics/key_value_extraction 2026-01-06T13:30:28,539 copying build/lib/unitxt/catalog/metrics/key_value_extraction/token_overlap.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/metrics/key_value_extraction 2026-01-06T13:30:28,541 copying build/lib/unitxt/catalog/metrics/key_value_extraction/accuracy.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/metrics/key_value_extraction 2026-01-06T13:30:28,542 copying build/lib/unitxt/catalog/metrics/f1_binary.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/metrics 2026-01-06T13:30:28,544 copying build/lib/unitxt/catalog/metrics/anls.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/metrics 2026-01-06T13:30:28,546 copying build/lib/unitxt/catalog/metrics/unsorted_list_exact_match.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/metrics 2026-01-06T13:30:28,547 copying build/lib/unitxt/catalog/metrics/precision_binary.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/metrics 2026-01-06T13:30:28,550 creating build/bdist.linux-armv7l/wheel/unitxt/catalog/metrics/rag 2026-01-06T13:30:28,551 copying build/lib/unitxt/catalog/metrics/rag/granite_guardian_context_relevance.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/metrics/rag 2026-01-06T13:30:28,553 creating build/bdist.linux-armv7l/wheel/unitxt/catalog/metrics/rag/faithfulness 2026-01-06T13:30:28,554 copying build/lib/unitxt/catalog/metrics/rag/faithfulness/llama_3_3_70b_instruct_wml_q_c_a.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/metrics/rag/faithfulness 2026-01-06T13:30:28,556 copying build/lib/unitxt/catalog/metrics/rag/faithfulness/sentence_bert_mini_lm.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/metrics/rag/faithfulness 2026-01-06T13:30:28,558 copying build/lib/unitxt/catalog/metrics/rag/faithfulness/llama_3_3_70b_instruct_wml_q_c_a_verbal.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/metrics/rag/faithfulness 2026-01-06T13:30:28,560 copying build/lib/unitxt/catalog/metrics/rag/faithfulness/generic_inference_engine_q_c_a.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/metrics/rag/faithfulness 2026-01-06T13:30:28,562 copying build/lib/unitxt/catalog/metrics/rag/faithfulness/vectara_hhem_2_1.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/metrics/rag/faithfulness 2026-01-06T13:30:28,563 copying build/lib/unitxt/catalog/metrics/rag/faithfulness/llama_3_3_70b_instruct_wml_q_c_a_logprobs.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/metrics/rag/faithfulness 2026-01-06T13:30:28,565 copying build/lib/unitxt/catalog/metrics/rag/faithfulness/llama_3_3_70b_instruct_wml_c_a_logprobs.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/metrics/rag/faithfulness 2026-01-06T13:30:28,567 copying build/lib/unitxt/catalog/metrics/rag/faithfulness/bert_score_k_precision.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/metrics/rag/faithfulness 2026-01-06T13:30:28,569 copying build/lib/unitxt/catalog/metrics/rag/faithfulness/generic_inference_engine_c_a_verbal.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/metrics/rag/faithfulness 2026-01-06T13:30:28,571 copying build/lib/unitxt/catalog/metrics/rag/faithfulness/llama_3_3_70b_instruct_wml_c_a_verbal.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/metrics/rag/faithfulness 2026-01-06T13:30:28,572 copying build/lib/unitxt/catalog/metrics/rag/faithfulness/generic_inference_engine_c_a.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/metrics/rag/faithfulness 2026-01-06T13:30:28,574 copying build/lib/unitxt/catalog/metrics/rag/faithfulness/sentence_bert_bge.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/metrics/rag/faithfulness 2026-01-06T13:30:28,576 copying build/lib/unitxt/catalog/metrics/rag/faithfulness/llama_index_by_gpt_3_5_turbo.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/metrics/rag/faithfulness 2026-01-06T13:30:28,577 copying build/lib/unitxt/catalog/metrics/rag/faithfulness/llama_3_3_70b_instruct_wml_c_a.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/metrics/rag/faithfulness 2026-01-06T13:30:28,579 copying build/lib/unitxt/catalog/metrics/rag/faithfulness/llama_index_by_mock.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/metrics/rag/faithfulness 2026-01-06T13:30:28,581 copying build/lib/unitxt/catalog/metrics/rag/faithfulness/token_k_precision.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/metrics/rag/faithfulness 2026-01-06T13:30:28,582 copying build/lib/unitxt/catalog/metrics/rag/faithfulness/bert_score_k_precision_ml.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/metrics/rag/faithfulness 2026-01-06T13:30:28,584 copying build/lib/unitxt/catalog/metrics/rag/faithfulness/generic_inference_engine_q_c_a_verbal.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/metrics/rag/faithfulness 2026-01-06T13:30:28,586 creating build/bdist.linux-armv7l/wheel/unitxt/catalog/metrics/rag/response_generation 2026-01-06T13:30:28,588 creating build/bdist.linux-armv7l/wheel/unitxt/catalog/metrics/rag/response_generation/faithfulness 2026-01-06T13:30:28,589 copying build/lib/unitxt/catalog/metrics/rag/response_generation/faithfulness/sentence_bert_mini_lm.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/metrics/rag/response_generation/faithfulness 2026-01-06T13:30:28,591 copying build/lib/unitxt/catalog/metrics/rag/response_generation/faithfulness/llama_4_maverick_rits_judge.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/metrics/rag/response_generation/faithfulness 2026-01-06T13:30:28,593 copying build/lib/unitxt/catalog/metrics/rag/response_generation/faithfulness/llama_4_maverick_watsonx_judge.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/metrics/rag/response_generation/faithfulness 2026-01-06T13:30:28,595 copying build/lib/unitxt/catalog/metrics/rag/response_generation/faithfulness/mistral_large_instruct_watsonx_judge.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/metrics/rag/response_generation/faithfulness 2026-01-06T13:30:28,596 copying build/lib/unitxt/catalog/metrics/rag/response_generation/faithfulness/vectara_hhem_2_1.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/metrics/rag/response_generation/faithfulness 2026-01-06T13:30:28,598 copying build/lib/unitxt/catalog/metrics/rag/response_generation/faithfulness/bert_score_k_precision.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/metrics/rag/response_generation/faithfulness 2026-01-06T13:30:28,600 copying build/lib/unitxt/catalog/metrics/rag/response_generation/faithfulness/gpt_oss_120b_rits_judge.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/metrics/rag/response_generation/faithfulness 2026-01-06T13:30:28,602 copying build/lib/unitxt/catalog/metrics/rag/response_generation/faithfulness/mistral_large_instruct_rits_judge.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/metrics/rag/response_generation/faithfulness 2026-01-06T13:30:28,603 copying build/lib/unitxt/catalog/metrics/rag/response_generation/faithfulness/generic_inference_engine_judge.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/metrics/rag/response_generation/faithfulness 2026-01-06T13:30:28,605 copying build/lib/unitxt/catalog/metrics/rag/response_generation/faithfulness/sentence_bert_bge.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/metrics/rag/response_generation/faithfulness 2026-01-06T13:30:28,607 copying build/lib/unitxt/catalog/metrics/rag/response_generation/faithfulness/gpt_4o_azure_judge.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/metrics/rag/response_generation/faithfulness 2026-01-06T13:30:28,609 copying build/lib/unitxt/catalog/metrics/rag/response_generation/faithfulness/llama_3_3_70b_instruct_rits_judge.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/metrics/rag/response_generation/faithfulness 2026-01-06T13:30:28,611 copying build/lib/unitxt/catalog/metrics/rag/response_generation/faithfulness/llama_3_3_70b_instruct_watsonx_judge.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/metrics/rag/response_generation/faithfulness 2026-01-06T13:30:28,612 copying build/lib/unitxt/catalog/metrics/rag/response_generation/faithfulness/token_k_precision.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/metrics/rag/response_generation/faithfulness 2026-01-06T13:30:28,614 copying build/lib/unitxt/catalog/metrics/rag/response_generation/faithfulness/gpt_oss_120b_watsonx_judge.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/metrics/rag/response_generation/faithfulness 2026-01-06T13:30:28,616 copying build/lib/unitxt/catalog/metrics/rag/response_generation/faithfulness/bert_score_k_precision_ml.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/metrics/rag/response_generation/faithfulness 2026-01-06T13:30:28,618 copying build/lib/unitxt/catalog/metrics/rag/response_generation/faithfulness/mistral_small_3_1_24b_instruct_2503_wml_judge.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/metrics/rag/response_generation/faithfulness 2026-01-06T13:30:28,620 creating build/bdist.linux-armv7l/wheel/unitxt/catalog/metrics/rag/response_generation/faithfullness 2026-01-06T13:30:28,621 copying build/lib/unitxt/catalog/metrics/rag/response_generation/faithfullness/token_overlap.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/metrics/rag/response_generation/faithfullness 2026-01-06T13:30:28,623 creating build/bdist.linux-armv7l/wheel/unitxt/catalog/metrics/rag/response_generation/answer_correctness 2026-01-06T13:30:28,624 copying build/lib/unitxt/catalog/metrics/rag/response_generation/answer_correctness/bert_score_recall_ml.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/metrics/rag/response_generation/answer_correctness 2026-01-06T13:30:28,626 copying build/lib/unitxt/catalog/metrics/rag/response_generation/answer_correctness/sentence_bert_mini_lm.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/metrics/rag/response_generation/answer_correctness 2026-01-06T13:30:28,628 copying build/lib/unitxt/catalog/metrics/rag/response_generation/answer_correctness/llama_4_maverick_rits_judge.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/metrics/rag/response_generation/answer_correctness 2026-01-06T13:30:28,630 copying build/lib/unitxt/catalog/metrics/rag/response_generation/answer_correctness/llama_4_maverick_watsonx_judge.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/metrics/rag/response_generation/answer_correctness 2026-01-06T13:30:28,631 copying build/lib/unitxt/catalog/metrics/rag/response_generation/answer_correctness/mistral_large_instruct_watsonx_judge.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/metrics/rag/response_generation/answer_correctness 2026-01-06T13:30:28,633 copying build/lib/unitxt/catalog/metrics/rag/response_generation/answer_correctness/bert_score_recall.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/metrics/rag/response_generation/answer_correctness 2026-01-06T13:30:28,635 copying build/lib/unitxt/catalog/metrics/rag/response_generation/answer_correctness/gpt_oss_120b_rits_judge.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/metrics/rag/response_generation/answer_correctness 2026-01-06T13:30:28,637 copying build/lib/unitxt/catalog/metrics/rag/response_generation/answer_correctness/mistral_large_instruct_rits_judge.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/metrics/rag/response_generation/answer_correctness 2026-01-06T13:30:28,638 copying build/lib/unitxt/catalog/metrics/rag/response_generation/answer_correctness/generic_inference_engine_judge.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/metrics/rag/response_generation/answer_correctness 2026-01-06T13:30:28,640 copying build/lib/unitxt/catalog/metrics/rag/response_generation/answer_correctness/sentence_bert_bge.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/metrics/rag/response_generation/answer_correctness 2026-01-06T13:30:28,642 copying build/lib/unitxt/catalog/metrics/rag/response_generation/answer_correctness/gpt_4o_azure_judge.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/metrics/rag/response_generation/answer_correctness 2026-01-06T13:30:28,643 copying build/lib/unitxt/catalog/metrics/rag/response_generation/answer_correctness/llama_3_3_70b_instruct_rits_judge.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/metrics/rag/response_generation/answer_correctness 2026-01-06T13:30:28,645 copying build/lib/unitxt/catalog/metrics/rag/response_generation/answer_correctness/llama_3_3_70b_instruct_watsonx_judge.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/metrics/rag/response_generation/answer_correctness 2026-01-06T13:30:28,647 copying build/lib/unitxt/catalog/metrics/rag/response_generation/answer_correctness/token_recall.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/metrics/rag/response_generation/answer_correctness 2026-01-06T13:30:28,648 copying build/lib/unitxt/catalog/metrics/rag/response_generation/answer_correctness/gpt_oss_120b_watsonx_judge.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/metrics/rag/response_generation/answer_correctness 2026-01-06T13:30:28,650 copying build/lib/unitxt/catalog/metrics/rag/response_generation/answer_correctness/mistral_small_3_1_24b_instruct_2503_wml_judge.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/metrics/rag/response_generation/answer_correctness 2026-01-06T13:30:28,652 creating build/bdist.linux-armv7l/wheel/unitxt/catalog/metrics/rag/response_generation/adherence_with_format 2026-01-06T13:30:28,653 copying build/lib/unitxt/catalog/metrics/rag/response_generation/adherence_with_format/llama_3_3_70b_instruct_judge.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/metrics/rag/response_generation/adherence_with_format 2026-01-06T13:30:28,656 creating build/bdist.linux-armv7l/wheel/unitxt/catalog/metrics/rag/response_generation/answer_completeness 2026-01-06T13:30:28,657 copying build/lib/unitxt/catalog/metrics/rag/response_generation/answer_completeness/llama_3_3_70b_instruct_judge.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/metrics/rag/response_generation/answer_completeness 2026-01-06T13:30:28,659 creating build/bdist.linux-armv7l/wheel/unitxt/catalog/metrics/rag/response_generation/correctness 2026-01-06T13:30:28,661 creating build/bdist.linux-armv7l/wheel/unitxt/catalog/metrics/rag/response_generation/correctness/bert_score 2026-01-06T13:30:28,662 copying build/lib/unitxt/catalog/metrics/rag/response_generation/correctness/bert_score/deberta_v3_base_mnli_xnli_ml.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/metrics/rag/response_generation/correctness/bert_score 2026-01-06T13:30:28,664 copying build/lib/unitxt/catalog/metrics/rag/response_generation/correctness/bert_score/deberta_large_mnli.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/metrics/rag/response_generation/correctness/bert_score 2026-01-06T13:30:28,666 copying build/lib/unitxt/catalog/metrics/rag/response_generation/correctness/token_overlap.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/metrics/rag/response_generation/correctness 2026-01-06T13:30:28,668 creating build/bdist.linux-armv7l/wheel/unitxt/catalog/metrics/rag/response_generation/answer_relevance 2026-01-06T13:30:28,669 copying build/lib/unitxt/catalog/metrics/rag/response_generation/answer_relevance/llama_4_maverick_rits_judge.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/metrics/rag/response_generation/answer_relevance 2026-01-06T13:30:28,671 copying build/lib/unitxt/catalog/metrics/rag/response_generation/answer_relevance/llama_4_maverick_watsonx_judge.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/metrics/rag/response_generation/answer_relevance 2026-01-06T13:30:28,673 copying build/lib/unitxt/catalog/metrics/rag/response_generation/answer_relevance/mistral_large_instruct_watsonx_judge.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/metrics/rag/response_generation/answer_relevance 2026-01-06T13:30:28,675 copying build/lib/unitxt/catalog/metrics/rag/response_generation/answer_relevance/gpt_oss_120b_rits_judge.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/metrics/rag/response_generation/answer_relevance 2026-01-06T13:30:28,676 copying build/lib/unitxt/catalog/metrics/rag/response_generation/answer_relevance/mistral_large_instruct_rits_judge.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/metrics/rag/response_generation/answer_relevance 2026-01-06T13:30:28,678 copying build/lib/unitxt/catalog/metrics/rag/response_generation/answer_relevance/generic_inference_engine_judge.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/metrics/rag/response_generation/answer_relevance 2026-01-06T13:30:28,680 copying build/lib/unitxt/catalog/metrics/rag/response_generation/answer_relevance/gpt_4o_azure_judge.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/metrics/rag/response_generation/answer_relevance 2026-01-06T13:30:28,681 copying build/lib/unitxt/catalog/metrics/rag/response_generation/answer_relevance/llama_3_3_70b_instruct_rits_judge.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/metrics/rag/response_generation/answer_relevance 2026-01-06T13:30:28,683 copying build/lib/unitxt/catalog/metrics/rag/response_generation/answer_relevance/llama_3_3_70b_instruct_watsonx_judge.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/metrics/rag/response_generation/answer_relevance 2026-01-06T13:30:28,685 copying build/lib/unitxt/catalog/metrics/rag/response_generation/answer_relevance/token_recall.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/metrics/rag/response_generation/answer_relevance 2026-01-06T13:30:28,687 copying build/lib/unitxt/catalog/metrics/rag/response_generation/answer_relevance/gpt_oss_120b_watsonx_judge.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/metrics/rag/response_generation/answer_relevance 2026-01-06T13:30:28,689 copying build/lib/unitxt/catalog/metrics/rag/response_generation/answer_relevance/answer_reward.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/metrics/rag/response_generation/answer_relevance 2026-01-06T13:30:28,690 copying build/lib/unitxt/catalog/metrics/rag/response_generation/answer_relevance/mistral_small_3_1_24b_instruct_2503_wml_judge.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/metrics/rag/response_generation/answer_relevance 2026-01-06T13:30:28,693 creating build/bdist.linux-armv7l/wheel/unitxt/catalog/metrics/rag/response_generation/recommended 2026-01-06T13:30:28,694 creating build/bdist.linux-armv7l/wheel/unitxt/catalog/metrics/rag/response_generation/recommended/llmaj_rits 2026-01-06T13:30:28,695 copying build/lib/unitxt/catalog/metrics/rag/response_generation/recommended/llmaj_rits/all.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/metrics/rag/response_generation/recommended/llmaj_rits 2026-01-06T13:30:28,698 creating build/bdist.linux-armv7l/wheel/unitxt/catalog/metrics/rag/response_generation/recommended/small_llm 2026-01-06T13:30:28,699 copying build/lib/unitxt/catalog/metrics/rag/response_generation/recommended/small_llm/all.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/metrics/rag/response_generation/recommended/small_llm 2026-01-06T13:30:28,701 creating build/bdist.linux-armv7l/wheel/unitxt/catalog/metrics/rag/response_generation/recommended/cpu_only 2026-01-06T13:30:28,702 copying build/lib/unitxt/catalog/metrics/rag/response_generation/recommended/cpu_only/all.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/metrics/rag/response_generation/recommended/cpu_only 2026-01-06T13:30:28,704 creating build/bdist.linux-armv7l/wheel/unitxt/catalog/metrics/rag/response_generation/recommended/llmaj_watsonx 2026-01-06T13:30:28,705 copying build/lib/unitxt/catalog/metrics/rag/response_generation/recommended/llmaj_watsonx/all.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/metrics/rag/response_generation/recommended/llmaj_watsonx 2026-01-06T13:30:28,707 creating build/bdist.linux-armv7l/wheel/unitxt/catalog/metrics/rag/response_generation/recommended/llmaj_azure 2026-01-06T13:30:28,708 copying build/lib/unitxt/catalog/metrics/rag/response_generation/recommended/llmaj_azure/all.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/metrics/rag/response_generation/recommended/llmaj_azure 2026-01-06T13:30:28,711 creating build/bdist.linux-armv7l/wheel/unitxt/catalog/metrics/rag/correctness_holistic 2026-01-06T13:30:28,712 copying build/lib/unitxt/catalog/metrics/rag/correctness_holistic/llama_3_3_70b_instruct_wml_q_c_a.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/metrics/rag/correctness_holistic 2026-01-06T13:30:28,714 copying build/lib/unitxt/catalog/metrics/rag/correctness_holistic/generic_inference_engine_q_c_a_numeric.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/metrics/rag/correctness_holistic 2026-01-06T13:30:28,715 copying build/lib/unitxt/catalog/metrics/rag/correctness_holistic/generic_inference_engine_q_c_a.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/metrics/rag/correctness_holistic 2026-01-06T13:30:28,717 copying build/lib/unitxt/catalog/metrics/rag/correctness_holistic/llama_3_3_70b_instruct_wml_q_c_a_logprobs.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/metrics/rag/correctness_holistic 2026-01-06T13:30:28,718 copying build/lib/unitxt/catalog/metrics/rag/correctness_holistic/llama_3_3_70b_instruct_wml_q_c_a_numeric.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/metrics/rag/correctness_holistic 2026-01-06T13:30:28,720 copying build/lib/unitxt/catalog/metrics/rag/context_perplexity.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/metrics/rag 2026-01-06T13:30:28,722 creating build/bdist.linux-armv7l/wheel/unitxt/catalog/metrics/rag/external_rag 2026-01-06T13:30:28,724 creating build/bdist.linux-armv7l/wheel/unitxt/catalog/metrics/rag/external_rag/faithfulness 2026-01-06T13:30:28,725 copying build/lib/unitxt/catalog/metrics/rag/external_rag/faithfulness/sentence_bert_mini_lm.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/metrics/rag/external_rag/faithfulness 2026-01-06T13:30:28,727 copying build/lib/unitxt/catalog/metrics/rag/external_rag/faithfulness/llama_4_maverick_rits_judge.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/metrics/rag/external_rag/faithfulness 2026-01-06T13:30:28,729 copying build/lib/unitxt/catalog/metrics/rag/external_rag/faithfulness/llama_4_maverick_watsonx_judge.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/metrics/rag/external_rag/faithfulness 2026-01-06T13:30:28,730 copying build/lib/unitxt/catalog/metrics/rag/external_rag/faithfulness/mistral_large_instruct_watsonx_judge.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/metrics/rag/external_rag/faithfulness 2026-01-06T13:30:28,732 copying build/lib/unitxt/catalog/metrics/rag/external_rag/faithfulness/vectara_hhem_2_1.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/metrics/rag/external_rag/faithfulness 2026-01-06T13:30:28,734 copying build/lib/unitxt/catalog/metrics/rag/external_rag/faithfulness/bert_score_k_precision.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/metrics/rag/external_rag/faithfulness 2026-01-06T13:30:28,736 copying build/lib/unitxt/catalog/metrics/rag/external_rag/faithfulness/gpt_oss_120b_rits_judge.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/metrics/rag/external_rag/faithfulness 2026-01-06T13:30:28,738 copying build/lib/unitxt/catalog/metrics/rag/external_rag/faithfulness/mistral_large_instruct_rits_judge.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/metrics/rag/external_rag/faithfulness 2026-01-06T13:30:28,739 copying build/lib/unitxt/catalog/metrics/rag/external_rag/faithfulness/generic_inference_engine_judge.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/metrics/rag/external_rag/faithfulness 2026-01-06T13:30:28,741 copying build/lib/unitxt/catalog/metrics/rag/external_rag/faithfulness/sentence_bert_bge.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/metrics/rag/external_rag/faithfulness 2026-01-06T13:30:28,743 copying build/lib/unitxt/catalog/metrics/rag/external_rag/faithfulness/gpt_4o_azure_judge.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/metrics/rag/external_rag/faithfulness 2026-01-06T13:30:28,745 copying build/lib/unitxt/catalog/metrics/rag/external_rag/faithfulness/llama_3_3_70b_instruct_rits_judge.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/metrics/rag/external_rag/faithfulness 2026-01-06T13:30:28,746 copying build/lib/unitxt/catalog/metrics/rag/external_rag/faithfulness/llama_3_3_70b_instruct_watsonx_judge.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/metrics/rag/external_rag/faithfulness 2026-01-06T13:30:28,748 copying build/lib/unitxt/catalog/metrics/rag/external_rag/faithfulness/token_k_precision.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/metrics/rag/external_rag/faithfulness 2026-01-06T13:30:28,750 copying build/lib/unitxt/catalog/metrics/rag/external_rag/faithfulness/gpt_oss_120b_watsonx_judge.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/metrics/rag/external_rag/faithfulness 2026-01-06T13:30:28,751 copying build/lib/unitxt/catalog/metrics/rag/external_rag/faithfulness/bert_score_k_precision_ml.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/metrics/rag/external_rag/faithfulness 2026-01-06T13:30:28,753 copying build/lib/unitxt/catalog/metrics/rag/external_rag/faithfulness/mistral_small_3_1_24b_instruct_2503_wml_judge.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/metrics/rag/external_rag/faithfulness 2026-01-06T13:30:28,755 copying build/lib/unitxt/catalog/metrics/rag/external_rag/answer_correctness.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/metrics/rag/external_rag 2026-01-06T13:30:28,757 creating build/bdist.linux-armv7l/wheel/unitxt/catalog/metrics/rag/external_rag/context_relevance 2026-01-06T13:30:28,759 copying build/lib/unitxt/catalog/metrics/rag/external_rag/context_relevance/sentence_bert_mini_lm.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/metrics/rag/external_rag/context_relevance 2026-01-06T13:30:28,761 copying build/lib/unitxt/catalog/metrics/rag/external_rag/context_relevance/llama_4_maverick_rits_judge.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/metrics/rag/external_rag/context_relevance 2026-01-06T13:30:28,763 copying build/lib/unitxt/catalog/metrics/rag/external_rag/context_relevance/perplexity_flan_t5_small.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/metrics/rag/external_rag/context_relevance 2026-01-06T13:30:28,765 copying build/lib/unitxt/catalog/metrics/rag/external_rag/context_relevance/llama_4_maverick_watsonx_judge.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/metrics/rag/external_rag/context_relevance 2026-01-06T13:30:28,767 copying build/lib/unitxt/catalog/metrics/rag/external_rag/context_relevance/mistral_large_instruct_watsonx_judge.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/metrics/rag/external_rag/context_relevance 2026-01-06T13:30:28,768 copying build/lib/unitxt/catalog/metrics/rag/external_rag/context_relevance/gpt_oss_120b_rits_judge.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/metrics/rag/external_rag/context_relevance 2026-01-06T13:30:28,770 copying build/lib/unitxt/catalog/metrics/rag/external_rag/context_relevance/mistral_large_instruct_rits_judge.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/metrics/rag/external_rag/context_relevance 2026-01-06T13:30:28,772 copying build/lib/unitxt/catalog/metrics/rag/external_rag/context_relevance/token_precision.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/metrics/rag/external_rag/context_relevance 2026-01-06T13:30:28,774 copying build/lib/unitxt/catalog/metrics/rag/external_rag/context_relevance/generic_inference_engine_judge.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/metrics/rag/external_rag/context_relevance 2026-01-06T13:30:28,776 copying build/lib/unitxt/catalog/metrics/rag/external_rag/context_relevance/sentence_bert_bge.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/metrics/rag/external_rag/context_relevance 2026-01-06T13:30:28,777 copying build/lib/unitxt/catalog/metrics/rag/external_rag/context_relevance/gpt_4o_azure_judge.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/metrics/rag/external_rag/context_relevance 2026-01-06T13:30:28,779 copying build/lib/unitxt/catalog/metrics/rag/external_rag/context_relevance/llama_3_3_70b_instruct_rits_judge.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/metrics/rag/external_rag/context_relevance 2026-01-06T13:30:28,781 copying build/lib/unitxt/catalog/metrics/rag/external_rag/context_relevance/llama_3_3_70b_instruct_watsonx_judge.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/metrics/rag/external_rag/context_relevance 2026-01-06T13:30:28,782 copying build/lib/unitxt/catalog/metrics/rag/external_rag/context_relevance/gpt_oss_120b_watsonx_judge.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/metrics/rag/external_rag/context_relevance 2026-01-06T13:30:28,784 copying build/lib/unitxt/catalog/metrics/rag/external_rag/context_relevance/mistral_small_3_1_24b_instruct_2503_wml_judge.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/metrics/rag/external_rag/context_relevance 2026-01-06T13:30:28,786 copying build/lib/unitxt/catalog/metrics/rag/external_rag/faithfulness.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/metrics/rag/external_rag 2026-01-06T13:30:28,788 creating build/bdist.linux-armv7l/wheel/unitxt/catalog/metrics/rag/external_rag/answer_correctness 2026-01-06T13:30:28,790 copying build/lib/unitxt/catalog/metrics/rag/external_rag/answer_correctness/bert_score_recall_ml.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/metrics/rag/external_rag/answer_correctness 2026-01-06T13:30:28,792 copying build/lib/unitxt/catalog/metrics/rag/external_rag/answer_correctness/sentence_bert_mini_lm.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/metrics/rag/external_rag/answer_correctness 2026-01-06T13:30:28,794 copying build/lib/unitxt/catalog/metrics/rag/external_rag/answer_correctness/llama_4_maverick_rits_judge.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/metrics/rag/external_rag/answer_correctness 2026-01-06T13:30:28,796 copying build/lib/unitxt/catalog/metrics/rag/external_rag/answer_correctness/llama_4_maverick_watsonx_judge.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/metrics/rag/external_rag/answer_correctness 2026-01-06T13:30:28,798 copying build/lib/unitxt/catalog/metrics/rag/external_rag/answer_correctness/mistral_large_instruct_watsonx_judge.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/metrics/rag/external_rag/answer_correctness 2026-01-06T13:30:28,800 copying build/lib/unitxt/catalog/metrics/rag/external_rag/answer_correctness/bert_score_recall.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/metrics/rag/external_rag/answer_correctness 2026-01-06T13:30:28,802 copying build/lib/unitxt/catalog/metrics/rag/external_rag/answer_correctness/gpt_oss_120b_rits_judge.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/metrics/rag/external_rag/answer_correctness 2026-01-06T13:30:28,805 copying build/lib/unitxt/catalog/metrics/rag/external_rag/answer_correctness/mistral_large_instruct_rits_judge.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/metrics/rag/external_rag/answer_correctness 2026-01-06T13:30:28,807 copying build/lib/unitxt/catalog/metrics/rag/external_rag/answer_correctness/generic_inference_engine_judge.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/metrics/rag/external_rag/answer_correctness 2026-01-06T13:30:28,809 copying build/lib/unitxt/catalog/metrics/rag/external_rag/answer_correctness/sentence_bert_bge.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/metrics/rag/external_rag/answer_correctness 2026-01-06T13:30:28,811 copying build/lib/unitxt/catalog/metrics/rag/external_rag/answer_correctness/gpt_4o_azure_judge.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/metrics/rag/external_rag/answer_correctness 2026-01-06T13:30:28,813 copying build/lib/unitxt/catalog/metrics/rag/external_rag/answer_correctness/llama_3_3_70b_instruct_rits_judge.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/metrics/rag/external_rag/answer_correctness 2026-01-06T13:30:28,816 copying build/lib/unitxt/catalog/metrics/rag/external_rag/answer_correctness/llama_3_3_70b_instruct_watsonx_judge.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/metrics/rag/external_rag/answer_correctness 2026-01-06T13:30:28,818 copying build/lib/unitxt/catalog/metrics/rag/external_rag/answer_correctness/token_recall.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/metrics/rag/external_rag/answer_correctness 2026-01-06T13:30:28,820 copying build/lib/unitxt/catalog/metrics/rag/external_rag/answer_correctness/gpt_oss_120b_watsonx_judge.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/metrics/rag/external_rag/answer_correctness 2026-01-06T13:30:28,822 copying build/lib/unitxt/catalog/metrics/rag/external_rag/answer_correctness/mistral_small_3_1_24b_instruct_2503_wml_judge.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/metrics/rag/external_rag/answer_correctness 2026-01-06T13:30:28,825 creating build/bdist.linux-armv7l/wheel/unitxt/catalog/metrics/rag/external_rag/answer_relevance 2026-01-06T13:30:28,826 copying build/lib/unitxt/catalog/metrics/rag/external_rag/answer_relevance/llama_4_maverick_rits_judge.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/metrics/rag/external_rag/answer_relevance 2026-01-06T13:30:28,829 copying build/lib/unitxt/catalog/metrics/rag/external_rag/answer_relevance/llama_4_maverick_watsonx_judge.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/metrics/rag/external_rag/answer_relevance 2026-01-06T13:30:28,831 copying build/lib/unitxt/catalog/metrics/rag/external_rag/answer_relevance/mistral_large_instruct_watsonx_judge.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/metrics/rag/external_rag/answer_relevance 2026-01-06T13:30:28,833 copying build/lib/unitxt/catalog/metrics/rag/external_rag/answer_relevance/gpt_oss_120b_rits_judge.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/metrics/rag/external_rag/answer_relevance 2026-01-06T13:30:28,835 copying build/lib/unitxt/catalog/metrics/rag/external_rag/answer_relevance/mistral_large_instruct_rits_judge.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/metrics/rag/external_rag/answer_relevance 2026-01-06T13:30:28,837 copying build/lib/unitxt/catalog/metrics/rag/external_rag/answer_relevance/generic_inference_engine_judge.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/metrics/rag/external_rag/answer_relevance 2026-01-06T13:30:28,840 copying build/lib/unitxt/catalog/metrics/rag/external_rag/answer_relevance/gpt_4o_azure_judge.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/metrics/rag/external_rag/answer_relevance 2026-01-06T13:30:28,842 copying build/lib/unitxt/catalog/metrics/rag/external_rag/answer_relevance/llama_3_3_70b_instruct_rits_judge.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/metrics/rag/external_rag/answer_relevance 2026-01-06T13:30:28,844 copying build/lib/unitxt/catalog/metrics/rag/external_rag/answer_relevance/llama_3_3_70b_instruct_watsonx_judge.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/metrics/rag/external_rag/answer_relevance 2026-01-06T13:30:28,846 copying build/lib/unitxt/catalog/metrics/rag/external_rag/answer_relevance/token_recall.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/metrics/rag/external_rag/answer_relevance 2026-01-06T13:30:28,848 copying build/lib/unitxt/catalog/metrics/rag/external_rag/answer_relevance/gpt_oss_120b_watsonx_judge.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/metrics/rag/external_rag/answer_relevance 2026-01-06T13:30:28,851 copying build/lib/unitxt/catalog/metrics/rag/external_rag/answer_relevance/answer_reward.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/metrics/rag/external_rag/answer_relevance 2026-01-06T13:30:28,853 copying build/lib/unitxt/catalog/metrics/rag/external_rag/answer_relevance/mistral_small_3_1_24b_instruct_2503_wml_judge.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/metrics/rag/external_rag/answer_relevance 2026-01-06T13:30:28,855 copying build/lib/unitxt/catalog/metrics/rag/external_rag/context_correctness.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/metrics/rag/external_rag 2026-01-06T13:30:28,857 copying build/lib/unitxt/catalog/metrics/rag/external_rag/context_relevance.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/metrics/rag/external_rag 2026-01-06T13:30:28,858 copying build/lib/unitxt/catalog/metrics/rag/external_rag/answer_reward.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/metrics/rag/external_rag 2026-01-06T13:30:28,861 creating build/bdist.linux-armv7l/wheel/unitxt/catalog/metrics/rag/external_rag/context_correctness 2026-01-06T13:30:28,862 copying build/lib/unitxt/catalog/metrics/rag/external_rag/context_correctness/mrr.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/metrics/rag/external_rag/context_correctness 2026-01-06T13:30:28,864 copying build/lib/unitxt/catalog/metrics/rag/external_rag/context_correctness/retrieval_at_k.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/metrics/rag/external_rag/context_correctness 2026-01-06T13:30:28,866 copying build/lib/unitxt/catalog/metrics/rag/external_rag/context_correctness/map.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/metrics/rag/external_rag/context_correctness 2026-01-06T13:30:28,869 creating build/bdist.linux-armv7l/wheel/unitxt/catalog/metrics/rag/external_rag/recommended 2026-01-06T13:30:28,870 creating build/bdist.linux-armv7l/wheel/unitxt/catalog/metrics/rag/external_rag/recommended/llmaj_rits 2026-01-06T13:30:28,872 copying build/lib/unitxt/catalog/metrics/rag/external_rag/recommended/llmaj_rits/all.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/metrics/rag/external_rag/recommended/llmaj_rits 2026-01-06T13:30:28,874 creating build/bdist.linux-armv7l/wheel/unitxt/catalog/metrics/rag/external_rag/recommended/small_llm 2026-01-06T13:30:28,875 copying build/lib/unitxt/catalog/metrics/rag/external_rag/recommended/small_llm/all.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/metrics/rag/external_rag/recommended/small_llm 2026-01-06T13:30:28,877 creating build/bdist.linux-armv7l/wheel/unitxt/catalog/metrics/rag/external_rag/recommended/cpu_only 2026-01-06T13:30:28,879 copying build/lib/unitxt/catalog/metrics/rag/external_rag/recommended/cpu_only/all.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/metrics/rag/external_rag/recommended/cpu_only 2026-01-06T13:30:28,881 creating build/bdist.linux-armv7l/wheel/unitxt/catalog/metrics/rag/external_rag/recommended/llmaj_watsonx 2026-01-06T13:30:28,882 copying build/lib/unitxt/catalog/metrics/rag/external_rag/recommended/llmaj_watsonx/all.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/metrics/rag/external_rag/recommended/llmaj_watsonx 2026-01-06T13:30:28,885 creating build/bdist.linux-armv7l/wheel/unitxt/catalog/metrics/rag/external_rag/recommended/llmaj_azure 2026-01-06T13:30:28,886 copying build/lib/unitxt/catalog/metrics/rag/external_rag/recommended/llmaj_azure/all.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/metrics/rag/external_rag/recommended/llmaj_azure 2026-01-06T13:30:28,888 copying build/lib/unitxt/catalog/metrics/rag/granite_guardian_groundedness.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/metrics/rag 2026-01-06T13:30:28,890 copying build/lib/unitxt/catalog/metrics/rag/answer_correctness.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/metrics/rag 2026-01-06T13:30:28,893 creating build/bdist.linux-armv7l/wheel/unitxt/catalog/metrics/rag/end_to_end 2026-01-06T13:30:28,894 creating build/bdist.linux-armv7l/wheel/unitxt/catalog/metrics/rag/end_to_end/faithfulness 2026-01-06T13:30:28,896 copying build/lib/unitxt/catalog/metrics/rag/end_to_end/faithfulness/sentence_bert_mini_lm.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/metrics/rag/end_to_end/faithfulness 2026-01-06T13:30:28,898 copying build/lib/unitxt/catalog/metrics/rag/end_to_end/faithfulness/llama_4_maverick_rits_judge.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/metrics/rag/end_to_end/faithfulness 2026-01-06T13:30:28,899 copying build/lib/unitxt/catalog/metrics/rag/end_to_end/faithfulness/llama_4_maverick_watsonx_judge.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/metrics/rag/end_to_end/faithfulness 2026-01-06T13:30:28,901 copying build/lib/unitxt/catalog/metrics/rag/end_to_end/faithfulness/mistral_large_instruct_watsonx_judge.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/metrics/rag/end_to_end/faithfulness 2026-01-06T13:30:28,903 copying build/lib/unitxt/catalog/metrics/rag/end_to_end/faithfulness/vectara_hhem_2_1.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/metrics/rag/end_to_end/faithfulness 2026-01-06T13:30:28,904 copying build/lib/unitxt/catalog/metrics/rag/end_to_end/faithfulness/bert_score_k_precision.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/metrics/rag/end_to_end/faithfulness 2026-01-06T13:30:28,906 copying build/lib/unitxt/catalog/metrics/rag/end_to_end/faithfulness/gpt_oss_120b_rits_judge.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/metrics/rag/end_to_end/faithfulness 2026-01-06T13:30:28,908 copying build/lib/unitxt/catalog/metrics/rag/end_to_end/faithfulness/mistral_large_instruct_rits_judge.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/metrics/rag/end_to_end/faithfulness 2026-01-06T13:30:28,910 copying build/lib/unitxt/catalog/metrics/rag/end_to_end/faithfulness/generic_inference_engine_judge.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/metrics/rag/end_to_end/faithfulness 2026-01-06T13:30:28,911 copying build/lib/unitxt/catalog/metrics/rag/end_to_end/faithfulness/sentence_bert_bge.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/metrics/rag/end_to_end/faithfulness 2026-01-06T13:30:28,913 copying build/lib/unitxt/catalog/metrics/rag/end_to_end/faithfulness/gpt_4o_azure_judge.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/metrics/rag/end_to_end/faithfulness 2026-01-06T13:30:28,915 copying build/lib/unitxt/catalog/metrics/rag/end_to_end/faithfulness/llama_3_3_70b_instruct_rits_judge.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/metrics/rag/end_to_end/faithfulness 2026-01-06T13:30:28,917 copying build/lib/unitxt/catalog/metrics/rag/end_to_end/faithfulness/llama_3_3_70b_instruct_watsonx_judge.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/metrics/rag/end_to_end/faithfulness 2026-01-06T13:30:28,919 copying build/lib/unitxt/catalog/metrics/rag/end_to_end/faithfulness/token_k_precision.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/metrics/rag/end_to_end/faithfulness 2026-01-06T13:30:28,921 copying build/lib/unitxt/catalog/metrics/rag/end_to_end/faithfulness/gpt_oss_120b_watsonx_judge.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/metrics/rag/end_to_end/faithfulness 2026-01-06T13:30:28,922 copying build/lib/unitxt/catalog/metrics/rag/end_to_end/faithfulness/bert_score_k_precision_ml.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/metrics/rag/end_to_end/faithfulness 2026-01-06T13:30:28,924 copying build/lib/unitxt/catalog/metrics/rag/end_to_end/faithfulness/mistral_small_3_1_24b_instruct_2503_wml_judge.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/metrics/rag/end_to_end/faithfulness 2026-01-06T13:30:28,926 copying build/lib/unitxt/catalog/metrics/rag/end_to_end/answer_correctness.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/metrics/rag/end_to_end 2026-01-06T13:30:28,929 creating build/bdist.linux-armv7l/wheel/unitxt/catalog/metrics/rag/end_to_end/context_relevance 2026-01-06T13:30:28,930 copying build/lib/unitxt/catalog/metrics/rag/end_to_end/context_relevance/sentence_bert_mini_lm.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/metrics/rag/end_to_end/context_relevance 2026-01-06T13:30:28,932 copying build/lib/unitxt/catalog/metrics/rag/end_to_end/context_relevance/llama_4_maverick_rits_judge.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/metrics/rag/end_to_end/context_relevance 2026-01-06T13:30:28,934 copying build/lib/unitxt/catalog/metrics/rag/end_to_end/context_relevance/perplexity_flan_t5_small.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/metrics/rag/end_to_end/context_relevance 2026-01-06T13:30:28,935 copying build/lib/unitxt/catalog/metrics/rag/end_to_end/context_relevance/llama_4_maverick_watsonx_judge.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/metrics/rag/end_to_end/context_relevance 2026-01-06T13:30:28,937 copying build/lib/unitxt/catalog/metrics/rag/end_to_end/context_relevance/mistral_large_instruct_watsonx_judge.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/metrics/rag/end_to_end/context_relevance 2026-01-06T13:30:28,939 copying build/lib/unitxt/catalog/metrics/rag/end_to_end/context_relevance/gpt_oss_120b_rits_judge.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/metrics/rag/end_to_end/context_relevance 2026-01-06T13:30:28,940 copying build/lib/unitxt/catalog/metrics/rag/end_to_end/context_relevance/mistral_large_instruct_rits_judge.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/metrics/rag/end_to_end/context_relevance 2026-01-06T13:30:28,942 copying build/lib/unitxt/catalog/metrics/rag/end_to_end/context_relevance/token_precision.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/metrics/rag/end_to_end/context_relevance 2026-01-06T13:30:28,944 copying build/lib/unitxt/catalog/metrics/rag/end_to_end/context_relevance/generic_inference_engine_judge.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/metrics/rag/end_to_end/context_relevance 2026-01-06T13:30:28,946 copying build/lib/unitxt/catalog/metrics/rag/end_to_end/context_relevance/sentence_bert_bge.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/metrics/rag/end_to_end/context_relevance 2026-01-06T13:30:28,947 copying build/lib/unitxt/catalog/metrics/rag/end_to_end/context_relevance/gpt_4o_azure_judge.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/metrics/rag/end_to_end/context_relevance 2026-01-06T13:30:28,949 copying build/lib/unitxt/catalog/metrics/rag/end_to_end/context_relevance/llama_3_3_70b_instruct_rits_judge.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/metrics/rag/end_to_end/context_relevance 2026-01-06T13:30:28,951 copying build/lib/unitxt/catalog/metrics/rag/end_to_end/context_relevance/llama_3_3_70b_instruct_watsonx_judge.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/metrics/rag/end_to_end/context_relevance 2026-01-06T13:30:28,953 copying build/lib/unitxt/catalog/metrics/rag/end_to_end/context_relevance/gpt_oss_120b_watsonx_judge.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/metrics/rag/end_to_end/context_relevance 2026-01-06T13:30:28,955 copying build/lib/unitxt/catalog/metrics/rag/end_to_end/context_relevance/mistral_small_3_1_24b_instruct_2503_wml_judge.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/metrics/rag/end_to_end/context_relevance 2026-01-06T13:30:28,956 copying build/lib/unitxt/catalog/metrics/rag/end_to_end/answer_faithfulness.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/metrics/rag/end_to_end 2026-01-06T13:30:28,959 creating build/bdist.linux-armv7l/wheel/unitxt/catalog/metrics/rag/end_to_end/answer_correctness 2026-01-06T13:30:28,960 copying build/lib/unitxt/catalog/metrics/rag/end_to_end/answer_correctness/bert_score_recall_ml.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/metrics/rag/end_to_end/answer_correctness 2026-01-06T13:30:28,962 copying build/lib/unitxt/catalog/metrics/rag/end_to_end/answer_correctness/sentence_bert_mini_lm.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/metrics/rag/end_to_end/answer_correctness 2026-01-06T13:30:28,964 copying build/lib/unitxt/catalog/metrics/rag/end_to_end/answer_correctness/llama_4_maverick_rits_judge.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/metrics/rag/end_to_end/answer_correctness 2026-01-06T13:30:28,966 copying build/lib/unitxt/catalog/metrics/rag/end_to_end/answer_correctness/llama_4_maverick_watsonx_judge.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/metrics/rag/end_to_end/answer_correctness 2026-01-06T13:30:28,967 copying build/lib/unitxt/catalog/metrics/rag/end_to_end/answer_correctness/mistral_large_instruct_watsonx_judge.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/metrics/rag/end_to_end/answer_correctness 2026-01-06T13:30:28,969 copying build/lib/unitxt/catalog/metrics/rag/end_to_end/answer_correctness/bert_score_recall.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/metrics/rag/end_to_end/answer_correctness 2026-01-06T13:30:28,971 copying build/lib/unitxt/catalog/metrics/rag/end_to_end/answer_correctness/gpt_oss_120b_rits_judge.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/metrics/rag/end_to_end/answer_correctness 2026-01-06T13:30:28,973 copying build/lib/unitxt/catalog/metrics/rag/end_to_end/answer_correctness/mistral_large_instruct_rits_judge.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/metrics/rag/end_to_end/answer_correctness 2026-01-06T13:30:28,974 copying build/lib/unitxt/catalog/metrics/rag/end_to_end/answer_correctness/generic_inference_engine_judge.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/metrics/rag/end_to_end/answer_correctness 2026-01-06T13:30:28,976 copying build/lib/unitxt/catalog/metrics/rag/end_to_end/answer_correctness/sentence_bert_bge.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/metrics/rag/end_to_end/answer_correctness 2026-01-06T13:30:28,978 copying build/lib/unitxt/catalog/metrics/rag/end_to_end/answer_correctness/gpt_4o_azure_judge.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/metrics/rag/end_to_end/answer_correctness 2026-01-06T13:30:28,980 copying build/lib/unitxt/catalog/metrics/rag/end_to_end/answer_correctness/llama_3_3_70b_instruct_rits_judge.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/metrics/rag/end_to_end/answer_correctness 2026-01-06T13:30:28,981 copying build/lib/unitxt/catalog/metrics/rag/end_to_end/answer_correctness/llama_3_3_70b_instruct_watsonx_judge.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/metrics/rag/end_to_end/answer_correctness 2026-01-06T13:30:28,983 copying build/lib/unitxt/catalog/metrics/rag/end_to_end/answer_correctness/token_recall.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/metrics/rag/end_to_end/answer_correctness 2026-01-06T13:30:28,985 copying build/lib/unitxt/catalog/metrics/rag/end_to_end/answer_correctness/gpt_oss_120b_watsonx_judge.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/metrics/rag/end_to_end/answer_correctness 2026-01-06T13:30:28,987 copying build/lib/unitxt/catalog/metrics/rag/end_to_end/answer_correctness/mistral_small_3_1_24b_instruct_2503_wml_judge.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/metrics/rag/end_to_end/answer_correctness 2026-01-06T13:30:28,989 creating build/bdist.linux-armv7l/wheel/unitxt/catalog/metrics/rag/end_to_end/answer_relevance 2026-01-06T13:30:28,990 copying build/lib/unitxt/catalog/metrics/rag/end_to_end/answer_relevance/llama_4_maverick_rits_judge.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/metrics/rag/end_to_end/answer_relevance 2026-01-06T13:30:28,992 copying build/lib/unitxt/catalog/metrics/rag/end_to_end/answer_relevance/llama_4_maverick_watsonx_judge.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/metrics/rag/end_to_end/answer_relevance 2026-01-06T13:30:28,994 copying build/lib/unitxt/catalog/metrics/rag/end_to_end/answer_relevance/mistral_large_instruct_watsonx_judge.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/metrics/rag/end_to_end/answer_relevance 2026-01-06T13:30:28,996 copying build/lib/unitxt/catalog/metrics/rag/end_to_end/answer_relevance/gpt_oss_120b_rits_judge.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/metrics/rag/end_to_end/answer_relevance 2026-01-06T13:30:28,998 copying build/lib/unitxt/catalog/metrics/rag/end_to_end/answer_relevance/mistral_large_instruct_rits_judge.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/metrics/rag/end_to_end/answer_relevance 2026-01-06T13:30:29,000 copying build/lib/unitxt/catalog/metrics/rag/end_to_end/answer_relevance/generic_inference_engine_judge.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/metrics/rag/end_to_end/answer_relevance 2026-01-06T13:30:29,002 copying build/lib/unitxt/catalog/metrics/rag/end_to_end/answer_relevance/gpt_4o_azure_judge.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/metrics/rag/end_to_end/answer_relevance 2026-01-06T13:30:29,003 copying build/lib/unitxt/catalog/metrics/rag/end_to_end/answer_relevance/llama_3_3_70b_instruct_rits_judge.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/metrics/rag/end_to_end/answer_relevance 2026-01-06T13:30:29,005 copying build/lib/unitxt/catalog/metrics/rag/end_to_end/answer_relevance/llama_3_3_70b_instruct_watsonx_judge.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/metrics/rag/end_to_end/answer_relevance 2026-01-06T13:30:29,007 copying build/lib/unitxt/catalog/metrics/rag/end_to_end/answer_relevance/token_recall.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/metrics/rag/end_to_end/answer_relevance 2026-01-06T13:30:29,008 copying build/lib/unitxt/catalog/metrics/rag/end_to_end/answer_relevance/gpt_oss_120b_watsonx_judge.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/metrics/rag/end_to_end/answer_relevance 2026-01-06T13:30:29,010 copying build/lib/unitxt/catalog/metrics/rag/end_to_end/answer_relevance/answer_reward.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/metrics/rag/end_to_end/answer_relevance 2026-01-06T13:30:29,012 copying build/lib/unitxt/catalog/metrics/rag/end_to_end/answer_relevance/mistral_small_3_1_24b_instruct_2503_wml_judge.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/metrics/rag/end_to_end/answer_relevance 2026-01-06T13:30:29,014 copying build/lib/unitxt/catalog/metrics/rag/end_to_end/context_correctness.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/metrics/rag/end_to_end 2026-01-06T13:30:29,016 copying build/lib/unitxt/catalog/metrics/rag/end_to_end/context_relevance.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/metrics/rag/end_to_end 2026-01-06T13:30:29,017 copying build/lib/unitxt/catalog/metrics/rag/end_to_end/answer_reward.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/metrics/rag/end_to_end 2026-01-06T13:30:29,020 creating build/bdist.linux-armv7l/wheel/unitxt/catalog/metrics/rag/end_to_end/context_correctness 2026-01-06T13:30:29,021 copying build/lib/unitxt/catalog/metrics/rag/end_to_end/context_correctness/mrr.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/metrics/rag/end_to_end/context_correctness 2026-01-06T13:30:29,023 copying build/lib/unitxt/catalog/metrics/rag/end_to_end/context_correctness/retrieval_at_k.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/metrics/rag/end_to_end/context_correctness 2026-01-06T13:30:29,025 copying build/lib/unitxt/catalog/metrics/rag/end_to_end/context_correctness/map.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/metrics/rag/end_to_end/context_correctness 2026-01-06T13:30:29,027 creating build/bdist.linux-armv7l/wheel/unitxt/catalog/metrics/rag/end_to_end/recommended 2026-01-06T13:30:29,028 creating build/bdist.linux-armv7l/wheel/unitxt/catalog/metrics/rag/end_to_end/recommended/llmaj_rits 2026-01-06T13:30:29,030 copying build/lib/unitxt/catalog/metrics/rag/end_to_end/recommended/llmaj_rits/all.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/metrics/rag/end_to_end/recommended/llmaj_rits 2026-01-06T13:30:29,032 creating build/bdist.linux-armv7l/wheel/unitxt/catalog/metrics/rag/end_to_end/recommended/small_llm 2026-01-06T13:30:29,033 copying build/lib/unitxt/catalog/metrics/rag/end_to_end/recommended/small_llm/all.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/metrics/rag/end_to_end/recommended/small_llm 2026-01-06T13:30:29,036 creating build/bdist.linux-armv7l/wheel/unitxt/catalog/metrics/rag/end_to_end/recommended/cpu_only 2026-01-06T13:30:29,037 copying build/lib/unitxt/catalog/metrics/rag/end_to_end/recommended/cpu_only/all.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/metrics/rag/end_to_end/recommended/cpu_only 2026-01-06T13:30:29,039 creating build/bdist.linux-armv7l/wheel/unitxt/catalog/metrics/rag/end_to_end/recommended/llmaj_watsonx 2026-01-06T13:30:29,040 copying build/lib/unitxt/catalog/metrics/rag/end_to_end/recommended/llmaj_watsonx/all.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/metrics/rag/end_to_end/recommended/llmaj_watsonx 2026-01-06T13:30:29,042 creating build/bdist.linux-armv7l/wheel/unitxt/catalog/metrics/rag/end_to_end/recommended/llmaj_azure 2026-01-06T13:30:29,043 copying build/lib/unitxt/catalog/metrics/rag/end_to_end/recommended/llmaj_azure/all.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/metrics/rag/end_to_end/recommended/llmaj_azure 2026-01-06T13:30:29,046 creating build/bdist.linux-armv7l/wheel/unitxt/catalog/metrics/rag/context_relevance 2026-01-06T13:30:29,047 copying build/lib/unitxt/catalog/metrics/rag/context_relevance/sentence_bert_mini_lm.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/metrics/rag/context_relevance 2026-01-06T13:30:29,049 copying build/lib/unitxt/catalog/metrics/rag/context_relevance/perplexity_flan_t5_small.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/metrics/rag/context_relevance 2026-01-06T13:30:29,051 copying build/lib/unitxt/catalog/metrics/rag/context_relevance/generic_inference_engine_q_c_ares.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/metrics/rag/context_relevance 2026-01-06T13:30:29,053 copying build/lib/unitxt/catalog/metrics/rag/context_relevance/llama_3_3_70b_instruct_wml_q_c_ares.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/metrics/rag/context_relevance 2026-01-06T13:30:29,054 copying build/lib/unitxt/catalog/metrics/rag/context_relevance/llama_3_3_70b_instruct_wml_q_c_ares_numeric.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/metrics/rag/context_relevance 2026-01-06T13:30:29,056 copying build/lib/unitxt/catalog/metrics/rag/context_relevance/token_precision.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/metrics/rag/context_relevance 2026-01-06T13:30:29,058 copying build/lib/unitxt/catalog/metrics/rag/context_relevance/llama_3_3_70b_instruct_wml_q_c_ares_logprobs.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/metrics/rag/context_relevance 2026-01-06T13:30:29,060 copying build/lib/unitxt/catalog/metrics/rag/context_relevance/sentence_bert_bge.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/metrics/rag/context_relevance 2026-01-06T13:30:29,061 copying build/lib/unitxt/catalog/metrics/rag/context_relevance/generic_inference_engine_q_c_ares_numeric.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/metrics/rag/context_relevance 2026-01-06T13:30:29,063 copying build/lib/unitxt/catalog/metrics/rag/faithfulness.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/metrics/rag 2026-01-06T13:30:29,065 creating build/bdist.linux-armv7l/wheel/unitxt/catalog/metrics/rag/answer_correctness 2026-01-06T13:30:29,066 copying build/lib/unitxt/catalog/metrics/rag/answer_correctness/bert_score_recall_ml.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/metrics/rag/answer_correctness 2026-01-06T13:30:29,068 copying build/lib/unitxt/catalog/metrics/rag/answer_correctness/sentence_bert_mini_lm.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/metrics/rag/answer_correctness 2026-01-06T13:30:29,070 copying build/lib/unitxt/catalog/metrics/rag/answer_correctness/llama_3_3_70b_instruct_wml_q_a_gt_loose.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/metrics/rag/answer_correctness 2026-01-06T13:30:29,072 copying build/lib/unitxt/catalog/metrics/rag/answer_correctness/llama_3_3_70b_instruct_wml_q_a_gt_loose_logprobs.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/metrics/rag/answer_correctness 2026-01-06T13:30:29,074 copying build/lib/unitxt/catalog/metrics/rag/answer_correctness/bert_score_recall.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/metrics/rag/answer_correctness 2026-01-06T13:30:29,076 copying build/lib/unitxt/catalog/metrics/rag/answer_correctness/sentence_bert_bge.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/metrics/rag/answer_correctness 2026-01-06T13:30:29,077 copying build/lib/unitxt/catalog/metrics/rag/answer_correctness/llama_3_3_70b_instruct_wml_q_a_gt_loose_numeric.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/metrics/rag/answer_correctness 2026-01-06T13:30:29,079 copying build/lib/unitxt/catalog/metrics/rag/answer_correctness/token_recall.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/metrics/rag/answer_correctness 2026-01-06T13:30:29,081 copying build/lib/unitxt/catalog/metrics/rag/answer_correctness/generic_inference_engine_q_a_gt_loose_numeric.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/metrics/rag/answer_correctness 2026-01-06T13:30:29,082 copying build/lib/unitxt/catalog/metrics/rag/answer_correctness/generic_inference_engine_q_a_gt_loose.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/metrics/rag/answer_correctness 2026-01-06T13:30:29,085 creating build/bdist.linux-armv7l/wheel/unitxt/catalog/metrics/rag/correctness 2026-01-06T13:30:29,086 copying build/lib/unitxt/catalog/metrics/rag/correctness/llama_index_by_gpt_3_5_turbo.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/metrics/rag/correctness 2026-01-06T13:30:29,087 copying build/lib/unitxt/catalog/metrics/rag/correctness/llama_index_by_mock.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/metrics/rag/correctness 2026-01-06T13:30:29,090 creating build/bdist.linux-armv7l/wheel/unitxt/catalog/metrics/rag/answer_relevance 2026-01-06T13:30:29,091 copying build/lib/unitxt/catalog/metrics/rag/answer_relevance/generic_inference_engine_q_a.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/metrics/rag/answer_relevance 2026-01-06T13:30:29,093 copying build/lib/unitxt/catalog/metrics/rag/answer_relevance/llama_3_3_70b_instruct_wml_q_a_numeric.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/metrics/rag/answer_relevance 2026-01-06T13:30:29,095 copying build/lib/unitxt/catalog/metrics/rag/answer_relevance/generic_inference_engine_q_a_numeric.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/metrics/rag/answer_relevance 2026-01-06T13:30:29,096 copying build/lib/unitxt/catalog/metrics/rag/answer_relevance/llama_3_3_70b_instruct_wml_q_a_logprobs.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/metrics/rag/answer_relevance 2026-01-06T13:30:29,098 copying build/lib/unitxt/catalog/metrics/rag/answer_relevance/llama_3_3_70b_instruct_wml_q_a.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/metrics/rag/answer_relevance 2026-01-06T13:30:29,100 copying build/lib/unitxt/catalog/metrics/rag/answer_relevance/token_recall.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/metrics/rag/answer_relevance 2026-01-06T13:30:29,102 copying build/lib/unitxt/catalog/metrics/rag/context_correctness.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/metrics/rag 2026-01-06T13:30:29,104 copying build/lib/unitxt/catalog/metrics/rag/context_relevance.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/metrics/rag 2026-01-06T13:30:29,105 copying build/lib/unitxt/catalog/metrics/rag/granite_guardian_answer_relevance.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/metrics/rag 2026-01-06T13:30:29,107 copying build/lib/unitxt/catalog/metrics/rag/answer_reward.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/metrics/rag 2026-01-06T13:30:29,110 creating build/bdist.linux-armv7l/wheel/unitxt/catalog/metrics/rag/context_correctness 2026-01-06T13:30:29,111 copying build/lib/unitxt/catalog/metrics/rag/context_correctness/mrr.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/metrics/rag/context_correctness 2026-01-06T13:30:29,113 copying build/lib/unitxt/catalog/metrics/rag/context_correctness/retrieval_at_k.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/metrics/rag/context_correctness 2026-01-06T13:30:29,115 copying build/lib/unitxt/catalog/metrics/rag/context_correctness/map.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/metrics/rag/context_correctness 2026-01-06T13:30:29,117 copying build/lib/unitxt/catalog/metrics/rag/answer_inference.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/metrics/rag 2026-01-06T13:30:29,118 copying build/lib/unitxt/catalog/metrics/accuracy_binary.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/metrics 2026-01-06T13:30:29,120 copying build/lib/unitxt/catalog/metrics/token_overlap_with_context.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/metrics 2026-01-06T13:30:29,122 creating build/bdist.linux-armv7l/wheel/unitxt/catalog/metrics/reward 2026-01-06T13:30:29,123 copying build/lib/unitxt/catalog/metrics/reward/deberta_v3_large_v2.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/metrics/reward 2026-01-06T13:30:29,125 copying build/lib/unitxt/catalog/metrics/fuzzyner.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/metrics 2026-01-06T13:30:29,127 creating build/bdist.linux-armv7l/wheel/unitxt/catalog/metrics/perplexity_q 2026-01-06T13:30:29,128 copying build/lib/unitxt/catalog/metrics/perplexity_q/flan_t5_small.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/metrics/perplexity_q 2026-01-06T13:30:29,130 copying build/lib/unitxt/catalog/metrics/mean_squared_error.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/metrics 2026-01-06T13:30:29,132 copying build/lib/unitxt/catalog/metrics/max_f1_binary.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/metrics 2026-01-06T13:30:29,134 copying build/lib/unitxt/catalog/metrics/kendalltau_b.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/metrics 2026-01-06T13:30:29,135 copying build/lib/unitxt/catalog/metrics/map.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/metrics 2026-01-06T13:30:29,137 copying build/lib/unitxt/catalog/metrics/precision_macro_multi_label.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/metrics 2026-01-06T13:30:29,139 copying build/lib/unitxt/catalog/metrics/kpa.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/metrics 2026-01-06T13:30:29,141 copying build/lib/unitxt/catalog/metrics/vectara_groundedness_hhem_2_1.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/metrics 2026-01-06T13:30:29,142 copying build/lib/unitxt/catalog/metrics/jaccard_index_words.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/metrics 2026-01-06T13:30:29,147 creating build/bdist.linux-armv7l/wheel/unitxt/catalog/cards 2026-01-06T13:30:29,148 copying build/lib/unitxt/catalog/cards/race_high.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards 2026-01-06T13:30:29,150 copying build/lib/unitxt/catalog/cards/stsb.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards 2026-01-06T13:30:29,152 copying build/lib/unitxt/catalog/cards/coedit_error_detection.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards 2026-01-06T13:30:29,155 creating build/bdist.linux-armv7l/wheel/unitxt/catalog/cards/mmlu 2026-01-06T13:30:29,156 copying build/lib/unitxt/catalog/cards/mmlu/elementary_mathematics.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/mmlu 2026-01-06T13:30:29,158 copying build/lib/unitxt/catalog/cards/mmlu/human_aging.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/mmlu 2026-01-06T13:30:29,160 copying build/lib/unitxt/catalog/cards/mmlu/high_school_computer_science.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/mmlu 2026-01-06T13:30:29,162 copying build/lib/unitxt/catalog/cards/mmlu/college_physics.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/mmlu 2026-01-06T13:30:29,164 copying build/lib/unitxt/catalog/cards/mmlu/college_medicine.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/mmlu 2026-01-06T13:30:29,166 copying build/lib/unitxt/catalog/cards/mmlu/college_mathematics.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/mmlu 2026-01-06T13:30:29,168 copying build/lib/unitxt/catalog/cards/mmlu/high_school_microeconomics.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/mmlu 2026-01-06T13:30:29,170 copying build/lib/unitxt/catalog/cards/mmlu/anatomy.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/mmlu 2026-01-06T13:30:29,172 copying build/lib/unitxt/catalog/cards/mmlu/world_religions.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/mmlu 2026-01-06T13:30:29,173 copying build/lib/unitxt/catalog/cards/mmlu/management.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/mmlu 2026-01-06T13:30:29,175 copying build/lib/unitxt/catalog/cards/mmlu/moral_scenarios.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/mmlu 2026-01-06T13:30:29,177 copying build/lib/unitxt/catalog/cards/mmlu/global_facts.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/mmlu 2026-01-06T13:30:29,179 copying build/lib/unitxt/catalog/cards/mmlu/miscellaneous.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/mmlu 2026-01-06T13:30:29,180 copying build/lib/unitxt/catalog/cards/mmlu/clinical_knowledge.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/mmlu 2026-01-06T13:30:29,182 copying build/lib/unitxt/catalog/cards/mmlu/high_school_biology.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/mmlu 2026-01-06T13:30:29,184 copying build/lib/unitxt/catalog/cards/mmlu/prehistory.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/mmlu 2026-01-06T13:30:29,186 copying build/lib/unitxt/catalog/cards/mmlu/high_school_us_history.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/mmlu 2026-01-06T13:30:29,188 copying build/lib/unitxt/catalog/cards/mmlu/international_law.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/mmlu 2026-01-06T13:30:29,190 copying build/lib/unitxt/catalog/cards/mmlu/college_computer_science.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/mmlu 2026-01-06T13:30:29,191 copying build/lib/unitxt/catalog/cards/mmlu/astronomy.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/mmlu 2026-01-06T13:30:29,193 copying build/lib/unitxt/catalog/cards/mmlu/high_school_european_history.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/mmlu 2026-01-06T13:30:29,195 copying build/lib/unitxt/catalog/cards/mmlu/electrical_engineering.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/mmlu 2026-01-06T13:30:29,197 copying build/lib/unitxt/catalog/cards/mmlu/nutrition.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/mmlu 2026-01-06T13:30:29,199 copying build/lib/unitxt/catalog/cards/mmlu/abstract_algebra.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/mmlu 2026-01-06T13:30:29,201 copying build/lib/unitxt/catalog/cards/mmlu/professional_medicine.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/mmlu 2026-01-06T13:30:29,203 copying build/lib/unitxt/catalog/cards/mmlu/human_sexuality.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/mmlu 2026-01-06T13:30:29,205 copying build/lib/unitxt/catalog/cards/mmlu/business_ethics.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/mmlu 2026-01-06T13:30:29,206 copying build/lib/unitxt/catalog/cards/mmlu/high_school_chemistry.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/mmlu 2026-01-06T13:30:29,208 copying build/lib/unitxt/catalog/cards/mmlu/logical_fallacies.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/mmlu 2026-01-06T13:30:29,210 copying build/lib/unitxt/catalog/cards/mmlu/formal_logic.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/mmlu 2026-01-06T13:30:29,212 copying build/lib/unitxt/catalog/cards/mmlu/high_school_psychology.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/mmlu 2026-01-06T13:30:29,214 copying build/lib/unitxt/catalog/cards/mmlu/medical_genetics.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/mmlu 2026-01-06T13:30:29,216 copying build/lib/unitxt/catalog/cards/mmlu/security_studies.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/mmlu 2026-01-06T13:30:29,218 copying build/lib/unitxt/catalog/cards/mmlu/high_school_macroeconomics.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/mmlu 2026-01-06T13:30:29,219 copying build/lib/unitxt/catalog/cards/mmlu/professional_law.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/mmlu 2026-01-06T13:30:29,221 copying build/lib/unitxt/catalog/cards/mmlu/high_school_physics.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/mmlu 2026-01-06T13:30:29,223 copying build/lib/unitxt/catalog/cards/mmlu/econometrics.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/mmlu 2026-01-06T13:30:29,225 copying build/lib/unitxt/catalog/cards/mmlu/sociology.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/mmlu 2026-01-06T13:30:29,226 copying build/lib/unitxt/catalog/cards/mmlu/moral_disputes.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/mmlu 2026-01-06T13:30:29,228 copying build/lib/unitxt/catalog/cards/mmlu/college_chemistry.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/mmlu 2026-01-06T13:30:29,230 copying build/lib/unitxt/catalog/cards/mmlu/high_school_geography.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/mmlu 2026-01-06T13:30:29,232 copying build/lib/unitxt/catalog/cards/mmlu/jurisprudence.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/mmlu 2026-01-06T13:30:29,234 copying build/lib/unitxt/catalog/cards/mmlu/high_school_statistics.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/mmlu 2026-01-06T13:30:29,235 copying build/lib/unitxt/catalog/cards/mmlu/professional_accounting.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/mmlu 2026-01-06T13:30:29,237 copying build/lib/unitxt/catalog/cards/mmlu/us_foreign_policy.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/mmlu 2026-01-06T13:30:29,239 copying build/lib/unitxt/catalog/cards/mmlu/professional_psychology.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/mmlu 2026-01-06T13:30:29,241 copying build/lib/unitxt/catalog/cards/mmlu/public_relations.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/mmlu 2026-01-06T13:30:29,243 copying build/lib/unitxt/catalog/cards/mmlu/computer_security.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/mmlu 2026-01-06T13:30:29,245 copying build/lib/unitxt/catalog/cards/mmlu/philosophy.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/mmlu 2026-01-06T13:30:29,247 copying build/lib/unitxt/catalog/cards/mmlu/virology.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/mmlu 2026-01-06T13:30:29,248 copying build/lib/unitxt/catalog/cards/mmlu/marketing.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/mmlu 2026-01-06T13:30:29,250 copying build/lib/unitxt/catalog/cards/mmlu/high_school_world_history.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/mmlu 2026-01-06T13:30:29,252 copying build/lib/unitxt/catalog/cards/mmlu/machine_learning.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/mmlu 2026-01-06T13:30:29,254 copying build/lib/unitxt/catalog/cards/mmlu/high_school_government_and_politics.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/mmlu 2026-01-06T13:30:29,256 copying build/lib/unitxt/catalog/cards/mmlu/conceptual_physics.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/mmlu 2026-01-06T13:30:29,258 copying build/lib/unitxt/catalog/cards/mmlu/college_biology.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/mmlu 2026-01-06T13:30:29,260 copying build/lib/unitxt/catalog/cards/mmlu/high_school_mathematics.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/mmlu 2026-01-06T13:30:29,262 creating build/bdist.linux-armv7l/wheel/unitxt/catalog/cards/head_qa 2026-01-06T13:30:29,263 copying build/lib/unitxt/catalog/cards/head_qa/ru.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/head_qa 2026-01-06T13:30:29,265 copying build/lib/unitxt/catalog/cards/head_qa/en.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/head_qa 2026-01-06T13:30:29,267 copying build/lib/unitxt/catalog/cards/head_qa/it.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/head_qa 2026-01-06T13:30:29,269 copying build/lib/unitxt/catalog/cards/head_qa/es.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/head_qa 2026-01-06T13:30:29,270 copying build/lib/unitxt/catalog/cards/head_qa/gl.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/head_qa 2026-01-06T13:30:29,272 copying build/lib/unitxt/catalog/cards/atis.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards 2026-01-06T13:30:29,274 copying build/lib/unitxt/catalog/cards/sciq.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards 2026-01-06T13:30:29,276 copying build/lib/unitxt/catalog/cards/wsc.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards 2026-01-06T13:30:29,279 creating build/bdist.linux-armv7l/wheel/unitxt/catalog/cards/amazon_mass 2026-01-06T13:30:29,280 copying build/lib/unitxt/catalog/cards/amazon_mass/sl_SL.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/amazon_mass 2026-01-06T13:30:29,283 copying build/lib/unitxt/catalog/cards/amazon_mass/cy_GB.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/amazon_mass 2026-01-06T13:30:29,285 copying build/lib/unitxt/catalog/cards/amazon_mass/fi_FI.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/amazon_mass 2026-01-06T13:30:29,287 copying build/lib/unitxt/catalog/cards/amazon_mass/jv_ID.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/amazon_mass 2026-01-06T13:30:29,289 copying build/lib/unitxt/catalog/cards/amazon_mass/he_IL.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/amazon_mass 2026-01-06T13:30:29,291 copying build/lib/unitxt/catalog/cards/amazon_mass/es_ES.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/amazon_mass 2026-01-06T13:30:29,293 copying build/lib/unitxt/catalog/cards/amazon_mass/it_IT.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/amazon_mass 2026-01-06T13:30:29,295 copying build/lib/unitxt/catalog/cards/amazon_mass/hy_AM.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/amazon_mass 2026-01-06T13:30:29,297 copying build/lib/unitxt/catalog/cards/amazon_mass/ur_PK.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/amazon_mass 2026-01-06T13:30:29,300 copying build/lib/unitxt/catalog/cards/amazon_mass/de_DE.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/amazon_mass 2026-01-06T13:30:29,302 copying build/lib/unitxt/catalog/cards/amazon_mass/km_KH.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/amazon_mass 2026-01-06T13:30:29,304 copying build/lib/unitxt/catalog/cards/amazon_mass/my_MM.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/amazon_mass 2026-01-06T13:30:29,306 copying build/lib/unitxt/catalog/cards/amazon_mass/af_ZA.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/amazon_mass 2026-01-06T13:30:29,309 copying build/lib/unitxt/catalog/cards/amazon_mass/el_GR.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/amazon_mass 2026-01-06T13:30:29,311 copying build/lib/unitxt/catalog/cards/amazon_mass/ca_ES.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/amazon_mass 2026-01-06T13:30:29,313 copying build/lib/unitxt/catalog/cards/amazon_mass/vi_VN.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/amazon_mass 2026-01-06T13:30:29,315 copying build/lib/unitxt/catalog/cards/amazon_mass/fa_IR.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/amazon_mass 2026-01-06T13:30:29,318 copying build/lib/unitxt/catalog/cards/amazon_mass/zh_CN.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/amazon_mass 2026-01-06T13:30:29,320 copying build/lib/unitxt/catalog/cards/amazon_mass/sq_AL.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/amazon_mass 2026-01-06T13:30:29,322 copying build/lib/unitxt/catalog/cards/amazon_mass/hu_HU.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/amazon_mass 2026-01-06T13:30:29,324 copying build/lib/unitxt/catalog/cards/amazon_mass/az_AZ.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/amazon_mass 2026-01-06T13:30:29,327 copying build/lib/unitxt/catalog/cards/amazon_mass/nb_NO.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/amazon_mass 2026-01-06T13:30:29,329 copying build/lib/unitxt/catalog/cards/amazon_mass/nl_NL.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/amazon_mass 2026-01-06T13:30:29,331 copying build/lib/unitxt/catalog/cards/amazon_mass/bn_BD.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/amazon_mass 2026-01-06T13:30:29,333 copying build/lib/unitxt/catalog/cards/amazon_mass/ms_MY.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/amazon_mass 2026-01-06T13:30:29,335 copying build/lib/unitxt/catalog/cards/amazon_mass/ja_JP.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/amazon_mass 2026-01-06T13:30:29,337 copying build/lib/unitxt/catalog/cards/amazon_mass/ar_SA.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/amazon_mass 2026-01-06T13:30:29,339 copying build/lib/unitxt/catalog/cards/amazon_mass/en_US.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/amazon_mass 2026-01-06T13:30:29,341 copying build/lib/unitxt/catalog/cards/amazon_mass/zh_TW.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/amazon_mass 2026-01-06T13:30:29,343 copying build/lib/unitxt/catalog/cards/amazon_mass/tl_PH.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/amazon_mass 2026-01-06T13:30:29,346 copying build/lib/unitxt/catalog/cards/amazon_mass/ta_IN.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/amazon_mass 2026-01-06T13:30:29,348 copying build/lib/unitxt/catalog/cards/amazon_mass/pt_PT.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/amazon_mass 2026-01-06T13:30:29,350 copying build/lib/unitxt/catalog/cards/amazon_mass/tr_TR.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/amazon_mass 2026-01-06T13:30:29,352 copying build/lib/unitxt/catalog/cards/amazon_mass/mn_MN.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/amazon_mass 2026-01-06T13:30:29,355 creating build/bdist.linux-armv7l/wheel/unitxt/catalog/cards/amazon_mass/all_1 2026-01-06T13:30:29,356 copying build/lib/unitxt/catalog/cards/amazon_mass/all_1/1.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/amazon_mass/all_1 2026-01-06T13:30:29,358 copying build/lib/unitxt/catalog/cards/amazon_mass/sv_SE.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/amazon_mass 2026-01-06T13:30:29,360 copying build/lib/unitxt/catalog/cards/amazon_mass/ml_IN.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/amazon_mass 2026-01-06T13:30:29,362 copying build/lib/unitxt/catalog/cards/amazon_mass/da_DK.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/amazon_mass 2026-01-06T13:30:29,365 copying build/lib/unitxt/catalog/cards/amazon_mass/sw_KE.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/amazon_mass 2026-01-06T13:30:29,367 copying build/lib/unitxt/catalog/cards/amazon_mass/id_ID.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/amazon_mass 2026-01-06T13:30:29,369 copying build/lib/unitxt/catalog/cards/amazon_mass/ka_GE.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/amazon_mass 2026-01-06T13:30:29,371 copying build/lib/unitxt/catalog/cards/amazon_mass/pl_PL.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/amazon_mass 2026-01-06T13:30:29,374 copying build/lib/unitxt/catalog/cards/amazon_mass/ko_KR.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/amazon_mass 2026-01-06T13:30:29,376 copying build/lib/unitxt/catalog/cards/amazon_mass/te_IN.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/amazon_mass 2026-01-06T13:30:29,378 copying build/lib/unitxt/catalog/cards/amazon_mass/ro_RO.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/amazon_mass 2026-01-06T13:30:29,380 copying build/lib/unitxt/catalog/cards/amazon_mass/am_ET.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/amazon_mass 2026-01-06T13:30:29,382 copying build/lib/unitxt/catalog/cards/amazon_mass/th_TH.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/amazon_mass 2026-01-06T13:30:29,384 copying build/lib/unitxt/catalog/cards/amazon_mass/is_IS.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/amazon_mass 2026-01-06T13:30:29,386 copying build/lib/unitxt/catalog/cards/amazon_mass/hi_IN.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/amazon_mass 2026-01-06T13:30:29,388 copying build/lib/unitxt/catalog/cards/amazon_mass/fr_FR.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/amazon_mass 2026-01-06T13:30:29,391 copying build/lib/unitxt/catalog/cards/amazon_mass/lv_LV.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/amazon_mass 2026-01-06T13:30:29,393 copying build/lib/unitxt/catalog/cards/amazon_mass/all.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/amazon_mass 2026-01-06T13:30:29,395 copying build/lib/unitxt/catalog/cards/amazon_mass/ru_RU.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/amazon_mass 2026-01-06T13:30:29,397 copying build/lib/unitxt/catalog/cards/amazon_mass/kn_IN.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/amazon_mass 2026-01-06T13:30:29,399 copying build/lib/unitxt/catalog/cards/coedit_gec.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards 2026-01-06T13:30:29,401 copying build/lib/unitxt/catalog/cards/pop_qa_robust.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards 2026-01-06T13:30:29,403 copying build/lib/unitxt/catalog/cards/cola.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards 2026-01-06T13:30:29,405 copying build/lib/unitxt/catalog/cards/race_middle.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards 2026-01-06T13:30:29,406 copying build/lib/unitxt/catalog/cards/unfair_tos.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards 2026-01-06T13:30:29,408 copying build/lib/unitxt/catalog/cards/news_category_classification_headline.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards 2026-01-06T13:30:29,410 copying build/lib/unitxt/catalog/cards/billsum_document_filtered_to_6000_chars.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards 2026-01-06T13:30:29,412 copying build/lib/unitxt/catalog/cards/wiki_bio.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards 2026-01-06T13:30:29,414 creating build/bdist.linux-armv7l/wheel/unitxt/catalog/cards/wmt 2026-01-06T13:30:29,415 copying build/lib/unitxt/catalog/cards/wmt/en_fr.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/wmt 2026-01-06T13:30:29,417 copying build/lib/unitxt/catalog/cards/wmt/en_ro.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/wmt 2026-01-06T13:30:29,419 copying build/lib/unitxt/catalog/cards/wmt/en_de.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/wmt 2026-01-06T13:30:29,421 creating build/bdist.linux-armv7l/wheel/unitxt/catalog/cards/tablebench_fact_checking 2026-01-06T13:30:29,422 copying build/lib/unitxt/catalog/cards/tablebench_fact_checking/legacy.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/tablebench_fact_checking 2026-01-06T13:30:29,425 creating build/bdist.linux-armv7l/wheel/unitxt/catalog/cards/bfcl 2026-01-06T13:30:29,426 copying build/lib/unitxt/catalog/cards/bfcl/simple_v3.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/bfcl 2026-01-06T13:30:29,428 creating build/bdist.linux-armv7l/wheel/unitxt/catalog/cards/bfcl/multi_turn 2026-01-06T13:30:29,429 copying build/lib/unitxt/catalog/cards/bfcl/multi_turn/simple_v3.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/bfcl/multi_turn 2026-01-06T13:30:29,431 copying build/lib/unitxt/catalog/cards/bfcl/multi_turn/live_parallel_v3.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/bfcl/multi_turn 2026-01-06T13:30:29,433 copying build/lib/unitxt/catalog/cards/bfcl/multi_turn/live_relevance_v3.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/bfcl/multi_turn 2026-01-06T13:30:29,435 copying build/lib/unitxt/catalog/cards/bfcl/multi_turn/parallel_multiple_v3.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/bfcl/multi_turn 2026-01-06T13:30:29,437 copying build/lib/unitxt/catalog/cards/bfcl/multi_turn/live_simple_v3.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/bfcl/multi_turn 2026-01-06T13:30:29,439 copying build/lib/unitxt/catalog/cards/bfcl/multi_turn/live_irrelevance_v3.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/bfcl/multi_turn 2026-01-06T13:30:29,441 copying build/lib/unitxt/catalog/cards/bfcl/multi_turn/live_multiple_v3.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/bfcl/multi_turn 2026-01-06T13:30:29,442 copying build/lib/unitxt/catalog/cards/bfcl/multi_turn/multiple_v3.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/bfcl/multi_turn 2026-01-06T13:30:29,444 copying build/lib/unitxt/catalog/cards/bfcl/multi_turn/live_parallel_multiple_v3.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/bfcl/multi_turn 2026-01-06T13:30:29,446 copying build/lib/unitxt/catalog/cards/bfcl/multi_turn/parallel_v3.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/bfcl/multi_turn 2026-01-06T13:30:29,448 copying build/lib/unitxt/catalog/cards/bfcl/multi_turn/javascript_v3.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/bfcl/multi_turn 2026-01-06T13:30:29,450 copying build/lib/unitxt/catalog/cards/bfcl/multi_turn/java_v3.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/bfcl/multi_turn 2026-01-06T13:30:29,452 creating build/bdist.linux-armv7l/wheel/unitxt/catalog/cards/almost_evil 2026-01-06T13:30:29,453 copying build/lib/unitxt/catalog/cards/almost_evil/nl.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/almost_evil 2026-01-06T13:30:29,455 copying build/lib/unitxt/catalog/cards/almost_evil/ru.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/almost_evil 2026-01-06T13:30:29,457 copying build/lib/unitxt/catalog/cards/almost_evil/en.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/almost_evil 2026-01-06T13:30:29,459 copying build/lib/unitxt/catalog/cards/almost_evil/it.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/almost_evil 2026-01-06T13:30:29,461 copying build/lib/unitxt/catalog/cards/almost_evil/es.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/almost_evil 2026-01-06T13:30:29,462 copying build/lib/unitxt/catalog/cards/almost_evil/pt.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/almost_evil 2026-01-06T13:30:29,464 copying build/lib/unitxt/catalog/cards/almost_evil/de.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/almost_evil 2026-01-06T13:30:29,466 copying build/lib/unitxt/catalog/cards/almost_evil/fr.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/almost_evil 2026-01-06T13:30:29,468 creating build/bdist.linux-armv7l/wheel/unitxt/catalog/cards/xwinogrande 2026-01-06T13:30:29,469 copying build/lib/unitxt/catalog/cards/xwinogrande/zh.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/xwinogrande 2026-01-06T13:30:29,471 copying build/lib/unitxt/catalog/cards/xwinogrande/jp.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/xwinogrande 2026-01-06T13:30:29,473 copying build/lib/unitxt/catalog/cards/xwinogrande/ru.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/xwinogrande 2026-01-06T13:30:29,475 copying build/lib/unitxt/catalog/cards/xwinogrande/en.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/xwinogrande 2026-01-06T13:30:29,477 copying build/lib/unitxt/catalog/cards/xwinogrande/pt.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/xwinogrande 2026-01-06T13:30:29,479 copying build/lib/unitxt/catalog/cards/human_eval.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards 2026-01-06T13:30:29,481 copying build/lib/unitxt/catalog/cards/tldr.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards 2026-01-06T13:30:29,482 copying build/lib/unitxt/catalog/cards/mnli.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards 2026-01-06T13:30:29,484 copying build/lib/unitxt/catalog/cards/chart_qa.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards 2026-01-06T13:30:29,486 copying build/lib/unitxt/catalog/cards/xsum.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards 2026-01-06T13:30:29,487 copying build/lib/unitxt/catalog/cards/chart_qa_lmms_eval.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards 2026-01-06T13:30:29,489 copying build/lib/unitxt/catalog/cards/turl_col_type.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards 2026-01-06T13:30:29,491 copying build/lib/unitxt/catalog/cards/sst2.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards 2026-01-06T13:30:29,494 creating build/bdist.linux-armv7l/wheel/unitxt/catalog/cards/biggen_bench 2026-01-06T13:30:29,495 creating build/bdist.linux-armv7l/wheel/unitxt/catalog/cards/biggen_bench/results 2026-01-06T13:30:29,496 copying build/lib/unitxt/catalog/cards/biggen_bench/results/human_eval.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/biggen_bench/results 2026-01-06T13:30:29,499 creating build/bdist.linux-armv7l/wheel/unitxt/catalog/cards/winogrande 2026-01-06T13:30:29,500 copying build/lib/unitxt/catalog/cards/winogrande/s.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/winogrande 2026-01-06T13:30:29,502 copying build/lib/unitxt/catalog/cards/winogrande/xs.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/winogrande 2026-01-06T13:30:29,503 copying build/lib/unitxt/catalog/cards/winogrande/xl.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/winogrande 2026-01-06T13:30:29,505 copying build/lib/unitxt/catalog/cards/winogrande/debiased.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/winogrande 2026-01-06T13:30:29,507 copying build/lib/unitxt/catalog/cards/winogrande/m.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/winogrande 2026-01-06T13:30:29,509 copying build/lib/unitxt/catalog/cards/winogrande/l.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/winogrande 2026-01-06T13:30:29,511 creating build/bdist.linux-armv7l/wheel/unitxt/catalog/cards/wnli 2026-01-06T13:30:29,512 copying build/lib/unitxt/catalog/cards/wnli/truthfulness.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/wnli 2026-01-06T13:30:29,515 creating build/bdist.linux-armv7l/wheel/unitxt/catalog/cards/global_mmlu 2026-01-06T13:30:29,517 creating build/bdist.linux-armv7l/wheel/unitxt/catalog/cards/global_mmlu/uk 2026-01-06T13:30:29,518 copying build/lib/unitxt/catalog/cards/global_mmlu/uk/elementary_mathematics.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/uk 2026-01-06T13:30:29,520 copying build/lib/unitxt/catalog/cards/global_mmlu/uk/human_aging.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/uk 2026-01-06T13:30:29,522 copying build/lib/unitxt/catalog/cards/global_mmlu/uk/high_school_computer_science.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/uk 2026-01-06T13:30:29,524 copying build/lib/unitxt/catalog/cards/global_mmlu/uk/college_physics.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/uk 2026-01-06T13:30:29,526 copying build/lib/unitxt/catalog/cards/global_mmlu/uk/college_medicine.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/uk 2026-01-06T13:30:29,528 copying build/lib/unitxt/catalog/cards/global_mmlu/uk/college_mathematics.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/uk 2026-01-06T13:30:29,530 copying build/lib/unitxt/catalog/cards/global_mmlu/uk/high_school_microeconomics.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/uk 2026-01-06T13:30:29,531 copying build/lib/unitxt/catalog/cards/global_mmlu/uk/anatomy.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/uk 2026-01-06T13:30:29,533 copying build/lib/unitxt/catalog/cards/global_mmlu/uk/world_religions.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/uk 2026-01-06T13:30:29,535 copying build/lib/unitxt/catalog/cards/global_mmlu/uk/management.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/uk 2026-01-06T13:30:29,537 copying build/lib/unitxt/catalog/cards/global_mmlu/uk/moral_scenarios.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/uk 2026-01-06T13:30:29,539 copying build/lib/unitxt/catalog/cards/global_mmlu/uk/global_facts.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/uk 2026-01-06T13:30:29,540 copying build/lib/unitxt/catalog/cards/global_mmlu/uk/miscellaneous.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/uk 2026-01-06T13:30:29,542 copying build/lib/unitxt/catalog/cards/global_mmlu/uk/clinical_knowledge.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/uk 2026-01-06T13:30:29,544 copying build/lib/unitxt/catalog/cards/global_mmlu/uk/high_school_biology.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/uk 2026-01-06T13:30:29,546 copying build/lib/unitxt/catalog/cards/global_mmlu/uk/prehistory.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/uk 2026-01-06T13:30:29,548 copying build/lib/unitxt/catalog/cards/global_mmlu/uk/high_school_us_history.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/uk 2026-01-06T13:30:29,550 copying build/lib/unitxt/catalog/cards/global_mmlu/uk/international_law.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/uk 2026-01-06T13:30:29,551 copying build/lib/unitxt/catalog/cards/global_mmlu/uk/college_computer_science.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/uk 2026-01-06T13:30:29,553 copying build/lib/unitxt/catalog/cards/global_mmlu/uk/astronomy.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/uk 2026-01-06T13:30:29,555 copying build/lib/unitxt/catalog/cards/global_mmlu/uk/high_school_european_history.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/uk 2026-01-06T13:30:29,557 copying build/lib/unitxt/catalog/cards/global_mmlu/uk/electrical_engineering.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/uk 2026-01-06T13:30:29,559 copying build/lib/unitxt/catalog/cards/global_mmlu/uk/nutrition.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/uk 2026-01-06T13:30:29,561 copying build/lib/unitxt/catalog/cards/global_mmlu/uk/abstract_algebra.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/uk 2026-01-06T13:30:29,563 copying build/lib/unitxt/catalog/cards/global_mmlu/uk/professional_medicine.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/uk 2026-01-06T13:30:29,565 copying build/lib/unitxt/catalog/cards/global_mmlu/uk/human_sexuality.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/uk 2026-01-06T13:30:29,566 copying build/lib/unitxt/catalog/cards/global_mmlu/uk/business_ethics.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/uk 2026-01-06T13:30:29,569 copying build/lib/unitxt/catalog/cards/global_mmlu/uk/high_school_chemistry.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/uk 2026-01-06T13:30:29,571 copying build/lib/unitxt/catalog/cards/global_mmlu/uk/logical_fallacies.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/uk 2026-01-06T13:30:29,573 copying build/lib/unitxt/catalog/cards/global_mmlu/uk/formal_logic.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/uk 2026-01-06T13:30:29,574 copying build/lib/unitxt/catalog/cards/global_mmlu/uk/high_school_psychology.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/uk 2026-01-06T13:30:29,576 copying build/lib/unitxt/catalog/cards/global_mmlu/uk/medical_genetics.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/uk 2026-01-06T13:30:29,578 copying build/lib/unitxt/catalog/cards/global_mmlu/uk/security_studies.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/uk 2026-01-06T13:30:29,580 copying build/lib/unitxt/catalog/cards/global_mmlu/uk/high_school_macroeconomics.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/uk 2026-01-06T13:30:29,582 copying build/lib/unitxt/catalog/cards/global_mmlu/uk/professional_law.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/uk 2026-01-06T13:30:29,583 copying build/lib/unitxt/catalog/cards/global_mmlu/uk/high_school_physics.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/uk 2026-01-06T13:30:29,585 copying build/lib/unitxt/catalog/cards/global_mmlu/uk/econometrics.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/uk 2026-01-06T13:30:29,587 copying build/lib/unitxt/catalog/cards/global_mmlu/uk/sociology.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/uk 2026-01-06T13:30:29,589 copying build/lib/unitxt/catalog/cards/global_mmlu/uk/moral_disputes.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/uk 2026-01-06T13:30:29,591 copying build/lib/unitxt/catalog/cards/global_mmlu/uk/college_chemistry.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/uk 2026-01-06T13:30:29,593 copying build/lib/unitxt/catalog/cards/global_mmlu/uk/high_school_geography.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/uk 2026-01-06T13:30:29,595 copying build/lib/unitxt/catalog/cards/global_mmlu/uk/jurisprudence.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/uk 2026-01-06T13:30:29,596 copying build/lib/unitxt/catalog/cards/global_mmlu/uk/high_school_statistics.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/uk 2026-01-06T13:30:29,598 copying build/lib/unitxt/catalog/cards/global_mmlu/uk/professional_accounting.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/uk 2026-01-06T13:30:29,600 copying build/lib/unitxt/catalog/cards/global_mmlu/uk/us_foreign_policy.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/uk 2026-01-06T13:30:29,602 copying build/lib/unitxt/catalog/cards/global_mmlu/uk/professional_psychology.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/uk 2026-01-06T13:30:29,604 copying build/lib/unitxt/catalog/cards/global_mmlu/uk/public_relations.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/uk 2026-01-06T13:30:29,606 copying build/lib/unitxt/catalog/cards/global_mmlu/uk/computer_security.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/uk 2026-01-06T13:30:29,608 copying build/lib/unitxt/catalog/cards/global_mmlu/uk/philosophy.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/uk 2026-01-06T13:30:29,610 copying build/lib/unitxt/catalog/cards/global_mmlu/uk/virology.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/uk 2026-01-06T13:30:29,611 copying build/lib/unitxt/catalog/cards/global_mmlu/uk/marketing.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/uk 2026-01-06T13:30:29,613 copying build/lib/unitxt/catalog/cards/global_mmlu/uk/high_school_world_history.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/uk 2026-01-06T13:30:29,615 copying build/lib/unitxt/catalog/cards/global_mmlu/uk/machine_learning.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/uk 2026-01-06T13:30:29,617 copying build/lib/unitxt/catalog/cards/global_mmlu/uk/high_school_government_and_politics.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/uk 2026-01-06T13:30:29,619 copying build/lib/unitxt/catalog/cards/global_mmlu/uk/conceptual_physics.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/uk 2026-01-06T13:30:29,621 copying build/lib/unitxt/catalog/cards/global_mmlu/uk/college_biology.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/uk 2026-01-06T13:30:29,622 copying build/lib/unitxt/catalog/cards/global_mmlu/uk/high_school_mathematics.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/uk 2026-01-06T13:30:29,625 creating build/bdist.linux-armv7l/wheel/unitxt/catalog/cards/global_mmlu/ny 2026-01-06T13:30:29,626 copying build/lib/unitxt/catalog/cards/global_mmlu/ny/elementary_mathematics.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/ny 2026-01-06T13:30:29,628 copying build/lib/unitxt/catalog/cards/global_mmlu/ny/human_aging.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/ny 2026-01-06T13:30:29,630 copying build/lib/unitxt/catalog/cards/global_mmlu/ny/high_school_computer_science.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/ny 2026-01-06T13:30:29,632 copying build/lib/unitxt/catalog/cards/global_mmlu/ny/college_physics.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/ny 2026-01-06T13:30:29,633 copying build/lib/unitxt/catalog/cards/global_mmlu/ny/college_medicine.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/ny 2026-01-06T13:30:29,635 copying build/lib/unitxt/catalog/cards/global_mmlu/ny/college_mathematics.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/ny 2026-01-06T13:30:29,637 copying build/lib/unitxt/catalog/cards/global_mmlu/ny/high_school_microeconomics.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/ny 2026-01-06T13:30:29,639 copying build/lib/unitxt/catalog/cards/global_mmlu/ny/anatomy.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/ny 2026-01-06T13:30:29,641 copying build/lib/unitxt/catalog/cards/global_mmlu/ny/world_religions.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/ny 2026-01-06T13:30:29,643 copying build/lib/unitxt/catalog/cards/global_mmlu/ny/management.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/ny 2026-01-06T13:30:29,645 copying build/lib/unitxt/catalog/cards/global_mmlu/ny/moral_scenarios.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/ny 2026-01-06T13:30:29,646 copying build/lib/unitxt/catalog/cards/global_mmlu/ny/global_facts.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/ny 2026-01-06T13:30:29,649 copying build/lib/unitxt/catalog/cards/global_mmlu/ny/miscellaneous.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/ny 2026-01-06T13:30:29,650 copying build/lib/unitxt/catalog/cards/global_mmlu/ny/clinical_knowledge.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/ny 2026-01-06T13:30:29,652 copying build/lib/unitxt/catalog/cards/global_mmlu/ny/high_school_biology.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/ny 2026-01-06T13:30:29,654 copying build/lib/unitxt/catalog/cards/global_mmlu/ny/prehistory.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/ny 2026-01-06T13:30:29,656 copying build/lib/unitxt/catalog/cards/global_mmlu/ny/high_school_us_history.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/ny 2026-01-06T13:30:29,658 copying build/lib/unitxt/catalog/cards/global_mmlu/ny/international_law.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/ny 2026-01-06T13:30:29,660 copying build/lib/unitxt/catalog/cards/global_mmlu/ny/college_computer_science.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/ny 2026-01-06T13:30:29,662 copying build/lib/unitxt/catalog/cards/global_mmlu/ny/astronomy.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/ny 2026-01-06T13:30:29,664 copying build/lib/unitxt/catalog/cards/global_mmlu/ny/high_school_european_history.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/ny 2026-01-06T13:30:29,665 copying build/lib/unitxt/catalog/cards/global_mmlu/ny/electrical_engineering.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/ny 2026-01-06T13:30:29,667 copying build/lib/unitxt/catalog/cards/global_mmlu/ny/nutrition.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/ny 2026-01-06T13:30:29,669 copying build/lib/unitxt/catalog/cards/global_mmlu/ny/abstract_algebra.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/ny 2026-01-06T13:30:29,671 copying build/lib/unitxt/catalog/cards/global_mmlu/ny/professional_medicine.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/ny 2026-01-06T13:30:29,673 copying build/lib/unitxt/catalog/cards/global_mmlu/ny/human_sexuality.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/ny 2026-01-06T13:30:29,674 copying build/lib/unitxt/catalog/cards/global_mmlu/ny/business_ethics.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/ny 2026-01-06T13:30:29,676 copying build/lib/unitxt/catalog/cards/global_mmlu/ny/high_school_chemistry.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/ny 2026-01-06T13:30:29,678 copying build/lib/unitxt/catalog/cards/global_mmlu/ny/logical_fallacies.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/ny 2026-01-06T13:30:29,680 copying build/lib/unitxt/catalog/cards/global_mmlu/ny/formal_logic.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/ny 2026-01-06T13:30:29,682 copying build/lib/unitxt/catalog/cards/global_mmlu/ny/high_school_psychology.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/ny 2026-01-06T13:30:29,683 copying build/lib/unitxt/catalog/cards/global_mmlu/ny/medical_genetics.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/ny 2026-01-06T13:30:29,685 copying build/lib/unitxt/catalog/cards/global_mmlu/ny/security_studies.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/ny 2026-01-06T13:30:29,687 copying build/lib/unitxt/catalog/cards/global_mmlu/ny/high_school_macroeconomics.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/ny 2026-01-06T13:30:29,690 copying build/lib/unitxt/catalog/cards/global_mmlu/ny/professional_law.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/ny 2026-01-06T13:30:29,691 copying build/lib/unitxt/catalog/cards/global_mmlu/ny/high_school_physics.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/ny 2026-01-06T13:30:29,693 copying build/lib/unitxt/catalog/cards/global_mmlu/ny/econometrics.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/ny 2026-01-06T13:30:29,695 copying build/lib/unitxt/catalog/cards/global_mmlu/ny/sociology.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/ny 2026-01-06T13:30:29,697 copying build/lib/unitxt/catalog/cards/global_mmlu/ny/moral_disputes.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/ny 2026-01-06T13:30:29,699 copying build/lib/unitxt/catalog/cards/global_mmlu/ny/college_chemistry.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/ny 2026-01-06T13:30:29,701 copying build/lib/unitxt/catalog/cards/global_mmlu/ny/high_school_geography.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/ny 2026-01-06T13:30:29,703 copying build/lib/unitxt/catalog/cards/global_mmlu/ny/jurisprudence.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/ny 2026-01-06T13:30:29,705 copying build/lib/unitxt/catalog/cards/global_mmlu/ny/high_school_statistics.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/ny 2026-01-06T13:30:29,707 copying build/lib/unitxt/catalog/cards/global_mmlu/ny/professional_accounting.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/ny 2026-01-06T13:30:29,709 copying build/lib/unitxt/catalog/cards/global_mmlu/ny/us_foreign_policy.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/ny 2026-01-06T13:30:29,710 copying build/lib/unitxt/catalog/cards/global_mmlu/ny/professional_psychology.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/ny 2026-01-06T13:30:29,712 copying build/lib/unitxt/catalog/cards/global_mmlu/ny/public_relations.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/ny 2026-01-06T13:30:29,714 copying build/lib/unitxt/catalog/cards/global_mmlu/ny/computer_security.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/ny 2026-01-06T13:30:29,716 copying build/lib/unitxt/catalog/cards/global_mmlu/ny/philosophy.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/ny 2026-01-06T13:30:29,718 copying build/lib/unitxt/catalog/cards/global_mmlu/ny/virology.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/ny 2026-01-06T13:30:29,719 copying build/lib/unitxt/catalog/cards/global_mmlu/ny/marketing.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/ny 2026-01-06T13:30:29,721 copying build/lib/unitxt/catalog/cards/global_mmlu/ny/high_school_world_history.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/ny 2026-01-06T13:30:29,723 copying build/lib/unitxt/catalog/cards/global_mmlu/ny/machine_learning.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/ny 2026-01-06T13:30:29,725 copying build/lib/unitxt/catalog/cards/global_mmlu/ny/high_school_government_and_politics.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/ny 2026-01-06T13:30:29,727 copying build/lib/unitxt/catalog/cards/global_mmlu/ny/conceptual_physics.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/ny 2026-01-06T13:30:29,729 copying build/lib/unitxt/catalog/cards/global_mmlu/ny/college_biology.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/ny 2026-01-06T13:30:29,731 copying build/lib/unitxt/catalog/cards/global_mmlu/ny/high_school_mathematics.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/ny 2026-01-06T13:30:29,734 creating build/bdist.linux-armv7l/wheel/unitxt/catalog/cards/global_mmlu/so 2026-01-06T13:30:29,735 copying build/lib/unitxt/catalog/cards/global_mmlu/so/elementary_mathematics.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/so 2026-01-06T13:30:29,737 copying build/lib/unitxt/catalog/cards/global_mmlu/so/human_aging.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/so 2026-01-06T13:30:29,739 copying build/lib/unitxt/catalog/cards/global_mmlu/so/high_school_computer_science.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/so 2026-01-06T13:30:29,741 copying build/lib/unitxt/catalog/cards/global_mmlu/so/college_physics.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/so 2026-01-06T13:30:29,743 copying build/lib/unitxt/catalog/cards/global_mmlu/so/college_medicine.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/so 2026-01-06T13:30:29,745 copying build/lib/unitxt/catalog/cards/global_mmlu/so/college_mathematics.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/so 2026-01-06T13:30:29,746 copying build/lib/unitxt/catalog/cards/global_mmlu/so/high_school_microeconomics.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/so 2026-01-06T13:30:29,748 copying build/lib/unitxt/catalog/cards/global_mmlu/so/anatomy.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/so 2026-01-06T13:30:29,750 copying build/lib/unitxt/catalog/cards/global_mmlu/so/world_religions.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/so 2026-01-06T13:30:29,752 copying build/lib/unitxt/catalog/cards/global_mmlu/so/management.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/so 2026-01-06T13:30:29,754 copying build/lib/unitxt/catalog/cards/global_mmlu/so/moral_scenarios.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/so 2026-01-06T13:30:29,756 copying build/lib/unitxt/catalog/cards/global_mmlu/so/global_facts.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/so 2026-01-06T13:30:29,758 copying build/lib/unitxt/catalog/cards/global_mmlu/so/miscellaneous.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/so 2026-01-06T13:30:29,759 copying build/lib/unitxt/catalog/cards/global_mmlu/so/clinical_knowledge.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/so 2026-01-06T13:30:29,761 copying build/lib/unitxt/catalog/cards/global_mmlu/so/high_school_biology.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/so 2026-01-06T13:30:29,763 copying build/lib/unitxt/catalog/cards/global_mmlu/so/prehistory.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/so 2026-01-06T13:30:29,765 copying build/lib/unitxt/catalog/cards/global_mmlu/so/high_school_us_history.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/so 2026-01-06T13:30:29,767 copying build/lib/unitxt/catalog/cards/global_mmlu/so/international_law.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/so 2026-01-06T13:30:29,768 copying build/lib/unitxt/catalog/cards/global_mmlu/so/college_computer_science.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/so 2026-01-06T13:30:29,770 copying build/lib/unitxt/catalog/cards/global_mmlu/so/astronomy.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/so 2026-01-06T13:30:29,772 copying build/lib/unitxt/catalog/cards/global_mmlu/so/high_school_european_history.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/so 2026-01-06T13:30:29,774 copying build/lib/unitxt/catalog/cards/global_mmlu/so/electrical_engineering.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/so 2026-01-06T13:30:29,776 copying build/lib/unitxt/catalog/cards/global_mmlu/so/nutrition.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/so 2026-01-06T13:30:29,778 copying build/lib/unitxt/catalog/cards/global_mmlu/so/abstract_algebra.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/so 2026-01-06T13:30:29,780 copying build/lib/unitxt/catalog/cards/global_mmlu/so/professional_medicine.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/so 2026-01-06T13:30:29,782 copying build/lib/unitxt/catalog/cards/global_mmlu/so/human_sexuality.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/so 2026-01-06T13:30:29,783 copying build/lib/unitxt/catalog/cards/global_mmlu/so/business_ethics.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/so 2026-01-06T13:30:29,785 copying build/lib/unitxt/catalog/cards/global_mmlu/so/high_school_chemistry.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/so 2026-01-06T13:30:29,787 copying build/lib/unitxt/catalog/cards/global_mmlu/so/logical_fallacies.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/so 2026-01-06T13:30:29,789 copying build/lib/unitxt/catalog/cards/global_mmlu/so/formal_logic.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/so 2026-01-06T13:30:29,791 copying build/lib/unitxt/catalog/cards/global_mmlu/so/high_school_psychology.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/so 2026-01-06T13:30:29,793 copying build/lib/unitxt/catalog/cards/global_mmlu/so/medical_genetics.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/so 2026-01-06T13:30:29,795 copying build/lib/unitxt/catalog/cards/global_mmlu/so/security_studies.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/so 2026-01-06T13:30:29,797 copying build/lib/unitxt/catalog/cards/global_mmlu/so/high_school_macroeconomics.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/so 2026-01-06T13:30:29,799 copying build/lib/unitxt/catalog/cards/global_mmlu/so/professional_law.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/so 2026-01-06T13:30:29,800 copying build/lib/unitxt/catalog/cards/global_mmlu/so/high_school_physics.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/so 2026-01-06T13:30:29,802 copying build/lib/unitxt/catalog/cards/global_mmlu/so/econometrics.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/so 2026-01-06T13:30:29,804 copying build/lib/unitxt/catalog/cards/global_mmlu/so/sociology.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/so 2026-01-06T13:30:29,806 copying build/lib/unitxt/catalog/cards/global_mmlu/so/moral_disputes.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/so 2026-01-06T13:30:29,807 copying build/lib/unitxt/catalog/cards/global_mmlu/so/college_chemistry.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/so 2026-01-06T13:30:29,809 copying build/lib/unitxt/catalog/cards/global_mmlu/so/high_school_geography.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/so 2026-01-06T13:30:29,811 copying build/lib/unitxt/catalog/cards/global_mmlu/so/jurisprudence.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/so 2026-01-06T13:30:29,813 copying build/lib/unitxt/catalog/cards/global_mmlu/so/high_school_statistics.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/so 2026-01-06T13:30:29,815 copying build/lib/unitxt/catalog/cards/global_mmlu/so/professional_accounting.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/so 2026-01-06T13:30:29,817 copying build/lib/unitxt/catalog/cards/global_mmlu/so/us_foreign_policy.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/so 2026-01-06T13:30:29,819 copying build/lib/unitxt/catalog/cards/global_mmlu/so/professional_psychology.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/so 2026-01-06T13:30:29,821 copying build/lib/unitxt/catalog/cards/global_mmlu/so/public_relations.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/so 2026-01-06T13:30:29,822 copying build/lib/unitxt/catalog/cards/global_mmlu/so/computer_security.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/so 2026-01-06T13:30:29,824 copying build/lib/unitxt/catalog/cards/global_mmlu/so/philosophy.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/so 2026-01-06T13:30:29,826 copying build/lib/unitxt/catalog/cards/global_mmlu/so/virology.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/so 2026-01-06T13:30:29,828 copying build/lib/unitxt/catalog/cards/global_mmlu/so/marketing.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/so 2026-01-06T13:30:29,830 copying build/lib/unitxt/catalog/cards/global_mmlu/so/high_school_world_history.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/so 2026-01-06T13:30:29,832 copying build/lib/unitxt/catalog/cards/global_mmlu/so/machine_learning.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/so 2026-01-06T13:30:29,834 copying build/lib/unitxt/catalog/cards/global_mmlu/so/high_school_government_and_politics.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/so 2026-01-06T13:30:29,835 copying build/lib/unitxt/catalog/cards/global_mmlu/so/conceptual_physics.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/so 2026-01-06T13:30:29,837 copying build/lib/unitxt/catalog/cards/global_mmlu/so/college_biology.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/so 2026-01-06T13:30:29,839 copying build/lib/unitxt/catalog/cards/global_mmlu/so/high_school_mathematics.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/so 2026-01-06T13:30:29,842 creating build/bdist.linux-armv7l/wheel/unitxt/catalog/cards/global_mmlu/he 2026-01-06T13:30:29,843 copying build/lib/unitxt/catalog/cards/global_mmlu/he/elementary_mathematics.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/he 2026-01-06T13:30:29,845 copying build/lib/unitxt/catalog/cards/global_mmlu/he/human_aging.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/he 2026-01-06T13:30:29,847 copying build/lib/unitxt/catalog/cards/global_mmlu/he/high_school_computer_science.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/he 2026-01-06T13:30:29,849 copying build/lib/unitxt/catalog/cards/global_mmlu/he/college_physics.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/he 2026-01-06T13:30:29,851 copying build/lib/unitxt/catalog/cards/global_mmlu/he/college_medicine.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/he 2026-01-06T13:30:29,853 copying build/lib/unitxt/catalog/cards/global_mmlu/he/college_mathematics.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/he 2026-01-06T13:30:29,855 copying build/lib/unitxt/catalog/cards/global_mmlu/he/high_school_microeconomics.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/he 2026-01-06T13:30:29,857 copying build/lib/unitxt/catalog/cards/global_mmlu/he/anatomy.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/he 2026-01-06T13:30:29,859 copying build/lib/unitxt/catalog/cards/global_mmlu/he/world_religions.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/he 2026-01-06T13:30:29,861 copying build/lib/unitxt/catalog/cards/global_mmlu/he/management.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/he 2026-01-06T13:30:29,863 copying build/lib/unitxt/catalog/cards/global_mmlu/he/moral_scenarios.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/he 2026-01-06T13:30:29,864 copying build/lib/unitxt/catalog/cards/global_mmlu/he/global_facts.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/he 2026-01-06T13:30:29,866 copying build/lib/unitxt/catalog/cards/global_mmlu/he/miscellaneous.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/he 2026-01-06T13:30:29,868 copying build/lib/unitxt/catalog/cards/global_mmlu/he/clinical_knowledge.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/he 2026-01-06T13:30:29,870 copying build/lib/unitxt/catalog/cards/global_mmlu/he/high_school_biology.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/he 2026-01-06T13:30:29,872 copying build/lib/unitxt/catalog/cards/global_mmlu/he/prehistory.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/he 2026-01-06T13:30:29,874 copying build/lib/unitxt/catalog/cards/global_mmlu/he/high_school_us_history.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/he 2026-01-06T13:30:29,876 copying build/lib/unitxt/catalog/cards/global_mmlu/he/international_law.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/he 2026-01-06T13:30:29,878 copying build/lib/unitxt/catalog/cards/global_mmlu/he/college_computer_science.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/he 2026-01-06T13:30:29,880 copying build/lib/unitxt/catalog/cards/global_mmlu/he/astronomy.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/he 2026-01-06T13:30:29,882 copying build/lib/unitxt/catalog/cards/global_mmlu/he/high_school_european_history.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/he 2026-01-06T13:30:29,883 copying build/lib/unitxt/catalog/cards/global_mmlu/he/electrical_engineering.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/he 2026-01-06T13:30:29,885 copying build/lib/unitxt/catalog/cards/global_mmlu/he/nutrition.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/he 2026-01-06T13:30:29,887 copying build/lib/unitxt/catalog/cards/global_mmlu/he/abstract_algebra.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/he 2026-01-06T13:30:29,889 copying build/lib/unitxt/catalog/cards/global_mmlu/he/professional_medicine.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/he 2026-01-06T13:30:29,891 copying build/lib/unitxt/catalog/cards/global_mmlu/he/human_sexuality.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/he 2026-01-06T13:30:29,893 copying build/lib/unitxt/catalog/cards/global_mmlu/he/business_ethics.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/he 2026-01-06T13:30:29,895 copying build/lib/unitxt/catalog/cards/global_mmlu/he/high_school_chemistry.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/he 2026-01-06T13:30:29,897 copying build/lib/unitxt/catalog/cards/global_mmlu/he/logical_fallacies.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/he 2026-01-06T13:30:29,899 copying build/lib/unitxt/catalog/cards/global_mmlu/he/formal_logic.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/he 2026-01-06T13:30:29,900 copying build/lib/unitxt/catalog/cards/global_mmlu/he/high_school_psychology.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/he 2026-01-06T13:30:29,902 copying build/lib/unitxt/catalog/cards/global_mmlu/he/medical_genetics.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/he 2026-01-06T13:30:29,904 copying build/lib/unitxt/catalog/cards/global_mmlu/he/security_studies.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/he 2026-01-06T13:30:29,906 copying build/lib/unitxt/catalog/cards/global_mmlu/he/high_school_macroeconomics.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/he 2026-01-06T13:30:29,908 copying build/lib/unitxt/catalog/cards/global_mmlu/he/professional_law.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/he 2026-01-06T13:30:29,910 copying build/lib/unitxt/catalog/cards/global_mmlu/he/high_school_physics.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/he 2026-01-06T13:30:29,912 copying build/lib/unitxt/catalog/cards/global_mmlu/he/econometrics.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/he 2026-01-06T13:30:29,913 copying build/lib/unitxt/catalog/cards/global_mmlu/he/sociology.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/he 2026-01-06T13:30:29,915 copying build/lib/unitxt/catalog/cards/global_mmlu/he/moral_disputes.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/he 2026-01-06T13:30:29,917 copying build/lib/unitxt/catalog/cards/global_mmlu/he/college_chemistry.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/he 2026-01-06T13:30:29,919 copying build/lib/unitxt/catalog/cards/global_mmlu/he/high_school_geography.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/he 2026-01-06T13:30:29,921 copying build/lib/unitxt/catalog/cards/global_mmlu/he/jurisprudence.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/he 2026-01-06T13:30:29,923 copying build/lib/unitxt/catalog/cards/global_mmlu/he/high_school_statistics.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/he 2026-01-06T13:30:29,925 copying build/lib/unitxt/catalog/cards/global_mmlu/he/professional_accounting.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/he 2026-01-06T13:30:29,927 copying build/lib/unitxt/catalog/cards/global_mmlu/he/us_foreign_policy.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/he 2026-01-06T13:30:29,928 copying build/lib/unitxt/catalog/cards/global_mmlu/he/professional_psychology.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/he 2026-01-06T13:30:29,930 copying build/lib/unitxt/catalog/cards/global_mmlu/he/public_relations.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/he 2026-01-06T13:30:29,932 copying build/lib/unitxt/catalog/cards/global_mmlu/he/computer_security.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/he 2026-01-06T13:30:29,934 copying build/lib/unitxt/catalog/cards/global_mmlu/he/philosophy.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/he 2026-01-06T13:30:29,936 copying build/lib/unitxt/catalog/cards/global_mmlu/he/virology.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/he 2026-01-06T13:30:29,937 copying build/lib/unitxt/catalog/cards/global_mmlu/he/marketing.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/he 2026-01-06T13:30:29,939 copying build/lib/unitxt/catalog/cards/global_mmlu/he/high_school_world_history.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/he 2026-01-06T13:30:29,941 copying build/lib/unitxt/catalog/cards/global_mmlu/he/machine_learning.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/he 2026-01-06T13:30:29,943 copying build/lib/unitxt/catalog/cards/global_mmlu/he/high_school_government_and_politics.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/he 2026-01-06T13:30:29,945 copying build/lib/unitxt/catalog/cards/global_mmlu/he/conceptual_physics.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/he 2026-01-06T13:30:29,946 copying build/lib/unitxt/catalog/cards/global_mmlu/he/college_biology.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/he 2026-01-06T13:30:29,949 copying build/lib/unitxt/catalog/cards/global_mmlu/he/high_school_mathematics.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/he 2026-01-06T13:30:29,952 creating build/bdist.linux-armv7l/wheel/unitxt/catalog/cards/global_mmlu/en 2026-01-06T13:30:29,953 copying build/lib/unitxt/catalog/cards/global_mmlu/en/elementary_mathematics.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/en 2026-01-06T13:30:29,955 copying build/lib/unitxt/catalog/cards/global_mmlu/en/human_aging.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/en 2026-01-06T13:30:29,957 copying build/lib/unitxt/catalog/cards/global_mmlu/en/high_school_computer_science.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/en 2026-01-06T13:30:29,959 copying build/lib/unitxt/catalog/cards/global_mmlu/en/college_physics.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/en 2026-01-06T13:30:29,961 copying build/lib/unitxt/catalog/cards/global_mmlu/en/college_medicine.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/en 2026-01-06T13:30:29,963 copying build/lib/unitxt/catalog/cards/global_mmlu/en/college_mathematics.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/en 2026-01-06T13:30:29,964 copying build/lib/unitxt/catalog/cards/global_mmlu/en/high_school_microeconomics.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/en 2026-01-06T13:30:29,966 copying build/lib/unitxt/catalog/cards/global_mmlu/en/anatomy.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/en 2026-01-06T13:30:29,968 copying build/lib/unitxt/catalog/cards/global_mmlu/en/world_religions.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/en 2026-01-06T13:30:29,970 copying build/lib/unitxt/catalog/cards/global_mmlu/en/management.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/en 2026-01-06T13:30:29,972 copying build/lib/unitxt/catalog/cards/global_mmlu/en/moral_scenarios.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/en 2026-01-06T13:30:29,974 copying build/lib/unitxt/catalog/cards/global_mmlu/en/global_facts.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/en 2026-01-06T13:30:29,976 copying build/lib/unitxt/catalog/cards/global_mmlu/en/miscellaneous.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/en 2026-01-06T13:30:29,978 copying build/lib/unitxt/catalog/cards/global_mmlu/en/clinical_knowledge.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/en 2026-01-06T13:30:29,980 copying build/lib/unitxt/catalog/cards/global_mmlu/en/high_school_biology.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/en 2026-01-06T13:30:29,981 copying build/lib/unitxt/catalog/cards/global_mmlu/en/prehistory.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/en 2026-01-06T13:30:29,983 copying build/lib/unitxt/catalog/cards/global_mmlu/en/high_school_us_history.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/en 2026-01-06T13:30:29,985 copying build/lib/unitxt/catalog/cards/global_mmlu/en/international_law.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/en 2026-01-06T13:30:29,987 copying build/lib/unitxt/catalog/cards/global_mmlu/en/college_computer_science.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/en 2026-01-06T13:30:29,989 copying build/lib/unitxt/catalog/cards/global_mmlu/en/astronomy.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/en 2026-01-06T13:30:29,991 copying build/lib/unitxt/catalog/cards/global_mmlu/en/high_school_european_history.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/en 2026-01-06T13:30:29,992 copying build/lib/unitxt/catalog/cards/global_mmlu/en/electrical_engineering.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/en 2026-01-06T13:30:29,994 copying build/lib/unitxt/catalog/cards/global_mmlu/en/nutrition.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/en 2026-01-06T13:30:29,996 copying build/lib/unitxt/catalog/cards/global_mmlu/en/abstract_algebra.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/en 2026-01-06T13:30:29,998 copying build/lib/unitxt/catalog/cards/global_mmlu/en/professional_medicine.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/en 2026-01-06T13:30:30,000 copying build/lib/unitxt/catalog/cards/global_mmlu/en/human_sexuality.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/en 2026-01-06T13:30:30,002 copying build/lib/unitxt/catalog/cards/global_mmlu/en/business_ethics.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/en 2026-01-06T13:30:30,004 copying build/lib/unitxt/catalog/cards/global_mmlu/en/high_school_chemistry.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/en 2026-01-06T13:30:30,006 copying build/lib/unitxt/catalog/cards/global_mmlu/en/logical_fallacies.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/en 2026-01-06T13:30:30,008 copying build/lib/unitxt/catalog/cards/global_mmlu/en/formal_logic.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/en 2026-01-06T13:30:30,010 copying build/lib/unitxt/catalog/cards/global_mmlu/en/high_school_psychology.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/en 2026-01-06T13:30:30,012 copying build/lib/unitxt/catalog/cards/global_mmlu/en/medical_genetics.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/en 2026-01-06T13:30:30,013 copying build/lib/unitxt/catalog/cards/global_mmlu/en/security_studies.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/en 2026-01-06T13:30:30,015 copying build/lib/unitxt/catalog/cards/global_mmlu/en/high_school_macroeconomics.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/en 2026-01-06T13:30:30,017 copying build/lib/unitxt/catalog/cards/global_mmlu/en/professional_law.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/en 2026-01-06T13:30:30,019 copying build/lib/unitxt/catalog/cards/global_mmlu/en/high_school_physics.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/en 2026-01-06T13:30:30,021 copying build/lib/unitxt/catalog/cards/global_mmlu/en/econometrics.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/en 2026-01-06T13:30:30,023 copying build/lib/unitxt/catalog/cards/global_mmlu/en/sociology.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/en 2026-01-06T13:30:30,025 copying build/lib/unitxt/catalog/cards/global_mmlu/en/moral_disputes.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/en 2026-01-06T13:30:30,026 copying build/lib/unitxt/catalog/cards/global_mmlu/en/college_chemistry.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/en 2026-01-06T13:30:30,028 copying build/lib/unitxt/catalog/cards/global_mmlu/en/high_school_geography.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/en 2026-01-06T13:30:30,030 copying build/lib/unitxt/catalog/cards/global_mmlu/en/jurisprudence.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/en 2026-01-06T13:30:30,032 copying build/lib/unitxt/catalog/cards/global_mmlu/en/high_school_statistics.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/en 2026-01-06T13:30:30,034 copying build/lib/unitxt/catalog/cards/global_mmlu/en/professional_accounting.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/en 2026-01-06T13:30:30,036 copying build/lib/unitxt/catalog/cards/global_mmlu/en/us_foreign_policy.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/en 2026-01-06T13:30:30,037 copying build/lib/unitxt/catalog/cards/global_mmlu/en/professional_psychology.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/en 2026-01-06T13:30:30,039 copying build/lib/unitxt/catalog/cards/global_mmlu/en/public_relations.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/en 2026-01-06T13:30:30,041 copying build/lib/unitxt/catalog/cards/global_mmlu/en/computer_security.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/en 2026-01-06T13:30:30,043 copying build/lib/unitxt/catalog/cards/global_mmlu/en/philosophy.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/en 2026-01-06T13:30:30,045 copying build/lib/unitxt/catalog/cards/global_mmlu/en/virology.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/en 2026-01-06T13:30:30,047 copying build/lib/unitxt/catalog/cards/global_mmlu/en/marketing.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/en 2026-01-06T13:30:30,049 copying build/lib/unitxt/catalog/cards/global_mmlu/en/high_school_world_history.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/en 2026-01-06T13:30:30,051 copying build/lib/unitxt/catalog/cards/global_mmlu/en/machine_learning.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/en 2026-01-06T13:30:30,053 copying build/lib/unitxt/catalog/cards/global_mmlu/en/high_school_government_and_politics.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/en 2026-01-06T13:30:30,054 copying build/lib/unitxt/catalog/cards/global_mmlu/en/conceptual_physics.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/en 2026-01-06T13:30:30,057 copying build/lib/unitxt/catalog/cards/global_mmlu/en/college_biology.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/en 2026-01-06T13:30:30,059 copying build/lib/unitxt/catalog/cards/global_mmlu/en/high_school_mathematics.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/en 2026-01-06T13:30:30,062 creating build/bdist.linux-armv7l/wheel/unitxt/catalog/cards/global_mmlu/es 2026-01-06T13:30:30,063 copying build/lib/unitxt/catalog/cards/global_mmlu/es/elementary_mathematics.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/es 2026-01-06T13:30:30,065 copying build/lib/unitxt/catalog/cards/global_mmlu/es/human_aging.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/es 2026-01-06T13:30:30,067 copying build/lib/unitxt/catalog/cards/global_mmlu/es/high_school_computer_science.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/es 2026-01-06T13:30:30,069 copying build/lib/unitxt/catalog/cards/global_mmlu/es/college_physics.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/es 2026-01-06T13:30:30,070 copying build/lib/unitxt/catalog/cards/global_mmlu/es/college_medicine.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/es 2026-01-06T13:30:30,072 copying build/lib/unitxt/catalog/cards/global_mmlu/es/college_mathematics.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/es 2026-01-06T13:30:30,074 copying build/lib/unitxt/catalog/cards/global_mmlu/es/high_school_microeconomics.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/es 2026-01-06T13:30:30,076 copying build/lib/unitxt/catalog/cards/global_mmlu/es/anatomy.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/es 2026-01-06T13:30:30,077 copying build/lib/unitxt/catalog/cards/global_mmlu/es/world_religions.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/es 2026-01-06T13:30:30,079 copying build/lib/unitxt/catalog/cards/global_mmlu/es/management.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/es 2026-01-06T13:30:30,081 copying build/lib/unitxt/catalog/cards/global_mmlu/es/moral_scenarios.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/es 2026-01-06T13:30:30,083 copying build/lib/unitxt/catalog/cards/global_mmlu/es/global_facts.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/es 2026-01-06T13:30:30,085 copying build/lib/unitxt/catalog/cards/global_mmlu/es/miscellaneous.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/es 2026-01-06T13:30:30,087 copying build/lib/unitxt/catalog/cards/global_mmlu/es/clinical_knowledge.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/es 2026-01-06T13:30:30,089 copying build/lib/unitxt/catalog/cards/global_mmlu/es/high_school_biology.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/es 2026-01-06T13:30:30,090 copying build/lib/unitxt/catalog/cards/global_mmlu/es/prehistory.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/es 2026-01-06T13:30:30,092 copying build/lib/unitxt/catalog/cards/global_mmlu/es/high_school_us_history.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/es 2026-01-06T13:30:30,094 copying build/lib/unitxt/catalog/cards/global_mmlu/es/international_law.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/es 2026-01-06T13:30:30,096 copying build/lib/unitxt/catalog/cards/global_mmlu/es/college_computer_science.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/es 2026-01-06T13:30:30,098 copying build/lib/unitxt/catalog/cards/global_mmlu/es/astronomy.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/es 2026-01-06T13:30:30,100 copying build/lib/unitxt/catalog/cards/global_mmlu/es/high_school_european_history.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/es 2026-01-06T13:30:30,102 copying build/lib/unitxt/catalog/cards/global_mmlu/es/electrical_engineering.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/es 2026-01-06T13:30:30,104 copying build/lib/unitxt/catalog/cards/global_mmlu/es/nutrition.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/es 2026-01-06T13:30:30,106 copying build/lib/unitxt/catalog/cards/global_mmlu/es/abstract_algebra.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/es 2026-01-06T13:30:30,107 copying build/lib/unitxt/catalog/cards/global_mmlu/es/professional_medicine.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/es 2026-01-06T13:30:30,109 copying build/lib/unitxt/catalog/cards/global_mmlu/es/human_sexuality.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/es 2026-01-06T13:30:30,111 copying build/lib/unitxt/catalog/cards/global_mmlu/es/business_ethics.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/es 2026-01-06T13:30:30,113 copying build/lib/unitxt/catalog/cards/global_mmlu/es/high_school_chemistry.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/es 2026-01-06T13:30:30,115 copying build/lib/unitxt/catalog/cards/global_mmlu/es/logical_fallacies.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/es 2026-01-06T13:30:30,116 copying build/lib/unitxt/catalog/cards/global_mmlu/es/formal_logic.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/es 2026-01-06T13:30:30,118 copying build/lib/unitxt/catalog/cards/global_mmlu/es/high_school_psychology.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/es 2026-01-06T13:30:30,120 copying build/lib/unitxt/catalog/cards/global_mmlu/es/medical_genetics.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/es 2026-01-06T13:30:30,122 copying build/lib/unitxt/catalog/cards/global_mmlu/es/security_studies.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/es 2026-01-06T13:30:30,124 copying build/lib/unitxt/catalog/cards/global_mmlu/es/high_school_macroeconomics.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/es 2026-01-06T13:30:30,126 copying build/lib/unitxt/catalog/cards/global_mmlu/es/professional_law.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/es 2026-01-06T13:30:30,127 copying build/lib/unitxt/catalog/cards/global_mmlu/es/high_school_physics.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/es 2026-01-06T13:30:30,129 copying build/lib/unitxt/catalog/cards/global_mmlu/es/econometrics.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/es 2026-01-06T13:30:30,131 copying build/lib/unitxt/catalog/cards/global_mmlu/es/sociology.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/es 2026-01-06T13:30:30,133 copying build/lib/unitxt/catalog/cards/global_mmlu/es/moral_disputes.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/es 2026-01-06T13:30:30,135 copying build/lib/unitxt/catalog/cards/global_mmlu/es/college_chemistry.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/es 2026-01-06T13:30:30,137 copying build/lib/unitxt/catalog/cards/global_mmlu/es/high_school_geography.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/es 2026-01-06T13:30:30,139 copying build/lib/unitxt/catalog/cards/global_mmlu/es/jurisprudence.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/es 2026-01-06T13:30:30,141 copying build/lib/unitxt/catalog/cards/global_mmlu/es/high_school_statistics.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/es 2026-01-06T13:30:30,142 copying build/lib/unitxt/catalog/cards/global_mmlu/es/professional_accounting.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/es 2026-01-06T13:30:30,144 copying build/lib/unitxt/catalog/cards/global_mmlu/es/us_foreign_policy.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/es 2026-01-06T13:30:30,146 copying build/lib/unitxt/catalog/cards/global_mmlu/es/professional_psychology.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/es 2026-01-06T13:30:30,148 copying build/lib/unitxt/catalog/cards/global_mmlu/es/public_relations.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/es 2026-01-06T13:30:30,150 copying build/lib/unitxt/catalog/cards/global_mmlu/es/computer_security.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/es 2026-01-06T13:30:30,152 copying build/lib/unitxt/catalog/cards/global_mmlu/es/philosophy.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/es 2026-01-06T13:30:30,154 copying build/lib/unitxt/catalog/cards/global_mmlu/es/virology.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/es 2026-01-06T13:30:30,156 copying build/lib/unitxt/catalog/cards/global_mmlu/es/marketing.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/es 2026-01-06T13:30:30,158 copying build/lib/unitxt/catalog/cards/global_mmlu/es/high_school_world_history.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/es 2026-01-06T13:30:30,160 copying build/lib/unitxt/catalog/cards/global_mmlu/es/machine_learning.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/es 2026-01-06T13:30:30,161 copying build/lib/unitxt/catalog/cards/global_mmlu/es/high_school_government_and_politics.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/es 2026-01-06T13:30:30,163 copying build/lib/unitxt/catalog/cards/global_mmlu/es/conceptual_physics.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/es 2026-01-06T13:30:30,165 copying build/lib/unitxt/catalog/cards/global_mmlu/es/college_biology.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/es 2026-01-06T13:30:30,167 copying build/lib/unitxt/catalog/cards/global_mmlu/es/high_school_mathematics.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/es 2026-01-06T13:30:30,170 creating build/bdist.linux-armv7l/wheel/unitxt/catalog/cards/global_mmlu/hi 2026-01-06T13:30:30,171 copying build/lib/unitxt/catalog/cards/global_mmlu/hi/elementary_mathematics.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/hi 2026-01-06T13:30:30,173 copying build/lib/unitxt/catalog/cards/global_mmlu/hi/human_aging.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/hi 2026-01-06T13:30:30,175 copying build/lib/unitxt/catalog/cards/global_mmlu/hi/high_school_computer_science.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/hi 2026-01-06T13:30:30,177 copying build/lib/unitxt/catalog/cards/global_mmlu/hi/college_physics.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/hi 2026-01-06T13:30:30,179 copying build/lib/unitxt/catalog/cards/global_mmlu/hi/college_medicine.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/hi 2026-01-06T13:30:30,181 copying build/lib/unitxt/catalog/cards/global_mmlu/hi/college_mathematics.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/hi 2026-01-06T13:30:30,183 copying build/lib/unitxt/catalog/cards/global_mmlu/hi/high_school_microeconomics.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/hi 2026-01-06T13:30:30,184 copying build/lib/unitxt/catalog/cards/global_mmlu/hi/anatomy.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/hi 2026-01-06T13:30:30,186 copying build/lib/unitxt/catalog/cards/global_mmlu/hi/world_religions.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/hi 2026-01-06T13:30:30,188 copying build/lib/unitxt/catalog/cards/global_mmlu/hi/management.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/hi 2026-01-06T13:30:30,190 copying build/lib/unitxt/catalog/cards/global_mmlu/hi/moral_scenarios.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/hi 2026-01-06T13:30:30,192 copying build/lib/unitxt/catalog/cards/global_mmlu/hi/global_facts.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/hi 2026-01-06T13:30:30,194 copying build/lib/unitxt/catalog/cards/global_mmlu/hi/miscellaneous.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/hi 2026-01-06T13:30:30,196 copying build/lib/unitxt/catalog/cards/global_mmlu/hi/clinical_knowledge.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/hi 2026-01-06T13:30:30,198 copying build/lib/unitxt/catalog/cards/global_mmlu/hi/high_school_biology.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/hi 2026-01-06T13:30:30,200 copying build/lib/unitxt/catalog/cards/global_mmlu/hi/prehistory.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/hi 2026-01-06T13:30:30,202 copying build/lib/unitxt/catalog/cards/global_mmlu/hi/high_school_us_history.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/hi 2026-01-06T13:30:30,203 copying build/lib/unitxt/catalog/cards/global_mmlu/hi/international_law.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/hi 2026-01-06T13:30:30,205 copying build/lib/unitxt/catalog/cards/global_mmlu/hi/college_computer_science.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/hi 2026-01-06T13:30:30,207 copying build/lib/unitxt/catalog/cards/global_mmlu/hi/astronomy.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/hi 2026-01-06T13:30:30,209 copying build/lib/unitxt/catalog/cards/global_mmlu/hi/high_school_european_history.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/hi 2026-01-06T13:30:30,211 copying build/lib/unitxt/catalog/cards/global_mmlu/hi/electrical_engineering.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/hi 2026-01-06T13:30:30,212 copying build/lib/unitxt/catalog/cards/global_mmlu/hi/nutrition.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/hi 2026-01-06T13:30:30,214 copying build/lib/unitxt/catalog/cards/global_mmlu/hi/abstract_algebra.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/hi 2026-01-06T13:30:30,216 copying build/lib/unitxt/catalog/cards/global_mmlu/hi/professional_medicine.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/hi 2026-01-06T13:30:30,218 copying build/lib/unitxt/catalog/cards/global_mmlu/hi/human_sexuality.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/hi 2026-01-06T13:30:30,220 copying build/lib/unitxt/catalog/cards/global_mmlu/hi/business_ethics.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/hi 2026-01-06T13:30:30,222 copying build/lib/unitxt/catalog/cards/global_mmlu/hi/high_school_chemistry.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/hi 2026-01-06T13:30:30,223 copying build/lib/unitxt/catalog/cards/global_mmlu/hi/logical_fallacies.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/hi 2026-01-06T13:30:30,225 copying build/lib/unitxt/catalog/cards/global_mmlu/hi/formal_logic.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/hi 2026-01-06T13:30:30,227 copying build/lib/unitxt/catalog/cards/global_mmlu/hi/high_school_psychology.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/hi 2026-01-06T13:30:30,229 copying build/lib/unitxt/catalog/cards/global_mmlu/hi/medical_genetics.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/hi 2026-01-06T13:30:30,231 copying build/lib/unitxt/catalog/cards/global_mmlu/hi/security_studies.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/hi 2026-01-06T13:30:30,233 copying build/lib/unitxt/catalog/cards/global_mmlu/hi/high_school_macroeconomics.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/hi 2026-01-06T13:30:30,235 copying build/lib/unitxt/catalog/cards/global_mmlu/hi/professional_law.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/hi 2026-01-06T13:30:30,237 copying build/lib/unitxt/catalog/cards/global_mmlu/hi/high_school_physics.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/hi 2026-01-06T13:30:30,239 copying build/lib/unitxt/catalog/cards/global_mmlu/hi/econometrics.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/hi 2026-01-06T13:30:30,241 copying build/lib/unitxt/catalog/cards/global_mmlu/hi/sociology.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/hi 2026-01-06T13:30:30,242 copying build/lib/unitxt/catalog/cards/global_mmlu/hi/moral_disputes.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/hi 2026-01-06T13:30:30,244 copying build/lib/unitxt/catalog/cards/global_mmlu/hi/college_chemistry.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/hi 2026-01-06T13:30:30,246 copying build/lib/unitxt/catalog/cards/global_mmlu/hi/high_school_geography.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/hi 2026-01-06T13:30:30,248 copying build/lib/unitxt/catalog/cards/global_mmlu/hi/jurisprudence.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/hi 2026-01-06T13:30:30,249 copying build/lib/unitxt/catalog/cards/global_mmlu/hi/high_school_statistics.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/hi 2026-01-06T13:30:30,251 copying build/lib/unitxt/catalog/cards/global_mmlu/hi/professional_accounting.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/hi 2026-01-06T13:30:30,253 copying build/lib/unitxt/catalog/cards/global_mmlu/hi/us_foreign_policy.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/hi 2026-01-06T13:30:30,255 copying build/lib/unitxt/catalog/cards/global_mmlu/hi/professional_psychology.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/hi 2026-01-06T13:30:30,257 copying build/lib/unitxt/catalog/cards/global_mmlu/hi/public_relations.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/hi 2026-01-06T13:30:30,259 copying build/lib/unitxt/catalog/cards/global_mmlu/hi/computer_security.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/hi 2026-01-06T13:30:30,260 copying build/lib/unitxt/catalog/cards/global_mmlu/hi/philosophy.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/hi 2026-01-06T13:30:30,262 copying build/lib/unitxt/catalog/cards/global_mmlu/hi/virology.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/hi 2026-01-06T13:30:30,264 copying build/lib/unitxt/catalog/cards/global_mmlu/hi/marketing.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/hi 2026-01-06T13:30:30,268 copying build/lib/unitxt/catalog/cards/global_mmlu/hi/high_school_world_history.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/hi 2026-01-06T13:30:30,270 copying build/lib/unitxt/catalog/cards/global_mmlu/hi/machine_learning.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/hi 2026-01-06T13:30:30,272 copying build/lib/unitxt/catalog/cards/global_mmlu/hi/high_school_government_and_politics.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/hi 2026-01-06T13:30:30,274 copying build/lib/unitxt/catalog/cards/global_mmlu/hi/conceptual_physics.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/hi 2026-01-06T13:30:30,276 copying build/lib/unitxt/catalog/cards/global_mmlu/hi/college_biology.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/hi 2026-01-06T13:30:30,278 copying build/lib/unitxt/catalog/cards/global_mmlu/hi/high_school_mathematics.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/hi 2026-01-06T13:30:30,281 creating build/bdist.linux-armv7l/wheel/unitxt/catalog/cards/global_mmlu/lt 2026-01-06T13:30:30,282 copying build/lib/unitxt/catalog/cards/global_mmlu/lt/elementary_mathematics.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/lt 2026-01-06T13:30:30,284 copying build/lib/unitxt/catalog/cards/global_mmlu/lt/human_aging.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/lt 2026-01-06T13:30:30,286 copying build/lib/unitxt/catalog/cards/global_mmlu/lt/high_school_computer_science.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/lt 2026-01-06T13:30:30,287 copying build/lib/unitxt/catalog/cards/global_mmlu/lt/college_physics.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/lt 2026-01-06T13:30:30,289 copying build/lib/unitxt/catalog/cards/global_mmlu/lt/college_medicine.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/lt 2026-01-06T13:30:30,291 copying build/lib/unitxt/catalog/cards/global_mmlu/lt/college_mathematics.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/lt 2026-01-06T13:30:30,293 copying build/lib/unitxt/catalog/cards/global_mmlu/lt/high_school_microeconomics.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/lt 2026-01-06T13:30:30,295 copying build/lib/unitxt/catalog/cards/global_mmlu/lt/anatomy.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/lt 2026-01-06T13:30:30,296 copying build/lib/unitxt/catalog/cards/global_mmlu/lt/world_religions.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/lt 2026-01-06T13:30:30,298 copying build/lib/unitxt/catalog/cards/global_mmlu/lt/management.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/lt 2026-01-06T13:30:30,300 copying build/lib/unitxt/catalog/cards/global_mmlu/lt/moral_scenarios.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/lt 2026-01-06T13:30:30,302 copying build/lib/unitxt/catalog/cards/global_mmlu/lt/global_facts.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/lt 2026-01-06T13:30:30,304 copying build/lib/unitxt/catalog/cards/global_mmlu/lt/miscellaneous.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/lt 2026-01-06T13:30:30,305 copying build/lib/unitxt/catalog/cards/global_mmlu/lt/clinical_knowledge.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/lt 2026-01-06T13:30:30,307 copying build/lib/unitxt/catalog/cards/global_mmlu/lt/high_school_biology.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/lt 2026-01-06T13:30:30,309 copying build/lib/unitxt/catalog/cards/global_mmlu/lt/prehistory.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/lt 2026-01-06T13:30:30,311 copying build/lib/unitxt/catalog/cards/global_mmlu/lt/high_school_us_history.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/lt 2026-01-06T13:30:30,313 copying build/lib/unitxt/catalog/cards/global_mmlu/lt/international_law.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/lt 2026-01-06T13:30:30,315 copying build/lib/unitxt/catalog/cards/global_mmlu/lt/college_computer_science.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/lt 2026-01-06T13:30:30,317 copying build/lib/unitxt/catalog/cards/global_mmlu/lt/astronomy.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/lt 2026-01-06T13:30:30,319 copying build/lib/unitxt/catalog/cards/global_mmlu/lt/high_school_european_history.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/lt 2026-01-06T13:30:30,321 copying build/lib/unitxt/catalog/cards/global_mmlu/lt/electrical_engineering.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/lt 2026-01-06T13:30:30,322 copying build/lib/unitxt/catalog/cards/global_mmlu/lt/nutrition.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/lt 2026-01-06T13:30:30,324 copying build/lib/unitxt/catalog/cards/global_mmlu/lt/abstract_algebra.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/lt 2026-01-06T13:30:30,326 copying build/lib/unitxt/catalog/cards/global_mmlu/lt/professional_medicine.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/lt 2026-01-06T13:30:30,328 copying build/lib/unitxt/catalog/cards/global_mmlu/lt/human_sexuality.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/lt 2026-01-06T13:30:30,330 copying build/lib/unitxt/catalog/cards/global_mmlu/lt/business_ethics.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/lt 2026-01-06T13:30:30,332 copying build/lib/unitxt/catalog/cards/global_mmlu/lt/high_school_chemistry.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/lt 2026-01-06T13:30:30,333 copying build/lib/unitxt/catalog/cards/global_mmlu/lt/logical_fallacies.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/lt 2026-01-06T13:30:30,335 copying build/lib/unitxt/catalog/cards/global_mmlu/lt/formal_logic.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/lt 2026-01-06T13:30:30,337 copying build/lib/unitxt/catalog/cards/global_mmlu/lt/high_school_psychology.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/lt 2026-01-06T13:30:30,339 copying build/lib/unitxt/catalog/cards/global_mmlu/lt/medical_genetics.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/lt 2026-01-06T13:30:30,341 copying build/lib/unitxt/catalog/cards/global_mmlu/lt/security_studies.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/lt 2026-01-06T13:30:30,342 copying build/lib/unitxt/catalog/cards/global_mmlu/lt/high_school_macroeconomics.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/lt 2026-01-06T13:30:30,344 copying build/lib/unitxt/catalog/cards/global_mmlu/lt/professional_law.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/lt 2026-01-06T13:30:30,346 copying build/lib/unitxt/catalog/cards/global_mmlu/lt/high_school_physics.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/lt 2026-01-06T13:30:30,348 copying build/lib/unitxt/catalog/cards/global_mmlu/lt/econometrics.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/lt 2026-01-06T13:30:30,350 copying build/lib/unitxt/catalog/cards/global_mmlu/lt/sociology.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/lt 2026-01-06T13:30:30,352 copying build/lib/unitxt/catalog/cards/global_mmlu/lt/moral_disputes.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/lt 2026-01-06T13:30:30,353 copying build/lib/unitxt/catalog/cards/global_mmlu/lt/college_chemistry.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/lt 2026-01-06T13:30:30,355 copying build/lib/unitxt/catalog/cards/global_mmlu/lt/high_school_geography.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/lt 2026-01-06T13:30:30,357 copying build/lib/unitxt/catalog/cards/global_mmlu/lt/jurisprudence.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/lt 2026-01-06T13:30:30,359 copying build/lib/unitxt/catalog/cards/global_mmlu/lt/high_school_statistics.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/lt 2026-01-06T13:30:30,361 copying build/lib/unitxt/catalog/cards/global_mmlu/lt/professional_accounting.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/lt 2026-01-06T13:30:30,363 copying build/lib/unitxt/catalog/cards/global_mmlu/lt/us_foreign_policy.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/lt 2026-01-06T13:30:30,365 copying build/lib/unitxt/catalog/cards/global_mmlu/lt/professional_psychology.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/lt 2026-01-06T13:30:30,367 copying build/lib/unitxt/catalog/cards/global_mmlu/lt/public_relations.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/lt 2026-01-06T13:30:30,369 copying build/lib/unitxt/catalog/cards/global_mmlu/lt/computer_security.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/lt 2026-01-06T13:30:30,371 copying build/lib/unitxt/catalog/cards/global_mmlu/lt/philosophy.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/lt 2026-01-06T13:30:30,373 copying build/lib/unitxt/catalog/cards/global_mmlu/lt/virology.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/lt 2026-01-06T13:30:30,375 copying build/lib/unitxt/catalog/cards/global_mmlu/lt/marketing.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/lt 2026-01-06T13:30:30,377 copying build/lib/unitxt/catalog/cards/global_mmlu/lt/high_school_world_history.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/lt 2026-01-06T13:30:30,378 copying build/lib/unitxt/catalog/cards/global_mmlu/lt/machine_learning.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/lt 2026-01-06T13:30:30,380 copying build/lib/unitxt/catalog/cards/global_mmlu/lt/high_school_government_and_politics.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/lt 2026-01-06T13:30:30,382 copying build/lib/unitxt/catalog/cards/global_mmlu/lt/conceptual_physics.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/lt 2026-01-06T13:30:30,384 copying build/lib/unitxt/catalog/cards/global_mmlu/lt/college_biology.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/lt 2026-01-06T13:30:30,385 copying build/lib/unitxt/catalog/cards/global_mmlu/lt/high_school_mathematics.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/lt 2026-01-06T13:30:30,388 creating build/bdist.linux-armv7l/wheel/unitxt/catalog/cards/global_mmlu/ky 2026-01-06T13:30:30,389 copying build/lib/unitxt/catalog/cards/global_mmlu/ky/elementary_mathematics.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/ky 2026-01-06T13:30:30,391 copying build/lib/unitxt/catalog/cards/global_mmlu/ky/human_aging.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/ky 2026-01-06T13:30:30,393 copying build/lib/unitxt/catalog/cards/global_mmlu/ky/high_school_computer_science.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/ky 2026-01-06T13:30:30,395 copying build/lib/unitxt/catalog/cards/global_mmlu/ky/college_physics.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/ky 2026-01-06T13:30:30,397 copying build/lib/unitxt/catalog/cards/global_mmlu/ky/college_medicine.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/ky 2026-01-06T13:30:30,399 copying build/lib/unitxt/catalog/cards/global_mmlu/ky/college_mathematics.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/ky 2026-01-06T13:30:30,401 copying build/lib/unitxt/catalog/cards/global_mmlu/ky/high_school_microeconomics.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/ky 2026-01-06T13:30:30,403 copying build/lib/unitxt/catalog/cards/global_mmlu/ky/anatomy.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/ky 2026-01-06T13:30:30,404 copying build/lib/unitxt/catalog/cards/global_mmlu/ky/world_religions.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/ky 2026-01-06T13:30:30,406 copying build/lib/unitxt/catalog/cards/global_mmlu/ky/management.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/ky 2026-01-06T13:30:30,408 copying build/lib/unitxt/catalog/cards/global_mmlu/ky/moral_scenarios.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/ky 2026-01-06T13:30:30,410 copying build/lib/unitxt/catalog/cards/global_mmlu/ky/global_facts.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/ky 2026-01-06T13:30:30,412 copying build/lib/unitxt/catalog/cards/global_mmlu/ky/miscellaneous.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/ky 2026-01-06T13:30:30,414 copying build/lib/unitxt/catalog/cards/global_mmlu/ky/clinical_knowledge.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/ky 2026-01-06T13:30:30,416 copying build/lib/unitxt/catalog/cards/global_mmlu/ky/high_school_biology.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/ky 2026-01-06T13:30:30,418 copying build/lib/unitxt/catalog/cards/global_mmlu/ky/prehistory.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/ky 2026-01-06T13:30:30,420 copying build/lib/unitxt/catalog/cards/global_mmlu/ky/high_school_us_history.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/ky 2026-01-06T13:30:30,421 copying build/lib/unitxt/catalog/cards/global_mmlu/ky/international_law.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/ky 2026-01-06T13:30:30,423 copying build/lib/unitxt/catalog/cards/global_mmlu/ky/college_computer_science.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/ky 2026-01-06T13:30:30,425 copying build/lib/unitxt/catalog/cards/global_mmlu/ky/astronomy.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/ky 2026-01-06T13:30:30,427 copying build/lib/unitxt/catalog/cards/global_mmlu/ky/high_school_european_history.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/ky 2026-01-06T13:30:30,429 copying build/lib/unitxt/catalog/cards/global_mmlu/ky/electrical_engineering.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/ky 2026-01-06T13:30:30,430 copying build/lib/unitxt/catalog/cards/global_mmlu/ky/nutrition.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/ky 2026-01-06T13:30:30,432 copying build/lib/unitxt/catalog/cards/global_mmlu/ky/abstract_algebra.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/ky 2026-01-06T13:30:30,434 copying build/lib/unitxt/catalog/cards/global_mmlu/ky/professional_medicine.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/ky 2026-01-06T13:30:30,436 copying build/lib/unitxt/catalog/cards/global_mmlu/ky/human_sexuality.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/ky 2026-01-06T13:30:30,438 copying build/lib/unitxt/catalog/cards/global_mmlu/ky/business_ethics.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/ky 2026-01-06T13:30:30,439 copying build/lib/unitxt/catalog/cards/global_mmlu/ky/high_school_chemistry.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/ky 2026-01-06T13:30:30,441 copying build/lib/unitxt/catalog/cards/global_mmlu/ky/logical_fallacies.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/ky 2026-01-06T13:30:30,443 copying build/lib/unitxt/catalog/cards/global_mmlu/ky/formal_logic.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/ky 2026-01-06T13:30:30,445 copying build/lib/unitxt/catalog/cards/global_mmlu/ky/high_school_psychology.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/ky 2026-01-06T13:30:30,447 copying build/lib/unitxt/catalog/cards/global_mmlu/ky/medical_genetics.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/ky 2026-01-06T13:30:30,449 copying build/lib/unitxt/catalog/cards/global_mmlu/ky/security_studies.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/ky 2026-01-06T13:30:30,451 copying build/lib/unitxt/catalog/cards/global_mmlu/ky/high_school_macroeconomics.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/ky 2026-01-06T13:30:30,453 copying build/lib/unitxt/catalog/cards/global_mmlu/ky/professional_law.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/ky 2026-01-06T13:30:30,454 copying build/lib/unitxt/catalog/cards/global_mmlu/ky/high_school_physics.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/ky 2026-01-06T13:30:30,456 copying build/lib/unitxt/catalog/cards/global_mmlu/ky/econometrics.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/ky 2026-01-06T13:30:30,458 copying build/lib/unitxt/catalog/cards/global_mmlu/ky/sociology.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/ky 2026-01-06T13:30:30,460 copying build/lib/unitxt/catalog/cards/global_mmlu/ky/moral_disputes.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/ky 2026-01-06T13:30:30,462 copying build/lib/unitxt/catalog/cards/global_mmlu/ky/college_chemistry.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/ky 2026-01-06T13:30:30,464 copying build/lib/unitxt/catalog/cards/global_mmlu/ky/high_school_geography.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/ky 2026-01-06T13:30:30,466 copying build/lib/unitxt/catalog/cards/global_mmlu/ky/jurisprudence.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/ky 2026-01-06T13:30:30,468 copying build/lib/unitxt/catalog/cards/global_mmlu/ky/high_school_statistics.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/ky 2026-01-06T13:30:30,469 copying build/lib/unitxt/catalog/cards/global_mmlu/ky/professional_accounting.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/ky 2026-01-06T13:30:30,471 copying build/lib/unitxt/catalog/cards/global_mmlu/ky/us_foreign_policy.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/ky 2026-01-06T13:30:30,473 copying build/lib/unitxt/catalog/cards/global_mmlu/ky/professional_psychology.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/ky 2026-01-06T13:30:30,475 copying build/lib/unitxt/catalog/cards/global_mmlu/ky/public_relations.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/ky 2026-01-06T13:30:30,477 copying build/lib/unitxt/catalog/cards/global_mmlu/ky/computer_security.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/ky 2026-01-06T13:30:30,479 copying build/lib/unitxt/catalog/cards/global_mmlu/ky/philosophy.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/ky 2026-01-06T13:30:30,480 copying build/lib/unitxt/catalog/cards/global_mmlu/ky/virology.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/ky 2026-01-06T13:30:30,482 copying build/lib/unitxt/catalog/cards/global_mmlu/ky/marketing.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/ky 2026-01-06T13:30:30,484 copying build/lib/unitxt/catalog/cards/global_mmlu/ky/high_school_world_history.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/ky 2026-01-06T13:30:30,486 copying build/lib/unitxt/catalog/cards/global_mmlu/ky/machine_learning.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/ky 2026-01-06T13:30:30,488 copying build/lib/unitxt/catalog/cards/global_mmlu/ky/high_school_government_and_politics.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/ky 2026-01-06T13:30:30,490 copying build/lib/unitxt/catalog/cards/global_mmlu/ky/conceptual_physics.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/ky 2026-01-06T13:30:30,492 copying build/lib/unitxt/catalog/cards/global_mmlu/ky/college_biology.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/ky 2026-01-06T13:30:30,494 copying build/lib/unitxt/catalog/cards/global_mmlu/ky/high_school_mathematics.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/ky 2026-01-06T13:30:30,497 creating build/bdist.linux-armv7l/wheel/unitxt/catalog/cards/global_mmlu/cs 2026-01-06T13:30:30,498 copying build/lib/unitxt/catalog/cards/global_mmlu/cs/elementary_mathematics.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/cs 2026-01-06T13:30:30,500 copying build/lib/unitxt/catalog/cards/global_mmlu/cs/human_aging.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/cs 2026-01-06T13:30:30,502 copying build/lib/unitxt/catalog/cards/global_mmlu/cs/high_school_computer_science.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/cs 2026-01-06T13:30:30,504 copying build/lib/unitxt/catalog/cards/global_mmlu/cs/college_physics.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/cs 2026-01-06T13:30:30,505 copying build/lib/unitxt/catalog/cards/global_mmlu/cs/college_medicine.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/cs 2026-01-06T13:30:30,507 copying build/lib/unitxt/catalog/cards/global_mmlu/cs/college_mathematics.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/cs 2026-01-06T13:30:30,509 copying build/lib/unitxt/catalog/cards/global_mmlu/cs/high_school_microeconomics.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/cs 2026-01-06T13:30:30,511 copying build/lib/unitxt/catalog/cards/global_mmlu/cs/anatomy.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/cs 2026-01-06T13:30:30,513 copying build/lib/unitxt/catalog/cards/global_mmlu/cs/world_religions.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/cs 2026-01-06T13:30:30,514 copying build/lib/unitxt/catalog/cards/global_mmlu/cs/management.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/cs 2026-01-06T13:30:30,516 copying build/lib/unitxt/catalog/cards/global_mmlu/cs/moral_scenarios.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/cs 2026-01-06T13:30:30,518 copying build/lib/unitxt/catalog/cards/global_mmlu/cs/global_facts.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/cs 2026-01-06T13:30:30,520 copying build/lib/unitxt/catalog/cards/global_mmlu/cs/miscellaneous.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/cs 2026-01-06T13:30:30,522 copying build/lib/unitxt/catalog/cards/global_mmlu/cs/clinical_knowledge.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/cs 2026-01-06T13:30:30,523 copying build/lib/unitxt/catalog/cards/global_mmlu/cs/high_school_biology.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/cs 2026-01-06T13:30:30,525 copying build/lib/unitxt/catalog/cards/global_mmlu/cs/prehistory.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/cs 2026-01-06T13:30:30,527 copying build/lib/unitxt/catalog/cards/global_mmlu/cs/high_school_us_history.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/cs 2026-01-06T13:30:30,529 copying build/lib/unitxt/catalog/cards/global_mmlu/cs/international_law.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/cs 2026-01-06T13:30:30,531 copying build/lib/unitxt/catalog/cards/global_mmlu/cs/college_computer_science.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/cs 2026-01-06T13:30:30,533 copying build/lib/unitxt/catalog/cards/global_mmlu/cs/astronomy.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/cs 2026-01-06T13:30:30,534 copying build/lib/unitxt/catalog/cards/global_mmlu/cs/high_school_european_history.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/cs 2026-01-06T13:30:30,536 copying build/lib/unitxt/catalog/cards/global_mmlu/cs/electrical_engineering.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/cs 2026-01-06T13:30:30,538 copying build/lib/unitxt/catalog/cards/global_mmlu/cs/nutrition.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/cs 2026-01-06T13:30:30,540 copying build/lib/unitxt/catalog/cards/global_mmlu/cs/abstract_algebra.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/cs 2026-01-06T13:30:30,542 copying build/lib/unitxt/catalog/cards/global_mmlu/cs/professional_medicine.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/cs 2026-01-06T13:30:30,544 copying build/lib/unitxt/catalog/cards/global_mmlu/cs/human_sexuality.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/cs 2026-01-06T13:30:30,546 copying build/lib/unitxt/catalog/cards/global_mmlu/cs/business_ethics.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/cs 2026-01-06T13:30:30,548 copying build/lib/unitxt/catalog/cards/global_mmlu/cs/high_school_chemistry.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/cs 2026-01-06T13:30:30,550 copying build/lib/unitxt/catalog/cards/global_mmlu/cs/logical_fallacies.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/cs 2026-01-06T13:30:30,551 copying build/lib/unitxt/catalog/cards/global_mmlu/cs/formal_logic.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/cs 2026-01-06T13:30:30,553 copying build/lib/unitxt/catalog/cards/global_mmlu/cs/high_school_psychology.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/cs 2026-01-06T13:30:30,555 copying build/lib/unitxt/catalog/cards/global_mmlu/cs/medical_genetics.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/cs 2026-01-06T13:30:30,557 copying build/lib/unitxt/catalog/cards/global_mmlu/cs/security_studies.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/cs 2026-01-06T13:30:30,559 copying build/lib/unitxt/catalog/cards/global_mmlu/cs/high_school_macroeconomics.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/cs 2026-01-06T13:30:30,560 copying build/lib/unitxt/catalog/cards/global_mmlu/cs/professional_law.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/cs 2026-01-06T13:30:30,562 copying build/lib/unitxt/catalog/cards/global_mmlu/cs/high_school_physics.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/cs 2026-01-06T13:30:30,564 copying build/lib/unitxt/catalog/cards/global_mmlu/cs/econometrics.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/cs 2026-01-06T13:30:30,566 copying build/lib/unitxt/catalog/cards/global_mmlu/cs/sociology.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/cs 2026-01-06T13:30:30,568 copying build/lib/unitxt/catalog/cards/global_mmlu/cs/moral_disputes.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/cs 2026-01-06T13:30:30,570 copying build/lib/unitxt/catalog/cards/global_mmlu/cs/college_chemistry.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/cs 2026-01-06T13:30:30,572 copying build/lib/unitxt/catalog/cards/global_mmlu/cs/high_school_geography.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/cs 2026-01-06T13:30:30,573 copying build/lib/unitxt/catalog/cards/global_mmlu/cs/jurisprudence.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/cs 2026-01-06T13:30:30,575 copying build/lib/unitxt/catalog/cards/global_mmlu/cs/high_school_statistics.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/cs 2026-01-06T13:30:30,577 copying build/lib/unitxt/catalog/cards/global_mmlu/cs/professional_accounting.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/cs 2026-01-06T13:30:30,579 copying build/lib/unitxt/catalog/cards/global_mmlu/cs/us_foreign_policy.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/cs 2026-01-06T13:30:30,581 copying build/lib/unitxt/catalog/cards/global_mmlu/cs/professional_psychology.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/cs 2026-01-06T13:30:30,583 copying build/lib/unitxt/catalog/cards/global_mmlu/cs/public_relations.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/cs 2026-01-06T13:30:30,585 copying build/lib/unitxt/catalog/cards/global_mmlu/cs/computer_security.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/cs 2026-01-06T13:30:30,587 copying build/lib/unitxt/catalog/cards/global_mmlu/cs/philosophy.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/cs 2026-01-06T13:30:30,589 copying build/lib/unitxt/catalog/cards/global_mmlu/cs/virology.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/cs 2026-01-06T13:30:30,591 copying build/lib/unitxt/catalog/cards/global_mmlu/cs/marketing.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/cs 2026-01-06T13:30:30,593 copying build/lib/unitxt/catalog/cards/global_mmlu/cs/high_school_world_history.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/cs 2026-01-06T13:30:30,595 copying build/lib/unitxt/catalog/cards/global_mmlu/cs/machine_learning.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/cs 2026-01-06T13:30:30,597 copying build/lib/unitxt/catalog/cards/global_mmlu/cs/high_school_government_and_politics.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/cs 2026-01-06T13:30:30,600 copying build/lib/unitxt/catalog/cards/global_mmlu/cs/conceptual_physics.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/cs 2026-01-06T13:30:30,602 copying build/lib/unitxt/catalog/cards/global_mmlu/cs/college_biology.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/cs 2026-01-06T13:30:30,604 copying build/lib/unitxt/catalog/cards/global_mmlu/cs/high_school_mathematics.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/cs 2026-01-06T13:30:30,608 creating build/bdist.linux-armv7l/wheel/unitxt/catalog/cards/global_mmlu/ms 2026-01-06T13:30:30,609 copying build/lib/unitxt/catalog/cards/global_mmlu/ms/elementary_mathematics.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/ms 2026-01-06T13:30:30,611 copying build/lib/unitxt/catalog/cards/global_mmlu/ms/human_aging.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/ms 2026-01-06T13:30:30,614 copying build/lib/unitxt/catalog/cards/global_mmlu/ms/high_school_computer_science.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/ms 2026-01-06T13:30:30,616 copying build/lib/unitxt/catalog/cards/global_mmlu/ms/college_physics.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/ms 2026-01-06T13:30:30,618 copying build/lib/unitxt/catalog/cards/global_mmlu/ms/college_medicine.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/ms 2026-01-06T13:30:30,620 copying build/lib/unitxt/catalog/cards/global_mmlu/ms/college_mathematics.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/ms 2026-01-06T13:30:30,623 copying build/lib/unitxt/catalog/cards/global_mmlu/ms/high_school_microeconomics.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/ms 2026-01-06T13:30:30,625 copying build/lib/unitxt/catalog/cards/global_mmlu/ms/anatomy.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/ms 2026-01-06T13:30:30,627 copying build/lib/unitxt/catalog/cards/global_mmlu/ms/world_religions.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/ms 2026-01-06T13:30:30,630 copying build/lib/unitxt/catalog/cards/global_mmlu/ms/management.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/ms 2026-01-06T13:30:30,632 copying build/lib/unitxt/catalog/cards/global_mmlu/ms/moral_scenarios.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/ms 2026-01-06T13:30:30,634 copying build/lib/unitxt/catalog/cards/global_mmlu/ms/global_facts.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/ms 2026-01-06T13:30:30,636 copying build/lib/unitxt/catalog/cards/global_mmlu/ms/miscellaneous.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/ms 2026-01-06T13:30:30,639 copying build/lib/unitxt/catalog/cards/global_mmlu/ms/clinical_knowledge.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/ms 2026-01-06T13:30:30,641 copying build/lib/unitxt/catalog/cards/global_mmlu/ms/high_school_biology.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/ms 2026-01-06T13:30:30,643 copying build/lib/unitxt/catalog/cards/global_mmlu/ms/prehistory.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/ms 2026-01-06T13:30:30,646 copying build/lib/unitxt/catalog/cards/global_mmlu/ms/high_school_us_history.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/ms 2026-01-06T13:30:30,648 copying build/lib/unitxt/catalog/cards/global_mmlu/ms/international_law.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/ms 2026-01-06T13:30:30,650 copying build/lib/unitxt/catalog/cards/global_mmlu/ms/college_computer_science.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/ms 2026-01-06T13:30:30,652 copying build/lib/unitxt/catalog/cards/global_mmlu/ms/astronomy.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/ms 2026-01-06T13:30:30,654 copying build/lib/unitxt/catalog/cards/global_mmlu/ms/high_school_european_history.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/ms 2026-01-06T13:30:30,657 copying build/lib/unitxt/catalog/cards/global_mmlu/ms/electrical_engineering.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/ms 2026-01-06T13:30:30,659 copying build/lib/unitxt/catalog/cards/global_mmlu/ms/nutrition.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/ms 2026-01-06T13:30:30,661 copying build/lib/unitxt/catalog/cards/global_mmlu/ms/abstract_algebra.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/ms 2026-01-06T13:30:30,663 copying build/lib/unitxt/catalog/cards/global_mmlu/ms/professional_medicine.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/ms 2026-01-06T13:30:30,666 copying build/lib/unitxt/catalog/cards/global_mmlu/ms/human_sexuality.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/ms 2026-01-06T13:30:30,668 copying build/lib/unitxt/catalog/cards/global_mmlu/ms/business_ethics.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/ms 2026-01-06T13:30:30,670 copying build/lib/unitxt/catalog/cards/global_mmlu/ms/high_school_chemistry.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/ms 2026-01-06T13:30:30,673 copying build/lib/unitxt/catalog/cards/global_mmlu/ms/logical_fallacies.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/ms 2026-01-06T13:30:30,675 copying build/lib/unitxt/catalog/cards/global_mmlu/ms/formal_logic.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/ms 2026-01-06T13:30:30,677 copying build/lib/unitxt/catalog/cards/global_mmlu/ms/high_school_psychology.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/ms 2026-01-06T13:30:30,679 copying build/lib/unitxt/catalog/cards/global_mmlu/ms/medical_genetics.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/ms 2026-01-06T13:30:30,681 copying build/lib/unitxt/catalog/cards/global_mmlu/ms/security_studies.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/ms 2026-01-06T13:30:30,684 copying build/lib/unitxt/catalog/cards/global_mmlu/ms/high_school_macroeconomics.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/ms 2026-01-06T13:30:30,686 copying build/lib/unitxt/catalog/cards/global_mmlu/ms/professional_law.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/ms 2026-01-06T13:30:30,688 copying build/lib/unitxt/catalog/cards/global_mmlu/ms/high_school_physics.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/ms 2026-01-06T13:30:30,691 copying build/lib/unitxt/catalog/cards/global_mmlu/ms/econometrics.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/ms 2026-01-06T13:30:30,693 copying build/lib/unitxt/catalog/cards/global_mmlu/ms/sociology.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/ms 2026-01-06T13:30:30,695 copying build/lib/unitxt/catalog/cards/global_mmlu/ms/moral_disputes.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/ms 2026-01-06T13:30:30,697 copying build/lib/unitxt/catalog/cards/global_mmlu/ms/college_chemistry.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/ms 2026-01-06T13:30:30,699 copying build/lib/unitxt/catalog/cards/global_mmlu/ms/high_school_geography.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/ms 2026-01-06T13:30:30,701 copying build/lib/unitxt/catalog/cards/global_mmlu/ms/jurisprudence.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/ms 2026-01-06T13:30:30,703 copying build/lib/unitxt/catalog/cards/global_mmlu/ms/high_school_statistics.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/ms 2026-01-06T13:30:30,704 copying build/lib/unitxt/catalog/cards/global_mmlu/ms/professional_accounting.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/ms 2026-01-06T13:30:30,706 copying build/lib/unitxt/catalog/cards/global_mmlu/ms/us_foreign_policy.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/ms 2026-01-06T13:30:30,708 copying build/lib/unitxt/catalog/cards/global_mmlu/ms/professional_psychology.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/ms 2026-01-06T13:30:30,710 copying build/lib/unitxt/catalog/cards/global_mmlu/ms/public_relations.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/ms 2026-01-06T13:30:30,711 copying build/lib/unitxt/catalog/cards/global_mmlu/ms/computer_security.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/ms 2026-01-06T13:30:30,713 copying build/lib/unitxt/catalog/cards/global_mmlu/ms/philosophy.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/ms 2026-01-06T13:30:30,715 copying build/lib/unitxt/catalog/cards/global_mmlu/ms/virology.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/ms 2026-01-06T13:30:30,717 copying build/lib/unitxt/catalog/cards/global_mmlu/ms/marketing.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/ms 2026-01-06T13:30:30,719 copying build/lib/unitxt/catalog/cards/global_mmlu/ms/high_school_world_history.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/ms 2026-01-06T13:30:30,720 copying build/lib/unitxt/catalog/cards/global_mmlu/ms/machine_learning.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/ms 2026-01-06T13:30:30,722 copying build/lib/unitxt/catalog/cards/global_mmlu/ms/high_school_government_and_politics.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/ms 2026-01-06T13:30:30,724 copying build/lib/unitxt/catalog/cards/global_mmlu/ms/conceptual_physics.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/ms 2026-01-06T13:30:30,726 copying build/lib/unitxt/catalog/cards/global_mmlu/ms/college_biology.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/ms 2026-01-06T13:30:30,728 copying build/lib/unitxt/catalog/cards/global_mmlu/ms/high_school_mathematics.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/ms 2026-01-06T13:30:30,732 creating build/bdist.linux-armv7l/wheel/unitxt/catalog/cards/global_mmlu/ha 2026-01-06T13:30:30,733 copying build/lib/unitxt/catalog/cards/global_mmlu/ha/elementary_mathematics.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/ha 2026-01-06T13:30:30,735 copying build/lib/unitxt/catalog/cards/global_mmlu/ha/human_aging.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/ha 2026-01-06T13:30:30,736 copying build/lib/unitxt/catalog/cards/global_mmlu/ha/high_school_computer_science.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/ha 2026-01-06T13:30:30,738 copying build/lib/unitxt/catalog/cards/global_mmlu/ha/college_physics.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/ha 2026-01-06T13:30:30,740 copying build/lib/unitxt/catalog/cards/global_mmlu/ha/college_medicine.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/ha 2026-01-06T13:30:30,742 copying build/lib/unitxt/catalog/cards/global_mmlu/ha/college_mathematics.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/ha 2026-01-06T13:30:30,744 copying build/lib/unitxt/catalog/cards/global_mmlu/ha/high_school_microeconomics.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/ha 2026-01-06T13:30:30,746 copying build/lib/unitxt/catalog/cards/global_mmlu/ha/anatomy.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/ha 2026-01-06T13:30:30,748 copying build/lib/unitxt/catalog/cards/global_mmlu/ha/world_religions.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/ha 2026-01-06T13:30:30,749 copying build/lib/unitxt/catalog/cards/global_mmlu/ha/management.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/ha 2026-01-06T13:30:30,751 copying build/lib/unitxt/catalog/cards/global_mmlu/ha/moral_scenarios.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/ha 2026-01-06T13:30:30,753 copying build/lib/unitxt/catalog/cards/global_mmlu/ha/global_facts.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/ha 2026-01-06T13:30:30,755 copying build/lib/unitxt/catalog/cards/global_mmlu/ha/miscellaneous.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/ha 2026-01-06T13:30:30,757 copying build/lib/unitxt/catalog/cards/global_mmlu/ha/clinical_knowledge.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/ha 2026-01-06T13:30:30,759 copying build/lib/unitxt/catalog/cards/global_mmlu/ha/high_school_biology.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/ha 2026-01-06T13:30:30,760 copying build/lib/unitxt/catalog/cards/global_mmlu/ha/prehistory.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/ha 2026-01-06T13:30:30,762 copying build/lib/unitxt/catalog/cards/global_mmlu/ha/high_school_us_history.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/ha 2026-01-06T13:30:30,764 copying build/lib/unitxt/catalog/cards/global_mmlu/ha/international_law.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/ha 2026-01-06T13:30:30,766 copying build/lib/unitxt/catalog/cards/global_mmlu/ha/college_computer_science.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/ha 2026-01-06T13:30:30,768 copying build/lib/unitxt/catalog/cards/global_mmlu/ha/astronomy.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/ha 2026-01-06T13:30:30,770 copying build/lib/unitxt/catalog/cards/global_mmlu/ha/high_school_european_history.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/ha 2026-01-06T13:30:30,772 copying build/lib/unitxt/catalog/cards/global_mmlu/ha/electrical_engineering.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/ha 2026-01-06T13:30:30,773 copying build/lib/unitxt/catalog/cards/global_mmlu/ha/nutrition.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/ha 2026-01-06T13:30:30,775 copying build/lib/unitxt/catalog/cards/global_mmlu/ha/abstract_algebra.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/ha 2026-01-06T13:30:30,777 copying build/lib/unitxt/catalog/cards/global_mmlu/ha/professional_medicine.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/ha 2026-01-06T13:30:30,779 copying build/lib/unitxt/catalog/cards/global_mmlu/ha/human_sexuality.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/ha 2026-01-06T13:30:30,781 copying build/lib/unitxt/catalog/cards/global_mmlu/ha/business_ethics.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/ha 2026-01-06T13:30:30,782 copying build/lib/unitxt/catalog/cards/global_mmlu/ha/high_school_chemistry.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/ha 2026-01-06T13:30:30,784 copying build/lib/unitxt/catalog/cards/global_mmlu/ha/logical_fallacies.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/ha 2026-01-06T13:30:30,786 copying build/lib/unitxt/catalog/cards/global_mmlu/ha/formal_logic.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/ha 2026-01-06T13:30:30,788 copying build/lib/unitxt/catalog/cards/global_mmlu/ha/high_school_psychology.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/ha 2026-01-06T13:30:30,790 copying build/lib/unitxt/catalog/cards/global_mmlu/ha/medical_genetics.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/ha 2026-01-06T13:30:30,792 copying build/lib/unitxt/catalog/cards/global_mmlu/ha/security_studies.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/ha 2026-01-06T13:30:30,793 copying build/lib/unitxt/catalog/cards/global_mmlu/ha/high_school_macroeconomics.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/ha 2026-01-06T13:30:30,795 copying build/lib/unitxt/catalog/cards/global_mmlu/ha/professional_law.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/ha 2026-01-06T13:30:30,797 copying build/lib/unitxt/catalog/cards/global_mmlu/ha/high_school_physics.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/ha 2026-01-06T13:30:30,799 copying build/lib/unitxt/catalog/cards/global_mmlu/ha/econometrics.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/ha 2026-01-06T13:30:30,801 copying build/lib/unitxt/catalog/cards/global_mmlu/ha/sociology.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/ha 2026-01-06T13:30:30,802 copying build/lib/unitxt/catalog/cards/global_mmlu/ha/moral_disputes.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/ha 2026-01-06T13:30:30,804 copying build/lib/unitxt/catalog/cards/global_mmlu/ha/college_chemistry.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/ha 2026-01-06T13:30:30,806 copying build/lib/unitxt/catalog/cards/global_mmlu/ha/high_school_geography.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/ha 2026-01-06T13:30:30,808 copying build/lib/unitxt/catalog/cards/global_mmlu/ha/jurisprudence.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/ha 2026-01-06T13:30:30,810 copying build/lib/unitxt/catalog/cards/global_mmlu/ha/high_school_statistics.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/ha 2026-01-06T13:30:30,812 copying build/lib/unitxt/catalog/cards/global_mmlu/ha/professional_accounting.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/ha 2026-01-06T13:30:30,814 copying build/lib/unitxt/catalog/cards/global_mmlu/ha/us_foreign_policy.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/ha 2026-01-06T13:30:30,815 copying build/lib/unitxt/catalog/cards/global_mmlu/ha/professional_psychology.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/ha 2026-01-06T13:30:30,817 copying build/lib/unitxt/catalog/cards/global_mmlu/ha/public_relations.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/ha 2026-01-06T13:30:30,819 copying build/lib/unitxt/catalog/cards/global_mmlu/ha/computer_security.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/ha 2026-01-06T13:30:30,821 copying build/lib/unitxt/catalog/cards/global_mmlu/ha/philosophy.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/ha 2026-01-06T13:30:30,824 copying build/lib/unitxt/catalog/cards/global_mmlu/ha/virology.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/ha 2026-01-06T13:30:30,826 copying build/lib/unitxt/catalog/cards/global_mmlu/ha/marketing.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/ha 2026-01-06T13:30:30,827 copying build/lib/unitxt/catalog/cards/global_mmlu/ha/high_school_world_history.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/ha 2026-01-06T13:30:30,829 copying build/lib/unitxt/catalog/cards/global_mmlu/ha/machine_learning.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/ha 2026-01-06T13:30:30,831 copying build/lib/unitxt/catalog/cards/global_mmlu/ha/high_school_government_and_politics.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/ha 2026-01-06T13:30:30,833 copying build/lib/unitxt/catalog/cards/global_mmlu/ha/conceptual_physics.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/ha 2026-01-06T13:30:30,835 copying build/lib/unitxt/catalog/cards/global_mmlu/ha/college_biology.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/ha 2026-01-06T13:30:30,837 copying build/lib/unitxt/catalog/cards/global_mmlu/ha/high_school_mathematics.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/ha 2026-01-06T13:30:30,841 creating build/bdist.linux-armv7l/wheel/unitxt/catalog/cards/global_mmlu/ru 2026-01-06T13:30:30,842 copying build/lib/unitxt/catalog/cards/global_mmlu/ru/elementary_mathematics.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/ru 2026-01-06T13:30:30,844 copying build/lib/unitxt/catalog/cards/global_mmlu/ru/human_aging.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/ru 2026-01-06T13:30:30,846 copying build/lib/unitxt/catalog/cards/global_mmlu/ru/high_school_computer_science.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/ru 2026-01-06T13:30:30,848 copying build/lib/unitxt/catalog/cards/global_mmlu/ru/college_physics.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/ru 2026-01-06T13:30:30,850 copying build/lib/unitxt/catalog/cards/global_mmlu/ru/college_medicine.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/ru 2026-01-06T13:30:30,851 copying build/lib/unitxt/catalog/cards/global_mmlu/ru/college_mathematics.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/ru 2026-01-06T13:30:30,853 copying build/lib/unitxt/catalog/cards/global_mmlu/ru/high_school_microeconomics.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/ru 2026-01-06T13:30:30,855 copying build/lib/unitxt/catalog/cards/global_mmlu/ru/anatomy.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/ru 2026-01-06T13:30:30,857 copying build/lib/unitxt/catalog/cards/global_mmlu/ru/world_religions.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/ru 2026-01-06T13:30:30,859 copying build/lib/unitxt/catalog/cards/global_mmlu/ru/management.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/ru 2026-01-06T13:30:30,861 copying build/lib/unitxt/catalog/cards/global_mmlu/ru/moral_scenarios.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/ru 2026-01-06T13:30:30,863 copying build/lib/unitxt/catalog/cards/global_mmlu/ru/global_facts.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/ru 2026-01-06T13:30:30,864 copying build/lib/unitxt/catalog/cards/global_mmlu/ru/miscellaneous.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/ru 2026-01-06T13:30:30,866 copying build/lib/unitxt/catalog/cards/global_mmlu/ru/clinical_knowledge.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/ru 2026-01-06T13:30:30,868 copying build/lib/unitxt/catalog/cards/global_mmlu/ru/high_school_biology.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/ru 2026-01-06T13:30:30,870 copying build/lib/unitxt/catalog/cards/global_mmlu/ru/prehistory.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/ru 2026-01-06T13:30:30,872 copying build/lib/unitxt/catalog/cards/global_mmlu/ru/high_school_us_history.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/ru 2026-01-06T13:30:30,874 copying build/lib/unitxt/catalog/cards/global_mmlu/ru/international_law.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/ru 2026-01-06T13:30:30,875 copying build/lib/unitxt/catalog/cards/global_mmlu/ru/college_computer_science.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/ru 2026-01-06T13:30:30,877 copying build/lib/unitxt/catalog/cards/global_mmlu/ru/astronomy.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/ru 2026-01-06T13:30:30,879 copying build/lib/unitxt/catalog/cards/global_mmlu/ru/high_school_european_history.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/ru 2026-01-06T13:30:30,881 copying build/lib/unitxt/catalog/cards/global_mmlu/ru/electrical_engineering.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/ru 2026-01-06T13:30:30,882 copying build/lib/unitxt/catalog/cards/global_mmlu/ru/nutrition.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/ru 2026-01-06T13:30:30,884 copying build/lib/unitxt/catalog/cards/global_mmlu/ru/abstract_algebra.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/ru 2026-01-06T13:30:30,886 copying build/lib/unitxt/catalog/cards/global_mmlu/ru/professional_medicine.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/ru 2026-01-06T13:30:30,888 copying build/lib/unitxt/catalog/cards/global_mmlu/ru/human_sexuality.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/ru 2026-01-06T13:30:30,890 copying build/lib/unitxt/catalog/cards/global_mmlu/ru/business_ethics.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/ru 2026-01-06T13:30:30,892 copying build/lib/unitxt/catalog/cards/global_mmlu/ru/high_school_chemistry.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/ru 2026-01-06T13:30:30,894 copying build/lib/unitxt/catalog/cards/global_mmlu/ru/logical_fallacies.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/ru 2026-01-06T13:30:30,896 copying build/lib/unitxt/catalog/cards/global_mmlu/ru/formal_logic.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/ru 2026-01-06T13:30:30,898 copying build/lib/unitxt/catalog/cards/global_mmlu/ru/high_school_psychology.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/ru 2026-01-06T13:30:30,899 copying build/lib/unitxt/catalog/cards/global_mmlu/ru/medical_genetics.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/ru 2026-01-06T13:30:30,901 copying build/lib/unitxt/catalog/cards/global_mmlu/ru/security_studies.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/ru 2026-01-06T13:30:30,903 copying build/lib/unitxt/catalog/cards/global_mmlu/ru/high_school_macroeconomics.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/ru 2026-01-06T13:30:30,905 copying build/lib/unitxt/catalog/cards/global_mmlu/ru/professional_law.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/ru 2026-01-06T13:30:30,907 copying build/lib/unitxt/catalog/cards/global_mmlu/ru/high_school_physics.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/ru 2026-01-06T13:30:30,909 copying build/lib/unitxt/catalog/cards/global_mmlu/ru/econometrics.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/ru 2026-01-06T13:30:30,911 copying build/lib/unitxt/catalog/cards/global_mmlu/ru/sociology.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/ru 2026-01-06T13:30:30,912 copying build/lib/unitxt/catalog/cards/global_mmlu/ru/moral_disputes.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/ru 2026-01-06T13:30:30,914 copying build/lib/unitxt/catalog/cards/global_mmlu/ru/college_chemistry.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/ru 2026-01-06T13:30:30,916 copying build/lib/unitxt/catalog/cards/global_mmlu/ru/high_school_geography.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/ru 2026-01-06T13:30:30,918 copying build/lib/unitxt/catalog/cards/global_mmlu/ru/jurisprudence.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/ru 2026-01-06T13:30:30,920 copying build/lib/unitxt/catalog/cards/global_mmlu/ru/high_school_statistics.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/ru 2026-01-06T13:30:30,922 copying build/lib/unitxt/catalog/cards/global_mmlu/ru/professional_accounting.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/ru 2026-01-06T13:30:30,924 copying build/lib/unitxt/catalog/cards/global_mmlu/ru/us_foreign_policy.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/ru 2026-01-06T13:30:30,925 copying build/lib/unitxt/catalog/cards/global_mmlu/ru/professional_psychology.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/ru 2026-01-06T13:30:30,927 copying build/lib/unitxt/catalog/cards/global_mmlu/ru/public_relations.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/ru 2026-01-06T13:30:30,929 copying build/lib/unitxt/catalog/cards/global_mmlu/ru/computer_security.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/ru 2026-01-06T13:30:30,931 copying build/lib/unitxt/catalog/cards/global_mmlu/ru/philosophy.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/ru 2026-01-06T13:30:30,932 copying build/lib/unitxt/catalog/cards/global_mmlu/ru/virology.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/ru 2026-01-06T13:30:30,934 copying build/lib/unitxt/catalog/cards/global_mmlu/ru/marketing.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/ru 2026-01-06T13:30:30,936 copying build/lib/unitxt/catalog/cards/global_mmlu/ru/high_school_world_history.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/ru 2026-01-06T13:30:30,938 copying build/lib/unitxt/catalog/cards/global_mmlu/ru/machine_learning.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/ru 2026-01-06T13:30:30,940 copying build/lib/unitxt/catalog/cards/global_mmlu/ru/high_school_government_and_politics.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/ru 2026-01-06T13:30:30,942 copying build/lib/unitxt/catalog/cards/global_mmlu/ru/conceptual_physics.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/ru 2026-01-06T13:30:30,943 copying build/lib/unitxt/catalog/cards/global_mmlu/ru/college_biology.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/ru 2026-01-06T13:30:30,945 copying build/lib/unitxt/catalog/cards/global_mmlu/ru/high_school_mathematics.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/ru 2026-01-06T13:30:30,948 creating build/bdist.linux-armv7l/wheel/unitxt/catalog/cards/global_mmlu/yo 2026-01-06T13:30:30,949 copying build/lib/unitxt/catalog/cards/global_mmlu/yo/elementary_mathematics.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/yo 2026-01-06T13:30:30,951 copying build/lib/unitxt/catalog/cards/global_mmlu/yo/human_aging.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/yo 2026-01-06T13:30:30,953 copying build/lib/unitxt/catalog/cards/global_mmlu/yo/high_school_computer_science.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/yo 2026-01-06T13:30:30,955 copying build/lib/unitxt/catalog/cards/global_mmlu/yo/college_physics.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/yo 2026-01-06T13:30:30,957 copying build/lib/unitxt/catalog/cards/global_mmlu/yo/college_medicine.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/yo 2026-01-06T13:30:30,959 copying build/lib/unitxt/catalog/cards/global_mmlu/yo/college_mathematics.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/yo 2026-01-06T13:30:30,961 copying build/lib/unitxt/catalog/cards/global_mmlu/yo/high_school_microeconomics.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/yo 2026-01-06T13:30:30,962 copying build/lib/unitxt/catalog/cards/global_mmlu/yo/anatomy.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/yo 2026-01-06T13:30:30,964 copying build/lib/unitxt/catalog/cards/global_mmlu/yo/world_religions.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/yo 2026-01-06T13:30:30,966 copying build/lib/unitxt/catalog/cards/global_mmlu/yo/management.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/yo 2026-01-06T13:30:30,968 copying build/lib/unitxt/catalog/cards/global_mmlu/yo/moral_scenarios.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/yo 2026-01-06T13:30:30,970 copying build/lib/unitxt/catalog/cards/global_mmlu/yo/global_facts.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/yo 2026-01-06T13:30:30,971 copying build/lib/unitxt/catalog/cards/global_mmlu/yo/miscellaneous.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/yo 2026-01-06T13:30:30,973 copying build/lib/unitxt/catalog/cards/global_mmlu/yo/clinical_knowledge.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/yo 2026-01-06T13:30:30,975 copying build/lib/unitxt/catalog/cards/global_mmlu/yo/high_school_biology.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/yo 2026-01-06T13:30:30,977 copying build/lib/unitxt/catalog/cards/global_mmlu/yo/prehistory.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/yo 2026-01-06T13:30:30,979 copying build/lib/unitxt/catalog/cards/global_mmlu/yo/high_school_us_history.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/yo 2026-01-06T13:30:30,980 copying build/lib/unitxt/catalog/cards/global_mmlu/yo/international_law.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/yo 2026-01-06T13:30:30,982 copying build/lib/unitxt/catalog/cards/global_mmlu/yo/college_computer_science.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/yo 2026-01-06T13:30:30,984 copying build/lib/unitxt/catalog/cards/global_mmlu/yo/astronomy.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/yo 2026-01-06T13:30:30,986 copying build/lib/unitxt/catalog/cards/global_mmlu/yo/high_school_european_history.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/yo 2026-01-06T13:30:30,988 copying build/lib/unitxt/catalog/cards/global_mmlu/yo/electrical_engineering.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/yo 2026-01-06T13:30:30,990 copying build/lib/unitxt/catalog/cards/global_mmlu/yo/nutrition.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/yo 2026-01-06T13:30:30,992 copying build/lib/unitxt/catalog/cards/global_mmlu/yo/abstract_algebra.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/yo 2026-01-06T13:30:30,993 copying build/lib/unitxt/catalog/cards/global_mmlu/yo/professional_medicine.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/yo 2026-01-06T13:30:30,995 copying build/lib/unitxt/catalog/cards/global_mmlu/yo/human_sexuality.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/yo 2026-01-06T13:30:30,997 copying build/lib/unitxt/catalog/cards/global_mmlu/yo/business_ethics.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/yo 2026-01-06T13:30:30,999 copying build/lib/unitxt/catalog/cards/global_mmlu/yo/high_school_chemistry.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/yo 2026-01-06T13:30:31,001 copying build/lib/unitxt/catalog/cards/global_mmlu/yo/logical_fallacies.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/yo 2026-01-06T13:30:31,003 copying build/lib/unitxt/catalog/cards/global_mmlu/yo/formal_logic.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/yo 2026-01-06T13:30:31,005 copying build/lib/unitxt/catalog/cards/global_mmlu/yo/high_school_psychology.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/yo 2026-01-06T13:30:31,007 copying build/lib/unitxt/catalog/cards/global_mmlu/yo/medical_genetics.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/yo 2026-01-06T13:30:31,009 copying build/lib/unitxt/catalog/cards/global_mmlu/yo/security_studies.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/yo 2026-01-06T13:30:31,011 copying build/lib/unitxt/catalog/cards/global_mmlu/yo/high_school_macroeconomics.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/yo 2026-01-06T13:30:31,012 copying build/lib/unitxt/catalog/cards/global_mmlu/yo/professional_law.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/yo 2026-01-06T13:30:31,014 copying build/lib/unitxt/catalog/cards/global_mmlu/yo/high_school_physics.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/yo 2026-01-06T13:30:31,016 copying build/lib/unitxt/catalog/cards/global_mmlu/yo/econometrics.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/yo 2026-01-06T13:30:31,018 copying build/lib/unitxt/catalog/cards/global_mmlu/yo/sociology.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/yo 2026-01-06T13:30:31,019 copying build/lib/unitxt/catalog/cards/global_mmlu/yo/moral_disputes.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/yo 2026-01-06T13:30:31,021 copying build/lib/unitxt/catalog/cards/global_mmlu/yo/college_chemistry.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/yo 2026-01-06T13:30:31,023 copying build/lib/unitxt/catalog/cards/global_mmlu/yo/high_school_geography.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/yo 2026-01-06T13:30:31,025 copying build/lib/unitxt/catalog/cards/global_mmlu/yo/jurisprudence.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/yo 2026-01-06T13:30:31,027 copying build/lib/unitxt/catalog/cards/global_mmlu/yo/high_school_statistics.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/yo 2026-01-06T13:30:31,029 copying build/lib/unitxt/catalog/cards/global_mmlu/yo/professional_accounting.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/yo 2026-01-06T13:30:31,031 copying build/lib/unitxt/catalog/cards/global_mmlu/yo/us_foreign_policy.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/yo 2026-01-06T13:30:31,033 copying build/lib/unitxt/catalog/cards/global_mmlu/yo/professional_psychology.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/yo 2026-01-06T13:30:31,034 copying build/lib/unitxt/catalog/cards/global_mmlu/yo/public_relations.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/yo 2026-01-06T13:30:31,036 copying build/lib/unitxt/catalog/cards/global_mmlu/yo/computer_security.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/yo 2026-01-06T13:30:31,038 copying build/lib/unitxt/catalog/cards/global_mmlu/yo/philosophy.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/yo 2026-01-06T13:30:31,040 copying build/lib/unitxt/catalog/cards/global_mmlu/yo/virology.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/yo 2026-01-06T13:30:31,042 copying build/lib/unitxt/catalog/cards/global_mmlu/yo/marketing.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/yo 2026-01-06T13:30:31,044 copying build/lib/unitxt/catalog/cards/global_mmlu/yo/high_school_world_history.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/yo 2026-01-06T13:30:31,046 copying build/lib/unitxt/catalog/cards/global_mmlu/yo/machine_learning.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/yo 2026-01-06T13:30:31,048 copying build/lib/unitxt/catalog/cards/global_mmlu/yo/high_school_government_and_politics.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/yo 2026-01-06T13:30:31,049 copying build/lib/unitxt/catalog/cards/global_mmlu/yo/conceptual_physics.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/yo 2026-01-06T13:30:31,051 copying build/lib/unitxt/catalog/cards/global_mmlu/yo/college_biology.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/yo 2026-01-06T13:30:31,053 copying build/lib/unitxt/catalog/cards/global_mmlu/yo/high_school_mathematics.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/yo 2026-01-06T13:30:31,056 creating build/bdist.linux-armv7l/wheel/unitxt/catalog/cards/global_mmlu/zh 2026-01-06T13:30:31,057 copying build/lib/unitxt/catalog/cards/global_mmlu/zh/elementary_mathematics.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/zh 2026-01-06T13:30:31,059 copying build/lib/unitxt/catalog/cards/global_mmlu/zh/human_aging.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/zh 2026-01-06T13:30:31,061 copying build/lib/unitxt/catalog/cards/global_mmlu/zh/high_school_computer_science.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/zh 2026-01-06T13:30:31,062 copying build/lib/unitxt/catalog/cards/global_mmlu/zh/college_physics.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/zh 2026-01-06T13:30:31,064 copying build/lib/unitxt/catalog/cards/global_mmlu/zh/college_medicine.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/zh 2026-01-06T13:30:31,066 copying build/lib/unitxt/catalog/cards/global_mmlu/zh/college_mathematics.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/zh 2026-01-06T13:30:31,068 copying build/lib/unitxt/catalog/cards/global_mmlu/zh/high_school_microeconomics.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/zh 2026-01-06T13:30:31,070 copying build/lib/unitxt/catalog/cards/global_mmlu/zh/anatomy.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/zh 2026-01-06T13:30:31,072 copying build/lib/unitxt/catalog/cards/global_mmlu/zh/world_religions.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/zh 2026-01-06T13:30:31,074 copying build/lib/unitxt/catalog/cards/global_mmlu/zh/management.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/zh 2026-01-06T13:30:31,075 copying build/lib/unitxt/catalog/cards/global_mmlu/zh/moral_scenarios.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/zh 2026-01-06T13:30:31,077 copying build/lib/unitxt/catalog/cards/global_mmlu/zh/global_facts.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/zh 2026-01-06T13:30:31,079 copying build/lib/unitxt/catalog/cards/global_mmlu/zh/miscellaneous.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/zh 2026-01-06T13:30:31,081 copying build/lib/unitxt/catalog/cards/global_mmlu/zh/clinical_knowledge.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/zh 2026-01-06T13:30:31,083 copying build/lib/unitxt/catalog/cards/global_mmlu/zh/high_school_biology.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/zh 2026-01-06T13:30:31,085 copying build/lib/unitxt/catalog/cards/global_mmlu/zh/prehistory.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/zh 2026-01-06T13:30:31,087 copying build/lib/unitxt/catalog/cards/global_mmlu/zh/high_school_us_history.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/zh 2026-01-06T13:30:31,089 copying build/lib/unitxt/catalog/cards/global_mmlu/zh/international_law.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/zh 2026-01-06T13:30:31,090 copying build/lib/unitxt/catalog/cards/global_mmlu/zh/college_computer_science.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/zh 2026-01-06T13:30:31,092 copying build/lib/unitxt/catalog/cards/global_mmlu/zh/astronomy.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/zh 2026-01-06T13:30:31,094 copying build/lib/unitxt/catalog/cards/global_mmlu/zh/high_school_european_history.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/zh 2026-01-06T13:30:31,096 copying build/lib/unitxt/catalog/cards/global_mmlu/zh/electrical_engineering.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/zh 2026-01-06T13:30:31,098 copying build/lib/unitxt/catalog/cards/global_mmlu/zh/nutrition.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/zh 2026-01-06T13:30:31,100 copying build/lib/unitxt/catalog/cards/global_mmlu/zh/abstract_algebra.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/zh 2026-01-06T13:30:31,101 copying build/lib/unitxt/catalog/cards/global_mmlu/zh/professional_medicine.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/zh 2026-01-06T13:30:31,103 copying build/lib/unitxt/catalog/cards/global_mmlu/zh/human_sexuality.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/zh 2026-01-06T13:30:31,105 copying build/lib/unitxt/catalog/cards/global_mmlu/zh/business_ethics.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/zh 2026-01-06T13:30:31,107 copying build/lib/unitxt/catalog/cards/global_mmlu/zh/high_school_chemistry.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/zh 2026-01-06T13:30:31,109 copying build/lib/unitxt/catalog/cards/global_mmlu/zh/logical_fallacies.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/zh 2026-01-06T13:30:31,110 copying build/lib/unitxt/catalog/cards/global_mmlu/zh/formal_logic.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/zh 2026-01-06T13:30:31,112 copying build/lib/unitxt/catalog/cards/global_mmlu/zh/high_school_psychology.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/zh 2026-01-06T13:30:31,114 copying build/lib/unitxt/catalog/cards/global_mmlu/zh/medical_genetics.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/zh 2026-01-06T13:30:31,116 copying build/lib/unitxt/catalog/cards/global_mmlu/zh/security_studies.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/zh 2026-01-06T13:30:31,118 copying build/lib/unitxt/catalog/cards/global_mmlu/zh/high_school_macroeconomics.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/zh 2026-01-06T13:30:31,120 copying build/lib/unitxt/catalog/cards/global_mmlu/zh/professional_law.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/zh 2026-01-06T13:30:31,122 copying build/lib/unitxt/catalog/cards/global_mmlu/zh/high_school_physics.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/zh 2026-01-06T13:30:31,124 copying build/lib/unitxt/catalog/cards/global_mmlu/zh/econometrics.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/zh 2026-01-06T13:30:31,125 copying build/lib/unitxt/catalog/cards/global_mmlu/zh/sociology.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/zh 2026-01-06T13:30:31,127 copying build/lib/unitxt/catalog/cards/global_mmlu/zh/moral_disputes.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/zh 2026-01-06T13:30:31,129 copying build/lib/unitxt/catalog/cards/global_mmlu/zh/college_chemistry.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/zh 2026-01-06T13:30:31,131 copying build/lib/unitxt/catalog/cards/global_mmlu/zh/high_school_geography.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/zh 2026-01-06T13:30:31,133 copying build/lib/unitxt/catalog/cards/global_mmlu/zh/jurisprudence.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/zh 2026-01-06T13:30:31,135 copying build/lib/unitxt/catalog/cards/global_mmlu/zh/high_school_statistics.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/zh 2026-01-06T13:30:31,137 copying build/lib/unitxt/catalog/cards/global_mmlu/zh/professional_accounting.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/zh 2026-01-06T13:30:31,139 copying build/lib/unitxt/catalog/cards/global_mmlu/zh/us_foreign_policy.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/zh 2026-01-06T13:30:31,141 copying build/lib/unitxt/catalog/cards/global_mmlu/zh/professional_psychology.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/zh 2026-01-06T13:30:31,143 copying build/lib/unitxt/catalog/cards/global_mmlu/zh/public_relations.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/zh 2026-01-06T13:30:31,144 copying build/lib/unitxt/catalog/cards/global_mmlu/zh/computer_security.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/zh 2026-01-06T13:30:31,146 copying build/lib/unitxt/catalog/cards/global_mmlu/zh/philosophy.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/zh 2026-01-06T13:30:31,148 copying build/lib/unitxt/catalog/cards/global_mmlu/zh/virology.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/zh 2026-01-06T13:30:31,150 copying build/lib/unitxt/catalog/cards/global_mmlu/zh/marketing.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/zh 2026-01-06T13:30:31,152 copying build/lib/unitxt/catalog/cards/global_mmlu/zh/high_school_world_history.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/zh 2026-01-06T13:30:31,154 copying build/lib/unitxt/catalog/cards/global_mmlu/zh/machine_learning.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/zh 2026-01-06T13:30:31,156 copying build/lib/unitxt/catalog/cards/global_mmlu/zh/high_school_government_and_politics.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/zh 2026-01-06T13:30:31,159 copying build/lib/unitxt/catalog/cards/global_mmlu/zh/conceptual_physics.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/zh 2026-01-06T13:30:31,160 copying build/lib/unitxt/catalog/cards/global_mmlu/zh/college_biology.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/zh 2026-01-06T13:30:31,162 copying build/lib/unitxt/catalog/cards/global_mmlu/zh/high_school_mathematics.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/zh 2026-01-06T13:30:31,166 creating build/bdist.linux-armv7l/wheel/unitxt/catalog/cards/global_mmlu/fa 2026-01-06T13:30:31,167 copying build/lib/unitxt/catalog/cards/global_mmlu/fa/elementary_mathematics.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/fa 2026-01-06T13:30:31,169 copying build/lib/unitxt/catalog/cards/global_mmlu/fa/human_aging.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/fa 2026-01-06T13:30:31,171 copying build/lib/unitxt/catalog/cards/global_mmlu/fa/high_school_computer_science.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/fa 2026-01-06T13:30:31,172 copying build/lib/unitxt/catalog/cards/global_mmlu/fa/college_physics.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/fa 2026-01-06T13:30:31,174 copying build/lib/unitxt/catalog/cards/global_mmlu/fa/college_medicine.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/fa 2026-01-06T13:30:31,176 copying build/lib/unitxt/catalog/cards/global_mmlu/fa/college_mathematics.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/fa 2026-01-06T13:30:31,178 copying build/lib/unitxt/catalog/cards/global_mmlu/fa/high_school_microeconomics.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/fa 2026-01-06T13:30:31,180 copying build/lib/unitxt/catalog/cards/global_mmlu/fa/anatomy.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/fa 2026-01-06T13:30:31,182 copying build/lib/unitxt/catalog/cards/global_mmlu/fa/world_religions.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/fa 2026-01-06T13:30:31,184 copying build/lib/unitxt/catalog/cards/global_mmlu/fa/management.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/fa 2026-01-06T13:30:31,186 copying build/lib/unitxt/catalog/cards/global_mmlu/fa/moral_scenarios.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/fa 2026-01-06T13:30:31,187 copying build/lib/unitxt/catalog/cards/global_mmlu/fa/global_facts.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/fa 2026-01-06T13:30:31,189 copying build/lib/unitxt/catalog/cards/global_mmlu/fa/miscellaneous.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/fa 2026-01-06T13:30:31,191 copying build/lib/unitxt/catalog/cards/global_mmlu/fa/clinical_knowledge.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/fa 2026-01-06T13:30:31,193 copying build/lib/unitxt/catalog/cards/global_mmlu/fa/high_school_biology.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/fa 2026-01-06T13:30:31,195 copying build/lib/unitxt/catalog/cards/global_mmlu/fa/prehistory.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/fa 2026-01-06T13:30:31,196 copying build/lib/unitxt/catalog/cards/global_mmlu/fa/high_school_us_history.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/fa 2026-01-06T13:30:31,198 copying build/lib/unitxt/catalog/cards/global_mmlu/fa/international_law.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/fa 2026-01-06T13:30:31,200 copying build/lib/unitxt/catalog/cards/global_mmlu/fa/college_computer_science.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/fa 2026-01-06T13:30:31,202 copying build/lib/unitxt/catalog/cards/global_mmlu/fa/astronomy.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/fa 2026-01-06T13:30:31,204 copying build/lib/unitxt/catalog/cards/global_mmlu/fa/high_school_european_history.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/fa 2026-01-06T13:30:31,205 copying build/lib/unitxt/catalog/cards/global_mmlu/fa/electrical_engineering.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/fa 2026-01-06T13:30:31,207 copying build/lib/unitxt/catalog/cards/global_mmlu/fa/nutrition.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/fa 2026-01-06T13:30:31,209 copying build/lib/unitxt/catalog/cards/global_mmlu/fa/abstract_algebra.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/fa 2026-01-06T13:30:31,211 copying build/lib/unitxt/catalog/cards/global_mmlu/fa/professional_medicine.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/fa 2026-01-06T13:30:31,213 copying build/lib/unitxt/catalog/cards/global_mmlu/fa/human_sexuality.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/fa 2026-01-06T13:30:31,215 copying build/lib/unitxt/catalog/cards/global_mmlu/fa/business_ethics.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/fa 2026-01-06T13:30:31,217 copying build/lib/unitxt/catalog/cards/global_mmlu/fa/high_school_chemistry.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/fa 2026-01-06T13:30:31,219 copying build/lib/unitxt/catalog/cards/global_mmlu/fa/logical_fallacies.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/fa 2026-01-06T13:30:31,221 copying build/lib/unitxt/catalog/cards/global_mmlu/fa/formal_logic.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/fa 2026-01-06T13:30:31,222 copying build/lib/unitxt/catalog/cards/global_mmlu/fa/high_school_psychology.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/fa 2026-01-06T13:30:31,224 copying build/lib/unitxt/catalog/cards/global_mmlu/fa/medical_genetics.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/fa 2026-01-06T13:30:31,226 copying build/lib/unitxt/catalog/cards/global_mmlu/fa/security_studies.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/fa 2026-01-06T13:30:31,228 copying build/lib/unitxt/catalog/cards/global_mmlu/fa/high_school_macroeconomics.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/fa 2026-01-06T13:30:31,230 copying build/lib/unitxt/catalog/cards/global_mmlu/fa/professional_law.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/fa 2026-01-06T13:30:31,232 copying build/lib/unitxt/catalog/cards/global_mmlu/fa/high_school_physics.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/fa 2026-01-06T13:30:31,233 copying build/lib/unitxt/catalog/cards/global_mmlu/fa/econometrics.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/fa 2026-01-06T13:30:31,235 copying build/lib/unitxt/catalog/cards/global_mmlu/fa/sociology.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/fa 2026-01-06T13:30:31,237 copying build/lib/unitxt/catalog/cards/global_mmlu/fa/moral_disputes.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/fa 2026-01-06T13:30:31,239 copying build/lib/unitxt/catalog/cards/global_mmlu/fa/college_chemistry.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/fa 2026-01-06T13:30:31,240 copying build/lib/unitxt/catalog/cards/global_mmlu/fa/high_school_geography.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/fa 2026-01-06T13:30:31,242 copying build/lib/unitxt/catalog/cards/global_mmlu/fa/jurisprudence.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/fa 2026-01-06T13:30:31,244 copying build/lib/unitxt/catalog/cards/global_mmlu/fa/high_school_statistics.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/fa 2026-01-06T13:30:31,246 copying build/lib/unitxt/catalog/cards/global_mmlu/fa/professional_accounting.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/fa 2026-01-06T13:30:31,248 copying build/lib/unitxt/catalog/cards/global_mmlu/fa/us_foreign_policy.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/fa 2026-01-06T13:30:31,250 copying build/lib/unitxt/catalog/cards/global_mmlu/fa/professional_psychology.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/fa 2026-01-06T13:30:31,252 copying build/lib/unitxt/catalog/cards/global_mmlu/fa/public_relations.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/fa 2026-01-06T13:30:31,253 copying build/lib/unitxt/catalog/cards/global_mmlu/fa/computer_security.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/fa 2026-01-06T13:30:31,255 copying build/lib/unitxt/catalog/cards/global_mmlu/fa/philosophy.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/fa 2026-01-06T13:30:31,257 copying build/lib/unitxt/catalog/cards/global_mmlu/fa/virology.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/fa 2026-01-06T13:30:31,259 copying build/lib/unitxt/catalog/cards/global_mmlu/fa/marketing.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/fa 2026-01-06T13:30:31,261 copying build/lib/unitxt/catalog/cards/global_mmlu/fa/high_school_world_history.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/fa 2026-01-06T13:30:31,263 copying build/lib/unitxt/catalog/cards/global_mmlu/fa/machine_learning.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/fa 2026-01-06T13:30:31,264 copying build/lib/unitxt/catalog/cards/global_mmlu/fa/high_school_government_and_politics.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/fa 2026-01-06T13:30:31,267 copying build/lib/unitxt/catalog/cards/global_mmlu/fa/conceptual_physics.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/fa 2026-01-06T13:30:31,268 copying build/lib/unitxt/catalog/cards/global_mmlu/fa/college_biology.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/fa 2026-01-06T13:30:31,270 copying build/lib/unitxt/catalog/cards/global_mmlu/fa/high_school_mathematics.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/fa 2026-01-06T13:30:31,273 creating build/bdist.linux-armv7l/wheel/unitxt/catalog/cards/global_mmlu/ro 2026-01-06T13:30:31,274 copying build/lib/unitxt/catalog/cards/global_mmlu/ro/elementary_mathematics.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/ro 2026-01-06T13:30:31,276 copying build/lib/unitxt/catalog/cards/global_mmlu/ro/human_aging.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/ro 2026-01-06T13:30:31,278 copying build/lib/unitxt/catalog/cards/global_mmlu/ro/high_school_computer_science.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/ro 2026-01-06T13:30:31,280 copying build/lib/unitxt/catalog/cards/global_mmlu/ro/college_physics.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/ro 2026-01-06T13:30:31,282 copying build/lib/unitxt/catalog/cards/global_mmlu/ro/college_medicine.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/ro 2026-01-06T13:30:31,283 copying build/lib/unitxt/catalog/cards/global_mmlu/ro/college_mathematics.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/ro 2026-01-06T13:30:31,285 copying build/lib/unitxt/catalog/cards/global_mmlu/ro/high_school_microeconomics.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/ro 2026-01-06T13:30:31,287 copying build/lib/unitxt/catalog/cards/global_mmlu/ro/anatomy.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/ro 2026-01-06T13:30:31,289 copying build/lib/unitxt/catalog/cards/global_mmlu/ro/world_religions.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/ro 2026-01-06T13:30:31,291 copying build/lib/unitxt/catalog/cards/global_mmlu/ro/management.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/ro 2026-01-06T13:30:31,294 copying build/lib/unitxt/catalog/cards/global_mmlu/ro/moral_scenarios.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/ro 2026-01-06T13:30:31,295 copying build/lib/unitxt/catalog/cards/global_mmlu/ro/global_facts.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/ro 2026-01-06T13:30:31,297 copying build/lib/unitxt/catalog/cards/global_mmlu/ro/miscellaneous.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/ro 2026-01-06T13:30:31,299 copying build/lib/unitxt/catalog/cards/global_mmlu/ro/clinical_knowledge.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/ro 2026-01-06T13:30:31,301 copying build/lib/unitxt/catalog/cards/global_mmlu/ro/high_school_biology.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/ro 2026-01-06T13:30:31,303 copying build/lib/unitxt/catalog/cards/global_mmlu/ro/prehistory.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/ro 2026-01-06T13:30:31,305 copying build/lib/unitxt/catalog/cards/global_mmlu/ro/high_school_us_history.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/ro 2026-01-06T13:30:31,307 copying build/lib/unitxt/catalog/cards/global_mmlu/ro/international_law.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/ro 2026-01-06T13:30:31,309 copying build/lib/unitxt/catalog/cards/global_mmlu/ro/college_computer_science.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/ro 2026-01-06T13:30:31,311 copying build/lib/unitxt/catalog/cards/global_mmlu/ro/astronomy.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/ro 2026-01-06T13:30:31,312 copying build/lib/unitxt/catalog/cards/global_mmlu/ro/high_school_european_history.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/ro 2026-01-06T13:30:31,314 copying build/lib/unitxt/catalog/cards/global_mmlu/ro/electrical_engineering.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/ro 2026-01-06T13:30:31,316 copying build/lib/unitxt/catalog/cards/global_mmlu/ro/nutrition.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/ro 2026-01-06T13:30:31,318 copying build/lib/unitxt/catalog/cards/global_mmlu/ro/abstract_algebra.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/ro 2026-01-06T13:30:31,319 copying build/lib/unitxt/catalog/cards/global_mmlu/ro/professional_medicine.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/ro 2026-01-06T13:30:31,321 copying build/lib/unitxt/catalog/cards/global_mmlu/ro/human_sexuality.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/ro 2026-01-06T13:30:31,323 copying build/lib/unitxt/catalog/cards/global_mmlu/ro/business_ethics.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/ro 2026-01-06T13:30:31,325 copying build/lib/unitxt/catalog/cards/global_mmlu/ro/high_school_chemistry.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/ro 2026-01-06T13:30:31,326 copying build/lib/unitxt/catalog/cards/global_mmlu/ro/logical_fallacies.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/ro 2026-01-06T13:30:31,328 copying build/lib/unitxt/catalog/cards/global_mmlu/ro/formal_logic.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/ro 2026-01-06T13:30:31,330 copying build/lib/unitxt/catalog/cards/global_mmlu/ro/high_school_psychology.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/ro 2026-01-06T13:30:31,332 copying build/lib/unitxt/catalog/cards/global_mmlu/ro/medical_genetics.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/ro 2026-01-06T13:30:31,333 copying build/lib/unitxt/catalog/cards/global_mmlu/ro/security_studies.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/ro 2026-01-06T13:30:31,335 copying build/lib/unitxt/catalog/cards/global_mmlu/ro/high_school_macroeconomics.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/ro 2026-01-06T13:30:31,337 copying build/lib/unitxt/catalog/cards/global_mmlu/ro/professional_law.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/ro 2026-01-06T13:30:31,339 copying build/lib/unitxt/catalog/cards/global_mmlu/ro/high_school_physics.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/ro 2026-01-06T13:30:31,341 copying build/lib/unitxt/catalog/cards/global_mmlu/ro/econometrics.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/ro 2026-01-06T13:30:31,343 copying build/lib/unitxt/catalog/cards/global_mmlu/ro/sociology.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/ro 2026-01-06T13:30:31,344 copying build/lib/unitxt/catalog/cards/global_mmlu/ro/moral_disputes.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/ro 2026-01-06T13:30:31,346 copying build/lib/unitxt/catalog/cards/global_mmlu/ro/college_chemistry.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/ro 2026-01-06T13:30:31,348 copying build/lib/unitxt/catalog/cards/global_mmlu/ro/high_school_geography.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/ro 2026-01-06T13:30:31,350 copying build/lib/unitxt/catalog/cards/global_mmlu/ro/jurisprudence.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/ro 2026-01-06T13:30:31,352 copying build/lib/unitxt/catalog/cards/global_mmlu/ro/high_school_statistics.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/ro 2026-01-06T13:30:31,354 copying build/lib/unitxt/catalog/cards/global_mmlu/ro/professional_accounting.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/ro 2026-01-06T13:30:31,356 copying build/lib/unitxt/catalog/cards/global_mmlu/ro/us_foreign_policy.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/ro 2026-01-06T13:30:31,358 copying build/lib/unitxt/catalog/cards/global_mmlu/ro/professional_psychology.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/ro 2026-01-06T13:30:31,359 copying build/lib/unitxt/catalog/cards/global_mmlu/ro/public_relations.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/ro 2026-01-06T13:30:31,361 copying build/lib/unitxt/catalog/cards/global_mmlu/ro/computer_security.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/ro 2026-01-06T13:30:31,363 copying build/lib/unitxt/catalog/cards/global_mmlu/ro/philosophy.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/ro 2026-01-06T13:30:31,365 copying build/lib/unitxt/catalog/cards/global_mmlu/ro/virology.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/ro 2026-01-06T13:30:31,366 copying build/lib/unitxt/catalog/cards/global_mmlu/ro/marketing.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/ro 2026-01-06T13:30:31,368 copying build/lib/unitxt/catalog/cards/global_mmlu/ro/high_school_world_history.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/ro 2026-01-06T13:30:31,370 copying build/lib/unitxt/catalog/cards/global_mmlu/ro/machine_learning.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/ro 2026-01-06T13:30:31,372 copying build/lib/unitxt/catalog/cards/global_mmlu/ro/high_school_government_and_politics.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/ro 2026-01-06T13:30:31,374 copying build/lib/unitxt/catalog/cards/global_mmlu/ro/conceptual_physics.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/ro 2026-01-06T13:30:31,375 copying build/lib/unitxt/catalog/cards/global_mmlu/ro/college_biology.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/ro 2026-01-06T13:30:31,378 copying build/lib/unitxt/catalog/cards/global_mmlu/ro/high_school_mathematics.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/ro 2026-01-06T13:30:31,381 creating build/bdist.linux-armv7l/wheel/unitxt/catalog/cards/global_mmlu/de 2026-01-06T13:30:31,382 copying build/lib/unitxt/catalog/cards/global_mmlu/de/elementary_mathematics.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/de 2026-01-06T13:30:31,384 copying build/lib/unitxt/catalog/cards/global_mmlu/de/human_aging.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/de 2026-01-06T13:30:31,385 copying build/lib/unitxt/catalog/cards/global_mmlu/de/high_school_computer_science.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/de 2026-01-06T13:30:31,387 copying build/lib/unitxt/catalog/cards/global_mmlu/de/college_physics.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/de 2026-01-06T13:30:31,389 copying build/lib/unitxt/catalog/cards/global_mmlu/de/college_medicine.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/de 2026-01-06T13:30:31,391 copying build/lib/unitxt/catalog/cards/global_mmlu/de/college_mathematics.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/de 2026-01-06T13:30:31,393 copying build/lib/unitxt/catalog/cards/global_mmlu/de/high_school_microeconomics.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/de 2026-01-06T13:30:31,395 copying build/lib/unitxt/catalog/cards/global_mmlu/de/anatomy.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/de 2026-01-06T13:30:31,397 copying build/lib/unitxt/catalog/cards/global_mmlu/de/world_religions.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/de 2026-01-06T13:30:31,399 copying build/lib/unitxt/catalog/cards/global_mmlu/de/management.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/de 2026-01-06T13:30:31,401 copying build/lib/unitxt/catalog/cards/global_mmlu/de/moral_scenarios.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/de 2026-01-06T13:30:31,403 copying build/lib/unitxt/catalog/cards/global_mmlu/de/global_facts.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/de 2026-01-06T13:30:31,405 copying build/lib/unitxt/catalog/cards/global_mmlu/de/miscellaneous.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/de 2026-01-06T13:30:31,407 copying build/lib/unitxt/catalog/cards/global_mmlu/de/clinical_knowledge.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/de 2026-01-06T13:30:31,409 copying build/lib/unitxt/catalog/cards/global_mmlu/de/high_school_biology.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/de 2026-01-06T13:30:31,412 copying build/lib/unitxt/catalog/cards/global_mmlu/de/prehistory.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/de 2026-01-06T13:30:31,414 copying build/lib/unitxt/catalog/cards/global_mmlu/de/high_school_us_history.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/de 2026-01-06T13:30:31,416 copying build/lib/unitxt/catalog/cards/global_mmlu/de/international_law.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/de 2026-01-06T13:30:31,418 copying build/lib/unitxt/catalog/cards/global_mmlu/de/college_computer_science.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/de 2026-01-06T13:30:31,420 copying build/lib/unitxt/catalog/cards/global_mmlu/de/astronomy.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/de 2026-01-06T13:30:31,423 copying build/lib/unitxt/catalog/cards/global_mmlu/de/high_school_european_history.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/de 2026-01-06T13:30:31,425 copying build/lib/unitxt/catalog/cards/global_mmlu/de/electrical_engineering.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/de 2026-01-06T13:30:31,427 copying build/lib/unitxt/catalog/cards/global_mmlu/de/nutrition.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/de 2026-01-06T13:30:31,429 copying build/lib/unitxt/catalog/cards/global_mmlu/de/abstract_algebra.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/de 2026-01-06T13:30:31,432 copying build/lib/unitxt/catalog/cards/global_mmlu/de/professional_medicine.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/de 2026-01-06T13:30:31,434 copying build/lib/unitxt/catalog/cards/global_mmlu/de/human_sexuality.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/de 2026-01-06T13:30:31,436 copying build/lib/unitxt/catalog/cards/global_mmlu/de/business_ethics.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/de 2026-01-06T13:30:31,439 copying build/lib/unitxt/catalog/cards/global_mmlu/de/high_school_chemistry.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/de 2026-01-06T13:30:31,441 copying build/lib/unitxt/catalog/cards/global_mmlu/de/logical_fallacies.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/de 2026-01-06T13:30:31,443 copying build/lib/unitxt/catalog/cards/global_mmlu/de/formal_logic.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/de 2026-01-06T13:30:31,446 copying build/lib/unitxt/catalog/cards/global_mmlu/de/high_school_psychology.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/de 2026-01-06T13:30:31,448 copying build/lib/unitxt/catalog/cards/global_mmlu/de/medical_genetics.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/de 2026-01-06T13:30:31,450 copying build/lib/unitxt/catalog/cards/global_mmlu/de/security_studies.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/de 2026-01-06T13:30:31,452 copying build/lib/unitxt/catalog/cards/global_mmlu/de/high_school_macroeconomics.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/de 2026-01-06T13:30:31,455 copying build/lib/unitxt/catalog/cards/global_mmlu/de/professional_law.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/de 2026-01-06T13:30:31,457 copying build/lib/unitxt/catalog/cards/global_mmlu/de/high_school_physics.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/de 2026-01-06T13:30:31,459 copying build/lib/unitxt/catalog/cards/global_mmlu/de/econometrics.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/de 2026-01-06T13:30:31,461 copying build/lib/unitxt/catalog/cards/global_mmlu/de/sociology.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/de 2026-01-06T13:30:31,463 copying build/lib/unitxt/catalog/cards/global_mmlu/de/moral_disputes.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/de 2026-01-06T13:30:31,465 copying build/lib/unitxt/catalog/cards/global_mmlu/de/college_chemistry.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/de 2026-01-06T13:30:31,468 copying build/lib/unitxt/catalog/cards/global_mmlu/de/high_school_geography.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/de 2026-01-06T13:30:31,470 copying build/lib/unitxt/catalog/cards/global_mmlu/de/jurisprudence.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/de 2026-01-06T13:30:31,472 copying build/lib/unitxt/catalog/cards/global_mmlu/de/high_school_statistics.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/de 2026-01-06T13:30:31,475 copying build/lib/unitxt/catalog/cards/global_mmlu/de/professional_accounting.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/de 2026-01-06T13:30:31,477 copying build/lib/unitxt/catalog/cards/global_mmlu/de/us_foreign_policy.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/de 2026-01-06T13:30:31,479 copying build/lib/unitxt/catalog/cards/global_mmlu/de/professional_psychology.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/de 2026-01-06T13:30:31,481 copying build/lib/unitxt/catalog/cards/global_mmlu/de/public_relations.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/de 2026-01-06T13:30:31,483 copying build/lib/unitxt/catalog/cards/global_mmlu/de/computer_security.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/de 2026-01-06T13:30:31,486 copying build/lib/unitxt/catalog/cards/global_mmlu/de/philosophy.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/de 2026-01-06T13:30:31,488 copying build/lib/unitxt/catalog/cards/global_mmlu/de/virology.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/de 2026-01-06T13:30:31,490 copying build/lib/unitxt/catalog/cards/global_mmlu/de/marketing.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/de 2026-01-06T13:30:31,492 copying build/lib/unitxt/catalog/cards/global_mmlu/de/high_school_world_history.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/de 2026-01-06T13:30:31,495 copying build/lib/unitxt/catalog/cards/global_mmlu/de/machine_learning.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/de 2026-01-06T13:30:31,497 copying build/lib/unitxt/catalog/cards/global_mmlu/de/high_school_government_and_politics.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/de 2026-01-06T13:30:31,499 copying build/lib/unitxt/catalog/cards/global_mmlu/de/conceptual_physics.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/de 2026-01-06T13:30:31,502 copying build/lib/unitxt/catalog/cards/global_mmlu/de/college_biology.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/de 2026-01-06T13:30:31,504 copying build/lib/unitxt/catalog/cards/global_mmlu/de/high_school_mathematics.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/de 2026-01-06T13:30:31,507 creating build/bdist.linux-armv7l/wheel/unitxt/catalog/cards/global_mmlu/pl 2026-01-06T13:30:31,508 copying build/lib/unitxt/catalog/cards/global_mmlu/pl/elementary_mathematics.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/pl 2026-01-06T13:30:31,510 copying build/lib/unitxt/catalog/cards/global_mmlu/pl/human_aging.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/pl 2026-01-06T13:30:31,512 copying build/lib/unitxt/catalog/cards/global_mmlu/pl/high_school_computer_science.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/pl 2026-01-06T13:30:31,514 copying build/lib/unitxt/catalog/cards/global_mmlu/pl/college_physics.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/pl 2026-01-06T13:30:31,515 copying build/lib/unitxt/catalog/cards/global_mmlu/pl/college_medicine.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/pl 2026-01-06T13:30:31,517 copying build/lib/unitxt/catalog/cards/global_mmlu/pl/college_mathematics.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/pl 2026-01-06T13:30:31,519 copying build/lib/unitxt/catalog/cards/global_mmlu/pl/high_school_microeconomics.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/pl 2026-01-06T13:30:31,521 copying build/lib/unitxt/catalog/cards/global_mmlu/pl/anatomy.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/pl 2026-01-06T13:30:31,523 copying build/lib/unitxt/catalog/cards/global_mmlu/pl/world_religions.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/pl 2026-01-06T13:30:31,524 copying build/lib/unitxt/catalog/cards/global_mmlu/pl/management.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/pl 2026-01-06T13:30:31,526 copying build/lib/unitxt/catalog/cards/global_mmlu/pl/moral_scenarios.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/pl 2026-01-06T13:30:31,528 copying build/lib/unitxt/catalog/cards/global_mmlu/pl/global_facts.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/pl 2026-01-06T13:30:31,530 copying build/lib/unitxt/catalog/cards/global_mmlu/pl/miscellaneous.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/pl 2026-01-06T13:30:31,532 copying build/lib/unitxt/catalog/cards/global_mmlu/pl/clinical_knowledge.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/pl 2026-01-06T13:30:31,534 copying build/lib/unitxt/catalog/cards/global_mmlu/pl/high_school_biology.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/pl 2026-01-06T13:30:31,536 copying build/lib/unitxt/catalog/cards/global_mmlu/pl/prehistory.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/pl 2026-01-06T13:30:31,538 copying build/lib/unitxt/catalog/cards/global_mmlu/pl/high_school_us_history.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/pl 2026-01-06T13:30:31,540 copying build/lib/unitxt/catalog/cards/global_mmlu/pl/international_law.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/pl 2026-01-06T13:30:31,542 copying build/lib/unitxt/catalog/cards/global_mmlu/pl/college_computer_science.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/pl 2026-01-06T13:30:31,544 copying build/lib/unitxt/catalog/cards/global_mmlu/pl/astronomy.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/pl 2026-01-06T13:30:31,545 copying build/lib/unitxt/catalog/cards/global_mmlu/pl/high_school_european_history.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/pl 2026-01-06T13:30:31,547 copying build/lib/unitxt/catalog/cards/global_mmlu/pl/electrical_engineering.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/pl 2026-01-06T13:30:31,549 copying build/lib/unitxt/catalog/cards/global_mmlu/pl/nutrition.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/pl 2026-01-06T13:30:31,551 copying build/lib/unitxt/catalog/cards/global_mmlu/pl/abstract_algebra.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/pl 2026-01-06T13:30:31,553 copying build/lib/unitxt/catalog/cards/global_mmlu/pl/professional_medicine.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/pl 2026-01-06T13:30:31,555 copying build/lib/unitxt/catalog/cards/global_mmlu/pl/human_sexuality.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/pl 2026-01-06T13:30:31,557 copying build/lib/unitxt/catalog/cards/global_mmlu/pl/business_ethics.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/pl 2026-01-06T13:30:31,559 copying build/lib/unitxt/catalog/cards/global_mmlu/pl/high_school_chemistry.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/pl 2026-01-06T13:30:31,561 copying build/lib/unitxt/catalog/cards/global_mmlu/pl/logical_fallacies.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/pl 2026-01-06T13:30:31,563 copying build/lib/unitxt/catalog/cards/global_mmlu/pl/formal_logic.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/pl 2026-01-06T13:30:31,565 copying build/lib/unitxt/catalog/cards/global_mmlu/pl/high_school_psychology.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/pl 2026-01-06T13:30:31,566 copying build/lib/unitxt/catalog/cards/global_mmlu/pl/medical_genetics.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/pl 2026-01-06T13:30:31,568 copying build/lib/unitxt/catalog/cards/global_mmlu/pl/security_studies.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/pl 2026-01-06T13:30:31,570 copying build/lib/unitxt/catalog/cards/global_mmlu/pl/high_school_macroeconomics.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/pl 2026-01-06T13:30:31,572 copying build/lib/unitxt/catalog/cards/global_mmlu/pl/professional_law.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/pl 2026-01-06T13:30:31,574 copying build/lib/unitxt/catalog/cards/global_mmlu/pl/high_school_physics.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/pl 2026-01-06T13:30:31,576 copying build/lib/unitxt/catalog/cards/global_mmlu/pl/econometrics.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/pl 2026-01-06T13:30:31,578 copying build/lib/unitxt/catalog/cards/global_mmlu/pl/sociology.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/pl 2026-01-06T13:30:31,580 copying build/lib/unitxt/catalog/cards/global_mmlu/pl/moral_disputes.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/pl 2026-01-06T13:30:31,581 copying build/lib/unitxt/catalog/cards/global_mmlu/pl/college_chemistry.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/pl 2026-01-06T13:30:31,583 copying build/lib/unitxt/catalog/cards/global_mmlu/pl/high_school_geography.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/pl 2026-01-06T13:30:31,585 copying build/lib/unitxt/catalog/cards/global_mmlu/pl/jurisprudence.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/pl 2026-01-06T13:30:31,587 copying build/lib/unitxt/catalog/cards/global_mmlu/pl/high_school_statistics.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/pl 2026-01-06T13:30:31,589 copying build/lib/unitxt/catalog/cards/global_mmlu/pl/professional_accounting.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/pl 2026-01-06T13:30:31,591 copying build/lib/unitxt/catalog/cards/global_mmlu/pl/us_foreign_policy.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/pl 2026-01-06T13:30:31,593 copying build/lib/unitxt/catalog/cards/global_mmlu/pl/professional_psychology.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/pl 2026-01-06T13:30:31,595 copying build/lib/unitxt/catalog/cards/global_mmlu/pl/public_relations.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/pl 2026-01-06T13:30:31,597 copying build/lib/unitxt/catalog/cards/global_mmlu/pl/computer_security.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/pl 2026-01-06T13:30:31,599 copying build/lib/unitxt/catalog/cards/global_mmlu/pl/philosophy.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/pl 2026-01-06T13:30:31,600 copying build/lib/unitxt/catalog/cards/global_mmlu/pl/virology.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/pl 2026-01-06T13:30:31,602 copying build/lib/unitxt/catalog/cards/global_mmlu/pl/marketing.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/pl 2026-01-06T13:30:31,604 copying build/lib/unitxt/catalog/cards/global_mmlu/pl/high_school_world_history.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/pl 2026-01-06T13:30:31,606 copying build/lib/unitxt/catalog/cards/global_mmlu/pl/machine_learning.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/pl 2026-01-06T13:30:31,608 copying build/lib/unitxt/catalog/cards/global_mmlu/pl/high_school_government_and_politics.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/pl 2026-01-06T13:30:31,610 copying build/lib/unitxt/catalog/cards/global_mmlu/pl/conceptual_physics.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/pl 2026-01-06T13:30:31,612 copying build/lib/unitxt/catalog/cards/global_mmlu/pl/college_biology.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/pl 2026-01-06T13:30:31,614 copying build/lib/unitxt/catalog/cards/global_mmlu/pl/high_school_mathematics.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/pl 2026-01-06T13:30:31,617 creating build/bdist.linux-armv7l/wheel/unitxt/catalog/cards/global_mmlu/ja 2026-01-06T13:30:31,618 copying build/lib/unitxt/catalog/cards/global_mmlu/ja/elementary_mathematics.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/ja 2026-01-06T13:30:31,620 copying build/lib/unitxt/catalog/cards/global_mmlu/ja/human_aging.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/ja 2026-01-06T13:30:31,622 copying build/lib/unitxt/catalog/cards/global_mmlu/ja/high_school_computer_science.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/ja 2026-01-06T13:30:31,623 copying build/lib/unitxt/catalog/cards/global_mmlu/ja/college_physics.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/ja 2026-01-06T13:30:31,625 copying build/lib/unitxt/catalog/cards/global_mmlu/ja/college_medicine.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/ja 2026-01-06T13:30:31,627 copying build/lib/unitxt/catalog/cards/global_mmlu/ja/college_mathematics.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/ja 2026-01-06T13:30:31,629 copying build/lib/unitxt/catalog/cards/global_mmlu/ja/high_school_microeconomics.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/ja 2026-01-06T13:30:31,631 copying build/lib/unitxt/catalog/cards/global_mmlu/ja/anatomy.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/ja 2026-01-06T13:30:31,633 copying build/lib/unitxt/catalog/cards/global_mmlu/ja/world_religions.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/ja 2026-01-06T13:30:31,635 copying build/lib/unitxt/catalog/cards/global_mmlu/ja/management.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/ja 2026-01-06T13:30:31,637 copying build/lib/unitxt/catalog/cards/global_mmlu/ja/moral_scenarios.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/ja 2026-01-06T13:30:31,639 copying build/lib/unitxt/catalog/cards/global_mmlu/ja/global_facts.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/ja 2026-01-06T13:30:31,640 copying build/lib/unitxt/catalog/cards/global_mmlu/ja/miscellaneous.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/ja 2026-01-06T13:30:31,642 copying build/lib/unitxt/catalog/cards/global_mmlu/ja/clinical_knowledge.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/ja 2026-01-06T13:30:31,644 copying build/lib/unitxt/catalog/cards/global_mmlu/ja/high_school_biology.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/ja 2026-01-06T13:30:31,646 copying build/lib/unitxt/catalog/cards/global_mmlu/ja/prehistory.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/ja 2026-01-06T13:30:31,648 copying build/lib/unitxt/catalog/cards/global_mmlu/ja/high_school_us_history.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/ja 2026-01-06T13:30:31,650 copying build/lib/unitxt/catalog/cards/global_mmlu/ja/international_law.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/ja 2026-01-06T13:30:31,651 copying build/lib/unitxt/catalog/cards/global_mmlu/ja/college_computer_science.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/ja 2026-01-06T13:30:31,653 copying build/lib/unitxt/catalog/cards/global_mmlu/ja/astronomy.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/ja 2026-01-06T13:30:31,655 copying build/lib/unitxt/catalog/cards/global_mmlu/ja/high_school_european_history.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/ja 2026-01-06T13:30:31,657 copying build/lib/unitxt/catalog/cards/global_mmlu/ja/electrical_engineering.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/ja 2026-01-06T13:30:31,659 copying build/lib/unitxt/catalog/cards/global_mmlu/ja/nutrition.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/ja 2026-01-06T13:30:31,661 copying build/lib/unitxt/catalog/cards/global_mmlu/ja/abstract_algebra.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/ja 2026-01-06T13:30:31,662 copying build/lib/unitxt/catalog/cards/global_mmlu/ja/professional_medicine.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/ja 2026-01-06T13:30:31,664 copying build/lib/unitxt/catalog/cards/global_mmlu/ja/human_sexuality.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/ja 2026-01-06T13:30:31,666 copying build/lib/unitxt/catalog/cards/global_mmlu/ja/business_ethics.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/ja 2026-01-06T13:30:31,668 copying build/lib/unitxt/catalog/cards/global_mmlu/ja/high_school_chemistry.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/ja 2026-01-06T13:30:31,670 copying build/lib/unitxt/catalog/cards/global_mmlu/ja/logical_fallacies.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/ja 2026-01-06T13:30:31,672 copying build/lib/unitxt/catalog/cards/global_mmlu/ja/formal_logic.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/ja 2026-01-06T13:30:31,674 copying build/lib/unitxt/catalog/cards/global_mmlu/ja/high_school_psychology.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/ja 2026-01-06T13:30:31,676 copying build/lib/unitxt/catalog/cards/global_mmlu/ja/medical_genetics.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/ja 2026-01-06T13:30:31,678 copying build/lib/unitxt/catalog/cards/global_mmlu/ja/security_studies.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/ja 2026-01-06T13:30:31,680 copying build/lib/unitxt/catalog/cards/global_mmlu/ja/high_school_macroeconomics.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/ja 2026-01-06T13:30:31,682 copying build/lib/unitxt/catalog/cards/global_mmlu/ja/professional_law.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/ja 2026-01-06T13:30:31,683 copying build/lib/unitxt/catalog/cards/global_mmlu/ja/high_school_physics.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/ja 2026-01-06T13:30:31,685 copying build/lib/unitxt/catalog/cards/global_mmlu/ja/econometrics.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/ja 2026-01-06T13:30:31,687 copying build/lib/unitxt/catalog/cards/global_mmlu/ja/sociology.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/ja 2026-01-06T13:30:31,689 copying build/lib/unitxt/catalog/cards/global_mmlu/ja/moral_disputes.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/ja 2026-01-06T13:30:31,691 copying build/lib/unitxt/catalog/cards/global_mmlu/ja/college_chemistry.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/ja 2026-01-06T13:30:31,692 copying build/lib/unitxt/catalog/cards/global_mmlu/ja/high_school_geography.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/ja 2026-01-06T13:30:31,694 copying build/lib/unitxt/catalog/cards/global_mmlu/ja/jurisprudence.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/ja 2026-01-06T13:30:31,696 copying build/lib/unitxt/catalog/cards/global_mmlu/ja/high_school_statistics.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/ja 2026-01-06T13:30:31,698 copying build/lib/unitxt/catalog/cards/global_mmlu/ja/professional_accounting.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/ja 2026-01-06T13:30:31,699 copying build/lib/unitxt/catalog/cards/global_mmlu/ja/us_foreign_policy.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/ja 2026-01-06T13:30:31,701 copying build/lib/unitxt/catalog/cards/global_mmlu/ja/professional_psychology.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/ja 2026-01-06T13:30:31,703 copying build/lib/unitxt/catalog/cards/global_mmlu/ja/public_relations.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/ja 2026-01-06T13:30:31,705 copying build/lib/unitxt/catalog/cards/global_mmlu/ja/computer_security.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/ja 2026-01-06T13:30:31,707 copying build/lib/unitxt/catalog/cards/global_mmlu/ja/philosophy.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/ja 2026-01-06T13:30:31,709 copying build/lib/unitxt/catalog/cards/global_mmlu/ja/virology.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/ja 2026-01-06T13:30:31,711 copying build/lib/unitxt/catalog/cards/global_mmlu/ja/marketing.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/ja 2026-01-06T13:30:31,713 copying build/lib/unitxt/catalog/cards/global_mmlu/ja/high_school_world_history.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/ja 2026-01-06T13:30:31,715 copying build/lib/unitxt/catalog/cards/global_mmlu/ja/machine_learning.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/ja 2026-01-06T13:30:31,716 copying build/lib/unitxt/catalog/cards/global_mmlu/ja/high_school_government_and_politics.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/ja 2026-01-06T13:30:31,718 copying build/lib/unitxt/catalog/cards/global_mmlu/ja/conceptual_physics.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/ja 2026-01-06T13:30:31,720 copying build/lib/unitxt/catalog/cards/global_mmlu/ja/college_biology.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/ja 2026-01-06T13:30:31,722 copying build/lib/unitxt/catalog/cards/global_mmlu/ja/high_school_mathematics.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/ja 2026-01-06T13:30:31,725 creating build/bdist.linux-armv7l/wheel/unitxt/catalog/cards/global_mmlu/mg 2026-01-06T13:30:31,726 copying build/lib/unitxt/catalog/cards/global_mmlu/mg/elementary_mathematics.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/mg 2026-01-06T13:30:31,728 copying build/lib/unitxt/catalog/cards/global_mmlu/mg/human_aging.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/mg 2026-01-06T13:30:31,730 copying build/lib/unitxt/catalog/cards/global_mmlu/mg/high_school_computer_science.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/mg 2026-01-06T13:30:31,732 copying build/lib/unitxt/catalog/cards/global_mmlu/mg/college_physics.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/mg 2026-01-06T13:30:31,733 copying build/lib/unitxt/catalog/cards/global_mmlu/mg/college_medicine.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/mg 2026-01-06T13:30:31,735 copying build/lib/unitxt/catalog/cards/global_mmlu/mg/college_mathematics.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/mg 2026-01-06T13:30:31,737 copying build/lib/unitxt/catalog/cards/global_mmlu/mg/high_school_microeconomics.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/mg 2026-01-06T13:30:31,739 copying build/lib/unitxt/catalog/cards/global_mmlu/mg/anatomy.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/mg 2026-01-06T13:30:31,740 copying build/lib/unitxt/catalog/cards/global_mmlu/mg/world_religions.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/mg 2026-01-06T13:30:31,742 copying build/lib/unitxt/catalog/cards/global_mmlu/mg/management.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/mg 2026-01-06T13:30:31,744 copying build/lib/unitxt/catalog/cards/global_mmlu/mg/moral_scenarios.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/mg 2026-01-06T13:30:31,746 copying build/lib/unitxt/catalog/cards/global_mmlu/mg/global_facts.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/mg 2026-01-06T13:30:31,748 copying build/lib/unitxt/catalog/cards/global_mmlu/mg/miscellaneous.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/mg 2026-01-06T13:30:31,750 copying build/lib/unitxt/catalog/cards/global_mmlu/mg/clinical_knowledge.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/mg 2026-01-06T13:30:31,751 copying build/lib/unitxt/catalog/cards/global_mmlu/mg/high_school_biology.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/mg 2026-01-06T13:30:31,753 copying build/lib/unitxt/catalog/cards/global_mmlu/mg/prehistory.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/mg 2026-01-06T13:30:31,755 copying build/lib/unitxt/catalog/cards/global_mmlu/mg/high_school_us_history.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/mg 2026-01-06T13:30:31,757 copying build/lib/unitxt/catalog/cards/global_mmlu/mg/international_law.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/mg 2026-01-06T13:30:31,759 copying build/lib/unitxt/catalog/cards/global_mmlu/mg/college_computer_science.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/mg 2026-01-06T13:30:31,761 copying build/lib/unitxt/catalog/cards/global_mmlu/mg/astronomy.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/mg 2026-01-06T13:30:31,762 copying build/lib/unitxt/catalog/cards/global_mmlu/mg/high_school_european_history.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/mg 2026-01-06T13:30:31,764 copying build/lib/unitxt/catalog/cards/global_mmlu/mg/electrical_engineering.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/mg 2026-01-06T13:30:31,766 copying build/lib/unitxt/catalog/cards/global_mmlu/mg/nutrition.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/mg 2026-01-06T13:30:31,768 copying build/lib/unitxt/catalog/cards/global_mmlu/mg/abstract_algebra.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/mg 2026-01-06T13:30:31,770 copying build/lib/unitxt/catalog/cards/global_mmlu/mg/professional_medicine.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/mg 2026-01-06T13:30:31,772 copying build/lib/unitxt/catalog/cards/global_mmlu/mg/human_sexuality.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/mg 2026-01-06T13:30:31,774 copying build/lib/unitxt/catalog/cards/global_mmlu/mg/business_ethics.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/mg 2026-01-06T13:30:31,775 copying build/lib/unitxt/catalog/cards/global_mmlu/mg/high_school_chemistry.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/mg 2026-01-06T13:30:31,777 copying build/lib/unitxt/catalog/cards/global_mmlu/mg/logical_fallacies.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/mg 2026-01-06T13:30:31,779 copying build/lib/unitxt/catalog/cards/global_mmlu/mg/formal_logic.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/mg 2026-01-06T13:30:31,781 copying build/lib/unitxt/catalog/cards/global_mmlu/mg/high_school_psychology.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/mg 2026-01-06T13:30:31,783 copying build/lib/unitxt/catalog/cards/global_mmlu/mg/medical_genetics.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/mg 2026-01-06T13:30:31,784 copying build/lib/unitxt/catalog/cards/global_mmlu/mg/security_studies.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/mg 2026-01-06T13:30:31,786 copying build/lib/unitxt/catalog/cards/global_mmlu/mg/high_school_macroeconomics.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/mg 2026-01-06T13:30:31,788 copying build/lib/unitxt/catalog/cards/global_mmlu/mg/professional_law.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/mg 2026-01-06T13:30:31,790 copying build/lib/unitxt/catalog/cards/global_mmlu/mg/high_school_physics.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/mg 2026-01-06T13:30:31,792 copying build/lib/unitxt/catalog/cards/global_mmlu/mg/econometrics.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/mg 2026-01-06T13:30:31,794 copying build/lib/unitxt/catalog/cards/global_mmlu/mg/sociology.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/mg 2026-01-06T13:30:31,795 copying build/lib/unitxt/catalog/cards/global_mmlu/mg/moral_disputes.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/mg 2026-01-06T13:30:31,797 copying build/lib/unitxt/catalog/cards/global_mmlu/mg/college_chemistry.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/mg 2026-01-06T13:30:31,799 copying build/lib/unitxt/catalog/cards/global_mmlu/mg/high_school_geography.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/mg 2026-01-06T13:30:31,801 copying build/lib/unitxt/catalog/cards/global_mmlu/mg/jurisprudence.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/mg 2026-01-06T13:30:31,803 copying build/lib/unitxt/catalog/cards/global_mmlu/mg/high_school_statistics.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/mg 2026-01-06T13:30:31,805 copying build/lib/unitxt/catalog/cards/global_mmlu/mg/professional_accounting.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/mg 2026-01-06T13:30:31,807 copying build/lib/unitxt/catalog/cards/global_mmlu/mg/us_foreign_policy.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/mg 2026-01-06T13:30:31,809 copying build/lib/unitxt/catalog/cards/global_mmlu/mg/professional_psychology.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/mg 2026-01-06T13:30:31,811 copying build/lib/unitxt/catalog/cards/global_mmlu/mg/public_relations.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/mg 2026-01-06T13:30:31,812 copying build/lib/unitxt/catalog/cards/global_mmlu/mg/computer_security.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/mg 2026-01-06T13:30:31,814 copying build/lib/unitxt/catalog/cards/global_mmlu/mg/philosophy.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/mg 2026-01-06T13:30:31,817 copying build/lib/unitxt/catalog/cards/global_mmlu/mg/virology.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/mg 2026-01-06T13:30:31,818 copying build/lib/unitxt/catalog/cards/global_mmlu/mg/marketing.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/mg 2026-01-06T13:30:31,820 copying build/lib/unitxt/catalog/cards/global_mmlu/mg/high_school_world_history.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/mg 2026-01-06T13:30:31,822 copying build/lib/unitxt/catalog/cards/global_mmlu/mg/machine_learning.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/mg 2026-01-06T13:30:31,824 copying build/lib/unitxt/catalog/cards/global_mmlu/mg/high_school_government_and_politics.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/mg 2026-01-06T13:30:31,826 copying build/lib/unitxt/catalog/cards/global_mmlu/mg/conceptual_physics.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/mg 2026-01-06T13:30:31,828 copying build/lib/unitxt/catalog/cards/global_mmlu/mg/college_biology.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/mg 2026-01-06T13:30:31,830 copying build/lib/unitxt/catalog/cards/global_mmlu/mg/high_school_mathematics.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/mg 2026-01-06T13:30:31,833 creating build/bdist.linux-armv7l/wheel/unitxt/catalog/cards/global_mmlu/fil 2026-01-06T13:30:31,834 copying build/lib/unitxt/catalog/cards/global_mmlu/fil/elementary_mathematics.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/fil 2026-01-06T13:30:31,836 copying build/lib/unitxt/catalog/cards/global_mmlu/fil/human_aging.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/fil 2026-01-06T13:30:31,838 copying build/lib/unitxt/catalog/cards/global_mmlu/fil/high_school_computer_science.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/fil 2026-01-06T13:30:31,840 copying build/lib/unitxt/catalog/cards/global_mmlu/fil/college_physics.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/fil 2026-01-06T13:30:31,842 copying build/lib/unitxt/catalog/cards/global_mmlu/fil/college_medicine.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/fil 2026-01-06T13:30:31,843 copying build/lib/unitxt/catalog/cards/global_mmlu/fil/college_mathematics.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/fil 2026-01-06T13:30:31,845 copying build/lib/unitxt/catalog/cards/global_mmlu/fil/high_school_microeconomics.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/fil 2026-01-06T13:30:31,847 copying build/lib/unitxt/catalog/cards/global_mmlu/fil/anatomy.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/fil 2026-01-06T13:30:31,849 copying build/lib/unitxt/catalog/cards/global_mmlu/fil/world_religions.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/fil 2026-01-06T13:30:31,851 copying build/lib/unitxt/catalog/cards/global_mmlu/fil/management.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/fil 2026-01-06T13:30:31,852 copying build/lib/unitxt/catalog/cards/global_mmlu/fil/moral_scenarios.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/fil 2026-01-06T13:30:31,854 copying build/lib/unitxt/catalog/cards/global_mmlu/fil/global_facts.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/fil 2026-01-06T13:30:31,856 copying build/lib/unitxt/catalog/cards/global_mmlu/fil/miscellaneous.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/fil 2026-01-06T13:30:31,858 copying build/lib/unitxt/catalog/cards/global_mmlu/fil/clinical_knowledge.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/fil 2026-01-06T13:30:31,860 copying build/lib/unitxt/catalog/cards/global_mmlu/fil/high_school_biology.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/fil 2026-01-06T13:30:31,862 copying build/lib/unitxt/catalog/cards/global_mmlu/fil/prehistory.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/fil 2026-01-06T13:30:31,864 copying build/lib/unitxt/catalog/cards/global_mmlu/fil/high_school_us_history.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/fil 2026-01-06T13:30:31,865 copying build/lib/unitxt/catalog/cards/global_mmlu/fil/international_law.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/fil 2026-01-06T13:30:31,867 copying build/lib/unitxt/catalog/cards/global_mmlu/fil/college_computer_science.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/fil 2026-01-06T13:30:31,869 copying build/lib/unitxt/catalog/cards/global_mmlu/fil/astronomy.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/fil 2026-01-06T13:30:31,871 copying build/lib/unitxt/catalog/cards/global_mmlu/fil/high_school_european_history.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/fil 2026-01-06T13:30:31,873 copying build/lib/unitxt/catalog/cards/global_mmlu/fil/electrical_engineering.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/fil 2026-01-06T13:30:31,874 copying build/lib/unitxt/catalog/cards/global_mmlu/fil/nutrition.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/fil 2026-01-06T13:30:31,876 copying build/lib/unitxt/catalog/cards/global_mmlu/fil/abstract_algebra.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/fil 2026-01-06T13:30:31,879 copying build/lib/unitxt/catalog/cards/global_mmlu/fil/professional_medicine.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/fil 2026-01-06T13:30:31,880 copying build/lib/unitxt/catalog/cards/global_mmlu/fil/human_sexuality.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/fil 2026-01-06T13:30:31,882 copying build/lib/unitxt/catalog/cards/global_mmlu/fil/business_ethics.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/fil 2026-01-06T13:30:31,884 copying build/lib/unitxt/catalog/cards/global_mmlu/fil/high_school_chemistry.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/fil 2026-01-06T13:30:31,886 copying build/lib/unitxt/catalog/cards/global_mmlu/fil/logical_fallacies.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/fil 2026-01-06T13:30:31,888 copying build/lib/unitxt/catalog/cards/global_mmlu/fil/formal_logic.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/fil 2026-01-06T13:30:31,890 copying build/lib/unitxt/catalog/cards/global_mmlu/fil/high_school_psychology.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/fil 2026-01-06T13:30:31,892 copying build/lib/unitxt/catalog/cards/global_mmlu/fil/medical_genetics.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/fil 2026-01-06T13:30:31,894 copying build/lib/unitxt/catalog/cards/global_mmlu/fil/security_studies.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/fil 2026-01-06T13:30:31,895 copying build/lib/unitxt/catalog/cards/global_mmlu/fil/high_school_macroeconomics.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/fil 2026-01-06T13:30:31,897 copying build/lib/unitxt/catalog/cards/global_mmlu/fil/professional_law.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/fil 2026-01-06T13:30:31,899 copying build/lib/unitxt/catalog/cards/global_mmlu/fil/high_school_physics.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/fil 2026-01-06T13:30:31,901 copying build/lib/unitxt/catalog/cards/global_mmlu/fil/econometrics.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/fil 2026-01-06T13:30:31,903 copying build/lib/unitxt/catalog/cards/global_mmlu/fil/sociology.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/fil 2026-01-06T13:30:31,905 copying build/lib/unitxt/catalog/cards/global_mmlu/fil/moral_disputes.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/fil 2026-01-06T13:30:31,907 copying build/lib/unitxt/catalog/cards/global_mmlu/fil/college_chemistry.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/fil 2026-01-06T13:30:31,909 copying build/lib/unitxt/catalog/cards/global_mmlu/fil/high_school_geography.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/fil 2026-01-06T13:30:31,910 copying build/lib/unitxt/catalog/cards/global_mmlu/fil/jurisprudence.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/fil 2026-01-06T13:30:31,912 copying build/lib/unitxt/catalog/cards/global_mmlu/fil/high_school_statistics.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/fil 2026-01-06T13:30:31,914 copying build/lib/unitxt/catalog/cards/global_mmlu/fil/professional_accounting.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/fil 2026-01-06T13:30:31,916 copying build/lib/unitxt/catalog/cards/global_mmlu/fil/us_foreign_policy.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/fil 2026-01-06T13:30:31,917 copying build/lib/unitxt/catalog/cards/global_mmlu/fil/professional_psychology.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/fil 2026-01-06T13:30:31,919 copying build/lib/unitxt/catalog/cards/global_mmlu/fil/public_relations.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/fil 2026-01-06T13:30:31,921 copying build/lib/unitxt/catalog/cards/global_mmlu/fil/computer_security.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/fil 2026-01-06T13:30:31,923 copying build/lib/unitxt/catalog/cards/global_mmlu/fil/philosophy.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/fil 2026-01-06T13:30:31,925 copying build/lib/unitxt/catalog/cards/global_mmlu/fil/virology.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/fil 2026-01-06T13:30:31,927 copying build/lib/unitxt/catalog/cards/global_mmlu/fil/marketing.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/fil 2026-01-06T13:30:31,929 copying build/lib/unitxt/catalog/cards/global_mmlu/fil/high_school_world_history.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/fil 2026-01-06T13:30:31,931 copying build/lib/unitxt/catalog/cards/global_mmlu/fil/machine_learning.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/fil 2026-01-06T13:30:31,932 copying build/lib/unitxt/catalog/cards/global_mmlu/fil/high_school_government_and_politics.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/fil 2026-01-06T13:30:31,934 copying build/lib/unitxt/catalog/cards/global_mmlu/fil/conceptual_physics.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/fil 2026-01-06T13:30:31,936 copying build/lib/unitxt/catalog/cards/global_mmlu/fil/college_biology.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/fil 2026-01-06T13:30:31,938 copying build/lib/unitxt/catalog/cards/global_mmlu/fil/high_school_mathematics.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/fil 2026-01-06T13:30:31,941 creating build/bdist.linux-armv7l/wheel/unitxt/catalog/cards/global_mmlu/ar 2026-01-06T13:30:31,942 copying build/lib/unitxt/catalog/cards/global_mmlu/ar/elementary_mathematics.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/ar 2026-01-06T13:30:31,944 copying build/lib/unitxt/catalog/cards/global_mmlu/ar/human_aging.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/ar 2026-01-06T13:30:31,946 copying build/lib/unitxt/catalog/cards/global_mmlu/ar/high_school_computer_science.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/ar 2026-01-06T13:30:31,948 copying build/lib/unitxt/catalog/cards/global_mmlu/ar/college_physics.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/ar 2026-01-06T13:30:31,950 copying build/lib/unitxt/catalog/cards/global_mmlu/ar/college_medicine.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/ar 2026-01-06T13:30:31,952 copying build/lib/unitxt/catalog/cards/global_mmlu/ar/college_mathematics.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/ar 2026-01-06T13:30:31,954 copying build/lib/unitxt/catalog/cards/global_mmlu/ar/high_school_microeconomics.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/ar 2026-01-06T13:30:31,955 copying build/lib/unitxt/catalog/cards/global_mmlu/ar/anatomy.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/ar 2026-01-06T13:30:31,957 copying build/lib/unitxt/catalog/cards/global_mmlu/ar/world_religions.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/ar 2026-01-06T13:30:31,959 copying build/lib/unitxt/catalog/cards/global_mmlu/ar/management.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/ar 2026-01-06T13:30:31,961 copying build/lib/unitxt/catalog/cards/global_mmlu/ar/moral_scenarios.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/ar 2026-01-06T13:30:31,963 copying build/lib/unitxt/catalog/cards/global_mmlu/ar/global_facts.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/ar 2026-01-06T13:30:31,965 copying build/lib/unitxt/catalog/cards/global_mmlu/ar/miscellaneous.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/ar 2026-01-06T13:30:31,967 copying build/lib/unitxt/catalog/cards/global_mmlu/ar/clinical_knowledge.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/ar 2026-01-06T13:30:31,969 copying build/lib/unitxt/catalog/cards/global_mmlu/ar/high_school_biology.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/ar 2026-01-06T13:30:31,971 copying build/lib/unitxt/catalog/cards/global_mmlu/ar/prehistory.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/ar 2026-01-06T13:30:31,972 copying build/lib/unitxt/catalog/cards/global_mmlu/ar/high_school_us_history.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/ar 2026-01-06T13:30:31,974 copying build/lib/unitxt/catalog/cards/global_mmlu/ar/international_law.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/ar 2026-01-06T13:30:31,976 copying build/lib/unitxt/catalog/cards/global_mmlu/ar/college_computer_science.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/ar 2026-01-06T13:30:31,978 copying build/lib/unitxt/catalog/cards/global_mmlu/ar/astronomy.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/ar 2026-01-06T13:30:31,980 copying build/lib/unitxt/catalog/cards/global_mmlu/ar/high_school_european_history.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/ar 2026-01-06T13:30:31,982 copying build/lib/unitxt/catalog/cards/global_mmlu/ar/electrical_engineering.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/ar 2026-01-06T13:30:31,984 copying build/lib/unitxt/catalog/cards/global_mmlu/ar/nutrition.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/ar 2026-01-06T13:30:31,985 copying build/lib/unitxt/catalog/cards/global_mmlu/ar/abstract_algebra.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/ar 2026-01-06T13:30:31,987 copying build/lib/unitxt/catalog/cards/global_mmlu/ar/professional_medicine.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/ar 2026-01-06T13:30:31,989 copying build/lib/unitxt/catalog/cards/global_mmlu/ar/human_sexuality.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/ar 2026-01-06T13:30:31,991 copying build/lib/unitxt/catalog/cards/global_mmlu/ar/business_ethics.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/ar 2026-01-06T13:30:31,993 copying build/lib/unitxt/catalog/cards/global_mmlu/ar/high_school_chemistry.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/ar 2026-01-06T13:30:31,995 copying build/lib/unitxt/catalog/cards/global_mmlu/ar/logical_fallacies.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/ar 2026-01-06T13:30:31,996 copying build/lib/unitxt/catalog/cards/global_mmlu/ar/formal_logic.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/ar 2026-01-06T13:30:31,999 copying build/lib/unitxt/catalog/cards/global_mmlu/ar/high_school_psychology.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/ar 2026-01-06T13:30:32,000 copying build/lib/unitxt/catalog/cards/global_mmlu/ar/medical_genetics.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/ar 2026-01-06T13:30:32,002 copying build/lib/unitxt/catalog/cards/global_mmlu/ar/security_studies.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/ar 2026-01-06T13:30:32,004 copying build/lib/unitxt/catalog/cards/global_mmlu/ar/high_school_macroeconomics.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/ar 2026-01-06T13:30:32,006 copying build/lib/unitxt/catalog/cards/global_mmlu/ar/professional_law.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/ar 2026-01-06T13:30:32,008 copying build/lib/unitxt/catalog/cards/global_mmlu/ar/high_school_physics.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/ar 2026-01-06T13:30:32,010 copying build/lib/unitxt/catalog/cards/global_mmlu/ar/econometrics.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/ar 2026-01-06T13:30:32,012 copying build/lib/unitxt/catalog/cards/global_mmlu/ar/sociology.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/ar 2026-01-06T13:30:32,014 copying build/lib/unitxt/catalog/cards/global_mmlu/ar/moral_disputes.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/ar 2026-01-06T13:30:32,016 copying build/lib/unitxt/catalog/cards/global_mmlu/ar/college_chemistry.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/ar 2026-01-06T13:30:32,018 copying build/lib/unitxt/catalog/cards/global_mmlu/ar/high_school_geography.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/ar 2026-01-06T13:30:32,020 copying build/lib/unitxt/catalog/cards/global_mmlu/ar/jurisprudence.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/ar 2026-01-06T13:30:32,022 copying build/lib/unitxt/catalog/cards/global_mmlu/ar/high_school_statistics.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/ar 2026-01-06T13:30:32,024 copying build/lib/unitxt/catalog/cards/global_mmlu/ar/professional_accounting.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/ar 2026-01-06T13:30:32,026 copying build/lib/unitxt/catalog/cards/global_mmlu/ar/us_foreign_policy.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/ar 2026-01-06T13:30:32,028 copying build/lib/unitxt/catalog/cards/global_mmlu/ar/professional_psychology.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/ar 2026-01-06T13:30:32,029 copying build/lib/unitxt/catalog/cards/global_mmlu/ar/public_relations.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/ar 2026-01-06T13:30:32,031 copying build/lib/unitxt/catalog/cards/global_mmlu/ar/computer_security.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/ar 2026-01-06T13:30:32,033 copying build/lib/unitxt/catalog/cards/global_mmlu/ar/philosophy.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/ar 2026-01-06T13:30:32,035 copying build/lib/unitxt/catalog/cards/global_mmlu/ar/virology.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/ar 2026-01-06T13:30:32,037 copying build/lib/unitxt/catalog/cards/global_mmlu/ar/marketing.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/ar 2026-01-06T13:30:32,039 copying build/lib/unitxt/catalog/cards/global_mmlu/ar/high_school_world_history.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/ar 2026-01-06T13:30:32,041 copying build/lib/unitxt/catalog/cards/global_mmlu/ar/machine_learning.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/ar 2026-01-06T13:30:32,043 copying build/lib/unitxt/catalog/cards/global_mmlu/ar/high_school_government_and_politics.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/ar 2026-01-06T13:30:32,044 copying build/lib/unitxt/catalog/cards/global_mmlu/ar/conceptual_physics.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/ar 2026-01-06T13:30:32,046 copying build/lib/unitxt/catalog/cards/global_mmlu/ar/college_biology.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/ar 2026-01-06T13:30:32,048 copying build/lib/unitxt/catalog/cards/global_mmlu/ar/high_school_mathematics.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/ar 2026-01-06T13:30:32,052 creating build/bdist.linux-armv7l/wheel/unitxt/catalog/cards/global_mmlu/pt 2026-01-06T13:30:32,053 copying build/lib/unitxt/catalog/cards/global_mmlu/pt/elementary_mathematics.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/pt 2026-01-06T13:30:32,055 copying build/lib/unitxt/catalog/cards/global_mmlu/pt/human_aging.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/pt 2026-01-06T13:30:32,057 copying build/lib/unitxt/catalog/cards/global_mmlu/pt/high_school_computer_science.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/pt 2026-01-06T13:30:32,058 copying build/lib/unitxt/catalog/cards/global_mmlu/pt/college_physics.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/pt 2026-01-06T13:30:32,060 copying build/lib/unitxt/catalog/cards/global_mmlu/pt/college_medicine.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/pt 2026-01-06T13:30:32,062 copying build/lib/unitxt/catalog/cards/global_mmlu/pt/college_mathematics.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/pt 2026-01-06T13:30:32,064 copying build/lib/unitxt/catalog/cards/global_mmlu/pt/high_school_microeconomics.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/pt 2026-01-06T13:30:32,066 copying build/lib/unitxt/catalog/cards/global_mmlu/pt/anatomy.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/pt 2026-01-06T13:30:32,068 copying build/lib/unitxt/catalog/cards/global_mmlu/pt/world_religions.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/pt 2026-01-06T13:30:32,070 copying build/lib/unitxt/catalog/cards/global_mmlu/pt/management.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/pt 2026-01-06T13:30:32,072 copying build/lib/unitxt/catalog/cards/global_mmlu/pt/moral_scenarios.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/pt 2026-01-06T13:30:32,074 copying build/lib/unitxt/catalog/cards/global_mmlu/pt/global_facts.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/pt 2026-01-06T13:30:32,075 copying build/lib/unitxt/catalog/cards/global_mmlu/pt/miscellaneous.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/pt 2026-01-06T13:30:32,077 copying build/lib/unitxt/catalog/cards/global_mmlu/pt/clinical_knowledge.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/pt 2026-01-06T13:30:32,079 copying build/lib/unitxt/catalog/cards/global_mmlu/pt/high_school_biology.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/pt 2026-01-06T13:30:32,081 copying build/lib/unitxt/catalog/cards/global_mmlu/pt/prehistory.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/pt 2026-01-06T13:30:32,083 copying build/lib/unitxt/catalog/cards/global_mmlu/pt/high_school_us_history.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/pt 2026-01-06T13:30:32,085 copying build/lib/unitxt/catalog/cards/global_mmlu/pt/international_law.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/pt 2026-01-06T13:30:32,087 copying build/lib/unitxt/catalog/cards/global_mmlu/pt/college_computer_science.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/pt 2026-01-06T13:30:32,089 copying build/lib/unitxt/catalog/cards/global_mmlu/pt/astronomy.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/pt 2026-01-06T13:30:32,090 copying build/lib/unitxt/catalog/cards/global_mmlu/pt/high_school_european_history.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/pt 2026-01-06T13:30:32,092 copying build/lib/unitxt/catalog/cards/global_mmlu/pt/electrical_engineering.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/pt 2026-01-06T13:30:32,094 copying build/lib/unitxt/catalog/cards/global_mmlu/pt/nutrition.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/pt 2026-01-06T13:30:32,096 copying build/lib/unitxt/catalog/cards/global_mmlu/pt/abstract_algebra.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/pt 2026-01-06T13:30:32,098 copying build/lib/unitxt/catalog/cards/global_mmlu/pt/professional_medicine.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/pt 2026-01-06T13:30:32,100 copying build/lib/unitxt/catalog/cards/global_mmlu/pt/human_sexuality.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/pt 2026-01-06T13:30:32,101 copying build/lib/unitxt/catalog/cards/global_mmlu/pt/business_ethics.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/pt 2026-01-06T13:30:32,103 copying build/lib/unitxt/catalog/cards/global_mmlu/pt/high_school_chemistry.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/pt 2026-01-06T13:30:32,105 copying build/lib/unitxt/catalog/cards/global_mmlu/pt/logical_fallacies.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/pt 2026-01-06T13:30:32,107 copying build/lib/unitxt/catalog/cards/global_mmlu/pt/formal_logic.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/pt 2026-01-06T13:30:32,110 copying build/lib/unitxt/catalog/cards/global_mmlu/pt/high_school_psychology.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/pt 2026-01-06T13:30:32,112 copying build/lib/unitxt/catalog/cards/global_mmlu/pt/medical_genetics.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/pt 2026-01-06T13:30:32,114 copying build/lib/unitxt/catalog/cards/global_mmlu/pt/security_studies.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/pt 2026-01-06T13:30:32,116 copying build/lib/unitxt/catalog/cards/global_mmlu/pt/high_school_macroeconomics.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/pt 2026-01-06T13:30:32,118 copying build/lib/unitxt/catalog/cards/global_mmlu/pt/professional_law.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/pt 2026-01-06T13:30:32,120 copying build/lib/unitxt/catalog/cards/global_mmlu/pt/high_school_physics.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/pt 2026-01-06T13:30:32,122 copying build/lib/unitxt/catalog/cards/global_mmlu/pt/econometrics.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/pt 2026-01-06T13:30:32,123 copying build/lib/unitxt/catalog/cards/global_mmlu/pt/sociology.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/pt 2026-01-06T13:30:32,125 copying build/lib/unitxt/catalog/cards/global_mmlu/pt/moral_disputes.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/pt 2026-01-06T13:30:32,127 copying build/lib/unitxt/catalog/cards/global_mmlu/pt/college_chemistry.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/pt 2026-01-06T13:30:32,129 copying build/lib/unitxt/catalog/cards/global_mmlu/pt/high_school_geography.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/pt 2026-01-06T13:30:32,131 copying build/lib/unitxt/catalog/cards/global_mmlu/pt/jurisprudence.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/pt 2026-01-06T13:30:32,134 copying build/lib/unitxt/catalog/cards/global_mmlu/pt/high_school_statistics.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/pt 2026-01-06T13:30:32,136 copying build/lib/unitxt/catalog/cards/global_mmlu/pt/professional_accounting.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/pt 2026-01-06T13:30:32,138 copying build/lib/unitxt/catalog/cards/global_mmlu/pt/us_foreign_policy.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/pt 2026-01-06T13:30:32,140 copying build/lib/unitxt/catalog/cards/global_mmlu/pt/professional_psychology.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/pt 2026-01-06T13:30:32,142 copying build/lib/unitxt/catalog/cards/global_mmlu/pt/public_relations.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/pt 2026-01-06T13:30:32,144 copying build/lib/unitxt/catalog/cards/global_mmlu/pt/computer_security.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/pt 2026-01-06T13:30:32,146 copying build/lib/unitxt/catalog/cards/global_mmlu/pt/philosophy.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/pt 2026-01-06T13:30:32,147 copying build/lib/unitxt/catalog/cards/global_mmlu/pt/virology.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/pt 2026-01-06T13:30:32,149 copying build/lib/unitxt/catalog/cards/global_mmlu/pt/marketing.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/pt 2026-01-06T13:30:32,151 copying build/lib/unitxt/catalog/cards/global_mmlu/pt/high_school_world_history.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/pt 2026-01-06T13:30:32,153 copying build/lib/unitxt/catalog/cards/global_mmlu/pt/machine_learning.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/pt 2026-01-06T13:30:32,155 copying build/lib/unitxt/catalog/cards/global_mmlu/pt/high_school_government_and_politics.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/pt 2026-01-06T13:30:32,157 copying build/lib/unitxt/catalog/cards/global_mmlu/pt/conceptual_physics.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/pt 2026-01-06T13:30:32,159 copying build/lib/unitxt/catalog/cards/global_mmlu/pt/college_biology.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/pt 2026-01-06T13:30:32,161 copying build/lib/unitxt/catalog/cards/global_mmlu/pt/high_school_mathematics.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/pt 2026-01-06T13:30:32,164 creating build/bdist.linux-armv7l/wheel/unitxt/catalog/cards/global_mmlu/el 2026-01-06T13:30:32,165 copying build/lib/unitxt/catalog/cards/global_mmlu/el/elementary_mathematics.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/el 2026-01-06T13:30:32,167 copying build/lib/unitxt/catalog/cards/global_mmlu/el/human_aging.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/el 2026-01-06T13:30:32,169 copying build/lib/unitxt/catalog/cards/global_mmlu/el/high_school_computer_science.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/el 2026-01-06T13:30:32,171 copying build/lib/unitxt/catalog/cards/global_mmlu/el/college_physics.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/el 2026-01-06T13:30:32,173 copying build/lib/unitxt/catalog/cards/global_mmlu/el/college_medicine.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/el 2026-01-06T13:30:32,175 copying build/lib/unitxt/catalog/cards/global_mmlu/el/college_mathematics.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/el 2026-01-06T13:30:32,176 copying build/lib/unitxt/catalog/cards/global_mmlu/el/high_school_microeconomics.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/el 2026-01-06T13:30:32,178 copying build/lib/unitxt/catalog/cards/global_mmlu/el/anatomy.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/el 2026-01-06T13:30:32,180 copying build/lib/unitxt/catalog/cards/global_mmlu/el/world_religions.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/el 2026-01-06T13:30:32,182 copying build/lib/unitxt/catalog/cards/global_mmlu/el/management.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/el 2026-01-06T13:30:32,184 copying build/lib/unitxt/catalog/cards/global_mmlu/el/moral_scenarios.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/el 2026-01-06T13:30:32,186 copying build/lib/unitxt/catalog/cards/global_mmlu/el/global_facts.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/el 2026-01-06T13:30:32,187 copying build/lib/unitxt/catalog/cards/global_mmlu/el/miscellaneous.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/el 2026-01-06T13:30:32,189 copying build/lib/unitxt/catalog/cards/global_mmlu/el/clinical_knowledge.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/el 2026-01-06T13:30:32,191 copying build/lib/unitxt/catalog/cards/global_mmlu/el/high_school_biology.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/el 2026-01-06T13:30:32,193 copying build/lib/unitxt/catalog/cards/global_mmlu/el/prehistory.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/el 2026-01-06T13:30:32,195 copying build/lib/unitxt/catalog/cards/global_mmlu/el/high_school_us_history.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/el 2026-01-06T13:30:32,197 copying build/lib/unitxt/catalog/cards/global_mmlu/el/international_law.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/el 2026-01-06T13:30:32,199 copying build/lib/unitxt/catalog/cards/global_mmlu/el/college_computer_science.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/el 2026-01-06T13:30:32,200 copying build/lib/unitxt/catalog/cards/global_mmlu/el/astronomy.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/el 2026-01-06T13:30:32,202 copying build/lib/unitxt/catalog/cards/global_mmlu/el/high_school_european_history.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/el 2026-01-06T13:30:32,204 copying build/lib/unitxt/catalog/cards/global_mmlu/el/electrical_engineering.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/el 2026-01-06T13:30:32,206 copying build/lib/unitxt/catalog/cards/global_mmlu/el/nutrition.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/el 2026-01-06T13:30:32,208 copying build/lib/unitxt/catalog/cards/global_mmlu/el/abstract_algebra.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/el 2026-01-06T13:30:32,210 copying build/lib/unitxt/catalog/cards/global_mmlu/el/professional_medicine.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/el 2026-01-06T13:30:32,212 copying build/lib/unitxt/catalog/cards/global_mmlu/el/human_sexuality.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/el 2026-01-06T13:30:32,214 copying build/lib/unitxt/catalog/cards/global_mmlu/el/business_ethics.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/el 2026-01-06T13:30:32,215 copying build/lib/unitxt/catalog/cards/global_mmlu/el/high_school_chemistry.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/el 2026-01-06T13:30:32,217 copying build/lib/unitxt/catalog/cards/global_mmlu/el/logical_fallacies.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/el 2026-01-06T13:30:32,219 copying build/lib/unitxt/catalog/cards/global_mmlu/el/formal_logic.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/el 2026-01-06T13:30:32,221 copying build/lib/unitxt/catalog/cards/global_mmlu/el/high_school_psychology.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/el 2026-01-06T13:30:32,223 copying build/lib/unitxt/catalog/cards/global_mmlu/el/medical_genetics.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/el 2026-01-06T13:30:32,224 copying build/lib/unitxt/catalog/cards/global_mmlu/el/security_studies.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/el 2026-01-06T13:30:32,226 copying build/lib/unitxt/catalog/cards/global_mmlu/el/high_school_macroeconomics.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/el 2026-01-06T13:30:32,228 copying build/lib/unitxt/catalog/cards/global_mmlu/el/professional_law.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/el 2026-01-06T13:30:32,230 copying build/lib/unitxt/catalog/cards/global_mmlu/el/high_school_physics.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/el 2026-01-06T13:30:32,232 copying build/lib/unitxt/catalog/cards/global_mmlu/el/econometrics.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/el 2026-01-06T13:30:32,234 copying build/lib/unitxt/catalog/cards/global_mmlu/el/sociology.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/el 2026-01-06T13:30:32,235 copying build/lib/unitxt/catalog/cards/global_mmlu/el/moral_disputes.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/el 2026-01-06T13:30:32,237 copying build/lib/unitxt/catalog/cards/global_mmlu/el/college_chemistry.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/el 2026-01-06T13:30:32,239 copying build/lib/unitxt/catalog/cards/global_mmlu/el/high_school_geography.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/el 2026-01-06T13:30:32,241 copying build/lib/unitxt/catalog/cards/global_mmlu/el/jurisprudence.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/el 2026-01-06T13:30:32,243 copying build/lib/unitxt/catalog/cards/global_mmlu/el/high_school_statistics.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/el 2026-01-06T13:30:32,245 copying build/lib/unitxt/catalog/cards/global_mmlu/el/professional_accounting.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/el 2026-01-06T13:30:32,247 copying build/lib/unitxt/catalog/cards/global_mmlu/el/us_foreign_policy.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/el 2026-01-06T13:30:32,249 copying build/lib/unitxt/catalog/cards/global_mmlu/el/professional_psychology.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/el 2026-01-06T13:30:32,251 copying build/lib/unitxt/catalog/cards/global_mmlu/el/public_relations.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/el 2026-01-06T13:30:32,253 copying build/lib/unitxt/catalog/cards/global_mmlu/el/computer_security.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/el 2026-01-06T13:30:32,255 copying build/lib/unitxt/catalog/cards/global_mmlu/el/philosophy.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/el 2026-01-06T13:30:32,256 copying build/lib/unitxt/catalog/cards/global_mmlu/el/virology.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/el 2026-01-06T13:30:32,258 copying build/lib/unitxt/catalog/cards/global_mmlu/el/marketing.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/el 2026-01-06T13:30:32,260 copying build/lib/unitxt/catalog/cards/global_mmlu/el/high_school_world_history.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/el 2026-01-06T13:30:32,262 copying build/lib/unitxt/catalog/cards/global_mmlu/el/machine_learning.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/el 2026-01-06T13:30:32,264 copying build/lib/unitxt/catalog/cards/global_mmlu/el/high_school_government_and_politics.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/el 2026-01-06T13:30:32,266 copying build/lib/unitxt/catalog/cards/global_mmlu/el/conceptual_physics.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/el 2026-01-06T13:30:32,267 copying build/lib/unitxt/catalog/cards/global_mmlu/el/college_biology.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/el 2026-01-06T13:30:32,269 copying build/lib/unitxt/catalog/cards/global_mmlu/el/high_school_mathematics.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/el 2026-01-06T13:30:32,272 creating build/bdist.linux-armv7l/wheel/unitxt/catalog/cards/global_mmlu/ko 2026-01-06T13:30:32,273 copying build/lib/unitxt/catalog/cards/global_mmlu/ko/elementary_mathematics.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/ko 2026-01-06T13:30:32,275 copying build/lib/unitxt/catalog/cards/global_mmlu/ko/human_aging.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/ko 2026-01-06T13:30:32,277 copying build/lib/unitxt/catalog/cards/global_mmlu/ko/high_school_computer_science.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/ko 2026-01-06T13:30:32,279 copying build/lib/unitxt/catalog/cards/global_mmlu/ko/college_physics.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/ko 2026-01-06T13:30:32,280 copying build/lib/unitxt/catalog/cards/global_mmlu/ko/college_medicine.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/ko 2026-01-06T13:30:32,282 copying build/lib/unitxt/catalog/cards/global_mmlu/ko/college_mathematics.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/ko 2026-01-06T13:30:32,284 copying build/lib/unitxt/catalog/cards/global_mmlu/ko/high_school_microeconomics.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/ko 2026-01-06T13:30:32,286 copying build/lib/unitxt/catalog/cards/global_mmlu/ko/anatomy.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/ko 2026-01-06T13:30:32,288 copying build/lib/unitxt/catalog/cards/global_mmlu/ko/world_religions.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/ko 2026-01-06T13:30:32,290 copying build/lib/unitxt/catalog/cards/global_mmlu/ko/management.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/ko 2026-01-06T13:30:32,291 copying build/lib/unitxt/catalog/cards/global_mmlu/ko/moral_scenarios.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/ko 2026-01-06T13:30:32,293 copying build/lib/unitxt/catalog/cards/global_mmlu/ko/global_facts.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/ko 2026-01-06T13:30:32,295 copying build/lib/unitxt/catalog/cards/global_mmlu/ko/miscellaneous.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/ko 2026-01-06T13:30:32,297 copying build/lib/unitxt/catalog/cards/global_mmlu/ko/clinical_knowledge.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/ko 2026-01-06T13:30:32,299 copying build/lib/unitxt/catalog/cards/global_mmlu/ko/high_school_biology.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/ko 2026-01-06T13:30:32,300 copying build/lib/unitxt/catalog/cards/global_mmlu/ko/prehistory.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/ko 2026-01-06T13:30:32,302 copying build/lib/unitxt/catalog/cards/global_mmlu/ko/high_school_us_history.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/ko 2026-01-06T13:30:32,304 copying build/lib/unitxt/catalog/cards/global_mmlu/ko/international_law.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/ko 2026-01-06T13:30:32,306 copying build/lib/unitxt/catalog/cards/global_mmlu/ko/college_computer_science.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/ko 2026-01-06T13:30:32,308 copying build/lib/unitxt/catalog/cards/global_mmlu/ko/astronomy.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/ko 2026-01-06T13:30:32,309 copying build/lib/unitxt/catalog/cards/global_mmlu/ko/high_school_european_history.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/ko 2026-01-06T13:30:32,311 copying build/lib/unitxt/catalog/cards/global_mmlu/ko/electrical_engineering.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/ko 2026-01-06T13:30:32,313 copying build/lib/unitxt/catalog/cards/global_mmlu/ko/nutrition.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/ko 2026-01-06T13:30:32,315 copying build/lib/unitxt/catalog/cards/global_mmlu/ko/abstract_algebra.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/ko 2026-01-06T13:30:32,316 copying build/lib/unitxt/catalog/cards/global_mmlu/ko/professional_medicine.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/ko 2026-01-06T13:30:32,318 copying build/lib/unitxt/catalog/cards/global_mmlu/ko/human_sexuality.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/ko 2026-01-06T13:30:32,320 copying build/lib/unitxt/catalog/cards/global_mmlu/ko/business_ethics.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/ko 2026-01-06T13:30:32,322 copying build/lib/unitxt/catalog/cards/global_mmlu/ko/high_school_chemistry.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/ko 2026-01-06T13:30:32,324 copying build/lib/unitxt/catalog/cards/global_mmlu/ko/logical_fallacies.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/ko 2026-01-06T13:30:32,326 copying build/lib/unitxt/catalog/cards/global_mmlu/ko/formal_logic.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/ko 2026-01-06T13:30:32,328 copying build/lib/unitxt/catalog/cards/global_mmlu/ko/high_school_psychology.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/ko 2026-01-06T13:30:32,329 copying build/lib/unitxt/catalog/cards/global_mmlu/ko/medical_genetics.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/ko 2026-01-06T13:30:32,331 copying build/lib/unitxt/catalog/cards/global_mmlu/ko/security_studies.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/ko 2026-01-06T13:30:32,333 copying build/lib/unitxt/catalog/cards/global_mmlu/ko/high_school_macroeconomics.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/ko 2026-01-06T13:30:32,335 copying build/lib/unitxt/catalog/cards/global_mmlu/ko/professional_law.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/ko 2026-01-06T13:30:32,337 copying build/lib/unitxt/catalog/cards/global_mmlu/ko/high_school_physics.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/ko 2026-01-06T13:30:32,339 copying build/lib/unitxt/catalog/cards/global_mmlu/ko/econometrics.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/ko 2026-01-06T13:30:32,341 copying build/lib/unitxt/catalog/cards/global_mmlu/ko/sociology.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/ko 2026-01-06T13:30:32,342 copying build/lib/unitxt/catalog/cards/global_mmlu/ko/moral_disputes.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/ko 2026-01-06T13:30:32,344 copying build/lib/unitxt/catalog/cards/global_mmlu/ko/college_chemistry.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/ko 2026-01-06T13:30:32,346 copying build/lib/unitxt/catalog/cards/global_mmlu/ko/high_school_geography.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/ko 2026-01-06T13:30:32,348 copying build/lib/unitxt/catalog/cards/global_mmlu/ko/jurisprudence.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/ko 2026-01-06T13:30:32,350 copying build/lib/unitxt/catalog/cards/global_mmlu/ko/high_school_statistics.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/ko 2026-01-06T13:30:32,352 copying build/lib/unitxt/catalog/cards/global_mmlu/ko/professional_accounting.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/ko 2026-01-06T13:30:32,354 copying build/lib/unitxt/catalog/cards/global_mmlu/ko/us_foreign_policy.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/ko 2026-01-06T13:30:32,355 copying build/lib/unitxt/catalog/cards/global_mmlu/ko/professional_psychology.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/ko 2026-01-06T13:30:32,357 copying build/lib/unitxt/catalog/cards/global_mmlu/ko/public_relations.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/ko 2026-01-06T13:30:32,359 copying build/lib/unitxt/catalog/cards/global_mmlu/ko/computer_security.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/ko 2026-01-06T13:30:32,361 copying build/lib/unitxt/catalog/cards/global_mmlu/ko/philosophy.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/ko 2026-01-06T13:30:32,363 copying build/lib/unitxt/catalog/cards/global_mmlu/ko/virology.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/ko 2026-01-06T13:30:32,364 copying build/lib/unitxt/catalog/cards/global_mmlu/ko/marketing.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/ko 2026-01-06T13:30:32,366 copying build/lib/unitxt/catalog/cards/global_mmlu/ko/high_school_world_history.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/ko 2026-01-06T13:30:32,368 copying build/lib/unitxt/catalog/cards/global_mmlu/ko/machine_learning.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/ko 2026-01-06T13:30:32,370 copying build/lib/unitxt/catalog/cards/global_mmlu/ko/high_school_government_and_politics.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/ko 2026-01-06T13:30:32,372 copying build/lib/unitxt/catalog/cards/global_mmlu/ko/conceptual_physics.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/ko 2026-01-06T13:30:32,374 copying build/lib/unitxt/catalog/cards/global_mmlu/ko/college_biology.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/ko 2026-01-06T13:30:32,376 copying build/lib/unitxt/catalog/cards/global_mmlu/ko/high_school_mathematics.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/ko 2026-01-06T13:30:32,379 creating build/bdist.linux-armv7l/wheel/unitxt/catalog/cards/global_mmlu/ne 2026-01-06T13:30:32,380 copying build/lib/unitxt/catalog/cards/global_mmlu/ne/elementary_mathematics.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/ne 2026-01-06T13:30:32,382 copying build/lib/unitxt/catalog/cards/global_mmlu/ne/human_aging.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/ne 2026-01-06T13:30:32,384 copying build/lib/unitxt/catalog/cards/global_mmlu/ne/high_school_computer_science.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/ne 2026-01-06T13:30:32,386 copying build/lib/unitxt/catalog/cards/global_mmlu/ne/college_physics.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/ne 2026-01-06T13:30:32,387 copying build/lib/unitxt/catalog/cards/global_mmlu/ne/college_medicine.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/ne 2026-01-06T13:30:32,389 copying build/lib/unitxt/catalog/cards/global_mmlu/ne/college_mathematics.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/ne 2026-01-06T13:30:32,391 copying build/lib/unitxt/catalog/cards/global_mmlu/ne/high_school_microeconomics.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/ne 2026-01-06T13:30:32,393 copying build/lib/unitxt/catalog/cards/global_mmlu/ne/anatomy.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/ne 2026-01-06T13:30:32,395 copying build/lib/unitxt/catalog/cards/global_mmlu/ne/world_religions.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/ne 2026-01-06T13:30:32,397 copying build/lib/unitxt/catalog/cards/global_mmlu/ne/management.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/ne 2026-01-06T13:30:32,398 copying build/lib/unitxt/catalog/cards/global_mmlu/ne/moral_scenarios.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/ne 2026-01-06T13:30:32,400 copying build/lib/unitxt/catalog/cards/global_mmlu/ne/global_facts.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/ne 2026-01-06T13:30:32,402 copying build/lib/unitxt/catalog/cards/global_mmlu/ne/miscellaneous.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/ne 2026-01-06T13:30:32,403 copying build/lib/unitxt/catalog/cards/global_mmlu/ne/clinical_knowledge.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/ne 2026-01-06T13:30:32,405 copying build/lib/unitxt/catalog/cards/global_mmlu/ne/high_school_biology.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/ne 2026-01-06T13:30:32,407 copying build/lib/unitxt/catalog/cards/global_mmlu/ne/prehistory.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/ne 2026-01-06T13:30:32,409 copying build/lib/unitxt/catalog/cards/global_mmlu/ne/high_school_us_history.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/ne 2026-01-06T13:30:32,411 copying build/lib/unitxt/catalog/cards/global_mmlu/ne/international_law.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/ne 2026-01-06T13:30:32,412 copying build/lib/unitxt/catalog/cards/global_mmlu/ne/college_computer_science.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/ne 2026-01-06T13:30:32,414 copying build/lib/unitxt/catalog/cards/global_mmlu/ne/astronomy.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/ne 2026-01-06T13:30:32,416 copying build/lib/unitxt/catalog/cards/global_mmlu/ne/high_school_european_history.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/ne 2026-01-06T13:30:32,418 copying build/lib/unitxt/catalog/cards/global_mmlu/ne/electrical_engineering.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/ne 2026-01-06T13:30:32,420 copying build/lib/unitxt/catalog/cards/global_mmlu/ne/nutrition.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/ne 2026-01-06T13:30:32,422 copying build/lib/unitxt/catalog/cards/global_mmlu/ne/abstract_algebra.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/ne 2026-01-06T13:30:32,424 copying build/lib/unitxt/catalog/cards/global_mmlu/ne/professional_medicine.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/ne 2026-01-06T13:30:32,425 copying build/lib/unitxt/catalog/cards/global_mmlu/ne/human_sexuality.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/ne 2026-01-06T13:30:32,427 copying build/lib/unitxt/catalog/cards/global_mmlu/ne/business_ethics.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/ne 2026-01-06T13:30:32,429 copying build/lib/unitxt/catalog/cards/global_mmlu/ne/high_school_chemistry.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/ne 2026-01-06T13:30:32,431 copying build/lib/unitxt/catalog/cards/global_mmlu/ne/logical_fallacies.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/ne 2026-01-06T13:30:32,433 copying build/lib/unitxt/catalog/cards/global_mmlu/ne/formal_logic.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/ne 2026-01-06T13:30:32,435 copying build/lib/unitxt/catalog/cards/global_mmlu/ne/high_school_psychology.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/ne 2026-01-06T13:30:32,437 copying build/lib/unitxt/catalog/cards/global_mmlu/ne/medical_genetics.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/ne 2026-01-06T13:30:32,438 copying build/lib/unitxt/catalog/cards/global_mmlu/ne/security_studies.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/ne 2026-01-06T13:30:32,440 copying build/lib/unitxt/catalog/cards/global_mmlu/ne/high_school_macroeconomics.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/ne 2026-01-06T13:30:32,442 copying build/lib/unitxt/catalog/cards/global_mmlu/ne/professional_law.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/ne 2026-01-06T13:30:32,444 copying build/lib/unitxt/catalog/cards/global_mmlu/ne/high_school_physics.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/ne 2026-01-06T13:30:32,445 copying build/lib/unitxt/catalog/cards/global_mmlu/ne/econometrics.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/ne 2026-01-06T13:30:32,447 copying build/lib/unitxt/catalog/cards/global_mmlu/ne/sociology.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/ne 2026-01-06T13:30:32,449 copying build/lib/unitxt/catalog/cards/global_mmlu/ne/moral_disputes.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/ne 2026-01-06T13:30:32,451 copying build/lib/unitxt/catalog/cards/global_mmlu/ne/college_chemistry.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/ne 2026-01-06T13:30:32,453 copying build/lib/unitxt/catalog/cards/global_mmlu/ne/high_school_geography.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/ne 2026-01-06T13:30:32,454 copying build/lib/unitxt/catalog/cards/global_mmlu/ne/jurisprudence.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/ne 2026-01-06T13:30:32,456 copying build/lib/unitxt/catalog/cards/global_mmlu/ne/high_school_statistics.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/ne 2026-01-06T13:30:32,458 copying build/lib/unitxt/catalog/cards/global_mmlu/ne/professional_accounting.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/ne 2026-01-06T13:30:32,460 copying build/lib/unitxt/catalog/cards/global_mmlu/ne/us_foreign_policy.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/ne 2026-01-06T13:30:32,462 copying build/lib/unitxt/catalog/cards/global_mmlu/ne/professional_psychology.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/ne 2026-01-06T13:30:32,464 copying build/lib/unitxt/catalog/cards/global_mmlu/ne/public_relations.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/ne 2026-01-06T13:30:32,466 copying build/lib/unitxt/catalog/cards/global_mmlu/ne/computer_security.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/ne 2026-01-06T13:30:32,467 copying build/lib/unitxt/catalog/cards/global_mmlu/ne/philosophy.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/ne 2026-01-06T13:30:32,469 copying build/lib/unitxt/catalog/cards/global_mmlu/ne/virology.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/ne 2026-01-06T13:30:32,471 copying build/lib/unitxt/catalog/cards/global_mmlu/ne/marketing.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/ne 2026-01-06T13:30:32,473 copying build/lib/unitxt/catalog/cards/global_mmlu/ne/high_school_world_history.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/ne 2026-01-06T13:30:32,475 copying build/lib/unitxt/catalog/cards/global_mmlu/ne/machine_learning.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/ne 2026-01-06T13:30:32,477 copying build/lib/unitxt/catalog/cards/global_mmlu/ne/high_school_government_and_politics.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/ne 2026-01-06T13:30:32,479 copying build/lib/unitxt/catalog/cards/global_mmlu/ne/conceptual_physics.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/ne 2026-01-06T13:30:32,481 copying build/lib/unitxt/catalog/cards/global_mmlu/ne/college_biology.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/ne 2026-01-06T13:30:32,483 copying build/lib/unitxt/catalog/cards/global_mmlu/ne/high_school_mathematics.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/ne 2026-01-06T13:30:32,486 creating build/bdist.linux-armv7l/wheel/unitxt/catalog/cards/global_mmlu/it 2026-01-06T13:30:32,486 copying build/lib/unitxt/catalog/cards/global_mmlu/it/elementary_mathematics.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/it 2026-01-06T13:30:32,488 copying build/lib/unitxt/catalog/cards/global_mmlu/it/human_aging.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/it 2026-01-06T13:30:32,490 copying build/lib/unitxt/catalog/cards/global_mmlu/it/high_school_computer_science.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/it 2026-01-06T13:30:32,492 copying build/lib/unitxt/catalog/cards/global_mmlu/it/college_physics.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/it 2026-01-06T13:30:32,494 copying build/lib/unitxt/catalog/cards/global_mmlu/it/college_medicine.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/it 2026-01-06T13:30:32,496 copying build/lib/unitxt/catalog/cards/global_mmlu/it/college_mathematics.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/it 2026-01-06T13:30:32,497 copying build/lib/unitxt/catalog/cards/global_mmlu/it/high_school_microeconomics.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/it 2026-01-06T13:30:32,499 copying build/lib/unitxt/catalog/cards/global_mmlu/it/anatomy.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/it 2026-01-06T13:30:32,501 copying build/lib/unitxt/catalog/cards/global_mmlu/it/world_religions.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/it 2026-01-06T13:30:32,503 copying build/lib/unitxt/catalog/cards/global_mmlu/it/management.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/it 2026-01-06T13:30:32,505 copying build/lib/unitxt/catalog/cards/global_mmlu/it/moral_scenarios.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/it 2026-01-06T13:30:32,507 copying build/lib/unitxt/catalog/cards/global_mmlu/it/global_facts.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/it 2026-01-06T13:30:32,510 copying build/lib/unitxt/catalog/cards/global_mmlu/it/miscellaneous.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/it 2026-01-06T13:30:32,512 copying build/lib/unitxt/catalog/cards/global_mmlu/it/clinical_knowledge.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/it 2026-01-06T13:30:32,514 copying build/lib/unitxt/catalog/cards/global_mmlu/it/high_school_biology.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/it 2026-01-06T13:30:32,516 copying build/lib/unitxt/catalog/cards/global_mmlu/it/prehistory.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/it 2026-01-06T13:30:32,519 copying build/lib/unitxt/catalog/cards/global_mmlu/it/high_school_us_history.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/it 2026-01-06T13:30:32,521 copying build/lib/unitxt/catalog/cards/global_mmlu/it/international_law.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/it 2026-01-06T13:30:32,523 copying build/lib/unitxt/catalog/cards/global_mmlu/it/college_computer_science.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/it 2026-01-06T13:30:32,525 copying build/lib/unitxt/catalog/cards/global_mmlu/it/astronomy.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/it 2026-01-06T13:30:32,527 copying build/lib/unitxt/catalog/cards/global_mmlu/it/high_school_european_history.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/it 2026-01-06T13:30:32,529 copying build/lib/unitxt/catalog/cards/global_mmlu/it/electrical_engineering.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/it 2026-01-06T13:30:32,532 copying build/lib/unitxt/catalog/cards/global_mmlu/it/nutrition.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/it 2026-01-06T13:30:32,534 copying build/lib/unitxt/catalog/cards/global_mmlu/it/abstract_algebra.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/it 2026-01-06T13:30:32,536 copying build/lib/unitxt/catalog/cards/global_mmlu/it/professional_medicine.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/it 2026-01-06T13:30:32,539 copying build/lib/unitxt/catalog/cards/global_mmlu/it/human_sexuality.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/it 2026-01-06T13:30:32,541 copying build/lib/unitxt/catalog/cards/global_mmlu/it/business_ethics.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/it 2026-01-06T13:30:32,543 copying build/lib/unitxt/catalog/cards/global_mmlu/it/high_school_chemistry.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/it 2026-01-06T13:30:32,545 copying build/lib/unitxt/catalog/cards/global_mmlu/it/logical_fallacies.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/it 2026-01-06T13:30:32,547 copying build/lib/unitxt/catalog/cards/global_mmlu/it/formal_logic.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/it 2026-01-06T13:30:32,549 copying build/lib/unitxt/catalog/cards/global_mmlu/it/high_school_psychology.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/it 2026-01-06T13:30:32,551 copying build/lib/unitxt/catalog/cards/global_mmlu/it/medical_genetics.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/it 2026-01-06T13:30:32,553 copying build/lib/unitxt/catalog/cards/global_mmlu/it/security_studies.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/it 2026-01-06T13:30:32,555 copying build/lib/unitxt/catalog/cards/global_mmlu/it/high_school_macroeconomics.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/it 2026-01-06T13:30:32,557 copying build/lib/unitxt/catalog/cards/global_mmlu/it/professional_law.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/it 2026-01-06T13:30:32,560 copying build/lib/unitxt/catalog/cards/global_mmlu/it/high_school_physics.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/it 2026-01-06T13:30:32,562 copying build/lib/unitxt/catalog/cards/global_mmlu/it/econometrics.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/it 2026-01-06T13:30:32,564 copying build/lib/unitxt/catalog/cards/global_mmlu/it/sociology.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/it 2026-01-06T13:30:32,566 copying build/lib/unitxt/catalog/cards/global_mmlu/it/moral_disputes.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/it 2026-01-06T13:30:32,568 copying build/lib/unitxt/catalog/cards/global_mmlu/it/college_chemistry.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/it 2026-01-06T13:30:32,570 copying build/lib/unitxt/catalog/cards/global_mmlu/it/high_school_geography.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/it 2026-01-06T13:30:32,573 copying build/lib/unitxt/catalog/cards/global_mmlu/it/jurisprudence.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/it 2026-01-06T13:30:32,575 copying build/lib/unitxt/catalog/cards/global_mmlu/it/high_school_statistics.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/it 2026-01-06T13:30:32,577 copying build/lib/unitxt/catalog/cards/global_mmlu/it/professional_accounting.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/it 2026-01-06T13:30:32,580 copying build/lib/unitxt/catalog/cards/global_mmlu/it/us_foreign_policy.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/it 2026-01-06T13:30:32,582 copying build/lib/unitxt/catalog/cards/global_mmlu/it/professional_psychology.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/it 2026-01-06T13:30:32,584 copying build/lib/unitxt/catalog/cards/global_mmlu/it/public_relations.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/it 2026-01-06T13:30:32,586 copying build/lib/unitxt/catalog/cards/global_mmlu/it/computer_security.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/it 2026-01-06T13:30:32,589 copying build/lib/unitxt/catalog/cards/global_mmlu/it/philosophy.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/it 2026-01-06T13:30:32,591 copying build/lib/unitxt/catalog/cards/global_mmlu/it/virology.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/it 2026-01-06T13:30:32,594 copying build/lib/unitxt/catalog/cards/global_mmlu/it/marketing.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/it 2026-01-06T13:30:32,596 copying build/lib/unitxt/catalog/cards/global_mmlu/it/high_school_world_history.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/it 2026-01-06T13:30:32,598 copying build/lib/unitxt/catalog/cards/global_mmlu/it/machine_learning.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/it 2026-01-06T13:30:32,601 copying build/lib/unitxt/catalog/cards/global_mmlu/it/high_school_government_and_politics.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/it 2026-01-06T13:30:32,603 copying build/lib/unitxt/catalog/cards/global_mmlu/it/conceptual_physics.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/it 2026-01-06T13:30:32,606 copying build/lib/unitxt/catalog/cards/global_mmlu/it/college_biology.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/it 2026-01-06T13:30:32,608 copying build/lib/unitxt/catalog/cards/global_mmlu/it/high_school_mathematics.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/it 2026-01-06T13:30:32,612 creating build/bdist.linux-armv7l/wheel/unitxt/catalog/cards/global_mmlu/sv 2026-01-06T13:30:32,613 copying build/lib/unitxt/catalog/cards/global_mmlu/sv/elementary_mathematics.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/sv 2026-01-06T13:30:32,615 copying build/lib/unitxt/catalog/cards/global_mmlu/sv/human_aging.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/sv 2026-01-06T13:30:32,618 copying build/lib/unitxt/catalog/cards/global_mmlu/sv/high_school_computer_science.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/sv 2026-01-06T13:30:32,620 copying build/lib/unitxt/catalog/cards/global_mmlu/sv/college_physics.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/sv 2026-01-06T13:30:32,622 copying build/lib/unitxt/catalog/cards/global_mmlu/sv/college_medicine.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/sv 2026-01-06T13:30:32,625 copying build/lib/unitxt/catalog/cards/global_mmlu/sv/college_mathematics.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/sv 2026-01-06T13:30:32,627 copying build/lib/unitxt/catalog/cards/global_mmlu/sv/high_school_microeconomics.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/sv 2026-01-06T13:30:32,630 copying build/lib/unitxt/catalog/cards/global_mmlu/sv/anatomy.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/sv 2026-01-06T13:30:32,632 copying build/lib/unitxt/catalog/cards/global_mmlu/sv/world_religions.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/sv 2026-01-06T13:30:32,635 copying build/lib/unitxt/catalog/cards/global_mmlu/sv/management.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/sv 2026-01-06T13:30:32,637 copying build/lib/unitxt/catalog/cards/global_mmlu/sv/moral_scenarios.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/sv 2026-01-06T13:30:32,640 copying build/lib/unitxt/catalog/cards/global_mmlu/sv/global_facts.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/sv 2026-01-06T13:30:32,642 copying build/lib/unitxt/catalog/cards/global_mmlu/sv/miscellaneous.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/sv 2026-01-06T13:30:32,645 copying build/lib/unitxt/catalog/cards/global_mmlu/sv/clinical_knowledge.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/sv 2026-01-06T13:30:32,647 copying build/lib/unitxt/catalog/cards/global_mmlu/sv/high_school_biology.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/sv 2026-01-06T13:30:32,649 copying build/lib/unitxt/catalog/cards/global_mmlu/sv/prehistory.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/sv 2026-01-06T13:30:32,652 copying build/lib/unitxt/catalog/cards/global_mmlu/sv/high_school_us_history.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/sv 2026-01-06T13:30:32,654 copying build/lib/unitxt/catalog/cards/global_mmlu/sv/international_law.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/sv 2026-01-06T13:30:32,656 copying build/lib/unitxt/catalog/cards/global_mmlu/sv/college_computer_science.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/sv 2026-01-06T13:30:32,658 copying build/lib/unitxt/catalog/cards/global_mmlu/sv/astronomy.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/sv 2026-01-06T13:30:32,660 copying build/lib/unitxt/catalog/cards/global_mmlu/sv/high_school_european_history.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/sv 2026-01-06T13:30:32,662 copying build/lib/unitxt/catalog/cards/global_mmlu/sv/electrical_engineering.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/sv 2026-01-06T13:30:32,665 copying build/lib/unitxt/catalog/cards/global_mmlu/sv/nutrition.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/sv 2026-01-06T13:30:32,667 copying build/lib/unitxt/catalog/cards/global_mmlu/sv/abstract_algebra.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/sv 2026-01-06T13:30:32,669 copying build/lib/unitxt/catalog/cards/global_mmlu/sv/professional_medicine.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/sv 2026-01-06T13:30:32,671 copying build/lib/unitxt/catalog/cards/global_mmlu/sv/human_sexuality.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/sv 2026-01-06T13:30:32,673 copying build/lib/unitxt/catalog/cards/global_mmlu/sv/business_ethics.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/sv 2026-01-06T13:30:32,675 copying build/lib/unitxt/catalog/cards/global_mmlu/sv/high_school_chemistry.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/sv 2026-01-06T13:30:32,677 copying build/lib/unitxt/catalog/cards/global_mmlu/sv/logical_fallacies.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/sv 2026-01-06T13:30:32,680 copying build/lib/unitxt/catalog/cards/global_mmlu/sv/formal_logic.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/sv 2026-01-06T13:30:32,682 copying build/lib/unitxt/catalog/cards/global_mmlu/sv/high_school_psychology.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/sv 2026-01-06T13:30:32,684 copying build/lib/unitxt/catalog/cards/global_mmlu/sv/medical_genetics.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/sv 2026-01-06T13:30:32,686 copying build/lib/unitxt/catalog/cards/global_mmlu/sv/security_studies.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/sv 2026-01-06T13:30:32,688 copying build/lib/unitxt/catalog/cards/global_mmlu/sv/high_school_macroeconomics.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/sv 2026-01-06T13:30:32,690 copying build/lib/unitxt/catalog/cards/global_mmlu/sv/professional_law.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/sv 2026-01-06T13:30:32,692 copying build/lib/unitxt/catalog/cards/global_mmlu/sv/high_school_physics.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/sv 2026-01-06T13:30:32,694 copying build/lib/unitxt/catalog/cards/global_mmlu/sv/econometrics.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/sv 2026-01-06T13:30:32,696 copying build/lib/unitxt/catalog/cards/global_mmlu/sv/sociology.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/sv 2026-01-06T13:30:32,698 copying build/lib/unitxt/catalog/cards/global_mmlu/sv/moral_disputes.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/sv 2026-01-06T13:30:32,701 copying build/lib/unitxt/catalog/cards/global_mmlu/sv/college_chemistry.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/sv 2026-01-06T13:30:32,703 copying build/lib/unitxt/catalog/cards/global_mmlu/sv/high_school_geography.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/sv 2026-01-06T13:30:32,705 copying build/lib/unitxt/catalog/cards/global_mmlu/sv/jurisprudence.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/sv 2026-01-06T13:30:32,707 copying build/lib/unitxt/catalog/cards/global_mmlu/sv/high_school_statistics.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/sv 2026-01-06T13:30:32,709 copying build/lib/unitxt/catalog/cards/global_mmlu/sv/professional_accounting.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/sv 2026-01-06T13:30:32,711 copying build/lib/unitxt/catalog/cards/global_mmlu/sv/us_foreign_policy.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/sv 2026-01-06T13:30:32,713 copying build/lib/unitxt/catalog/cards/global_mmlu/sv/professional_psychology.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/sv 2026-01-06T13:30:32,716 copying build/lib/unitxt/catalog/cards/global_mmlu/sv/public_relations.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/sv 2026-01-06T13:30:32,718 copying build/lib/unitxt/catalog/cards/global_mmlu/sv/computer_security.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/sv 2026-01-06T13:30:32,720 copying build/lib/unitxt/catalog/cards/global_mmlu/sv/philosophy.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/sv 2026-01-06T13:30:32,722 copying build/lib/unitxt/catalog/cards/global_mmlu/sv/virology.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/sv 2026-01-06T13:30:32,724 copying build/lib/unitxt/catalog/cards/global_mmlu/sv/marketing.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/sv 2026-01-06T13:30:32,726 copying build/lib/unitxt/catalog/cards/global_mmlu/sv/high_school_world_history.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/sv 2026-01-06T13:30:32,728 copying build/lib/unitxt/catalog/cards/global_mmlu/sv/machine_learning.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/sv 2026-01-06T13:30:32,731 copying build/lib/unitxt/catalog/cards/global_mmlu/sv/high_school_government_and_politics.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/sv 2026-01-06T13:30:32,733 copying build/lib/unitxt/catalog/cards/global_mmlu/sv/conceptual_physics.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/sv 2026-01-06T13:30:32,735 copying build/lib/unitxt/catalog/cards/global_mmlu/sv/college_biology.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/sv 2026-01-06T13:30:32,737 copying build/lib/unitxt/catalog/cards/global_mmlu/sv/high_school_mathematics.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/sv 2026-01-06T13:30:32,740 creating build/bdist.linux-armv7l/wheel/unitxt/catalog/cards/global_mmlu/id 2026-01-06T13:30:32,742 copying build/lib/unitxt/catalog/cards/global_mmlu/id/elementary_mathematics.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/id 2026-01-06T13:30:32,744 copying build/lib/unitxt/catalog/cards/global_mmlu/id/human_aging.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/id 2026-01-06T13:30:32,746 copying build/lib/unitxt/catalog/cards/global_mmlu/id/high_school_computer_science.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/id 2026-01-06T13:30:32,748 copying build/lib/unitxt/catalog/cards/global_mmlu/id/college_physics.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/id 2026-01-06T13:30:32,750 copying build/lib/unitxt/catalog/cards/global_mmlu/id/college_medicine.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/id 2026-01-06T13:30:32,752 copying build/lib/unitxt/catalog/cards/global_mmlu/id/college_mathematics.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/id 2026-01-06T13:30:32,755 copying build/lib/unitxt/catalog/cards/global_mmlu/id/high_school_microeconomics.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/id 2026-01-06T13:30:32,757 copying build/lib/unitxt/catalog/cards/global_mmlu/id/anatomy.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/id 2026-01-06T13:30:32,759 copying build/lib/unitxt/catalog/cards/global_mmlu/id/world_religions.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/id 2026-01-06T13:30:32,761 copying build/lib/unitxt/catalog/cards/global_mmlu/id/management.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/id 2026-01-06T13:30:32,763 copying build/lib/unitxt/catalog/cards/global_mmlu/id/moral_scenarios.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/id 2026-01-06T13:30:32,766 copying build/lib/unitxt/catalog/cards/global_mmlu/id/global_facts.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/id 2026-01-06T13:30:32,768 copying build/lib/unitxt/catalog/cards/global_mmlu/id/miscellaneous.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/id 2026-01-06T13:30:32,770 copying build/lib/unitxt/catalog/cards/global_mmlu/id/clinical_knowledge.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/id 2026-01-06T13:30:32,772 copying build/lib/unitxt/catalog/cards/global_mmlu/id/high_school_biology.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/id 2026-01-06T13:30:32,774 copying build/lib/unitxt/catalog/cards/global_mmlu/id/prehistory.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/id 2026-01-06T13:30:32,776 copying build/lib/unitxt/catalog/cards/global_mmlu/id/high_school_us_history.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/id 2026-01-06T13:30:32,779 copying build/lib/unitxt/catalog/cards/global_mmlu/id/international_law.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/id 2026-01-06T13:30:32,781 copying build/lib/unitxt/catalog/cards/global_mmlu/id/college_computer_science.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/id 2026-01-06T13:30:32,783 copying build/lib/unitxt/catalog/cards/global_mmlu/id/astronomy.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/id 2026-01-06T13:30:32,785 copying build/lib/unitxt/catalog/cards/global_mmlu/id/high_school_european_history.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/id 2026-01-06T13:30:32,787 copying build/lib/unitxt/catalog/cards/global_mmlu/id/electrical_engineering.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/id 2026-01-06T13:30:32,790 copying build/lib/unitxt/catalog/cards/global_mmlu/id/nutrition.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/id 2026-01-06T13:30:32,792 copying build/lib/unitxt/catalog/cards/global_mmlu/id/abstract_algebra.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/id 2026-01-06T13:30:32,794 copying build/lib/unitxt/catalog/cards/global_mmlu/id/professional_medicine.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/id 2026-01-06T13:30:32,796 copying build/lib/unitxt/catalog/cards/global_mmlu/id/human_sexuality.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/id 2026-01-06T13:30:32,798 copying build/lib/unitxt/catalog/cards/global_mmlu/id/business_ethics.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/id 2026-01-06T13:30:32,800 copying build/lib/unitxt/catalog/cards/global_mmlu/id/high_school_chemistry.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/id 2026-01-06T13:30:32,802 copying build/lib/unitxt/catalog/cards/global_mmlu/id/logical_fallacies.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/id 2026-01-06T13:30:32,804 copying build/lib/unitxt/catalog/cards/global_mmlu/id/formal_logic.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/id 2026-01-06T13:30:32,806 copying build/lib/unitxt/catalog/cards/global_mmlu/id/high_school_psychology.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/id 2026-01-06T13:30:32,808 copying build/lib/unitxt/catalog/cards/global_mmlu/id/medical_genetics.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/id 2026-01-06T13:30:32,811 copying build/lib/unitxt/catalog/cards/global_mmlu/id/security_studies.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/id 2026-01-06T13:30:32,813 copying build/lib/unitxt/catalog/cards/global_mmlu/id/high_school_macroeconomics.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/id 2026-01-06T13:30:32,815 copying build/lib/unitxt/catalog/cards/global_mmlu/id/professional_law.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/id 2026-01-06T13:30:32,817 copying build/lib/unitxt/catalog/cards/global_mmlu/id/high_school_physics.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/id 2026-01-06T13:30:32,819 copying build/lib/unitxt/catalog/cards/global_mmlu/id/econometrics.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/id 2026-01-06T13:30:32,821 copying build/lib/unitxt/catalog/cards/global_mmlu/id/sociology.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/id 2026-01-06T13:30:32,824 copying build/lib/unitxt/catalog/cards/global_mmlu/id/moral_disputes.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/id 2026-01-06T13:30:32,826 copying build/lib/unitxt/catalog/cards/global_mmlu/id/college_chemistry.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/id 2026-01-06T13:30:32,829 copying build/lib/unitxt/catalog/cards/global_mmlu/id/high_school_geography.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/id 2026-01-06T13:30:32,831 copying build/lib/unitxt/catalog/cards/global_mmlu/id/jurisprudence.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/id 2026-01-06T13:30:32,833 copying build/lib/unitxt/catalog/cards/global_mmlu/id/high_school_statistics.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/id 2026-01-06T13:30:32,835 copying build/lib/unitxt/catalog/cards/global_mmlu/id/professional_accounting.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/id 2026-01-06T13:30:32,837 copying build/lib/unitxt/catalog/cards/global_mmlu/id/us_foreign_policy.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/id 2026-01-06T13:30:32,839 copying build/lib/unitxt/catalog/cards/global_mmlu/id/professional_psychology.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/id 2026-01-06T13:30:32,842 copying build/lib/unitxt/catalog/cards/global_mmlu/id/public_relations.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/id 2026-01-06T13:30:32,844 copying build/lib/unitxt/catalog/cards/global_mmlu/id/computer_security.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/id 2026-01-06T13:30:32,846 copying build/lib/unitxt/catalog/cards/global_mmlu/id/philosophy.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/id 2026-01-06T13:30:32,848 copying build/lib/unitxt/catalog/cards/global_mmlu/id/virology.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/id 2026-01-06T13:30:32,850 copying build/lib/unitxt/catalog/cards/global_mmlu/id/marketing.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/id 2026-01-06T13:30:32,852 copying build/lib/unitxt/catalog/cards/global_mmlu/id/high_school_world_history.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/id 2026-01-06T13:30:32,854 copying build/lib/unitxt/catalog/cards/global_mmlu/id/machine_learning.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/id 2026-01-06T13:30:32,856 copying build/lib/unitxt/catalog/cards/global_mmlu/id/high_school_government_and_politics.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/id 2026-01-06T13:30:32,858 copying build/lib/unitxt/catalog/cards/global_mmlu/id/conceptual_physics.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/id 2026-01-06T13:30:32,860 copying build/lib/unitxt/catalog/cards/global_mmlu/id/college_biology.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/id 2026-01-06T13:30:32,862 copying build/lib/unitxt/catalog/cards/global_mmlu/id/high_school_mathematics.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/id 2026-01-06T13:30:32,866 creating build/bdist.linux-armv7l/wheel/unitxt/catalog/cards/global_mmlu/tr 2026-01-06T13:30:32,867 copying build/lib/unitxt/catalog/cards/global_mmlu/tr/elementary_mathematics.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/tr 2026-01-06T13:30:32,869 copying build/lib/unitxt/catalog/cards/global_mmlu/tr/human_aging.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/tr 2026-01-06T13:30:32,872 copying build/lib/unitxt/catalog/cards/global_mmlu/tr/high_school_computer_science.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/tr 2026-01-06T13:30:32,874 copying build/lib/unitxt/catalog/cards/global_mmlu/tr/college_physics.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/tr 2026-01-06T13:30:32,876 copying build/lib/unitxt/catalog/cards/global_mmlu/tr/college_medicine.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/tr 2026-01-06T13:30:32,878 copying build/lib/unitxt/catalog/cards/global_mmlu/tr/college_mathematics.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/tr 2026-01-06T13:30:32,880 copying build/lib/unitxt/catalog/cards/global_mmlu/tr/high_school_microeconomics.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/tr 2026-01-06T13:30:32,882 copying build/lib/unitxt/catalog/cards/global_mmlu/tr/anatomy.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/tr 2026-01-06T13:30:32,884 copying build/lib/unitxt/catalog/cards/global_mmlu/tr/world_religions.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/tr 2026-01-06T13:30:32,886 copying build/lib/unitxt/catalog/cards/global_mmlu/tr/management.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/tr 2026-01-06T13:30:32,889 copying build/lib/unitxt/catalog/cards/global_mmlu/tr/moral_scenarios.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/tr 2026-01-06T13:30:32,891 copying build/lib/unitxt/catalog/cards/global_mmlu/tr/global_facts.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/tr 2026-01-06T13:30:32,893 copying build/lib/unitxt/catalog/cards/global_mmlu/tr/miscellaneous.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/tr 2026-01-06T13:30:32,895 copying build/lib/unitxt/catalog/cards/global_mmlu/tr/clinical_knowledge.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/tr 2026-01-06T13:30:32,897 copying build/lib/unitxt/catalog/cards/global_mmlu/tr/high_school_biology.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/tr 2026-01-06T13:30:32,899 copying build/lib/unitxt/catalog/cards/global_mmlu/tr/prehistory.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/tr 2026-01-06T13:30:32,901 copying build/lib/unitxt/catalog/cards/global_mmlu/tr/high_school_us_history.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/tr 2026-01-06T13:30:32,903 copying build/lib/unitxt/catalog/cards/global_mmlu/tr/international_law.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/tr 2026-01-06T13:30:32,905 copying build/lib/unitxt/catalog/cards/global_mmlu/tr/college_computer_science.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/tr 2026-01-06T13:30:32,908 copying build/lib/unitxt/catalog/cards/global_mmlu/tr/astronomy.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/tr 2026-01-06T13:30:32,910 copying build/lib/unitxt/catalog/cards/global_mmlu/tr/high_school_european_history.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/tr 2026-01-06T13:30:32,912 copying build/lib/unitxt/catalog/cards/global_mmlu/tr/electrical_engineering.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/tr 2026-01-06T13:30:32,914 copying build/lib/unitxt/catalog/cards/global_mmlu/tr/nutrition.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/tr 2026-01-06T13:30:32,916 copying build/lib/unitxt/catalog/cards/global_mmlu/tr/abstract_algebra.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/tr 2026-01-06T13:30:32,918 copying build/lib/unitxt/catalog/cards/global_mmlu/tr/professional_medicine.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/tr 2026-01-06T13:30:32,920 copying build/lib/unitxt/catalog/cards/global_mmlu/tr/human_sexuality.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/tr 2026-01-06T13:30:32,923 copying build/lib/unitxt/catalog/cards/global_mmlu/tr/business_ethics.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/tr 2026-01-06T13:30:32,925 copying build/lib/unitxt/catalog/cards/global_mmlu/tr/high_school_chemistry.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/tr 2026-01-06T13:30:32,927 copying build/lib/unitxt/catalog/cards/global_mmlu/tr/logical_fallacies.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/tr 2026-01-06T13:30:32,929 copying build/lib/unitxt/catalog/cards/global_mmlu/tr/formal_logic.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/tr 2026-01-06T13:30:32,931 copying build/lib/unitxt/catalog/cards/global_mmlu/tr/high_school_psychology.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/tr 2026-01-06T13:30:32,933 copying build/lib/unitxt/catalog/cards/global_mmlu/tr/medical_genetics.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/tr 2026-01-06T13:30:32,935 copying build/lib/unitxt/catalog/cards/global_mmlu/tr/security_studies.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/tr 2026-01-06T13:30:32,938 copying build/lib/unitxt/catalog/cards/global_mmlu/tr/high_school_macroeconomics.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/tr 2026-01-06T13:30:32,940 copying build/lib/unitxt/catalog/cards/global_mmlu/tr/professional_law.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/tr 2026-01-06T13:30:32,942 copying build/lib/unitxt/catalog/cards/global_mmlu/tr/high_school_physics.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/tr 2026-01-06T13:30:32,944 copying build/lib/unitxt/catalog/cards/global_mmlu/tr/econometrics.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/tr 2026-01-06T13:30:32,946 copying build/lib/unitxt/catalog/cards/global_mmlu/tr/sociology.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/tr 2026-01-06T13:30:32,949 copying build/lib/unitxt/catalog/cards/global_mmlu/tr/moral_disputes.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/tr 2026-01-06T13:30:32,951 copying build/lib/unitxt/catalog/cards/global_mmlu/tr/college_chemistry.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/tr 2026-01-06T13:30:32,953 copying build/lib/unitxt/catalog/cards/global_mmlu/tr/high_school_geography.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/tr 2026-01-06T13:30:32,955 copying build/lib/unitxt/catalog/cards/global_mmlu/tr/jurisprudence.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/tr 2026-01-06T13:30:32,957 copying build/lib/unitxt/catalog/cards/global_mmlu/tr/high_school_statistics.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/tr 2026-01-06T13:30:32,959 copying build/lib/unitxt/catalog/cards/global_mmlu/tr/professional_accounting.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/tr 2026-01-06T13:30:32,961 copying build/lib/unitxt/catalog/cards/global_mmlu/tr/us_foreign_policy.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/tr 2026-01-06T13:30:32,963 copying build/lib/unitxt/catalog/cards/global_mmlu/tr/professional_psychology.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/tr 2026-01-06T13:30:32,966 copying build/lib/unitxt/catalog/cards/global_mmlu/tr/public_relations.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/tr 2026-01-06T13:30:32,968 copying build/lib/unitxt/catalog/cards/global_mmlu/tr/computer_security.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/tr 2026-01-06T13:30:32,970 copying build/lib/unitxt/catalog/cards/global_mmlu/tr/philosophy.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/tr 2026-01-06T13:30:32,972 copying build/lib/unitxt/catalog/cards/global_mmlu/tr/virology.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/tr 2026-01-06T13:30:32,974 copying build/lib/unitxt/catalog/cards/global_mmlu/tr/marketing.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/tr 2026-01-06T13:30:32,976 copying build/lib/unitxt/catalog/cards/global_mmlu/tr/high_school_world_history.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/tr 2026-01-06T13:30:32,978 copying build/lib/unitxt/catalog/cards/global_mmlu/tr/machine_learning.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/tr 2026-01-06T13:30:32,980 copying build/lib/unitxt/catalog/cards/global_mmlu/tr/high_school_government_and_politics.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/tr 2026-01-06T13:30:32,983 copying build/lib/unitxt/catalog/cards/global_mmlu/tr/conceptual_physics.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/tr 2026-01-06T13:30:32,985 copying build/lib/unitxt/catalog/cards/global_mmlu/tr/college_biology.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/tr 2026-01-06T13:30:32,987 copying build/lib/unitxt/catalog/cards/global_mmlu/tr/high_school_mathematics.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/tr 2026-01-06T13:30:32,991 creating build/bdist.linux-armv7l/wheel/unitxt/catalog/cards/global_mmlu/nl 2026-01-06T13:30:32,992 copying build/lib/unitxt/catalog/cards/global_mmlu/nl/elementary_mathematics.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/nl 2026-01-06T13:30:32,994 copying build/lib/unitxt/catalog/cards/global_mmlu/nl/human_aging.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/nl 2026-01-06T13:30:32,997 copying build/lib/unitxt/catalog/cards/global_mmlu/nl/high_school_computer_science.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/nl 2026-01-06T13:30:32,999 copying build/lib/unitxt/catalog/cards/global_mmlu/nl/college_physics.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/nl 2026-01-06T13:30:33,001 copying build/lib/unitxt/catalog/cards/global_mmlu/nl/college_medicine.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/nl 2026-01-06T13:30:33,003 copying build/lib/unitxt/catalog/cards/global_mmlu/nl/college_mathematics.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/nl 2026-01-06T13:30:33,005 copying build/lib/unitxt/catalog/cards/global_mmlu/nl/high_school_microeconomics.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/nl 2026-01-06T13:30:33,007 copying build/lib/unitxt/catalog/cards/global_mmlu/nl/anatomy.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/nl 2026-01-06T13:30:33,010 copying build/lib/unitxt/catalog/cards/global_mmlu/nl/world_religions.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/nl 2026-01-06T13:30:33,012 copying build/lib/unitxt/catalog/cards/global_mmlu/nl/management.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/nl 2026-01-06T13:30:33,014 copying build/lib/unitxt/catalog/cards/global_mmlu/nl/moral_scenarios.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/nl 2026-01-06T13:30:33,016 copying build/lib/unitxt/catalog/cards/global_mmlu/nl/global_facts.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/nl 2026-01-06T13:30:33,018 copying build/lib/unitxt/catalog/cards/global_mmlu/nl/miscellaneous.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/nl 2026-01-06T13:30:33,020 copying build/lib/unitxt/catalog/cards/global_mmlu/nl/clinical_knowledge.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/nl 2026-01-06T13:30:33,022 copying build/lib/unitxt/catalog/cards/global_mmlu/nl/high_school_biology.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/nl 2026-01-06T13:30:33,024 copying build/lib/unitxt/catalog/cards/global_mmlu/nl/prehistory.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/nl 2026-01-06T13:30:33,026 copying build/lib/unitxt/catalog/cards/global_mmlu/nl/high_school_us_history.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/nl 2026-01-06T13:30:33,028 copying build/lib/unitxt/catalog/cards/global_mmlu/nl/international_law.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/nl 2026-01-06T13:30:33,030 copying build/lib/unitxt/catalog/cards/global_mmlu/nl/college_computer_science.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/nl 2026-01-06T13:30:33,032 copying build/lib/unitxt/catalog/cards/global_mmlu/nl/astronomy.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/nl 2026-01-06T13:30:33,035 copying build/lib/unitxt/catalog/cards/global_mmlu/nl/high_school_european_history.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/nl 2026-01-06T13:30:33,037 copying build/lib/unitxt/catalog/cards/global_mmlu/nl/electrical_engineering.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/nl 2026-01-06T13:30:33,039 copying build/lib/unitxt/catalog/cards/global_mmlu/nl/nutrition.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/nl 2026-01-06T13:30:33,041 copying build/lib/unitxt/catalog/cards/global_mmlu/nl/abstract_algebra.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/nl 2026-01-06T13:30:33,043 copying build/lib/unitxt/catalog/cards/global_mmlu/nl/professional_medicine.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/nl 2026-01-06T13:30:33,045 copying build/lib/unitxt/catalog/cards/global_mmlu/nl/human_sexuality.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/nl 2026-01-06T13:30:33,047 copying build/lib/unitxt/catalog/cards/global_mmlu/nl/business_ethics.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/nl 2026-01-06T13:30:33,050 copying build/lib/unitxt/catalog/cards/global_mmlu/nl/high_school_chemistry.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/nl 2026-01-06T13:30:33,052 copying build/lib/unitxt/catalog/cards/global_mmlu/nl/logical_fallacies.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/nl 2026-01-06T13:30:33,054 copying build/lib/unitxt/catalog/cards/global_mmlu/nl/formal_logic.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/nl 2026-01-06T13:30:33,056 copying build/lib/unitxt/catalog/cards/global_mmlu/nl/high_school_psychology.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/nl 2026-01-06T13:30:33,059 copying build/lib/unitxt/catalog/cards/global_mmlu/nl/medical_genetics.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/nl 2026-01-06T13:30:33,061 copying build/lib/unitxt/catalog/cards/global_mmlu/nl/security_studies.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/nl 2026-01-06T13:30:33,063 copying build/lib/unitxt/catalog/cards/global_mmlu/nl/high_school_macroeconomics.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/nl 2026-01-06T13:30:33,065 copying build/lib/unitxt/catalog/cards/global_mmlu/nl/professional_law.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/nl 2026-01-06T13:30:33,067 copying build/lib/unitxt/catalog/cards/global_mmlu/nl/high_school_physics.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/nl 2026-01-06T13:30:33,069 copying build/lib/unitxt/catalog/cards/global_mmlu/nl/econometrics.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/nl 2026-01-06T13:30:33,071 copying build/lib/unitxt/catalog/cards/global_mmlu/nl/sociology.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/nl 2026-01-06T13:30:33,074 copying build/lib/unitxt/catalog/cards/global_mmlu/nl/moral_disputes.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/nl 2026-01-06T13:30:33,076 copying build/lib/unitxt/catalog/cards/global_mmlu/nl/college_chemistry.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/nl 2026-01-06T13:30:33,078 copying build/lib/unitxt/catalog/cards/global_mmlu/nl/high_school_geography.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/nl 2026-01-06T13:30:33,080 copying build/lib/unitxt/catalog/cards/global_mmlu/nl/jurisprudence.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/nl 2026-01-06T13:30:33,082 copying build/lib/unitxt/catalog/cards/global_mmlu/nl/high_school_statistics.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/nl 2026-01-06T13:30:33,084 copying build/lib/unitxt/catalog/cards/global_mmlu/nl/professional_accounting.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/nl 2026-01-06T13:30:33,086 copying build/lib/unitxt/catalog/cards/global_mmlu/nl/us_foreign_policy.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/nl 2026-01-06T13:30:33,088 copying build/lib/unitxt/catalog/cards/global_mmlu/nl/professional_psychology.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/nl 2026-01-06T13:30:33,091 copying build/lib/unitxt/catalog/cards/global_mmlu/nl/public_relations.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/nl 2026-01-06T13:30:33,093 copying build/lib/unitxt/catalog/cards/global_mmlu/nl/computer_security.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/nl 2026-01-06T13:30:33,095 copying build/lib/unitxt/catalog/cards/global_mmlu/nl/philosophy.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/nl 2026-01-06T13:30:33,097 copying build/lib/unitxt/catalog/cards/global_mmlu/nl/virology.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/nl 2026-01-06T13:30:33,099 copying build/lib/unitxt/catalog/cards/global_mmlu/nl/marketing.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/nl 2026-01-06T13:30:33,101 copying build/lib/unitxt/catalog/cards/global_mmlu/nl/high_school_world_history.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/nl 2026-01-06T13:30:33,103 copying build/lib/unitxt/catalog/cards/global_mmlu/nl/machine_learning.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/nl 2026-01-06T13:30:33,106 copying build/lib/unitxt/catalog/cards/global_mmlu/nl/high_school_government_and_politics.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/nl 2026-01-06T13:30:33,108 copying build/lib/unitxt/catalog/cards/global_mmlu/nl/conceptual_physics.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/nl 2026-01-06T13:30:33,110 copying build/lib/unitxt/catalog/cards/global_mmlu/nl/college_biology.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/nl 2026-01-06T13:30:33,112 copying build/lib/unitxt/catalog/cards/global_mmlu/nl/high_school_mathematics.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/nl 2026-01-06T13:30:33,116 creating build/bdist.linux-armv7l/wheel/unitxt/catalog/cards/global_mmlu/bn 2026-01-06T13:30:33,117 copying build/lib/unitxt/catalog/cards/global_mmlu/bn/elementary_mathematics.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/bn 2026-01-06T13:30:33,120 copying build/lib/unitxt/catalog/cards/global_mmlu/bn/human_aging.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/bn 2026-01-06T13:30:33,122 copying build/lib/unitxt/catalog/cards/global_mmlu/bn/high_school_computer_science.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/bn 2026-01-06T13:30:33,124 copying build/lib/unitxt/catalog/cards/global_mmlu/bn/college_physics.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/bn 2026-01-06T13:30:33,127 copying build/lib/unitxt/catalog/cards/global_mmlu/bn/college_medicine.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/bn 2026-01-06T13:30:33,129 copying build/lib/unitxt/catalog/cards/global_mmlu/bn/college_mathematics.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/bn 2026-01-06T13:30:33,131 copying build/lib/unitxt/catalog/cards/global_mmlu/bn/high_school_microeconomics.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/bn 2026-01-06T13:30:33,133 copying build/lib/unitxt/catalog/cards/global_mmlu/bn/anatomy.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/bn 2026-01-06T13:30:33,135 copying build/lib/unitxt/catalog/cards/global_mmlu/bn/world_religions.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/bn 2026-01-06T13:30:33,138 copying build/lib/unitxt/catalog/cards/global_mmlu/bn/management.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/bn 2026-01-06T13:30:33,140 copying build/lib/unitxt/catalog/cards/global_mmlu/bn/moral_scenarios.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/bn 2026-01-06T13:30:33,142 copying build/lib/unitxt/catalog/cards/global_mmlu/bn/global_facts.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/bn 2026-01-06T13:30:33,144 copying build/lib/unitxt/catalog/cards/global_mmlu/bn/miscellaneous.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/bn 2026-01-06T13:30:33,146 copying build/lib/unitxt/catalog/cards/global_mmlu/bn/clinical_knowledge.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/bn 2026-01-06T13:30:33,148 copying build/lib/unitxt/catalog/cards/global_mmlu/bn/high_school_biology.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/bn 2026-01-06T13:30:33,150 copying build/lib/unitxt/catalog/cards/global_mmlu/bn/prehistory.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/bn 2026-01-06T13:30:33,153 copying build/lib/unitxt/catalog/cards/global_mmlu/bn/high_school_us_history.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/bn 2026-01-06T13:30:33,155 copying build/lib/unitxt/catalog/cards/global_mmlu/bn/international_law.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/bn 2026-01-06T13:30:33,157 copying build/lib/unitxt/catalog/cards/global_mmlu/bn/college_computer_science.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/bn 2026-01-06T13:30:33,160 copying build/lib/unitxt/catalog/cards/global_mmlu/bn/astronomy.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/bn 2026-01-06T13:30:33,162 copying build/lib/unitxt/catalog/cards/global_mmlu/bn/high_school_european_history.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/bn 2026-01-06T13:30:33,164 copying build/lib/unitxt/catalog/cards/global_mmlu/bn/electrical_engineering.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/bn 2026-01-06T13:30:33,166 copying build/lib/unitxt/catalog/cards/global_mmlu/bn/nutrition.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/bn 2026-01-06T13:30:33,169 copying build/lib/unitxt/catalog/cards/global_mmlu/bn/abstract_algebra.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/bn 2026-01-06T13:30:33,171 copying build/lib/unitxt/catalog/cards/global_mmlu/bn/professional_medicine.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/bn 2026-01-06T13:30:33,173 copying build/lib/unitxt/catalog/cards/global_mmlu/bn/human_sexuality.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/bn 2026-01-06T13:30:33,175 copying build/lib/unitxt/catalog/cards/global_mmlu/bn/business_ethics.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/bn 2026-01-06T13:30:33,177 copying build/lib/unitxt/catalog/cards/global_mmlu/bn/high_school_chemistry.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/bn 2026-01-06T13:30:33,179 copying build/lib/unitxt/catalog/cards/global_mmlu/bn/logical_fallacies.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/bn 2026-01-06T13:30:33,182 copying build/lib/unitxt/catalog/cards/global_mmlu/bn/formal_logic.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/bn 2026-01-06T13:30:33,184 copying build/lib/unitxt/catalog/cards/global_mmlu/bn/high_school_psychology.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/bn 2026-01-06T13:30:33,186 copying build/lib/unitxt/catalog/cards/global_mmlu/bn/medical_genetics.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/bn 2026-01-06T13:30:33,188 copying build/lib/unitxt/catalog/cards/global_mmlu/bn/security_studies.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/bn 2026-01-06T13:30:33,191 copying build/lib/unitxt/catalog/cards/global_mmlu/bn/high_school_macroeconomics.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/bn 2026-01-06T13:30:33,193 copying build/lib/unitxt/catalog/cards/global_mmlu/bn/professional_law.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/bn 2026-01-06T13:30:33,195 copying build/lib/unitxt/catalog/cards/global_mmlu/bn/high_school_physics.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/bn 2026-01-06T13:30:33,197 copying build/lib/unitxt/catalog/cards/global_mmlu/bn/econometrics.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/bn 2026-01-06T13:30:33,200 copying build/lib/unitxt/catalog/cards/global_mmlu/bn/sociology.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/bn 2026-01-06T13:30:33,202 copying build/lib/unitxt/catalog/cards/global_mmlu/bn/moral_disputes.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/bn 2026-01-06T13:30:33,204 copying build/lib/unitxt/catalog/cards/global_mmlu/bn/college_chemistry.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/bn 2026-01-06T13:30:33,206 copying build/lib/unitxt/catalog/cards/global_mmlu/bn/high_school_geography.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/bn 2026-01-06T13:30:33,208 copying build/lib/unitxt/catalog/cards/global_mmlu/bn/jurisprudence.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/bn 2026-01-06T13:30:33,211 copying build/lib/unitxt/catalog/cards/global_mmlu/bn/high_school_statistics.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/bn 2026-01-06T13:30:33,213 copying build/lib/unitxt/catalog/cards/global_mmlu/bn/professional_accounting.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/bn 2026-01-06T13:30:33,215 copying build/lib/unitxt/catalog/cards/global_mmlu/bn/us_foreign_policy.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/bn 2026-01-06T13:30:33,217 copying build/lib/unitxt/catalog/cards/global_mmlu/bn/professional_psychology.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/bn 2026-01-06T13:30:33,219 copying build/lib/unitxt/catalog/cards/global_mmlu/bn/public_relations.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/bn 2026-01-06T13:30:33,221 copying build/lib/unitxt/catalog/cards/global_mmlu/bn/computer_security.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/bn 2026-01-06T13:30:33,223 copying build/lib/unitxt/catalog/cards/global_mmlu/bn/philosophy.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/bn 2026-01-06T13:30:33,226 copying build/lib/unitxt/catalog/cards/global_mmlu/bn/virology.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/bn 2026-01-06T13:30:33,228 copying build/lib/unitxt/catalog/cards/global_mmlu/bn/marketing.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/bn 2026-01-06T13:30:33,230 copying build/lib/unitxt/catalog/cards/global_mmlu/bn/high_school_world_history.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/bn 2026-01-06T13:30:33,232 copying build/lib/unitxt/catalog/cards/global_mmlu/bn/machine_learning.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/bn 2026-01-06T13:30:33,234 copying build/lib/unitxt/catalog/cards/global_mmlu/bn/high_school_government_and_politics.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/bn 2026-01-06T13:30:33,236 copying build/lib/unitxt/catalog/cards/global_mmlu/bn/conceptual_physics.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/bn 2026-01-06T13:30:33,238 copying build/lib/unitxt/catalog/cards/global_mmlu/bn/college_biology.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/bn 2026-01-06T13:30:33,240 copying build/lib/unitxt/catalog/cards/global_mmlu/bn/high_school_mathematics.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/bn 2026-01-06T13:30:33,244 creating build/bdist.linux-armv7l/wheel/unitxt/catalog/cards/global_mmlu/sr 2026-01-06T13:30:33,245 copying build/lib/unitxt/catalog/cards/global_mmlu/sr/elementary_mathematics.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/sr 2026-01-06T13:30:33,248 copying build/lib/unitxt/catalog/cards/global_mmlu/sr/human_aging.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/sr 2026-01-06T13:30:33,250 copying build/lib/unitxt/catalog/cards/global_mmlu/sr/high_school_computer_science.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/sr 2026-01-06T13:30:33,252 copying build/lib/unitxt/catalog/cards/global_mmlu/sr/college_physics.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/sr 2026-01-06T13:30:33,254 copying build/lib/unitxt/catalog/cards/global_mmlu/sr/college_medicine.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/sr 2026-01-06T13:30:33,256 copying build/lib/unitxt/catalog/cards/global_mmlu/sr/college_mathematics.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/sr 2026-01-06T13:30:33,258 copying build/lib/unitxt/catalog/cards/global_mmlu/sr/high_school_microeconomics.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/sr 2026-01-06T13:30:33,260 copying build/lib/unitxt/catalog/cards/global_mmlu/sr/anatomy.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/sr 2026-01-06T13:30:33,263 copying build/lib/unitxt/catalog/cards/global_mmlu/sr/world_religions.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/sr 2026-01-06T13:30:33,265 copying build/lib/unitxt/catalog/cards/global_mmlu/sr/management.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/sr 2026-01-06T13:30:33,267 copying build/lib/unitxt/catalog/cards/global_mmlu/sr/moral_scenarios.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/sr 2026-01-06T13:30:33,269 copying build/lib/unitxt/catalog/cards/global_mmlu/sr/global_facts.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/sr 2026-01-06T13:30:33,271 copying build/lib/unitxt/catalog/cards/global_mmlu/sr/miscellaneous.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/sr 2026-01-06T13:30:33,273 copying build/lib/unitxt/catalog/cards/global_mmlu/sr/clinical_knowledge.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/sr 2026-01-06T13:30:33,276 copying build/lib/unitxt/catalog/cards/global_mmlu/sr/high_school_biology.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/sr 2026-01-06T13:30:33,278 copying build/lib/unitxt/catalog/cards/global_mmlu/sr/prehistory.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/sr 2026-01-06T13:30:33,280 copying build/lib/unitxt/catalog/cards/global_mmlu/sr/high_school_us_history.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/sr 2026-01-06T13:30:33,282 copying build/lib/unitxt/catalog/cards/global_mmlu/sr/international_law.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/sr 2026-01-06T13:30:33,285 copying build/lib/unitxt/catalog/cards/global_mmlu/sr/college_computer_science.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/sr 2026-01-06T13:30:33,287 copying build/lib/unitxt/catalog/cards/global_mmlu/sr/astronomy.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/sr 2026-01-06T13:30:33,289 copying build/lib/unitxt/catalog/cards/global_mmlu/sr/high_school_european_history.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/sr 2026-01-06T13:30:33,291 copying build/lib/unitxt/catalog/cards/global_mmlu/sr/electrical_engineering.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/sr 2026-01-06T13:30:33,293 copying build/lib/unitxt/catalog/cards/global_mmlu/sr/nutrition.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/sr 2026-01-06T13:30:33,296 copying build/lib/unitxt/catalog/cards/global_mmlu/sr/abstract_algebra.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/sr 2026-01-06T13:30:33,298 copying build/lib/unitxt/catalog/cards/global_mmlu/sr/professional_medicine.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/sr 2026-01-06T13:30:33,300 copying build/lib/unitxt/catalog/cards/global_mmlu/sr/human_sexuality.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/sr 2026-01-06T13:30:33,302 copying build/lib/unitxt/catalog/cards/global_mmlu/sr/business_ethics.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/sr 2026-01-06T13:30:33,304 copying build/lib/unitxt/catalog/cards/global_mmlu/sr/high_school_chemistry.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/sr 2026-01-06T13:30:33,306 copying build/lib/unitxt/catalog/cards/global_mmlu/sr/logical_fallacies.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/sr 2026-01-06T13:30:33,308 copying build/lib/unitxt/catalog/cards/global_mmlu/sr/formal_logic.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/sr 2026-01-06T13:30:33,310 copying build/lib/unitxt/catalog/cards/global_mmlu/sr/high_school_psychology.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/sr 2026-01-06T13:30:33,312 copying build/lib/unitxt/catalog/cards/global_mmlu/sr/medical_genetics.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/sr 2026-01-06T13:30:33,314 copying build/lib/unitxt/catalog/cards/global_mmlu/sr/security_studies.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/sr 2026-01-06T13:30:33,316 copying build/lib/unitxt/catalog/cards/global_mmlu/sr/high_school_macroeconomics.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/sr 2026-01-06T13:30:33,319 copying build/lib/unitxt/catalog/cards/global_mmlu/sr/professional_law.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/sr 2026-01-06T13:30:33,321 copying build/lib/unitxt/catalog/cards/global_mmlu/sr/high_school_physics.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/sr 2026-01-06T13:30:33,323 copying build/lib/unitxt/catalog/cards/global_mmlu/sr/econometrics.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/sr 2026-01-06T13:30:33,325 copying build/lib/unitxt/catalog/cards/global_mmlu/sr/sociology.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/sr 2026-01-06T13:30:33,327 copying build/lib/unitxt/catalog/cards/global_mmlu/sr/moral_disputes.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/sr 2026-01-06T13:30:33,329 copying build/lib/unitxt/catalog/cards/global_mmlu/sr/college_chemistry.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/sr 2026-01-06T13:30:33,331 copying build/lib/unitxt/catalog/cards/global_mmlu/sr/high_school_geography.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/sr 2026-01-06T13:30:33,333 copying build/lib/unitxt/catalog/cards/global_mmlu/sr/jurisprudence.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/sr 2026-01-06T13:30:33,336 copying build/lib/unitxt/catalog/cards/global_mmlu/sr/high_school_statistics.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/sr 2026-01-06T13:30:33,338 copying build/lib/unitxt/catalog/cards/global_mmlu/sr/professional_accounting.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/sr 2026-01-06T13:30:33,340 copying build/lib/unitxt/catalog/cards/global_mmlu/sr/us_foreign_policy.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/sr 2026-01-06T13:30:33,342 copying build/lib/unitxt/catalog/cards/global_mmlu/sr/professional_psychology.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/sr 2026-01-06T13:30:33,344 copying build/lib/unitxt/catalog/cards/global_mmlu/sr/public_relations.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/sr 2026-01-06T13:30:33,346 copying build/lib/unitxt/catalog/cards/global_mmlu/sr/computer_security.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/sr 2026-01-06T13:30:33,349 copying build/lib/unitxt/catalog/cards/global_mmlu/sr/philosophy.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/sr 2026-01-06T13:30:33,351 copying build/lib/unitxt/catalog/cards/global_mmlu/sr/virology.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/sr 2026-01-06T13:30:33,353 copying build/lib/unitxt/catalog/cards/global_mmlu/sr/marketing.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/sr 2026-01-06T13:30:33,355 copying build/lib/unitxt/catalog/cards/global_mmlu/sr/high_school_world_history.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/sr 2026-01-06T13:30:33,357 copying build/lib/unitxt/catalog/cards/global_mmlu/sr/machine_learning.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/sr 2026-01-06T13:30:33,359 copying build/lib/unitxt/catalog/cards/global_mmlu/sr/high_school_government_and_politics.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/sr 2026-01-06T13:30:33,361 copying build/lib/unitxt/catalog/cards/global_mmlu/sr/conceptual_physics.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/sr 2026-01-06T13:30:33,363 copying build/lib/unitxt/catalog/cards/global_mmlu/sr/college_biology.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/sr 2026-01-06T13:30:33,365 copying build/lib/unitxt/catalog/cards/global_mmlu/sr/high_school_mathematics.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/sr 2026-01-06T13:30:33,369 creating build/bdist.linux-armv7l/wheel/unitxt/catalog/cards/global_mmlu/vi 2026-01-06T13:30:33,370 copying build/lib/unitxt/catalog/cards/global_mmlu/vi/elementary_mathematics.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/vi 2026-01-06T13:30:33,372 copying build/lib/unitxt/catalog/cards/global_mmlu/vi/human_aging.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/vi 2026-01-06T13:30:33,375 copying build/lib/unitxt/catalog/cards/global_mmlu/vi/high_school_computer_science.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/vi 2026-01-06T13:30:33,377 copying build/lib/unitxt/catalog/cards/global_mmlu/vi/college_physics.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/vi 2026-01-06T13:30:33,379 copying build/lib/unitxt/catalog/cards/global_mmlu/vi/college_medicine.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/vi 2026-01-06T13:30:33,381 copying build/lib/unitxt/catalog/cards/global_mmlu/vi/college_mathematics.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/vi 2026-01-06T13:30:33,383 copying build/lib/unitxt/catalog/cards/global_mmlu/vi/high_school_microeconomics.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/vi 2026-01-06T13:30:33,386 copying build/lib/unitxt/catalog/cards/global_mmlu/vi/anatomy.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/vi 2026-01-06T13:30:33,388 copying build/lib/unitxt/catalog/cards/global_mmlu/vi/world_religions.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/vi 2026-01-06T13:30:33,390 copying build/lib/unitxt/catalog/cards/global_mmlu/vi/management.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/vi 2026-01-06T13:30:33,392 copying build/lib/unitxt/catalog/cards/global_mmlu/vi/moral_scenarios.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/vi 2026-01-06T13:30:33,394 copying build/lib/unitxt/catalog/cards/global_mmlu/vi/global_facts.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/vi 2026-01-06T13:30:33,397 copying build/lib/unitxt/catalog/cards/global_mmlu/vi/miscellaneous.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/vi 2026-01-06T13:30:33,399 copying build/lib/unitxt/catalog/cards/global_mmlu/vi/clinical_knowledge.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/vi 2026-01-06T13:30:33,401 copying build/lib/unitxt/catalog/cards/global_mmlu/vi/high_school_biology.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/vi 2026-01-06T13:30:33,403 copying build/lib/unitxt/catalog/cards/global_mmlu/vi/prehistory.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/vi 2026-01-06T13:30:33,405 copying build/lib/unitxt/catalog/cards/global_mmlu/vi/high_school_us_history.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/vi 2026-01-06T13:30:33,407 copying build/lib/unitxt/catalog/cards/global_mmlu/vi/international_law.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/vi 2026-01-06T13:30:33,410 copying build/lib/unitxt/catalog/cards/global_mmlu/vi/college_computer_science.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/vi 2026-01-06T13:30:33,411 copying build/lib/unitxt/catalog/cards/global_mmlu/vi/astronomy.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/vi 2026-01-06T13:30:33,414 copying build/lib/unitxt/catalog/cards/global_mmlu/vi/high_school_european_history.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/vi 2026-01-06T13:30:33,416 copying build/lib/unitxt/catalog/cards/global_mmlu/vi/electrical_engineering.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/vi 2026-01-06T13:30:33,418 copying build/lib/unitxt/catalog/cards/global_mmlu/vi/nutrition.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/vi 2026-01-06T13:30:33,420 copying build/lib/unitxt/catalog/cards/global_mmlu/vi/abstract_algebra.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/vi 2026-01-06T13:30:33,422 copying build/lib/unitxt/catalog/cards/global_mmlu/vi/professional_medicine.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/vi 2026-01-06T13:30:33,424 copying build/lib/unitxt/catalog/cards/global_mmlu/vi/human_sexuality.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/vi 2026-01-06T13:30:33,426 copying build/lib/unitxt/catalog/cards/global_mmlu/vi/business_ethics.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/vi 2026-01-06T13:30:33,428 copying build/lib/unitxt/catalog/cards/global_mmlu/vi/high_school_chemistry.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/vi 2026-01-06T13:30:33,430 copying build/lib/unitxt/catalog/cards/global_mmlu/vi/logical_fallacies.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/vi 2026-01-06T13:30:33,432 copying build/lib/unitxt/catalog/cards/global_mmlu/vi/formal_logic.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/vi 2026-01-06T13:30:33,434 copying build/lib/unitxt/catalog/cards/global_mmlu/vi/high_school_psychology.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/vi 2026-01-06T13:30:33,437 copying build/lib/unitxt/catalog/cards/global_mmlu/vi/medical_genetics.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/vi 2026-01-06T13:30:33,439 copying build/lib/unitxt/catalog/cards/global_mmlu/vi/security_studies.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/vi 2026-01-06T13:30:33,441 copying build/lib/unitxt/catalog/cards/global_mmlu/vi/high_school_macroeconomics.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/vi 2026-01-06T13:30:33,443 copying build/lib/unitxt/catalog/cards/global_mmlu/vi/professional_law.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/vi 2026-01-06T13:30:33,445 copying build/lib/unitxt/catalog/cards/global_mmlu/vi/high_school_physics.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/vi 2026-01-06T13:30:33,447 copying build/lib/unitxt/catalog/cards/global_mmlu/vi/econometrics.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/vi 2026-01-06T13:30:33,450 copying build/lib/unitxt/catalog/cards/global_mmlu/vi/sociology.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/vi 2026-01-06T13:30:33,452 copying build/lib/unitxt/catalog/cards/global_mmlu/vi/moral_disputes.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/vi 2026-01-06T13:30:33,454 copying build/lib/unitxt/catalog/cards/global_mmlu/vi/college_chemistry.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/vi 2026-01-06T13:30:33,456 copying build/lib/unitxt/catalog/cards/global_mmlu/vi/high_school_geography.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/vi 2026-01-06T13:30:33,458 copying build/lib/unitxt/catalog/cards/global_mmlu/vi/jurisprudence.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/vi 2026-01-06T13:30:33,460 copying build/lib/unitxt/catalog/cards/global_mmlu/vi/high_school_statistics.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/vi 2026-01-06T13:30:33,463 copying build/lib/unitxt/catalog/cards/global_mmlu/vi/professional_accounting.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/vi 2026-01-06T13:30:33,465 copying build/lib/unitxt/catalog/cards/global_mmlu/vi/us_foreign_policy.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/vi 2026-01-06T13:30:33,467 copying build/lib/unitxt/catalog/cards/global_mmlu/vi/professional_psychology.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/vi 2026-01-06T13:30:33,469 copying build/lib/unitxt/catalog/cards/global_mmlu/vi/public_relations.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/vi 2026-01-06T13:30:33,471 copying build/lib/unitxt/catalog/cards/global_mmlu/vi/computer_security.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/vi 2026-01-06T13:30:33,473 copying build/lib/unitxt/catalog/cards/global_mmlu/vi/philosophy.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/vi 2026-01-06T13:30:33,476 copying build/lib/unitxt/catalog/cards/global_mmlu/vi/virology.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/vi 2026-01-06T13:30:33,478 copying build/lib/unitxt/catalog/cards/global_mmlu/vi/marketing.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/vi 2026-01-06T13:30:33,480 copying build/lib/unitxt/catalog/cards/global_mmlu/vi/high_school_world_history.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/vi 2026-01-06T13:30:33,482 copying build/lib/unitxt/catalog/cards/global_mmlu/vi/machine_learning.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/vi 2026-01-06T13:30:33,484 copying build/lib/unitxt/catalog/cards/global_mmlu/vi/high_school_government_and_politics.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/vi 2026-01-06T13:30:33,487 copying build/lib/unitxt/catalog/cards/global_mmlu/vi/conceptual_physics.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/vi 2026-01-06T13:30:33,489 copying build/lib/unitxt/catalog/cards/global_mmlu/vi/college_biology.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/vi 2026-01-06T13:30:33,491 copying build/lib/unitxt/catalog/cards/global_mmlu/vi/high_school_mathematics.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/vi 2026-01-06T13:30:33,494 creating build/bdist.linux-armv7l/wheel/unitxt/catalog/cards/global_mmlu/fr 2026-01-06T13:30:33,496 copying build/lib/unitxt/catalog/cards/global_mmlu/fr/elementary_mathematics.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/fr 2026-01-06T13:30:33,498 copying build/lib/unitxt/catalog/cards/global_mmlu/fr/human_aging.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/fr 2026-01-06T13:30:33,500 copying build/lib/unitxt/catalog/cards/global_mmlu/fr/high_school_computer_science.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/fr 2026-01-06T13:30:33,502 copying build/lib/unitxt/catalog/cards/global_mmlu/fr/college_physics.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/fr 2026-01-06T13:30:33,505 copying build/lib/unitxt/catalog/cards/global_mmlu/fr/college_medicine.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/fr 2026-01-06T13:30:33,507 copying build/lib/unitxt/catalog/cards/global_mmlu/fr/college_mathematics.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/fr 2026-01-06T13:30:33,509 copying build/lib/unitxt/catalog/cards/global_mmlu/fr/high_school_microeconomics.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/fr 2026-01-06T13:30:33,511 copying build/lib/unitxt/catalog/cards/global_mmlu/fr/anatomy.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/fr 2026-01-06T13:30:33,513 copying build/lib/unitxt/catalog/cards/global_mmlu/fr/world_religions.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/fr 2026-01-06T13:30:33,515 copying build/lib/unitxt/catalog/cards/global_mmlu/fr/management.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/fr 2026-01-06T13:30:33,517 copying build/lib/unitxt/catalog/cards/global_mmlu/fr/moral_scenarios.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/fr 2026-01-06T13:30:33,519 copying build/lib/unitxt/catalog/cards/global_mmlu/fr/global_facts.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/fr 2026-01-06T13:30:33,522 copying build/lib/unitxt/catalog/cards/global_mmlu/fr/miscellaneous.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/fr 2026-01-06T13:30:33,524 copying build/lib/unitxt/catalog/cards/global_mmlu/fr/clinical_knowledge.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/fr 2026-01-06T13:30:33,526 copying build/lib/unitxt/catalog/cards/global_mmlu/fr/high_school_biology.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/fr 2026-01-06T13:30:33,528 copying build/lib/unitxt/catalog/cards/global_mmlu/fr/prehistory.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/fr 2026-01-06T13:30:33,530 copying build/lib/unitxt/catalog/cards/global_mmlu/fr/high_school_us_history.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/fr 2026-01-06T13:30:33,533 copying build/lib/unitxt/catalog/cards/global_mmlu/fr/international_law.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/fr 2026-01-06T13:30:33,535 copying build/lib/unitxt/catalog/cards/global_mmlu/fr/college_computer_science.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/fr 2026-01-06T13:30:33,537 copying build/lib/unitxt/catalog/cards/global_mmlu/fr/astronomy.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/fr 2026-01-06T13:30:33,539 copying build/lib/unitxt/catalog/cards/global_mmlu/fr/high_school_european_history.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/fr 2026-01-06T13:30:33,541 copying build/lib/unitxt/catalog/cards/global_mmlu/fr/electrical_engineering.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/fr 2026-01-06T13:30:33,543 copying build/lib/unitxt/catalog/cards/global_mmlu/fr/nutrition.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/fr 2026-01-06T13:30:33,545 copying build/lib/unitxt/catalog/cards/global_mmlu/fr/abstract_algebra.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/fr 2026-01-06T13:30:33,548 copying build/lib/unitxt/catalog/cards/global_mmlu/fr/professional_medicine.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/fr 2026-01-06T13:30:33,550 copying build/lib/unitxt/catalog/cards/global_mmlu/fr/human_sexuality.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/fr 2026-01-06T13:30:33,552 copying build/lib/unitxt/catalog/cards/global_mmlu/fr/business_ethics.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/fr 2026-01-06T13:30:33,553 copying build/lib/unitxt/catalog/cards/global_mmlu/fr/high_school_chemistry.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/fr 2026-01-06T13:30:33,555 copying build/lib/unitxt/catalog/cards/global_mmlu/fr/logical_fallacies.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/fr 2026-01-06T13:30:33,557 copying build/lib/unitxt/catalog/cards/global_mmlu/fr/formal_logic.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/fr 2026-01-06T13:30:33,559 copying build/lib/unitxt/catalog/cards/global_mmlu/fr/high_school_psychology.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/fr 2026-01-06T13:30:33,561 copying build/lib/unitxt/catalog/cards/global_mmlu/fr/medical_genetics.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/fr 2026-01-06T13:30:33,563 copying build/lib/unitxt/catalog/cards/global_mmlu/fr/security_studies.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/fr 2026-01-06T13:30:33,565 copying build/lib/unitxt/catalog/cards/global_mmlu/fr/high_school_macroeconomics.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/fr 2026-01-06T13:30:33,566 copying build/lib/unitxt/catalog/cards/global_mmlu/fr/professional_law.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/fr 2026-01-06T13:30:33,568 copying build/lib/unitxt/catalog/cards/global_mmlu/fr/high_school_physics.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/fr 2026-01-06T13:30:33,570 copying build/lib/unitxt/catalog/cards/global_mmlu/fr/econometrics.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/fr 2026-01-06T13:30:33,572 copying build/lib/unitxt/catalog/cards/global_mmlu/fr/sociology.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/fr 2026-01-06T13:30:33,574 copying build/lib/unitxt/catalog/cards/global_mmlu/fr/moral_disputes.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/fr 2026-01-06T13:30:33,576 copying build/lib/unitxt/catalog/cards/global_mmlu/fr/college_chemistry.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/fr 2026-01-06T13:30:33,578 copying build/lib/unitxt/catalog/cards/global_mmlu/fr/high_school_geography.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/fr 2026-01-06T13:30:33,579 copying build/lib/unitxt/catalog/cards/global_mmlu/fr/jurisprudence.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/fr 2026-01-06T13:30:33,581 copying build/lib/unitxt/catalog/cards/global_mmlu/fr/high_school_statistics.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/fr 2026-01-06T13:30:33,583 copying build/lib/unitxt/catalog/cards/global_mmlu/fr/professional_accounting.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/fr 2026-01-06T13:30:33,585 copying build/lib/unitxt/catalog/cards/global_mmlu/fr/us_foreign_policy.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/fr 2026-01-06T13:30:33,587 copying build/lib/unitxt/catalog/cards/global_mmlu/fr/professional_psychology.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/fr 2026-01-06T13:30:33,589 copying build/lib/unitxt/catalog/cards/global_mmlu/fr/public_relations.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/fr 2026-01-06T13:30:33,591 copying build/lib/unitxt/catalog/cards/global_mmlu/fr/computer_security.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/fr 2026-01-06T13:30:33,593 copying build/lib/unitxt/catalog/cards/global_mmlu/fr/philosophy.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/fr 2026-01-06T13:30:33,595 copying build/lib/unitxt/catalog/cards/global_mmlu/fr/virology.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/fr 2026-01-06T13:30:33,597 copying build/lib/unitxt/catalog/cards/global_mmlu/fr/marketing.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/fr 2026-01-06T13:30:33,598 copying build/lib/unitxt/catalog/cards/global_mmlu/fr/high_school_world_history.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/fr 2026-01-06T13:30:33,600 copying build/lib/unitxt/catalog/cards/global_mmlu/fr/machine_learning.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/fr 2026-01-06T13:30:33,602 copying build/lib/unitxt/catalog/cards/global_mmlu/fr/high_school_government_and_politics.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/fr 2026-01-06T13:30:33,604 copying build/lib/unitxt/catalog/cards/global_mmlu/fr/conceptual_physics.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/fr 2026-01-06T13:30:33,606 copying build/lib/unitxt/catalog/cards/global_mmlu/fr/college_biology.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/fr 2026-01-06T13:30:33,608 copying build/lib/unitxt/catalog/cards/global_mmlu/fr/high_school_mathematics.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/fr 2026-01-06T13:30:33,611 creating build/bdist.linux-armv7l/wheel/unitxt/catalog/cards/global_mmlu/ig 2026-01-06T13:30:33,612 copying build/lib/unitxt/catalog/cards/global_mmlu/ig/elementary_mathematics.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/ig 2026-01-06T13:30:33,614 copying build/lib/unitxt/catalog/cards/global_mmlu/ig/human_aging.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/ig 2026-01-06T13:30:33,616 copying build/lib/unitxt/catalog/cards/global_mmlu/ig/high_school_computer_science.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/ig 2026-01-06T13:30:33,618 copying build/lib/unitxt/catalog/cards/global_mmlu/ig/college_physics.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/ig 2026-01-06T13:30:33,620 copying build/lib/unitxt/catalog/cards/global_mmlu/ig/college_medicine.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/ig 2026-01-06T13:30:33,621 copying build/lib/unitxt/catalog/cards/global_mmlu/ig/college_mathematics.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/ig 2026-01-06T13:30:33,623 copying build/lib/unitxt/catalog/cards/global_mmlu/ig/high_school_microeconomics.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/ig 2026-01-06T13:30:33,625 copying build/lib/unitxt/catalog/cards/global_mmlu/ig/anatomy.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/ig 2026-01-06T13:30:33,627 copying build/lib/unitxt/catalog/cards/global_mmlu/ig/world_religions.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/ig 2026-01-06T13:30:33,629 copying build/lib/unitxt/catalog/cards/global_mmlu/ig/management.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/ig 2026-01-06T13:30:33,631 copying build/lib/unitxt/catalog/cards/global_mmlu/ig/moral_scenarios.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/ig 2026-01-06T13:30:33,633 copying build/lib/unitxt/catalog/cards/global_mmlu/ig/global_facts.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/ig 2026-01-06T13:30:33,635 copying build/lib/unitxt/catalog/cards/global_mmlu/ig/miscellaneous.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/ig 2026-01-06T13:30:33,637 copying build/lib/unitxt/catalog/cards/global_mmlu/ig/clinical_knowledge.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/ig 2026-01-06T13:30:33,639 copying build/lib/unitxt/catalog/cards/global_mmlu/ig/high_school_biology.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/ig 2026-01-06T13:30:33,641 copying build/lib/unitxt/catalog/cards/global_mmlu/ig/prehistory.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/ig 2026-01-06T13:30:33,643 copying build/lib/unitxt/catalog/cards/global_mmlu/ig/high_school_us_history.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/ig 2026-01-06T13:30:33,645 copying build/lib/unitxt/catalog/cards/global_mmlu/ig/international_law.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/ig 2026-01-06T13:30:33,647 copying build/lib/unitxt/catalog/cards/global_mmlu/ig/college_computer_science.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/ig 2026-01-06T13:30:33,649 copying build/lib/unitxt/catalog/cards/global_mmlu/ig/astronomy.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/ig 2026-01-06T13:30:33,651 copying build/lib/unitxt/catalog/cards/global_mmlu/ig/high_school_european_history.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/ig 2026-01-06T13:30:33,652 copying build/lib/unitxt/catalog/cards/global_mmlu/ig/electrical_engineering.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/ig 2026-01-06T13:30:33,654 copying build/lib/unitxt/catalog/cards/global_mmlu/ig/nutrition.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/ig 2026-01-06T13:30:33,656 copying build/lib/unitxt/catalog/cards/global_mmlu/ig/abstract_algebra.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/ig 2026-01-06T13:30:33,658 copying build/lib/unitxt/catalog/cards/global_mmlu/ig/professional_medicine.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/ig 2026-01-06T13:30:33,660 copying build/lib/unitxt/catalog/cards/global_mmlu/ig/human_sexuality.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/ig 2026-01-06T13:30:33,662 copying build/lib/unitxt/catalog/cards/global_mmlu/ig/business_ethics.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/ig 2026-01-06T13:30:33,664 copying build/lib/unitxt/catalog/cards/global_mmlu/ig/high_school_chemistry.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/ig 2026-01-06T13:30:33,665 copying build/lib/unitxt/catalog/cards/global_mmlu/ig/logical_fallacies.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/ig 2026-01-06T13:30:33,667 copying build/lib/unitxt/catalog/cards/global_mmlu/ig/formal_logic.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/ig 2026-01-06T13:30:33,669 copying build/lib/unitxt/catalog/cards/global_mmlu/ig/high_school_psychology.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/ig 2026-01-06T13:30:33,671 copying build/lib/unitxt/catalog/cards/global_mmlu/ig/medical_genetics.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/ig 2026-01-06T13:30:33,673 copying build/lib/unitxt/catalog/cards/global_mmlu/ig/security_studies.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/ig 2026-01-06T13:30:33,675 copying build/lib/unitxt/catalog/cards/global_mmlu/ig/high_school_macroeconomics.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/ig 2026-01-06T13:30:33,677 copying build/lib/unitxt/catalog/cards/global_mmlu/ig/professional_law.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/ig 2026-01-06T13:30:33,678 copying build/lib/unitxt/catalog/cards/global_mmlu/ig/high_school_physics.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/ig 2026-01-06T13:30:33,680 copying build/lib/unitxt/catalog/cards/global_mmlu/ig/econometrics.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/ig 2026-01-06T13:30:33,682 copying build/lib/unitxt/catalog/cards/global_mmlu/ig/sociology.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/ig 2026-01-06T13:30:33,684 copying build/lib/unitxt/catalog/cards/global_mmlu/ig/moral_disputes.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/ig 2026-01-06T13:30:33,686 copying build/lib/unitxt/catalog/cards/global_mmlu/ig/college_chemistry.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/ig 2026-01-06T13:30:33,688 copying build/lib/unitxt/catalog/cards/global_mmlu/ig/high_school_geography.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/ig 2026-01-06T13:30:33,689 copying build/lib/unitxt/catalog/cards/global_mmlu/ig/jurisprudence.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/ig 2026-01-06T13:30:33,691 copying build/lib/unitxt/catalog/cards/global_mmlu/ig/high_school_statistics.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/ig 2026-01-06T13:30:33,693 copying build/lib/unitxt/catalog/cards/global_mmlu/ig/professional_accounting.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/ig 2026-01-06T13:30:33,695 copying build/lib/unitxt/catalog/cards/global_mmlu/ig/us_foreign_policy.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/ig 2026-01-06T13:30:33,697 copying build/lib/unitxt/catalog/cards/global_mmlu/ig/professional_psychology.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/ig 2026-01-06T13:30:33,699 copying build/lib/unitxt/catalog/cards/global_mmlu/ig/public_relations.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/ig 2026-01-06T13:30:33,701 copying build/lib/unitxt/catalog/cards/global_mmlu/ig/computer_security.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/ig 2026-01-06T13:30:33,702 copying build/lib/unitxt/catalog/cards/global_mmlu/ig/philosophy.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/ig 2026-01-06T13:30:33,704 copying build/lib/unitxt/catalog/cards/global_mmlu/ig/virology.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/ig 2026-01-06T13:30:33,706 copying build/lib/unitxt/catalog/cards/global_mmlu/ig/marketing.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/ig 2026-01-06T13:30:33,708 copying build/lib/unitxt/catalog/cards/global_mmlu/ig/high_school_world_history.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/ig 2026-01-06T13:30:33,710 copying build/lib/unitxt/catalog/cards/global_mmlu/ig/machine_learning.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/ig 2026-01-06T13:30:33,712 copying build/lib/unitxt/catalog/cards/global_mmlu/ig/high_school_government_and_politics.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/ig 2026-01-06T13:30:33,714 copying build/lib/unitxt/catalog/cards/global_mmlu/ig/conceptual_physics.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/ig 2026-01-06T13:30:33,716 copying build/lib/unitxt/catalog/cards/global_mmlu/ig/college_biology.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/ig 2026-01-06T13:30:33,718 copying build/lib/unitxt/catalog/cards/global_mmlu/ig/high_school_mathematics.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/ig 2026-01-06T13:30:33,721 creating build/bdist.linux-armv7l/wheel/unitxt/catalog/cards/global_mmlu/te 2026-01-06T13:30:33,722 copying build/lib/unitxt/catalog/cards/global_mmlu/te/elementary_mathematics.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/te 2026-01-06T13:30:33,724 copying build/lib/unitxt/catalog/cards/global_mmlu/te/human_aging.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/te 2026-01-06T13:30:33,726 copying build/lib/unitxt/catalog/cards/global_mmlu/te/high_school_computer_science.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/te 2026-01-06T13:30:33,728 copying build/lib/unitxt/catalog/cards/global_mmlu/te/college_physics.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/te 2026-01-06T13:30:33,730 copying build/lib/unitxt/catalog/cards/global_mmlu/te/college_medicine.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/te 2026-01-06T13:30:33,732 copying build/lib/unitxt/catalog/cards/global_mmlu/te/college_mathematics.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/te 2026-01-06T13:30:33,733 copying build/lib/unitxt/catalog/cards/global_mmlu/te/high_school_microeconomics.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/te 2026-01-06T13:30:33,735 copying build/lib/unitxt/catalog/cards/global_mmlu/te/anatomy.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/te 2026-01-06T13:30:33,737 copying build/lib/unitxt/catalog/cards/global_mmlu/te/world_religions.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/te 2026-01-06T13:30:33,739 copying build/lib/unitxt/catalog/cards/global_mmlu/te/management.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/te 2026-01-06T13:30:33,741 copying build/lib/unitxt/catalog/cards/global_mmlu/te/moral_scenarios.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/te 2026-01-06T13:30:33,742 copying build/lib/unitxt/catalog/cards/global_mmlu/te/global_facts.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/te 2026-01-06T13:30:33,744 copying build/lib/unitxt/catalog/cards/global_mmlu/te/miscellaneous.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/te 2026-01-06T13:30:33,746 copying build/lib/unitxt/catalog/cards/global_mmlu/te/clinical_knowledge.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/te 2026-01-06T13:30:33,748 copying build/lib/unitxt/catalog/cards/global_mmlu/te/high_school_biology.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/te 2026-01-06T13:30:33,750 copying build/lib/unitxt/catalog/cards/global_mmlu/te/prehistory.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/te 2026-01-06T13:30:33,752 copying build/lib/unitxt/catalog/cards/global_mmlu/te/high_school_us_history.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/te 2026-01-06T13:30:33,754 copying build/lib/unitxt/catalog/cards/global_mmlu/te/international_law.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/te 2026-01-06T13:30:33,756 copying build/lib/unitxt/catalog/cards/global_mmlu/te/college_computer_science.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/te 2026-01-06T13:30:33,758 copying build/lib/unitxt/catalog/cards/global_mmlu/te/astronomy.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/te 2026-01-06T13:30:33,760 copying build/lib/unitxt/catalog/cards/global_mmlu/te/high_school_european_history.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/te 2026-01-06T13:30:33,762 copying build/lib/unitxt/catalog/cards/global_mmlu/te/electrical_engineering.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/te 2026-01-06T13:30:33,764 copying build/lib/unitxt/catalog/cards/global_mmlu/te/nutrition.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/te 2026-01-06T13:30:33,765 copying build/lib/unitxt/catalog/cards/global_mmlu/te/abstract_algebra.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/te 2026-01-06T13:30:33,767 copying build/lib/unitxt/catalog/cards/global_mmlu/te/professional_medicine.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/te 2026-01-06T13:30:33,769 copying build/lib/unitxt/catalog/cards/global_mmlu/te/human_sexuality.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/te 2026-01-06T13:30:33,771 copying build/lib/unitxt/catalog/cards/global_mmlu/te/business_ethics.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/te 2026-01-06T13:30:33,773 copying build/lib/unitxt/catalog/cards/global_mmlu/te/high_school_chemistry.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/te 2026-01-06T13:30:33,775 copying build/lib/unitxt/catalog/cards/global_mmlu/te/logical_fallacies.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/te 2026-01-06T13:30:33,777 copying build/lib/unitxt/catalog/cards/global_mmlu/te/formal_logic.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/te 2026-01-06T13:30:33,779 copying build/lib/unitxt/catalog/cards/global_mmlu/te/high_school_psychology.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/te 2026-01-06T13:30:33,780 copying build/lib/unitxt/catalog/cards/global_mmlu/te/medical_genetics.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/te 2026-01-06T13:30:33,782 copying build/lib/unitxt/catalog/cards/global_mmlu/te/security_studies.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/te 2026-01-06T13:30:33,784 copying build/lib/unitxt/catalog/cards/global_mmlu/te/high_school_macroeconomics.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/te 2026-01-06T13:30:33,786 copying build/lib/unitxt/catalog/cards/global_mmlu/te/professional_law.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/te 2026-01-06T13:30:33,787 copying build/lib/unitxt/catalog/cards/global_mmlu/te/high_school_physics.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/te 2026-01-06T13:30:33,789 copying build/lib/unitxt/catalog/cards/global_mmlu/te/econometrics.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/te 2026-01-06T13:30:33,791 copying build/lib/unitxt/catalog/cards/global_mmlu/te/sociology.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/te 2026-01-06T13:30:33,793 copying build/lib/unitxt/catalog/cards/global_mmlu/te/moral_disputes.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/te 2026-01-06T13:30:33,795 copying build/lib/unitxt/catalog/cards/global_mmlu/te/college_chemistry.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/te 2026-01-06T13:30:33,797 copying build/lib/unitxt/catalog/cards/global_mmlu/te/high_school_geography.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/te 2026-01-06T13:30:33,799 copying build/lib/unitxt/catalog/cards/global_mmlu/te/jurisprudence.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/te 2026-01-06T13:30:33,801 copying build/lib/unitxt/catalog/cards/global_mmlu/te/high_school_statistics.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/te 2026-01-06T13:30:33,802 copying build/lib/unitxt/catalog/cards/global_mmlu/te/professional_accounting.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/te 2026-01-06T13:30:33,804 copying build/lib/unitxt/catalog/cards/global_mmlu/te/us_foreign_policy.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/te 2026-01-06T13:30:33,806 copying build/lib/unitxt/catalog/cards/global_mmlu/te/professional_psychology.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/te 2026-01-06T13:30:33,808 copying build/lib/unitxt/catalog/cards/global_mmlu/te/public_relations.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/te 2026-01-06T13:30:33,810 copying build/lib/unitxt/catalog/cards/global_mmlu/te/computer_security.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/te 2026-01-06T13:30:33,812 copying build/lib/unitxt/catalog/cards/global_mmlu/te/philosophy.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/te 2026-01-06T13:30:33,814 copying build/lib/unitxt/catalog/cards/global_mmlu/te/virology.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/te 2026-01-06T13:30:33,816 copying build/lib/unitxt/catalog/cards/global_mmlu/te/marketing.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/te 2026-01-06T13:30:33,817 copying build/lib/unitxt/catalog/cards/global_mmlu/te/high_school_world_history.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/te 2026-01-06T13:30:33,820 copying build/lib/unitxt/catalog/cards/global_mmlu/te/machine_learning.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/te 2026-01-06T13:30:33,821 copying build/lib/unitxt/catalog/cards/global_mmlu/te/high_school_government_and_politics.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/te 2026-01-06T13:30:33,823 copying build/lib/unitxt/catalog/cards/global_mmlu/te/conceptual_physics.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/te 2026-01-06T13:30:33,825 copying build/lib/unitxt/catalog/cards/global_mmlu/te/college_biology.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/te 2026-01-06T13:30:33,827 copying build/lib/unitxt/catalog/cards/global_mmlu/te/high_school_mathematics.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/te 2026-01-06T13:30:33,830 creating build/bdist.linux-armv7l/wheel/unitxt/catalog/cards/global_mmlu/si 2026-01-06T13:30:33,831 copying build/lib/unitxt/catalog/cards/global_mmlu/si/elementary_mathematics.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/si 2026-01-06T13:30:33,833 copying build/lib/unitxt/catalog/cards/global_mmlu/si/human_aging.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/si 2026-01-06T13:30:33,835 copying build/lib/unitxt/catalog/cards/global_mmlu/si/high_school_computer_science.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/si 2026-01-06T13:30:33,837 copying build/lib/unitxt/catalog/cards/global_mmlu/si/college_physics.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/si 2026-01-06T13:30:33,839 copying build/lib/unitxt/catalog/cards/global_mmlu/si/college_medicine.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/si 2026-01-06T13:30:33,840 copying build/lib/unitxt/catalog/cards/global_mmlu/si/college_mathematics.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/si 2026-01-06T13:30:33,842 copying build/lib/unitxt/catalog/cards/global_mmlu/si/high_school_microeconomics.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/si 2026-01-06T13:30:33,844 copying build/lib/unitxt/catalog/cards/global_mmlu/si/anatomy.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/si 2026-01-06T13:30:33,846 copying build/lib/unitxt/catalog/cards/global_mmlu/si/world_religions.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/si 2026-01-06T13:30:33,848 copying build/lib/unitxt/catalog/cards/global_mmlu/si/management.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/si 2026-01-06T13:30:33,850 copying build/lib/unitxt/catalog/cards/global_mmlu/si/moral_scenarios.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/si 2026-01-06T13:30:33,852 copying build/lib/unitxt/catalog/cards/global_mmlu/si/global_facts.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/si 2026-01-06T13:30:33,854 copying build/lib/unitxt/catalog/cards/global_mmlu/si/miscellaneous.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/si 2026-01-06T13:30:33,856 copying build/lib/unitxt/catalog/cards/global_mmlu/si/clinical_knowledge.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/si 2026-01-06T13:30:33,857 copying build/lib/unitxt/catalog/cards/global_mmlu/si/high_school_biology.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/si 2026-01-06T13:30:33,859 copying build/lib/unitxt/catalog/cards/global_mmlu/si/prehistory.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/si 2026-01-06T13:30:33,861 copying build/lib/unitxt/catalog/cards/global_mmlu/si/high_school_us_history.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/si 2026-01-06T13:30:33,863 copying build/lib/unitxt/catalog/cards/global_mmlu/si/international_law.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/si 2026-01-06T13:30:33,865 copying build/lib/unitxt/catalog/cards/global_mmlu/si/college_computer_science.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/si 2026-01-06T13:30:33,867 copying build/lib/unitxt/catalog/cards/global_mmlu/si/astronomy.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/si 2026-01-06T13:30:33,869 copying build/lib/unitxt/catalog/cards/global_mmlu/si/high_school_european_history.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/si 2026-01-06T13:30:33,871 copying build/lib/unitxt/catalog/cards/global_mmlu/si/electrical_engineering.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/si 2026-01-06T13:30:33,872 copying build/lib/unitxt/catalog/cards/global_mmlu/si/nutrition.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/si 2026-01-06T13:30:33,874 copying build/lib/unitxt/catalog/cards/global_mmlu/si/abstract_algebra.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/si 2026-01-06T13:30:33,876 copying build/lib/unitxt/catalog/cards/global_mmlu/si/professional_medicine.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/si 2026-01-06T13:30:33,878 copying build/lib/unitxt/catalog/cards/global_mmlu/si/human_sexuality.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/si 2026-01-06T13:30:33,880 copying build/lib/unitxt/catalog/cards/global_mmlu/si/business_ethics.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/si 2026-01-06T13:30:33,882 copying build/lib/unitxt/catalog/cards/global_mmlu/si/high_school_chemistry.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/si 2026-01-06T13:30:33,884 copying build/lib/unitxt/catalog/cards/global_mmlu/si/logical_fallacies.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/si 2026-01-06T13:30:33,886 copying build/lib/unitxt/catalog/cards/global_mmlu/si/formal_logic.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/si 2026-01-06T13:30:33,887 copying build/lib/unitxt/catalog/cards/global_mmlu/si/high_school_psychology.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/si 2026-01-06T13:30:33,889 copying build/lib/unitxt/catalog/cards/global_mmlu/si/medical_genetics.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/si 2026-01-06T13:30:33,891 copying build/lib/unitxt/catalog/cards/global_mmlu/si/security_studies.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/si 2026-01-06T13:30:33,895 copying build/lib/unitxt/catalog/cards/global_mmlu/si/high_school_macroeconomics.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/si 2026-01-06T13:30:33,897 copying build/lib/unitxt/catalog/cards/global_mmlu/si/professional_law.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/si 2026-01-06T13:30:33,898 copying build/lib/unitxt/catalog/cards/global_mmlu/si/high_school_physics.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/si 2026-01-06T13:30:33,900 copying build/lib/unitxt/catalog/cards/global_mmlu/si/econometrics.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/si 2026-01-06T13:30:33,902 copying build/lib/unitxt/catalog/cards/global_mmlu/si/sociology.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/si 2026-01-06T13:30:33,904 copying build/lib/unitxt/catalog/cards/global_mmlu/si/moral_disputes.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/si 2026-01-06T13:30:33,906 copying build/lib/unitxt/catalog/cards/global_mmlu/si/college_chemistry.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/si 2026-01-06T13:30:33,908 copying build/lib/unitxt/catalog/cards/global_mmlu/si/high_school_geography.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/si 2026-01-06T13:30:33,910 copying build/lib/unitxt/catalog/cards/global_mmlu/si/jurisprudence.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/si 2026-01-06T13:30:33,911 copying build/lib/unitxt/catalog/cards/global_mmlu/si/high_school_statistics.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/si 2026-01-06T13:30:33,913 copying build/lib/unitxt/catalog/cards/global_mmlu/si/professional_accounting.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/si 2026-01-06T13:30:33,915 copying build/lib/unitxt/catalog/cards/global_mmlu/si/us_foreign_policy.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/si 2026-01-06T13:30:33,917 copying build/lib/unitxt/catalog/cards/global_mmlu/si/professional_psychology.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/si 2026-01-06T13:30:33,919 copying build/lib/unitxt/catalog/cards/global_mmlu/si/public_relations.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/si 2026-01-06T13:30:33,921 copying build/lib/unitxt/catalog/cards/global_mmlu/si/computer_security.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/si 2026-01-06T13:30:33,923 copying build/lib/unitxt/catalog/cards/global_mmlu/si/philosophy.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/si 2026-01-06T13:30:33,925 copying build/lib/unitxt/catalog/cards/global_mmlu/si/virology.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/si 2026-01-06T13:30:33,927 copying build/lib/unitxt/catalog/cards/global_mmlu/si/marketing.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/si 2026-01-06T13:30:33,929 copying build/lib/unitxt/catalog/cards/global_mmlu/si/high_school_world_history.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/si 2026-01-06T13:30:33,930 copying build/lib/unitxt/catalog/cards/global_mmlu/si/machine_learning.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/si 2026-01-06T13:30:33,932 copying build/lib/unitxt/catalog/cards/global_mmlu/si/high_school_government_and_politics.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/si 2026-01-06T13:30:33,934 copying build/lib/unitxt/catalog/cards/global_mmlu/si/conceptual_physics.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/si 2026-01-06T13:30:33,936 copying build/lib/unitxt/catalog/cards/global_mmlu/si/college_biology.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/si 2026-01-06T13:30:33,938 copying build/lib/unitxt/catalog/cards/global_mmlu/si/high_school_mathematics.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/si 2026-01-06T13:30:33,941 creating build/bdist.linux-armv7l/wheel/unitxt/catalog/cards/global_mmlu/am 2026-01-06T13:30:33,942 copying build/lib/unitxt/catalog/cards/global_mmlu/am/elementary_mathematics.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/am 2026-01-06T13:30:33,944 copying build/lib/unitxt/catalog/cards/global_mmlu/am/human_aging.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/am 2026-01-06T13:30:33,946 copying build/lib/unitxt/catalog/cards/global_mmlu/am/high_school_computer_science.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/am 2026-01-06T13:30:33,948 copying build/lib/unitxt/catalog/cards/global_mmlu/am/college_physics.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/am 2026-01-06T13:30:33,950 copying build/lib/unitxt/catalog/cards/global_mmlu/am/college_medicine.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/am 2026-01-06T13:30:33,952 copying build/lib/unitxt/catalog/cards/global_mmlu/am/college_mathematics.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/am 2026-01-06T13:30:33,954 copying build/lib/unitxt/catalog/cards/global_mmlu/am/high_school_microeconomics.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/am 2026-01-06T13:30:33,956 copying build/lib/unitxt/catalog/cards/global_mmlu/am/anatomy.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/am 2026-01-06T13:30:33,958 copying build/lib/unitxt/catalog/cards/global_mmlu/am/world_religions.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/am 2026-01-06T13:30:33,960 copying build/lib/unitxt/catalog/cards/global_mmlu/am/management.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/am 2026-01-06T13:30:33,962 copying build/lib/unitxt/catalog/cards/global_mmlu/am/moral_scenarios.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/am 2026-01-06T13:30:33,963 copying build/lib/unitxt/catalog/cards/global_mmlu/am/global_facts.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/am 2026-01-06T13:30:33,965 copying build/lib/unitxt/catalog/cards/global_mmlu/am/miscellaneous.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/am 2026-01-06T13:30:33,967 copying build/lib/unitxt/catalog/cards/global_mmlu/am/clinical_knowledge.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/am 2026-01-06T13:30:33,969 copying build/lib/unitxt/catalog/cards/global_mmlu/am/high_school_biology.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/am 2026-01-06T13:30:33,971 copying build/lib/unitxt/catalog/cards/global_mmlu/am/prehistory.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/am 2026-01-06T13:30:33,973 copying build/lib/unitxt/catalog/cards/global_mmlu/am/high_school_us_history.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/am 2026-01-06T13:30:33,975 copying build/lib/unitxt/catalog/cards/global_mmlu/am/international_law.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/am 2026-01-06T13:30:33,976 copying build/lib/unitxt/catalog/cards/global_mmlu/am/college_computer_science.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/am 2026-01-06T13:30:33,978 copying build/lib/unitxt/catalog/cards/global_mmlu/am/astronomy.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/am 2026-01-06T13:30:33,980 copying build/lib/unitxt/catalog/cards/global_mmlu/am/high_school_european_history.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/am 2026-01-06T13:30:33,982 copying build/lib/unitxt/catalog/cards/global_mmlu/am/electrical_engineering.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/am 2026-01-06T13:30:33,984 copying build/lib/unitxt/catalog/cards/global_mmlu/am/nutrition.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/am 2026-01-06T13:30:33,986 copying build/lib/unitxt/catalog/cards/global_mmlu/am/abstract_algebra.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/am 2026-01-06T13:30:33,988 copying build/lib/unitxt/catalog/cards/global_mmlu/am/professional_medicine.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/am 2026-01-06T13:30:33,990 copying build/lib/unitxt/catalog/cards/global_mmlu/am/human_sexuality.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/am 2026-01-06T13:30:33,992 copying build/lib/unitxt/catalog/cards/global_mmlu/am/business_ethics.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/am 2026-01-06T13:30:33,993 copying build/lib/unitxt/catalog/cards/global_mmlu/am/high_school_chemistry.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/am 2026-01-06T13:30:33,995 copying build/lib/unitxt/catalog/cards/global_mmlu/am/logical_fallacies.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/am 2026-01-06T13:30:33,997 copying build/lib/unitxt/catalog/cards/global_mmlu/am/formal_logic.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/am 2026-01-06T13:30:33,999 copying build/lib/unitxt/catalog/cards/global_mmlu/am/high_school_psychology.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/am 2026-01-06T13:30:34,001 copying build/lib/unitxt/catalog/cards/global_mmlu/am/medical_genetics.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/am 2026-01-06T13:30:34,003 copying build/lib/unitxt/catalog/cards/global_mmlu/am/security_studies.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/am 2026-01-06T13:30:34,005 copying build/lib/unitxt/catalog/cards/global_mmlu/am/high_school_macroeconomics.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/am 2026-01-06T13:30:34,006 copying build/lib/unitxt/catalog/cards/global_mmlu/am/professional_law.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/am 2026-01-06T13:30:34,008 copying build/lib/unitxt/catalog/cards/global_mmlu/am/high_school_physics.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/am 2026-01-06T13:30:34,010 copying build/lib/unitxt/catalog/cards/global_mmlu/am/econometrics.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/am 2026-01-06T13:30:34,012 copying build/lib/unitxt/catalog/cards/global_mmlu/am/sociology.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/am 2026-01-06T13:30:34,014 copying build/lib/unitxt/catalog/cards/global_mmlu/am/moral_disputes.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/am 2026-01-06T13:30:34,016 copying build/lib/unitxt/catalog/cards/global_mmlu/am/college_chemistry.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/am 2026-01-06T13:30:34,018 copying build/lib/unitxt/catalog/cards/global_mmlu/am/high_school_geography.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/am 2026-01-06T13:30:34,019 copying build/lib/unitxt/catalog/cards/global_mmlu/am/jurisprudence.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/am 2026-01-06T13:30:34,021 copying build/lib/unitxt/catalog/cards/global_mmlu/am/high_school_statistics.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/am 2026-01-06T13:30:34,023 copying build/lib/unitxt/catalog/cards/global_mmlu/am/professional_accounting.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/am 2026-01-06T13:30:34,025 copying build/lib/unitxt/catalog/cards/global_mmlu/am/us_foreign_policy.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/am 2026-01-06T13:30:34,027 copying build/lib/unitxt/catalog/cards/global_mmlu/am/professional_psychology.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/am 2026-01-06T13:30:34,029 copying build/lib/unitxt/catalog/cards/global_mmlu/am/public_relations.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/am 2026-01-06T13:30:34,031 copying build/lib/unitxt/catalog/cards/global_mmlu/am/computer_security.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/am 2026-01-06T13:30:34,033 copying build/lib/unitxt/catalog/cards/global_mmlu/am/philosophy.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/am 2026-01-06T13:30:34,035 copying build/lib/unitxt/catalog/cards/global_mmlu/am/virology.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/am 2026-01-06T13:30:34,037 copying build/lib/unitxt/catalog/cards/global_mmlu/am/marketing.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/am 2026-01-06T13:30:34,038 copying build/lib/unitxt/catalog/cards/global_mmlu/am/high_school_world_history.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/am 2026-01-06T13:30:34,040 copying build/lib/unitxt/catalog/cards/global_mmlu/am/machine_learning.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/am 2026-01-06T13:30:34,042 copying build/lib/unitxt/catalog/cards/global_mmlu/am/high_school_government_and_politics.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/am 2026-01-06T13:30:34,044 copying build/lib/unitxt/catalog/cards/global_mmlu/am/conceptual_physics.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/am 2026-01-06T13:30:34,046 copying build/lib/unitxt/catalog/cards/global_mmlu/am/college_biology.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/am 2026-01-06T13:30:34,048 copying build/lib/unitxt/catalog/cards/global_mmlu/am/high_school_mathematics.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/am 2026-01-06T13:30:34,051 creating build/bdist.linux-armv7l/wheel/unitxt/catalog/cards/global_mmlu/sn 2026-01-06T13:30:34,052 copying build/lib/unitxt/catalog/cards/global_mmlu/sn/elementary_mathematics.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/sn 2026-01-06T13:30:34,054 copying build/lib/unitxt/catalog/cards/global_mmlu/sn/human_aging.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/sn 2026-01-06T13:30:34,056 copying build/lib/unitxt/catalog/cards/global_mmlu/sn/high_school_computer_science.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/sn 2026-01-06T13:30:34,058 copying build/lib/unitxt/catalog/cards/global_mmlu/sn/college_physics.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/sn 2026-01-06T13:30:34,060 copying build/lib/unitxt/catalog/cards/global_mmlu/sn/college_medicine.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/sn 2026-01-06T13:30:34,061 copying build/lib/unitxt/catalog/cards/global_mmlu/sn/college_mathematics.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/sn 2026-01-06T13:30:34,063 copying build/lib/unitxt/catalog/cards/global_mmlu/sn/high_school_microeconomics.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/sn 2026-01-06T13:30:34,065 copying build/lib/unitxt/catalog/cards/global_mmlu/sn/anatomy.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/sn 2026-01-06T13:30:34,067 copying build/lib/unitxt/catalog/cards/global_mmlu/sn/world_religions.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/sn 2026-01-06T13:30:34,069 copying build/lib/unitxt/catalog/cards/global_mmlu/sn/management.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/sn 2026-01-06T13:30:34,071 copying build/lib/unitxt/catalog/cards/global_mmlu/sn/moral_scenarios.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/sn 2026-01-06T13:30:34,073 copying build/lib/unitxt/catalog/cards/global_mmlu/sn/global_facts.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/sn 2026-01-06T13:30:34,075 copying build/lib/unitxt/catalog/cards/global_mmlu/sn/miscellaneous.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/sn 2026-01-06T13:30:34,076 copying build/lib/unitxt/catalog/cards/global_mmlu/sn/clinical_knowledge.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/sn 2026-01-06T13:30:34,078 copying build/lib/unitxt/catalog/cards/global_mmlu/sn/high_school_biology.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/sn 2026-01-06T13:30:34,080 copying build/lib/unitxt/catalog/cards/global_mmlu/sn/prehistory.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/sn 2026-01-06T13:30:34,082 copying build/lib/unitxt/catalog/cards/global_mmlu/sn/high_school_us_history.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/sn 2026-01-06T13:30:34,084 copying build/lib/unitxt/catalog/cards/global_mmlu/sn/international_law.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/sn 2026-01-06T13:30:34,086 copying build/lib/unitxt/catalog/cards/global_mmlu/sn/college_computer_science.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/sn 2026-01-06T13:30:34,088 copying build/lib/unitxt/catalog/cards/global_mmlu/sn/astronomy.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/sn 2026-01-06T13:30:34,090 copying build/lib/unitxt/catalog/cards/global_mmlu/sn/high_school_european_history.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/sn 2026-01-06T13:30:34,091 copying build/lib/unitxt/catalog/cards/global_mmlu/sn/electrical_engineering.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/sn 2026-01-06T13:30:34,093 copying build/lib/unitxt/catalog/cards/global_mmlu/sn/nutrition.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/sn 2026-01-06T13:30:34,095 copying build/lib/unitxt/catalog/cards/global_mmlu/sn/abstract_algebra.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/sn 2026-01-06T13:30:34,097 copying build/lib/unitxt/catalog/cards/global_mmlu/sn/professional_medicine.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/sn 2026-01-06T13:30:34,099 copying build/lib/unitxt/catalog/cards/global_mmlu/sn/human_sexuality.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/sn 2026-01-06T13:30:34,101 copying build/lib/unitxt/catalog/cards/global_mmlu/sn/business_ethics.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/sn 2026-01-06T13:30:34,102 copying build/lib/unitxt/catalog/cards/global_mmlu/sn/high_school_chemistry.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/sn 2026-01-06T13:30:34,104 copying build/lib/unitxt/catalog/cards/global_mmlu/sn/logical_fallacies.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/sn 2026-01-06T13:30:34,106 copying build/lib/unitxt/catalog/cards/global_mmlu/sn/formal_logic.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/sn 2026-01-06T13:30:34,108 copying build/lib/unitxt/catalog/cards/global_mmlu/sn/high_school_psychology.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/sn 2026-01-06T13:30:34,110 copying build/lib/unitxt/catalog/cards/global_mmlu/sn/medical_genetics.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/sn 2026-01-06T13:30:34,112 copying build/lib/unitxt/catalog/cards/global_mmlu/sn/security_studies.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/sn 2026-01-06T13:30:34,114 copying build/lib/unitxt/catalog/cards/global_mmlu/sn/high_school_macroeconomics.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/sn 2026-01-06T13:30:34,116 copying build/lib/unitxt/catalog/cards/global_mmlu/sn/professional_law.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/sn 2026-01-06T13:30:34,118 copying build/lib/unitxt/catalog/cards/global_mmlu/sn/high_school_physics.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/sn 2026-01-06T13:30:34,120 copying build/lib/unitxt/catalog/cards/global_mmlu/sn/econometrics.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/sn 2026-01-06T13:30:34,122 copying build/lib/unitxt/catalog/cards/global_mmlu/sn/sociology.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/sn 2026-01-06T13:30:34,123 copying build/lib/unitxt/catalog/cards/global_mmlu/sn/moral_disputes.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/sn 2026-01-06T13:30:34,125 copying build/lib/unitxt/catalog/cards/global_mmlu/sn/college_chemistry.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/sn 2026-01-06T13:30:34,127 copying build/lib/unitxt/catalog/cards/global_mmlu/sn/high_school_geography.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/sn 2026-01-06T13:30:34,129 copying build/lib/unitxt/catalog/cards/global_mmlu/sn/jurisprudence.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/sn 2026-01-06T13:30:34,131 copying build/lib/unitxt/catalog/cards/global_mmlu/sn/high_school_statistics.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/sn 2026-01-06T13:30:34,133 copying build/lib/unitxt/catalog/cards/global_mmlu/sn/professional_accounting.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/sn 2026-01-06T13:30:34,135 copying build/lib/unitxt/catalog/cards/global_mmlu/sn/us_foreign_policy.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/sn 2026-01-06T13:30:34,137 copying build/lib/unitxt/catalog/cards/global_mmlu/sn/professional_psychology.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/sn 2026-01-06T13:30:34,139 copying build/lib/unitxt/catalog/cards/global_mmlu/sn/public_relations.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/sn 2026-01-06T13:30:34,140 copying build/lib/unitxt/catalog/cards/global_mmlu/sn/computer_security.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/sn 2026-01-06T13:30:34,142 copying build/lib/unitxt/catalog/cards/global_mmlu/sn/philosophy.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/sn 2026-01-06T13:30:34,144 copying build/lib/unitxt/catalog/cards/global_mmlu/sn/virology.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/sn 2026-01-06T13:30:34,146 copying build/lib/unitxt/catalog/cards/global_mmlu/sn/marketing.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/sn 2026-01-06T13:30:34,148 copying build/lib/unitxt/catalog/cards/global_mmlu/sn/high_school_world_history.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/sn 2026-01-06T13:30:34,150 copying build/lib/unitxt/catalog/cards/global_mmlu/sn/machine_learning.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/sn 2026-01-06T13:30:34,152 copying build/lib/unitxt/catalog/cards/global_mmlu/sn/high_school_government_and_politics.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/sn 2026-01-06T13:30:34,154 copying build/lib/unitxt/catalog/cards/global_mmlu/sn/conceptual_physics.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/sn 2026-01-06T13:30:34,156 copying build/lib/unitxt/catalog/cards/global_mmlu/sn/college_biology.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/sn 2026-01-06T13:30:34,158 copying build/lib/unitxt/catalog/cards/global_mmlu/sn/high_school_mathematics.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/sn 2026-01-06T13:30:34,161 creating build/bdist.linux-armv7l/wheel/unitxt/catalog/cards/global_mmlu/sw 2026-01-06T13:30:34,162 copying build/lib/unitxt/catalog/cards/global_mmlu/sw/elementary_mathematics.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/sw 2026-01-06T13:30:34,164 copying build/lib/unitxt/catalog/cards/global_mmlu/sw/human_aging.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/sw 2026-01-06T13:30:34,166 copying build/lib/unitxt/catalog/cards/global_mmlu/sw/high_school_computer_science.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/sw 2026-01-06T13:30:34,168 copying build/lib/unitxt/catalog/cards/global_mmlu/sw/college_physics.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/sw 2026-01-06T13:30:34,169 copying build/lib/unitxt/catalog/cards/global_mmlu/sw/college_medicine.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/sw 2026-01-06T13:30:34,171 copying build/lib/unitxt/catalog/cards/global_mmlu/sw/college_mathematics.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/sw 2026-01-06T13:30:34,174 copying build/lib/unitxt/catalog/cards/global_mmlu/sw/high_school_microeconomics.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/sw 2026-01-06T13:30:34,175 copying build/lib/unitxt/catalog/cards/global_mmlu/sw/anatomy.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/sw 2026-01-06T13:30:34,177 copying build/lib/unitxt/catalog/cards/global_mmlu/sw/world_religions.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/sw 2026-01-06T13:30:34,179 copying build/lib/unitxt/catalog/cards/global_mmlu/sw/management.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/sw 2026-01-06T13:30:34,181 copying build/lib/unitxt/catalog/cards/global_mmlu/sw/moral_scenarios.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/sw 2026-01-06T13:30:34,183 copying build/lib/unitxt/catalog/cards/global_mmlu/sw/global_facts.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/sw 2026-01-06T13:30:34,185 copying build/lib/unitxt/catalog/cards/global_mmlu/sw/miscellaneous.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/sw 2026-01-06T13:30:34,187 copying build/lib/unitxt/catalog/cards/global_mmlu/sw/clinical_knowledge.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/sw 2026-01-06T13:30:34,189 copying build/lib/unitxt/catalog/cards/global_mmlu/sw/high_school_biology.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/sw 2026-01-06T13:30:34,191 copying build/lib/unitxt/catalog/cards/global_mmlu/sw/prehistory.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/sw 2026-01-06T13:30:34,193 copying build/lib/unitxt/catalog/cards/global_mmlu/sw/high_school_us_history.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/sw 2026-01-06T13:30:34,194 copying build/lib/unitxt/catalog/cards/global_mmlu/sw/international_law.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/sw 2026-01-06T13:30:34,196 copying build/lib/unitxt/catalog/cards/global_mmlu/sw/college_computer_science.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/sw 2026-01-06T13:30:34,199 copying build/lib/unitxt/catalog/cards/global_mmlu/sw/astronomy.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/sw 2026-01-06T13:30:34,201 copying build/lib/unitxt/catalog/cards/global_mmlu/sw/high_school_european_history.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/sw 2026-01-06T13:30:34,202 copying build/lib/unitxt/catalog/cards/global_mmlu/sw/electrical_engineering.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/sw 2026-01-06T13:30:34,204 copying build/lib/unitxt/catalog/cards/global_mmlu/sw/nutrition.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/sw 2026-01-06T13:30:34,206 copying build/lib/unitxt/catalog/cards/global_mmlu/sw/abstract_algebra.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/sw 2026-01-06T13:30:34,208 copying build/lib/unitxt/catalog/cards/global_mmlu/sw/professional_medicine.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/sw 2026-01-06T13:30:34,210 copying build/lib/unitxt/catalog/cards/global_mmlu/sw/human_sexuality.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/sw 2026-01-06T13:30:34,212 copying build/lib/unitxt/catalog/cards/global_mmlu/sw/business_ethics.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/sw 2026-01-06T13:30:34,214 copying build/lib/unitxt/catalog/cards/global_mmlu/sw/high_school_chemistry.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/sw 2026-01-06T13:30:34,216 copying build/lib/unitxt/catalog/cards/global_mmlu/sw/logical_fallacies.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/sw 2026-01-06T13:30:34,218 copying build/lib/unitxt/catalog/cards/global_mmlu/sw/formal_logic.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/sw 2026-01-06T13:30:34,220 copying build/lib/unitxt/catalog/cards/global_mmlu/sw/high_school_psychology.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/sw 2026-01-06T13:30:34,222 copying build/lib/unitxt/catalog/cards/global_mmlu/sw/medical_genetics.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/sw 2026-01-06T13:30:34,224 copying build/lib/unitxt/catalog/cards/global_mmlu/sw/security_studies.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/sw 2026-01-06T13:30:34,225 copying build/lib/unitxt/catalog/cards/global_mmlu/sw/high_school_macroeconomics.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/sw 2026-01-06T13:30:34,227 copying build/lib/unitxt/catalog/cards/global_mmlu/sw/professional_law.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/sw 2026-01-06T13:30:34,229 copying build/lib/unitxt/catalog/cards/global_mmlu/sw/high_school_physics.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/sw 2026-01-06T13:30:34,231 copying build/lib/unitxt/catalog/cards/global_mmlu/sw/econometrics.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/sw 2026-01-06T13:30:34,233 copying build/lib/unitxt/catalog/cards/global_mmlu/sw/sociology.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/sw 2026-01-06T13:30:34,235 copying build/lib/unitxt/catalog/cards/global_mmlu/sw/moral_disputes.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/sw 2026-01-06T13:30:34,237 copying build/lib/unitxt/catalog/cards/global_mmlu/sw/college_chemistry.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/sw 2026-01-06T13:30:34,238 copying build/lib/unitxt/catalog/cards/global_mmlu/sw/high_school_geography.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/sw 2026-01-06T13:30:34,240 copying build/lib/unitxt/catalog/cards/global_mmlu/sw/jurisprudence.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/sw 2026-01-06T13:30:34,242 copying build/lib/unitxt/catalog/cards/global_mmlu/sw/high_school_statistics.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/sw 2026-01-06T13:30:34,244 copying build/lib/unitxt/catalog/cards/global_mmlu/sw/professional_accounting.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/sw 2026-01-06T13:30:34,246 copying build/lib/unitxt/catalog/cards/global_mmlu/sw/us_foreign_policy.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/sw 2026-01-06T13:30:34,248 copying build/lib/unitxt/catalog/cards/global_mmlu/sw/professional_psychology.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/sw 2026-01-06T13:30:34,250 copying build/lib/unitxt/catalog/cards/global_mmlu/sw/public_relations.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/sw 2026-01-06T13:30:34,252 copying build/lib/unitxt/catalog/cards/global_mmlu/sw/computer_security.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/sw 2026-01-06T13:30:34,254 copying build/lib/unitxt/catalog/cards/global_mmlu/sw/philosophy.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/sw 2026-01-06T13:30:34,256 copying build/lib/unitxt/catalog/cards/global_mmlu/sw/virology.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/sw 2026-01-06T13:30:34,258 copying build/lib/unitxt/catalog/cards/global_mmlu/sw/marketing.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/sw 2026-01-06T13:30:34,260 copying build/lib/unitxt/catalog/cards/global_mmlu/sw/high_school_world_history.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/sw 2026-01-06T13:30:34,262 copying build/lib/unitxt/catalog/cards/global_mmlu/sw/machine_learning.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/sw 2026-01-06T13:30:34,264 copying build/lib/unitxt/catalog/cards/global_mmlu/sw/high_school_government_and_politics.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/sw 2026-01-06T13:30:34,266 copying build/lib/unitxt/catalog/cards/global_mmlu/sw/conceptual_physics.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/sw 2026-01-06T13:30:34,268 copying build/lib/unitxt/catalog/cards/global_mmlu/sw/college_biology.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/sw 2026-01-06T13:30:34,269 copying build/lib/unitxt/catalog/cards/global_mmlu/sw/high_school_mathematics.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/sw 2026-01-06T13:30:34,272 creating build/bdist.linux-armv7l/wheel/unitxt/catalog/cards/tablebench_numerical_reasoning 2026-01-06T13:30:34,273 copying build/lib/unitxt/catalog/cards/tablebench_numerical_reasoning/legacy.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/tablebench_numerical_reasoning 2026-01-06T13:30:34,276 creating build/bdist.linux-armv7l/wheel/unitxt/catalog/cards/20_newsgroups 2026-01-06T13:30:34,277 copying build/lib/unitxt/catalog/cards/20_newsgroups/sklearn.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/20_newsgroups 2026-01-06T13:30:34,279 copying build/lib/unitxt/catalog/cards/banking77.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards 2026-01-06T13:30:34,281 copying build/lib/unitxt/catalog/cards/medical_abstracts.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards 2026-01-06T13:30:34,283 creating build/bdist.linux-armv7l/wheel/unitxt/catalog/cards/boolq 2026-01-06T13:30:34,284 copying build/lib/unitxt/catalog/cards/boolq/classification.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/boolq 2026-01-06T13:30:34,286 copying build/lib/unitxt/catalog/cards/boolq/multiple_choice.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/boolq 2026-01-06T13:30:34,288 copying build/lib/unitxt/catalog/cards/trec.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards 2026-01-06T13:30:34,291 copying build/lib/unitxt/catalog/cards/tablerow_classify.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards 2026-01-06T13:30:34,293 creating build/bdist.linux-armv7l/wheel/unitxt/catalog/cards/reuters21578 2026-01-06T13:30:34,294 copying build/lib/unitxt/catalog/cards/reuters21578/ModApte.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/reuters21578 2026-01-06T13:30:34,296 copying build/lib/unitxt/catalog/cards/reuters21578/ModHayes.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/reuters21578 2026-01-06T13:30:34,299 copying build/lib/unitxt/catalog/cards/reuters21578/ModLewis.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/reuters21578 2026-01-06T13:30:34,301 copying build/lib/unitxt/catalog/cards/mrpc.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards 2026-01-06T13:30:34,303 copying build/lib/unitxt/catalog/cards/wikitq.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards 2026-01-06T13:30:34,305 copying build/lib/unitxt/catalog/cards/almost_evil.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards 2026-01-06T13:30:34,307 copying build/lib/unitxt/catalog/cards/ai2d.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards 2026-01-06T13:30:34,309 creating build/bdist.linux-armv7l/wheel/unitxt/catalog/cards/ai2_arc 2026-01-06T13:30:34,310 copying build/lib/unitxt/catalog/cards/ai2_arc/arc_challenge.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/ai2_arc 2026-01-06T13:30:34,312 copying build/lib/unitxt/catalog/cards/ai2_arc/arc_easy.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/ai2_arc 2026-01-06T13:30:34,314 copying build/lib/unitxt/catalog/cards/simple_qa.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards 2026-01-06T13:30:34,316 copying build/lib/unitxt/catalog/cards/hh_rlhf.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards 2026-01-06T13:30:34,318 creating build/bdist.linux-armv7l/wheel/unitxt/catalog/cards/global_mmlu_lite_ca 2026-01-06T13:30:34,319 copying build/lib/unitxt/catalog/cards/global_mmlu_lite_ca/zh.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu_lite_ca 2026-01-06T13:30:34,322 copying build/lib/unitxt/catalog/cards/global_mmlu_lite_ca/it.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu_lite_ca 2026-01-06T13:30:34,324 copying build/lib/unitxt/catalog/cards/global_mmlu_lite_ca/ar.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu_lite_ca 2026-01-06T13:30:34,326 copying build/lib/unitxt/catalog/cards/global_mmlu_lite_ca/bn.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu_lite_ca 2026-01-06T13:30:34,328 copying build/lib/unitxt/catalog/cards/global_mmlu_lite_ca/yo.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu_lite_ca 2026-01-06T13:30:34,331 copying build/lib/unitxt/catalog/cards/global_mmlu_lite_ca/es.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu_lite_ca 2026-01-06T13:30:34,333 copying build/lib/unitxt/catalog/cards/global_mmlu_lite_ca/ja.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu_lite_ca 2026-01-06T13:30:34,335 copying build/lib/unitxt/catalog/cards/global_mmlu_lite_ca/ko.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu_lite_ca 2026-01-06T13:30:34,337 copying build/lib/unitxt/catalog/cards/global_mmlu_lite_ca/pt.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu_lite_ca 2026-01-06T13:30:34,339 copying build/lib/unitxt/catalog/cards/global_mmlu_lite_ca/id.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu_lite_ca 2026-01-06T13:30:34,342 copying build/lib/unitxt/catalog/cards/global_mmlu_lite_ca/de.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu_lite_ca 2026-01-06T13:30:34,344 copying build/lib/unitxt/catalog/cards/global_mmlu_lite_ca/fr.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu_lite_ca 2026-01-06T13:30:34,346 copying build/lib/unitxt/catalog/cards/global_mmlu_lite_ca/sw.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu_lite_ca 2026-01-06T13:30:34,349 copying build/lib/unitxt/catalog/cards/global_mmlu_lite_ca/hi.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu_lite_ca 2026-01-06T13:30:34,351 creating build/bdist.linux-armv7l/wheel/unitxt/catalog/cards/babi 2026-01-06T13:30:34,353 copying build/lib/unitxt/catalog/cards/babi/qa.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/babi 2026-01-06T13:30:34,355 copying build/lib/unitxt/catalog/cards/numeric_nlg.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards 2026-01-06T13:30:34,357 copying build/lib/unitxt/catalog/cards/attaq_500.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards 2026-01-06T13:30:34,361 creating build/bdist.linux-armv7l/wheel/unitxt/catalog/cards/tablebench_data_analysis 2026-01-06T13:30:34,362 copying build/lib/unitxt/catalog/cards/tablebench_data_analysis/legacy.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/tablebench_data_analysis 2026-01-06T13:30:34,365 creating build/bdist.linux-armv7l/wheel/unitxt/catalog/cards/tot 2026-01-06T13:30:34,366 copying build/lib/unitxt/catalog/cards/tot/semantic.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/tot 2026-01-06T13:30:34,368 copying build/lib/unitxt/catalog/cards/tot/arithmetic.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/tot 2026-01-06T13:30:34,369 copying build/lib/unitxt/catalog/cards/seed_bench.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards 2026-01-06T13:30:34,371 copying build/lib/unitxt/catalog/cards/ledgar.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards 2026-01-06T13:30:34,374 copying build/lib/unitxt/catalog/cards/openbook_qa.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards 2026-01-06T13:30:34,376 copying build/lib/unitxt/catalog/cards/dart.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards 2026-01-06T13:30:34,378 copying build/lib/unitxt/catalog/cards/billsum_document_filtered_to_10000_chars.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards 2026-01-06T13:30:34,380 copying build/lib/unitxt/catalog/cards/piqa.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards 2026-01-06T13:30:34,382 copying build/lib/unitxt/catalog/cards/toxigen.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards 2026-01-06T13:30:34,384 creating build/bdist.linux-armv7l/wheel/unitxt/catalog/cards/legalbench 2026-01-06T13:30:34,385 copying build/lib/unitxt/catalog/cards/legalbench/proa.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/legalbench 2026-01-06T13:30:34,387 copying build/lib/unitxt/catalog/cards/legalbench/function_of_decision_section.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/legalbench 2026-01-06T13:30:34,389 copying build/lib/unitxt/catalog/cards/legalbench/international_citizenship_questions.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/legalbench 2026-01-06T13:30:34,391 copying build/lib/unitxt/catalog/cards/legalbench/corporate_lobbying.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/legalbench 2026-01-06T13:30:34,393 copying build/lib/unitxt/catalog/cards/legalbench/abercrombie.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/legalbench 2026-01-06T13:30:34,396 copying build/lib/unitxt/catalog/cards/tablebench.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards 2026-01-06T13:30:34,398 copying build/lib/unitxt/catalog/cards/social_iqa.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards 2026-01-06T13:30:34,401 creating build/bdist.linux-armv7l/wheel/unitxt/catalog/cards/go_emotions 2026-01-06T13:30:34,402 copying build/lib/unitxt/catalog/cards/go_emotions/simplified.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/go_emotions 2026-01-06T13:30:34,404 copying build/lib/unitxt/catalog/cards/pop_qa.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards 2026-01-06T13:30:34,406 copying build/lib/unitxt/catalog/cards/qnli.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards 2026-01-06T13:30:34,408 creating build/bdist.linux-armv7l/wheel/unitxt/catalog/cards/ffqa_filtered 2026-01-06T13:30:34,409 copying build/lib/unitxt/catalog/cards/ffqa_filtered/8k.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/ffqa_filtered 2026-01-06T13:30:34,411 copying build/lib/unitxt/catalog/cards/ffqa_filtered/16k.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/ffqa_filtered 2026-01-06T13:30:34,413 copying build/lib/unitxt/catalog/cards/ffqa_filtered/4k.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/ffqa_filtered 2026-01-06T13:30:34,415 copying build/lib/unitxt/catalog/cards/ffqa_filtered/2k.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/ffqa_filtered 2026-01-06T13:30:34,417 copying build/lib/unitxt/catalog/cards/hellaswag.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards 2026-01-06T13:30:34,419 copying build/lib/unitxt/catalog/cards/tldr_document_filtered_to_10000_chars.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards 2026-01-06T13:30:34,421 copying build/lib/unitxt/catalog/cards/mbpp.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards 2026-01-06T13:30:34,422 copying build/lib/unitxt/catalog/cards/open_australian_legal_qa.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards 2026-01-06T13:30:34,424 copying build/lib/unitxt/catalog/cards/dbpedia_14.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards 2026-01-06T13:30:34,427 creating build/bdist.linux-armv7l/wheel/unitxt/catalog/cards/coedit 2026-01-06T13:30:34,428 copying build/lib/unitxt/catalog/cards/coedit/rewriting.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/coedit 2026-01-06T13:30:34,430 copying build/lib/unitxt/catalog/cards/coedit/selection.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/coedit 2026-01-06T13:30:34,432 copying build/lib/unitxt/catalog/cards/coedit/preference.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/coedit 2026-01-06T13:30:34,434 copying build/lib/unitxt/catalog/cards/coedit/paraphrase.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/coedit 2026-01-06T13:30:34,436 creating build/bdist.linux-armv7l/wheel/unitxt/catalog/cards/universal_ner 2026-01-06T13:30:34,438 creating build/bdist.linux-armv7l/wheel/unitxt/catalog/cards/universal_ner/en 2026-01-06T13:30:34,440 copying build/lib/unitxt/catalog/cards/universal_ner/en/pud.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/universal_ner/en 2026-01-06T13:30:34,442 copying build/lib/unitxt/catalog/cards/universal_ner/en/ewt.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/universal_ner/en 2026-01-06T13:30:34,445 creating build/bdist.linux-armv7l/wheel/unitxt/catalog/cards/universal_ner/da 2026-01-06T13:30:34,446 copying build/lib/unitxt/catalog/cards/universal_ner/da/ddt.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/universal_ner/da 2026-01-06T13:30:34,449 creating build/bdist.linux-armv7l/wheel/unitxt/catalog/cards/universal_ner/ceb 2026-01-06T13:30:34,450 copying build/lib/unitxt/catalog/cards/universal_ner/ceb/gja.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/universal_ner/ceb 2026-01-06T13:30:34,452 creating build/bdist.linux-armv7l/wheel/unitxt/catalog/cards/universal_ner/tl 2026-01-06T13:30:34,453 copying build/lib/unitxt/catalog/cards/universal_ner/tl/trg.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/universal_ner/tl 2026-01-06T13:30:34,455 copying build/lib/unitxt/catalog/cards/universal_ner/tl/ugnayan.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/universal_ner/tl 2026-01-06T13:30:34,458 creating build/bdist.linux-armv7l/wheel/unitxt/catalog/cards/universal_ner/ru 2026-01-06T13:30:34,459 copying build/lib/unitxt/catalog/cards/universal_ner/ru/pud.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/universal_ner/ru 2026-01-06T13:30:34,461 creating build/bdist.linux-armv7l/wheel/unitxt/catalog/cards/universal_ner/zh 2026-01-06T13:30:34,462 copying build/lib/unitxt/catalog/cards/universal_ner/zh/gsdsimp.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/universal_ner/zh 2026-01-06T13:30:34,464 copying build/lib/unitxt/catalog/cards/universal_ner/zh/gsd.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/universal_ner/zh 2026-01-06T13:30:34,466 copying build/lib/unitxt/catalog/cards/universal_ner/zh/pud.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/universal_ner/zh 2026-01-06T13:30:34,469 creating build/bdist.linux-armv7l/wheel/unitxt/catalog/cards/universal_ner/de 2026-01-06T13:30:34,470 copying build/lib/unitxt/catalog/cards/universal_ner/de/pud.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/universal_ner/de 2026-01-06T13:30:34,472 creating build/bdist.linux-armv7l/wheel/unitxt/catalog/cards/universal_ner/pt 2026-01-06T13:30:34,473 copying build/lib/unitxt/catalog/cards/universal_ner/pt/bosque.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/universal_ner/pt 2026-01-06T13:30:34,475 copying build/lib/unitxt/catalog/cards/universal_ner/pt/pud.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/universal_ner/pt 2026-01-06T13:30:34,478 creating build/bdist.linux-armv7l/wheel/unitxt/catalog/cards/universal_ner/sk 2026-01-06T13:30:34,479 copying build/lib/unitxt/catalog/cards/universal_ner/sk/snk.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/universal_ner/sk 2026-01-06T13:30:34,482 creating build/bdist.linux-armv7l/wheel/unitxt/catalog/cards/universal_ner/sv 2026-01-06T13:30:34,483 copying build/lib/unitxt/catalog/cards/universal_ner/sv/talbanken.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/universal_ner/sv 2026-01-06T13:30:34,485 copying build/lib/unitxt/catalog/cards/universal_ner/sv/pud.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/universal_ner/sv 2026-01-06T13:30:34,487 creating build/bdist.linux-armv7l/wheel/unitxt/catalog/cards/universal_ner/sr 2026-01-06T13:30:34,488 copying build/lib/unitxt/catalog/cards/universal_ner/sr/set.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/universal_ner/sr 2026-01-06T13:30:34,491 creating build/bdist.linux-armv7l/wheel/unitxt/catalog/cards/universal_ner/hr 2026-01-06T13:30:34,492 copying build/lib/unitxt/catalog/cards/universal_ner/hr/set.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/universal_ner/hr 2026-01-06T13:30:34,493 copying build/lib/unitxt/catalog/cards/info_vqa.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards 2026-01-06T13:30:34,496 creating build/bdist.linux-armv7l/wheel/unitxt/catalog/cards/cohere_for_ai 2026-01-06T13:30:34,497 creating build/bdist.linux-armv7l/wheel/unitxt/catalog/cards/cohere_for_ai/aya_human_annotated 2026-01-06T13:30:34,498 copying build/lib/unitxt/catalog/cards/cohere_for_ai/aya_human_annotated/eng.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/cohere_for_ai/aya_human_annotated 2026-01-06T13:30:34,500 copying build/lib/unitxt/catalog/cards/cohere_for_ai/aya_human_annotated/tur.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/cohere_for_ai/aya_human_annotated 2026-01-06T13:30:34,502 copying build/lib/unitxt/catalog/cards/cohere_for_ai/aya_human_annotated/arb.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/cohere_for_ai/aya_human_annotated 2026-01-06T13:30:34,504 copying build/lib/unitxt/catalog/cards/cohere_for_ai/aya_human_annotated/tel.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/cohere_for_ai/aya_human_annotated 2026-01-06T13:30:34,506 copying build/lib/unitxt/catalog/cards/cohere_for_ai/aya_human_annotated/yor.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/cohere_for_ai/aya_human_annotated 2026-01-06T13:30:34,508 copying build/lib/unitxt/catalog/cards/cohere_for_ai/aya_human_annotated/zho.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/cohere_for_ai/aya_human_annotated 2026-01-06T13:30:34,510 copying build/lib/unitxt/catalog/cards/cohere_for_ai/aya_human_annotated/por.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/cohere_for_ai/aya_human_annotated 2026-01-06T13:30:34,512 creating build/bdist.linux-armv7l/wheel/unitxt/catalog/cards/cohere_for_ai/dolly_machine_translated 2026-01-06T13:30:34,513 copying build/lib/unitxt/catalog/cards/cohere_for_ai/dolly_machine_translated/fra.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/cohere_for_ai/dolly_machine_translated 2026-01-06T13:30:34,515 copying build/lib/unitxt/catalog/cards/cohere_for_ai/dolly_machine_translated/eng.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/cohere_for_ai/dolly_machine_translated 2026-01-06T13:30:34,517 copying build/lib/unitxt/catalog/cards/cohere_for_ai/dolly_machine_translated/deu.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/cohere_for_ai/dolly_machine_translated 2026-01-06T13:30:34,519 copying build/lib/unitxt/catalog/cards/cohere_for_ai/dolly_machine_translated/spa.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/cohere_for_ai/dolly_machine_translated 2026-01-06T13:30:34,521 copying build/lib/unitxt/catalog/cards/cohere_for_ai/dolly_machine_translated/jpn.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/cohere_for_ai/dolly_machine_translated 2026-01-06T13:30:34,523 copying build/lib/unitxt/catalog/cards/cohere_for_ai/dolly_machine_translated/por.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/cohere_for_ai/dolly_machine_translated 2026-01-06T13:30:34,525 creating build/bdist.linux-armv7l/wheel/unitxt/catalog/cards/cohere_for_ai/dolly_human_edited 2026-01-06T13:30:34,526 copying build/lib/unitxt/catalog/cards/cohere_for_ai/dolly_human_edited/fra.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/cohere_for_ai/dolly_human_edited 2026-01-06T13:30:34,528 copying build/lib/unitxt/catalog/cards/cohere_for_ai/dolly_human_edited/spa.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/cohere_for_ai/dolly_human_edited 2026-01-06T13:30:34,530 copying build/lib/unitxt/catalog/cards/race_all.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards 2026-01-06T13:30:34,533 creating build/bdist.linux-armv7l/wheel/unitxt/catalog/cards/mmlu_pro 2026-01-06T13:30:34,534 copying build/lib/unitxt/catalog/cards/mmlu_pro/law.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/mmlu_pro 2026-01-06T13:30:34,536 copying build/lib/unitxt/catalog/cards/mmlu_pro/health.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/mmlu_pro 2026-01-06T13:30:34,537 copying build/lib/unitxt/catalog/cards/mmlu_pro/engineering.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/mmlu_pro 2026-01-06T13:30:34,539 copying build/lib/unitxt/catalog/cards/mmlu_pro/computer_science.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/mmlu_pro 2026-01-06T13:30:34,541 copying build/lib/unitxt/catalog/cards/mmlu_pro/math.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/mmlu_pro 2026-01-06T13:30:34,543 copying build/lib/unitxt/catalog/cards/mmlu_pro/physics.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/mmlu_pro 2026-01-06T13:30:34,544 copying build/lib/unitxt/catalog/cards/mmlu_pro/economics.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/mmlu_pro 2026-01-06T13:30:34,546 copying build/lib/unitxt/catalog/cards/mmlu_pro/business.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/mmlu_pro 2026-01-06T13:30:34,548 copying build/lib/unitxt/catalog/cards/mmlu_pro/psychology.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/mmlu_pro 2026-01-06T13:30:34,550 copying build/lib/unitxt/catalog/cards/mmlu_pro/history.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/mmlu_pro 2026-01-06T13:30:34,552 copying build/lib/unitxt/catalog/cards/mmlu_pro/biology.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/mmlu_pro 2026-01-06T13:30:34,554 copying build/lib/unitxt/catalog/cards/mmlu_pro/other.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/mmlu_pro 2026-01-06T13:30:34,555 copying build/lib/unitxt/catalog/cards/mmlu_pro/philosophy.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/mmlu_pro 2026-01-06T13:30:34,557 copying build/lib/unitxt/catalog/cards/mmlu_pro/chemistry.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/mmlu_pro 2026-01-06T13:30:34,559 copying build/lib/unitxt/catalog/cards/tldr_document_filtered_to_6000_chars.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards 2026-01-06T13:30:34,561 copying build/lib/unitxt/catalog/cards/ethos_binary.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards 2026-01-06T13:30:34,564 creating build/bdist.linux-armv7l/wheel/unitxt/catalog/cards/text2sql 2026-01-06T13:30:34,565 copying build/lib/unitxt/catalog/cards/text2sql/bird.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/text2sql 2026-01-06T13:30:34,567 copying build/lib/unitxt/catalog/cards/tablebench_data_analysis.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards 2026-01-06T13:30:34,569 copying build/lib/unitxt/catalog/cards/attaq.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards 2026-01-06T13:30:34,571 copying build/lib/unitxt/catalog/cards/tablebench_numerical_reasoning.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards 2026-01-06T13:30:34,573 copying build/lib/unitxt/catalog/cards/yahoo_answers_topics.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards 2026-01-06T13:30:34,575 creating build/bdist.linux-armv7l/wheel/unitxt/catalog/cards/xlsum 2026-01-06T13:30:34,577 copying build/lib/unitxt/catalog/cards/xlsum/thai.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/xlsum 2026-01-06T13:30:34,579 copying build/lib/unitxt/catalog/cards/xlsum/scottish_gaelic.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/xlsum 2026-01-06T13:30:34,580 copying build/lib/unitxt/catalog/cards/xlsum/french.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/xlsum 2026-01-06T13:30:34,582 copying build/lib/unitxt/catalog/cards/xlsum/igbo.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/xlsum 2026-01-06T13:30:34,584 copying build/lib/unitxt/catalog/cards/xlsum/gujarati.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/xlsum 2026-01-06T13:30:34,586 copying build/lib/unitxt/catalog/cards/xlsum/turkish.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/xlsum 2026-01-06T13:30:34,588 copying build/lib/unitxt/catalog/cards/xlsum/burmese.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/xlsum 2026-01-06T13:30:34,589 copying build/lib/unitxt/catalog/cards/xlsum/arabic.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/xlsum 2026-01-06T13:30:34,591 copying build/lib/unitxt/catalog/cards/xlsum/japanese.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/xlsum 2026-01-06T13:30:34,593 copying build/lib/unitxt/catalog/cards/xlsum/amharic.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/xlsum 2026-01-06T13:30:34,595 copying build/lib/unitxt/catalog/cards/xlsum/ukrainian.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/xlsum 2026-01-06T13:30:34,596 copying build/lib/unitxt/catalog/cards/xlsum/indonesian.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/xlsum 2026-01-06T13:30:34,598 copying build/lib/unitxt/catalog/cards/xlsum/tamil.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/xlsum 2026-01-06T13:30:34,600 copying build/lib/unitxt/catalog/cards/xlsum/spanish.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/xlsum 2026-01-06T13:30:34,602 copying build/lib/unitxt/catalog/cards/xlsum/tigrinya.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/xlsum 2026-01-06T13:30:34,603 copying build/lib/unitxt/catalog/cards/xlsum/welsh.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/xlsum 2026-01-06T13:30:34,605 copying build/lib/unitxt/catalog/cards/xlsum/vietnamese.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/xlsum 2026-01-06T13:30:34,607 copying build/lib/unitxt/catalog/cards/xlsum/urdu.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/xlsum 2026-01-06T13:30:34,609 copying build/lib/unitxt/catalog/cards/xlsum/yoruba.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/xlsum 2026-01-06T13:30:34,611 copying build/lib/unitxt/catalog/cards/xlsum/chinese_traditional.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/xlsum 2026-01-06T13:30:34,612 copying build/lib/unitxt/catalog/cards/xlsum/portuguese.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/xlsum 2026-01-06T13:30:34,614 copying build/lib/unitxt/catalog/cards/xlsum/pashto.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/xlsum 2026-01-06T13:30:34,616 copying build/lib/unitxt/catalog/cards/xlsum/persian.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/xlsum 2026-01-06T13:30:34,618 copying build/lib/unitxt/catalog/cards/xlsum/sinhala.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/xlsum 2026-01-06T13:30:34,620 copying build/lib/unitxt/catalog/cards/xlsum/serbian_cyrillic.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/xlsum 2026-01-06T13:30:34,621 copying build/lib/unitxt/catalog/cards/xlsum/nepali.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/xlsum 2026-01-06T13:30:34,623 copying build/lib/unitxt/catalog/cards/xlsum/somali.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/xlsum 2026-01-06T13:30:34,625 copying build/lib/unitxt/catalog/cards/xlsum/hausa.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/xlsum 2026-01-06T13:30:34,627 copying build/lib/unitxt/catalog/cards/xlsum/punjabi.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/xlsum 2026-01-06T13:30:34,629 copying build/lib/unitxt/catalog/cards/xlsum/kirundi.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/xlsum 2026-01-06T13:30:34,631 copying build/lib/unitxt/catalog/cards/xlsum/english.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/xlsum 2026-01-06T13:30:34,633 copying build/lib/unitxt/catalog/cards/xlsum/russian.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/xlsum 2026-01-06T13:30:34,635 copying build/lib/unitxt/catalog/cards/xlsum/uzbek.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/xlsum 2026-01-06T13:30:34,636 copying build/lib/unitxt/catalog/cards/xlsum/oromo.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/xlsum 2026-01-06T13:30:34,638 copying build/lib/unitxt/catalog/cards/xlsum/telugu.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/xlsum 2026-01-06T13:30:34,640 copying build/lib/unitxt/catalog/cards/xlsum/korean.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/xlsum 2026-01-06T13:30:34,642 copying build/lib/unitxt/catalog/cards/xlsum/bengali.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/xlsum 2026-01-06T13:30:34,644 copying build/lib/unitxt/catalog/cards/xlsum/pidgin.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/xlsum 2026-01-06T13:30:34,646 copying build/lib/unitxt/catalog/cards/xlsum/marathi.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/xlsum 2026-01-06T13:30:34,648 copying build/lib/unitxt/catalog/cards/xlsum/swahili.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/xlsum 2026-01-06T13:30:34,650 copying build/lib/unitxt/catalog/cards/xlsum/hindi.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/xlsum 2026-01-06T13:30:34,651 copying build/lib/unitxt/catalog/cards/xlsum/serbian_latin.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/xlsum 2026-01-06T13:30:34,653 copying build/lib/unitxt/catalog/cards/xlsum/chinese_simplified.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/xlsum 2026-01-06T13:30:34,655 copying build/lib/unitxt/catalog/cards/xlsum/azerbaijani.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/xlsum 2026-01-06T13:30:34,657 copying build/lib/unitxt/catalog/cards/xlsum/kyrgyz.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/xlsum 2026-01-06T13:30:34,659 copying build/lib/unitxt/catalog/cards/language_identification.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards 2026-01-06T13:30:34,661 creating build/bdist.linux-armv7l/wheel/unitxt/catalog/cards/milu 2026-01-06T13:30:34,663 creating build/bdist.linux-armv7l/wheel/unitxt/catalog/cards/milu/Hindi 2026-01-06T13:30:34,664 copying build/lib/unitxt/catalog/cards/milu/Hindi/Science.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/milu/Hindi 2026-01-06T13:30:34,666 copying build/lib/unitxt/catalog/cards/milu/Hindi/Arts_and_Humanities.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/milu/Hindi 2026-01-06T13:30:34,668 copying build/lib/unitxt/catalog/cards/milu/Hindi/Law_and_Governance.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/milu/Hindi 2026-01-06T13:30:34,670 copying build/lib/unitxt/catalog/cards/milu/Hindi/Business_Studies.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/milu/Hindi 2026-01-06T13:30:34,672 copying build/lib/unitxt/catalog/cards/milu/Hindi/Environmental_Sciences.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/milu/Hindi 2026-01-06T13:30:34,674 copying build/lib/unitxt/catalog/cards/milu/Hindi/Engineering_and_Tech.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/milu/Hindi 2026-01-06T13:30:34,676 copying build/lib/unitxt/catalog/cards/milu/Hindi/Health_and_Medicine.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/milu/Hindi 2026-01-06T13:30:34,678 copying build/lib/unitxt/catalog/cards/milu/Hindi/Social_Sciences.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/milu/Hindi 2026-01-06T13:30:34,680 creating build/bdist.linux-armv7l/wheel/unitxt/catalog/cards/milu/English 2026-01-06T13:30:34,681 copying build/lib/unitxt/catalog/cards/milu/English/Science.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/milu/English 2026-01-06T13:30:34,683 copying build/lib/unitxt/catalog/cards/milu/English/Arts_and_Humanities.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/milu/English 2026-01-06T13:30:34,685 copying build/lib/unitxt/catalog/cards/milu/English/Law_and_Governance.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/milu/English 2026-01-06T13:30:34,687 copying build/lib/unitxt/catalog/cards/milu/English/Business_Studies.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/milu/English 2026-01-06T13:30:34,689 copying build/lib/unitxt/catalog/cards/milu/English/Environmental_Sciences.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/milu/English 2026-01-06T13:30:34,691 copying build/lib/unitxt/catalog/cards/milu/English/Engineering_and_Tech.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/milu/English 2026-01-06T13:30:34,693 copying build/lib/unitxt/catalog/cards/milu/English/Health_and_Medicine.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/milu/English 2026-01-06T13:30:34,695 copying build/lib/unitxt/catalog/cards/milu/English/Social_Sciences.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/milu/English 2026-01-06T13:30:34,697 creating build/bdist.linux-armv7l/wheel/unitxt/catalog/cards/milu/Tamil 2026-01-06T13:30:34,699 copying build/lib/unitxt/catalog/cards/milu/Tamil/Science.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/milu/Tamil 2026-01-06T13:30:34,700 copying build/lib/unitxt/catalog/cards/milu/Tamil/Arts_and_Humanities.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/milu/Tamil 2026-01-06T13:30:34,702 copying build/lib/unitxt/catalog/cards/milu/Tamil/Law_and_Governance.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/milu/Tamil 2026-01-06T13:30:34,704 copying build/lib/unitxt/catalog/cards/milu/Tamil/Business_Studies.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/milu/Tamil 2026-01-06T13:30:34,706 copying build/lib/unitxt/catalog/cards/milu/Tamil/Environmental_Sciences.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/milu/Tamil 2026-01-06T13:30:34,708 copying build/lib/unitxt/catalog/cards/milu/Tamil/Engineering_and_Tech.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/milu/Tamil 2026-01-06T13:30:34,710 copying build/lib/unitxt/catalog/cards/milu/Tamil/Health_and_Medicine.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/milu/Tamil 2026-01-06T13:30:34,712 copying build/lib/unitxt/catalog/cards/milu/Tamil/Social_Sciences.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/milu/Tamil 2026-01-06T13:30:34,714 creating build/bdist.linux-armv7l/wheel/unitxt/catalog/cards/milu/Telugu 2026-01-06T13:30:34,715 copying build/lib/unitxt/catalog/cards/milu/Telugu/Science.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/milu/Telugu 2026-01-06T13:30:34,718 copying build/lib/unitxt/catalog/cards/milu/Telugu/Arts_and_Humanities.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/milu/Telugu 2026-01-06T13:30:34,720 copying build/lib/unitxt/catalog/cards/milu/Telugu/Law_and_Governance.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/milu/Telugu 2026-01-06T13:30:34,722 copying build/lib/unitxt/catalog/cards/milu/Telugu/Business_Studies.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/milu/Telugu 2026-01-06T13:30:34,724 copying build/lib/unitxt/catalog/cards/milu/Telugu/Environmental_Sciences.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/milu/Telugu 2026-01-06T13:30:34,726 copying build/lib/unitxt/catalog/cards/milu/Telugu/Engineering_and_Tech.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/milu/Telugu 2026-01-06T13:30:34,728 copying build/lib/unitxt/catalog/cards/milu/Telugu/Health_and_Medicine.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/milu/Telugu 2026-01-06T13:30:34,730 copying build/lib/unitxt/catalog/cards/milu/Telugu/Social_Sciences.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/milu/Telugu 2026-01-06T13:30:34,733 creating build/bdist.linux-armv7l/wheel/unitxt/catalog/cards/milu/Malayalam 2026-01-06T13:30:34,735 copying build/lib/unitxt/catalog/cards/milu/Malayalam/Science.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/milu/Malayalam 2026-01-06T13:30:34,737 copying build/lib/unitxt/catalog/cards/milu/Malayalam/Arts_and_Humanities.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/milu/Malayalam 2026-01-06T13:30:34,738 copying build/lib/unitxt/catalog/cards/milu/Malayalam/Law_and_Governance.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/milu/Malayalam 2026-01-06T13:30:34,740 copying build/lib/unitxt/catalog/cards/milu/Malayalam/Business_Studies.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/milu/Malayalam 2026-01-06T13:30:34,742 copying build/lib/unitxt/catalog/cards/milu/Malayalam/Environmental_Sciences.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/milu/Malayalam 2026-01-06T13:30:34,744 copying build/lib/unitxt/catalog/cards/milu/Malayalam/Engineering_and_Tech.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/milu/Malayalam 2026-01-06T13:30:34,746 copying build/lib/unitxt/catalog/cards/milu/Malayalam/Health_and_Medicine.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/milu/Malayalam 2026-01-06T13:30:34,747 copying build/lib/unitxt/catalog/cards/milu/Malayalam/Social_Sciences.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/milu/Malayalam 2026-01-06T13:30:34,750 creating build/bdist.linux-armv7l/wheel/unitxt/catalog/cards/milu/Kannada 2026-01-06T13:30:34,751 copying build/lib/unitxt/catalog/cards/milu/Kannada/Science.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/milu/Kannada 2026-01-06T13:30:34,753 copying build/lib/unitxt/catalog/cards/milu/Kannada/Arts_and_Humanities.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/milu/Kannada 2026-01-06T13:30:34,755 copying build/lib/unitxt/catalog/cards/milu/Kannada/Law_and_Governance.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/milu/Kannada 2026-01-06T13:30:34,756 copying build/lib/unitxt/catalog/cards/milu/Kannada/Business_Studies.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/milu/Kannada 2026-01-06T13:30:34,758 copying build/lib/unitxt/catalog/cards/milu/Kannada/Environmental_Sciences.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/milu/Kannada 2026-01-06T13:30:34,760 copying build/lib/unitxt/catalog/cards/milu/Kannada/Engineering_and_Tech.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/milu/Kannada 2026-01-06T13:30:34,762 copying build/lib/unitxt/catalog/cards/milu/Kannada/Health_and_Medicine.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/milu/Kannada 2026-01-06T13:30:34,764 copying build/lib/unitxt/catalog/cards/milu/Kannada/Social_Sciences.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/milu/Kannada 2026-01-06T13:30:34,766 creating build/bdist.linux-armv7l/wheel/unitxt/catalog/cards/milu/Odia 2026-01-06T13:30:34,767 copying build/lib/unitxt/catalog/cards/milu/Odia/Science.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/milu/Odia 2026-01-06T13:30:34,769 copying build/lib/unitxt/catalog/cards/milu/Odia/Arts_and_Humanities.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/milu/Odia 2026-01-06T13:30:34,772 copying build/lib/unitxt/catalog/cards/milu/Odia/Law_and_Governance.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/milu/Odia 2026-01-06T13:30:34,773 copying build/lib/unitxt/catalog/cards/milu/Odia/Business_Studies.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/milu/Odia 2026-01-06T13:30:34,775 copying build/lib/unitxt/catalog/cards/milu/Odia/Environmental_Sciences.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/milu/Odia 2026-01-06T13:30:34,777 copying build/lib/unitxt/catalog/cards/milu/Odia/Engineering_and_Tech.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/milu/Odia 2026-01-06T13:30:34,779 copying build/lib/unitxt/catalog/cards/milu/Odia/Health_and_Medicine.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/milu/Odia 2026-01-06T13:30:34,781 copying build/lib/unitxt/catalog/cards/milu/Odia/Social_Sciences.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/milu/Odia 2026-01-06T13:30:34,783 creating build/bdist.linux-armv7l/wheel/unitxt/catalog/cards/milu/Bengali 2026-01-06T13:30:34,784 copying build/lib/unitxt/catalog/cards/milu/Bengali/Science.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/milu/Bengali 2026-01-06T13:30:34,786 copying build/lib/unitxt/catalog/cards/milu/Bengali/Arts_and_Humanities.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/milu/Bengali 2026-01-06T13:30:34,788 copying build/lib/unitxt/catalog/cards/milu/Bengali/Law_and_Governance.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/milu/Bengali 2026-01-06T13:30:34,790 copying build/lib/unitxt/catalog/cards/milu/Bengali/Business_Studies.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/milu/Bengali 2026-01-06T13:30:34,792 copying build/lib/unitxt/catalog/cards/milu/Bengali/Environmental_Sciences.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/milu/Bengali 2026-01-06T13:30:34,794 copying build/lib/unitxt/catalog/cards/milu/Bengali/Engineering_and_Tech.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/milu/Bengali 2026-01-06T13:30:34,796 copying build/lib/unitxt/catalog/cards/milu/Bengali/Health_and_Medicine.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/milu/Bengali 2026-01-06T13:30:34,797 copying build/lib/unitxt/catalog/cards/milu/Bengali/Social_Sciences.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/milu/Bengali 2026-01-06T13:30:34,800 creating build/bdist.linux-armv7l/wheel/unitxt/catalog/cards/milu/Punjabi 2026-01-06T13:30:34,801 copying build/lib/unitxt/catalog/cards/milu/Punjabi/Science.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/milu/Punjabi 2026-01-06T13:30:34,803 copying build/lib/unitxt/catalog/cards/milu/Punjabi/Arts_and_Humanities.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/milu/Punjabi 2026-01-06T13:30:34,805 copying build/lib/unitxt/catalog/cards/milu/Punjabi/Law_and_Governance.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/milu/Punjabi 2026-01-06T13:30:34,807 copying build/lib/unitxt/catalog/cards/milu/Punjabi/Business_Studies.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/milu/Punjabi 2026-01-06T13:30:34,809 copying build/lib/unitxt/catalog/cards/milu/Punjabi/Environmental_Sciences.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/milu/Punjabi 2026-01-06T13:30:34,811 copying build/lib/unitxt/catalog/cards/milu/Punjabi/Engineering_and_Tech.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/milu/Punjabi 2026-01-06T13:30:34,812 copying build/lib/unitxt/catalog/cards/milu/Punjabi/Health_and_Medicine.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/milu/Punjabi 2026-01-06T13:30:34,814 copying build/lib/unitxt/catalog/cards/milu/Punjabi/Social_Sciences.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/milu/Punjabi 2026-01-06T13:30:34,817 creating build/bdist.linux-armv7l/wheel/unitxt/catalog/cards/milu/Marathi 2026-01-06T13:30:34,818 copying build/lib/unitxt/catalog/cards/milu/Marathi/Science.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/milu/Marathi 2026-01-06T13:30:34,820 copying build/lib/unitxt/catalog/cards/milu/Marathi/Arts_and_Humanities.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/milu/Marathi 2026-01-06T13:30:34,822 copying build/lib/unitxt/catalog/cards/milu/Marathi/Law_and_Governance.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/milu/Marathi 2026-01-06T13:30:34,824 copying build/lib/unitxt/catalog/cards/milu/Marathi/Business_Studies.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/milu/Marathi 2026-01-06T13:30:34,826 copying build/lib/unitxt/catalog/cards/milu/Marathi/Environmental_Sciences.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/milu/Marathi 2026-01-06T13:30:34,828 copying build/lib/unitxt/catalog/cards/milu/Marathi/Engineering_and_Tech.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/milu/Marathi 2026-01-06T13:30:34,830 copying build/lib/unitxt/catalog/cards/milu/Marathi/Health_and_Medicine.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/milu/Marathi 2026-01-06T13:30:34,832 copying build/lib/unitxt/catalog/cards/milu/Marathi/Social_Sciences.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/milu/Marathi 2026-01-06T13:30:34,834 creating build/bdist.linux-armv7l/wheel/unitxt/catalog/cards/milu/Gujarati 2026-01-06T13:30:34,835 copying build/lib/unitxt/catalog/cards/milu/Gujarati/Science.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/milu/Gujarati 2026-01-06T13:30:34,837 copying build/lib/unitxt/catalog/cards/milu/Gujarati/Arts_and_Humanities.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/milu/Gujarati 2026-01-06T13:30:34,839 copying build/lib/unitxt/catalog/cards/milu/Gujarati/Law_and_Governance.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/milu/Gujarati 2026-01-06T13:30:34,841 copying build/lib/unitxt/catalog/cards/milu/Gujarati/Business_Studies.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/milu/Gujarati 2026-01-06T13:30:34,843 copying build/lib/unitxt/catalog/cards/milu/Gujarati/Environmental_Sciences.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/milu/Gujarati 2026-01-06T13:30:34,844 copying build/lib/unitxt/catalog/cards/milu/Gujarati/Engineering_and_Tech.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/milu/Gujarati 2026-01-06T13:30:34,846 copying build/lib/unitxt/catalog/cards/milu/Gujarati/Health_and_Medicine.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/milu/Gujarati 2026-01-06T13:30:34,848 copying build/lib/unitxt/catalog/cards/milu/Gujarati/Social_Sciences.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/milu/Gujarati 2026-01-06T13:30:34,850 copying build/lib/unitxt/catalog/cards/copa.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards 2026-01-06T13:30:34,852 creating build/bdist.linux-armv7l/wheel/unitxt/catalog/cards/coqa 2026-01-06T13:30:34,853 copying build/lib/unitxt/catalog/cards/coqa/multi_turn.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/coqa 2026-01-06T13:30:34,856 copying build/lib/unitxt/catalog/cards/coqa/qa.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/coqa 2026-01-06T13:30:34,858 copying build/lib/unitxt/catalog/cards/coqa/completion.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/coqa 2026-01-06T13:30:34,860 creating build/bdist.linux-armv7l/wheel/unitxt/catalog/cards/doc_vqa 2026-01-06T13:30:34,861 copying build/lib/unitxt/catalog/cards/doc_vqa/en.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/doc_vqa 2026-01-06T13:30:34,863 copying build/lib/unitxt/catalog/cards/doc_vqa/lmms_eval.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/doc_vqa 2026-01-06T13:30:34,865 copying build/lib/unitxt/catalog/cards/doc_vqa/fr.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/doc_vqa 2026-01-06T13:30:34,867 creating build/bdist.linux-armv7l/wheel/unitxt/catalog/cards/clinc_oos 2026-01-06T13:30:34,868 copying build/lib/unitxt/catalog/cards/clinc_oos/small.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/clinc_oos 2026-01-06T13:30:34,871 copying build/lib/unitxt/catalog/cards/clinc_oos/plus.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/clinc_oos 2026-01-06T13:30:34,873 copying build/lib/unitxt/catalog/cards/clinc_oos/imbalanced.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/clinc_oos 2026-01-06T13:30:34,876 copying build/lib/unitxt/catalog/cards/xlam_function_calling_60k.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards 2026-01-06T13:30:34,878 copying build/lib/unitxt/catalog/cards/tablebench_fact_checking.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards 2026-01-06T13:30:34,880 copying build/lib/unitxt/catalog/cards/wnli.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards 2026-01-06T13:30:34,882 creating build/bdist.linux-armv7l/wheel/unitxt/catalog/cards/safety 2026-01-06T13:30:34,884 creating build/bdist.linux-armv7l/wheel/unitxt/catalog/cards/safety/bbq 2026-01-06T13:30:34,885 copying build/lib/unitxt/catalog/cards/safety/bbq/Race_x_gender.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/safety/bbq 2026-01-06T13:30:34,887 copying build/lib/unitxt/catalog/cards/safety/bbq/Gender_identity.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/safety/bbq 2026-01-06T13:30:34,889 copying build/lib/unitxt/catalog/cards/safety/bbq/Sexual_orientation.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/safety/bbq 2026-01-06T13:30:34,891 copying build/lib/unitxt/catalog/cards/safety/bbq/Religion.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/safety/bbq 2026-01-06T13:30:34,893 copying build/lib/unitxt/catalog/cards/safety/bbq/Race_ethnicity.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/safety/bbq 2026-01-06T13:30:34,894 copying build/lib/unitxt/catalog/cards/safety/bbq/Age.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/safety/bbq 2026-01-06T13:30:34,896 copying build/lib/unitxt/catalog/cards/safety/bbq/Nationality.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/safety/bbq 2026-01-06T13:30:34,898 copying build/lib/unitxt/catalog/cards/safety/bbq/Physical_appearance.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/safety/bbq 2026-01-06T13:30:34,900 copying build/lib/unitxt/catalog/cards/safety/bbq/Disability_status.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/safety/bbq 2026-01-06T13:30:34,902 copying build/lib/unitxt/catalog/cards/safety/bbq/SES.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/safety/bbq 2026-01-06T13:30:34,903 copying build/lib/unitxt/catalog/cards/safety/bbq/Race_x_SES.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/safety/bbq 2026-01-06T13:30:34,905 copying build/lib/unitxt/catalog/cards/safety/simple_safety_tests.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/safety 2026-01-06T13:30:34,907 copying build/lib/unitxt/catalog/cards/safety/xstest.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/safety 2026-01-06T13:30:34,909 copying build/lib/unitxt/catalog/cards/safety/airbench2024.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/safety 2026-01-06T13:30:34,911 creating build/bdist.linux-armv7l/wheel/unitxt/catalog/cards/safety/discrim_eval 2026-01-06T13:30:34,913 copying build/lib/unitxt/catalog/cards/safety/discrim_eval/implicit.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/safety/discrim_eval 2026-01-06T13:30:34,914 copying build/lib/unitxt/catalog/cards/safety/discrim_eval/explicit.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/safety/discrim_eval 2026-01-06T13:30:34,916 copying build/lib/unitxt/catalog/cards/safety/mlcommons_ailuminate.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/safety 2026-01-06T13:30:34,918 copying build/lib/unitxt/catalog/cards/safety/provoq.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/safety 2026-01-06T13:30:34,920 copying build/lib/unitxt/catalog/cards/safety/truthful_qa.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/safety 2026-01-06T13:30:34,922 creating build/bdist.linux-armv7l/wheel/unitxt/catalog/cards/rag_eval 2026-01-06T13:30:34,924 creating build/bdist.linux-armv7l/wheel/unitxt/catalog/cards/rag_eval/faithfulness 2026-01-06T13:30:34,926 creating build/bdist.linux-armv7l/wheel/unitxt/catalog/cards/rag_eval/faithfulness/ragbench 2026-01-06T13:30:34,927 copying build/lib/unitxt/catalog/cards/rag_eval/faithfulness/ragbench/cuad.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/rag_eval/faithfulness/ragbench 2026-01-06T13:30:34,929 copying build/lib/unitxt/catalog/cards/rag_eval/faithfulness/ragbench/tatqa.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/rag_eval/faithfulness/ragbench 2026-01-06T13:30:34,931 copying build/lib/unitxt/catalog/cards/rag_eval/faithfulness/ragbench/msmarco.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/rag_eval/faithfulness/ragbench 2026-01-06T13:30:34,933 copying build/lib/unitxt/catalog/cards/rag_eval/faithfulness/ragbench/delucionqa.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/rag_eval/faithfulness/ragbench 2026-01-06T13:30:34,935 copying build/lib/unitxt/catalog/cards/rag_eval/faithfulness/ragbench/covidqa.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/rag_eval/faithfulness/ragbench 2026-01-06T13:30:34,936 copying build/lib/unitxt/catalog/cards/rag_eval/faithfulness/ragbench/techqa.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/rag_eval/faithfulness/ragbench 2026-01-06T13:30:34,938 copying build/lib/unitxt/catalog/cards/rag_eval/faithfulness/ragbench/expertqa.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/rag_eval/faithfulness/ragbench 2026-01-06T13:30:34,940 copying build/lib/unitxt/catalog/cards/rag_eval/faithfulness/ragbench/finqa.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/rag_eval/faithfulness/ragbench 2026-01-06T13:30:34,942 copying build/lib/unitxt/catalog/cards/rag_eval/faithfulness/ragbench/emanual.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/rag_eval/faithfulness/ragbench 2026-01-06T13:30:34,944 copying build/lib/unitxt/catalog/cards/rag_eval/faithfulness/ragbench/pubmedqa.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/rag_eval/faithfulness/ragbench 2026-01-06T13:30:34,945 copying build/lib/unitxt/catalog/cards/rag_eval/faithfulness/ragbench/hotpotqa.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/rag_eval/faithfulness/ragbench 2026-01-06T13:30:34,947 copying build/lib/unitxt/catalog/cards/rag_eval/faithfulness/ragbench/hagrid.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/rag_eval/faithfulness/ragbench 2026-01-06T13:30:34,950 creating build/bdist.linux-armv7l/wheel/unitxt/catalog/cards/reward_bench 2026-01-06T13:30:34,951 copying build/lib/unitxt/catalog/cards/reward_bench/reasoning.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/reward_bench 2026-01-06T13:30:34,953 copying build/lib/unitxt/catalog/cards/reward_bench/chat_hard.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/reward_bench 2026-01-06T13:30:34,955 copying build/lib/unitxt/catalog/cards/reward_bench/safety.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/reward_bench 2026-01-06T13:30:34,957 copying build/lib/unitxt/catalog/cards/reward_bench/chat.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/reward_bench 2026-01-06T13:30:34,958 copying build/lib/unitxt/catalog/cards/summarize_from_human_feedback.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards 2026-01-06T13:30:34,960 copying build/lib/unitxt/catalog/cards/fin_qa.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards 2026-01-06T13:30:34,962 copying build/lib/unitxt/catalog/cards/20_newsgroups_short.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards 2026-01-06T13:30:34,964 copying build/lib/unitxt/catalog/cards/long_bench_v2.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards 2026-01-06T13:30:34,966 copying build/lib/unitxt/catalog/cards/squad.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards 2026-01-06T13:30:34,970 creating build/bdist.linux-armv7l/wheel/unitxt/catalog/cards/belebele 2026-01-06T13:30:34,971 copying build/lib/unitxt/catalog/cards/belebele/ory_orya.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/belebele 2026-01-06T13:30:34,973 copying build/lib/unitxt/catalog/cards/belebele/nso_latn.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/belebele 2026-01-06T13:30:34,975 copying build/lib/unitxt/catalog/cards/belebele/est_latn.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/belebele 2026-01-06T13:30:34,977 copying build/lib/unitxt/catalog/cards/belebele/urd_latn.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/belebele 2026-01-06T13:30:34,979 copying build/lib/unitxt/catalog/cards/belebele/jpn_jpan.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/belebele 2026-01-06T13:30:34,981 copying build/lib/unitxt/catalog/cards/belebele/kor_hang.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/belebele 2026-01-06T13:30:34,983 copying build/lib/unitxt/catalog/cards/belebele/ron_latn.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/belebele 2026-01-06T13:30:34,984 copying build/lib/unitxt/catalog/cards/belebele/war_latn.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/belebele 2026-01-06T13:30:34,986 copying build/lib/unitxt/catalog/cards/belebele/slk_latn.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/belebele 2026-01-06T13:30:34,988 copying build/lib/unitxt/catalog/cards/belebele/hin_latn.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/belebele 2026-01-06T13:30:34,990 copying build/lib/unitxt/catalog/cards/belebele/lit_latn.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/belebele 2026-01-06T13:30:34,992 copying build/lib/unitxt/catalog/cards/belebele/als_latn.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/belebele 2026-01-06T13:30:34,994 copying build/lib/unitxt/catalog/cards/belebele/dan_latn.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/belebele 2026-01-06T13:30:34,996 copying build/lib/unitxt/catalog/cards/belebele/kir_cyrl.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/belebele 2026-01-06T13:30:34,998 copying build/lib/unitxt/catalog/cards/belebele/uzn_latn.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/belebele 2026-01-06T13:30:35,000 copying build/lib/unitxt/catalog/cards/belebele/pol_latn.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/belebele 2026-01-06T13:30:35,001 copying build/lib/unitxt/catalog/cards/belebele/jav_latn.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/belebele 2026-01-06T13:30:35,003 copying build/lib/unitxt/catalog/cards/belebele/ceb_latn.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/belebele 2026-01-06T13:30:35,005 copying build/lib/unitxt/catalog/cards/belebele/isl_latn.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/belebele 2026-01-06T13:30:35,007 copying build/lib/unitxt/catalog/cards/belebele/fuv_latn.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/belebele 2026-01-06T13:30:35,009 copying build/lib/unitxt/catalog/cards/belebele/yor_latn.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/belebele 2026-01-06T13:30:35,011 copying build/lib/unitxt/catalog/cards/belebele/mal_mlym.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/belebele 2026-01-06T13:30:35,013 copying build/lib/unitxt/catalog/cards/belebele/hrv_latn.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/belebele 2026-01-06T13:30:35,015 copying build/lib/unitxt/catalog/cards/belebele/mri_latn.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/belebele 2026-01-06T13:30:35,017 copying build/lib/unitxt/catalog/cards/belebele/kin_latn.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/belebele 2026-01-06T13:30:35,019 copying build/lib/unitxt/catalog/cards/belebele/mlt_latn.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/belebele 2026-01-06T13:30:35,021 copying build/lib/unitxt/catalog/cards/belebele/khm_khmr.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/belebele 2026-01-06T13:30:35,023 copying build/lib/unitxt/catalog/cards/belebele/swe_latn.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/belebele 2026-01-06T13:30:35,024 copying build/lib/unitxt/catalog/cards/belebele/spa_latn.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/belebele 2026-01-06T13:30:35,027 copying build/lib/unitxt/catalog/cards/belebele/sin_sinh.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/belebele 2026-01-06T13:30:35,028 copying build/lib/unitxt/catalog/cards/belebele/shn_mymr.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/belebele 2026-01-06T13:30:35,030 copying build/lib/unitxt/catalog/cards/belebele/zsm_latn.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/belebele 2026-01-06T13:30:35,032 copying build/lib/unitxt/catalog/cards/belebele/por_latn.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/belebele 2026-01-06T13:30:35,034 copying build/lib/unitxt/catalog/cards/belebele/sot_latn.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/belebele 2026-01-06T13:30:35,036 copying build/lib/unitxt/catalog/cards/belebele/lvs_latn.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/belebele 2026-01-06T13:30:35,038 copying build/lib/unitxt/catalog/cards/belebele/nya_latn.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/belebele 2026-01-06T13:30:35,039 copying build/lib/unitxt/catalog/cards/belebele/hau_latn.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/belebele 2026-01-06T13:30:35,041 copying build/lib/unitxt/catalog/cards/belebele/snd_arab.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/belebele 2026-01-06T13:30:35,043 copying build/lib/unitxt/catalog/cards/belebele/hun_latn.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/belebele 2026-01-06T13:30:35,045 copying build/lib/unitxt/catalog/cards/belebele/azj_latn.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/belebele 2026-01-06T13:30:35,047 copying build/lib/unitxt/catalog/cards/belebele/tam_taml.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/belebele 2026-01-06T13:30:35,049 copying build/lib/unitxt/catalog/cards/belebele/srp_cyrl.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/belebele 2026-01-06T13:30:35,051 copying build/lib/unitxt/catalog/cards/belebele/bul_cyrl.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/belebele 2026-01-06T13:30:35,053 copying build/lib/unitxt/catalog/cards/belebele/tsn_latn.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/belebele 2026-01-06T13:30:35,054 copying build/lib/unitxt/catalog/cards/belebele/mar_deva.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/belebele 2026-01-06T13:30:35,056 copying build/lib/unitxt/catalog/cards/belebele/tir_ethi.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/belebele 2026-01-06T13:30:35,058 copying build/lib/unitxt/catalog/cards/belebele/xho_latn.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/belebele 2026-01-06T13:30:35,060 copying build/lib/unitxt/catalog/cards/belebele/kac_latn.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/belebele 2026-01-06T13:30:35,062 copying build/lib/unitxt/catalog/cards/belebele/zho_hans.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/belebele 2026-01-06T13:30:35,064 copying build/lib/unitxt/catalog/cards/belebele/pes_arab.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/belebele 2026-01-06T13:30:35,066 copying build/lib/unitxt/catalog/cards/belebele/pbt_arab.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/belebele 2026-01-06T13:30:35,068 copying build/lib/unitxt/catalog/cards/belebele/ukr_cyrl.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/belebele 2026-01-06T13:30:35,070 copying build/lib/unitxt/catalog/cards/belebele/amh_ethi.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/belebele 2026-01-06T13:30:35,072 copying build/lib/unitxt/catalog/cards/belebele/asm_beng.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/belebele 2026-01-06T13:30:35,074 copying build/lib/unitxt/catalog/cards/belebele/tur_latn.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/belebele 2026-01-06T13:30:35,076 copying build/lib/unitxt/catalog/cards/belebele/ilo_latn.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/belebele 2026-01-06T13:30:35,077 copying build/lib/unitxt/catalog/cards/belebele/arb_arab.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/belebele 2026-01-06T13:30:35,079 copying build/lib/unitxt/catalog/cards/belebele/cat_latn.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/belebele 2026-01-06T13:30:35,081 copying build/lib/unitxt/catalog/cards/belebele/acm_arab.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/belebele 2026-01-06T13:30:35,083 copying build/lib/unitxt/catalog/cards/belebele/mkd_cyrl.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/belebele 2026-01-06T13:30:35,085 copying build/lib/unitxt/catalog/cards/belebele/tso_latn.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/belebele 2026-01-06T13:30:35,087 copying build/lib/unitxt/catalog/cards/belebele/ben_latn.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/belebele 2026-01-06T13:30:35,088 copying build/lib/unitxt/catalog/cards/belebele/grn_latn.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/belebele 2026-01-06T13:30:35,090 copying build/lib/unitxt/catalog/cards/belebele/kaz_cyrl.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/belebele 2026-01-06T13:30:35,092 copying build/lib/unitxt/catalog/cards/belebele/ary_arab.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/belebele 2026-01-06T13:30:35,094 copying build/lib/unitxt/catalog/cards/belebele/rus_cyrl.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/belebele 2026-01-06T13:30:35,095 copying build/lib/unitxt/catalog/cards/belebele/gaz_latn.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/belebele 2026-01-06T13:30:35,097 copying build/lib/unitxt/catalog/cards/belebele/ind_latn.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/belebele 2026-01-06T13:30:35,099 copying build/lib/unitxt/catalog/cards/belebele/tha_thai.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/belebele 2026-01-06T13:30:35,101 copying build/lib/unitxt/catalog/cards/belebele/pan_guru.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/belebele 2026-01-06T13:30:35,103 copying build/lib/unitxt/catalog/cards/belebele/tgl_latn.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/belebele 2026-01-06T13:30:35,105 copying build/lib/unitxt/catalog/cards/belebele/kat_geor.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/belebele 2026-01-06T13:30:35,106 copying build/lib/unitxt/catalog/cards/belebele/hin_deva.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/belebele 2026-01-06T13:30:35,108 copying build/lib/unitxt/catalog/cards/belebele/plt_latn.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/belebele 2026-01-06T13:30:35,110 copying build/lib/unitxt/catalog/cards/belebele/ell_grek.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/belebele 2026-01-06T13:30:35,112 copying build/lib/unitxt/catalog/cards/belebele/ckb_arab.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/belebele 2026-01-06T13:30:35,114 copying build/lib/unitxt/catalog/cards/belebele/slv_latn.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/belebele 2026-01-06T13:30:35,116 copying build/lib/unitxt/catalog/cards/belebele/sun_latn.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/belebele 2026-01-06T13:30:35,118 copying build/lib/unitxt/catalog/cards/belebele/eus_latn.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/belebele 2026-01-06T13:30:35,120 copying build/lib/unitxt/catalog/cards/belebele/tgk_cyrl.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/belebele 2026-01-06T13:30:35,122 copying build/lib/unitxt/catalog/cards/belebele/khk_cyrl.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/belebele 2026-01-06T13:30:35,124 copying build/lib/unitxt/catalog/cards/belebele/heb_hebr.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/belebele 2026-01-06T13:30:35,126 copying build/lib/unitxt/catalog/cards/belebele/sna_latn.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/belebele 2026-01-06T13:30:35,127 copying build/lib/unitxt/catalog/cards/belebele/guj_gujr.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/belebele 2026-01-06T13:30:35,130 copying build/lib/unitxt/catalog/cards/belebele/nob_latn.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/belebele 2026-01-06T13:30:35,132 copying build/lib/unitxt/catalog/cards/belebele/fra_latn.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/belebele 2026-01-06T13:30:35,134 copying build/lib/unitxt/catalog/cards/belebele/ibo_latn.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/belebele 2026-01-06T13:30:35,135 copying build/lib/unitxt/catalog/cards/belebele/npi_latn.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/belebele 2026-01-06T13:30:35,137 copying build/lib/unitxt/catalog/cards/belebele/arz_arab.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/belebele 2026-01-06T13:30:35,139 copying build/lib/unitxt/catalog/cards/belebele/vie_latn.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/belebele 2026-01-06T13:30:35,141 copying build/lib/unitxt/catalog/cards/belebele/som_latn.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/belebele 2026-01-06T13:30:35,143 copying build/lib/unitxt/catalog/cards/belebele/ben_beng.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/belebele 2026-01-06T13:30:35,145 copying build/lib/unitxt/catalog/cards/belebele/zho_hant.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/belebele 2026-01-06T13:30:35,146 copying build/lib/unitxt/catalog/cards/belebele/bod_tibt.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/belebele 2026-01-06T13:30:35,148 copying build/lib/unitxt/catalog/cards/belebele/ces_latn.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/belebele 2026-01-06T13:30:35,150 copying build/lib/unitxt/catalog/cards/belebele/lug_latn.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/belebele 2026-01-06T13:30:35,152 copying build/lib/unitxt/catalog/cards/belebele/kea_latn.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/belebele 2026-01-06T13:30:35,154 copying build/lib/unitxt/catalog/cards/belebele/lin_latn.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/belebele 2026-01-06T13:30:35,156 copying build/lib/unitxt/catalog/cards/belebele/mya_mymr.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/belebele 2026-01-06T13:30:35,158 copying build/lib/unitxt/catalog/cards/belebele/ita_latn.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/belebele 2026-01-06T13:30:35,160 copying build/lib/unitxt/catalog/cards/belebele/npi_deva.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/belebele 2026-01-06T13:30:35,162 copying build/lib/unitxt/catalog/cards/belebele/ssw_latn.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/belebele 2026-01-06T13:30:35,164 copying build/lib/unitxt/catalog/cards/belebele/fin_latn.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/belebele 2026-01-06T13:30:35,165 copying build/lib/unitxt/catalog/cards/belebele/tel_telu.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/belebele 2026-01-06T13:30:35,167 copying build/lib/unitxt/catalog/cards/belebele/arb_latn.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/belebele 2026-01-06T13:30:35,169 copying build/lib/unitxt/catalog/cards/belebele/lao_laoo.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/belebele 2026-01-06T13:30:35,171 copying build/lib/unitxt/catalog/cards/belebele/afr_latn.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/belebele 2026-01-06T13:30:35,173 copying build/lib/unitxt/catalog/cards/belebele/ars_arab.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/belebele 2026-01-06T13:30:35,175 copying build/lib/unitxt/catalog/cards/belebele/nld_latn.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/belebele 2026-01-06T13:30:35,177 copying build/lib/unitxt/catalog/cards/belebele/wol_latn.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/belebele 2026-01-06T13:30:35,179 copying build/lib/unitxt/catalog/cards/belebele/kan_knda.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/belebele 2026-01-06T13:30:35,181 copying build/lib/unitxt/catalog/cards/belebele/luo_latn.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/belebele 2026-01-06T13:30:35,183 copying build/lib/unitxt/catalog/cards/belebele/hat_latn.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/belebele 2026-01-06T13:30:35,185 copying build/lib/unitxt/catalog/cards/belebele/zul_latn.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/belebele 2026-01-06T13:30:35,187 copying build/lib/unitxt/catalog/cards/belebele/deu_latn.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/belebele 2026-01-06T13:30:35,188 copying build/lib/unitxt/catalog/cards/belebele/bam_latn.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/belebele 2026-01-06T13:30:35,190 copying build/lib/unitxt/catalog/cards/belebele/swh_latn.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/belebele 2026-01-06T13:30:35,192 copying build/lib/unitxt/catalog/cards/belebele/apc_arab.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/belebele 2026-01-06T13:30:35,194 copying build/lib/unitxt/catalog/cards/belebele/eng_latn.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/belebele 2026-01-06T13:30:35,196 copying build/lib/unitxt/catalog/cards/belebele/sin_latn.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/belebele 2026-01-06T13:30:35,198 copying build/lib/unitxt/catalog/cards/belebele/hye_armn.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/belebele 2026-01-06T13:30:35,200 copying build/lib/unitxt/catalog/cards/belebele/urd_arab.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/belebele 2026-01-06T13:30:35,202 creating build/bdist.linux-armv7l/wheel/unitxt/catalog/cards/mt_bench 2026-01-06T13:30:35,204 creating build/bdist.linux-armv7l/wheel/unitxt/catalog/cards/mt_bench/response_assessment 2026-01-06T13:30:35,205 creating build/bdist.linux-armv7l/wheel/unitxt/catalog/cards/mt_bench/response_assessment/pairwise_comparison 2026-01-06T13:30:35,206 copying build/lib/unitxt/catalog/cards/mt_bench/response_assessment/pairwise_comparison/single_turn_gpt4_judgement.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/mt_bench/response_assessment/pairwise_comparison 2026-01-06T13:30:35,209 copying build/lib/unitxt/catalog/cards/mt_bench/response_assessment/pairwise_comparison/single_turn_with_reference_gpt4_judgement.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/mt_bench/response_assessment/pairwise_comparison 2026-01-06T13:30:35,211 copying build/lib/unitxt/catalog/cards/mt_bench/response_assessment/pairwise_comparison/multi_turn_gpt4_judgement.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/mt_bench/response_assessment/pairwise_comparison 2026-01-06T13:30:35,212 copying build/lib/unitxt/catalog/cards/mt_bench/response_assessment/pairwise_comparison/multi_turn_with_reference_gpt4_judgement.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/mt_bench/response_assessment/pairwise_comparison 2026-01-06T13:30:35,215 creating build/bdist.linux-armv7l/wheel/unitxt/catalog/cards/mt_bench/response_assessment/rating 2026-01-06T13:30:35,216 copying build/lib/unitxt/catalog/cards/mt_bench/response_assessment/rating/single_turn_gpt4_judgement.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/mt_bench/response_assessment/rating 2026-01-06T13:30:35,218 copying build/lib/unitxt/catalog/cards/mt_bench/response_assessment/rating/single_turn_with_reference_gpt4_judgement.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/mt_bench/response_assessment/rating 2026-01-06T13:30:35,220 copying build/lib/unitxt/catalog/cards/mt_bench/response_assessment/rating/multi_turn_gpt4_judgement.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/mt_bench/response_assessment/rating 2026-01-06T13:30:35,222 copying build/lib/unitxt/catalog/cards/mt_bench/response_assessment/rating/multi_turn_with_reference_gpt4_judgement.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/mt_bench/response_assessment/rating 2026-01-06T13:30:35,224 creating build/bdist.linux-armv7l/wheel/unitxt/catalog/cards/mt_bench/generation 2026-01-06T13:30:35,225 copying build/lib/unitxt/catalog/cards/mt_bench/generation/english_single_turn.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/mt_bench/generation 2026-01-06T13:30:35,227 copying build/lib/unitxt/catalog/cards/mt_bench/generation/japanese_single_turn.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/mt_bench/generation 2026-01-06T13:30:35,229 creating build/bdist.linux-armv7l/wheel/unitxt/catalog/cards/CFPB 2026-01-06T13:30:35,231 creating build/bdist.linux-armv7l/wheel/unitxt/catalog/cards/CFPB/product 2026-01-06T13:30:35,232 copying build/lib/unitxt/catalog/cards/CFPB/product/watsonx.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/CFPB/product 2026-01-06T13:30:35,234 copying build/lib/unitxt/catalog/cards/CFPB/product/2023.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/CFPB/product 2026-01-06T13:30:35,236 copying build/lib/unitxt/catalog/cards/law_stack_exchange.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards 2026-01-06T13:30:35,238 creating build/bdist.linux-armv7l/wheel/unitxt/catalog/cards/dynamic_cards_for_llm_judges 2026-01-06T13:30:35,240 creating build/bdist.linux-armv7l/wheel/unitxt/catalog/cards/dynamic_cards_for_llm_judges/rating 2026-01-06T13:30:35,241 copying build/lib/unitxt/catalog/cards/dynamic_cards_for_llm_judges/rating/single_turn.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/dynamic_cards_for_llm_judges/rating 2026-01-06T13:30:35,243 copying build/lib/unitxt/catalog/cards/dynamic_cards_for_llm_judges/rating/single_turn_with_reference.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/dynamic_cards_for_llm_judges/rating 2026-01-06T13:30:35,245 creating build/bdist.linux-armv7l/wheel/unitxt/catalog/cards/dynamic_cards_for_llm_judges/pairwise_comparative_rating 2026-01-06T13:30:35,246 copying build/lib/unitxt/catalog/cards/dynamic_cards_for_llm_judges/pairwise_comparative_rating/single_turn.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/dynamic_cards_for_llm_judges/pairwise_comparative_rating 2026-01-06T13:30:35,248 copying build/lib/unitxt/catalog/cards/atta_q.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards 2026-01-06T13:30:35,250 copying build/lib/unitxt/catalog/cards/cnn_dailymail.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards 2026-01-06T13:30:35,252 copying build/lib/unitxt/catalog/cards/bold.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards 2026-01-06T13:30:35,253 copying build/lib/unitxt/catalog/cards/tab_fact.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards 2026-01-06T13:30:35,255 copying build/lib/unitxt/catalog/cards/financial_tweets.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards 2026-01-06T13:30:35,257 copying build/lib/unitxt/catalog/cards/websrc.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards 2026-01-06T13:30:35,260 creating build/bdist.linux-armv7l/wheel/unitxt/catalog/cards/mt 2026-01-06T13:30:35,261 creating build/bdist.linux-armv7l/wheel/unitxt/catalog/cards/mt/flores_101 2026-01-06T13:30:35,262 copying build/lib/unitxt/catalog/cards/mt/flores_101/ara_eng.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/mt/flores_101 2026-01-06T13:30:35,264 copying build/lib/unitxt/catalog/cards/mt/flores_101/kor_eng.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/mt/flores_101 2026-01-06T13:30:35,266 copying build/lib/unitxt/catalog/cards/mt/flores_101/deu_eng.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/mt/flores_101 2026-01-06T13:30:35,268 copying build/lib/unitxt/catalog/cards/mt/flores_101/eng_ara.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/mt/flores_101 2026-01-06T13:30:35,269 copying build/lib/unitxt/catalog/cards/mt/flores_101/eng_ron.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/mt/flores_101 2026-01-06T13:30:35,271 copying build/lib/unitxt/catalog/cards/mt/flores_101/eng_fra.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/mt/flores_101 2026-01-06T13:30:35,273 copying build/lib/unitxt/catalog/cards/mt/flores_101/fra_eng.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/mt/flores_101 2026-01-06T13:30:35,275 copying build/lib/unitxt/catalog/cards/mt/flores_101/spa_eng.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/mt/flores_101 2026-01-06T13:30:35,277 copying build/lib/unitxt/catalog/cards/mt/flores_101/jpn_eng.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/mt/flores_101 2026-01-06T13:30:35,278 copying build/lib/unitxt/catalog/cards/mt/flores_101/ron_eng.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/mt/flores_101 2026-01-06T13:30:35,280 copying build/lib/unitxt/catalog/cards/mt/flores_101/eng_spa.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/mt/flores_101 2026-01-06T13:30:35,282 copying build/lib/unitxt/catalog/cards/mt/flores_101/eng_jpn.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/mt/flores_101 2026-01-06T13:30:35,283 copying build/lib/unitxt/catalog/cards/mt/flores_101/eng_deu.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/mt/flores_101 2026-01-06T13:30:35,285 copying build/lib/unitxt/catalog/cards/mt/flores_101/eng_kor.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/mt/flores_101 2026-01-06T13:30:35,287 copying build/lib/unitxt/catalog/cards/mt/flores_101/por_eng.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/mt/flores_101 2026-01-06T13:30:35,289 copying build/lib/unitxt/catalog/cards/mt/flores_101/eng_por.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/mt/flores_101 2026-01-06T13:30:35,291 creating build/bdist.linux-armv7l/wheel/unitxt/catalog/cards/mmmu 2026-01-06T13:30:35,292 copying build/lib/unitxt/catalog/cards/mmmu/architecture_and_engineering.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/mmmu 2026-01-06T13:30:35,294 copying build/lib/unitxt/catalog/cards/mmmu/agriculture.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/mmmu 2026-01-06T13:30:35,296 copying build/lib/unitxt/catalog/cards/mmmu/manage.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/mmmu 2026-01-06T13:30:35,298 copying build/lib/unitxt/catalog/cards/mmmu/computer_science.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/mmmu 2026-01-06T13:30:35,300 copying build/lib/unitxt/catalog/cards/mmmu/art_theory.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/mmmu 2026-01-06T13:30:35,302 copying build/lib/unitxt/catalog/cards/mmmu/math.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/mmmu 2026-01-06T13:30:35,304 copying build/lib/unitxt/catalog/cards/mmmu/physics.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/mmmu 2026-01-06T13:30:35,306 copying build/lib/unitxt/catalog/cards/mmmu/economics.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/mmmu 2026-01-06T13:30:35,308 copying build/lib/unitxt/catalog/cards/mmmu/design.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/mmmu 2026-01-06T13:30:35,310 copying build/lib/unitxt/catalog/cards/mmmu/materials.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/mmmu 2026-01-06T13:30:35,311 copying build/lib/unitxt/catalog/cards/mmmu/public_health.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/mmmu 2026-01-06T13:30:35,313 copying build/lib/unitxt/catalog/cards/mmmu/finance.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/mmmu 2026-01-06T13:30:35,315 copying build/lib/unitxt/catalog/cards/mmmu/clinical_medicine.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/mmmu 2026-01-06T13:30:35,317 copying build/lib/unitxt/catalog/cards/mmmu/pharmacy.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/mmmu 2026-01-06T13:30:35,319 copying build/lib/unitxt/catalog/cards/mmmu/basic_medical_science.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/mmmu 2026-01-06T13:30:35,321 copying build/lib/unitxt/catalog/cards/mmmu/geography.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/mmmu 2026-01-06T13:30:35,322 copying build/lib/unitxt/catalog/cards/mmmu/energy_and_power.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/mmmu 2026-01-06T13:30:35,324 copying build/lib/unitxt/catalog/cards/mmmu/psychology.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/mmmu 2026-01-06T13:30:35,326 copying build/lib/unitxt/catalog/cards/mmmu/sociology.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/mmmu 2026-01-06T13:30:35,328 copying build/lib/unitxt/catalog/cards/mmmu/history.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/mmmu 2026-01-06T13:30:35,330 copying build/lib/unitxt/catalog/cards/mmmu/art.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/mmmu 2026-01-06T13:30:35,331 copying build/lib/unitxt/catalog/cards/mmmu/accounting.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/mmmu 2026-01-06T13:30:35,333 copying build/lib/unitxt/catalog/cards/mmmu/biology.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/mmmu 2026-01-06T13:30:35,335 copying build/lib/unitxt/catalog/cards/mmmu/music.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/mmmu 2026-01-06T13:30:35,337 copying build/lib/unitxt/catalog/cards/mmmu/literature.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/mmmu 2026-01-06T13:30:35,339 copying build/lib/unitxt/catalog/cards/mmmu/marketing.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/mmmu 2026-01-06T13:30:35,341 copying build/lib/unitxt/catalog/cards/mmmu/mechanical_engineering.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/mmmu 2026-01-06T13:30:35,343 copying build/lib/unitxt/catalog/cards/mmmu/electronics.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/mmmu 2026-01-06T13:30:35,344 copying build/lib/unitxt/catalog/cards/mmmu/diagnostics_and_laboratory_medicine.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/mmmu 2026-01-06T13:30:35,346 copying build/lib/unitxt/catalog/cards/mmmu/chemistry.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/mmmu 2026-01-06T13:30:35,348 copying build/lib/unitxt/catalog/cards/ag_news.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards 2026-01-06T13:30:35,351 creating build/bdist.linux-armv7l/wheel/unitxt/catalog/cards/global_mmlu_lite_cs 2026-01-06T13:30:35,352 copying build/lib/unitxt/catalog/cards/global_mmlu_lite_cs/zh.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu_lite_cs 2026-01-06T13:30:35,354 copying build/lib/unitxt/catalog/cards/global_mmlu_lite_cs/it.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu_lite_cs 2026-01-06T13:30:35,356 copying build/lib/unitxt/catalog/cards/global_mmlu_lite_cs/ar.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu_lite_cs 2026-01-06T13:30:35,359 copying build/lib/unitxt/catalog/cards/global_mmlu_lite_cs/bn.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu_lite_cs 2026-01-06T13:30:35,361 copying build/lib/unitxt/catalog/cards/global_mmlu_lite_cs/yo.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu_lite_cs 2026-01-06T13:30:35,363 copying build/lib/unitxt/catalog/cards/global_mmlu_lite_cs/es.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu_lite_cs 2026-01-06T13:30:35,365 copying build/lib/unitxt/catalog/cards/global_mmlu_lite_cs/ja.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu_lite_cs 2026-01-06T13:30:35,368 copying build/lib/unitxt/catalog/cards/global_mmlu_lite_cs/ko.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu_lite_cs 2026-01-06T13:30:35,370 copying build/lib/unitxt/catalog/cards/global_mmlu_lite_cs/pt.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu_lite_cs 2026-01-06T13:30:35,372 copying build/lib/unitxt/catalog/cards/global_mmlu_lite_cs/id.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu_lite_cs 2026-01-06T13:30:35,374 copying build/lib/unitxt/catalog/cards/global_mmlu_lite_cs/de.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu_lite_cs 2026-01-06T13:30:35,377 copying build/lib/unitxt/catalog/cards/global_mmlu_lite_cs/fr.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu_lite_cs 2026-01-06T13:30:35,379 copying build/lib/unitxt/catalog/cards/global_mmlu_lite_cs/sw.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu_lite_cs 2026-01-06T13:30:35,381 copying build/lib/unitxt/catalog/cards/global_mmlu_lite_cs/hi.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu_lite_cs 2026-01-06T13:30:35,383 copying build/lib/unitxt/catalog/cards/frames.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards 2026-01-06T13:30:35,386 creating build/bdist.linux-armv7l/wheel/unitxt/catalog/cards/rag 2026-01-06T13:30:35,387 creating build/bdist.linux-armv7l/wheel/unitxt/catalog/cards/rag/mtrag 2026-01-06T13:30:35,389 creating build/bdist.linux-armv7l/wheel/unitxt/catalog/cards/rag/mtrag/documents 2026-01-06T13:30:35,390 copying build/lib/unitxt/catalog/cards/rag/mtrag/documents/fiqa.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/rag/mtrag/documents 2026-01-06T13:30:35,392 copying build/lib/unitxt/catalog/cards/rag/mtrag/documents/clapnq.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/rag/mtrag/documents 2026-01-06T13:30:35,394 copying build/lib/unitxt/catalog/cards/rag/mtrag/documents/govt.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/rag/mtrag/documents 2026-01-06T13:30:35,396 copying build/lib/unitxt/catalog/cards/rag/mtrag/documents/cloud.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/rag/mtrag/documents 2026-01-06T13:30:35,398 creating build/bdist.linux-armv7l/wheel/unitxt/catalog/cards/rag/response_generation 2026-01-06T13:30:35,399 copying build/lib/unitxt/catalog/cards/rag/response_generation/clapnq.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/rag/response_generation 2026-01-06T13:30:35,402 creating build/bdist.linux-armv7l/wheel/unitxt/catalog/cards/rag/response_generation/train 2026-01-06T13:30:35,403 copying build/lib/unitxt/catalog/cards/rag/response_generation/train/clapnq.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/rag/response_generation/train 2026-01-06T13:30:35,405 copying build/lib/unitxt/catalog/cards/rag/response_generation/train/open_australian_legal_qa.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/rag/response_generation/train 2026-01-06T13:30:35,407 creating build/bdist.linux-armv7l/wheel/unitxt/catalog/cards/rag/response_generation/ragbench 2026-01-06T13:30:35,409 copying build/lib/unitxt/catalog/cards/rag/response_generation/ragbench/cuad.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/rag/response_generation/ragbench 2026-01-06T13:30:35,410 copying build/lib/unitxt/catalog/cards/rag/response_generation/ragbench/tatqa.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/rag/response_generation/ragbench 2026-01-06T13:30:35,412 copying build/lib/unitxt/catalog/cards/rag/response_generation/ragbench/msmarco.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/rag/response_generation/ragbench 2026-01-06T13:30:35,414 copying build/lib/unitxt/catalog/cards/rag/response_generation/ragbench/delucionqa.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/rag/response_generation/ragbench 2026-01-06T13:30:35,416 copying build/lib/unitxt/catalog/cards/rag/response_generation/ragbench/covidqa.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/rag/response_generation/ragbench 2026-01-06T13:30:35,418 copying build/lib/unitxt/catalog/cards/rag/response_generation/ragbench/techqa.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/rag/response_generation/ragbench 2026-01-06T13:30:35,420 copying build/lib/unitxt/catalog/cards/rag/response_generation/ragbench/expertqa.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/rag/response_generation/ragbench 2026-01-06T13:30:35,421 copying build/lib/unitxt/catalog/cards/rag/response_generation/ragbench/finqa.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/rag/response_generation/ragbench 2026-01-06T13:30:35,423 copying build/lib/unitxt/catalog/cards/rag/response_generation/ragbench/emanual.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/rag/response_generation/ragbench 2026-01-06T13:30:35,425 copying build/lib/unitxt/catalog/cards/rag/response_generation/ragbench/pubmedqa.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/rag/response_generation/ragbench 2026-01-06T13:30:35,427 copying build/lib/unitxt/catalog/cards/rag/response_generation/ragbench/hotpotqa.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/rag/response_generation/ragbench 2026-01-06T13:30:35,428 copying build/lib/unitxt/catalog/cards/rag/response_generation/ragbench/hagrid.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/rag/response_generation/ragbench 2026-01-06T13:30:35,431 creating build/bdist.linux-armv7l/wheel/unitxt/catalog/cards/rag/response_generation/chat_rag_bench 2026-01-06T13:30:35,432 creating build/bdist.linux-armv7l/wheel/unitxt/catalog/cards/rag/response_generation/chat_rag_bench/user_assistant_format 2026-01-06T13:30:35,433 copying build/lib/unitxt/catalog/cards/rag/response_generation/chat_rag_bench/user_assistant_format/doqa_cooking.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/rag/response_generation/chat_rag_bench/user_assistant_format 2026-01-06T13:30:35,435 copying build/lib/unitxt/catalog/cards/rag/response_generation/chat_rag_bench/user_assistant_format/doqa_movies.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/rag/response_generation/chat_rag_bench/user_assistant_format 2026-01-06T13:30:35,437 copying build/lib/unitxt/catalog/cards/rag/response_generation/chat_rag_bench/user_assistant_format/hybridial.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/rag/response_generation/chat_rag_bench/user_assistant_format 2026-01-06T13:30:35,439 copying build/lib/unitxt/catalog/cards/rag/response_generation/chat_rag_bench/user_assistant_format/doqa_travel.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/rag/response_generation/chat_rag_bench/user_assistant_format 2026-01-06T13:30:35,441 copying build/lib/unitxt/catalog/cards/rag/response_generation/chat_rag_bench/user_assistant_format/doc2dial.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/rag/response_generation/chat_rag_bench/user_assistant_format 2026-01-06T13:30:35,444 creating build/bdist.linux-armv7l/wheel/unitxt/catalog/cards/rag/response_generation/chat_rag_bench/train 2026-01-06T13:30:35,445 creating build/bdist.linux-armv7l/wheel/unitxt/catalog/cards/rag/response_generation/chat_rag_bench/train/user_assistant_format 2026-01-06T13:30:35,447 copying build/lib/unitxt/catalog/cards/rag/response_generation/chat_rag_bench/train/user_assistant_format/doqa_cooking.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/rag/response_generation/chat_rag_bench/train/user_assistant_format 2026-01-06T13:30:35,449 copying build/lib/unitxt/catalog/cards/rag/response_generation/chat_rag_bench/train/user_assistant_format/doqa_movies.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/rag/response_generation/chat_rag_bench/train/user_assistant_format 2026-01-06T13:30:35,451 copying build/lib/unitxt/catalog/cards/rag/response_generation/chat_rag_bench/train/user_assistant_format/hybridial.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/rag/response_generation/chat_rag_bench/train/user_assistant_format 2026-01-06T13:30:35,452 copying build/lib/unitxt/catalog/cards/rag/response_generation/chat_rag_bench/train/user_assistant_format/doqa_travel.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/rag/response_generation/chat_rag_bench/train/user_assistant_format 2026-01-06T13:30:35,454 copying build/lib/unitxt/catalog/cards/rag/response_generation/chat_rag_bench/train/user_assistant_format/doc2dial.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/rag/response_generation/chat_rag_bench/train/user_assistant_format 2026-01-06T13:30:35,457 creating build/bdist.linux-armv7l/wheel/unitxt/catalog/cards/rag/benchmark 2026-01-06T13:30:35,458 creating build/bdist.linux-armv7l/wheel/unitxt/catalog/cards/rag/benchmark/clap_nq 2026-01-06T13:30:35,459 copying build/lib/unitxt/catalog/cards/rag/benchmark/clap_nq/en.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/rag/benchmark/clap_nq 2026-01-06T13:30:35,462 creating build/bdist.linux-armv7l/wheel/unitxt/catalog/cards/rag/benchmark/hotpotqa 2026-01-06T13:30:35,463 copying build/lib/unitxt/catalog/cards/rag/benchmark/hotpotqa/en.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/rag/benchmark/hotpotqa 2026-01-06T13:30:35,465 creating build/bdist.linux-armv7l/wheel/unitxt/catalog/cards/rag/benchmark/real_mm_rag_tech_slides 2026-01-06T13:30:35,466 copying build/lib/unitxt/catalog/cards/rag/benchmark/real_mm_rag_tech_slides/en.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/rag/benchmark/real_mm_rag_tech_slides 2026-01-06T13:30:35,469 creating build/bdist.linux-armv7l/wheel/unitxt/catalog/cards/rag/benchmark/real_mm_rag_fin_report 2026-01-06T13:30:35,470 copying build/lib/unitxt/catalog/cards/rag/benchmark/real_mm_rag_fin_report/en.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/rag/benchmark/real_mm_rag_fin_report 2026-01-06T13:30:35,472 creating build/bdist.linux-armv7l/wheel/unitxt/catalog/cards/rag/benchmark/watsonxqa 2026-01-06T13:30:35,473 copying build/lib/unitxt/catalog/cards/rag/benchmark/watsonxqa/en.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/rag/benchmark/watsonxqa 2026-01-06T13:30:35,476 creating build/bdist.linux-armv7l/wheel/unitxt/catalog/cards/rag/benchmark/real_mm_rag_tech_report 2026-01-06T13:30:35,477 copying build/lib/unitxt/catalog/cards/rag/benchmark/real_mm_rag_tech_report/en.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/rag/benchmark/real_mm_rag_tech_report 2026-01-06T13:30:35,479 creating build/bdist.linux-armv7l/wheel/unitxt/catalog/cards/rag/benchmark/real_mm_rag_fin_slides 2026-01-06T13:30:35,480 copying build/lib/unitxt/catalog/cards/rag/benchmark/real_mm_rag_fin_slides/en.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/rag/benchmark/real_mm_rag_fin_slides 2026-01-06T13:30:35,483 creating build/bdist.linux-armv7l/wheel/unitxt/catalog/cards/rag/benchmark/bioasq 2026-01-06T13:30:35,484 copying build/lib/unitxt/catalog/cards/rag/benchmark/bioasq/en.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/rag/benchmark/bioasq 2026-01-06T13:30:35,486 creating build/bdist.linux-armv7l/wheel/unitxt/catalog/cards/rag/benchmark/miniwiki 2026-01-06T13:30:35,487 copying build/lib/unitxt/catalog/cards/rag/benchmark/miniwiki/en.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/rag/benchmark/miniwiki 2026-01-06T13:30:35,489 copying build/lib/unitxt/catalog/cards/rag/mtrag.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/rag 2026-01-06T13:30:35,492 creating build/bdist.linux-armv7l/wheel/unitxt/catalog/cards/rag/documents 2026-01-06T13:30:35,493 creating build/bdist.linux-armv7l/wheel/unitxt/catalog/cards/rag/documents/clap_nq 2026-01-06T13:30:35,495 copying build/lib/unitxt/catalog/cards/rag/documents/clap_nq/en.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/rag/documents/clap_nq 2026-01-06T13:30:35,497 creating build/bdist.linux-armv7l/wheel/unitxt/catalog/cards/rag/documents/hotpotqa 2026-01-06T13:30:35,498 copying build/lib/unitxt/catalog/cards/rag/documents/hotpotqa/en.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/rag/documents/hotpotqa 2026-01-06T13:30:35,501 creating build/bdist.linux-armv7l/wheel/unitxt/catalog/cards/rag/documents/real_mm_rag_tech_slides 2026-01-06T13:30:35,502 copying build/lib/unitxt/catalog/cards/rag/documents/real_mm_rag_tech_slides/en.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/rag/documents/real_mm_rag_tech_slides 2026-01-06T13:30:35,505 creating build/bdist.linux-armv7l/wheel/unitxt/catalog/cards/rag/documents/real_mm_rag_fin_report 2026-01-06T13:30:35,506 copying build/lib/unitxt/catalog/cards/rag/documents/real_mm_rag_fin_report/en.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/rag/documents/real_mm_rag_fin_report 2026-01-06T13:30:35,509 creating build/bdist.linux-armv7l/wheel/unitxt/catalog/cards/rag/documents/watsonxqa 2026-01-06T13:30:35,510 copying build/lib/unitxt/catalog/cards/rag/documents/watsonxqa/en.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/rag/documents/watsonxqa 2026-01-06T13:30:35,512 creating build/bdist.linux-armv7l/wheel/unitxt/catalog/cards/rag/documents/real_mm_rag_tech_report 2026-01-06T13:30:35,514 copying build/lib/unitxt/catalog/cards/rag/documents/real_mm_rag_tech_report/en.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/rag/documents/real_mm_rag_tech_report 2026-01-06T13:30:35,516 creating build/bdist.linux-armv7l/wheel/unitxt/catalog/cards/rag/documents/real_mm_rag_fin_slides 2026-01-06T13:30:35,517 copying build/lib/unitxt/catalog/cards/rag/documents/real_mm_rag_fin_slides/en.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/rag/documents/real_mm_rag_fin_slides 2026-01-06T13:30:35,520 creating build/bdist.linux-armv7l/wheel/unitxt/catalog/cards/rag/documents/bioasq 2026-01-06T13:30:35,521 copying build/lib/unitxt/catalog/cards/rag/documents/bioasq/en.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/rag/documents/bioasq 2026-01-06T13:30:35,524 creating build/bdist.linux-armv7l/wheel/unitxt/catalog/cards/rag/documents/miniwiki 2026-01-06T13:30:35,525 copying build/lib/unitxt/catalog/cards/rag/documents/miniwiki/en.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/rag/documents/miniwiki 2026-01-06T13:30:35,527 copying build/lib/unitxt/catalog/cards/argument_topic.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards 2026-01-06T13:30:35,530 creating build/bdist.linux-armv7l/wheel/unitxt/catalog/cards/xnli 2026-01-06T13:30:35,531 copying build/lib/unitxt/catalog/cards/xnli/zh.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/xnli 2026-01-06T13:30:35,533 copying build/lib/unitxt/catalog/cards/xnli/vi.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/xnli 2026-01-06T13:30:35,535 copying build/lib/unitxt/catalog/cards/xnli/ur.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/xnli 2026-01-06T13:30:35,537 copying build/lib/unitxt/catalog/cards/xnli/ru.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/xnli 2026-01-06T13:30:35,539 copying build/lib/unitxt/catalog/cards/xnli/en.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/xnli 2026-01-06T13:30:35,541 copying build/lib/unitxt/catalog/cards/xnli/ar.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/xnli 2026-01-06T13:30:35,543 copying build/lib/unitxt/catalog/cards/xnli/es.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/xnli 2026-01-06T13:30:35,545 copying build/lib/unitxt/catalog/cards/xnli/th.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/xnli 2026-01-06T13:30:35,547 copying build/lib/unitxt/catalog/cards/xnli/tr.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/xnli 2026-01-06T13:30:35,549 copying build/lib/unitxt/catalog/cards/xnli/el.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/xnli 2026-01-06T13:30:35,551 copying build/lib/unitxt/catalog/cards/xnli/de.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/xnli 2026-01-06T13:30:35,553 copying build/lib/unitxt/catalog/cards/xnli/fr.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/xnli 2026-01-06T13:30:35,556 copying build/lib/unitxt/catalog/cards/xnli/sw.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/xnli 2026-01-06T13:30:35,558 copying build/lib/unitxt/catalog/cards/xnli/hi.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/xnli 2026-01-06T13:30:35,560 copying build/lib/unitxt/catalog/cards/xnli/bg.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/xnli 2026-01-06T13:30:35,562 creating build/bdist.linux-armv7l/wheel/unitxt/catalog/cards/mlsum 2026-01-06T13:30:35,563 copying build/lib/unitxt/catalog/cards/mlsum/ru.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/mlsum 2026-01-06T13:30:35,565 copying build/lib/unitxt/catalog/cards/mlsum/tu.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/mlsum 2026-01-06T13:30:35,567 copying build/lib/unitxt/catalog/cards/mlsum/es.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/mlsum 2026-01-06T13:30:35,569 copying build/lib/unitxt/catalog/cards/mlsum/de.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/mlsum 2026-01-06T13:30:35,571 copying build/lib/unitxt/catalog/cards/mlsum/fr.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/mlsum 2026-01-06T13:30:35,573 copying build/lib/unitxt/catalog/cards/claim_stance_topic.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards 2026-01-06T13:30:35,575 creating build/bdist.linux-armv7l/wheel/unitxt/catalog/cards/multidoc2dial 2026-01-06T13:30:35,576 copying build/lib/unitxt/catalog/cards/multidoc2dial/extractive.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/multidoc2dial 2026-01-06T13:30:35,578 copying build/lib/unitxt/catalog/cards/multidoc2dial/abstractive.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/multidoc2dial 2026-01-06T13:30:35,580 copying build/lib/unitxt/catalog/cards/billsum.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards 2026-01-06T13:30:35,581 copying build/lib/unitxt/catalog/cards/info_vqa_lmms_eval.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards 2026-01-06T13:30:35,584 creating build/bdist.linux-armv7l/wheel/unitxt/catalog/cards/judge_bench 2026-01-06T13:30:35,585 creating build/bdist.linux-armv7l/wheel/unitxt/catalog/cards/judge_bench/newswoom 2026-01-06T13:30:35,587 copying build/lib/unitxt/catalog/cards/judge_bench/newswoom/coherence.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/judge_bench/newswoom 2026-01-06T13:30:35,589 copying build/lib/unitxt/catalog/cards/judge_bench/newswoom/relevance.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/judge_bench/newswoom 2026-01-06T13:30:35,591 copying build/lib/unitxt/catalog/cards/judge_bench/newswoom/informativeness.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/judge_bench/newswoom 2026-01-06T13:30:35,593 copying build/lib/unitxt/catalog/cards/judge_bench/newswoom/fluency.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/judge_bench/newswoom 2026-01-06T13:30:35,596 creating build/bdist.linux-armv7l/wheel/unitxt/catalog/cards/judge_bench/roscoe 2026-01-06T13:30:35,598 creating build/bdist.linux-armv7l/wheel/unitxt/catalog/cards/judge_bench/roscoe/overall 2026-01-06T13:30:35,600 creating build/bdist.linux-armv7l/wheel/unitxt/catalog/cards/judge_bench/roscoe/overall/cosmos 2026-01-06T13:30:35,601 copying build/lib/unitxt/catalog/cards/judge_bench/roscoe/overall/cosmos/contradiction.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/judge_bench/roscoe/overall/cosmos 2026-01-06T13:30:35,603 copying build/lib/unitxt/catalog/cards/judge_bench/roscoe/overall/cosmos/coherence.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/judge_bench/roscoe/overall/cosmos 2026-01-06T13:30:35,605 copying build/lib/unitxt/catalog/cards/judge_bench/roscoe/overall/cosmos/missing_steps.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/judge_bench/roscoe/overall/cosmos 2026-01-06T13:30:35,607 copying build/lib/unitxt/catalog/cards/judge_bench/roscoe/overall/cosmos/overall_quality.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/judge_bench/roscoe/overall/cosmos 2026-01-06T13:30:35,610 creating build/bdist.linux-armv7l/wheel/unitxt/catalog/cards/judge_bench/roscoe/overall/esnli 2026-01-06T13:30:35,611 copying build/lib/unitxt/catalog/cards/judge_bench/roscoe/overall/esnli/contradiction.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/judge_bench/roscoe/overall/esnli 2026-01-06T13:30:35,613 copying build/lib/unitxt/catalog/cards/judge_bench/roscoe/overall/esnli/coherence.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/judge_bench/roscoe/overall/esnli 2026-01-06T13:30:35,615 copying build/lib/unitxt/catalog/cards/judge_bench/roscoe/overall/esnli/missing_steps.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/judge_bench/roscoe/overall/esnli 2026-01-06T13:30:35,616 copying build/lib/unitxt/catalog/cards/judge_bench/roscoe/overall/esnli/overall_quality.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/judge_bench/roscoe/overall/esnli 2026-01-06T13:30:35,619 creating build/bdist.linux-armv7l/wheel/unitxt/catalog/cards/judge_bench/roscoe/overall/drop 2026-01-06T13:30:35,620 copying build/lib/unitxt/catalog/cards/judge_bench/roscoe/overall/drop/contradiction.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/judge_bench/roscoe/overall/drop 2026-01-06T13:30:35,622 copying build/lib/unitxt/catalog/cards/judge_bench/roscoe/overall/drop/coherence.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/judge_bench/roscoe/overall/drop 2026-01-06T13:30:35,624 copying build/lib/unitxt/catalog/cards/judge_bench/roscoe/overall/drop/missing_steps.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/judge_bench/roscoe/overall/drop 2026-01-06T13:30:35,626 copying build/lib/unitxt/catalog/cards/judge_bench/roscoe/overall/drop/overall_quality.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/judge_bench/roscoe/overall/drop 2026-01-06T13:30:35,628 creating build/bdist.linux-armv7l/wheel/unitxt/catalog/cards/judge_bench/roscoe/stepwise 2026-01-06T13:30:35,630 creating build/bdist.linux-armv7l/wheel/unitxt/catalog/cards/judge_bench/roscoe/stepwise/cosmos 2026-01-06T13:30:35,631 copying build/lib/unitxt/catalog/cards/judge_bench/roscoe/stepwise/cosmos/coherency_and_logic.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/judge_bench/roscoe/stepwise/cosmos 2026-01-06T13:30:35,633 copying build/lib/unitxt/catalog/cards/judge_bench/roscoe/stepwise/cosmos/grammar.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/judge_bench/roscoe/stepwise/cosmos 2026-01-06T13:30:35,635 copying build/lib/unitxt/catalog/cards/judge_bench/roscoe/stepwise/cosmos/final_answer.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/judge_bench/roscoe/stepwise/cosmos 2026-01-06T13:30:35,638 copying build/lib/unitxt/catalog/cards/judge_bench/roscoe/stepwise/cosmos/repetition.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/judge_bench/roscoe/stepwise/cosmos 2026-01-06T13:30:35,640 copying build/lib/unitxt/catalog/cards/judge_bench/roscoe/stepwise/cosmos/commonsense.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/judge_bench/roscoe/stepwise/cosmos 2026-01-06T13:30:35,643 copying build/lib/unitxt/catalog/cards/judge_bench/roscoe/stepwise/cosmos/factuality.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/judge_bench/roscoe/stepwise/cosmos 2026-01-06T13:30:35,645 copying build/lib/unitxt/catalog/cards/judge_bench/roscoe/stepwise/cosmos/arithmetic.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/judge_bench/roscoe/stepwise/cosmos 2026-01-06T13:30:35,648 copying build/lib/unitxt/catalog/cards/judge_bench/roscoe/stepwise/cosmos/hallucination.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/judge_bench/roscoe/stepwise/cosmos 2026-01-06T13:30:35,651 copying build/lib/unitxt/catalog/cards/judge_bench/roscoe/stepwise/cosmos/redundancy.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/judge_bench/roscoe/stepwise/cosmos 2026-01-06T13:30:35,653 creating build/bdist.linux-armv7l/wheel/unitxt/catalog/cards/judge_bench/roscoe/stepwise/esnli 2026-01-06T13:30:35,655 copying build/lib/unitxt/catalog/cards/judge_bench/roscoe/stepwise/esnli/coherency_and_logic.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/judge_bench/roscoe/stepwise/esnli 2026-01-06T13:30:35,656 copying build/lib/unitxt/catalog/cards/judge_bench/roscoe/stepwise/esnli/grammar.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/judge_bench/roscoe/stepwise/esnli 2026-01-06T13:30:35,658 copying build/lib/unitxt/catalog/cards/judge_bench/roscoe/stepwise/esnli/final_answer.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/judge_bench/roscoe/stepwise/esnli 2026-01-06T13:30:35,660 copying build/lib/unitxt/catalog/cards/judge_bench/roscoe/stepwise/esnli/repetition.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/judge_bench/roscoe/stepwise/esnli 2026-01-06T13:30:35,662 copying build/lib/unitxt/catalog/cards/judge_bench/roscoe/stepwise/esnli/commonsense.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/judge_bench/roscoe/stepwise/esnli 2026-01-06T13:30:35,664 copying build/lib/unitxt/catalog/cards/judge_bench/roscoe/stepwise/esnli/factuality.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/judge_bench/roscoe/stepwise/esnli 2026-01-06T13:30:35,666 copying build/lib/unitxt/catalog/cards/judge_bench/roscoe/stepwise/esnli/arithmetic.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/judge_bench/roscoe/stepwise/esnli 2026-01-06T13:30:35,667 copying build/lib/unitxt/catalog/cards/judge_bench/roscoe/stepwise/esnli/hallucination.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/judge_bench/roscoe/stepwise/esnli 2026-01-06T13:30:35,669 copying build/lib/unitxt/catalog/cards/judge_bench/roscoe/stepwise/esnli/redundancy.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/judge_bench/roscoe/stepwise/esnli 2026-01-06T13:30:35,672 creating build/bdist.linux-armv7l/wheel/unitxt/catalog/cards/judge_bench/roscoe/stepwise/drop 2026-01-06T13:30:35,673 copying build/lib/unitxt/catalog/cards/judge_bench/roscoe/stepwise/drop/coherency_and_logic.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/judge_bench/roscoe/stepwise/drop 2026-01-06T13:30:35,675 copying build/lib/unitxt/catalog/cards/judge_bench/roscoe/stepwise/drop/grammar.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/judge_bench/roscoe/stepwise/drop 2026-01-06T13:30:35,677 copying build/lib/unitxt/catalog/cards/judge_bench/roscoe/stepwise/drop/final_answer.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/judge_bench/roscoe/stepwise/drop 2026-01-06T13:30:35,679 copying build/lib/unitxt/catalog/cards/judge_bench/roscoe/stepwise/drop/repetition.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/judge_bench/roscoe/stepwise/drop 2026-01-06T13:30:35,681 copying build/lib/unitxt/catalog/cards/judge_bench/roscoe/stepwise/drop/commonsense.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/judge_bench/roscoe/stepwise/drop 2026-01-06T13:30:35,683 copying build/lib/unitxt/catalog/cards/judge_bench/roscoe/stepwise/drop/factuality.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/judge_bench/roscoe/stepwise/drop 2026-01-06T13:30:35,685 copying build/lib/unitxt/catalog/cards/judge_bench/roscoe/stepwise/drop/arithmetic.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/judge_bench/roscoe/stepwise/drop 2026-01-06T13:30:35,687 copying build/lib/unitxt/catalog/cards/judge_bench/roscoe/stepwise/drop/hallucination.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/judge_bench/roscoe/stepwise/drop 2026-01-06T13:30:35,689 copying build/lib/unitxt/catalog/cards/judge_bench/roscoe/stepwise/drop/redundancy.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/judge_bench/roscoe/stepwise/drop 2026-01-06T13:30:35,691 creating build/bdist.linux-armv7l/wheel/unitxt/catalog/cards/judge_bench/inferential_strategies 2026-01-06T13:30:35,692 copying build/lib/unitxt/catalog/cards/judge_bench/inferential_strategies/sound_reasoning.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/judge_bench/inferential_strategies 2026-01-06T13:30:35,695 creating build/bdist.linux-armv7l/wheel/unitxt/catalog/cards/judge_bench/wmt_human 2026-01-06T13:30:35,697 creating build/bdist.linux-armv7l/wheel/unitxt/catalog/cards/judge_bench/wmt_human/chinese_to_english 2026-01-06T13:30:35,698 copying build/lib/unitxt/catalog/cards/judge_bench/wmt_human/chinese_to_english/quality.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/judge_bench/wmt_human/chinese_to_english 2026-01-06T13:30:35,700 creating build/bdist.linux-armv7l/wheel/unitxt/catalog/cards/judge_bench/wmt_human/english_to_german 2026-01-06T13:30:35,701 copying build/lib/unitxt/catalog/cards/judge_bench/wmt_human/english_to_german/quality.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/judge_bench/wmt_human/english_to_german 2026-01-06T13:30:35,704 creating build/bdist.linux-armv7l/wheel/unitxt/catalog/cards/judge_bench/cola 2026-01-06T13:30:35,705 copying build/lib/unitxt/catalog/cards/judge_bench/cola/grammaticality.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/judge_bench/cola 2026-01-06T13:30:35,707 creating build/bdist.linux-armv7l/wheel/unitxt/catalog/cards/judge_bench/toxic_chat 2026-01-06T13:30:35,708 copying build/lib/unitxt/catalog/cards/judge_bench/toxic_chat/toxicity.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/judge_bench/toxic_chat 2026-01-06T13:30:35,710 copying build/lib/unitxt/catalog/cards/judge_bench/toxic_chat/jailbreaking.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/judge_bench/toxic_chat 2026-01-06T13:30:35,713 creating build/bdist.linux-armv7l/wheel/unitxt/catalog/cards/judge_bench/dices 2026-01-06T13:30:35,714 copying build/lib/unitxt/catalog/cards/judge_bench/dices/safety.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/judge_bench/dices 2026-01-06T13:30:35,716 copying build/lib/unitxt/catalog/cards/scigen.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards 2026-01-06T13:30:35,719 creating build/bdist.linux-armv7l/wheel/unitxt/catalog/cards/ragbench 2026-01-06T13:30:35,720 copying build/lib/unitxt/catalog/cards/ragbench/cuad.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/ragbench 2026-01-06T13:30:35,722 copying build/lib/unitxt/catalog/cards/ragbench/tatqa.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/ragbench 2026-01-06T13:30:35,724 copying build/lib/unitxt/catalog/cards/ragbench/msmarco.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/ragbench 2026-01-06T13:30:35,726 copying build/lib/unitxt/catalog/cards/ragbench/delucionqa.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/ragbench 2026-01-06T13:30:35,727 copying build/lib/unitxt/catalog/cards/ragbench/covidqa.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/ragbench 2026-01-06T13:30:35,729 copying build/lib/unitxt/catalog/cards/ragbench/techqa.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/ragbench 2026-01-06T13:30:35,731 copying build/lib/unitxt/catalog/cards/ragbench/expertqa.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/ragbench 2026-01-06T13:30:35,733 copying build/lib/unitxt/catalog/cards/ragbench/finqa.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/ragbench 2026-01-06T13:30:35,735 copying build/lib/unitxt/catalog/cards/ragbench/emanual.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/ragbench 2026-01-06T13:30:35,737 copying build/lib/unitxt/catalog/cards/ragbench/pubmedqa.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/ragbench 2026-01-06T13:30:35,739 copying build/lib/unitxt/catalog/cards/ragbench/hotpotqa.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/ragbench 2026-01-06T13:30:35,741 copying build/lib/unitxt/catalog/cards/ragbench/hagrid.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/ragbench 2026-01-06T13:30:35,742 copying build/lib/unitxt/catalog/cards/20_newsgroups.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards 2026-01-06T13:30:35,745 creating build/bdist.linux-armv7l/wheel/unitxt/catalog/cards/gpqa 2026-01-06T13:30:35,746 copying build/lib/unitxt/catalog/cards/gpqa/main.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/gpqa 2026-01-06T13:30:35,748 copying build/lib/unitxt/catalog/cards/gpqa/extended.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/gpqa 2026-01-06T13:30:35,749 copying build/lib/unitxt/catalog/cards/gpqa/diamond.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/gpqa 2026-01-06T13:30:35,751 copying build/lib/unitxt/catalog/cards/qqp.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards 2026-01-06T13:30:35,754 creating build/bdist.linux-armv7l/wheel/unitxt/catalog/cards/arena_hard 2026-01-06T13:30:35,755 creating build/bdist.linux-armv7l/wheel/unitxt/catalog/cards/arena_hard/response_assessment 2026-01-06T13:30:35,757 creating build/bdist.linux-armv7l/wheel/unitxt/catalog/cards/arena_hard/response_assessment/pairwise_comparative_rating 2026-01-06T13:30:35,758 copying build/lib/unitxt/catalog/cards/arena_hard/response_assessment/pairwise_comparative_rating/first_game_only_gpt_4_judge.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/arena_hard/response_assessment/pairwise_comparative_rating 2026-01-06T13:30:35,760 copying build/lib/unitxt/catalog/cards/arena_hard/response_assessment/pairwise_comparative_rating/both_games_mean_judgment_gpt4_judge.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/arena_hard/response_assessment/pairwise_comparative_rating 2026-01-06T13:30:35,762 copying build/lib/unitxt/catalog/cards/arena_hard/response_assessment/pairwise_comparative_rating/both_games_gpt_4_judge.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/arena_hard/response_assessment/pairwise_comparative_rating 2026-01-06T13:30:35,764 creating build/bdist.linux-armv7l/wheel/unitxt/catalog/cards/arena_hard/generation 2026-01-06T13:30:35,765 copying build/lib/unitxt/catalog/cards/arena_hard/generation/english_gpt_4_0314_reference.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/arena_hard/generation 2026-01-06T13:30:35,768 creating build/bdist.linux-armv7l/wheel/unitxt/catalog/cards/boolq_indic 2026-01-06T13:30:35,770 creating build/bdist.linux-armv7l/wheel/unitxt/catalog/cards/boolq_indic/hi 2026-01-06T13:30:35,771 copying build/lib/unitxt/catalog/cards/boolq_indic/hi/classification.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/boolq_indic/hi 2026-01-06T13:30:35,773 copying build/lib/unitxt/catalog/cards/boolq_indic/hi/multiple_choice.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/boolq_indic/hi 2026-01-06T13:30:35,776 creating build/bdist.linux-armv7l/wheel/unitxt/catalog/cards/boolq_indic/or 2026-01-06T13:30:35,777 copying build/lib/unitxt/catalog/cards/boolq_indic/or/classification.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/boolq_indic/or 2026-01-06T13:30:35,779 copying build/lib/unitxt/catalog/cards/boolq_indic/or/multiple_choice.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/boolq_indic/or 2026-01-06T13:30:35,782 creating build/bdist.linux-armv7l/wheel/unitxt/catalog/cards/boolq_indic/bn 2026-01-06T13:30:35,783 copying build/lib/unitxt/catalog/cards/boolq_indic/bn/classification.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/boolq_indic/bn 2026-01-06T13:30:35,785 copying build/lib/unitxt/catalog/cards/boolq_indic/bn/multiple_choice.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/boolq_indic/bn 2026-01-06T13:30:35,788 creating build/bdist.linux-armv7l/wheel/unitxt/catalog/cards/boolq_indic/ta 2026-01-06T13:30:35,789 copying build/lib/unitxt/catalog/cards/boolq_indic/ta/classification.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/boolq_indic/ta 2026-01-06T13:30:35,791 copying build/lib/unitxt/catalog/cards/boolq_indic/ta/multiple_choice.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/boolq_indic/ta 2026-01-06T13:30:35,793 creating build/bdist.linux-armv7l/wheel/unitxt/catalog/cards/boolq_indic/mr 2026-01-06T13:30:35,794 copying build/lib/unitxt/catalog/cards/boolq_indic/mr/classification.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/boolq_indic/mr 2026-01-06T13:30:35,796 copying build/lib/unitxt/catalog/cards/boolq_indic/mr/multiple_choice.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/boolq_indic/mr 2026-01-06T13:30:35,799 creating build/bdist.linux-armv7l/wheel/unitxt/catalog/cards/boolq_indic/ml 2026-01-06T13:30:35,800 copying build/lib/unitxt/catalog/cards/boolq_indic/ml/classification.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/boolq_indic/ml 2026-01-06T13:30:35,802 copying build/lib/unitxt/catalog/cards/boolq_indic/ml/multiple_choice.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/boolq_indic/ml 2026-01-06T13:30:35,804 creating build/bdist.linux-armv7l/wheel/unitxt/catalog/cards/boolq_indic/pa 2026-01-06T13:30:35,805 copying build/lib/unitxt/catalog/cards/boolq_indic/pa/classification.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/boolq_indic/pa 2026-01-06T13:30:35,807 copying build/lib/unitxt/catalog/cards/boolq_indic/pa/multiple_choice.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/boolq_indic/pa 2026-01-06T13:30:35,810 creating build/bdist.linux-armv7l/wheel/unitxt/catalog/cards/boolq_indic/kn 2026-01-06T13:30:35,811 copying build/lib/unitxt/catalog/cards/boolq_indic/kn/classification.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/boolq_indic/kn 2026-01-06T13:30:35,813 copying build/lib/unitxt/catalog/cards/boolq_indic/kn/multiple_choice.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/boolq_indic/kn 2026-01-06T13:30:35,815 creating build/bdist.linux-armv7l/wheel/unitxt/catalog/cards/boolq_indic/gu 2026-01-06T13:30:35,816 copying build/lib/unitxt/catalog/cards/boolq_indic/gu/classification.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/boolq_indic/gu 2026-01-06T13:30:35,818 copying build/lib/unitxt/catalog/cards/boolq_indic/gu/multiple_choice.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/boolq_indic/gu 2026-01-06T13:30:35,821 creating build/bdist.linux-armv7l/wheel/unitxt/catalog/cards/boolq_indic/te 2026-01-06T13:30:35,822 copying build/lib/unitxt/catalog/cards/boolq_indic/te/classification.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/boolq_indic/te 2026-01-06T13:30:35,824 copying build/lib/unitxt/catalog/cards/boolq_indic/te/multiple_choice.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/boolq_indic/te 2026-01-06T13:30:35,826 copying build/lib/unitxt/catalog/cards/qtsumm.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards 2026-01-06T13:30:35,828 copying build/lib/unitxt/catalog/cards/quality.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards 2026-01-06T13:30:35,830 copying build/lib/unitxt/catalog/cards/rte.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards 2026-01-06T13:30:35,832 creating build/bdist.linux-armv7l/wheel/unitxt/catalog/serializers 2026-01-06T13:30:35,834 creating build/bdist.linux-armv7l/wheel/unitxt/catalog/serializers/text2sql 2026-01-06T13:30:35,835 copying build/lib/unitxt/catalog/serializers/text2sql/schema.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/serializers/text2sql 2026-01-06T13:30:35,838 creating build/bdist.linux-armv7l/wheel/unitxt/catalog/serializers/table 2026-01-06T13:30:35,839 copying build/lib/unitxt/catalog/serializers/table/markdown.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/serializers/table 2026-01-06T13:30:35,841 copying build/lib/unitxt/catalog/serializers/table/concat.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/serializers/table 2026-01-06T13:30:35,843 copying build/lib/unitxt/catalog/serializers/table/indexed_row_major.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/serializers/table 2026-01-06T13:30:35,844 copying build/lib/unitxt/catalog/serializers/table/df.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/serializers/table 2026-01-06T13:30:35,846 copying build/lib/unitxt/catalog/serializers/table/json.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/serializers/table 2026-01-06T13:30:35,848 copying build/lib/unitxt/catalog/serializers/table/image.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/serializers/table 2026-01-06T13:30:35,850 copying build/lib/unitxt/catalog/serializers/table/html.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/serializers/table 2026-01-06T13:30:35,852 creating build/bdist.linux-armv7l/wheel/unitxt/catalog/operators 2026-01-06T13:30:35,853 copying build/lib/unitxt/catalog/operators/extract_mt_bench_label_judgment.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/operators 2026-01-06T13:30:35,855 copying build/lib/unitxt/catalog/operators/regex_parser.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/operators 2026-01-06T13:30:35,857 copying build/lib/unitxt/catalog/operators/upper_case.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/operators 2026-01-06T13:30:35,859 copying build/lib/unitxt/catalog/operators/hate_speech_or_not_hate_speech.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/operators 2026-01-06T13:30:35,861 copying build/lib/unitxt/catalog/operators/extract_harm_rating_judgment.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/operators 2026-01-06T13:30:35,862 copying build/lib/unitxt/catalog/operators/extract_from_double_brackets.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/operators 2026-01-06T13:30:35,864 copying build/lib/unitxt/catalog/operators/take_first_non_empty_line.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/operators 2026-01-06T13:30:35,866 creating build/bdist.linux-armv7l/wheel/unitxt/catalog/operators/balancers 2026-01-06T13:30:35,868 creating build/bdist.linux-armv7l/wheel/unitxt/catalog/operators/balancers/qa 2026-01-06T13:30:35,869 copying build/lib/unitxt/catalog/operators/balancers/qa/by_answer.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/operators/balancers/qa 2026-01-06T13:30:35,872 creating build/bdist.linux-armv7l/wheel/unitxt/catalog/operators/balancers/ner 2026-01-06T13:30:35,873 copying build/lib/unitxt/catalog/operators/balancers/ner/zero_vs_many_entities.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/operators/balancers/ner 2026-01-06T13:30:35,875 creating build/bdist.linux-armv7l/wheel/unitxt/catalog/operators/balancers/multi_label 2026-01-06T13:30:35,876 copying build/lib/unitxt/catalog/operators/balancers/multi_label/zero_vs_many_labels.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/operators/balancers/multi_label 2026-01-06T13:30:35,879 creating build/bdist.linux-armv7l/wheel/unitxt/catalog/operators/balancers/classification 2026-01-06T13:30:35,880 copying build/lib/unitxt/catalog/operators/balancers/classification/minimum_one_example_per_class.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/operators/balancers/classification 2026-01-06T13:30:35,882 copying build/lib/unitxt/catalog/operators/balancers/classification/by_label.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/operators/balancers/classification 2026-01-06T13:30:35,883 copying build/lib/unitxt/catalog/operators/remove_articles.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/operators 2026-01-06T13:30:35,885 copying build/lib/unitxt/catalog/operators/extract_arena_hard_numerical_judgment.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/operators 2026-01-06T13:30:35,887 copying build/lib/unitxt/catalog/operators/lower_case.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/operators 2026-01-06T13:30:35,889 copying build/lib/unitxt/catalog/operators/toxic_or_not_toxic.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/operators 2026-01-06T13:30:35,891 copying build/lib/unitxt/catalog/operators/arena_hard_hf_space_processing_steps.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/operators 2026-01-06T13:30:35,893 copying build/lib/unitxt/catalog/operators/cast_to_float_return_nan_if_failed.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/operators 2026-01-06T13:30:35,895 copying build/lib/unitxt/catalog/operators/take_first_word.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/operators 2026-01-06T13:30:35,897 copying build/lib/unitxt/catalog/operators/remove_punctuations.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/operators 2026-01-06T13:30:35,899 copying build/lib/unitxt/catalog/operators/convert_to_boolean.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/operators 2026-01-06T13:30:35,900 copying build/lib/unitxt/catalog/operators/lower_case_till_punc.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/operators 2026-01-06T13:30:35,902 copying build/lib/unitxt/catalog/operators/yes_no_to_int.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/operators 2026-01-06T13:30:35,904 copying build/lib/unitxt/catalog/operators/extract_mt_bench_rating_judgment.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/operators 2026-01-06T13:30:35,905 copying build/lib/unitxt/catalog/operators/literal_eval.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/operators 2026-01-06T13:30:35,907 copying build/lib/unitxt/catalog/operators/extract_verbal_judgement.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/operators 2026-01-06T13:30:35,909 copying build/lib/unitxt/catalog/operators/predictions_yes_1_else_0.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/operators 2026-01-06T13:30:35,910 copying build/lib/unitxt/catalog/operators/fix_whitespace.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/operators 2026-01-06T13:30:35,912 copying build/lib/unitxt/catalog/operators/take_last_non_empty_line.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/operators 2026-01-06T13:30:35,914 copying build/lib/unitxt/catalog/operators/extract_verbal_judgement_bad_good.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/operators 2026-01-06T13:30:35,916 copying build/lib/unitxt/catalog/operators/substring.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/operators 2026-01-06T13:30:35,917 copying build/lib/unitxt/catalog/operators/match_closest_option.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/operators 2026-01-06T13:30:35,919 copying build/lib/unitxt/catalog/operators/cast_to_float_return_0_5_if_failed.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/operators 2026-01-06T13:30:35,922 creating build/bdist.linux-armv7l/wheel/unitxt/catalog/operators/mt_bench 2026-01-06T13:30:35,923 copying build/lib/unitxt/catalog/operators/mt_bench/pairwise_hf_space_processing_steps.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/operators/mt_bench 2026-01-06T13:30:35,925 copying build/lib/unitxt/catalog/operators/mt_bench/rating_hf_space_processing_steps.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/operators/mt_bench 2026-01-06T13:30:35,927 copying build/lib/unitxt/catalog/operators/cast_to_float_return_zero_if_failed.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/operators 2026-01-06T13:30:35,929 copying build/lib/unitxt/catalog/operators/capitalize.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/operators 2026-01-06T13:30:35,931 copying build/lib/unitxt/catalog/operators/get_string_after_colon.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/operators 2026-01-06T13:30:35,933 copying build/lib/unitxt/catalog/operators/fix_json_schema.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/operators 2026-01-06T13:30:35,935 copying build/lib/unitxt/catalog/operators/remove_none_from_list.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/operators 2026-01-06T13:30:35,937 copying build/lib/unitxt/catalog/operators/to_yes_or_none.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/operators 2026-01-06T13:30:35,939 copying build/lib/unitxt/catalog/operators/str_to_float_format.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/operators 2026-01-06T13:30:35,941 copying build/lib/unitxt/catalog/operators/scale_0_10_to_0_1.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/operators 2026-01-06T13:30:35,942 copying build/lib/unitxt/catalog/operators/stance_to_pro_con.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/operators 2026-01-06T13:30:35,944 copying build/lib/unitxt/catalog/operators/first_character.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/operators 2026-01-06T13:30:35,947 creating build/bdist.linux-armv7l/wheel/unitxt/catalog/splitters 2026-01-06T13:30:35,948 copying build/lib/unitxt/catalog/splitters/large_no_dev.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/splitters 2026-01-06T13:30:35,950 copying build/lib/unitxt/catalog/splitters/diverse_labels_sampler.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/splitters 2026-01-06T13:30:35,951 copying build/lib/unitxt/catalog/splitters/small_no_test.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/splitters 2026-01-06T13:30:35,953 copying build/lib/unitxt/catalog/splitters/small_no_dev.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/splitters 2026-01-06T13:30:35,955 copying build/lib/unitxt/catalog/splitters/test_only.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/splitters 2026-01-06T13:30:35,957 copying build/lib/unitxt/catalog/splitters/large_no_test.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/splitters 2026-01-06T13:30:35,960 creating build/bdist.linux-armv7l/wheel/unitxt/catalog/processors 2026-01-06T13:30:35,961 copying build/lib/unitxt/catalog/processors/to_list_by_comma_from_references.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/processors 2026-01-06T13:30:35,963 copying build/lib/unitxt/catalog/processors/extract_mt_bench_label_judgment.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/processors 2026-01-06T13:30:35,964 copying build/lib/unitxt/catalog/processors/upper_case.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/processors 2026-01-06T13:30:35,966 copying build/lib/unitxt/catalog/processors/hate_speech_or_not_hate_speech.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/processors 2026-01-06T13:30:35,968 copying build/lib/unitxt/catalog/processors/extract_harm_rating_judgment.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/processors 2026-01-06T13:30:35,970 copying build/lib/unitxt/catalog/processors/regex_parser_from_prediction.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/processors 2026-01-06T13:30:35,972 copying build/lib/unitxt/catalog/processors/extract_from_double_brackets.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/processors 2026-01-06T13:30:35,974 copying build/lib/unitxt/catalog/processors/take_first_non_empty_line.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/processors 2026-01-06T13:30:35,975 copying build/lib/unitxt/catalog/processors/to_list_by_comma.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/processors 2026-01-06T13:30:35,977 copying build/lib/unitxt/catalog/processors/load_json_from_predictions.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/processors 2026-01-06T13:30:35,979 copying build/lib/unitxt/catalog/processors/remove_articles.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/processors 2026-01-06T13:30:35,981 copying build/lib/unitxt/catalog/processors/to_list_by_hyphen_space_from_references.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/processors 2026-01-06T13:30:35,982 copying build/lib/unitxt/catalog/processors/to_string_stripped.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/processors 2026-01-06T13:30:35,984 copying build/lib/unitxt/catalog/processors/to_list_by_comma_space.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/processors 2026-01-06T13:30:35,986 copying build/lib/unitxt/catalog/processors/extract_arena_hard_numerical_judgment.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/processors 2026-01-06T13:30:35,988 copying build/lib/unitxt/catalog/processors/to_list_by_hyphen_space.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/processors 2026-01-06T13:30:35,990 copying build/lib/unitxt/catalog/processors/lower_case.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/processors 2026-01-06T13:30:35,991 copying build/lib/unitxt/catalog/processors/toxic_or_not_toxic.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/processors 2026-01-06T13:30:35,993 copying build/lib/unitxt/catalog/processors/list_to_empty_entity_tuples.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/processors 2026-01-06T13:30:35,995 copying build/lib/unitxt/catalog/processors/cast_to_float_return_nan_if_failed.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/processors 2026-01-06T13:30:35,997 copying build/lib/unitxt/catalog/processors/take_first_word.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/processors 2026-01-06T13:30:35,998 copying build/lib/unitxt/catalog/processors/infer_last_token_logprobs_to_yes_no_probs.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/processors 2026-01-06T13:30:36,000 copying build/lib/unitxt/catalog/processors/to_span_label_pairs.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/processors 2026-01-06T13:30:36,002 copying build/lib/unitxt/catalog/processors/remove_punctuations.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/processors 2026-01-06T13:30:36,004 copying build/lib/unitxt/catalog/processors/to_string.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/processors 2026-01-06T13:30:36,006 copying build/lib/unitxt/catalog/processors/multi_tool_call.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/processors 2026-01-06T13:30:36,008 copying build/lib/unitxt/catalog/processors/convert_to_boolean.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/processors 2026-01-06T13:30:36,010 copying build/lib/unitxt/catalog/processors/lower_case_till_punc.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/processors 2026-01-06T13:30:36,011 copying build/lib/unitxt/catalog/processors/yes_no_to_int.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/processors 2026-01-06T13:30:36,013 copying build/lib/unitxt/catalog/processors/to_span_label_pairs_surface_only.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/processors 2026-01-06T13:30:36,015 copying build/lib/unitxt/catalog/processors/extract_mt_bench_rating_judgment.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/processors 2026-01-06T13:30:36,017 copying build/lib/unitxt/catalog/processors/literal_eval.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/processors 2026-01-06T13:30:36,018 copying build/lib/unitxt/catalog/processors/extract_verbal_judgement.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/processors 2026-01-06T13:30:36,020 creating build/bdist.linux-armv7l/wheel/unitxt/catalog/processors/text2sql 2026-01-06T13:30:36,021 copying build/lib/unitxt/catalog/processors/text2sql/get_sql.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/processors/text2sql 2026-01-06T13:30:36,023 copying build/lib/unitxt/catalog/processors/predictions_yes_1_else_0.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/processors 2026-01-06T13:30:36,025 copying build/lib/unitxt/catalog/processors/fix_whitespace.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/processors 2026-01-06T13:30:36,027 copying build/lib/unitxt/catalog/processors/load_json_predictions.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/processors 2026-01-06T13:30:36,029 copying build/lib/unitxt/catalog/processors/take_last_non_empty_line.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/processors 2026-01-06T13:30:36,031 copying build/lib/unitxt/catalog/processors/extract_verbal_judgement_bad_good.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/processors 2026-01-06T13:30:36,032 copying build/lib/unitxt/catalog/processors/substring.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/processors 2026-01-06T13:30:36,034 copying build/lib/unitxt/catalog/processors/match_closest_option.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/processors 2026-01-06T13:30:36,036 copying build/lib/unitxt/catalog/processors/cast_to_float_return_0_5_if_failed.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/processors 2026-01-06T13:30:36,038 copying build/lib/unitxt/catalog/processors/load_json.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/processors 2026-01-06T13:30:36,040 copying build/lib/unitxt/catalog/processors/cast_to_float_return_zero_if_failed.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/processors 2026-01-06T13:30:36,041 copying build/lib/unitxt/catalog/processors/capitalize.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/processors 2026-01-06T13:30:36,043 copying build/lib/unitxt/catalog/processors/get_string_after_colon.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/processors 2026-01-06T13:30:36,045 copying build/lib/unitxt/catalog/processors/remove_none_from_list.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/processors 2026-01-06T13:30:36,046 copying build/lib/unitxt/catalog/processors/load_json_or_empty_tool_call.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/processors 2026-01-06T13:30:36,048 copying build/lib/unitxt/catalog/processors/safe_unsafe.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/processors 2026-01-06T13:30:36,050 copying build/lib/unitxt/catalog/processors/to_yes_or_none.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/processors 2026-01-06T13:30:36,052 copying build/lib/unitxt/catalog/processors/str_to_float_format.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/processors 2026-01-06T13:30:36,054 copying build/lib/unitxt/catalog/processors/scale_0_10_to_0_1.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/processors 2026-01-06T13:30:36,056 copying build/lib/unitxt/catalog/processors/infer_logprobs_to_yes_no_probs.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/processors 2026-01-06T13:30:36,057 copying build/lib/unitxt/catalog/processors/stance_to_pro_con.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/processors 2026-01-06T13:30:36,059 copying build/lib/unitxt/catalog/processors/first_character.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/processors 2026-01-06T13:30:36,061 copying build/lib/unitxt/catalog/processors/dict_of_lists_to_value_key_pairs.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/processors 2026-01-06T13:30:36,063 creating build/bdist.linux-armv7l/wheel/unitxt/catalog/benchmarks 2026-01-06T13:30:36,064 copying build/lib/unitxt/catalog/benchmarks/vision_full.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/benchmarks 2026-01-06T13:30:36,066 copying build/lib/unitxt/catalog/benchmarks/tool_calling.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/benchmarks 2026-01-06T13:30:36,069 copying build/lib/unitxt/catalog/benchmarks/glue.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/benchmarks 2026-01-06T13:30:36,070 copying build/lib/unitxt/catalog/benchmarks/llama_vision.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/benchmarks 2026-01-06T13:30:36,072 copying build/lib/unitxt/catalog/benchmarks/vision_default.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/benchmarks 2026-01-06T13:30:36,074 copying build/lib/unitxt/catalog/benchmarks/torr.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/benchmarks 2026-01-06T13:30:36,077 copying build/lib/unitxt/catalog/benchmarks/bluebench.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/benchmarks 2026-01-06T13:30:36,080 creating build/bdist.linux-armv7l/wheel/unitxt/catalog/formats 2026-01-06T13:30:36,081 copying build/lib/unitxt/catalog/formats/human_assistant.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/formats 2026-01-06T13:30:36,083 copying build/lib/unitxt/catalog/formats/empty.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/formats 2026-01-06T13:30:36,085 copying build/lib/unitxt/catalog/formats/llamaguard2.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/formats 2026-01-06T13:30:36,087 copying build/lib/unitxt/catalog/formats/chat_api.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/formats 2026-01-06T13:30:36,089 copying build/lib/unitxt/catalog/formats/llama3_instruct.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/formats 2026-01-06T13:30:36,091 copying build/lib/unitxt/catalog/formats/llama3_instruct_all_demos_in_one_turn.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/formats 2026-01-06T13:30:36,093 creating build/bdist.linux-armv7l/wheel/unitxt/catalog/formats/models 2026-01-06T13:30:36,094 copying build/lib/unitxt/catalog/formats/models/alpaca_instruct.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/formats/models 2026-01-06T13:30:36,096 copying build/lib/unitxt/catalog/formats/models/granite_3_1_documents.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/formats/models 2026-01-06T13:30:36,098 copying build/lib/unitxt/catalog/formats/models/phi_3.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/formats/models 2026-01-06T13:30:36,100 creating build/bdist.linux-armv7l/wheel/unitxt/catalog/formats/models/labradorite 2026-01-06T13:30:36,101 copying build/lib/unitxt/catalog/formats/models/labradorite/zero_shot.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/formats/models/labradorite 2026-01-06T13:30:36,103 copying build/lib/unitxt/catalog/formats/models/labradorite/few_shot.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/formats/models/labradorite 2026-01-06T13:30:36,105 copying build/lib/unitxt/catalog/formats/models/llava.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/formats/models 2026-01-06T13:30:36,107 creating build/bdist.linux-armv7l/wheel/unitxt/catalog/formats/models/flan 2026-01-06T13:30:36,108 copying build/lib/unitxt/catalog/formats/models/flan/exq_exa.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/formats/models/flan 2026-01-06T13:30:36,110 copying build/lib/unitxt/catalog/formats/models/flan/few_shot.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/formats/models/flan 2026-01-06T13:30:36,112 copying build/lib/unitxt/catalog/formats/models/starling.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/formats/models 2026-01-06T13:30:36,115 creating build/bdist.linux-armv7l/wheel/unitxt/catalog/formats/models/mistral 2026-01-06T13:30:36,115 copying build/lib/unitxt/catalog/formats/models/mistral/instruction.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/formats/models/mistral 2026-01-06T13:30:36,118 creating build/bdist.linux-armv7l/wheel/unitxt/catalog/formats/models/mistral/instruction 2026-01-06T13:30:36,119 copying build/lib/unitxt/catalog/formats/models/mistral/instruction/with_system_prompt.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/formats/models/mistral/instruction 2026-01-06T13:30:36,121 copying build/lib/unitxt/catalog/formats/models/llava_interleave.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/formats/models 2026-01-06T13:30:36,123 copying build/lib/unitxt/catalog/formats/chat_api_with_tokenizer_chat_template.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/formats 2026-01-06T13:30:36,125 copying build/lib/unitxt/catalog/formats/llama2.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/formats 2026-01-06T13:30:36,126 copying build/lib/unitxt/catalog/formats/deepseek_coder.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/formats 2026-01-06T13:30:36,128 copying build/lib/unitxt/catalog/formats/textual_assistant.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/formats 2026-01-06T13:30:36,130 copying build/lib/unitxt/catalog/formats/user_agent.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/formats 2026-01-06T13:30:36,132 copying build/lib/unitxt/catalog/formats/user_assistant.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/formats 2026-01-06T13:30:36,134 copying build/lib/unitxt/catalog/formats/llama.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/formats 2026-01-06T13:30:36,136 copying build/lib/unitxt/catalog/formats/empty_input_output_separator.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/formats 2026-01-06T13:30:36,138 copying build/lib/unitxt/generator_utils.py -> build/bdist.linux-armv7l/wheel/./unitxt 2026-01-06T13:30:36,140 copying build/lib/unitxt/dialog_operators.py -> build/bdist.linux-armv7l/wheel/./unitxt 2026-01-06T13:30:36,143 copying build/lib/unitxt/instructions.py -> build/bdist.linux-armv7l/wheel/./unitxt 2026-01-06T13:30:36,144 copying build/lib/unitxt/processors.py -> build/bdist.linux-armv7l/wheel/./unitxt 2026-01-06T13:30:36,147 copying build/lib/unitxt/catalog.py -> build/bdist.linux-armv7l/wheel/./unitxt 2026-01-06T13:30:36,150 copying build/lib/unitxt/serializers.py -> build/bdist.linux-armv7l/wheel/./unitxt 2026-01-06T13:30:36,152 copying build/lib/unitxt/api.py -> build/bdist.linux-armv7l/wheel/./unitxt 2026-01-06T13:30:36,155 running install_egg_info 2026-01-06T13:30:36,164 Copying src/unitxt.egg-info to build/bdist.linux-armv7l/wheel/./unitxt-1.26.8-py3.11.egg-info 2026-01-06T13:30:36,181 running install_scripts 2026-01-06T13:30:36,195 creating build/bdist.linux-armv7l/wheel/unitxt-1.26.8.dist-info/WHEEL 2026-01-06T13:30:36,198 creating '/tmp/pip-wheel-nmo1cw7a/.tmp-pkhmmi_3/unitxt-1.26.8-py3-none-any.whl' and adding 'build/bdist.linux-armv7l/wheel' to it 2026-01-06T13:30:36,201 adding 'unitxt/__init__.py' 2026-01-06T13:30:36,203 adding 'unitxt/api.py' 2026-01-06T13:30:36,207 adding 'unitxt/artifact.py' 2026-01-06T13:30:36,209 adding 'unitxt/augmentors.py' 2026-01-06T13:30:36,211 adding 'unitxt/base_metric.py' 2026-01-06T13:30:36,212 adding 'unitxt/benchmark.py' 2026-01-06T13:30:36,213 adding 'unitxt/blocks.py' 2026-01-06T13:30:36,215 adding 'unitxt/card.py' 2026-01-06T13:30:36,216 adding 'unitxt/catalog.py' 2026-01-06T13:30:36,218 adding 'unitxt/collections.py' 2026-01-06T13:30:36,219 adding 'unitxt/collections_operators.py' 2026-01-06T13:30:36,222 adding 'unitxt/dataclass.py' 2026-01-06T13:30:36,224 adding 'unitxt/dataset.py' 2026-01-06T13:30:36,225 adding 'unitxt/dataset_utils.py' 2026-01-06T13:30:36,226 adding 'unitxt/deprecation_utils.py' 2026-01-06T13:30:36,228 adding 'unitxt/dialog_operators.py' 2026-01-06T13:30:36,232 adding 'unitxt/dict_utils.py' 2026-01-06T13:30:36,234 adding 'unitxt/error_utils.py' 2026-01-06T13:30:36,235 adding 'unitxt/eval_utils.py' 2026-01-06T13:30:36,239 adding 'unitxt/evaluate_cli.py' 2026-01-06T13:30:36,241 adding 'unitxt/file_utils.py' 2026-01-06T13:30:36,243 adding 'unitxt/formats.py' 2026-01-06T13:30:36,245 adding 'unitxt/fusion.py' 2026-01-06T13:30:36,246 adding 'unitxt/generator_utils.py' 2026-01-06T13:30:36,248 adding 'unitxt/hf_utils.py' 2026-01-06T13:30:36,250 adding 'unitxt/image_operators.py' 2026-01-06T13:30:36,265 adding 'unitxt/inference.py' 2026-01-06T13:30:36,267 adding 'unitxt/instructions.py' 2026-01-06T13:30:36,273 adding 'unitxt/llm_as_judge.py' 2026-01-06T13:30:36,274 adding 'unitxt/llm_as_judge_chat_templates.py' 2026-01-06T13:30:36,280 adding 'unitxt/llm_as_judge_constants.py' 2026-01-06T13:30:36,283 adding 'unitxt/llm_as_judge_from_template.py' 2026-01-06T13:30:36,284 adding 'unitxt/llm_as_judge_operators.py' 2026-01-06T13:30:36,285 adding 'unitxt/llm_as_judge_utils.py' 2026-01-06T13:30:36,292 adding 'unitxt/loaders.py' 2026-01-06T13:30:36,293 adding 'unitxt/logging_utils.py' 2026-01-06T13:30:36,295 adding 'unitxt/metric.py' 2026-01-06T13:30:36,298 adding 'unitxt/metric_utils.py' 2026-01-06T13:30:36,330 adding 'unitxt/metrics.py' 2026-01-06T13:30:36,333 adding 'unitxt/normalizers.py' 2026-01-06T13:30:36,336 adding 'unitxt/operator.py' 2026-01-06T13:30:36,350 adding 'unitxt/operators.py' 2026-01-06T13:30:36,352 adding 'unitxt/parsing_utils.py' 2026-01-06T13:30:36,355 adding 'unitxt/processors.py' 2026-01-06T13:30:36,356 adding 'unitxt/random_utils.py' 2026-01-06T13:30:36,357 adding 'unitxt/recipe.py' 2026-01-06T13:30:36,359 adding 'unitxt/register.py' 2026-01-06T13:30:36,360 adding 'unitxt/schema.py' 2026-01-06T13:30:36,362 adding 'unitxt/serializers.py' 2026-01-06T13:30:36,364 adding 'unitxt/settings_utils.py' 2026-01-06T13:30:36,365 adding 'unitxt/span_lableing_operators.py' 2026-01-06T13:30:36,367 adding 'unitxt/split_utils.py' 2026-01-06T13:30:36,369 adding 'unitxt/splitters.py' 2026-01-06T13:30:36,373 adding 'unitxt/standard.py' 2026-01-06T13:30:36,374 adding 'unitxt/stream.py' 2026-01-06T13:30:36,376 adding 'unitxt/stream_operators.py' 2026-01-06T13:30:36,377 adding 'unitxt/string_operators.py' 2026-01-06T13:30:36,381 adding 'unitxt/struct_data_operators.py' 2026-01-06T13:30:36,383 adding 'unitxt/system_prompts.py' 2026-01-06T13:30:36,385 adding 'unitxt/task.py' 2026-01-06T13:30:36,389 adding 'unitxt/templates.py' 2026-01-06T13:30:36,394 adding 'unitxt/text2sql_utils.py' 2026-01-06T13:30:36,397 adding 'unitxt/text_utils.py' 2026-01-06T13:30:36,402 adding 'unitxt/type_utils.py' 2026-01-06T13:30:36,403 adding 'unitxt/types.py' 2026-01-06T13:30:36,406 adding 'unitxt/utils.py' 2026-01-06T13:30:36,407 adding 'unitxt/validate.py' 2026-01-06T13:30:36,408 adding 'unitxt/version.py' 2026-01-06T13:30:36,410 adding 'unitxt/assistant/__init__.py' 2026-01-06T13:30:36,412 adding 'unitxt/assistant/app.py' 2026-01-06T13:30:39,205 adding 'unitxt/assistant/embeddings.npz' 2026-01-06T13:30:39,371 adding 'unitxt/assistant/index.py' 2026-01-06T13:30:39,573 adding 'unitxt/assistant/metadata.parquet' 2026-01-06T13:30:39,586 adding 'unitxt/assistant/assessment/__init__.py' 2026-01-06T13:30:39,588 adding 'unitxt/assistant/assessment/assistant_inference_engine.py' 2026-01-06T13:30:39,589 adding 'unitxt/assistant/assessment/my_pretty_table.py' 2026-01-06T13:30:39,592 adding 'unitxt/catalog/augmentors/augment_whitespace_prefix_and_suffix_task_input.json' 2026-01-06T13:30:39,593 adding 'unitxt/catalog/augmentors/augment_whitespace_task_input.json' 2026-01-06T13:30:39,594 adding 'unitxt/catalog/augmentors/no_augmentation.json' 2026-01-06T13:30:39,596 adding 'unitxt/catalog/augmentors/image/grey_scale.json' 2026-01-06T13:30:39,597 adding 'unitxt/catalog/augmentors/image/grid_lines.json' 2026-01-06T13:30:39,598 adding 'unitxt/catalog/augmentors/image/oldify.json' 2026-01-06T13:30:39,599 adding 'unitxt/catalog/augmentors/image/white_noise.json' 2026-01-06T13:30:39,601 adding 'unitxt/catalog/augmentors/table/duplicate_columns.json' 2026-01-06T13:30:39,602 adding 'unitxt/catalog/augmentors/table/duplicate_rows.json' 2026-01-06T13:30:39,603 adding 'unitxt/catalog/augmentors/table/insert_empty_rows.json' 2026-01-06T13:30:39,605 adding 'unitxt/catalog/augmentors/table/mask_cols_names.json' 2026-01-06T13:30:39,606 adding 'unitxt/catalog/augmentors/table/shuffle_cols.json' 2026-01-06T13:30:39,607 adding 'unitxt/catalog/augmentors/table/shuffle_cols_names.json' 2026-01-06T13:30:39,608 adding 'unitxt/catalog/augmentors/table/shuffle_rows.json' 2026-01-06T13:30:39,609 adding 'unitxt/catalog/augmentors/table/transpose.json' 2026-01-06T13:30:39,611 adding 'unitxt/catalog/augmentors/table/truncate_rows.json' 2026-01-06T13:30:39,612 adding 'unitxt/catalog/augmentors/text/white_space.json' 2026-01-06T13:30:39,614 adding 'unitxt/catalog/augmentors/text/whitespace_prefix_suffix.json' 2026-01-06T13:30:39,616 adding 'unitxt/catalog/benchmarks/bluebench.json' 2026-01-06T13:30:39,617 adding 'unitxt/catalog/benchmarks/glue.json' 2026-01-06T13:30:39,618 adding 'unitxt/catalog/benchmarks/llama_vision.json' 2026-01-06T13:30:39,619 adding 'unitxt/catalog/benchmarks/tool_calling.json' 2026-01-06T13:30:39,623 adding 'unitxt/catalog/benchmarks/torr.json' 2026-01-06T13:30:39,624 adding 'unitxt/catalog/benchmarks/vision_default.json' 2026-01-06T13:30:39,625 adding 'unitxt/catalog/benchmarks/vision_full.json' 2026-01-06T13:30:39,630 adding 'unitxt/catalog/cards/20_newsgroups.json' 2026-01-06T13:30:39,632 adding 'unitxt/catalog/cards/20_newsgroups_short.json' 2026-01-06T13:30:39,633 adding 'unitxt/catalog/cards/ag_news.json' 2026-01-06T13:30:39,634 adding 'unitxt/catalog/cards/ai2d.json' 2026-01-06T13:30:39,636 adding 'unitxt/catalog/cards/almost_evil.json' 2026-01-06T13:30:39,637 adding 'unitxt/catalog/cards/argument_topic.json' 2026-01-06T13:30:39,639 adding 'unitxt/catalog/cards/atis.json' 2026-01-06T13:30:39,640 adding 'unitxt/catalog/cards/atta_q.json' 2026-01-06T13:30:39,641 adding 'unitxt/catalog/cards/attaq.json' 2026-01-06T13:30:39,653 adding 'unitxt/catalog/cards/attaq_500.json' 2026-01-06T13:30:39,655 adding 'unitxt/catalog/cards/banking77.json' 2026-01-06T13:30:39,657 adding 'unitxt/catalog/cards/billsum.json' 2026-01-06T13:30:39,658 adding 'unitxt/catalog/cards/billsum_document_filtered_to_10000_chars.json' 2026-01-06T13:30:39,659 adding 'unitxt/catalog/cards/billsum_document_filtered_to_6000_chars.json' 2026-01-06T13:30:39,660 adding 'unitxt/catalog/cards/bold.json' 2026-01-06T13:30:39,662 adding 'unitxt/catalog/cards/chart_qa.json' 2026-01-06T13:30:39,663 adding 'unitxt/catalog/cards/chart_qa_lmms_eval.json' 2026-01-06T13:30:39,664 adding 'unitxt/catalog/cards/claim_stance_topic.json' 2026-01-06T13:30:39,665 adding 'unitxt/catalog/cards/cnn_dailymail.json' 2026-01-06T13:30:39,667 adding 'unitxt/catalog/cards/coedit_error_detection.json' 2026-01-06T13:30:39,668 adding 'unitxt/catalog/cards/coedit_gec.json' 2026-01-06T13:30:39,669 adding 'unitxt/catalog/cards/cola.json' 2026-01-06T13:30:39,671 adding 'unitxt/catalog/cards/copa.json' 2026-01-06T13:30:39,672 adding 'unitxt/catalog/cards/dart.json' 2026-01-06T13:30:39,673 adding 'unitxt/catalog/cards/dbpedia_14.json' 2026-01-06T13:30:39,674 adding 'unitxt/catalog/cards/ethos_binary.json' 2026-01-06T13:30:39,676 adding 'unitxt/catalog/cards/fin_qa.json' 2026-01-06T13:30:39,677 adding 'unitxt/catalog/cards/financial_tweets.json' 2026-01-06T13:30:39,679 adding 'unitxt/catalog/cards/frames.json' 2026-01-06T13:30:39,680 adding 'unitxt/catalog/cards/hellaswag.json' 2026-01-06T13:30:39,681 adding 'unitxt/catalog/cards/hh_rlhf.json' 2026-01-06T13:30:39,682 adding 'unitxt/catalog/cards/human_eval.json' 2026-01-06T13:30:39,684 adding 'unitxt/catalog/cards/info_vqa.json' 2026-01-06T13:30:39,685 adding 'unitxt/catalog/cards/info_vqa_lmms_eval.json' 2026-01-06T13:30:39,686 adding 'unitxt/catalog/cards/language_identification.json' 2026-01-06T13:30:39,688 adding 'unitxt/catalog/cards/law_stack_exchange.json' 2026-01-06T13:30:39,689 adding 'unitxt/catalog/cards/ledgar.json' 2026-01-06T13:30:39,691 adding 'unitxt/catalog/cards/long_bench_v2.json' 2026-01-06T13:30:39,692 adding 'unitxt/catalog/cards/mbpp.json' 2026-01-06T13:30:39,693 adding 'unitxt/catalog/cards/medical_abstracts.json' 2026-01-06T13:30:39,695 adding 'unitxt/catalog/cards/mnli.json' 2026-01-06T13:30:39,696 adding 'unitxt/catalog/cards/mrpc.json' 2026-01-06T13:30:39,697 adding 'unitxt/catalog/cards/news_category_classification_headline.json' 2026-01-06T13:30:39,699 adding 'unitxt/catalog/cards/numeric_nlg.json' 2026-01-06T13:30:39,700 adding 'unitxt/catalog/cards/open_australian_legal_qa.json' 2026-01-06T13:30:39,701 adding 'unitxt/catalog/cards/openbook_qa.json' 2026-01-06T13:30:39,702 adding 'unitxt/catalog/cards/piqa.json' 2026-01-06T13:30:39,704 adding 'unitxt/catalog/cards/pop_qa.json' 2026-01-06T13:30:39,705 adding 'unitxt/catalog/cards/pop_qa_robust.json' 2026-01-06T13:30:39,706 adding 'unitxt/catalog/cards/qnli.json' 2026-01-06T13:30:39,708 adding 'unitxt/catalog/cards/qqp.json' 2026-01-06T13:30:39,709 adding 'unitxt/catalog/cards/qtsumm.json' 2026-01-06T13:30:39,710 adding 'unitxt/catalog/cards/quality.json' 2026-01-06T13:30:39,712 adding 'unitxt/catalog/cards/race_all.json' 2026-01-06T13:30:39,713 adding 'unitxt/catalog/cards/race_high.json' 2026-01-06T13:30:39,714 adding 'unitxt/catalog/cards/race_middle.json' 2026-01-06T13:30:39,716 adding 'unitxt/catalog/cards/rte.json' 2026-01-06T13:30:39,717 adding 'unitxt/catalog/cards/scigen.json' 2026-01-06T13:30:39,718 adding 'unitxt/catalog/cards/sciq.json' 2026-01-06T13:30:39,720 adding 'unitxt/catalog/cards/seed_bench.json' 2026-01-06T13:30:39,721 adding 'unitxt/catalog/cards/simple_qa.json' 2026-01-06T13:30:39,722 adding 'unitxt/catalog/cards/social_iqa.json' 2026-01-06T13:30:39,723 adding 'unitxt/catalog/cards/squad.json' 2026-01-06T13:30:39,724 adding 'unitxt/catalog/cards/sst2.json' 2026-01-06T13:30:39,726 adding 'unitxt/catalog/cards/stsb.json' 2026-01-06T13:30:39,727 adding 'unitxt/catalog/cards/summarize_from_human_feedback.json' 2026-01-06T13:30:39,728 adding 'unitxt/catalog/cards/tab_fact.json' 2026-01-06T13:30:39,729 adding 'unitxt/catalog/cards/tablebench.json' 2026-01-06T13:30:39,731 adding 'unitxt/catalog/cards/tablebench_data_analysis.json' 2026-01-06T13:30:39,732 adding 'unitxt/catalog/cards/tablebench_fact_checking.json' 2026-01-06T13:30:39,733 adding 'unitxt/catalog/cards/tablebench_numerical_reasoning.json' 2026-01-06T13:30:39,734 adding 'unitxt/catalog/cards/tablerow_classify.json' 2026-01-06T13:30:39,736 adding 'unitxt/catalog/cards/tldr.json' 2026-01-06T13:30:39,737 adding 'unitxt/catalog/cards/tldr_document_filtered_to_10000_chars.json' 2026-01-06T13:30:39,738 adding 'unitxt/catalog/cards/tldr_document_filtered_to_6000_chars.json' 2026-01-06T13:30:39,740 adding 'unitxt/catalog/cards/toxigen.json' 2026-01-06T13:30:39,741 adding 'unitxt/catalog/cards/trec.json' 2026-01-06T13:30:39,743 adding 'unitxt/catalog/cards/turl_col_type.json' 2026-01-06T13:30:39,745 adding 'unitxt/catalog/cards/unfair_tos.json' 2026-01-06T13:30:39,746 adding 'unitxt/catalog/cards/websrc.json' 2026-01-06T13:30:39,747 adding 'unitxt/catalog/cards/wiki_bio.json' 2026-01-06T13:30:39,749 adding 'unitxt/catalog/cards/wikitq.json' 2026-01-06T13:30:39,750 adding 'unitxt/catalog/cards/wnli.json' 2026-01-06T13:30:39,751 adding 'unitxt/catalog/cards/wsc.json' 2026-01-06T13:30:39,753 adding 'unitxt/catalog/cards/xlam_function_calling_60k.json' 2026-01-06T13:30:39,754 adding 'unitxt/catalog/cards/xsum.json' 2026-01-06T13:30:39,755 adding 'unitxt/catalog/cards/yahoo_answers_topics.json' 2026-01-06T13:30:39,757 adding 'unitxt/catalog/cards/20_newsgroups/sklearn.json' 2026-01-06T13:30:39,760 adding 'unitxt/catalog/cards/CFPB/product/2023.json' 2026-01-06T13:30:39,761 adding 'unitxt/catalog/cards/CFPB/product/watsonx.json' 2026-01-06T13:30:39,763 adding 'unitxt/catalog/cards/ai2_arc/arc_challenge.json' 2026-01-06T13:30:39,764 adding 'unitxt/catalog/cards/ai2_arc/arc_easy.json' 2026-01-06T13:30:39,766 adding 'unitxt/catalog/cards/almost_evil/de.json' 2026-01-06T13:30:39,767 adding 'unitxt/catalog/cards/almost_evil/en.json' 2026-01-06T13:30:39,769 adding 'unitxt/catalog/cards/almost_evil/es.json' 2026-01-06T13:30:39,770 adding 'unitxt/catalog/cards/almost_evil/fr.json' 2026-01-06T13:30:39,771 adding 'unitxt/catalog/cards/almost_evil/it.json' 2026-01-06T13:30:39,773 adding 'unitxt/catalog/cards/almost_evil/nl.json' 2026-01-06T13:30:39,774 adding 'unitxt/catalog/cards/almost_evil/pt.json' 2026-01-06T13:30:39,775 adding 'unitxt/catalog/cards/almost_evil/ru.json' 2026-01-06T13:30:39,778 adding 'unitxt/catalog/cards/amazon_mass/af_ZA.json' 2026-01-06T13:30:39,780 adding 'unitxt/catalog/cards/amazon_mass/all.json' 2026-01-06T13:30:39,782 adding 'unitxt/catalog/cards/amazon_mass/am_ET.json' 2026-01-06T13:30:39,783 adding 'unitxt/catalog/cards/amazon_mass/ar_SA.json' 2026-01-06T13:30:39,785 adding 'unitxt/catalog/cards/amazon_mass/az_AZ.json' 2026-01-06T13:30:39,787 adding 'unitxt/catalog/cards/amazon_mass/bn_BD.json' 2026-01-06T13:30:39,788 adding 'unitxt/catalog/cards/amazon_mass/ca_ES.json' 2026-01-06T13:30:39,790 adding 'unitxt/catalog/cards/amazon_mass/cy_GB.json' 2026-01-06T13:30:39,792 adding 'unitxt/catalog/cards/amazon_mass/da_DK.json' 2026-01-06T13:30:39,793 adding 'unitxt/catalog/cards/amazon_mass/de_DE.json' 2026-01-06T13:30:39,795 adding 'unitxt/catalog/cards/amazon_mass/el_GR.json' 2026-01-06T13:30:39,797 adding 'unitxt/catalog/cards/amazon_mass/en_US.json' 2026-01-06T13:30:39,798 adding 'unitxt/catalog/cards/amazon_mass/es_ES.json' 2026-01-06T13:30:39,800 adding 'unitxt/catalog/cards/amazon_mass/fa_IR.json' 2026-01-06T13:30:39,802 adding 'unitxt/catalog/cards/amazon_mass/fi_FI.json' 2026-01-06T13:30:39,803 adding 'unitxt/catalog/cards/amazon_mass/fr_FR.json' 2026-01-06T13:30:39,805 adding 'unitxt/catalog/cards/amazon_mass/he_IL.json' 2026-01-06T13:30:39,807 adding 'unitxt/catalog/cards/amazon_mass/hi_IN.json' 2026-01-06T13:30:39,808 adding 'unitxt/catalog/cards/amazon_mass/hu_HU.json' 2026-01-06T13:30:39,810 adding 'unitxt/catalog/cards/amazon_mass/hy_AM.json' 2026-01-06T13:30:39,812 adding 'unitxt/catalog/cards/amazon_mass/id_ID.json' 2026-01-06T13:30:39,813 adding 'unitxt/catalog/cards/amazon_mass/is_IS.json' 2026-01-06T13:30:39,815 adding 'unitxt/catalog/cards/amazon_mass/it_IT.json' 2026-01-06T13:30:39,817 adding 'unitxt/catalog/cards/amazon_mass/ja_JP.json' 2026-01-06T13:30:39,818 adding 'unitxt/catalog/cards/amazon_mass/jv_ID.json' 2026-01-06T13:30:39,820 adding 'unitxt/catalog/cards/amazon_mass/ka_GE.json' 2026-01-06T13:30:39,822 adding 'unitxt/catalog/cards/amazon_mass/km_KH.json' 2026-01-06T13:30:39,824 adding 'unitxt/catalog/cards/amazon_mass/kn_IN.json' 2026-01-06T13:30:39,825 adding 'unitxt/catalog/cards/amazon_mass/ko_KR.json' 2026-01-06T13:30:39,827 adding 'unitxt/catalog/cards/amazon_mass/lv_LV.json' 2026-01-06T13:30:39,828 adding 'unitxt/catalog/cards/amazon_mass/ml_IN.json' 2026-01-06T13:30:39,830 adding 'unitxt/catalog/cards/amazon_mass/mn_MN.json' 2026-01-06T13:30:39,832 adding 'unitxt/catalog/cards/amazon_mass/ms_MY.json' 2026-01-06T13:30:39,833 adding 'unitxt/catalog/cards/amazon_mass/my_MM.json' 2026-01-06T13:30:39,835 adding 'unitxt/catalog/cards/amazon_mass/nb_NO.json' 2026-01-06T13:30:39,836 adding 'unitxt/catalog/cards/amazon_mass/nl_NL.json' 2026-01-06T13:30:39,838 adding 'unitxt/catalog/cards/amazon_mass/pl_PL.json' 2026-01-06T13:30:39,840 adding 'unitxt/catalog/cards/amazon_mass/pt_PT.json' 2026-01-06T13:30:39,841 adding 'unitxt/catalog/cards/amazon_mass/ro_RO.json' 2026-01-06T13:30:39,843 adding 'unitxt/catalog/cards/amazon_mass/ru_RU.json' 2026-01-06T13:30:39,844 adding 'unitxt/catalog/cards/amazon_mass/sl_SL.json' 2026-01-06T13:30:39,846 adding 'unitxt/catalog/cards/amazon_mass/sq_AL.json' 2026-01-06T13:30:39,848 adding 'unitxt/catalog/cards/amazon_mass/sv_SE.json' 2026-01-06T13:30:39,849 adding 'unitxt/catalog/cards/amazon_mass/sw_KE.json' 2026-01-06T13:30:39,851 adding 'unitxt/catalog/cards/amazon_mass/ta_IN.json' 2026-01-06T13:30:39,852 adding 'unitxt/catalog/cards/amazon_mass/te_IN.json' 2026-01-06T13:30:39,854 adding 'unitxt/catalog/cards/amazon_mass/th_TH.json' 2026-01-06T13:30:39,855 adding 'unitxt/catalog/cards/amazon_mass/tl_PH.json' 2026-01-06T13:30:39,857 adding 'unitxt/catalog/cards/amazon_mass/tr_TR.json' 2026-01-06T13:30:39,859 adding 'unitxt/catalog/cards/amazon_mass/ur_PK.json' 2026-01-06T13:30:39,860 adding 'unitxt/catalog/cards/amazon_mass/vi_VN.json' 2026-01-06T13:30:39,862 adding 'unitxt/catalog/cards/amazon_mass/zh_CN.json' 2026-01-06T13:30:39,864 adding 'unitxt/catalog/cards/amazon_mass/zh_TW.json' 2026-01-06T13:30:39,866 adding 'unitxt/catalog/cards/amazon_mass/all_1/1.json' 2026-01-06T13:30:39,869 adding 'unitxt/catalog/cards/arena_hard/generation/english_gpt_4_0314_reference.json' 2026-01-06T13:30:39,871 adding 'unitxt/catalog/cards/arena_hard/response_assessment/pairwise_comparative_rating/both_games_gpt_4_judge.json' 2026-01-06T13:30:39,872 adding 'unitxt/catalog/cards/arena_hard/response_assessment/pairwise_comparative_rating/both_games_mean_judgment_gpt4_judge.json' 2026-01-06T13:30:39,873 adding 'unitxt/catalog/cards/arena_hard/response_assessment/pairwise_comparative_rating/first_game_only_gpt_4_judge.json' 2026-01-06T13:30:39,875 adding 'unitxt/catalog/cards/babi/qa.json' 2026-01-06T13:30:39,879 adding 'unitxt/catalog/cards/belebele/acm_arab.json' 2026-01-06T13:30:39,881 adding 'unitxt/catalog/cards/belebele/afr_latn.json' 2026-01-06T13:30:39,882 adding 'unitxt/catalog/cards/belebele/als_latn.json' 2026-01-06T13:30:39,884 adding 'unitxt/catalog/cards/belebele/amh_ethi.json' 2026-01-06T13:30:39,885 adding 'unitxt/catalog/cards/belebele/apc_arab.json' 2026-01-06T13:30:39,886 adding 'unitxt/catalog/cards/belebele/arb_arab.json' 2026-01-06T13:30:39,888 adding 'unitxt/catalog/cards/belebele/arb_latn.json' 2026-01-06T13:30:39,889 adding 'unitxt/catalog/cards/belebele/ars_arab.json' 2026-01-06T13:30:39,890 adding 'unitxt/catalog/cards/belebele/ary_arab.json' 2026-01-06T13:30:39,892 adding 'unitxt/catalog/cards/belebele/arz_arab.json' 2026-01-06T13:30:39,893 adding 'unitxt/catalog/cards/belebele/asm_beng.json' 2026-01-06T13:30:39,894 adding 'unitxt/catalog/cards/belebele/azj_latn.json' 2026-01-06T13:30:39,896 adding 'unitxt/catalog/cards/belebele/bam_latn.json' 2026-01-06T13:30:39,897 adding 'unitxt/catalog/cards/belebele/ben_beng.json' 2026-01-06T13:30:39,898 adding 'unitxt/catalog/cards/belebele/ben_latn.json' 2026-01-06T13:30:39,900 adding 'unitxt/catalog/cards/belebele/bod_tibt.json' 2026-01-06T13:30:39,901 adding 'unitxt/catalog/cards/belebele/bul_cyrl.json' 2026-01-06T13:30:39,902 adding 'unitxt/catalog/cards/belebele/cat_latn.json' 2026-01-06T13:30:39,904 adding 'unitxt/catalog/cards/belebele/ceb_latn.json' 2026-01-06T13:30:39,905 adding 'unitxt/catalog/cards/belebele/ces_latn.json' 2026-01-06T13:30:39,906 adding 'unitxt/catalog/cards/belebele/ckb_arab.json' 2026-01-06T13:30:39,908 adding 'unitxt/catalog/cards/belebele/dan_latn.json' 2026-01-06T13:30:39,909 adding 'unitxt/catalog/cards/belebele/deu_latn.json' 2026-01-06T13:30:39,910 adding 'unitxt/catalog/cards/belebele/ell_grek.json' 2026-01-06T13:30:39,912 adding 'unitxt/catalog/cards/belebele/eng_latn.json' 2026-01-06T13:30:39,913 adding 'unitxt/catalog/cards/belebele/est_latn.json' 2026-01-06T13:30:39,914 adding 'unitxt/catalog/cards/belebele/eus_latn.json' 2026-01-06T13:30:39,916 adding 'unitxt/catalog/cards/belebele/fin_latn.json' 2026-01-06T13:30:39,917 adding 'unitxt/catalog/cards/belebele/fra_latn.json' 2026-01-06T13:30:39,919 adding 'unitxt/catalog/cards/belebele/fuv_latn.json' 2026-01-06T13:30:39,920 adding 'unitxt/catalog/cards/belebele/gaz_latn.json' 2026-01-06T13:30:39,921 adding 'unitxt/catalog/cards/belebele/grn_latn.json' 2026-01-06T13:30:39,923 adding 'unitxt/catalog/cards/belebele/guj_gujr.json' 2026-01-06T13:30:39,924 adding 'unitxt/catalog/cards/belebele/hat_latn.json' 2026-01-06T13:30:39,925 adding 'unitxt/catalog/cards/belebele/hau_latn.json' 2026-01-06T13:30:39,927 adding 'unitxt/catalog/cards/belebele/heb_hebr.json' 2026-01-06T13:30:39,928 adding 'unitxt/catalog/cards/belebele/hin_deva.json' 2026-01-06T13:30:39,930 adding 'unitxt/catalog/cards/belebele/hin_latn.json' 2026-01-06T13:30:39,931 adding 'unitxt/catalog/cards/belebele/hrv_latn.json' 2026-01-06T13:30:39,932 adding 'unitxt/catalog/cards/belebele/hun_latn.json' 2026-01-06T13:30:39,934 adding 'unitxt/catalog/cards/belebele/hye_armn.json' 2026-01-06T13:30:39,935 adding 'unitxt/catalog/cards/belebele/ibo_latn.json' 2026-01-06T13:30:39,937 adding 'unitxt/catalog/cards/belebele/ilo_latn.json' 2026-01-06T13:30:39,938 adding 'unitxt/catalog/cards/belebele/ind_latn.json' 2026-01-06T13:30:39,939 adding 'unitxt/catalog/cards/belebele/isl_latn.json' 2026-01-06T13:30:39,941 adding 'unitxt/catalog/cards/belebele/ita_latn.json' 2026-01-06T13:30:39,942 adding 'unitxt/catalog/cards/belebele/jav_latn.json' 2026-01-06T13:30:39,943 adding 'unitxt/catalog/cards/belebele/jpn_jpan.json' 2026-01-06T13:30:39,945 adding 'unitxt/catalog/cards/belebele/kac_latn.json' 2026-01-06T13:30:39,946 adding 'unitxt/catalog/cards/belebele/kan_knda.json' 2026-01-06T13:30:39,948 adding 'unitxt/catalog/cards/belebele/kat_geor.json' 2026-01-06T13:30:39,949 adding 'unitxt/catalog/cards/belebele/kaz_cyrl.json' 2026-01-06T13:30:39,950 adding 'unitxt/catalog/cards/belebele/kea_latn.json' 2026-01-06T13:30:39,952 adding 'unitxt/catalog/cards/belebele/khk_cyrl.json' 2026-01-06T13:30:39,953 adding 'unitxt/catalog/cards/belebele/khm_khmr.json' 2026-01-06T13:30:39,954 adding 'unitxt/catalog/cards/belebele/kin_latn.json' 2026-01-06T13:30:39,956 adding 'unitxt/catalog/cards/belebele/kir_cyrl.json' 2026-01-06T13:30:39,957 adding 'unitxt/catalog/cards/belebele/kor_hang.json' 2026-01-06T13:30:39,958 adding 'unitxt/catalog/cards/belebele/lao_laoo.json' 2026-01-06T13:30:39,960 adding 'unitxt/catalog/cards/belebele/lin_latn.json' 2026-01-06T13:30:39,961 adding 'unitxt/catalog/cards/belebele/lit_latn.json' 2026-01-06T13:30:39,962 adding 'unitxt/catalog/cards/belebele/lug_latn.json' 2026-01-06T13:30:39,963 adding 'unitxt/catalog/cards/belebele/luo_latn.json' 2026-01-06T13:30:39,965 adding 'unitxt/catalog/cards/belebele/lvs_latn.json' 2026-01-06T13:30:39,966 adding 'unitxt/catalog/cards/belebele/mal_mlym.json' 2026-01-06T13:30:39,967 adding 'unitxt/catalog/cards/belebele/mar_deva.json' 2026-01-06T13:30:39,969 adding 'unitxt/catalog/cards/belebele/mkd_cyrl.json' 2026-01-06T13:30:39,970 adding 'unitxt/catalog/cards/belebele/mlt_latn.json' 2026-01-06T13:30:39,971 adding 'unitxt/catalog/cards/belebele/mri_latn.json' 2026-01-06T13:30:39,972 adding 'unitxt/catalog/cards/belebele/mya_mymr.json' 2026-01-06T13:30:39,974 adding 'unitxt/catalog/cards/belebele/nld_latn.json' 2026-01-06T13:30:39,975 adding 'unitxt/catalog/cards/belebele/nob_latn.json' 2026-01-06T13:30:39,977 adding 'unitxt/catalog/cards/belebele/npi_deva.json' 2026-01-06T13:30:39,978 adding 'unitxt/catalog/cards/belebele/npi_latn.json' 2026-01-06T13:30:39,979 adding 'unitxt/catalog/cards/belebele/nso_latn.json' 2026-01-06T13:30:39,980 adding 'unitxt/catalog/cards/belebele/nya_latn.json' 2026-01-06T13:30:39,982 adding 'unitxt/catalog/cards/belebele/ory_orya.json' 2026-01-06T13:30:39,983 adding 'unitxt/catalog/cards/belebele/pan_guru.json' 2026-01-06T13:30:39,984 adding 'unitxt/catalog/cards/belebele/pbt_arab.json' 2026-01-06T13:30:39,986 adding 'unitxt/catalog/cards/belebele/pes_arab.json' 2026-01-06T13:30:39,987 adding 'unitxt/catalog/cards/belebele/plt_latn.json' 2026-01-06T13:30:39,988 adding 'unitxt/catalog/cards/belebele/pol_latn.json' 2026-01-06T13:30:39,990 adding 'unitxt/catalog/cards/belebele/por_latn.json' 2026-01-06T13:30:39,991 adding 'unitxt/catalog/cards/belebele/ron_latn.json' 2026-01-06T13:30:39,992 adding 'unitxt/catalog/cards/belebele/rus_cyrl.json' 2026-01-06T13:30:39,994 adding 'unitxt/catalog/cards/belebele/shn_mymr.json' 2026-01-06T13:30:39,995 adding 'unitxt/catalog/cards/belebele/sin_latn.json' 2026-01-06T13:30:39,996 adding 'unitxt/catalog/cards/belebele/sin_sinh.json' 2026-01-06T13:30:39,998 adding 'unitxt/catalog/cards/belebele/slk_latn.json' 2026-01-06T13:30:39,999 adding 'unitxt/catalog/cards/belebele/slv_latn.json' 2026-01-06T13:30:40,000 adding 'unitxt/catalog/cards/belebele/sna_latn.json' 2026-01-06T13:30:40,002 adding 'unitxt/catalog/cards/belebele/snd_arab.json' 2026-01-06T13:30:40,003 adding 'unitxt/catalog/cards/belebele/som_latn.json' 2026-01-06T13:30:40,004 adding 'unitxt/catalog/cards/belebele/sot_latn.json' 2026-01-06T13:30:40,006 adding 'unitxt/catalog/cards/belebele/spa_latn.json' 2026-01-06T13:30:40,007 adding 'unitxt/catalog/cards/belebele/srp_cyrl.json' 2026-01-06T13:30:40,008 adding 'unitxt/catalog/cards/belebele/ssw_latn.json' 2026-01-06T13:30:40,010 adding 'unitxt/catalog/cards/belebele/sun_latn.json' 2026-01-06T13:30:40,011 adding 'unitxt/catalog/cards/belebele/swe_latn.json' 2026-01-06T13:30:40,013 adding 'unitxt/catalog/cards/belebele/swh_latn.json' 2026-01-06T13:30:40,014 adding 'unitxt/catalog/cards/belebele/tam_taml.json' 2026-01-06T13:30:40,015 adding 'unitxt/catalog/cards/belebele/tel_telu.json' 2026-01-06T13:30:40,017 adding 'unitxt/catalog/cards/belebele/tgk_cyrl.json' 2026-01-06T13:30:40,018 adding 'unitxt/catalog/cards/belebele/tgl_latn.json' 2026-01-06T13:30:40,019 adding 'unitxt/catalog/cards/belebele/tha_thai.json' 2026-01-06T13:30:40,021 adding 'unitxt/catalog/cards/belebele/tir_ethi.json' 2026-01-06T13:30:40,022 adding 'unitxt/catalog/cards/belebele/tsn_latn.json' 2026-01-06T13:30:40,023 adding 'unitxt/catalog/cards/belebele/tso_latn.json' 2026-01-06T13:30:40,025 adding 'unitxt/catalog/cards/belebele/tur_latn.json' 2026-01-06T13:30:40,026 adding 'unitxt/catalog/cards/belebele/ukr_cyrl.json' 2026-01-06T13:30:40,027 adding 'unitxt/catalog/cards/belebele/urd_arab.json' 2026-01-06T13:30:40,029 adding 'unitxt/catalog/cards/belebele/urd_latn.json' 2026-01-06T13:30:40,030 adding 'unitxt/catalog/cards/belebele/uzn_latn.json' 2026-01-06T13:30:40,031 adding 'unitxt/catalog/cards/belebele/vie_latn.json' 2026-01-06T13:30:40,032 adding 'unitxt/catalog/cards/belebele/war_latn.json' 2026-01-06T13:30:40,034 adding 'unitxt/catalog/cards/belebele/wol_latn.json' 2026-01-06T13:30:40,035 adding 'unitxt/catalog/cards/belebele/xho_latn.json' 2026-01-06T13:30:40,036 adding 'unitxt/catalog/cards/belebele/yor_latn.json' 2026-01-06T13:30:40,037 adding 'unitxt/catalog/cards/belebele/zho_hans.json' 2026-01-06T13:30:40,039 adding 'unitxt/catalog/cards/belebele/zho_hant.json' 2026-01-06T13:30:40,040 adding 'unitxt/catalog/cards/belebele/zsm_latn.json' 2026-01-06T13:30:40,042 adding 'unitxt/catalog/cards/belebele/zul_latn.json' 2026-01-06T13:30:40,043 adding 'unitxt/catalog/cards/bfcl/simple_v3.json' 2026-01-06T13:30:40,045 adding 'unitxt/catalog/cards/bfcl/multi_turn/java_v3.json' 2026-01-06T13:30:40,046 adding 'unitxt/catalog/cards/bfcl/multi_turn/javascript_v3.json' 2026-01-06T13:30:40,048 adding 'unitxt/catalog/cards/bfcl/multi_turn/live_irrelevance_v3.json' 2026-01-06T13:30:40,049 adding 'unitxt/catalog/cards/bfcl/multi_turn/live_multiple_v3.json' 2026-01-06T13:30:40,050 adding 'unitxt/catalog/cards/bfcl/multi_turn/live_parallel_multiple_v3.json' 2026-01-06T13:30:40,052 adding 'unitxt/catalog/cards/bfcl/multi_turn/live_parallel_v3.json' 2026-01-06T13:30:40,053 adding 'unitxt/catalog/cards/bfcl/multi_turn/live_relevance_v3.json' 2026-01-06T13:30:40,054 adding 'unitxt/catalog/cards/bfcl/multi_turn/live_simple_v3.json' 2026-01-06T13:30:40,056 adding 'unitxt/catalog/cards/bfcl/multi_turn/multiple_v3.json' 2026-01-06T13:30:40,057 adding 'unitxt/catalog/cards/bfcl/multi_turn/parallel_multiple_v3.json' 2026-01-06T13:30:40,058 adding 'unitxt/catalog/cards/bfcl/multi_turn/parallel_v3.json' 2026-01-06T13:30:40,060 adding 'unitxt/catalog/cards/bfcl/multi_turn/simple_v3.json' 2026-01-06T13:30:40,062 adding 'unitxt/catalog/cards/biggen_bench/results/human_eval.json' 2026-01-06T13:30:40,064 adding 'unitxt/catalog/cards/boolq/classification.json' 2026-01-06T13:30:40,065 adding 'unitxt/catalog/cards/boolq/multiple_choice.json' 2026-01-06T13:30:40,068 adding 'unitxt/catalog/cards/boolq_indic/bn/classification.json' 2026-01-06T13:30:40,069 adding 'unitxt/catalog/cards/boolq_indic/bn/multiple_choice.json' 2026-01-06T13:30:40,071 adding 'unitxt/catalog/cards/boolq_indic/gu/classification.json' 2026-01-06T13:30:40,072 adding 'unitxt/catalog/cards/boolq_indic/gu/multiple_choice.json' 2026-01-06T13:30:40,074 adding 'unitxt/catalog/cards/boolq_indic/hi/classification.json' 2026-01-06T13:30:40,075 adding 'unitxt/catalog/cards/boolq_indic/hi/multiple_choice.json' 2026-01-06T13:30:40,077 adding 'unitxt/catalog/cards/boolq_indic/kn/classification.json' 2026-01-06T13:30:40,078 adding 'unitxt/catalog/cards/boolq_indic/kn/multiple_choice.json' 2026-01-06T13:30:40,080 adding 'unitxt/catalog/cards/boolq_indic/ml/classification.json' 2026-01-06T13:30:40,082 adding 'unitxt/catalog/cards/boolq_indic/ml/multiple_choice.json' 2026-01-06T13:30:40,083 adding 'unitxt/catalog/cards/boolq_indic/mr/classification.json' 2026-01-06T13:30:40,085 adding 'unitxt/catalog/cards/boolq_indic/mr/multiple_choice.json' 2026-01-06T13:30:40,086 adding 'unitxt/catalog/cards/boolq_indic/or/classification.json' 2026-01-06T13:30:40,088 adding 'unitxt/catalog/cards/boolq_indic/or/multiple_choice.json' 2026-01-06T13:30:40,090 adding 'unitxt/catalog/cards/boolq_indic/pa/classification.json' 2026-01-06T13:30:40,091 adding 'unitxt/catalog/cards/boolq_indic/pa/multiple_choice.json' 2026-01-06T13:30:40,093 adding 'unitxt/catalog/cards/boolq_indic/ta/classification.json' 2026-01-06T13:30:40,094 adding 'unitxt/catalog/cards/boolq_indic/ta/multiple_choice.json' 2026-01-06T13:30:40,096 adding 'unitxt/catalog/cards/boolq_indic/te/classification.json' 2026-01-06T13:30:40,097 adding 'unitxt/catalog/cards/boolq_indic/te/multiple_choice.json' 2026-01-06T13:30:40,099 adding 'unitxt/catalog/cards/clinc_oos/imbalanced.json' 2026-01-06T13:30:40,101 adding 'unitxt/catalog/cards/clinc_oos/plus.json' 2026-01-06T13:30:40,103 adding 'unitxt/catalog/cards/clinc_oos/small.json' 2026-01-06T13:30:40,105 adding 'unitxt/catalog/cards/coedit/paraphrase.json' 2026-01-06T13:30:40,106 adding 'unitxt/catalog/cards/coedit/preference.json' 2026-01-06T13:30:40,107 adding 'unitxt/catalog/cards/coedit/rewriting.json' 2026-01-06T13:30:40,109 adding 'unitxt/catalog/cards/coedit/selection.json' 2026-01-06T13:30:40,111 adding 'unitxt/catalog/cards/cohere_for_ai/aya_human_annotated/arb.json' 2026-01-06T13:30:40,112 adding 'unitxt/catalog/cards/cohere_for_ai/aya_human_annotated/eng.json' 2026-01-06T13:30:40,114 adding 'unitxt/catalog/cards/cohere_for_ai/aya_human_annotated/por.json' 2026-01-06T13:30:40,115 adding 'unitxt/catalog/cards/cohere_for_ai/aya_human_annotated/tel.json' 2026-01-06T13:30:40,116 adding 'unitxt/catalog/cards/cohere_for_ai/aya_human_annotated/tur.json' 2026-01-06T13:30:40,118 adding 'unitxt/catalog/cards/cohere_for_ai/aya_human_annotated/yor.json' 2026-01-06T13:30:40,119 adding 'unitxt/catalog/cards/cohere_for_ai/aya_human_annotated/zho.json' 2026-01-06T13:30:40,121 adding 'unitxt/catalog/cards/cohere_for_ai/dolly_human_edited/fra.json' 2026-01-06T13:30:40,122 adding 'unitxt/catalog/cards/cohere_for_ai/dolly_human_edited/spa.json' 2026-01-06T13:30:40,124 adding 'unitxt/catalog/cards/cohere_for_ai/dolly_machine_translated/deu.json' 2026-01-06T13:30:40,126 adding 'unitxt/catalog/cards/cohere_for_ai/dolly_machine_translated/eng.json' 2026-01-06T13:30:40,127 adding 'unitxt/catalog/cards/cohere_for_ai/dolly_machine_translated/fra.json' 2026-01-06T13:30:40,129 adding 'unitxt/catalog/cards/cohere_for_ai/dolly_machine_translated/jpn.json' 2026-01-06T13:30:40,130 adding 'unitxt/catalog/cards/cohere_for_ai/dolly_machine_translated/por.json' 2026-01-06T13:30:40,131 adding 'unitxt/catalog/cards/cohere_for_ai/dolly_machine_translated/spa.json' 2026-01-06T13:30:40,133 adding 'unitxt/catalog/cards/coqa/completion.json' 2026-01-06T13:30:40,135 adding 'unitxt/catalog/cards/coqa/multi_turn.json' 2026-01-06T13:30:40,136 adding 'unitxt/catalog/cards/coqa/qa.json' 2026-01-06T13:30:40,138 adding 'unitxt/catalog/cards/doc_vqa/en.json' 2026-01-06T13:30:40,139 adding 'unitxt/catalog/cards/doc_vqa/fr.json' 2026-01-06T13:30:40,140 adding 'unitxt/catalog/cards/doc_vqa/lmms_eval.json' 2026-01-06T13:30:40,143 adding 'unitxt/catalog/cards/dynamic_cards_for_llm_judges/pairwise_comparative_rating/single_turn.json' 2026-01-06T13:30:40,144 adding 'unitxt/catalog/cards/dynamic_cards_for_llm_judges/rating/single_turn.json' 2026-01-06T13:30:40,145 adding 'unitxt/catalog/cards/dynamic_cards_for_llm_judges/rating/single_turn_with_reference.json' 2026-01-06T13:30:40,147 adding 'unitxt/catalog/cards/ffqa_filtered/16k.json' 2026-01-06T13:30:40,149 adding 'unitxt/catalog/cards/ffqa_filtered/2k.json' 2026-01-06T13:30:40,150 adding 'unitxt/catalog/cards/ffqa_filtered/4k.json' 2026-01-06T13:30:40,152 adding 'unitxt/catalog/cards/ffqa_filtered/8k.json' 2026-01-06T13:30:40,156 adding 'unitxt/catalog/cards/global_mmlu/am/abstract_algebra.json' 2026-01-06T13:30:40,157 adding 'unitxt/catalog/cards/global_mmlu/am/anatomy.json' 2026-01-06T13:30:40,159 adding 'unitxt/catalog/cards/global_mmlu/am/astronomy.json' 2026-01-06T13:30:40,160 adding 'unitxt/catalog/cards/global_mmlu/am/business_ethics.json' 2026-01-06T13:30:40,162 adding 'unitxt/catalog/cards/global_mmlu/am/clinical_knowledge.json' 2026-01-06T13:30:40,163 adding 'unitxt/catalog/cards/global_mmlu/am/college_biology.json' 2026-01-06T13:30:40,165 adding 'unitxt/catalog/cards/global_mmlu/am/college_chemistry.json' 2026-01-06T13:30:40,166 adding 'unitxt/catalog/cards/global_mmlu/am/college_computer_science.json' 2026-01-06T13:30:40,168 adding 'unitxt/catalog/cards/global_mmlu/am/college_mathematics.json' 2026-01-06T13:30:40,169 adding 'unitxt/catalog/cards/global_mmlu/am/college_medicine.json' 2026-01-06T13:30:40,170 adding 'unitxt/catalog/cards/global_mmlu/am/college_physics.json' 2026-01-06T13:30:40,172 adding 'unitxt/catalog/cards/global_mmlu/am/computer_security.json' 2026-01-06T13:30:40,173 adding 'unitxt/catalog/cards/global_mmlu/am/conceptual_physics.json' 2026-01-06T13:30:40,175 adding 'unitxt/catalog/cards/global_mmlu/am/econometrics.json' 2026-01-06T13:30:40,176 adding 'unitxt/catalog/cards/global_mmlu/am/electrical_engineering.json' 2026-01-06T13:30:40,177 adding 'unitxt/catalog/cards/global_mmlu/am/elementary_mathematics.json' 2026-01-06T13:30:40,179 adding 'unitxt/catalog/cards/global_mmlu/am/formal_logic.json' 2026-01-06T13:30:40,180 adding 'unitxt/catalog/cards/global_mmlu/am/global_facts.json' 2026-01-06T13:30:40,181 adding 'unitxt/catalog/cards/global_mmlu/am/high_school_biology.json' 2026-01-06T13:30:40,183 adding 'unitxt/catalog/cards/global_mmlu/am/high_school_chemistry.json' 2026-01-06T13:30:40,184 adding 'unitxt/catalog/cards/global_mmlu/am/high_school_computer_science.json' 2026-01-06T13:30:40,186 adding 'unitxt/catalog/cards/global_mmlu/am/high_school_european_history.json' 2026-01-06T13:30:40,187 adding 'unitxt/catalog/cards/global_mmlu/am/high_school_geography.json' 2026-01-06T13:30:40,189 adding 'unitxt/catalog/cards/global_mmlu/am/high_school_government_and_politics.json' 2026-01-06T13:30:40,190 adding 'unitxt/catalog/cards/global_mmlu/am/high_school_macroeconomics.json' 2026-01-06T13:30:40,192 adding 'unitxt/catalog/cards/global_mmlu/am/high_school_mathematics.json' 2026-01-06T13:30:40,193 adding 'unitxt/catalog/cards/global_mmlu/am/high_school_microeconomics.json' 2026-01-06T13:30:40,194 adding 'unitxt/catalog/cards/global_mmlu/am/high_school_physics.json' 2026-01-06T13:30:40,196 adding 'unitxt/catalog/cards/global_mmlu/am/high_school_psychology.json' 2026-01-06T13:30:40,197 adding 'unitxt/catalog/cards/global_mmlu/am/high_school_statistics.json' 2026-01-06T13:30:40,198 adding 'unitxt/catalog/cards/global_mmlu/am/high_school_us_history.json' 2026-01-06T13:30:40,200 adding 'unitxt/catalog/cards/global_mmlu/am/high_school_world_history.json' 2026-01-06T13:30:40,201 adding 'unitxt/catalog/cards/global_mmlu/am/human_aging.json' 2026-01-06T13:30:40,202 adding 'unitxt/catalog/cards/global_mmlu/am/human_sexuality.json' 2026-01-06T13:30:40,204 adding 'unitxt/catalog/cards/global_mmlu/am/international_law.json' 2026-01-06T13:30:40,205 adding 'unitxt/catalog/cards/global_mmlu/am/jurisprudence.json' 2026-01-06T13:30:40,206 adding 'unitxt/catalog/cards/global_mmlu/am/logical_fallacies.json' 2026-01-06T13:30:40,208 adding 'unitxt/catalog/cards/global_mmlu/am/machine_learning.json' 2026-01-06T13:30:40,209 adding 'unitxt/catalog/cards/global_mmlu/am/management.json' 2026-01-06T13:30:40,210 adding 'unitxt/catalog/cards/global_mmlu/am/marketing.json' 2026-01-06T13:30:40,212 adding 'unitxt/catalog/cards/global_mmlu/am/medical_genetics.json' 2026-01-06T13:30:40,213 adding 'unitxt/catalog/cards/global_mmlu/am/miscellaneous.json' 2026-01-06T13:30:40,214 adding 'unitxt/catalog/cards/global_mmlu/am/moral_disputes.json' 2026-01-06T13:30:40,216 adding 'unitxt/catalog/cards/global_mmlu/am/moral_scenarios.json' 2026-01-06T13:30:40,217 adding 'unitxt/catalog/cards/global_mmlu/am/nutrition.json' 2026-01-06T13:30:40,219 adding 'unitxt/catalog/cards/global_mmlu/am/philosophy.json' 2026-01-06T13:30:40,220 adding 'unitxt/catalog/cards/global_mmlu/am/prehistory.json' 2026-01-06T13:30:40,221 adding 'unitxt/catalog/cards/global_mmlu/am/professional_accounting.json' 2026-01-06T13:30:40,223 adding 'unitxt/catalog/cards/global_mmlu/am/professional_law.json' 2026-01-06T13:30:40,224 adding 'unitxt/catalog/cards/global_mmlu/am/professional_medicine.json' 2026-01-06T13:30:40,225 adding 'unitxt/catalog/cards/global_mmlu/am/professional_psychology.json' 2026-01-06T13:30:40,226 adding 'unitxt/catalog/cards/global_mmlu/am/public_relations.json' 2026-01-06T13:30:40,228 adding 'unitxt/catalog/cards/global_mmlu/am/security_studies.json' 2026-01-06T13:30:40,229 adding 'unitxt/catalog/cards/global_mmlu/am/sociology.json' 2026-01-06T13:30:40,230 adding 'unitxt/catalog/cards/global_mmlu/am/us_foreign_policy.json' 2026-01-06T13:30:40,231 adding 'unitxt/catalog/cards/global_mmlu/am/virology.json' 2026-01-06T13:30:40,233 adding 'unitxt/catalog/cards/global_mmlu/am/world_religions.json' 2026-01-06T13:30:40,235 adding 'unitxt/catalog/cards/global_mmlu/ar/abstract_algebra.json' 2026-01-06T13:30:40,237 adding 'unitxt/catalog/cards/global_mmlu/ar/anatomy.json' 2026-01-06T13:30:40,238 adding 'unitxt/catalog/cards/global_mmlu/ar/astronomy.json' 2026-01-06T13:30:40,239 adding 'unitxt/catalog/cards/global_mmlu/ar/business_ethics.json' 2026-01-06T13:30:40,241 adding 'unitxt/catalog/cards/global_mmlu/ar/clinical_knowledge.json' 2026-01-06T13:30:40,242 adding 'unitxt/catalog/cards/global_mmlu/ar/college_biology.json' 2026-01-06T13:30:40,243 adding 'unitxt/catalog/cards/global_mmlu/ar/college_chemistry.json' 2026-01-06T13:30:40,245 adding 'unitxt/catalog/cards/global_mmlu/ar/college_computer_science.json' 2026-01-06T13:30:40,246 adding 'unitxt/catalog/cards/global_mmlu/ar/college_mathematics.json' 2026-01-06T13:30:40,247 adding 'unitxt/catalog/cards/global_mmlu/ar/college_medicine.json' 2026-01-06T13:30:40,248 adding 'unitxt/catalog/cards/global_mmlu/ar/college_physics.json' 2026-01-06T13:30:40,250 adding 'unitxt/catalog/cards/global_mmlu/ar/computer_security.json' 2026-01-06T13:30:40,251 adding 'unitxt/catalog/cards/global_mmlu/ar/conceptual_physics.json' 2026-01-06T13:30:40,252 adding 'unitxt/catalog/cards/global_mmlu/ar/econometrics.json' 2026-01-06T13:30:40,254 adding 'unitxt/catalog/cards/global_mmlu/ar/electrical_engineering.json' 2026-01-06T13:30:40,255 adding 'unitxt/catalog/cards/global_mmlu/ar/elementary_mathematics.json' 2026-01-06T13:30:40,256 adding 'unitxt/catalog/cards/global_mmlu/ar/formal_logic.json' 2026-01-06T13:30:40,258 adding 'unitxt/catalog/cards/global_mmlu/ar/global_facts.json' 2026-01-06T13:30:40,259 adding 'unitxt/catalog/cards/global_mmlu/ar/high_school_biology.json' 2026-01-06T13:30:40,260 adding 'unitxt/catalog/cards/global_mmlu/ar/high_school_chemistry.json' 2026-01-06T13:30:40,261 adding 'unitxt/catalog/cards/global_mmlu/ar/high_school_computer_science.json' 2026-01-06T13:30:40,263 adding 'unitxt/catalog/cards/global_mmlu/ar/high_school_european_history.json' 2026-01-06T13:30:40,264 adding 'unitxt/catalog/cards/global_mmlu/ar/high_school_geography.json' 2026-01-06T13:30:40,265 adding 'unitxt/catalog/cards/global_mmlu/ar/high_school_government_and_politics.json' 2026-01-06T13:30:40,267 adding 'unitxt/catalog/cards/global_mmlu/ar/high_school_macroeconomics.json' 2026-01-06T13:30:40,268 adding 'unitxt/catalog/cards/global_mmlu/ar/high_school_mathematics.json' 2026-01-06T13:30:40,270 adding 'unitxt/catalog/cards/global_mmlu/ar/high_school_microeconomics.json' 2026-01-06T13:30:40,271 adding 'unitxt/catalog/cards/global_mmlu/ar/high_school_physics.json' 2026-01-06T13:30:40,272 adding 'unitxt/catalog/cards/global_mmlu/ar/high_school_psychology.json' 2026-01-06T13:30:40,274 adding 'unitxt/catalog/cards/global_mmlu/ar/high_school_statistics.json' 2026-01-06T13:30:40,275 adding 'unitxt/catalog/cards/global_mmlu/ar/high_school_us_history.json' 2026-01-06T13:30:40,276 adding 'unitxt/catalog/cards/global_mmlu/ar/high_school_world_history.json' 2026-01-06T13:30:40,278 adding 'unitxt/catalog/cards/global_mmlu/ar/human_aging.json' 2026-01-06T13:30:40,279 adding 'unitxt/catalog/cards/global_mmlu/ar/human_sexuality.json' 2026-01-06T13:30:40,280 adding 'unitxt/catalog/cards/global_mmlu/ar/international_law.json' 2026-01-06T13:30:40,282 adding 'unitxt/catalog/cards/global_mmlu/ar/jurisprudence.json' 2026-01-06T13:30:40,283 adding 'unitxt/catalog/cards/global_mmlu/ar/logical_fallacies.json' 2026-01-06T13:30:40,284 adding 'unitxt/catalog/cards/global_mmlu/ar/machine_learning.json' 2026-01-06T13:30:40,286 adding 'unitxt/catalog/cards/global_mmlu/ar/management.json' 2026-01-06T13:30:40,287 adding 'unitxt/catalog/cards/global_mmlu/ar/marketing.json' 2026-01-06T13:30:40,288 adding 'unitxt/catalog/cards/global_mmlu/ar/medical_genetics.json' 2026-01-06T13:30:40,289 adding 'unitxt/catalog/cards/global_mmlu/ar/miscellaneous.json' 2026-01-06T13:30:40,291 adding 'unitxt/catalog/cards/global_mmlu/ar/moral_disputes.json' 2026-01-06T13:30:40,292 adding 'unitxt/catalog/cards/global_mmlu/ar/moral_scenarios.json' 2026-01-06T13:30:40,293 adding 'unitxt/catalog/cards/global_mmlu/ar/nutrition.json' 2026-01-06T13:30:40,294 adding 'unitxt/catalog/cards/global_mmlu/ar/philosophy.json' 2026-01-06T13:30:40,296 adding 'unitxt/catalog/cards/global_mmlu/ar/prehistory.json' 2026-01-06T13:30:40,297 adding 'unitxt/catalog/cards/global_mmlu/ar/professional_accounting.json' 2026-01-06T13:30:40,299 adding 'unitxt/catalog/cards/global_mmlu/ar/professional_law.json' 2026-01-06T13:30:40,300 adding 'unitxt/catalog/cards/global_mmlu/ar/professional_medicine.json' 2026-01-06T13:30:40,301 adding 'unitxt/catalog/cards/global_mmlu/ar/professional_psychology.json' 2026-01-06T13:30:40,303 adding 'unitxt/catalog/cards/global_mmlu/ar/public_relations.json' 2026-01-06T13:30:40,304 adding 'unitxt/catalog/cards/global_mmlu/ar/security_studies.json' 2026-01-06T13:30:40,305 adding 'unitxt/catalog/cards/global_mmlu/ar/sociology.json' 2026-01-06T13:30:40,306 adding 'unitxt/catalog/cards/global_mmlu/ar/us_foreign_policy.json' 2026-01-06T13:30:40,308 adding 'unitxt/catalog/cards/global_mmlu/ar/virology.json' 2026-01-06T13:30:40,309 adding 'unitxt/catalog/cards/global_mmlu/ar/world_religions.json' 2026-01-06T13:30:40,312 adding 'unitxt/catalog/cards/global_mmlu/bn/abstract_algebra.json' 2026-01-06T13:30:40,313 adding 'unitxt/catalog/cards/global_mmlu/bn/anatomy.json' 2026-01-06T13:30:40,314 adding 'unitxt/catalog/cards/global_mmlu/bn/astronomy.json' 2026-01-06T13:30:40,316 adding 'unitxt/catalog/cards/global_mmlu/bn/business_ethics.json' 2026-01-06T13:30:40,317 adding 'unitxt/catalog/cards/global_mmlu/bn/clinical_knowledge.json' 2026-01-06T13:30:40,319 adding 'unitxt/catalog/cards/global_mmlu/bn/college_biology.json' 2026-01-06T13:30:40,320 adding 'unitxt/catalog/cards/global_mmlu/bn/college_chemistry.json' 2026-01-06T13:30:40,321 adding 'unitxt/catalog/cards/global_mmlu/bn/college_computer_science.json' 2026-01-06T13:30:40,323 adding 'unitxt/catalog/cards/global_mmlu/bn/college_mathematics.json' 2026-01-06T13:30:40,324 adding 'unitxt/catalog/cards/global_mmlu/bn/college_medicine.json' 2026-01-06T13:30:40,325 adding 'unitxt/catalog/cards/global_mmlu/bn/college_physics.json' 2026-01-06T13:30:40,327 adding 'unitxt/catalog/cards/global_mmlu/bn/computer_security.json' 2026-01-06T13:30:40,328 adding 'unitxt/catalog/cards/global_mmlu/bn/conceptual_physics.json' 2026-01-06T13:30:40,329 adding 'unitxt/catalog/cards/global_mmlu/bn/econometrics.json' 2026-01-06T13:30:40,331 adding 'unitxt/catalog/cards/global_mmlu/bn/electrical_engineering.json' 2026-01-06T13:30:40,332 adding 'unitxt/catalog/cards/global_mmlu/bn/elementary_mathematics.json' 2026-01-06T13:30:40,333 adding 'unitxt/catalog/cards/global_mmlu/bn/formal_logic.json' 2026-01-06T13:30:40,335 adding 'unitxt/catalog/cards/global_mmlu/bn/global_facts.json' 2026-01-06T13:30:40,336 adding 'unitxt/catalog/cards/global_mmlu/bn/high_school_biology.json' 2026-01-06T13:30:40,337 adding 'unitxt/catalog/cards/global_mmlu/bn/high_school_chemistry.json' 2026-01-06T13:30:40,339 adding 'unitxt/catalog/cards/global_mmlu/bn/high_school_computer_science.json' 2026-01-06T13:30:40,340 adding 'unitxt/catalog/cards/global_mmlu/bn/high_school_european_history.json' 2026-01-06T13:30:40,342 adding 'unitxt/catalog/cards/global_mmlu/bn/high_school_geography.json' 2026-01-06T13:30:40,343 adding 'unitxt/catalog/cards/global_mmlu/bn/high_school_government_and_politics.json' 2026-01-06T13:30:40,344 adding 'unitxt/catalog/cards/global_mmlu/bn/high_school_macroeconomics.json' 2026-01-06T13:30:40,346 adding 'unitxt/catalog/cards/global_mmlu/bn/high_school_mathematics.json' 2026-01-06T13:30:40,347 adding 'unitxt/catalog/cards/global_mmlu/bn/high_school_microeconomics.json' 2026-01-06T13:30:40,348 adding 'unitxt/catalog/cards/global_mmlu/bn/high_school_physics.json' 2026-01-06T13:30:40,350 adding 'unitxt/catalog/cards/global_mmlu/bn/high_school_psychology.json' 2026-01-06T13:30:40,351 adding 'unitxt/catalog/cards/global_mmlu/bn/high_school_statistics.json' 2026-01-06T13:30:40,352 adding 'unitxt/catalog/cards/global_mmlu/bn/high_school_us_history.json' 2026-01-06T13:30:40,354 adding 'unitxt/catalog/cards/global_mmlu/bn/high_school_world_history.json' 2026-01-06T13:30:40,356 adding 'unitxt/catalog/cards/global_mmlu/bn/human_aging.json' 2026-01-06T13:30:40,357 adding 'unitxt/catalog/cards/global_mmlu/bn/human_sexuality.json' 2026-01-06T13:30:40,359 adding 'unitxt/catalog/cards/global_mmlu/bn/international_law.json' 2026-01-06T13:30:40,360 adding 'unitxt/catalog/cards/global_mmlu/bn/jurisprudence.json' 2026-01-06T13:30:40,362 adding 'unitxt/catalog/cards/global_mmlu/bn/logical_fallacies.json' 2026-01-06T13:30:40,363 adding 'unitxt/catalog/cards/global_mmlu/bn/machine_learning.json' 2026-01-06T13:30:40,364 adding 'unitxt/catalog/cards/global_mmlu/bn/management.json' 2026-01-06T13:30:40,366 adding 'unitxt/catalog/cards/global_mmlu/bn/marketing.json' 2026-01-06T13:30:40,367 adding 'unitxt/catalog/cards/global_mmlu/bn/medical_genetics.json' 2026-01-06T13:30:40,368 adding 'unitxt/catalog/cards/global_mmlu/bn/miscellaneous.json' 2026-01-06T13:30:40,370 adding 'unitxt/catalog/cards/global_mmlu/bn/moral_disputes.json' 2026-01-06T13:30:40,371 adding 'unitxt/catalog/cards/global_mmlu/bn/moral_scenarios.json' 2026-01-06T13:30:40,372 adding 'unitxt/catalog/cards/global_mmlu/bn/nutrition.json' 2026-01-06T13:30:40,373 adding 'unitxt/catalog/cards/global_mmlu/bn/philosophy.json' 2026-01-06T13:30:40,375 adding 'unitxt/catalog/cards/global_mmlu/bn/prehistory.json' 2026-01-06T13:30:40,376 adding 'unitxt/catalog/cards/global_mmlu/bn/professional_accounting.json' 2026-01-06T13:30:40,377 adding 'unitxt/catalog/cards/global_mmlu/bn/professional_law.json' 2026-01-06T13:30:40,379 adding 'unitxt/catalog/cards/global_mmlu/bn/professional_medicine.json' 2026-01-06T13:30:40,380 adding 'unitxt/catalog/cards/global_mmlu/bn/professional_psychology.json' 2026-01-06T13:30:40,381 adding 'unitxt/catalog/cards/global_mmlu/bn/public_relations.json' 2026-01-06T13:30:40,383 adding 'unitxt/catalog/cards/global_mmlu/bn/security_studies.json' 2026-01-06T13:30:40,384 adding 'unitxt/catalog/cards/global_mmlu/bn/sociology.json' 2026-01-06T13:30:40,386 adding 'unitxt/catalog/cards/global_mmlu/bn/us_foreign_policy.json' 2026-01-06T13:30:40,387 adding 'unitxt/catalog/cards/global_mmlu/bn/virology.json' 2026-01-06T13:30:40,388 adding 'unitxt/catalog/cards/global_mmlu/bn/world_religions.json' 2026-01-06T13:30:40,391 adding 'unitxt/catalog/cards/global_mmlu/cs/abstract_algebra.json' 2026-01-06T13:30:40,393 adding 'unitxt/catalog/cards/global_mmlu/cs/anatomy.json' 2026-01-06T13:30:40,394 adding 'unitxt/catalog/cards/global_mmlu/cs/astronomy.json' 2026-01-06T13:30:40,396 adding 'unitxt/catalog/cards/global_mmlu/cs/business_ethics.json' 2026-01-06T13:30:40,398 adding 'unitxt/catalog/cards/global_mmlu/cs/clinical_knowledge.json' 2026-01-06T13:30:40,400 adding 'unitxt/catalog/cards/global_mmlu/cs/college_biology.json' 2026-01-06T13:30:40,401 adding 'unitxt/catalog/cards/global_mmlu/cs/college_chemistry.json' 2026-01-06T13:30:40,403 adding 'unitxt/catalog/cards/global_mmlu/cs/college_computer_science.json' 2026-01-06T13:30:40,404 adding 'unitxt/catalog/cards/global_mmlu/cs/college_mathematics.json' 2026-01-06T13:30:40,405 adding 'unitxt/catalog/cards/global_mmlu/cs/college_medicine.json' 2026-01-06T13:30:40,407 adding 'unitxt/catalog/cards/global_mmlu/cs/college_physics.json' 2026-01-06T13:30:40,408 adding 'unitxt/catalog/cards/global_mmlu/cs/computer_security.json' 2026-01-06T13:30:40,411 adding 'unitxt/catalog/cards/global_mmlu/cs/conceptual_physics.json' 2026-01-06T13:30:40,413 adding 'unitxt/catalog/cards/global_mmlu/cs/econometrics.json' 2026-01-06T13:30:40,414 adding 'unitxt/catalog/cards/global_mmlu/cs/electrical_engineering.json' 2026-01-06T13:30:40,415 adding 'unitxt/catalog/cards/global_mmlu/cs/elementary_mathematics.json' 2026-01-06T13:30:40,416 adding 'unitxt/catalog/cards/global_mmlu/cs/formal_logic.json' 2026-01-06T13:30:40,418 adding 'unitxt/catalog/cards/global_mmlu/cs/global_facts.json' 2026-01-06T13:30:40,419 adding 'unitxt/catalog/cards/global_mmlu/cs/high_school_biology.json' 2026-01-06T13:30:40,420 adding 'unitxt/catalog/cards/global_mmlu/cs/high_school_chemistry.json' 2026-01-06T13:30:40,422 adding 'unitxt/catalog/cards/global_mmlu/cs/high_school_computer_science.json' 2026-01-06T13:30:40,423 adding 'unitxt/catalog/cards/global_mmlu/cs/high_school_european_history.json' 2026-01-06T13:30:40,424 adding 'unitxt/catalog/cards/global_mmlu/cs/high_school_geography.json' 2026-01-06T13:30:40,426 adding 'unitxt/catalog/cards/global_mmlu/cs/high_school_government_and_politics.json' 2026-01-06T13:30:40,427 adding 'unitxt/catalog/cards/global_mmlu/cs/high_school_macroeconomics.json' 2026-01-06T13:30:40,429 adding 'unitxt/catalog/cards/global_mmlu/cs/high_school_mathematics.json' 2026-01-06T13:30:40,430 adding 'unitxt/catalog/cards/global_mmlu/cs/high_school_microeconomics.json' 2026-01-06T13:30:40,431 adding 'unitxt/catalog/cards/global_mmlu/cs/high_school_physics.json' 2026-01-06T13:30:40,433 adding 'unitxt/catalog/cards/global_mmlu/cs/high_school_psychology.json' 2026-01-06T13:30:40,435 adding 'unitxt/catalog/cards/global_mmlu/cs/high_school_statistics.json' 2026-01-06T13:30:40,436 adding 'unitxt/catalog/cards/global_mmlu/cs/high_school_us_history.json' 2026-01-06T13:30:40,438 adding 'unitxt/catalog/cards/global_mmlu/cs/high_school_world_history.json' 2026-01-06T13:30:40,439 adding 'unitxt/catalog/cards/global_mmlu/cs/human_aging.json' 2026-01-06T13:30:40,441 adding 'unitxt/catalog/cards/global_mmlu/cs/human_sexuality.json' 2026-01-06T13:30:40,443 adding 'unitxt/catalog/cards/global_mmlu/cs/international_law.json' 2026-01-06T13:30:40,445 adding 'unitxt/catalog/cards/global_mmlu/cs/jurisprudence.json' 2026-01-06T13:30:40,446 adding 'unitxt/catalog/cards/global_mmlu/cs/logical_fallacies.json' 2026-01-06T13:30:40,447 adding 'unitxt/catalog/cards/global_mmlu/cs/machine_learning.json' 2026-01-06T13:30:40,449 adding 'unitxt/catalog/cards/global_mmlu/cs/management.json' 2026-01-06T13:30:40,450 adding 'unitxt/catalog/cards/global_mmlu/cs/marketing.json' 2026-01-06T13:30:40,451 adding 'unitxt/catalog/cards/global_mmlu/cs/medical_genetics.json' 2026-01-06T13:30:40,453 adding 'unitxt/catalog/cards/global_mmlu/cs/miscellaneous.json' 2026-01-06T13:30:40,454 adding 'unitxt/catalog/cards/global_mmlu/cs/moral_disputes.json' 2026-01-06T13:30:40,455 adding 'unitxt/catalog/cards/global_mmlu/cs/moral_scenarios.json' 2026-01-06T13:30:40,457 adding 'unitxt/catalog/cards/global_mmlu/cs/nutrition.json' 2026-01-06T13:30:40,458 adding 'unitxt/catalog/cards/global_mmlu/cs/philosophy.json' 2026-01-06T13:30:40,459 adding 'unitxt/catalog/cards/global_mmlu/cs/prehistory.json' 2026-01-06T13:30:40,461 adding 'unitxt/catalog/cards/global_mmlu/cs/professional_accounting.json' 2026-01-06T13:30:40,462 adding 'unitxt/catalog/cards/global_mmlu/cs/professional_law.json' 2026-01-06T13:30:40,463 adding 'unitxt/catalog/cards/global_mmlu/cs/professional_medicine.json' 2026-01-06T13:30:40,465 adding 'unitxt/catalog/cards/global_mmlu/cs/professional_psychology.json' 2026-01-06T13:30:40,466 adding 'unitxt/catalog/cards/global_mmlu/cs/public_relations.json' 2026-01-06T13:30:40,468 adding 'unitxt/catalog/cards/global_mmlu/cs/security_studies.json' 2026-01-06T13:30:40,469 adding 'unitxt/catalog/cards/global_mmlu/cs/sociology.json' 2026-01-06T13:30:40,470 adding 'unitxt/catalog/cards/global_mmlu/cs/us_foreign_policy.json' 2026-01-06T13:30:40,471 adding 'unitxt/catalog/cards/global_mmlu/cs/virology.json' 2026-01-06T13:30:40,473 adding 'unitxt/catalog/cards/global_mmlu/cs/world_religions.json' 2026-01-06T13:30:40,475 adding 'unitxt/catalog/cards/global_mmlu/de/abstract_algebra.json' 2026-01-06T13:30:40,477 adding 'unitxt/catalog/cards/global_mmlu/de/anatomy.json' 2026-01-06T13:30:40,478 adding 'unitxt/catalog/cards/global_mmlu/de/astronomy.json' 2026-01-06T13:30:40,479 adding 'unitxt/catalog/cards/global_mmlu/de/business_ethics.json' 2026-01-06T13:30:40,480 adding 'unitxt/catalog/cards/global_mmlu/de/clinical_knowledge.json' 2026-01-06T13:30:40,482 adding 'unitxt/catalog/cards/global_mmlu/de/college_biology.json' 2026-01-06T13:30:40,483 adding 'unitxt/catalog/cards/global_mmlu/de/college_chemistry.json' 2026-01-06T13:30:40,484 adding 'unitxt/catalog/cards/global_mmlu/de/college_computer_science.json' 2026-01-06T13:30:40,486 adding 'unitxt/catalog/cards/global_mmlu/de/college_mathematics.json' 2026-01-06T13:30:40,487 adding 'unitxt/catalog/cards/global_mmlu/de/college_medicine.json' 2026-01-06T13:30:40,488 adding 'unitxt/catalog/cards/global_mmlu/de/college_physics.json' 2026-01-06T13:30:40,490 adding 'unitxt/catalog/cards/global_mmlu/de/computer_security.json' 2026-01-06T13:30:40,491 adding 'unitxt/catalog/cards/global_mmlu/de/conceptual_physics.json' 2026-01-06T13:30:40,492 adding 'unitxt/catalog/cards/global_mmlu/de/econometrics.json' 2026-01-06T13:30:40,494 adding 'unitxt/catalog/cards/global_mmlu/de/electrical_engineering.json' 2026-01-06T13:30:40,495 adding 'unitxt/catalog/cards/global_mmlu/de/elementary_mathematics.json' 2026-01-06T13:30:40,496 adding 'unitxt/catalog/cards/global_mmlu/de/formal_logic.json' 2026-01-06T13:30:40,498 adding 'unitxt/catalog/cards/global_mmlu/de/global_facts.json' 2026-01-06T13:30:40,499 adding 'unitxt/catalog/cards/global_mmlu/de/high_school_biology.json' 2026-01-06T13:30:40,501 adding 'unitxt/catalog/cards/global_mmlu/de/high_school_chemistry.json' 2026-01-06T13:30:40,502 adding 'unitxt/catalog/cards/global_mmlu/de/high_school_computer_science.json' 2026-01-06T13:30:40,503 adding 'unitxt/catalog/cards/global_mmlu/de/high_school_european_history.json' 2026-01-06T13:30:40,504 adding 'unitxt/catalog/cards/global_mmlu/de/high_school_geography.json' 2026-01-06T13:30:40,506 adding 'unitxt/catalog/cards/global_mmlu/de/high_school_government_and_politics.json' 2026-01-06T13:30:40,507 adding 'unitxt/catalog/cards/global_mmlu/de/high_school_macroeconomics.json' 2026-01-06T13:30:40,508 adding 'unitxt/catalog/cards/global_mmlu/de/high_school_mathematics.json' 2026-01-06T13:30:40,510 adding 'unitxt/catalog/cards/global_mmlu/de/high_school_microeconomics.json' 2026-01-06T13:30:40,511 adding 'unitxt/catalog/cards/global_mmlu/de/high_school_physics.json' 2026-01-06T13:30:40,512 adding 'unitxt/catalog/cards/global_mmlu/de/high_school_psychology.json' 2026-01-06T13:30:40,514 adding 'unitxt/catalog/cards/global_mmlu/de/high_school_statistics.json' 2026-01-06T13:30:40,515 adding 'unitxt/catalog/cards/global_mmlu/de/high_school_us_history.json' 2026-01-06T13:30:40,517 adding 'unitxt/catalog/cards/global_mmlu/de/high_school_world_history.json' 2026-01-06T13:30:40,518 adding 'unitxt/catalog/cards/global_mmlu/de/human_aging.json' 2026-01-06T13:30:40,519 adding 'unitxt/catalog/cards/global_mmlu/de/human_sexuality.json' 2026-01-06T13:30:40,521 adding 'unitxt/catalog/cards/global_mmlu/de/international_law.json' 2026-01-06T13:30:40,522 adding 'unitxt/catalog/cards/global_mmlu/de/jurisprudence.json' 2026-01-06T13:30:40,523 adding 'unitxt/catalog/cards/global_mmlu/de/logical_fallacies.json' 2026-01-06T13:30:40,525 adding 'unitxt/catalog/cards/global_mmlu/de/machine_learning.json' 2026-01-06T13:30:40,526 adding 'unitxt/catalog/cards/global_mmlu/de/management.json' 2026-01-06T13:30:40,527 adding 'unitxt/catalog/cards/global_mmlu/de/marketing.json' 2026-01-06T13:30:40,529 adding 'unitxt/catalog/cards/global_mmlu/de/medical_genetics.json' 2026-01-06T13:30:40,530 adding 'unitxt/catalog/cards/global_mmlu/de/miscellaneous.json' 2026-01-06T13:30:40,531 adding 'unitxt/catalog/cards/global_mmlu/de/moral_disputes.json' 2026-01-06T13:30:40,532 adding 'unitxt/catalog/cards/global_mmlu/de/moral_scenarios.json' 2026-01-06T13:30:40,533 adding 'unitxt/catalog/cards/global_mmlu/de/nutrition.json' 2026-01-06T13:30:40,535 adding 'unitxt/catalog/cards/global_mmlu/de/philosophy.json' 2026-01-06T13:30:40,536 adding 'unitxt/catalog/cards/global_mmlu/de/prehistory.json' 2026-01-06T13:30:40,537 adding 'unitxt/catalog/cards/global_mmlu/de/professional_accounting.json' 2026-01-06T13:30:40,538 adding 'unitxt/catalog/cards/global_mmlu/de/professional_law.json' 2026-01-06T13:30:40,540 adding 'unitxt/catalog/cards/global_mmlu/de/professional_medicine.json' 2026-01-06T13:30:40,541 adding 'unitxt/catalog/cards/global_mmlu/de/professional_psychology.json' 2026-01-06T13:30:40,542 adding 'unitxt/catalog/cards/global_mmlu/de/public_relations.json' 2026-01-06T13:30:40,544 adding 'unitxt/catalog/cards/global_mmlu/de/security_studies.json' 2026-01-06T13:30:40,545 adding 'unitxt/catalog/cards/global_mmlu/de/sociology.json' 2026-01-06T13:30:40,546 adding 'unitxt/catalog/cards/global_mmlu/de/us_foreign_policy.json' 2026-01-06T13:30:40,547 adding 'unitxt/catalog/cards/global_mmlu/de/virology.json' 2026-01-06T13:30:40,549 adding 'unitxt/catalog/cards/global_mmlu/de/world_religions.json' 2026-01-06T13:30:40,552 adding 'unitxt/catalog/cards/global_mmlu/el/abstract_algebra.json' 2026-01-06T13:30:40,553 adding 'unitxt/catalog/cards/global_mmlu/el/anatomy.json' 2026-01-06T13:30:40,554 adding 'unitxt/catalog/cards/global_mmlu/el/astronomy.json' 2026-01-06T13:30:40,555 adding 'unitxt/catalog/cards/global_mmlu/el/business_ethics.json' 2026-01-06T13:30:40,557 adding 'unitxt/catalog/cards/global_mmlu/el/clinical_knowledge.json' 2026-01-06T13:30:40,558 adding 'unitxt/catalog/cards/global_mmlu/el/college_biology.json' 2026-01-06T13:30:40,559 adding 'unitxt/catalog/cards/global_mmlu/el/college_chemistry.json' 2026-01-06T13:30:40,561 adding 'unitxt/catalog/cards/global_mmlu/el/college_computer_science.json' 2026-01-06T13:30:40,562 adding 'unitxt/catalog/cards/global_mmlu/el/college_mathematics.json' 2026-01-06T13:30:40,563 adding 'unitxt/catalog/cards/global_mmlu/el/college_medicine.json' 2026-01-06T13:30:40,565 adding 'unitxt/catalog/cards/global_mmlu/el/college_physics.json' 2026-01-06T13:30:40,566 adding 'unitxt/catalog/cards/global_mmlu/el/computer_security.json' 2026-01-06T13:30:40,567 adding 'unitxt/catalog/cards/global_mmlu/el/conceptual_physics.json' 2026-01-06T13:30:40,569 adding 'unitxt/catalog/cards/global_mmlu/el/econometrics.json' 2026-01-06T13:30:40,570 adding 'unitxt/catalog/cards/global_mmlu/el/electrical_engineering.json' 2026-01-06T13:30:40,571 adding 'unitxt/catalog/cards/global_mmlu/el/elementary_mathematics.json' 2026-01-06T13:30:40,573 adding 'unitxt/catalog/cards/global_mmlu/el/formal_logic.json' 2026-01-06T13:30:40,574 adding 'unitxt/catalog/cards/global_mmlu/el/global_facts.json' 2026-01-06T13:30:40,575 adding 'unitxt/catalog/cards/global_mmlu/el/high_school_biology.json' 2026-01-06T13:30:40,577 adding 'unitxt/catalog/cards/global_mmlu/el/high_school_chemistry.json' 2026-01-06T13:30:40,578 adding 'unitxt/catalog/cards/global_mmlu/el/high_school_computer_science.json' 2026-01-06T13:30:40,580 adding 'unitxt/catalog/cards/global_mmlu/el/high_school_european_history.json' 2026-01-06T13:30:40,581 adding 'unitxt/catalog/cards/global_mmlu/el/high_school_geography.json' 2026-01-06T13:30:40,582 adding 'unitxt/catalog/cards/global_mmlu/el/high_school_government_and_politics.json' 2026-01-06T13:30:40,584 adding 'unitxt/catalog/cards/global_mmlu/el/high_school_macroeconomics.json' 2026-01-06T13:30:40,585 adding 'unitxt/catalog/cards/global_mmlu/el/high_school_mathematics.json' 2026-01-06T13:30:40,586 adding 'unitxt/catalog/cards/global_mmlu/el/high_school_microeconomics.json' 2026-01-06T13:30:40,588 adding 'unitxt/catalog/cards/global_mmlu/el/high_school_physics.json' 2026-01-06T13:30:40,589 adding 'unitxt/catalog/cards/global_mmlu/el/high_school_psychology.json' 2026-01-06T13:30:40,590 adding 'unitxt/catalog/cards/global_mmlu/el/high_school_statistics.json' 2026-01-06T13:30:40,591 adding 'unitxt/catalog/cards/global_mmlu/el/high_school_us_history.json' 2026-01-06T13:30:40,592 adding 'unitxt/catalog/cards/global_mmlu/el/high_school_world_history.json' 2026-01-06T13:30:40,594 adding 'unitxt/catalog/cards/global_mmlu/el/human_aging.json' 2026-01-06T13:30:40,595 adding 'unitxt/catalog/cards/global_mmlu/el/human_sexuality.json' 2026-01-06T13:30:40,596 adding 'unitxt/catalog/cards/global_mmlu/el/international_law.json' 2026-01-06T13:30:40,598 adding 'unitxt/catalog/cards/global_mmlu/el/jurisprudence.json' 2026-01-06T13:30:40,599 adding 'unitxt/catalog/cards/global_mmlu/el/logical_fallacies.json' 2026-01-06T13:30:40,600 adding 'unitxt/catalog/cards/global_mmlu/el/machine_learning.json' 2026-01-06T13:30:40,602 adding 'unitxt/catalog/cards/global_mmlu/el/management.json' 2026-01-06T13:30:40,603 adding 'unitxt/catalog/cards/global_mmlu/el/marketing.json' 2026-01-06T13:30:40,604 adding 'unitxt/catalog/cards/global_mmlu/el/medical_genetics.json' 2026-01-06T13:30:40,605 adding 'unitxt/catalog/cards/global_mmlu/el/miscellaneous.json' 2026-01-06T13:30:40,607 adding 'unitxt/catalog/cards/global_mmlu/el/moral_disputes.json' 2026-01-06T13:30:40,608 adding 'unitxt/catalog/cards/global_mmlu/el/moral_scenarios.json' 2026-01-06T13:30:40,609 adding 'unitxt/catalog/cards/global_mmlu/el/nutrition.json' 2026-01-06T13:30:40,611 adding 'unitxt/catalog/cards/global_mmlu/el/philosophy.json' 2026-01-06T13:30:40,612 adding 'unitxt/catalog/cards/global_mmlu/el/prehistory.json' 2026-01-06T13:30:40,613 adding 'unitxt/catalog/cards/global_mmlu/el/professional_accounting.json' 2026-01-06T13:30:40,614 adding 'unitxt/catalog/cards/global_mmlu/el/professional_law.json' 2026-01-06T13:30:40,616 adding 'unitxt/catalog/cards/global_mmlu/el/professional_medicine.json' 2026-01-06T13:30:40,617 adding 'unitxt/catalog/cards/global_mmlu/el/professional_psychology.json' 2026-01-06T13:30:40,618 adding 'unitxt/catalog/cards/global_mmlu/el/public_relations.json' 2026-01-06T13:30:40,620 adding 'unitxt/catalog/cards/global_mmlu/el/security_studies.json' 2026-01-06T13:30:40,621 adding 'unitxt/catalog/cards/global_mmlu/el/sociology.json' 2026-01-06T13:30:40,622 adding 'unitxt/catalog/cards/global_mmlu/el/us_foreign_policy.json' 2026-01-06T13:30:40,624 adding 'unitxt/catalog/cards/global_mmlu/el/virology.json' 2026-01-06T13:30:40,625 adding 'unitxt/catalog/cards/global_mmlu/el/world_religions.json' 2026-01-06T13:30:40,628 adding 'unitxt/catalog/cards/global_mmlu/en/abstract_algebra.json' 2026-01-06T13:30:40,629 adding 'unitxt/catalog/cards/global_mmlu/en/anatomy.json' 2026-01-06T13:30:40,631 adding 'unitxt/catalog/cards/global_mmlu/en/astronomy.json' 2026-01-06T13:30:40,632 adding 'unitxt/catalog/cards/global_mmlu/en/business_ethics.json' 2026-01-06T13:30:40,633 adding 'unitxt/catalog/cards/global_mmlu/en/clinical_knowledge.json' 2026-01-06T13:30:40,635 adding 'unitxt/catalog/cards/global_mmlu/en/college_biology.json' 2026-01-06T13:30:40,636 adding 'unitxt/catalog/cards/global_mmlu/en/college_chemistry.json' 2026-01-06T13:30:40,637 adding 'unitxt/catalog/cards/global_mmlu/en/college_computer_science.json' 2026-01-06T13:30:40,639 adding 'unitxt/catalog/cards/global_mmlu/en/college_mathematics.json' 2026-01-06T13:30:40,640 adding 'unitxt/catalog/cards/global_mmlu/en/college_medicine.json' 2026-01-06T13:30:40,641 adding 'unitxt/catalog/cards/global_mmlu/en/college_physics.json' 2026-01-06T13:30:40,642 adding 'unitxt/catalog/cards/global_mmlu/en/computer_security.json' 2026-01-06T13:30:40,644 adding 'unitxt/catalog/cards/global_mmlu/en/conceptual_physics.json' 2026-01-06T13:30:40,645 adding 'unitxt/catalog/cards/global_mmlu/en/econometrics.json' 2026-01-06T13:30:40,646 adding 'unitxt/catalog/cards/global_mmlu/en/electrical_engineering.json' 2026-01-06T13:30:40,647 adding 'unitxt/catalog/cards/global_mmlu/en/elementary_mathematics.json' 2026-01-06T13:30:40,649 adding 'unitxt/catalog/cards/global_mmlu/en/formal_logic.json' 2026-01-06T13:30:40,650 adding 'unitxt/catalog/cards/global_mmlu/en/global_facts.json' 2026-01-06T13:30:40,651 adding 'unitxt/catalog/cards/global_mmlu/en/high_school_biology.json' 2026-01-06T13:30:40,652 adding 'unitxt/catalog/cards/global_mmlu/en/high_school_chemistry.json' 2026-01-06T13:30:40,654 adding 'unitxt/catalog/cards/global_mmlu/en/high_school_computer_science.json' 2026-01-06T13:30:40,655 adding 'unitxt/catalog/cards/global_mmlu/en/high_school_european_history.json' 2026-01-06T13:30:40,656 adding 'unitxt/catalog/cards/global_mmlu/en/high_school_geography.json' 2026-01-06T13:30:40,658 adding 'unitxt/catalog/cards/global_mmlu/en/high_school_government_and_politics.json' 2026-01-06T13:30:40,659 adding 'unitxt/catalog/cards/global_mmlu/en/high_school_macroeconomics.json' 2026-01-06T13:30:40,660 adding 'unitxt/catalog/cards/global_mmlu/en/high_school_mathematics.json' 2026-01-06T13:30:40,662 adding 'unitxt/catalog/cards/global_mmlu/en/high_school_microeconomics.json' 2026-01-06T13:30:40,663 adding 'unitxt/catalog/cards/global_mmlu/en/high_school_physics.json' 2026-01-06T13:30:40,664 adding 'unitxt/catalog/cards/global_mmlu/en/high_school_psychology.json' 2026-01-06T13:30:40,665 adding 'unitxt/catalog/cards/global_mmlu/en/high_school_statistics.json' 2026-01-06T13:30:40,667 adding 'unitxt/catalog/cards/global_mmlu/en/high_school_us_history.json' 2026-01-06T13:30:40,668 adding 'unitxt/catalog/cards/global_mmlu/en/high_school_world_history.json' 2026-01-06T13:30:40,669 adding 'unitxt/catalog/cards/global_mmlu/en/human_aging.json' 2026-01-06T13:30:40,671 adding 'unitxt/catalog/cards/global_mmlu/en/human_sexuality.json' 2026-01-06T13:30:40,672 adding 'unitxt/catalog/cards/global_mmlu/en/international_law.json' 2026-01-06T13:30:40,673 adding 'unitxt/catalog/cards/global_mmlu/en/jurisprudence.json' 2026-01-06T13:30:40,675 adding 'unitxt/catalog/cards/global_mmlu/en/logical_fallacies.json' 2026-01-06T13:30:40,676 adding 'unitxt/catalog/cards/global_mmlu/en/machine_learning.json' 2026-01-06T13:30:40,677 adding 'unitxt/catalog/cards/global_mmlu/en/management.json' 2026-01-06T13:30:40,679 adding 'unitxt/catalog/cards/global_mmlu/en/marketing.json' 2026-01-06T13:30:40,680 adding 'unitxt/catalog/cards/global_mmlu/en/medical_genetics.json' 2026-01-06T13:30:40,681 adding 'unitxt/catalog/cards/global_mmlu/en/miscellaneous.json' 2026-01-06T13:30:40,683 adding 'unitxt/catalog/cards/global_mmlu/en/moral_disputes.json' 2026-01-06T13:30:40,684 adding 'unitxt/catalog/cards/global_mmlu/en/moral_scenarios.json' 2026-01-06T13:30:40,685 adding 'unitxt/catalog/cards/global_mmlu/en/nutrition.json' 2026-01-06T13:30:40,687 adding 'unitxt/catalog/cards/global_mmlu/en/philosophy.json' 2026-01-06T13:30:40,688 adding 'unitxt/catalog/cards/global_mmlu/en/prehistory.json' 2026-01-06T13:30:40,690 adding 'unitxt/catalog/cards/global_mmlu/en/professional_accounting.json' 2026-01-06T13:30:40,691 adding 'unitxt/catalog/cards/global_mmlu/en/professional_law.json' 2026-01-06T13:30:40,692 adding 'unitxt/catalog/cards/global_mmlu/en/professional_medicine.json' 2026-01-06T13:30:40,694 adding 'unitxt/catalog/cards/global_mmlu/en/professional_psychology.json' 2026-01-06T13:30:40,695 adding 'unitxt/catalog/cards/global_mmlu/en/public_relations.json' 2026-01-06T13:30:40,696 adding 'unitxt/catalog/cards/global_mmlu/en/security_studies.json' 2026-01-06T13:30:40,698 adding 'unitxt/catalog/cards/global_mmlu/en/sociology.json' 2026-01-06T13:30:40,699 adding 'unitxt/catalog/cards/global_mmlu/en/us_foreign_policy.json' 2026-01-06T13:30:40,700 adding 'unitxt/catalog/cards/global_mmlu/en/virology.json' 2026-01-06T13:30:40,702 adding 'unitxt/catalog/cards/global_mmlu/en/world_religions.json' 2026-01-06T13:30:40,704 adding 'unitxt/catalog/cards/global_mmlu/es/abstract_algebra.json' 2026-01-06T13:30:40,706 adding 'unitxt/catalog/cards/global_mmlu/es/anatomy.json' 2026-01-06T13:30:40,707 adding 'unitxt/catalog/cards/global_mmlu/es/astronomy.json' 2026-01-06T13:30:40,708 adding 'unitxt/catalog/cards/global_mmlu/es/business_ethics.json' 2026-01-06T13:30:40,709 adding 'unitxt/catalog/cards/global_mmlu/es/clinical_knowledge.json' 2026-01-06T13:30:40,711 adding 'unitxt/catalog/cards/global_mmlu/es/college_biology.json' 2026-01-06T13:30:40,712 adding 'unitxt/catalog/cards/global_mmlu/es/college_chemistry.json' 2026-01-06T13:30:40,713 adding 'unitxt/catalog/cards/global_mmlu/es/college_computer_science.json' 2026-01-06T13:30:40,714 adding 'unitxt/catalog/cards/global_mmlu/es/college_mathematics.json' 2026-01-06T13:30:40,716 adding 'unitxt/catalog/cards/global_mmlu/es/college_medicine.json' 2026-01-06T13:30:40,717 adding 'unitxt/catalog/cards/global_mmlu/es/college_physics.json' 2026-01-06T13:30:40,718 adding 'unitxt/catalog/cards/global_mmlu/es/computer_security.json' 2026-01-06T13:30:40,720 adding 'unitxt/catalog/cards/global_mmlu/es/conceptual_physics.json' 2026-01-06T13:30:40,721 adding 'unitxt/catalog/cards/global_mmlu/es/econometrics.json' 2026-01-06T13:30:40,722 adding 'unitxt/catalog/cards/global_mmlu/es/electrical_engineering.json' 2026-01-06T13:30:40,723 adding 'unitxt/catalog/cards/global_mmlu/es/elementary_mathematics.json' 2026-01-06T13:30:40,725 adding 'unitxt/catalog/cards/global_mmlu/es/formal_logic.json' 2026-01-06T13:30:40,726 adding 'unitxt/catalog/cards/global_mmlu/es/global_facts.json' 2026-01-06T13:30:40,727 adding 'unitxt/catalog/cards/global_mmlu/es/high_school_biology.json' 2026-01-06T13:30:40,729 adding 'unitxt/catalog/cards/global_mmlu/es/high_school_chemistry.json' 2026-01-06T13:30:40,730 adding 'unitxt/catalog/cards/global_mmlu/es/high_school_computer_science.json' 2026-01-06T13:30:40,731 adding 'unitxt/catalog/cards/global_mmlu/es/high_school_european_history.json' 2026-01-06T13:30:40,732 adding 'unitxt/catalog/cards/global_mmlu/es/high_school_geography.json' 2026-01-06T13:30:40,734 adding 'unitxt/catalog/cards/global_mmlu/es/high_school_government_and_politics.json' 2026-01-06T13:30:40,735 adding 'unitxt/catalog/cards/global_mmlu/es/high_school_macroeconomics.json' 2026-01-06T13:30:40,736 adding 'unitxt/catalog/cards/global_mmlu/es/high_school_mathematics.json' 2026-01-06T13:30:40,738 adding 'unitxt/catalog/cards/global_mmlu/es/high_school_microeconomics.json' 2026-01-06T13:30:40,739 adding 'unitxt/catalog/cards/global_mmlu/es/high_school_physics.json' 2026-01-06T13:30:40,740 adding 'unitxt/catalog/cards/global_mmlu/es/high_school_psychology.json' 2026-01-06T13:30:40,742 adding 'unitxt/catalog/cards/global_mmlu/es/high_school_statistics.json' 2026-01-06T13:30:40,743 adding 'unitxt/catalog/cards/global_mmlu/es/high_school_us_history.json' 2026-01-06T13:30:40,744 adding 'unitxt/catalog/cards/global_mmlu/es/high_school_world_history.json' 2026-01-06T13:30:40,746 adding 'unitxt/catalog/cards/global_mmlu/es/human_aging.json' 2026-01-06T13:30:40,747 adding 'unitxt/catalog/cards/global_mmlu/es/human_sexuality.json' 2026-01-06T13:30:40,748 adding 'unitxt/catalog/cards/global_mmlu/es/international_law.json' 2026-01-06T13:30:40,750 adding 'unitxt/catalog/cards/global_mmlu/es/jurisprudence.json' 2026-01-06T13:30:40,751 adding 'unitxt/catalog/cards/global_mmlu/es/logical_fallacies.json' 2026-01-06T13:30:40,752 adding 'unitxt/catalog/cards/global_mmlu/es/machine_learning.json' 2026-01-06T13:30:40,754 adding 'unitxt/catalog/cards/global_mmlu/es/management.json' 2026-01-06T13:30:40,755 adding 'unitxt/catalog/cards/global_mmlu/es/marketing.json' 2026-01-06T13:30:40,756 adding 'unitxt/catalog/cards/global_mmlu/es/medical_genetics.json' 2026-01-06T13:30:40,758 adding 'unitxt/catalog/cards/global_mmlu/es/miscellaneous.json' 2026-01-06T13:30:40,759 adding 'unitxt/catalog/cards/global_mmlu/es/moral_disputes.json' 2026-01-06T13:30:40,760 adding 'unitxt/catalog/cards/global_mmlu/es/moral_scenarios.json' 2026-01-06T13:30:40,762 adding 'unitxt/catalog/cards/global_mmlu/es/nutrition.json' 2026-01-06T13:30:40,763 adding 'unitxt/catalog/cards/global_mmlu/es/philosophy.json' 2026-01-06T13:30:40,764 adding 'unitxt/catalog/cards/global_mmlu/es/prehistory.json' 2026-01-06T13:30:40,765 adding 'unitxt/catalog/cards/global_mmlu/es/professional_accounting.json' 2026-01-06T13:30:40,766 adding 'unitxt/catalog/cards/global_mmlu/es/professional_law.json' 2026-01-06T13:30:40,768 adding 'unitxt/catalog/cards/global_mmlu/es/professional_medicine.json' 2026-01-06T13:30:40,769 adding 'unitxt/catalog/cards/global_mmlu/es/professional_psychology.json' 2026-01-06T13:30:40,770 adding 'unitxt/catalog/cards/global_mmlu/es/public_relations.json' 2026-01-06T13:30:40,771 adding 'unitxt/catalog/cards/global_mmlu/es/security_studies.json' 2026-01-06T13:30:40,773 adding 'unitxt/catalog/cards/global_mmlu/es/sociology.json' 2026-01-06T13:30:40,774 adding 'unitxt/catalog/cards/global_mmlu/es/us_foreign_policy.json' 2026-01-06T13:30:40,775 adding 'unitxt/catalog/cards/global_mmlu/es/virology.json' 2026-01-06T13:30:40,777 adding 'unitxt/catalog/cards/global_mmlu/es/world_religions.json' 2026-01-06T13:30:40,780 adding 'unitxt/catalog/cards/global_mmlu/fa/abstract_algebra.json' 2026-01-06T13:30:40,781 adding 'unitxt/catalog/cards/global_mmlu/fa/anatomy.json' 2026-01-06T13:30:40,782 adding 'unitxt/catalog/cards/global_mmlu/fa/astronomy.json' 2026-01-06T13:30:40,783 adding 'unitxt/catalog/cards/global_mmlu/fa/business_ethics.json' 2026-01-06T13:30:40,785 adding 'unitxt/catalog/cards/global_mmlu/fa/clinical_knowledge.json' 2026-01-06T13:30:40,786 adding 'unitxt/catalog/cards/global_mmlu/fa/college_biology.json' 2026-01-06T13:30:40,787 adding 'unitxt/catalog/cards/global_mmlu/fa/college_chemistry.json' 2026-01-06T13:30:40,789 adding 'unitxt/catalog/cards/global_mmlu/fa/college_computer_science.json' 2026-01-06T13:30:40,790 adding 'unitxt/catalog/cards/global_mmlu/fa/college_mathematics.json' 2026-01-06T13:30:40,791 adding 'unitxt/catalog/cards/global_mmlu/fa/college_medicine.json' 2026-01-06T13:30:40,793 adding 'unitxt/catalog/cards/global_mmlu/fa/college_physics.json' 2026-01-06T13:30:40,794 adding 'unitxt/catalog/cards/global_mmlu/fa/computer_security.json' 2026-01-06T13:30:40,795 adding 'unitxt/catalog/cards/global_mmlu/fa/conceptual_physics.json' 2026-01-06T13:30:40,797 adding 'unitxt/catalog/cards/global_mmlu/fa/econometrics.json' 2026-01-06T13:30:40,798 adding 'unitxt/catalog/cards/global_mmlu/fa/electrical_engineering.json' 2026-01-06T13:30:40,799 adding 'unitxt/catalog/cards/global_mmlu/fa/elementary_mathematics.json' 2026-01-06T13:30:40,801 adding 'unitxt/catalog/cards/global_mmlu/fa/formal_logic.json' 2026-01-06T13:30:40,802 adding 'unitxt/catalog/cards/global_mmlu/fa/global_facts.json' 2026-01-06T13:30:40,803 adding 'unitxt/catalog/cards/global_mmlu/fa/high_school_biology.json' 2026-01-06T13:30:40,805 adding 'unitxt/catalog/cards/global_mmlu/fa/high_school_chemistry.json' 2026-01-06T13:30:40,806 adding 'unitxt/catalog/cards/global_mmlu/fa/high_school_computer_science.json' 2026-01-06T13:30:40,807 adding 'unitxt/catalog/cards/global_mmlu/fa/high_school_european_history.json' 2026-01-06T13:30:40,809 adding 'unitxt/catalog/cards/global_mmlu/fa/high_school_geography.json' 2026-01-06T13:30:40,810 adding 'unitxt/catalog/cards/global_mmlu/fa/high_school_government_and_politics.json' 2026-01-06T13:30:40,812 adding 'unitxt/catalog/cards/global_mmlu/fa/high_school_macroeconomics.json' 2026-01-06T13:30:40,813 adding 'unitxt/catalog/cards/global_mmlu/fa/high_school_mathematics.json' 2026-01-06T13:30:40,814 adding 'unitxt/catalog/cards/global_mmlu/fa/high_school_microeconomics.json' 2026-01-06T13:30:40,816 adding 'unitxt/catalog/cards/global_mmlu/fa/high_school_physics.json' 2026-01-06T13:30:40,817 adding 'unitxt/catalog/cards/global_mmlu/fa/high_school_psychology.json' 2026-01-06T13:30:40,818 adding 'unitxt/catalog/cards/global_mmlu/fa/high_school_statistics.json' 2026-01-06T13:30:40,819 adding 'unitxt/catalog/cards/global_mmlu/fa/high_school_us_history.json' 2026-01-06T13:30:40,821 adding 'unitxt/catalog/cards/global_mmlu/fa/high_school_world_history.json' 2026-01-06T13:30:40,822 adding 'unitxt/catalog/cards/global_mmlu/fa/human_aging.json' 2026-01-06T13:30:40,823 adding 'unitxt/catalog/cards/global_mmlu/fa/human_sexuality.json' 2026-01-06T13:30:40,824 adding 'unitxt/catalog/cards/global_mmlu/fa/international_law.json' 2026-01-06T13:30:40,825 adding 'unitxt/catalog/cards/global_mmlu/fa/jurisprudence.json' 2026-01-06T13:30:40,827 adding 'unitxt/catalog/cards/global_mmlu/fa/logical_fallacies.json' 2026-01-06T13:30:40,828 adding 'unitxt/catalog/cards/global_mmlu/fa/machine_learning.json' 2026-01-06T13:30:40,829 adding 'unitxt/catalog/cards/global_mmlu/fa/management.json' 2026-01-06T13:30:40,831 adding 'unitxt/catalog/cards/global_mmlu/fa/marketing.json' 2026-01-06T13:30:40,832 adding 'unitxt/catalog/cards/global_mmlu/fa/medical_genetics.json' 2026-01-06T13:30:40,833 adding 'unitxt/catalog/cards/global_mmlu/fa/miscellaneous.json' 2026-01-06T13:30:40,835 adding 'unitxt/catalog/cards/global_mmlu/fa/moral_disputes.json' 2026-01-06T13:30:40,836 adding 'unitxt/catalog/cards/global_mmlu/fa/moral_scenarios.json' 2026-01-06T13:30:40,837 adding 'unitxt/catalog/cards/global_mmlu/fa/nutrition.json' 2026-01-06T13:30:40,838 adding 'unitxt/catalog/cards/global_mmlu/fa/philosophy.json' 2026-01-06T13:30:40,840 adding 'unitxt/catalog/cards/global_mmlu/fa/prehistory.json' 2026-01-06T13:30:40,841 adding 'unitxt/catalog/cards/global_mmlu/fa/professional_accounting.json' 2026-01-06T13:30:40,842 adding 'unitxt/catalog/cards/global_mmlu/fa/professional_law.json' 2026-01-06T13:30:40,844 adding 'unitxt/catalog/cards/global_mmlu/fa/professional_medicine.json' 2026-01-06T13:30:40,845 adding 'unitxt/catalog/cards/global_mmlu/fa/professional_psychology.json' 2026-01-06T13:30:40,846 adding 'unitxt/catalog/cards/global_mmlu/fa/public_relations.json' 2026-01-06T13:30:40,848 adding 'unitxt/catalog/cards/global_mmlu/fa/security_studies.json' 2026-01-06T13:30:40,849 adding 'unitxt/catalog/cards/global_mmlu/fa/sociology.json' 2026-01-06T13:30:40,850 adding 'unitxt/catalog/cards/global_mmlu/fa/us_foreign_policy.json' 2026-01-06T13:30:40,852 adding 'unitxt/catalog/cards/global_mmlu/fa/virology.json' 2026-01-06T13:30:40,853 adding 'unitxt/catalog/cards/global_mmlu/fa/world_religions.json' 2026-01-06T13:30:40,856 adding 'unitxt/catalog/cards/global_mmlu/fil/abstract_algebra.json' 2026-01-06T13:30:40,857 adding 'unitxt/catalog/cards/global_mmlu/fil/anatomy.json' 2026-01-06T13:30:40,858 adding 'unitxt/catalog/cards/global_mmlu/fil/astronomy.json' 2026-01-06T13:30:40,860 adding 'unitxt/catalog/cards/global_mmlu/fil/business_ethics.json' 2026-01-06T13:30:40,861 adding 'unitxt/catalog/cards/global_mmlu/fil/clinical_knowledge.json' 2026-01-06T13:30:40,862 adding 'unitxt/catalog/cards/global_mmlu/fil/college_biology.json' 2026-01-06T13:30:40,864 adding 'unitxt/catalog/cards/global_mmlu/fil/college_chemistry.json' 2026-01-06T13:30:40,865 adding 'unitxt/catalog/cards/global_mmlu/fil/college_computer_science.json' 2026-01-06T13:30:40,866 adding 'unitxt/catalog/cards/global_mmlu/fil/college_mathematics.json' 2026-01-06T13:30:40,868 adding 'unitxt/catalog/cards/global_mmlu/fil/college_medicine.json' 2026-01-06T13:30:40,869 adding 'unitxt/catalog/cards/global_mmlu/fil/college_physics.json' 2026-01-06T13:30:40,870 adding 'unitxt/catalog/cards/global_mmlu/fil/computer_security.json' 2026-01-06T13:30:40,872 adding 'unitxt/catalog/cards/global_mmlu/fil/conceptual_physics.json' 2026-01-06T13:30:40,873 adding 'unitxt/catalog/cards/global_mmlu/fil/econometrics.json' 2026-01-06T13:30:40,874 adding 'unitxt/catalog/cards/global_mmlu/fil/electrical_engineering.json' 2026-01-06T13:30:40,876 adding 'unitxt/catalog/cards/global_mmlu/fil/elementary_mathematics.json' 2026-01-06T13:30:40,877 adding 'unitxt/catalog/cards/global_mmlu/fil/formal_logic.json' 2026-01-06T13:30:40,878 adding 'unitxt/catalog/cards/global_mmlu/fil/global_facts.json' 2026-01-06T13:30:40,880 adding 'unitxt/catalog/cards/global_mmlu/fil/high_school_biology.json' 2026-01-06T13:30:40,881 adding 'unitxt/catalog/cards/global_mmlu/fil/high_school_chemistry.json' 2026-01-06T13:30:40,882 adding 'unitxt/catalog/cards/global_mmlu/fil/high_school_computer_science.json' 2026-01-06T13:30:40,883 adding 'unitxt/catalog/cards/global_mmlu/fil/high_school_european_history.json' 2026-01-06T13:30:40,884 adding 'unitxt/catalog/cards/global_mmlu/fil/high_school_geography.json' 2026-01-06T13:30:40,886 adding 'unitxt/catalog/cards/global_mmlu/fil/high_school_government_and_politics.json' 2026-01-06T13:30:40,887 adding 'unitxt/catalog/cards/global_mmlu/fil/high_school_macroeconomics.json' 2026-01-06T13:30:40,888 adding 'unitxt/catalog/cards/global_mmlu/fil/high_school_mathematics.json' 2026-01-06T13:30:40,890 adding 'unitxt/catalog/cards/global_mmlu/fil/high_school_microeconomics.json' 2026-01-06T13:30:40,891 adding 'unitxt/catalog/cards/global_mmlu/fil/high_school_physics.json' 2026-01-06T13:30:40,892 adding 'unitxt/catalog/cards/global_mmlu/fil/high_school_psychology.json' 2026-01-06T13:30:40,894 adding 'unitxt/catalog/cards/global_mmlu/fil/high_school_statistics.json' 2026-01-06T13:30:40,895 adding 'unitxt/catalog/cards/global_mmlu/fil/high_school_us_history.json' 2026-01-06T13:30:40,896 adding 'unitxt/catalog/cards/global_mmlu/fil/high_school_world_history.json' 2026-01-06T13:30:40,898 adding 'unitxt/catalog/cards/global_mmlu/fil/human_aging.json' 2026-01-06T13:30:40,899 adding 'unitxt/catalog/cards/global_mmlu/fil/human_sexuality.json' 2026-01-06T13:30:40,900 adding 'unitxt/catalog/cards/global_mmlu/fil/international_law.json' 2026-01-06T13:30:40,902 adding 'unitxt/catalog/cards/global_mmlu/fil/jurisprudence.json' 2026-01-06T13:30:40,903 adding 'unitxt/catalog/cards/global_mmlu/fil/logical_fallacies.json' 2026-01-06T13:30:40,904 adding 'unitxt/catalog/cards/global_mmlu/fil/machine_learning.json' 2026-01-06T13:30:40,906 adding 'unitxt/catalog/cards/global_mmlu/fil/management.json' 2026-01-06T13:30:40,907 adding 'unitxt/catalog/cards/global_mmlu/fil/marketing.json' 2026-01-06T13:30:40,908 adding 'unitxt/catalog/cards/global_mmlu/fil/medical_genetics.json' 2026-01-06T13:30:40,910 adding 'unitxt/catalog/cards/global_mmlu/fil/miscellaneous.json' 2026-01-06T13:30:40,911 adding 'unitxt/catalog/cards/global_mmlu/fil/moral_disputes.json' 2026-01-06T13:30:40,912 adding 'unitxt/catalog/cards/global_mmlu/fil/moral_scenarios.json' 2026-01-06T13:30:40,914 adding 'unitxt/catalog/cards/global_mmlu/fil/nutrition.json' 2026-01-06T13:30:40,915 adding 'unitxt/catalog/cards/global_mmlu/fil/philosophy.json' 2026-01-06T13:30:40,916 adding 'unitxt/catalog/cards/global_mmlu/fil/prehistory.json' 2026-01-06T13:30:40,918 adding 'unitxt/catalog/cards/global_mmlu/fil/professional_accounting.json' 2026-01-06T13:30:40,919 adding 'unitxt/catalog/cards/global_mmlu/fil/professional_law.json' 2026-01-06T13:30:40,920 adding 'unitxt/catalog/cards/global_mmlu/fil/professional_medicine.json' 2026-01-06T13:30:40,922 adding 'unitxt/catalog/cards/global_mmlu/fil/professional_psychology.json' 2026-01-06T13:30:40,923 adding 'unitxt/catalog/cards/global_mmlu/fil/public_relations.json' 2026-01-06T13:30:40,924 adding 'unitxt/catalog/cards/global_mmlu/fil/security_studies.json' 2026-01-06T13:30:40,926 adding 'unitxt/catalog/cards/global_mmlu/fil/sociology.json' 2026-01-06T13:30:40,927 adding 'unitxt/catalog/cards/global_mmlu/fil/us_foreign_policy.json' 2026-01-06T13:30:40,928 adding 'unitxt/catalog/cards/global_mmlu/fil/virology.json' 2026-01-06T13:30:40,930 adding 'unitxt/catalog/cards/global_mmlu/fil/world_religions.json' 2026-01-06T13:30:40,933 adding 'unitxt/catalog/cards/global_mmlu/fr/abstract_algebra.json' 2026-01-06T13:30:40,934 adding 'unitxt/catalog/cards/global_mmlu/fr/anatomy.json' 2026-01-06T13:30:40,935 adding 'unitxt/catalog/cards/global_mmlu/fr/astronomy.json' 2026-01-06T13:30:40,936 adding 'unitxt/catalog/cards/global_mmlu/fr/business_ethics.json' 2026-01-06T13:30:40,938 adding 'unitxt/catalog/cards/global_mmlu/fr/clinical_knowledge.json' 2026-01-06T13:30:40,939 adding 'unitxt/catalog/cards/global_mmlu/fr/college_biology.json' 2026-01-06T13:30:40,940 adding 'unitxt/catalog/cards/global_mmlu/fr/college_chemistry.json' 2026-01-06T13:30:40,941 adding 'unitxt/catalog/cards/global_mmlu/fr/college_computer_science.json' 2026-01-06T13:30:40,943 adding 'unitxt/catalog/cards/global_mmlu/fr/college_mathematics.json' 2026-01-06T13:30:40,944 adding 'unitxt/catalog/cards/global_mmlu/fr/college_medicine.json' 2026-01-06T13:30:40,945 adding 'unitxt/catalog/cards/global_mmlu/fr/college_physics.json' 2026-01-06T13:30:40,946 adding 'unitxt/catalog/cards/global_mmlu/fr/computer_security.json' 2026-01-06T13:30:40,948 adding 'unitxt/catalog/cards/global_mmlu/fr/conceptual_physics.json' 2026-01-06T13:30:40,949 adding 'unitxt/catalog/cards/global_mmlu/fr/econometrics.json' 2026-01-06T13:30:40,951 adding 'unitxt/catalog/cards/global_mmlu/fr/electrical_engineering.json' 2026-01-06T13:30:40,952 adding 'unitxt/catalog/cards/global_mmlu/fr/elementary_mathematics.json' 2026-01-06T13:30:40,953 adding 'unitxt/catalog/cards/global_mmlu/fr/formal_logic.json' 2026-01-06T13:30:40,954 adding 'unitxt/catalog/cards/global_mmlu/fr/global_facts.json' 2026-01-06T13:30:40,956 adding 'unitxt/catalog/cards/global_mmlu/fr/high_school_biology.json' 2026-01-06T13:30:40,957 adding 'unitxt/catalog/cards/global_mmlu/fr/high_school_chemistry.json' 2026-01-06T13:30:40,958 adding 'unitxt/catalog/cards/global_mmlu/fr/high_school_computer_science.json' 2026-01-06T13:30:40,960 adding 'unitxt/catalog/cards/global_mmlu/fr/high_school_european_history.json' 2026-01-06T13:30:40,961 adding 'unitxt/catalog/cards/global_mmlu/fr/high_school_geography.json' 2026-01-06T13:30:40,962 adding 'unitxt/catalog/cards/global_mmlu/fr/high_school_government_and_politics.json' 2026-01-06T13:30:40,964 adding 'unitxt/catalog/cards/global_mmlu/fr/high_school_macroeconomics.json' 2026-01-06T13:30:40,965 adding 'unitxt/catalog/cards/global_mmlu/fr/high_school_mathematics.json' 2026-01-06T13:30:40,966 adding 'unitxt/catalog/cards/global_mmlu/fr/high_school_microeconomics.json' 2026-01-06T13:30:40,968 adding 'unitxt/catalog/cards/global_mmlu/fr/high_school_physics.json' 2026-01-06T13:30:40,969 adding 'unitxt/catalog/cards/global_mmlu/fr/high_school_psychology.json' 2026-01-06T13:30:40,970 adding 'unitxt/catalog/cards/global_mmlu/fr/high_school_statistics.json' 2026-01-06T13:30:40,972 adding 'unitxt/catalog/cards/global_mmlu/fr/high_school_us_history.json' 2026-01-06T13:30:40,973 adding 'unitxt/catalog/cards/global_mmlu/fr/high_school_world_history.json' 2026-01-06T13:30:40,974 adding 'unitxt/catalog/cards/global_mmlu/fr/human_aging.json' 2026-01-06T13:30:40,976 adding 'unitxt/catalog/cards/global_mmlu/fr/human_sexuality.json' 2026-01-06T13:30:40,977 adding 'unitxt/catalog/cards/global_mmlu/fr/international_law.json' 2026-01-06T13:30:40,978 adding 'unitxt/catalog/cards/global_mmlu/fr/jurisprudence.json' 2026-01-06T13:30:40,980 adding 'unitxt/catalog/cards/global_mmlu/fr/logical_fallacies.json' 2026-01-06T13:30:40,981 adding 'unitxt/catalog/cards/global_mmlu/fr/machine_learning.json' 2026-01-06T13:30:40,982 adding 'unitxt/catalog/cards/global_mmlu/fr/management.json' 2026-01-06T13:30:40,984 adding 'unitxt/catalog/cards/global_mmlu/fr/marketing.json' 2026-01-06T13:30:40,985 adding 'unitxt/catalog/cards/global_mmlu/fr/medical_genetics.json' 2026-01-06T13:30:40,986 adding 'unitxt/catalog/cards/global_mmlu/fr/miscellaneous.json' 2026-01-06T13:30:40,988 adding 'unitxt/catalog/cards/global_mmlu/fr/moral_disputes.json' 2026-01-06T13:30:40,989 adding 'unitxt/catalog/cards/global_mmlu/fr/moral_scenarios.json' 2026-01-06T13:30:40,990 adding 'unitxt/catalog/cards/global_mmlu/fr/nutrition.json' 2026-01-06T13:30:40,992 adding 'unitxt/catalog/cards/global_mmlu/fr/philosophy.json' 2026-01-06T13:30:40,993 adding 'unitxt/catalog/cards/global_mmlu/fr/prehistory.json' 2026-01-06T13:30:40,994 adding 'unitxt/catalog/cards/global_mmlu/fr/professional_accounting.json' 2026-01-06T13:30:40,995 adding 'unitxt/catalog/cards/global_mmlu/fr/professional_law.json' 2026-01-06T13:30:40,996 adding 'unitxt/catalog/cards/global_mmlu/fr/professional_medicine.json' 2026-01-06T13:30:40,998 adding 'unitxt/catalog/cards/global_mmlu/fr/professional_psychology.json' 2026-01-06T13:30:40,999 adding 'unitxt/catalog/cards/global_mmlu/fr/public_relations.json' 2026-01-06T13:30:41,000 adding 'unitxt/catalog/cards/global_mmlu/fr/security_studies.json' 2026-01-06T13:30:41,001 adding 'unitxt/catalog/cards/global_mmlu/fr/sociology.json' 2026-01-06T13:30:41,003 adding 'unitxt/catalog/cards/global_mmlu/fr/us_foreign_policy.json' 2026-01-06T13:30:41,004 adding 'unitxt/catalog/cards/global_mmlu/fr/virology.json' 2026-01-06T13:30:41,005 adding 'unitxt/catalog/cards/global_mmlu/fr/world_religions.json' 2026-01-06T13:30:41,008 adding 'unitxt/catalog/cards/global_mmlu/ha/abstract_algebra.json' 2026-01-06T13:30:41,009 adding 'unitxt/catalog/cards/global_mmlu/ha/anatomy.json' 2026-01-06T13:30:41,010 adding 'unitxt/catalog/cards/global_mmlu/ha/astronomy.json' 2026-01-06T13:30:41,012 adding 'unitxt/catalog/cards/global_mmlu/ha/business_ethics.json' 2026-01-06T13:30:41,013 adding 'unitxt/catalog/cards/global_mmlu/ha/clinical_knowledge.json' 2026-01-06T13:30:41,014 adding 'unitxt/catalog/cards/global_mmlu/ha/college_biology.json' 2026-01-06T13:30:41,016 adding 'unitxt/catalog/cards/global_mmlu/ha/college_chemistry.json' 2026-01-06T13:30:41,017 adding 'unitxt/catalog/cards/global_mmlu/ha/college_computer_science.json' 2026-01-06T13:30:41,018 adding 'unitxt/catalog/cards/global_mmlu/ha/college_mathematics.json' 2026-01-06T13:30:41,020 adding 'unitxt/catalog/cards/global_mmlu/ha/college_medicine.json' 2026-01-06T13:30:41,021 adding 'unitxt/catalog/cards/global_mmlu/ha/college_physics.json' 2026-01-06T13:30:41,022 adding 'unitxt/catalog/cards/global_mmlu/ha/computer_security.json' 2026-01-06T13:30:41,024 adding 'unitxt/catalog/cards/global_mmlu/ha/conceptual_physics.json' 2026-01-06T13:30:41,025 adding 'unitxt/catalog/cards/global_mmlu/ha/econometrics.json' 2026-01-06T13:30:41,026 adding 'unitxt/catalog/cards/global_mmlu/ha/electrical_engineering.json' 2026-01-06T13:30:41,028 adding 'unitxt/catalog/cards/global_mmlu/ha/elementary_mathematics.json' 2026-01-06T13:30:41,029 adding 'unitxt/catalog/cards/global_mmlu/ha/formal_logic.json' 2026-01-06T13:30:41,030 adding 'unitxt/catalog/cards/global_mmlu/ha/global_facts.json' 2026-01-06T13:30:41,032 adding 'unitxt/catalog/cards/global_mmlu/ha/high_school_biology.json' 2026-01-06T13:30:41,033 adding 'unitxt/catalog/cards/global_mmlu/ha/high_school_chemistry.json' 2026-01-06T13:30:41,034 adding 'unitxt/catalog/cards/global_mmlu/ha/high_school_computer_science.json' 2026-01-06T13:30:41,036 adding 'unitxt/catalog/cards/global_mmlu/ha/high_school_european_history.json' 2026-01-06T13:30:41,037 adding 'unitxt/catalog/cards/global_mmlu/ha/high_school_geography.json' 2026-01-06T13:30:41,039 adding 'unitxt/catalog/cards/global_mmlu/ha/high_school_government_and_politics.json' 2026-01-06T13:30:41,040 adding 'unitxt/catalog/cards/global_mmlu/ha/high_school_macroeconomics.json' 2026-01-06T13:30:41,041 adding 'unitxt/catalog/cards/global_mmlu/ha/high_school_mathematics.json' 2026-01-06T13:30:41,043 adding 'unitxt/catalog/cards/global_mmlu/ha/high_school_microeconomics.json' 2026-01-06T13:30:41,044 adding 'unitxt/catalog/cards/global_mmlu/ha/high_school_physics.json' 2026-01-06T13:30:41,045 adding 'unitxt/catalog/cards/global_mmlu/ha/high_school_psychology.json' 2026-01-06T13:30:41,047 adding 'unitxt/catalog/cards/global_mmlu/ha/high_school_statistics.json' 2026-01-06T13:30:41,048 adding 'unitxt/catalog/cards/global_mmlu/ha/high_school_us_history.json' 2026-01-06T13:30:41,049 adding 'unitxt/catalog/cards/global_mmlu/ha/high_school_world_history.json' 2026-01-06T13:30:41,050 adding 'unitxt/catalog/cards/global_mmlu/ha/human_aging.json' 2026-01-06T13:30:41,052 adding 'unitxt/catalog/cards/global_mmlu/ha/human_sexuality.json' 2026-01-06T13:30:41,053 adding 'unitxt/catalog/cards/global_mmlu/ha/international_law.json' 2026-01-06T13:30:41,054 adding 'unitxt/catalog/cards/global_mmlu/ha/jurisprudence.json' 2026-01-06T13:30:41,055 adding 'unitxt/catalog/cards/global_mmlu/ha/logical_fallacies.json' 2026-01-06T13:30:41,057 adding 'unitxt/catalog/cards/global_mmlu/ha/machine_learning.json' 2026-01-06T13:30:41,058 adding 'unitxt/catalog/cards/global_mmlu/ha/management.json' 2026-01-06T13:30:41,059 adding 'unitxt/catalog/cards/global_mmlu/ha/marketing.json' 2026-01-06T13:30:41,060 adding 'unitxt/catalog/cards/global_mmlu/ha/medical_genetics.json' 2026-01-06T13:30:41,062 adding 'unitxt/catalog/cards/global_mmlu/ha/miscellaneous.json' 2026-01-06T13:30:41,063 adding 'unitxt/catalog/cards/global_mmlu/ha/moral_disputes.json' 2026-01-06T13:30:41,064 adding 'unitxt/catalog/cards/global_mmlu/ha/moral_scenarios.json' 2026-01-06T13:30:41,066 adding 'unitxt/catalog/cards/global_mmlu/ha/nutrition.json' 2026-01-06T13:30:41,067 adding 'unitxt/catalog/cards/global_mmlu/ha/philosophy.json' 2026-01-06T13:30:41,068 adding 'unitxt/catalog/cards/global_mmlu/ha/prehistory.json' 2026-01-06T13:30:41,070 adding 'unitxt/catalog/cards/global_mmlu/ha/professional_accounting.json' 2026-01-06T13:30:41,071 adding 'unitxt/catalog/cards/global_mmlu/ha/professional_law.json' 2026-01-06T13:30:41,072 adding 'unitxt/catalog/cards/global_mmlu/ha/professional_medicine.json' 2026-01-06T13:30:41,073 adding 'unitxt/catalog/cards/global_mmlu/ha/professional_psychology.json' 2026-01-06T13:30:41,075 adding 'unitxt/catalog/cards/global_mmlu/ha/public_relations.json' 2026-01-06T13:30:41,076 adding 'unitxt/catalog/cards/global_mmlu/ha/security_studies.json' 2026-01-06T13:30:41,077 adding 'unitxt/catalog/cards/global_mmlu/ha/sociology.json' 2026-01-06T13:30:41,079 adding 'unitxt/catalog/cards/global_mmlu/ha/us_foreign_policy.json' 2026-01-06T13:30:41,080 adding 'unitxt/catalog/cards/global_mmlu/ha/virology.json' 2026-01-06T13:30:41,081 adding 'unitxt/catalog/cards/global_mmlu/ha/world_religions.json' 2026-01-06T13:30:41,084 adding 'unitxt/catalog/cards/global_mmlu/he/abstract_algebra.json' 2026-01-06T13:30:41,085 adding 'unitxt/catalog/cards/global_mmlu/he/anatomy.json' 2026-01-06T13:30:41,087 adding 'unitxt/catalog/cards/global_mmlu/he/astronomy.json' 2026-01-06T13:30:41,088 adding 'unitxt/catalog/cards/global_mmlu/he/business_ethics.json' 2026-01-06T13:30:41,089 adding 'unitxt/catalog/cards/global_mmlu/he/clinical_knowledge.json' 2026-01-06T13:30:41,091 adding 'unitxt/catalog/cards/global_mmlu/he/college_biology.json' 2026-01-06T13:30:41,092 adding 'unitxt/catalog/cards/global_mmlu/he/college_chemistry.json' 2026-01-06T13:30:41,093 adding 'unitxt/catalog/cards/global_mmlu/he/college_computer_science.json' 2026-01-06T13:30:41,095 adding 'unitxt/catalog/cards/global_mmlu/he/college_mathematics.json' 2026-01-06T13:30:41,096 adding 'unitxt/catalog/cards/global_mmlu/he/college_medicine.json' 2026-01-06T13:30:41,097 adding 'unitxt/catalog/cards/global_mmlu/he/college_physics.json' 2026-01-06T13:30:41,099 adding 'unitxt/catalog/cards/global_mmlu/he/computer_security.json' 2026-01-06T13:30:41,100 adding 'unitxt/catalog/cards/global_mmlu/he/conceptual_physics.json' 2026-01-06T13:30:41,102 adding 'unitxt/catalog/cards/global_mmlu/he/econometrics.json' 2026-01-06T13:30:41,103 adding 'unitxt/catalog/cards/global_mmlu/he/electrical_engineering.json' 2026-01-06T13:30:41,104 adding 'unitxt/catalog/cards/global_mmlu/he/elementary_mathematics.json' 2026-01-06T13:30:41,106 adding 'unitxt/catalog/cards/global_mmlu/he/formal_logic.json' 2026-01-06T13:30:41,107 adding 'unitxt/catalog/cards/global_mmlu/he/global_facts.json' 2026-01-06T13:30:41,108 adding 'unitxt/catalog/cards/global_mmlu/he/high_school_biology.json' 2026-01-06T13:30:41,110 adding 'unitxt/catalog/cards/global_mmlu/he/high_school_chemistry.json' 2026-01-06T13:30:41,111 adding 'unitxt/catalog/cards/global_mmlu/he/high_school_computer_science.json' 2026-01-06T13:30:41,112 adding 'unitxt/catalog/cards/global_mmlu/he/high_school_european_history.json' 2026-01-06T13:30:41,113 adding 'unitxt/catalog/cards/global_mmlu/he/high_school_geography.json' 2026-01-06T13:30:41,114 adding 'unitxt/catalog/cards/global_mmlu/he/high_school_government_and_politics.json' 2026-01-06T13:30:41,116 adding 'unitxt/catalog/cards/global_mmlu/he/high_school_macroeconomics.json' 2026-01-06T13:30:41,117 adding 'unitxt/catalog/cards/global_mmlu/he/high_school_mathematics.json' 2026-01-06T13:30:41,118 adding 'unitxt/catalog/cards/global_mmlu/he/high_school_microeconomics.json' 2026-01-06T13:30:41,120 adding 'unitxt/catalog/cards/global_mmlu/he/high_school_physics.json' 2026-01-06T13:30:41,121 adding 'unitxt/catalog/cards/global_mmlu/he/high_school_psychology.json' 2026-01-06T13:30:41,122 adding 'unitxt/catalog/cards/global_mmlu/he/high_school_statistics.json' 2026-01-06T13:30:41,123 adding 'unitxt/catalog/cards/global_mmlu/he/high_school_us_history.json' 2026-01-06T13:30:41,125 adding 'unitxt/catalog/cards/global_mmlu/he/high_school_world_history.json' 2026-01-06T13:30:41,126 adding 'unitxt/catalog/cards/global_mmlu/he/human_aging.json' 2026-01-06T13:30:41,127 adding 'unitxt/catalog/cards/global_mmlu/he/human_sexuality.json' 2026-01-06T13:30:41,129 adding 'unitxt/catalog/cards/global_mmlu/he/international_law.json' 2026-01-06T13:30:41,130 adding 'unitxt/catalog/cards/global_mmlu/he/jurisprudence.json' 2026-01-06T13:30:41,131 adding 'unitxt/catalog/cards/global_mmlu/he/logical_fallacies.json' 2026-01-06T13:30:41,132 adding 'unitxt/catalog/cards/global_mmlu/he/machine_learning.json' 2026-01-06T13:30:41,134 adding 'unitxt/catalog/cards/global_mmlu/he/management.json' 2026-01-06T13:30:41,135 adding 'unitxt/catalog/cards/global_mmlu/he/marketing.json' 2026-01-06T13:30:41,136 adding 'unitxt/catalog/cards/global_mmlu/he/medical_genetics.json' 2026-01-06T13:30:41,138 adding 'unitxt/catalog/cards/global_mmlu/he/miscellaneous.json' 2026-01-06T13:30:41,139 adding 'unitxt/catalog/cards/global_mmlu/he/moral_disputes.json' 2026-01-06T13:30:41,140 adding 'unitxt/catalog/cards/global_mmlu/he/moral_scenarios.json' 2026-01-06T13:30:41,142 adding 'unitxt/catalog/cards/global_mmlu/he/nutrition.json' 2026-01-06T13:30:41,143 adding 'unitxt/catalog/cards/global_mmlu/he/philosophy.json' 2026-01-06T13:30:41,144 adding 'unitxt/catalog/cards/global_mmlu/he/prehistory.json' 2026-01-06T13:30:41,146 adding 'unitxt/catalog/cards/global_mmlu/he/professional_accounting.json' 2026-01-06T13:30:41,147 adding 'unitxt/catalog/cards/global_mmlu/he/professional_law.json' 2026-01-06T13:30:41,148 adding 'unitxt/catalog/cards/global_mmlu/he/professional_medicine.json' 2026-01-06T13:30:41,150 adding 'unitxt/catalog/cards/global_mmlu/he/professional_psychology.json' 2026-01-06T13:30:41,151 adding 'unitxt/catalog/cards/global_mmlu/he/public_relations.json' 2026-01-06T13:30:41,152 adding 'unitxt/catalog/cards/global_mmlu/he/security_studies.json' 2026-01-06T13:30:41,154 adding 'unitxt/catalog/cards/global_mmlu/he/sociology.json' 2026-01-06T13:30:41,155 adding 'unitxt/catalog/cards/global_mmlu/he/us_foreign_policy.json' 2026-01-06T13:30:41,156 adding 'unitxt/catalog/cards/global_mmlu/he/virology.json' 2026-01-06T13:30:41,158 adding 'unitxt/catalog/cards/global_mmlu/he/world_religions.json' 2026-01-06T13:30:41,161 adding 'unitxt/catalog/cards/global_mmlu/hi/abstract_algebra.json' 2026-01-06T13:30:41,162 adding 'unitxt/catalog/cards/global_mmlu/hi/anatomy.json' 2026-01-06T13:30:41,163 adding 'unitxt/catalog/cards/global_mmlu/hi/astronomy.json' 2026-01-06T13:30:41,165 adding 'unitxt/catalog/cards/global_mmlu/hi/business_ethics.json' 2026-01-06T13:30:41,166 adding 'unitxt/catalog/cards/global_mmlu/hi/clinical_knowledge.json' 2026-01-06T13:30:41,167 adding 'unitxt/catalog/cards/global_mmlu/hi/college_biology.json' 2026-01-06T13:30:41,168 adding 'unitxt/catalog/cards/global_mmlu/hi/college_chemistry.json' 2026-01-06T13:30:41,170 adding 'unitxt/catalog/cards/global_mmlu/hi/college_computer_science.json' 2026-01-06T13:30:41,171 adding 'unitxt/catalog/cards/global_mmlu/hi/college_mathematics.json' 2026-01-06T13:30:41,172 adding 'unitxt/catalog/cards/global_mmlu/hi/college_medicine.json' 2026-01-06T13:30:41,173 adding 'unitxt/catalog/cards/global_mmlu/hi/college_physics.json' 2026-01-06T13:30:41,175 adding 'unitxt/catalog/cards/global_mmlu/hi/computer_security.json' 2026-01-06T13:30:41,176 adding 'unitxt/catalog/cards/global_mmlu/hi/conceptual_physics.json' 2026-01-06T13:30:41,177 adding 'unitxt/catalog/cards/global_mmlu/hi/econometrics.json' 2026-01-06T13:30:41,179 adding 'unitxt/catalog/cards/global_mmlu/hi/electrical_engineering.json' 2026-01-06T13:30:41,180 adding 'unitxt/catalog/cards/global_mmlu/hi/elementary_mathematics.json' 2026-01-06T13:30:41,181 adding 'unitxt/catalog/cards/global_mmlu/hi/formal_logic.json' 2026-01-06T13:30:41,183 adding 'unitxt/catalog/cards/global_mmlu/hi/global_facts.json' 2026-01-06T13:30:41,184 adding 'unitxt/catalog/cards/global_mmlu/hi/high_school_biology.json' 2026-01-06T13:30:41,185 adding 'unitxt/catalog/cards/global_mmlu/hi/high_school_chemistry.json' 2026-01-06T13:30:41,186 adding 'unitxt/catalog/cards/global_mmlu/hi/high_school_computer_science.json' 2026-01-06T13:30:41,188 adding 'unitxt/catalog/cards/global_mmlu/hi/high_school_european_history.json' 2026-01-06T13:30:41,189 adding 'unitxt/catalog/cards/global_mmlu/hi/high_school_geography.json' 2026-01-06T13:30:41,190 adding 'unitxt/catalog/cards/global_mmlu/hi/high_school_government_and_politics.json' 2026-01-06T13:30:41,192 adding 'unitxt/catalog/cards/global_mmlu/hi/high_school_macroeconomics.json' 2026-01-06T13:30:41,193 adding 'unitxt/catalog/cards/global_mmlu/hi/high_school_mathematics.json' 2026-01-06T13:30:41,194 adding 'unitxt/catalog/cards/global_mmlu/hi/high_school_microeconomics.json' 2026-01-06T13:30:41,196 adding 'unitxt/catalog/cards/global_mmlu/hi/high_school_physics.json' 2026-01-06T13:30:41,197 adding 'unitxt/catalog/cards/global_mmlu/hi/high_school_psychology.json' 2026-01-06T13:30:41,198 adding 'unitxt/catalog/cards/global_mmlu/hi/high_school_statistics.json' 2026-01-06T13:30:41,200 adding 'unitxt/catalog/cards/global_mmlu/hi/high_school_us_history.json' 2026-01-06T13:30:41,201 adding 'unitxt/catalog/cards/global_mmlu/hi/high_school_world_history.json' 2026-01-06T13:30:41,202 adding 'unitxt/catalog/cards/global_mmlu/hi/human_aging.json' 2026-01-06T13:30:41,204 adding 'unitxt/catalog/cards/global_mmlu/hi/human_sexuality.json' 2026-01-06T13:30:41,205 adding 'unitxt/catalog/cards/global_mmlu/hi/international_law.json' 2026-01-06T13:30:41,206 adding 'unitxt/catalog/cards/global_mmlu/hi/jurisprudence.json' 2026-01-06T13:30:41,208 adding 'unitxt/catalog/cards/global_mmlu/hi/logical_fallacies.json' 2026-01-06T13:30:41,209 adding 'unitxt/catalog/cards/global_mmlu/hi/machine_learning.json' 2026-01-06T13:30:41,210 adding 'unitxt/catalog/cards/global_mmlu/hi/management.json' 2026-01-06T13:30:41,212 adding 'unitxt/catalog/cards/global_mmlu/hi/marketing.json' 2026-01-06T13:30:41,213 adding 'unitxt/catalog/cards/global_mmlu/hi/medical_genetics.json' 2026-01-06T13:30:41,214 adding 'unitxt/catalog/cards/global_mmlu/hi/miscellaneous.json' 2026-01-06T13:30:41,216 adding 'unitxt/catalog/cards/global_mmlu/hi/moral_disputes.json' 2026-01-06T13:30:41,217 adding 'unitxt/catalog/cards/global_mmlu/hi/moral_scenarios.json' 2026-01-06T13:30:41,218 adding 'unitxt/catalog/cards/global_mmlu/hi/nutrition.json' 2026-01-06T13:30:41,220 adding 'unitxt/catalog/cards/global_mmlu/hi/philosophy.json' 2026-01-06T13:30:41,221 adding 'unitxt/catalog/cards/global_mmlu/hi/prehistory.json' 2026-01-06T13:30:41,222 adding 'unitxt/catalog/cards/global_mmlu/hi/professional_accounting.json' 2026-01-06T13:30:41,224 adding 'unitxt/catalog/cards/global_mmlu/hi/professional_law.json' 2026-01-06T13:30:41,225 adding 'unitxt/catalog/cards/global_mmlu/hi/professional_medicine.json' 2026-01-06T13:30:41,226 adding 'unitxt/catalog/cards/global_mmlu/hi/professional_psychology.json' 2026-01-06T13:30:41,227 adding 'unitxt/catalog/cards/global_mmlu/hi/public_relations.json' 2026-01-06T13:30:41,229 adding 'unitxt/catalog/cards/global_mmlu/hi/security_studies.json' 2026-01-06T13:30:41,230 adding 'unitxt/catalog/cards/global_mmlu/hi/sociology.json' 2026-01-06T13:30:41,231 adding 'unitxt/catalog/cards/global_mmlu/hi/us_foreign_policy.json' 2026-01-06T13:30:41,232 adding 'unitxt/catalog/cards/global_mmlu/hi/virology.json' 2026-01-06T13:30:41,234 adding 'unitxt/catalog/cards/global_mmlu/hi/world_religions.json' 2026-01-06T13:30:41,236 adding 'unitxt/catalog/cards/global_mmlu/id/abstract_algebra.json' 2026-01-06T13:30:41,238 adding 'unitxt/catalog/cards/global_mmlu/id/anatomy.json' 2026-01-06T13:30:41,239 adding 'unitxt/catalog/cards/global_mmlu/id/astronomy.json' 2026-01-06T13:30:41,240 adding 'unitxt/catalog/cards/global_mmlu/id/business_ethics.json' 2026-01-06T13:30:41,242 adding 'unitxt/catalog/cards/global_mmlu/id/clinical_knowledge.json' 2026-01-06T13:30:41,243 adding 'unitxt/catalog/cards/global_mmlu/id/college_biology.json' 2026-01-06T13:30:41,244 adding 'unitxt/catalog/cards/global_mmlu/id/college_chemistry.json' 2026-01-06T13:30:41,245 adding 'unitxt/catalog/cards/global_mmlu/id/college_computer_science.json' 2026-01-06T13:30:41,247 adding 'unitxt/catalog/cards/global_mmlu/id/college_mathematics.json' 2026-01-06T13:30:41,248 adding 'unitxt/catalog/cards/global_mmlu/id/college_medicine.json' 2026-01-06T13:30:41,249 adding 'unitxt/catalog/cards/global_mmlu/id/college_physics.json' 2026-01-06T13:30:41,251 adding 'unitxt/catalog/cards/global_mmlu/id/computer_security.json' 2026-01-06T13:30:41,252 adding 'unitxt/catalog/cards/global_mmlu/id/conceptual_physics.json' 2026-01-06T13:30:41,253 adding 'unitxt/catalog/cards/global_mmlu/id/econometrics.json' 2026-01-06T13:30:41,254 adding 'unitxt/catalog/cards/global_mmlu/id/electrical_engineering.json' 2026-01-06T13:30:41,256 adding 'unitxt/catalog/cards/global_mmlu/id/elementary_mathematics.json' 2026-01-06T13:30:41,257 adding 'unitxt/catalog/cards/global_mmlu/id/formal_logic.json' 2026-01-06T13:30:41,258 adding 'unitxt/catalog/cards/global_mmlu/id/global_facts.json' 2026-01-06T13:30:41,260 adding 'unitxt/catalog/cards/global_mmlu/id/high_school_biology.json' 2026-01-06T13:30:41,261 adding 'unitxt/catalog/cards/global_mmlu/id/high_school_chemistry.json' 2026-01-06T13:30:41,262 adding 'unitxt/catalog/cards/global_mmlu/id/high_school_computer_science.json' 2026-01-06T13:30:41,264 adding 'unitxt/catalog/cards/global_mmlu/id/high_school_european_history.json' 2026-01-06T13:30:41,265 adding 'unitxt/catalog/cards/global_mmlu/id/high_school_geography.json' 2026-01-06T13:30:41,266 adding 'unitxt/catalog/cards/global_mmlu/id/high_school_government_and_politics.json' 2026-01-06T13:30:41,268 adding 'unitxt/catalog/cards/global_mmlu/id/high_school_macroeconomics.json' 2026-01-06T13:30:41,269 adding 'unitxt/catalog/cards/global_mmlu/id/high_school_mathematics.json' 2026-01-06T13:30:41,270 adding 'unitxt/catalog/cards/global_mmlu/id/high_school_microeconomics.json' 2026-01-06T13:30:41,272 adding 'unitxt/catalog/cards/global_mmlu/id/high_school_physics.json' 2026-01-06T13:30:41,273 adding 'unitxt/catalog/cards/global_mmlu/id/high_school_psychology.json' 2026-01-06T13:30:41,275 adding 'unitxt/catalog/cards/global_mmlu/id/high_school_statistics.json' 2026-01-06T13:30:41,276 adding 'unitxt/catalog/cards/global_mmlu/id/high_school_us_history.json' 2026-01-06T13:30:41,277 adding 'unitxt/catalog/cards/global_mmlu/id/high_school_world_history.json' 2026-01-06T13:30:41,279 adding 'unitxt/catalog/cards/global_mmlu/id/human_aging.json' 2026-01-06T13:30:41,280 adding 'unitxt/catalog/cards/global_mmlu/id/human_sexuality.json' 2026-01-06T13:30:41,281 adding 'unitxt/catalog/cards/global_mmlu/id/international_law.json' 2026-01-06T13:30:41,282 adding 'unitxt/catalog/cards/global_mmlu/id/jurisprudence.json' 2026-01-06T13:30:41,284 adding 'unitxt/catalog/cards/global_mmlu/id/logical_fallacies.json' 2026-01-06T13:30:41,285 adding 'unitxt/catalog/cards/global_mmlu/id/machine_learning.json' 2026-01-06T13:30:41,286 adding 'unitxt/catalog/cards/global_mmlu/id/management.json' 2026-01-06T13:30:41,287 adding 'unitxt/catalog/cards/global_mmlu/id/marketing.json' 2026-01-06T13:30:41,289 adding 'unitxt/catalog/cards/global_mmlu/id/medical_genetics.json' 2026-01-06T13:30:41,290 adding 'unitxt/catalog/cards/global_mmlu/id/miscellaneous.json' 2026-01-06T13:30:41,291 adding 'unitxt/catalog/cards/global_mmlu/id/moral_disputes.json' 2026-01-06T13:30:41,292 adding 'unitxt/catalog/cards/global_mmlu/id/moral_scenarios.json' 2026-01-06T13:30:41,294 adding 'unitxt/catalog/cards/global_mmlu/id/nutrition.json' 2026-01-06T13:30:41,295 adding 'unitxt/catalog/cards/global_mmlu/id/philosophy.json' 2026-01-06T13:30:41,296 adding 'unitxt/catalog/cards/global_mmlu/id/prehistory.json' 2026-01-06T13:30:41,298 adding 'unitxt/catalog/cards/global_mmlu/id/professional_accounting.json' 2026-01-06T13:30:41,299 adding 'unitxt/catalog/cards/global_mmlu/id/professional_law.json' 2026-01-06T13:30:41,300 adding 'unitxt/catalog/cards/global_mmlu/id/professional_medicine.json' 2026-01-06T13:30:41,301 adding 'unitxt/catalog/cards/global_mmlu/id/professional_psychology.json' 2026-01-06T13:30:41,303 adding 'unitxt/catalog/cards/global_mmlu/id/public_relations.json' 2026-01-06T13:30:41,304 adding 'unitxt/catalog/cards/global_mmlu/id/security_studies.json' 2026-01-06T13:30:41,305 adding 'unitxt/catalog/cards/global_mmlu/id/sociology.json' 2026-01-06T13:30:41,307 adding 'unitxt/catalog/cards/global_mmlu/id/us_foreign_policy.json' 2026-01-06T13:30:41,308 adding 'unitxt/catalog/cards/global_mmlu/id/virology.json' 2026-01-06T13:30:41,309 adding 'unitxt/catalog/cards/global_mmlu/id/world_religions.json' 2026-01-06T13:30:41,312 adding 'unitxt/catalog/cards/global_mmlu/ig/abstract_algebra.json' 2026-01-06T13:30:41,313 adding 'unitxt/catalog/cards/global_mmlu/ig/anatomy.json' 2026-01-06T13:30:41,315 adding 'unitxt/catalog/cards/global_mmlu/ig/astronomy.json' 2026-01-06T13:30:41,316 adding 'unitxt/catalog/cards/global_mmlu/ig/business_ethics.json' 2026-01-06T13:30:41,317 adding 'unitxt/catalog/cards/global_mmlu/ig/clinical_knowledge.json' 2026-01-06T13:30:41,319 adding 'unitxt/catalog/cards/global_mmlu/ig/college_biology.json' 2026-01-06T13:30:41,320 adding 'unitxt/catalog/cards/global_mmlu/ig/college_chemistry.json' 2026-01-06T13:30:41,321 adding 'unitxt/catalog/cards/global_mmlu/ig/college_computer_science.json' 2026-01-06T13:30:41,323 adding 'unitxt/catalog/cards/global_mmlu/ig/college_mathematics.json' 2026-01-06T13:30:41,324 adding 'unitxt/catalog/cards/global_mmlu/ig/college_medicine.json' 2026-01-06T13:30:41,325 adding 'unitxt/catalog/cards/global_mmlu/ig/college_physics.json' 2026-01-06T13:30:41,327 adding 'unitxt/catalog/cards/global_mmlu/ig/computer_security.json' 2026-01-06T13:30:41,328 adding 'unitxt/catalog/cards/global_mmlu/ig/conceptual_physics.json' 2026-01-06T13:30:41,329 adding 'unitxt/catalog/cards/global_mmlu/ig/econometrics.json' 2026-01-06T13:30:41,331 adding 'unitxt/catalog/cards/global_mmlu/ig/electrical_engineering.json' 2026-01-06T13:30:41,332 adding 'unitxt/catalog/cards/global_mmlu/ig/elementary_mathematics.json' 2026-01-06T13:30:41,333 adding 'unitxt/catalog/cards/global_mmlu/ig/formal_logic.json' 2026-01-06T13:30:41,335 adding 'unitxt/catalog/cards/global_mmlu/ig/global_facts.json' 2026-01-06T13:30:41,336 adding 'unitxt/catalog/cards/global_mmlu/ig/high_school_biology.json' 2026-01-06T13:30:41,337 adding 'unitxt/catalog/cards/global_mmlu/ig/high_school_chemistry.json' 2026-01-06T13:30:41,339 adding 'unitxt/catalog/cards/global_mmlu/ig/high_school_computer_science.json' 2026-01-06T13:30:41,340 adding 'unitxt/catalog/cards/global_mmlu/ig/high_school_european_history.json' 2026-01-06T13:30:41,341 adding 'unitxt/catalog/cards/global_mmlu/ig/high_school_geography.json' 2026-01-06T13:30:41,343 adding 'unitxt/catalog/cards/global_mmlu/ig/high_school_government_and_politics.json' 2026-01-06T13:30:41,344 adding 'unitxt/catalog/cards/global_mmlu/ig/high_school_macroeconomics.json' 2026-01-06T13:30:41,345 adding 'unitxt/catalog/cards/global_mmlu/ig/high_school_mathematics.json' 2026-01-06T13:30:41,346 adding 'unitxt/catalog/cards/global_mmlu/ig/high_school_microeconomics.json' 2026-01-06T13:30:41,348 adding 'unitxt/catalog/cards/global_mmlu/ig/high_school_physics.json' 2026-01-06T13:30:41,349 adding 'unitxt/catalog/cards/global_mmlu/ig/high_school_psychology.json' 2026-01-06T13:30:41,350 adding 'unitxt/catalog/cards/global_mmlu/ig/high_school_statistics.json' 2026-01-06T13:30:41,352 adding 'unitxt/catalog/cards/global_mmlu/ig/high_school_us_history.json' 2026-01-06T13:30:41,353 adding 'unitxt/catalog/cards/global_mmlu/ig/high_school_world_history.json' 2026-01-06T13:30:41,354 adding 'unitxt/catalog/cards/global_mmlu/ig/human_aging.json' 2026-01-06T13:30:41,356 adding 'unitxt/catalog/cards/global_mmlu/ig/human_sexuality.json' 2026-01-06T13:30:41,357 adding 'unitxt/catalog/cards/global_mmlu/ig/international_law.json' 2026-01-06T13:30:41,358 adding 'unitxt/catalog/cards/global_mmlu/ig/jurisprudence.json' 2026-01-06T13:30:41,359 adding 'unitxt/catalog/cards/global_mmlu/ig/logical_fallacies.json' 2026-01-06T13:30:41,361 adding 'unitxt/catalog/cards/global_mmlu/ig/machine_learning.json' 2026-01-06T13:30:41,362 adding 'unitxt/catalog/cards/global_mmlu/ig/management.json' 2026-01-06T13:30:41,363 adding 'unitxt/catalog/cards/global_mmlu/ig/marketing.json' 2026-01-06T13:30:41,365 adding 'unitxt/catalog/cards/global_mmlu/ig/medical_genetics.json' 2026-01-06T13:30:41,366 adding 'unitxt/catalog/cards/global_mmlu/ig/miscellaneous.json' 2026-01-06T13:30:41,367 adding 'unitxt/catalog/cards/global_mmlu/ig/moral_disputes.json' 2026-01-06T13:30:41,369 adding 'unitxt/catalog/cards/global_mmlu/ig/moral_scenarios.json' 2026-01-06T13:30:41,370 adding 'unitxt/catalog/cards/global_mmlu/ig/nutrition.json' 2026-01-06T13:30:41,371 adding 'unitxt/catalog/cards/global_mmlu/ig/philosophy.json' 2026-01-06T13:30:41,373 adding 'unitxt/catalog/cards/global_mmlu/ig/prehistory.json' 2026-01-06T13:30:41,374 adding 'unitxt/catalog/cards/global_mmlu/ig/professional_accounting.json' 2026-01-06T13:30:41,375 adding 'unitxt/catalog/cards/global_mmlu/ig/professional_law.json' 2026-01-06T13:30:41,377 adding 'unitxt/catalog/cards/global_mmlu/ig/professional_medicine.json' 2026-01-06T13:30:41,378 adding 'unitxt/catalog/cards/global_mmlu/ig/professional_psychology.json' 2026-01-06T13:30:41,379 adding 'unitxt/catalog/cards/global_mmlu/ig/public_relations.json' 2026-01-06T13:30:41,381 adding 'unitxt/catalog/cards/global_mmlu/ig/security_studies.json' 2026-01-06T13:30:41,382 adding 'unitxt/catalog/cards/global_mmlu/ig/sociology.json' 2026-01-06T13:30:41,383 adding 'unitxt/catalog/cards/global_mmlu/ig/us_foreign_policy.json' 2026-01-06T13:30:41,385 adding 'unitxt/catalog/cards/global_mmlu/ig/virology.json' 2026-01-06T13:30:41,386 adding 'unitxt/catalog/cards/global_mmlu/ig/world_religions.json' 2026-01-06T13:30:41,389 adding 'unitxt/catalog/cards/global_mmlu/it/abstract_algebra.json' 2026-01-06T13:30:41,391 adding 'unitxt/catalog/cards/global_mmlu/it/anatomy.json' 2026-01-06T13:30:41,392 adding 'unitxt/catalog/cards/global_mmlu/it/astronomy.json' 2026-01-06T13:30:41,393 adding 'unitxt/catalog/cards/global_mmlu/it/business_ethics.json' 2026-01-06T13:30:41,395 adding 'unitxt/catalog/cards/global_mmlu/it/clinical_knowledge.json' 2026-01-06T13:30:41,396 adding 'unitxt/catalog/cards/global_mmlu/it/college_biology.json' 2026-01-06T13:30:41,397 adding 'unitxt/catalog/cards/global_mmlu/it/college_chemistry.json' 2026-01-06T13:30:41,399 adding 'unitxt/catalog/cards/global_mmlu/it/college_computer_science.json' 2026-01-06T13:30:41,400 adding 'unitxt/catalog/cards/global_mmlu/it/college_mathematics.json' 2026-01-06T13:30:41,401 adding 'unitxt/catalog/cards/global_mmlu/it/college_medicine.json' 2026-01-06T13:30:41,402 adding 'unitxt/catalog/cards/global_mmlu/it/college_physics.json' 2026-01-06T13:30:41,404 adding 'unitxt/catalog/cards/global_mmlu/it/computer_security.json' 2026-01-06T13:30:41,405 adding 'unitxt/catalog/cards/global_mmlu/it/conceptual_physics.json' 2026-01-06T13:30:41,406 adding 'unitxt/catalog/cards/global_mmlu/it/econometrics.json' 2026-01-06T13:30:41,407 adding 'unitxt/catalog/cards/global_mmlu/it/electrical_engineering.json' 2026-01-06T13:30:41,409 adding 'unitxt/catalog/cards/global_mmlu/it/elementary_mathematics.json' 2026-01-06T13:30:41,410 adding 'unitxt/catalog/cards/global_mmlu/it/formal_logic.json' 2026-01-06T13:30:41,411 adding 'unitxt/catalog/cards/global_mmlu/it/global_facts.json' 2026-01-06T13:30:41,413 adding 'unitxt/catalog/cards/global_mmlu/it/high_school_biology.json' 2026-01-06T13:30:41,414 adding 'unitxt/catalog/cards/global_mmlu/it/high_school_chemistry.json' 2026-01-06T13:30:41,415 adding 'unitxt/catalog/cards/global_mmlu/it/high_school_computer_science.json' 2026-01-06T13:30:41,417 adding 'unitxt/catalog/cards/global_mmlu/it/high_school_european_history.json' 2026-01-06T13:30:41,418 adding 'unitxt/catalog/cards/global_mmlu/it/high_school_geography.json' 2026-01-06T13:30:41,419 adding 'unitxt/catalog/cards/global_mmlu/it/high_school_government_and_politics.json' 2026-01-06T13:30:41,420 adding 'unitxt/catalog/cards/global_mmlu/it/high_school_macroeconomics.json' 2026-01-06T13:30:41,422 adding 'unitxt/catalog/cards/global_mmlu/it/high_school_mathematics.json' 2026-01-06T13:30:41,423 adding 'unitxt/catalog/cards/global_mmlu/it/high_school_microeconomics.json' 2026-01-06T13:30:41,424 adding 'unitxt/catalog/cards/global_mmlu/it/high_school_physics.json' 2026-01-06T13:30:41,426 adding 'unitxt/catalog/cards/global_mmlu/it/high_school_psychology.json' 2026-01-06T13:30:41,427 adding 'unitxt/catalog/cards/global_mmlu/it/high_school_statistics.json' 2026-01-06T13:30:41,428 adding 'unitxt/catalog/cards/global_mmlu/it/high_school_us_history.json' 2026-01-06T13:30:41,430 adding 'unitxt/catalog/cards/global_mmlu/it/high_school_world_history.json' 2026-01-06T13:30:41,431 adding 'unitxt/catalog/cards/global_mmlu/it/human_aging.json' 2026-01-06T13:30:41,432 adding 'unitxt/catalog/cards/global_mmlu/it/human_sexuality.json' 2026-01-06T13:30:41,434 adding 'unitxt/catalog/cards/global_mmlu/it/international_law.json' 2026-01-06T13:30:41,435 adding 'unitxt/catalog/cards/global_mmlu/it/jurisprudence.json' 2026-01-06T13:30:41,436 adding 'unitxt/catalog/cards/global_mmlu/it/logical_fallacies.json' 2026-01-06T13:30:41,438 adding 'unitxt/catalog/cards/global_mmlu/it/machine_learning.json' 2026-01-06T13:30:41,439 adding 'unitxt/catalog/cards/global_mmlu/it/management.json' 2026-01-06T13:30:41,440 adding 'unitxt/catalog/cards/global_mmlu/it/marketing.json' 2026-01-06T13:30:41,442 adding 'unitxt/catalog/cards/global_mmlu/it/medical_genetics.json' 2026-01-06T13:30:41,443 adding 'unitxt/catalog/cards/global_mmlu/it/miscellaneous.json' 2026-01-06T13:30:41,444 adding 'unitxt/catalog/cards/global_mmlu/it/moral_disputes.json' 2026-01-06T13:30:41,446 adding 'unitxt/catalog/cards/global_mmlu/it/moral_scenarios.json' 2026-01-06T13:30:41,447 adding 'unitxt/catalog/cards/global_mmlu/it/nutrition.json' 2026-01-06T13:30:41,448 adding 'unitxt/catalog/cards/global_mmlu/it/philosophy.json' 2026-01-06T13:30:41,450 adding 'unitxt/catalog/cards/global_mmlu/it/prehistory.json' 2026-01-06T13:30:41,451 adding 'unitxt/catalog/cards/global_mmlu/it/professional_accounting.json' 2026-01-06T13:30:41,452 adding 'unitxt/catalog/cards/global_mmlu/it/professional_law.json' 2026-01-06T13:30:41,454 adding 'unitxt/catalog/cards/global_mmlu/it/professional_medicine.json' 2026-01-06T13:30:41,455 adding 'unitxt/catalog/cards/global_mmlu/it/professional_psychology.json' 2026-01-06T13:30:41,456 adding 'unitxt/catalog/cards/global_mmlu/it/public_relations.json' 2026-01-06T13:30:41,458 adding 'unitxt/catalog/cards/global_mmlu/it/security_studies.json' 2026-01-06T13:30:41,459 adding 'unitxt/catalog/cards/global_mmlu/it/sociology.json' 2026-01-06T13:30:41,460 adding 'unitxt/catalog/cards/global_mmlu/it/us_foreign_policy.json' 2026-01-06T13:30:41,461 adding 'unitxt/catalog/cards/global_mmlu/it/virology.json' 2026-01-06T13:30:41,462 adding 'unitxt/catalog/cards/global_mmlu/it/world_religions.json' 2026-01-06T13:30:41,465 adding 'unitxt/catalog/cards/global_mmlu/ja/abstract_algebra.json' 2026-01-06T13:30:41,466 adding 'unitxt/catalog/cards/global_mmlu/ja/anatomy.json' 2026-01-06T13:30:41,468 adding 'unitxt/catalog/cards/global_mmlu/ja/astronomy.json' 2026-01-06T13:30:41,469 adding 'unitxt/catalog/cards/global_mmlu/ja/business_ethics.json' 2026-01-06T13:30:41,470 adding 'unitxt/catalog/cards/global_mmlu/ja/clinical_knowledge.json' 2026-01-06T13:30:41,471 adding 'unitxt/catalog/cards/global_mmlu/ja/college_biology.json' 2026-01-06T13:30:41,473 adding 'unitxt/catalog/cards/global_mmlu/ja/college_chemistry.json' 2026-01-06T13:30:41,474 adding 'unitxt/catalog/cards/global_mmlu/ja/college_computer_science.json' 2026-01-06T13:30:41,475 adding 'unitxt/catalog/cards/global_mmlu/ja/college_mathematics.json' 2026-01-06T13:30:41,477 adding 'unitxt/catalog/cards/global_mmlu/ja/college_medicine.json' 2026-01-06T13:30:41,478 adding 'unitxt/catalog/cards/global_mmlu/ja/college_physics.json' 2026-01-06T13:30:41,479 adding 'unitxt/catalog/cards/global_mmlu/ja/computer_security.json' 2026-01-06T13:30:41,480 adding 'unitxt/catalog/cards/global_mmlu/ja/conceptual_physics.json' 2026-01-06T13:30:41,482 adding 'unitxt/catalog/cards/global_mmlu/ja/econometrics.json' 2026-01-06T13:30:41,483 adding 'unitxt/catalog/cards/global_mmlu/ja/electrical_engineering.json' 2026-01-06T13:30:41,485 adding 'unitxt/catalog/cards/global_mmlu/ja/elementary_mathematics.json' 2026-01-06T13:30:41,486 adding 'unitxt/catalog/cards/global_mmlu/ja/formal_logic.json' 2026-01-06T13:30:41,487 adding 'unitxt/catalog/cards/global_mmlu/ja/global_facts.json' 2026-01-06T13:30:41,489 adding 'unitxt/catalog/cards/global_mmlu/ja/high_school_biology.json' 2026-01-06T13:30:41,490 adding 'unitxt/catalog/cards/global_mmlu/ja/high_school_chemistry.json' 2026-01-06T13:30:41,491 adding 'unitxt/catalog/cards/global_mmlu/ja/high_school_computer_science.json' 2026-01-06T13:30:41,493 adding 'unitxt/catalog/cards/global_mmlu/ja/high_school_european_history.json' 2026-01-06T13:30:41,494 adding 'unitxt/catalog/cards/global_mmlu/ja/high_school_geography.json' 2026-01-06T13:30:41,495 adding 'unitxt/catalog/cards/global_mmlu/ja/high_school_government_and_politics.json' 2026-01-06T13:30:41,497 adding 'unitxt/catalog/cards/global_mmlu/ja/high_school_macroeconomics.json' 2026-01-06T13:30:41,498 adding 'unitxt/catalog/cards/global_mmlu/ja/high_school_mathematics.json' 2026-01-06T13:30:41,500 adding 'unitxt/catalog/cards/global_mmlu/ja/high_school_microeconomics.json' 2026-01-06T13:30:41,501 adding 'unitxt/catalog/cards/global_mmlu/ja/high_school_physics.json' 2026-01-06T13:30:41,502 adding 'unitxt/catalog/cards/global_mmlu/ja/high_school_psychology.json' 2026-01-06T13:30:41,504 adding 'unitxt/catalog/cards/global_mmlu/ja/high_school_statistics.json' 2026-01-06T13:30:41,505 adding 'unitxt/catalog/cards/global_mmlu/ja/high_school_us_history.json' 2026-01-06T13:30:41,506 adding 'unitxt/catalog/cards/global_mmlu/ja/high_school_world_history.json' 2026-01-06T13:30:41,508 adding 'unitxt/catalog/cards/global_mmlu/ja/human_aging.json' 2026-01-06T13:30:41,509 adding 'unitxt/catalog/cards/global_mmlu/ja/human_sexuality.json' 2026-01-06T13:30:41,510 adding 'unitxt/catalog/cards/global_mmlu/ja/international_law.json' 2026-01-06T13:30:41,512 adding 'unitxt/catalog/cards/global_mmlu/ja/jurisprudence.json' 2026-01-06T13:30:41,513 adding 'unitxt/catalog/cards/global_mmlu/ja/logical_fallacies.json' 2026-01-06T13:30:41,514 adding 'unitxt/catalog/cards/global_mmlu/ja/machine_learning.json' 2026-01-06T13:30:41,515 adding 'unitxt/catalog/cards/global_mmlu/ja/management.json' 2026-01-06T13:30:41,517 adding 'unitxt/catalog/cards/global_mmlu/ja/marketing.json' 2026-01-06T13:30:41,518 adding 'unitxt/catalog/cards/global_mmlu/ja/medical_genetics.json' 2026-01-06T13:30:41,519 adding 'unitxt/catalog/cards/global_mmlu/ja/miscellaneous.json' 2026-01-06T13:30:41,520 adding 'unitxt/catalog/cards/global_mmlu/ja/moral_disputes.json' 2026-01-06T13:30:41,522 adding 'unitxt/catalog/cards/global_mmlu/ja/moral_scenarios.json' 2026-01-06T13:30:41,523 adding 'unitxt/catalog/cards/global_mmlu/ja/nutrition.json' 2026-01-06T13:30:41,524 adding 'unitxt/catalog/cards/global_mmlu/ja/philosophy.json' 2026-01-06T13:30:41,525 adding 'unitxt/catalog/cards/global_mmlu/ja/prehistory.json' 2026-01-06T13:30:41,527 adding 'unitxt/catalog/cards/global_mmlu/ja/professional_accounting.json' 2026-01-06T13:30:41,528 adding 'unitxt/catalog/cards/global_mmlu/ja/professional_law.json' 2026-01-06T13:30:41,530 adding 'unitxt/catalog/cards/global_mmlu/ja/professional_medicine.json' 2026-01-06T13:30:41,531 adding 'unitxt/catalog/cards/global_mmlu/ja/professional_psychology.json' 2026-01-06T13:30:41,532 adding 'unitxt/catalog/cards/global_mmlu/ja/public_relations.json' 2026-01-06T13:30:41,533 adding 'unitxt/catalog/cards/global_mmlu/ja/security_studies.json' 2026-01-06T13:30:41,535 adding 'unitxt/catalog/cards/global_mmlu/ja/sociology.json' 2026-01-06T13:30:41,536 adding 'unitxt/catalog/cards/global_mmlu/ja/us_foreign_policy.json' 2026-01-06T13:30:41,537 adding 'unitxt/catalog/cards/global_mmlu/ja/virology.json' 2026-01-06T13:30:41,539 adding 'unitxt/catalog/cards/global_mmlu/ja/world_religions.json' 2026-01-06T13:30:41,541 adding 'unitxt/catalog/cards/global_mmlu/ko/abstract_algebra.json' 2026-01-06T13:30:41,543 adding 'unitxt/catalog/cards/global_mmlu/ko/anatomy.json' 2026-01-06T13:30:41,544 adding 'unitxt/catalog/cards/global_mmlu/ko/astronomy.json' 2026-01-06T13:30:41,545 adding 'unitxt/catalog/cards/global_mmlu/ko/business_ethics.json' 2026-01-06T13:30:41,547 adding 'unitxt/catalog/cards/global_mmlu/ko/clinical_knowledge.json' 2026-01-06T13:30:41,548 adding 'unitxt/catalog/cards/global_mmlu/ko/college_biology.json' 2026-01-06T13:30:41,550 adding 'unitxt/catalog/cards/global_mmlu/ko/college_chemistry.json' 2026-01-06T13:30:41,551 adding 'unitxt/catalog/cards/global_mmlu/ko/college_computer_science.json' 2026-01-06T13:30:41,553 adding 'unitxt/catalog/cards/global_mmlu/ko/college_mathematics.json' 2026-01-06T13:30:41,554 adding 'unitxt/catalog/cards/global_mmlu/ko/college_medicine.json' 2026-01-06T13:30:41,556 adding 'unitxt/catalog/cards/global_mmlu/ko/college_physics.json' 2026-01-06T13:30:41,558 adding 'unitxt/catalog/cards/global_mmlu/ko/computer_security.json' 2026-01-06T13:30:41,559 adding 'unitxt/catalog/cards/global_mmlu/ko/conceptual_physics.json' 2026-01-06T13:30:41,561 adding 'unitxt/catalog/cards/global_mmlu/ko/econometrics.json' 2026-01-06T13:30:41,562 adding 'unitxt/catalog/cards/global_mmlu/ko/electrical_engineering.json' 2026-01-06T13:30:41,563 adding 'unitxt/catalog/cards/global_mmlu/ko/elementary_mathematics.json' 2026-01-06T13:30:41,565 adding 'unitxt/catalog/cards/global_mmlu/ko/formal_logic.json' 2026-01-06T13:30:41,566 adding 'unitxt/catalog/cards/global_mmlu/ko/global_facts.json' 2026-01-06T13:30:41,567 adding 'unitxt/catalog/cards/global_mmlu/ko/high_school_biology.json' 2026-01-06T13:30:41,569 adding 'unitxt/catalog/cards/global_mmlu/ko/high_school_chemistry.json' 2026-01-06T13:30:41,570 adding 'unitxt/catalog/cards/global_mmlu/ko/high_school_computer_science.json' 2026-01-06T13:30:41,571 adding 'unitxt/catalog/cards/global_mmlu/ko/high_school_european_history.json' 2026-01-06T13:30:41,573 adding 'unitxt/catalog/cards/global_mmlu/ko/high_school_geography.json' 2026-01-06T13:30:41,574 adding 'unitxt/catalog/cards/global_mmlu/ko/high_school_government_and_politics.json' 2026-01-06T13:30:41,575 adding 'unitxt/catalog/cards/global_mmlu/ko/high_school_macroeconomics.json' 2026-01-06T13:30:41,577 adding 'unitxt/catalog/cards/global_mmlu/ko/high_school_mathematics.json' 2026-01-06T13:30:41,578 adding 'unitxt/catalog/cards/global_mmlu/ko/high_school_microeconomics.json' 2026-01-06T13:30:41,579 adding 'unitxt/catalog/cards/global_mmlu/ko/high_school_physics.json' 2026-01-06T13:30:41,581 adding 'unitxt/catalog/cards/global_mmlu/ko/high_school_psychology.json' 2026-01-06T13:30:41,582 adding 'unitxt/catalog/cards/global_mmlu/ko/high_school_statistics.json' 2026-01-06T13:30:41,583 adding 'unitxt/catalog/cards/global_mmlu/ko/high_school_us_history.json' 2026-01-06T13:30:41,585 adding 'unitxt/catalog/cards/global_mmlu/ko/high_school_world_history.json' 2026-01-06T13:30:41,586 adding 'unitxt/catalog/cards/global_mmlu/ko/human_aging.json' 2026-01-06T13:30:41,587 adding 'unitxt/catalog/cards/global_mmlu/ko/human_sexuality.json' 2026-01-06T13:30:41,589 adding 'unitxt/catalog/cards/global_mmlu/ko/international_law.json' 2026-01-06T13:30:41,591 adding 'unitxt/catalog/cards/global_mmlu/ko/jurisprudence.json' 2026-01-06T13:30:41,592 adding 'unitxt/catalog/cards/global_mmlu/ko/logical_fallacies.json' 2026-01-06T13:30:41,593 adding 'unitxt/catalog/cards/global_mmlu/ko/machine_learning.json' 2026-01-06T13:30:41,595 adding 'unitxt/catalog/cards/global_mmlu/ko/management.json' 2026-01-06T13:30:41,597 adding 'unitxt/catalog/cards/global_mmlu/ko/marketing.json' 2026-01-06T13:30:41,598 adding 'unitxt/catalog/cards/global_mmlu/ko/medical_genetics.json' 2026-01-06T13:30:41,600 adding 'unitxt/catalog/cards/global_mmlu/ko/miscellaneous.json' 2026-01-06T13:30:41,601 adding 'unitxt/catalog/cards/global_mmlu/ko/moral_disputes.json' 2026-01-06T13:30:41,603 adding 'unitxt/catalog/cards/global_mmlu/ko/moral_scenarios.json' 2026-01-06T13:30:41,604 adding 'unitxt/catalog/cards/global_mmlu/ko/nutrition.json' 2026-01-06T13:30:41,606 adding 'unitxt/catalog/cards/global_mmlu/ko/philosophy.json' 2026-01-06T13:30:41,607 adding 'unitxt/catalog/cards/global_mmlu/ko/prehistory.json' 2026-01-06T13:30:41,608 adding 'unitxt/catalog/cards/global_mmlu/ko/professional_accounting.json' 2026-01-06T13:30:41,610 adding 'unitxt/catalog/cards/global_mmlu/ko/professional_law.json' 2026-01-06T13:30:41,611 adding 'unitxt/catalog/cards/global_mmlu/ko/professional_medicine.json' 2026-01-06T13:30:41,612 adding 'unitxt/catalog/cards/global_mmlu/ko/professional_psychology.json' 2026-01-06T13:30:41,614 adding 'unitxt/catalog/cards/global_mmlu/ko/public_relations.json' 2026-01-06T13:30:41,615 adding 'unitxt/catalog/cards/global_mmlu/ko/security_studies.json' 2026-01-06T13:30:41,616 adding 'unitxt/catalog/cards/global_mmlu/ko/sociology.json' 2026-01-06T13:30:41,618 adding 'unitxt/catalog/cards/global_mmlu/ko/us_foreign_policy.json' 2026-01-06T13:30:41,619 adding 'unitxt/catalog/cards/global_mmlu/ko/virology.json' 2026-01-06T13:30:41,620 adding 'unitxt/catalog/cards/global_mmlu/ko/world_religions.json' 2026-01-06T13:30:41,623 adding 'unitxt/catalog/cards/global_mmlu/ky/abstract_algebra.json' 2026-01-06T13:30:41,624 adding 'unitxt/catalog/cards/global_mmlu/ky/anatomy.json' 2026-01-06T13:30:41,626 adding 'unitxt/catalog/cards/global_mmlu/ky/astronomy.json' 2026-01-06T13:30:41,627 adding 'unitxt/catalog/cards/global_mmlu/ky/business_ethics.json' 2026-01-06T13:30:41,628 adding 'unitxt/catalog/cards/global_mmlu/ky/clinical_knowledge.json' 2026-01-06T13:30:41,630 adding 'unitxt/catalog/cards/global_mmlu/ky/college_biology.json' 2026-01-06T13:30:41,631 adding 'unitxt/catalog/cards/global_mmlu/ky/college_chemistry.json' 2026-01-06T13:30:41,633 adding 'unitxt/catalog/cards/global_mmlu/ky/college_computer_science.json' 2026-01-06T13:30:41,634 adding 'unitxt/catalog/cards/global_mmlu/ky/college_mathematics.json' 2026-01-06T13:30:41,636 adding 'unitxt/catalog/cards/global_mmlu/ky/college_medicine.json' 2026-01-06T13:30:41,638 adding 'unitxt/catalog/cards/global_mmlu/ky/college_physics.json' 2026-01-06T13:30:41,639 adding 'unitxt/catalog/cards/global_mmlu/ky/computer_security.json' 2026-01-06T13:30:41,641 adding 'unitxt/catalog/cards/global_mmlu/ky/conceptual_physics.json' 2026-01-06T13:30:41,643 adding 'unitxt/catalog/cards/global_mmlu/ky/econometrics.json' 2026-01-06T13:30:41,645 adding 'unitxt/catalog/cards/global_mmlu/ky/electrical_engineering.json' 2026-01-06T13:30:41,647 adding 'unitxt/catalog/cards/global_mmlu/ky/elementary_mathematics.json' 2026-01-06T13:30:41,648 adding 'unitxt/catalog/cards/global_mmlu/ky/formal_logic.json' 2026-01-06T13:30:41,649 adding 'unitxt/catalog/cards/global_mmlu/ky/global_facts.json' 2026-01-06T13:30:41,651 adding 'unitxt/catalog/cards/global_mmlu/ky/high_school_biology.json' 2026-01-06T13:30:41,652 adding 'unitxt/catalog/cards/global_mmlu/ky/high_school_chemistry.json' 2026-01-06T13:30:41,653 adding 'unitxt/catalog/cards/global_mmlu/ky/high_school_computer_science.json' 2026-01-06T13:30:41,655 adding 'unitxt/catalog/cards/global_mmlu/ky/high_school_european_history.json' 2026-01-06T13:30:41,656 adding 'unitxt/catalog/cards/global_mmlu/ky/high_school_geography.json' 2026-01-06T13:30:41,657 adding 'unitxt/catalog/cards/global_mmlu/ky/high_school_government_and_politics.json' 2026-01-06T13:30:41,659 adding 'unitxt/catalog/cards/global_mmlu/ky/high_school_macroeconomics.json' 2026-01-06T13:30:41,660 adding 'unitxt/catalog/cards/global_mmlu/ky/high_school_mathematics.json' 2026-01-06T13:30:41,662 adding 'unitxt/catalog/cards/global_mmlu/ky/high_school_microeconomics.json' 2026-01-06T13:30:41,663 adding 'unitxt/catalog/cards/global_mmlu/ky/high_school_physics.json' 2026-01-06T13:30:41,664 adding 'unitxt/catalog/cards/global_mmlu/ky/high_school_psychology.json' 2026-01-06T13:30:41,665 adding 'unitxt/catalog/cards/global_mmlu/ky/high_school_statistics.json' 2026-01-06T13:30:41,667 adding 'unitxt/catalog/cards/global_mmlu/ky/high_school_us_history.json' 2026-01-06T13:30:41,668 adding 'unitxt/catalog/cards/global_mmlu/ky/high_school_world_history.json' 2026-01-06T13:30:41,669 adding 'unitxt/catalog/cards/global_mmlu/ky/human_aging.json' 2026-01-06T13:30:41,671 adding 'unitxt/catalog/cards/global_mmlu/ky/human_sexuality.json' 2026-01-06T13:30:41,672 adding 'unitxt/catalog/cards/global_mmlu/ky/international_law.json' 2026-01-06T13:30:41,673 adding 'unitxt/catalog/cards/global_mmlu/ky/jurisprudence.json' 2026-01-06T13:30:41,675 adding 'unitxt/catalog/cards/global_mmlu/ky/logical_fallacies.json' 2026-01-06T13:30:41,676 adding 'unitxt/catalog/cards/global_mmlu/ky/machine_learning.json' 2026-01-06T13:30:41,677 adding 'unitxt/catalog/cards/global_mmlu/ky/management.json' 2026-01-06T13:30:41,679 adding 'unitxt/catalog/cards/global_mmlu/ky/marketing.json' 2026-01-06T13:30:41,680 adding 'unitxt/catalog/cards/global_mmlu/ky/medical_genetics.json' 2026-01-06T13:30:41,681 adding 'unitxt/catalog/cards/global_mmlu/ky/miscellaneous.json' 2026-01-06T13:30:41,683 adding 'unitxt/catalog/cards/global_mmlu/ky/moral_disputes.json' 2026-01-06T13:30:41,684 adding 'unitxt/catalog/cards/global_mmlu/ky/moral_scenarios.json' 2026-01-06T13:30:41,685 adding 'unitxt/catalog/cards/global_mmlu/ky/nutrition.json' 2026-01-06T13:30:41,687 adding 'unitxt/catalog/cards/global_mmlu/ky/philosophy.json' 2026-01-06T13:30:41,688 adding 'unitxt/catalog/cards/global_mmlu/ky/prehistory.json' 2026-01-06T13:30:41,689 adding 'unitxt/catalog/cards/global_mmlu/ky/professional_accounting.json' 2026-01-06T13:30:41,691 adding 'unitxt/catalog/cards/global_mmlu/ky/professional_law.json' 2026-01-06T13:30:41,692 adding 'unitxt/catalog/cards/global_mmlu/ky/professional_medicine.json' 2026-01-06T13:30:41,693 adding 'unitxt/catalog/cards/global_mmlu/ky/professional_psychology.json' 2026-01-06T13:30:41,695 adding 'unitxt/catalog/cards/global_mmlu/ky/public_relations.json' 2026-01-06T13:30:41,696 adding 'unitxt/catalog/cards/global_mmlu/ky/security_studies.json' 2026-01-06T13:30:41,697 adding 'unitxt/catalog/cards/global_mmlu/ky/sociology.json' 2026-01-06T13:30:41,698 adding 'unitxt/catalog/cards/global_mmlu/ky/us_foreign_policy.json' 2026-01-06T13:30:41,700 adding 'unitxt/catalog/cards/global_mmlu/ky/virology.json' 2026-01-06T13:30:41,701 adding 'unitxt/catalog/cards/global_mmlu/ky/world_religions.json' 2026-01-06T13:30:41,703 adding 'unitxt/catalog/cards/global_mmlu/lt/abstract_algebra.json' 2026-01-06T13:30:41,704 adding 'unitxt/catalog/cards/global_mmlu/lt/anatomy.json' 2026-01-06T13:30:41,706 adding 'unitxt/catalog/cards/global_mmlu/lt/astronomy.json' 2026-01-06T13:30:41,707 adding 'unitxt/catalog/cards/global_mmlu/lt/business_ethics.json' 2026-01-06T13:30:41,708 adding 'unitxt/catalog/cards/global_mmlu/lt/clinical_knowledge.json' 2026-01-06T13:30:41,709 adding 'unitxt/catalog/cards/global_mmlu/lt/college_biology.json' 2026-01-06T13:30:41,711 adding 'unitxt/catalog/cards/global_mmlu/lt/college_chemistry.json' 2026-01-06T13:30:41,712 adding 'unitxt/catalog/cards/global_mmlu/lt/college_computer_science.json' 2026-01-06T13:30:41,713 adding 'unitxt/catalog/cards/global_mmlu/lt/college_mathematics.json' 2026-01-06T13:30:41,715 adding 'unitxt/catalog/cards/global_mmlu/lt/college_medicine.json' 2026-01-06T13:30:41,716 adding 'unitxt/catalog/cards/global_mmlu/lt/college_physics.json' 2026-01-06T13:30:41,717 adding 'unitxt/catalog/cards/global_mmlu/lt/computer_security.json' 2026-01-06T13:30:41,718 adding 'unitxt/catalog/cards/global_mmlu/lt/conceptual_physics.json' 2026-01-06T13:30:41,720 adding 'unitxt/catalog/cards/global_mmlu/lt/econometrics.json' 2026-01-06T13:30:41,721 adding 'unitxt/catalog/cards/global_mmlu/lt/electrical_engineering.json' 2026-01-06T13:30:41,722 adding 'unitxt/catalog/cards/global_mmlu/lt/elementary_mathematics.json' 2026-01-06T13:30:41,724 adding 'unitxt/catalog/cards/global_mmlu/lt/formal_logic.json' 2026-01-06T13:30:41,725 adding 'unitxt/catalog/cards/global_mmlu/lt/global_facts.json' 2026-01-06T13:30:41,726 adding 'unitxt/catalog/cards/global_mmlu/lt/high_school_biology.json' 2026-01-06T13:30:41,727 adding 'unitxt/catalog/cards/global_mmlu/lt/high_school_chemistry.json' 2026-01-06T13:30:41,729 adding 'unitxt/catalog/cards/global_mmlu/lt/high_school_computer_science.json' 2026-01-06T13:30:41,730 adding 'unitxt/catalog/cards/global_mmlu/lt/high_school_european_history.json' 2026-01-06T13:30:41,731 adding 'unitxt/catalog/cards/global_mmlu/lt/high_school_geography.json' 2026-01-06T13:30:41,733 adding 'unitxt/catalog/cards/global_mmlu/lt/high_school_government_and_politics.json' 2026-01-06T13:30:41,734 adding 'unitxt/catalog/cards/global_mmlu/lt/high_school_macroeconomics.json' 2026-01-06T13:30:41,735 adding 'unitxt/catalog/cards/global_mmlu/lt/high_school_mathematics.json' 2026-01-06T13:30:41,737 adding 'unitxt/catalog/cards/global_mmlu/lt/high_school_microeconomics.json' 2026-01-06T13:30:41,738 adding 'unitxt/catalog/cards/global_mmlu/lt/high_school_physics.json' 2026-01-06T13:30:41,739 adding 'unitxt/catalog/cards/global_mmlu/lt/high_school_psychology.json' 2026-01-06T13:30:41,741 adding 'unitxt/catalog/cards/global_mmlu/lt/high_school_statistics.json' 2026-01-06T13:30:41,742 adding 'unitxt/catalog/cards/global_mmlu/lt/high_school_us_history.json' 2026-01-06T13:30:41,743 adding 'unitxt/catalog/cards/global_mmlu/lt/high_school_world_history.json' 2026-01-06T13:30:41,745 adding 'unitxt/catalog/cards/global_mmlu/lt/human_aging.json' 2026-01-06T13:30:41,746 adding 'unitxt/catalog/cards/global_mmlu/lt/human_sexuality.json' 2026-01-06T13:30:41,747 adding 'unitxt/catalog/cards/global_mmlu/lt/international_law.json' 2026-01-06T13:30:41,748 adding 'unitxt/catalog/cards/global_mmlu/lt/jurisprudence.json' 2026-01-06T13:30:41,750 adding 'unitxt/catalog/cards/global_mmlu/lt/logical_fallacies.json' 2026-01-06T13:30:41,751 adding 'unitxt/catalog/cards/global_mmlu/lt/machine_learning.json' 2026-01-06T13:30:41,752 adding 'unitxt/catalog/cards/global_mmlu/lt/management.json' 2026-01-06T13:30:41,754 adding 'unitxt/catalog/cards/global_mmlu/lt/marketing.json' 2026-01-06T13:30:41,755 adding 'unitxt/catalog/cards/global_mmlu/lt/medical_genetics.json' 2026-01-06T13:30:41,756 adding 'unitxt/catalog/cards/global_mmlu/lt/miscellaneous.json' 2026-01-06T13:30:41,757 adding 'unitxt/catalog/cards/global_mmlu/lt/moral_disputes.json' 2026-01-06T13:30:41,758 adding 'unitxt/catalog/cards/global_mmlu/lt/moral_scenarios.json' 2026-01-06T13:30:41,759 adding 'unitxt/catalog/cards/global_mmlu/lt/nutrition.json' 2026-01-06T13:30:41,761 adding 'unitxt/catalog/cards/global_mmlu/lt/philosophy.json' 2026-01-06T13:30:41,762 adding 'unitxt/catalog/cards/global_mmlu/lt/prehistory.json' 2026-01-06T13:30:41,763 adding 'unitxt/catalog/cards/global_mmlu/lt/professional_accounting.json' 2026-01-06T13:30:41,764 adding 'unitxt/catalog/cards/global_mmlu/lt/professional_law.json' 2026-01-06T13:30:41,766 adding 'unitxt/catalog/cards/global_mmlu/lt/professional_medicine.json' 2026-01-06T13:30:41,767 adding 'unitxt/catalog/cards/global_mmlu/lt/professional_psychology.json' 2026-01-06T13:30:41,768 adding 'unitxt/catalog/cards/global_mmlu/lt/public_relations.json' 2026-01-06T13:30:41,770 adding 'unitxt/catalog/cards/global_mmlu/lt/security_studies.json' 2026-01-06T13:30:41,771 adding 'unitxt/catalog/cards/global_mmlu/lt/sociology.json' 2026-01-06T13:30:41,772 adding 'unitxt/catalog/cards/global_mmlu/lt/us_foreign_policy.json' 2026-01-06T13:30:41,773 adding 'unitxt/catalog/cards/global_mmlu/lt/virology.json' 2026-01-06T13:30:41,774 adding 'unitxt/catalog/cards/global_mmlu/lt/world_religions.json' 2026-01-06T13:30:41,777 adding 'unitxt/catalog/cards/global_mmlu/mg/abstract_algebra.json' 2026-01-06T13:30:41,779 adding 'unitxt/catalog/cards/global_mmlu/mg/anatomy.json' 2026-01-06T13:30:41,780 adding 'unitxt/catalog/cards/global_mmlu/mg/astronomy.json' 2026-01-06T13:30:41,781 adding 'unitxt/catalog/cards/global_mmlu/mg/business_ethics.json' 2026-01-06T13:30:41,782 adding 'unitxt/catalog/cards/global_mmlu/mg/clinical_knowledge.json' 2026-01-06T13:30:41,784 adding 'unitxt/catalog/cards/global_mmlu/mg/college_biology.json' 2026-01-06T13:30:41,785 adding 'unitxt/catalog/cards/global_mmlu/mg/college_chemistry.json' 2026-01-06T13:30:41,786 adding 'unitxt/catalog/cards/global_mmlu/mg/college_computer_science.json' 2026-01-06T13:30:41,788 adding 'unitxt/catalog/cards/global_mmlu/mg/college_mathematics.json' 2026-01-06T13:30:41,789 adding 'unitxt/catalog/cards/global_mmlu/mg/college_medicine.json' 2026-01-06T13:30:41,790 adding 'unitxt/catalog/cards/global_mmlu/mg/college_physics.json' 2026-01-06T13:30:41,792 adding 'unitxt/catalog/cards/global_mmlu/mg/computer_security.json' 2026-01-06T13:30:41,793 adding 'unitxt/catalog/cards/global_mmlu/mg/conceptual_physics.json' 2026-01-06T13:30:41,794 adding 'unitxt/catalog/cards/global_mmlu/mg/econometrics.json' 2026-01-06T13:30:41,796 adding 'unitxt/catalog/cards/global_mmlu/mg/electrical_engineering.json' 2026-01-06T13:30:41,797 adding 'unitxt/catalog/cards/global_mmlu/mg/elementary_mathematics.json' 2026-01-06T13:30:41,798 adding 'unitxt/catalog/cards/global_mmlu/mg/formal_logic.json' 2026-01-06T13:30:41,800 adding 'unitxt/catalog/cards/global_mmlu/mg/global_facts.json' 2026-01-06T13:30:41,801 adding 'unitxt/catalog/cards/global_mmlu/mg/high_school_biology.json' 2026-01-06T13:30:41,802 adding 'unitxt/catalog/cards/global_mmlu/mg/high_school_chemistry.json' 2026-01-06T13:30:41,803 adding 'unitxt/catalog/cards/global_mmlu/mg/high_school_computer_science.json' 2026-01-06T13:30:41,805 adding 'unitxt/catalog/cards/global_mmlu/mg/high_school_european_history.json' 2026-01-06T13:30:41,806 adding 'unitxt/catalog/cards/global_mmlu/mg/high_school_geography.json' 2026-01-06T13:30:41,807 adding 'unitxt/catalog/cards/global_mmlu/mg/high_school_government_and_politics.json' 2026-01-06T13:30:41,809 adding 'unitxt/catalog/cards/global_mmlu/mg/high_school_macroeconomics.json' 2026-01-06T13:30:41,810 adding 'unitxt/catalog/cards/global_mmlu/mg/high_school_mathematics.json' 2026-01-06T13:30:41,811 adding 'unitxt/catalog/cards/global_mmlu/mg/high_school_microeconomics.json' 2026-01-06T13:30:41,812 adding 'unitxt/catalog/cards/global_mmlu/mg/high_school_physics.json' 2026-01-06T13:30:41,814 adding 'unitxt/catalog/cards/global_mmlu/mg/high_school_psychology.json' 2026-01-06T13:30:41,815 adding 'unitxt/catalog/cards/global_mmlu/mg/high_school_statistics.json' 2026-01-06T13:30:41,816 adding 'unitxt/catalog/cards/global_mmlu/mg/high_school_us_history.json' 2026-01-06T13:30:41,817 adding 'unitxt/catalog/cards/global_mmlu/mg/high_school_world_history.json' 2026-01-06T13:30:41,819 adding 'unitxt/catalog/cards/global_mmlu/mg/human_aging.json' 2026-01-06T13:30:41,820 adding 'unitxt/catalog/cards/global_mmlu/mg/human_sexuality.json' 2026-01-06T13:30:41,821 adding 'unitxt/catalog/cards/global_mmlu/mg/international_law.json' 2026-01-06T13:30:41,822 adding 'unitxt/catalog/cards/global_mmlu/mg/jurisprudence.json' 2026-01-06T13:30:41,824 adding 'unitxt/catalog/cards/global_mmlu/mg/logical_fallacies.json' 2026-01-06T13:30:41,825 adding 'unitxt/catalog/cards/global_mmlu/mg/machine_learning.json' 2026-01-06T13:30:41,826 adding 'unitxt/catalog/cards/global_mmlu/mg/management.json' 2026-01-06T13:30:41,828 adding 'unitxt/catalog/cards/global_mmlu/mg/marketing.json' 2026-01-06T13:30:41,829 adding 'unitxt/catalog/cards/global_mmlu/mg/medical_genetics.json' 2026-01-06T13:30:41,830 adding 'unitxt/catalog/cards/global_mmlu/mg/miscellaneous.json' 2026-01-06T13:30:41,831 adding 'unitxt/catalog/cards/global_mmlu/mg/moral_disputes.json' 2026-01-06T13:30:41,833 adding 'unitxt/catalog/cards/global_mmlu/mg/moral_scenarios.json' 2026-01-06T13:30:41,834 adding 'unitxt/catalog/cards/global_mmlu/mg/nutrition.json' 2026-01-06T13:30:41,835 adding 'unitxt/catalog/cards/global_mmlu/mg/philosophy.json' 2026-01-06T13:30:41,836 adding 'unitxt/catalog/cards/global_mmlu/mg/prehistory.json' 2026-01-06T13:30:41,838 adding 'unitxt/catalog/cards/global_mmlu/mg/professional_accounting.json' 2026-01-06T13:30:41,839 adding 'unitxt/catalog/cards/global_mmlu/mg/professional_law.json' 2026-01-06T13:30:41,840 adding 'unitxt/catalog/cards/global_mmlu/mg/professional_medicine.json' 2026-01-06T13:30:41,842 adding 'unitxt/catalog/cards/global_mmlu/mg/professional_psychology.json' 2026-01-06T13:30:41,843 adding 'unitxt/catalog/cards/global_mmlu/mg/public_relations.json' 2026-01-06T13:30:41,844 adding 'unitxt/catalog/cards/global_mmlu/mg/security_studies.json' 2026-01-06T13:30:41,846 adding 'unitxt/catalog/cards/global_mmlu/mg/sociology.json' 2026-01-06T13:30:41,847 adding 'unitxt/catalog/cards/global_mmlu/mg/us_foreign_policy.json' 2026-01-06T13:30:41,848 adding 'unitxt/catalog/cards/global_mmlu/mg/virology.json' 2026-01-06T13:30:41,850 adding 'unitxt/catalog/cards/global_mmlu/mg/world_religions.json' 2026-01-06T13:30:41,852 adding 'unitxt/catalog/cards/global_mmlu/ms/abstract_algebra.json' 2026-01-06T13:30:41,854 adding 'unitxt/catalog/cards/global_mmlu/ms/anatomy.json' 2026-01-06T13:30:41,855 adding 'unitxt/catalog/cards/global_mmlu/ms/astronomy.json' 2026-01-06T13:30:41,856 adding 'unitxt/catalog/cards/global_mmlu/ms/business_ethics.json' 2026-01-06T13:30:41,858 adding 'unitxt/catalog/cards/global_mmlu/ms/clinical_knowledge.json' 2026-01-06T13:30:41,859 adding 'unitxt/catalog/cards/global_mmlu/ms/college_biology.json' 2026-01-06T13:30:41,860 adding 'unitxt/catalog/cards/global_mmlu/ms/college_chemistry.json' 2026-01-06T13:30:41,862 adding 'unitxt/catalog/cards/global_mmlu/ms/college_computer_science.json' 2026-01-06T13:30:41,863 adding 'unitxt/catalog/cards/global_mmlu/ms/college_mathematics.json' 2026-01-06T13:30:41,864 adding 'unitxt/catalog/cards/global_mmlu/ms/college_medicine.json' 2026-01-06T13:30:41,866 adding 'unitxt/catalog/cards/global_mmlu/ms/college_physics.json' 2026-01-06T13:30:41,867 adding 'unitxt/catalog/cards/global_mmlu/ms/computer_security.json' 2026-01-06T13:30:41,868 adding 'unitxt/catalog/cards/global_mmlu/ms/conceptual_physics.json' 2026-01-06T13:30:41,870 adding 'unitxt/catalog/cards/global_mmlu/ms/econometrics.json' 2026-01-06T13:30:41,871 adding 'unitxt/catalog/cards/global_mmlu/ms/electrical_engineering.json' 2026-01-06T13:30:41,872 adding 'unitxt/catalog/cards/global_mmlu/ms/elementary_mathematics.json' 2026-01-06T13:30:41,873 adding 'unitxt/catalog/cards/global_mmlu/ms/formal_logic.json' 2026-01-06T13:30:41,874 adding 'unitxt/catalog/cards/global_mmlu/ms/global_facts.json' 2026-01-06T13:30:41,875 adding 'unitxt/catalog/cards/global_mmlu/ms/high_school_biology.json' 2026-01-06T13:30:41,877 adding 'unitxt/catalog/cards/global_mmlu/ms/high_school_chemistry.json' 2026-01-06T13:30:41,878 adding 'unitxt/catalog/cards/global_mmlu/ms/high_school_computer_science.json' 2026-01-06T13:30:41,879 adding 'unitxt/catalog/cards/global_mmlu/ms/high_school_european_history.json' 2026-01-06T13:30:41,881 adding 'unitxt/catalog/cards/global_mmlu/ms/high_school_geography.json' 2026-01-06T13:30:41,882 adding 'unitxt/catalog/cards/global_mmlu/ms/high_school_government_and_politics.json' 2026-01-06T13:30:41,883 adding 'unitxt/catalog/cards/global_mmlu/ms/high_school_macroeconomics.json' 2026-01-06T13:30:41,885 adding 'unitxt/catalog/cards/global_mmlu/ms/high_school_mathematics.json' 2026-01-06T13:30:41,886 adding 'unitxt/catalog/cards/global_mmlu/ms/high_school_microeconomics.json' 2026-01-06T13:30:41,887 adding 'unitxt/catalog/cards/global_mmlu/ms/high_school_physics.json' 2026-01-06T13:30:41,888 adding 'unitxt/catalog/cards/global_mmlu/ms/high_school_psychology.json' 2026-01-06T13:30:41,890 adding 'unitxt/catalog/cards/global_mmlu/ms/high_school_statistics.json' 2026-01-06T13:30:41,891 adding 'unitxt/catalog/cards/global_mmlu/ms/high_school_us_history.json' 2026-01-06T13:30:41,892 adding 'unitxt/catalog/cards/global_mmlu/ms/high_school_world_history.json' 2026-01-06T13:30:41,893 adding 'unitxt/catalog/cards/global_mmlu/ms/human_aging.json' 2026-01-06T13:30:41,895 adding 'unitxt/catalog/cards/global_mmlu/ms/human_sexuality.json' 2026-01-06T13:30:41,896 adding 'unitxt/catalog/cards/global_mmlu/ms/international_law.json' 2026-01-06T13:30:41,897 adding 'unitxt/catalog/cards/global_mmlu/ms/jurisprudence.json' 2026-01-06T13:30:41,899 adding 'unitxt/catalog/cards/global_mmlu/ms/logical_fallacies.json' 2026-01-06T13:30:41,900 adding 'unitxt/catalog/cards/global_mmlu/ms/machine_learning.json' 2026-01-06T13:30:41,901 adding 'unitxt/catalog/cards/global_mmlu/ms/management.json' 2026-01-06T13:30:41,903 adding 'unitxt/catalog/cards/global_mmlu/ms/marketing.json' 2026-01-06T13:30:41,904 adding 'unitxt/catalog/cards/global_mmlu/ms/medical_genetics.json' 2026-01-06T13:30:41,905 adding 'unitxt/catalog/cards/global_mmlu/ms/miscellaneous.json' 2026-01-06T13:30:41,906 adding 'unitxt/catalog/cards/global_mmlu/ms/moral_disputes.json' 2026-01-06T13:30:41,908 adding 'unitxt/catalog/cards/global_mmlu/ms/moral_scenarios.json' 2026-01-06T13:30:41,909 adding 'unitxt/catalog/cards/global_mmlu/ms/nutrition.json' 2026-01-06T13:30:41,910 adding 'unitxt/catalog/cards/global_mmlu/ms/philosophy.json' 2026-01-06T13:30:41,912 adding 'unitxt/catalog/cards/global_mmlu/ms/prehistory.json' 2026-01-06T13:30:41,913 adding 'unitxt/catalog/cards/global_mmlu/ms/professional_accounting.json' 2026-01-06T13:30:41,914 adding 'unitxt/catalog/cards/global_mmlu/ms/professional_law.json' 2026-01-06T13:30:41,916 adding 'unitxt/catalog/cards/global_mmlu/ms/professional_medicine.json' 2026-01-06T13:30:41,917 adding 'unitxt/catalog/cards/global_mmlu/ms/professional_psychology.json' 2026-01-06T13:30:41,918 adding 'unitxt/catalog/cards/global_mmlu/ms/public_relations.json' 2026-01-06T13:30:41,920 adding 'unitxt/catalog/cards/global_mmlu/ms/security_studies.json' 2026-01-06T13:30:41,921 adding 'unitxt/catalog/cards/global_mmlu/ms/sociology.json' 2026-01-06T13:30:41,922 adding 'unitxt/catalog/cards/global_mmlu/ms/us_foreign_policy.json' 2026-01-06T13:30:41,924 adding 'unitxt/catalog/cards/global_mmlu/ms/virology.json' 2026-01-06T13:30:41,925 adding 'unitxt/catalog/cards/global_mmlu/ms/world_religions.json' 2026-01-06T13:30:41,928 adding 'unitxt/catalog/cards/global_mmlu/ne/abstract_algebra.json' 2026-01-06T13:30:41,929 adding 'unitxt/catalog/cards/global_mmlu/ne/anatomy.json' 2026-01-06T13:30:41,930 adding 'unitxt/catalog/cards/global_mmlu/ne/astronomy.json' 2026-01-06T13:30:41,931 adding 'unitxt/catalog/cards/global_mmlu/ne/business_ethics.json' 2026-01-06T13:30:41,932 adding 'unitxt/catalog/cards/global_mmlu/ne/clinical_knowledge.json' 2026-01-06T13:30:41,934 adding 'unitxt/catalog/cards/global_mmlu/ne/college_biology.json' 2026-01-06T13:30:41,935 adding 'unitxt/catalog/cards/global_mmlu/ne/college_chemistry.json' 2026-01-06T13:30:41,936 adding 'unitxt/catalog/cards/global_mmlu/ne/college_computer_science.json' 2026-01-06T13:30:41,937 adding 'unitxt/catalog/cards/global_mmlu/ne/college_mathematics.json' 2026-01-06T13:30:41,939 adding 'unitxt/catalog/cards/global_mmlu/ne/college_medicine.json' 2026-01-06T13:30:41,940 adding 'unitxt/catalog/cards/global_mmlu/ne/college_physics.json' 2026-01-06T13:30:41,941 adding 'unitxt/catalog/cards/global_mmlu/ne/computer_security.json' 2026-01-06T13:30:41,943 adding 'unitxt/catalog/cards/global_mmlu/ne/conceptual_physics.json' 2026-01-06T13:30:41,944 adding 'unitxt/catalog/cards/global_mmlu/ne/econometrics.json' 2026-01-06T13:30:41,945 adding 'unitxt/catalog/cards/global_mmlu/ne/electrical_engineering.json' 2026-01-06T13:30:41,946 adding 'unitxt/catalog/cards/global_mmlu/ne/elementary_mathematics.json' 2026-01-06T13:30:41,948 adding 'unitxt/catalog/cards/global_mmlu/ne/formal_logic.json' 2026-01-06T13:30:41,949 adding 'unitxt/catalog/cards/global_mmlu/ne/global_facts.json' 2026-01-06T13:30:41,950 adding 'unitxt/catalog/cards/global_mmlu/ne/high_school_biology.json' 2026-01-06T13:30:41,952 adding 'unitxt/catalog/cards/global_mmlu/ne/high_school_chemistry.json' 2026-01-06T13:30:41,953 adding 'unitxt/catalog/cards/global_mmlu/ne/high_school_computer_science.json' 2026-01-06T13:30:41,954 adding 'unitxt/catalog/cards/global_mmlu/ne/high_school_european_history.json' 2026-01-06T13:30:41,956 adding 'unitxt/catalog/cards/global_mmlu/ne/high_school_geography.json' 2026-01-06T13:30:41,957 adding 'unitxt/catalog/cards/global_mmlu/ne/high_school_government_and_politics.json' 2026-01-06T13:30:41,958 adding 'unitxt/catalog/cards/global_mmlu/ne/high_school_macroeconomics.json' 2026-01-06T13:30:41,960 adding 'unitxt/catalog/cards/global_mmlu/ne/high_school_mathematics.json' 2026-01-06T13:30:41,961 adding 'unitxt/catalog/cards/global_mmlu/ne/high_school_microeconomics.json' 2026-01-06T13:30:41,962 adding 'unitxt/catalog/cards/global_mmlu/ne/high_school_physics.json' 2026-01-06T13:30:41,963 adding 'unitxt/catalog/cards/global_mmlu/ne/high_school_psychology.json' 2026-01-06T13:30:41,965 adding 'unitxt/catalog/cards/global_mmlu/ne/high_school_statistics.json' 2026-01-06T13:30:41,966 adding 'unitxt/catalog/cards/global_mmlu/ne/high_school_us_history.json' 2026-01-06T13:30:41,968 adding 'unitxt/catalog/cards/global_mmlu/ne/high_school_world_history.json' 2026-01-06T13:30:41,969 adding 'unitxt/catalog/cards/global_mmlu/ne/human_aging.json' 2026-01-06T13:30:41,971 adding 'unitxt/catalog/cards/global_mmlu/ne/human_sexuality.json' 2026-01-06T13:30:41,972 adding 'unitxt/catalog/cards/global_mmlu/ne/international_law.json' 2026-01-06T13:30:41,973 adding 'unitxt/catalog/cards/global_mmlu/ne/jurisprudence.json' 2026-01-06T13:30:41,975 adding 'unitxt/catalog/cards/global_mmlu/ne/logical_fallacies.json' 2026-01-06T13:30:41,976 adding 'unitxt/catalog/cards/global_mmlu/ne/machine_learning.json' 2026-01-06T13:30:41,977 adding 'unitxt/catalog/cards/global_mmlu/ne/management.json' 2026-01-06T13:30:41,979 adding 'unitxt/catalog/cards/global_mmlu/ne/marketing.json' 2026-01-06T13:30:41,980 adding 'unitxt/catalog/cards/global_mmlu/ne/medical_genetics.json' 2026-01-06T13:30:41,981 adding 'unitxt/catalog/cards/global_mmlu/ne/miscellaneous.json' 2026-01-06T13:30:41,983 adding 'unitxt/catalog/cards/global_mmlu/ne/moral_disputes.json' 2026-01-06T13:30:41,984 adding 'unitxt/catalog/cards/global_mmlu/ne/moral_scenarios.json' 2026-01-06T13:30:41,985 adding 'unitxt/catalog/cards/global_mmlu/ne/nutrition.json' 2026-01-06T13:30:41,986 adding 'unitxt/catalog/cards/global_mmlu/ne/philosophy.json' 2026-01-06T13:30:41,987 adding 'unitxt/catalog/cards/global_mmlu/ne/prehistory.json' 2026-01-06T13:30:41,989 adding 'unitxt/catalog/cards/global_mmlu/ne/professional_accounting.json' 2026-01-06T13:30:41,990 adding 'unitxt/catalog/cards/global_mmlu/ne/professional_law.json' 2026-01-06T13:30:41,991 adding 'unitxt/catalog/cards/global_mmlu/ne/professional_medicine.json' 2026-01-06T13:30:41,992 adding 'unitxt/catalog/cards/global_mmlu/ne/professional_psychology.json' 2026-01-06T13:30:41,994 adding 'unitxt/catalog/cards/global_mmlu/ne/public_relations.json' 2026-01-06T13:30:41,995 adding 'unitxt/catalog/cards/global_mmlu/ne/security_studies.json' 2026-01-06T13:30:41,996 adding 'unitxt/catalog/cards/global_mmlu/ne/sociology.json' 2026-01-06T13:30:41,998 adding 'unitxt/catalog/cards/global_mmlu/ne/us_foreign_policy.json' 2026-01-06T13:30:41,999 adding 'unitxt/catalog/cards/global_mmlu/ne/virology.json' 2026-01-06T13:30:42,000 adding 'unitxt/catalog/cards/global_mmlu/ne/world_religions.json' 2026-01-06T13:30:42,003 adding 'unitxt/catalog/cards/global_mmlu/nl/abstract_algebra.json' 2026-01-06T13:30:42,004 adding 'unitxt/catalog/cards/global_mmlu/nl/anatomy.json' 2026-01-06T13:30:42,005 adding 'unitxt/catalog/cards/global_mmlu/nl/astronomy.json' 2026-01-06T13:30:42,007 adding 'unitxt/catalog/cards/global_mmlu/nl/business_ethics.json' 2026-01-06T13:30:42,008 adding 'unitxt/catalog/cards/global_mmlu/nl/clinical_knowledge.json' 2026-01-06T13:30:42,009 adding 'unitxt/catalog/cards/global_mmlu/nl/college_biology.json' 2026-01-06T13:30:42,011 adding 'unitxt/catalog/cards/global_mmlu/nl/college_chemistry.json' 2026-01-06T13:30:42,012 adding 'unitxt/catalog/cards/global_mmlu/nl/college_computer_science.json' 2026-01-06T13:30:42,013 adding 'unitxt/catalog/cards/global_mmlu/nl/college_mathematics.json' 2026-01-06T13:30:42,014 adding 'unitxt/catalog/cards/global_mmlu/nl/college_medicine.json' 2026-01-06T13:30:42,016 adding 'unitxt/catalog/cards/global_mmlu/nl/college_physics.json' 2026-01-06T13:30:42,017 adding 'unitxt/catalog/cards/global_mmlu/nl/computer_security.json' 2026-01-06T13:30:42,018 adding 'unitxt/catalog/cards/global_mmlu/nl/conceptual_physics.json' 2026-01-06T13:30:42,020 adding 'unitxt/catalog/cards/global_mmlu/nl/econometrics.json' 2026-01-06T13:30:42,021 adding 'unitxt/catalog/cards/global_mmlu/nl/electrical_engineering.json' 2026-01-06T13:30:42,022 adding 'unitxt/catalog/cards/global_mmlu/nl/elementary_mathematics.json' 2026-01-06T13:30:42,024 adding 'unitxt/catalog/cards/global_mmlu/nl/formal_logic.json' 2026-01-06T13:30:42,025 adding 'unitxt/catalog/cards/global_mmlu/nl/global_facts.json' 2026-01-06T13:30:42,026 adding 'unitxt/catalog/cards/global_mmlu/nl/high_school_biology.json' 2026-01-06T13:30:42,028 adding 'unitxt/catalog/cards/global_mmlu/nl/high_school_chemistry.json' 2026-01-06T13:30:42,029 adding 'unitxt/catalog/cards/global_mmlu/nl/high_school_computer_science.json' 2026-01-06T13:30:42,030 adding 'unitxt/catalog/cards/global_mmlu/nl/high_school_european_history.json' 2026-01-06T13:30:42,032 adding 'unitxt/catalog/cards/global_mmlu/nl/high_school_geography.json' 2026-01-06T13:30:42,033 adding 'unitxt/catalog/cards/global_mmlu/nl/high_school_government_and_politics.json' 2026-01-06T13:30:42,034 adding 'unitxt/catalog/cards/global_mmlu/nl/high_school_macroeconomics.json' 2026-01-06T13:30:42,036 adding 'unitxt/catalog/cards/global_mmlu/nl/high_school_mathematics.json' 2026-01-06T13:30:42,037 adding 'unitxt/catalog/cards/global_mmlu/nl/high_school_microeconomics.json' 2026-01-06T13:30:42,038 adding 'unitxt/catalog/cards/global_mmlu/nl/high_school_physics.json' 2026-01-06T13:30:42,040 adding 'unitxt/catalog/cards/global_mmlu/nl/high_school_psychology.json' 2026-01-06T13:30:42,041 adding 'unitxt/catalog/cards/global_mmlu/nl/high_school_statistics.json' 2026-01-06T13:30:42,042 adding 'unitxt/catalog/cards/global_mmlu/nl/high_school_us_history.json' 2026-01-06T13:30:42,043 adding 'unitxt/catalog/cards/global_mmlu/nl/high_school_world_history.json' 2026-01-06T13:30:42,045 adding 'unitxt/catalog/cards/global_mmlu/nl/human_aging.json' 2026-01-06T13:30:42,046 adding 'unitxt/catalog/cards/global_mmlu/nl/human_sexuality.json' 2026-01-06T13:30:42,047 adding 'unitxt/catalog/cards/global_mmlu/nl/international_law.json' 2026-01-06T13:30:42,048 adding 'unitxt/catalog/cards/global_mmlu/nl/jurisprudence.json' 2026-01-06T13:30:42,049 adding 'unitxt/catalog/cards/global_mmlu/nl/logical_fallacies.json' 2026-01-06T13:30:42,051 adding 'unitxt/catalog/cards/global_mmlu/nl/machine_learning.json' 2026-01-06T13:30:42,052 adding 'unitxt/catalog/cards/global_mmlu/nl/management.json' 2026-01-06T13:30:42,053 adding 'unitxt/catalog/cards/global_mmlu/nl/marketing.json' 2026-01-06T13:30:42,055 adding 'unitxt/catalog/cards/global_mmlu/nl/medical_genetics.json' 2026-01-06T13:30:42,056 adding 'unitxt/catalog/cards/global_mmlu/nl/miscellaneous.json' 2026-01-06T13:30:42,057 adding 'unitxt/catalog/cards/global_mmlu/nl/moral_disputes.json' 2026-01-06T13:30:42,059 adding 'unitxt/catalog/cards/global_mmlu/nl/moral_scenarios.json' 2026-01-06T13:30:42,060 adding 'unitxt/catalog/cards/global_mmlu/nl/nutrition.json' 2026-01-06T13:30:42,061 adding 'unitxt/catalog/cards/global_mmlu/nl/philosophy.json' 2026-01-06T13:30:42,062 adding 'unitxt/catalog/cards/global_mmlu/nl/prehistory.json' 2026-01-06T13:30:42,064 adding 'unitxt/catalog/cards/global_mmlu/nl/professional_accounting.json' 2026-01-06T13:30:42,065 adding 'unitxt/catalog/cards/global_mmlu/nl/professional_law.json' 2026-01-06T13:30:42,066 adding 'unitxt/catalog/cards/global_mmlu/nl/professional_medicine.json' 2026-01-06T13:30:42,068 adding 'unitxt/catalog/cards/global_mmlu/nl/professional_psychology.json' 2026-01-06T13:30:42,069 adding 'unitxt/catalog/cards/global_mmlu/nl/public_relations.json' 2026-01-06T13:30:42,070 adding 'unitxt/catalog/cards/global_mmlu/nl/security_studies.json' 2026-01-06T13:30:42,071 adding 'unitxt/catalog/cards/global_mmlu/nl/sociology.json' 2026-01-06T13:30:42,073 adding 'unitxt/catalog/cards/global_mmlu/nl/us_foreign_policy.json' 2026-01-06T13:30:42,074 adding 'unitxt/catalog/cards/global_mmlu/nl/virology.json' 2026-01-06T13:30:42,075 adding 'unitxt/catalog/cards/global_mmlu/nl/world_religions.json' 2026-01-06T13:30:42,078 adding 'unitxt/catalog/cards/global_mmlu/ny/abstract_algebra.json' 2026-01-06T13:30:42,080 adding 'unitxt/catalog/cards/global_mmlu/ny/anatomy.json' 2026-01-06T13:30:42,081 adding 'unitxt/catalog/cards/global_mmlu/ny/astronomy.json' 2026-01-06T13:30:42,082 adding 'unitxt/catalog/cards/global_mmlu/ny/business_ethics.json' 2026-01-06T13:30:42,084 adding 'unitxt/catalog/cards/global_mmlu/ny/clinical_knowledge.json' 2026-01-06T13:30:42,085 adding 'unitxt/catalog/cards/global_mmlu/ny/college_biology.json' 2026-01-06T13:30:42,086 adding 'unitxt/catalog/cards/global_mmlu/ny/college_chemistry.json' 2026-01-06T13:30:42,088 adding 'unitxt/catalog/cards/global_mmlu/ny/college_computer_science.json' 2026-01-06T13:30:42,089 adding 'unitxt/catalog/cards/global_mmlu/ny/college_mathematics.json' 2026-01-06T13:30:42,090 adding 'unitxt/catalog/cards/global_mmlu/ny/college_medicine.json' 2026-01-06T13:30:42,092 adding 'unitxt/catalog/cards/global_mmlu/ny/college_physics.json' 2026-01-06T13:30:42,093 adding 'unitxt/catalog/cards/global_mmlu/ny/computer_security.json' 2026-01-06T13:30:42,094 adding 'unitxt/catalog/cards/global_mmlu/ny/conceptual_physics.json' 2026-01-06T13:30:42,096 adding 'unitxt/catalog/cards/global_mmlu/ny/econometrics.json' 2026-01-06T13:30:42,097 adding 'unitxt/catalog/cards/global_mmlu/ny/electrical_engineering.json' 2026-01-06T13:30:42,098 adding 'unitxt/catalog/cards/global_mmlu/ny/elementary_mathematics.json' 2026-01-06T13:30:42,100 adding 'unitxt/catalog/cards/global_mmlu/ny/formal_logic.json' 2026-01-06T13:30:42,101 adding 'unitxt/catalog/cards/global_mmlu/ny/global_facts.json' 2026-01-06T13:30:42,103 adding 'unitxt/catalog/cards/global_mmlu/ny/high_school_biology.json' 2026-01-06T13:30:42,104 adding 'unitxt/catalog/cards/global_mmlu/ny/high_school_chemistry.json' 2026-01-06T13:30:42,106 adding 'unitxt/catalog/cards/global_mmlu/ny/high_school_computer_science.json' 2026-01-06T13:30:42,107 adding 'unitxt/catalog/cards/global_mmlu/ny/high_school_european_history.json' 2026-01-06T13:30:42,109 adding 'unitxt/catalog/cards/global_mmlu/ny/high_school_geography.json' 2026-01-06T13:30:42,111 adding 'unitxt/catalog/cards/global_mmlu/ny/high_school_government_and_politics.json' 2026-01-06T13:30:42,112 adding 'unitxt/catalog/cards/global_mmlu/ny/high_school_macroeconomics.json' 2026-01-06T13:30:42,114 adding 'unitxt/catalog/cards/global_mmlu/ny/high_school_mathematics.json' 2026-01-06T13:30:42,116 adding 'unitxt/catalog/cards/global_mmlu/ny/high_school_microeconomics.json' 2026-01-06T13:30:42,117 adding 'unitxt/catalog/cards/global_mmlu/ny/high_school_physics.json' 2026-01-06T13:30:42,119 adding 'unitxt/catalog/cards/global_mmlu/ny/high_school_psychology.json' 2026-01-06T13:30:42,121 adding 'unitxt/catalog/cards/global_mmlu/ny/high_school_statistics.json' 2026-01-06T13:30:42,122 adding 'unitxt/catalog/cards/global_mmlu/ny/high_school_us_history.json' 2026-01-06T13:30:42,124 adding 'unitxt/catalog/cards/global_mmlu/ny/high_school_world_history.json' 2026-01-06T13:30:42,125 adding 'unitxt/catalog/cards/global_mmlu/ny/human_aging.json' 2026-01-06T13:30:42,127 adding 'unitxt/catalog/cards/global_mmlu/ny/human_sexuality.json' 2026-01-06T13:30:42,129 adding 'unitxt/catalog/cards/global_mmlu/ny/international_law.json' 2026-01-06T13:30:42,130 adding 'unitxt/catalog/cards/global_mmlu/ny/jurisprudence.json' 2026-01-06T13:30:42,132 adding 'unitxt/catalog/cards/global_mmlu/ny/logical_fallacies.json' 2026-01-06T13:30:42,134 adding 'unitxt/catalog/cards/global_mmlu/ny/machine_learning.json' 2026-01-06T13:30:42,135 adding 'unitxt/catalog/cards/global_mmlu/ny/management.json' 2026-01-06T13:30:42,137 adding 'unitxt/catalog/cards/global_mmlu/ny/marketing.json' 2026-01-06T13:30:42,139 adding 'unitxt/catalog/cards/global_mmlu/ny/medical_genetics.json' 2026-01-06T13:30:42,140 adding 'unitxt/catalog/cards/global_mmlu/ny/miscellaneous.json' 2026-01-06T13:30:42,142 adding 'unitxt/catalog/cards/global_mmlu/ny/moral_disputes.json' 2026-01-06T13:30:42,144 adding 'unitxt/catalog/cards/global_mmlu/ny/moral_scenarios.json' 2026-01-06T13:30:42,146 adding 'unitxt/catalog/cards/global_mmlu/ny/nutrition.json' 2026-01-06T13:30:42,147 adding 'unitxt/catalog/cards/global_mmlu/ny/philosophy.json' 2026-01-06T13:30:42,149 adding 'unitxt/catalog/cards/global_mmlu/ny/prehistory.json' 2026-01-06T13:30:42,151 adding 'unitxt/catalog/cards/global_mmlu/ny/professional_accounting.json' 2026-01-06T13:30:42,152 adding 'unitxt/catalog/cards/global_mmlu/ny/professional_law.json' 2026-01-06T13:30:42,154 adding 'unitxt/catalog/cards/global_mmlu/ny/professional_medicine.json' 2026-01-06T13:30:42,156 adding 'unitxt/catalog/cards/global_mmlu/ny/professional_psychology.json' 2026-01-06T13:30:42,158 adding 'unitxt/catalog/cards/global_mmlu/ny/public_relations.json' 2026-01-06T13:30:42,159 adding 'unitxt/catalog/cards/global_mmlu/ny/security_studies.json' 2026-01-06T13:30:42,161 adding 'unitxt/catalog/cards/global_mmlu/ny/sociology.json' 2026-01-06T13:30:42,163 adding 'unitxt/catalog/cards/global_mmlu/ny/us_foreign_policy.json' 2026-01-06T13:30:42,164 adding 'unitxt/catalog/cards/global_mmlu/ny/virology.json' 2026-01-06T13:30:42,166 adding 'unitxt/catalog/cards/global_mmlu/ny/world_religions.json' 2026-01-06T13:30:42,170 adding 'unitxt/catalog/cards/global_mmlu/pl/abstract_algebra.json' 2026-01-06T13:30:42,171 adding 'unitxt/catalog/cards/global_mmlu/pl/anatomy.json' 2026-01-06T13:30:42,173 adding 'unitxt/catalog/cards/global_mmlu/pl/astronomy.json' 2026-01-06T13:30:42,174 adding 'unitxt/catalog/cards/global_mmlu/pl/business_ethics.json' 2026-01-06T13:30:42,176 adding 'unitxt/catalog/cards/global_mmlu/pl/clinical_knowledge.json' 2026-01-06T13:30:42,178 adding 'unitxt/catalog/cards/global_mmlu/pl/college_biology.json' 2026-01-06T13:30:42,179 adding 'unitxt/catalog/cards/global_mmlu/pl/college_chemistry.json' 2026-01-06T13:30:42,181 adding 'unitxt/catalog/cards/global_mmlu/pl/college_computer_science.json' 2026-01-06T13:30:42,182 adding 'unitxt/catalog/cards/global_mmlu/pl/college_mathematics.json' 2026-01-06T13:30:42,184 adding 'unitxt/catalog/cards/global_mmlu/pl/college_medicine.json' 2026-01-06T13:30:42,186 adding 'unitxt/catalog/cards/global_mmlu/pl/college_physics.json' 2026-01-06T13:30:42,187 adding 'unitxt/catalog/cards/global_mmlu/pl/computer_security.json' 2026-01-06T13:30:42,189 adding 'unitxt/catalog/cards/global_mmlu/pl/conceptual_physics.json' 2026-01-06T13:30:42,191 adding 'unitxt/catalog/cards/global_mmlu/pl/econometrics.json' 2026-01-06T13:30:42,192 adding 'unitxt/catalog/cards/global_mmlu/pl/electrical_engineering.json' 2026-01-06T13:30:42,194 adding 'unitxt/catalog/cards/global_mmlu/pl/elementary_mathematics.json' 2026-01-06T13:30:42,196 adding 'unitxt/catalog/cards/global_mmlu/pl/formal_logic.json' 2026-01-06T13:30:42,197 adding 'unitxt/catalog/cards/global_mmlu/pl/global_facts.json' 2026-01-06T13:30:42,199 adding 'unitxt/catalog/cards/global_mmlu/pl/high_school_biology.json' 2026-01-06T13:30:42,201 adding 'unitxt/catalog/cards/global_mmlu/pl/high_school_chemistry.json' 2026-01-06T13:30:42,202 adding 'unitxt/catalog/cards/global_mmlu/pl/high_school_computer_science.json' 2026-01-06T13:30:42,203 adding 'unitxt/catalog/cards/global_mmlu/pl/high_school_european_history.json' 2026-01-06T13:30:42,205 adding 'unitxt/catalog/cards/global_mmlu/pl/high_school_geography.json' 2026-01-06T13:30:42,206 adding 'unitxt/catalog/cards/global_mmlu/pl/high_school_government_and_politics.json' 2026-01-06T13:30:42,207 adding 'unitxt/catalog/cards/global_mmlu/pl/high_school_macroeconomics.json' 2026-01-06T13:30:42,209 adding 'unitxt/catalog/cards/global_mmlu/pl/high_school_mathematics.json' 2026-01-06T13:30:42,210 adding 'unitxt/catalog/cards/global_mmlu/pl/high_school_microeconomics.json' 2026-01-06T13:30:42,211 adding 'unitxt/catalog/cards/global_mmlu/pl/high_school_physics.json' 2026-01-06T13:30:42,213 adding 'unitxt/catalog/cards/global_mmlu/pl/high_school_psychology.json' 2026-01-06T13:30:42,214 adding 'unitxt/catalog/cards/global_mmlu/pl/high_school_statistics.json' 2026-01-06T13:30:42,215 adding 'unitxt/catalog/cards/global_mmlu/pl/high_school_us_history.json' 2026-01-06T13:30:42,216 adding 'unitxt/catalog/cards/global_mmlu/pl/high_school_world_history.json' 2026-01-06T13:30:42,218 adding 'unitxt/catalog/cards/global_mmlu/pl/human_aging.json' 2026-01-06T13:30:42,219 adding 'unitxt/catalog/cards/global_mmlu/pl/human_sexuality.json' 2026-01-06T13:30:42,220 adding 'unitxt/catalog/cards/global_mmlu/pl/international_law.json' 2026-01-06T13:30:42,222 adding 'unitxt/catalog/cards/global_mmlu/pl/jurisprudence.json' 2026-01-06T13:30:42,223 adding 'unitxt/catalog/cards/global_mmlu/pl/logical_fallacies.json' 2026-01-06T13:30:42,224 adding 'unitxt/catalog/cards/global_mmlu/pl/machine_learning.json' 2026-01-06T13:30:42,226 adding 'unitxt/catalog/cards/global_mmlu/pl/management.json' 2026-01-06T13:30:42,227 adding 'unitxt/catalog/cards/global_mmlu/pl/marketing.json' 2026-01-06T13:30:42,228 adding 'unitxt/catalog/cards/global_mmlu/pl/medical_genetics.json' 2026-01-06T13:30:42,230 adding 'unitxt/catalog/cards/global_mmlu/pl/miscellaneous.json' 2026-01-06T13:30:42,231 adding 'unitxt/catalog/cards/global_mmlu/pl/moral_disputes.json' 2026-01-06T13:30:42,232 adding 'unitxt/catalog/cards/global_mmlu/pl/moral_scenarios.json' 2026-01-06T13:30:42,234 adding 'unitxt/catalog/cards/global_mmlu/pl/nutrition.json' 2026-01-06T13:30:42,235 adding 'unitxt/catalog/cards/global_mmlu/pl/philosophy.json' 2026-01-06T13:30:42,236 adding 'unitxt/catalog/cards/global_mmlu/pl/prehistory.json' 2026-01-06T13:30:42,237 adding 'unitxt/catalog/cards/global_mmlu/pl/professional_accounting.json' 2026-01-06T13:30:42,239 adding 'unitxt/catalog/cards/global_mmlu/pl/professional_law.json' 2026-01-06T13:30:42,240 adding 'unitxt/catalog/cards/global_mmlu/pl/professional_medicine.json' 2026-01-06T13:30:42,241 adding 'unitxt/catalog/cards/global_mmlu/pl/professional_psychology.json' 2026-01-06T13:30:42,242 adding 'unitxt/catalog/cards/global_mmlu/pl/public_relations.json' 2026-01-06T13:30:42,244 adding 'unitxt/catalog/cards/global_mmlu/pl/security_studies.json' 2026-01-06T13:30:42,245 adding 'unitxt/catalog/cards/global_mmlu/pl/sociology.json' 2026-01-06T13:30:42,246 adding 'unitxt/catalog/cards/global_mmlu/pl/us_foreign_policy.json' 2026-01-06T13:30:42,247 adding 'unitxt/catalog/cards/global_mmlu/pl/virology.json' 2026-01-06T13:30:42,249 adding 'unitxt/catalog/cards/global_mmlu/pl/world_religions.json' 2026-01-06T13:30:42,251 adding 'unitxt/catalog/cards/global_mmlu/pt/abstract_algebra.json' 2026-01-06T13:30:42,253 adding 'unitxt/catalog/cards/global_mmlu/pt/anatomy.json' 2026-01-06T13:30:42,254 adding 'unitxt/catalog/cards/global_mmlu/pt/astronomy.json' 2026-01-06T13:30:42,255 adding 'unitxt/catalog/cards/global_mmlu/pt/business_ethics.json' 2026-01-06T13:30:42,256 adding 'unitxt/catalog/cards/global_mmlu/pt/clinical_knowledge.json' 2026-01-06T13:30:42,258 adding 'unitxt/catalog/cards/global_mmlu/pt/college_biology.json' 2026-01-06T13:30:42,259 adding 'unitxt/catalog/cards/global_mmlu/pt/college_chemistry.json' 2026-01-06T13:30:42,260 adding 'unitxt/catalog/cards/global_mmlu/pt/college_computer_science.json' 2026-01-06T13:30:42,262 adding 'unitxt/catalog/cards/global_mmlu/pt/college_mathematics.json' 2026-01-06T13:30:42,263 adding 'unitxt/catalog/cards/global_mmlu/pt/college_medicine.json' 2026-01-06T13:30:42,264 adding 'unitxt/catalog/cards/global_mmlu/pt/college_physics.json' 2026-01-06T13:30:42,267 adding 'unitxt/catalog/cards/global_mmlu/pt/computer_security.json' 2026-01-06T13:30:42,269 adding 'unitxt/catalog/cards/global_mmlu/pt/conceptual_physics.json' 2026-01-06T13:30:42,270 adding 'unitxt/catalog/cards/global_mmlu/pt/econometrics.json' 2026-01-06T13:30:42,271 adding 'unitxt/catalog/cards/global_mmlu/pt/electrical_engineering.json' 2026-01-06T13:30:42,273 adding 'unitxt/catalog/cards/global_mmlu/pt/elementary_mathematics.json' 2026-01-06T13:30:42,274 adding 'unitxt/catalog/cards/global_mmlu/pt/formal_logic.json' 2026-01-06T13:30:42,275 adding 'unitxt/catalog/cards/global_mmlu/pt/global_facts.json' 2026-01-06T13:30:42,277 adding 'unitxt/catalog/cards/global_mmlu/pt/high_school_biology.json' 2026-01-06T13:30:42,278 adding 'unitxt/catalog/cards/global_mmlu/pt/high_school_chemistry.json' 2026-01-06T13:30:42,279 adding 'unitxt/catalog/cards/global_mmlu/pt/high_school_computer_science.json' 2026-01-06T13:30:42,281 adding 'unitxt/catalog/cards/global_mmlu/pt/high_school_european_history.json' 2026-01-06T13:30:42,282 adding 'unitxt/catalog/cards/global_mmlu/pt/high_school_geography.json' 2026-01-06T13:30:42,283 adding 'unitxt/catalog/cards/global_mmlu/pt/high_school_government_and_politics.json' 2026-01-06T13:30:42,284 adding 'unitxt/catalog/cards/global_mmlu/pt/high_school_macroeconomics.json' 2026-01-06T13:30:42,286 adding 'unitxt/catalog/cards/global_mmlu/pt/high_school_mathematics.json' 2026-01-06T13:30:42,287 adding 'unitxt/catalog/cards/global_mmlu/pt/high_school_microeconomics.json' 2026-01-06T13:30:42,288 adding 'unitxt/catalog/cards/global_mmlu/pt/high_school_physics.json' 2026-01-06T13:30:42,290 adding 'unitxt/catalog/cards/global_mmlu/pt/high_school_psychology.json' 2026-01-06T13:30:42,291 adding 'unitxt/catalog/cards/global_mmlu/pt/high_school_statistics.json' 2026-01-06T13:30:42,292 adding 'unitxt/catalog/cards/global_mmlu/pt/high_school_us_history.json' 2026-01-06T13:30:42,294 adding 'unitxt/catalog/cards/global_mmlu/pt/high_school_world_history.json' 2026-01-06T13:30:42,295 adding 'unitxt/catalog/cards/global_mmlu/pt/human_aging.json' 2026-01-06T13:30:42,296 adding 'unitxt/catalog/cards/global_mmlu/pt/human_sexuality.json' 2026-01-06T13:30:42,297 adding 'unitxt/catalog/cards/global_mmlu/pt/international_law.json' 2026-01-06T13:30:42,299 adding 'unitxt/catalog/cards/global_mmlu/pt/jurisprudence.json' 2026-01-06T13:30:42,300 adding 'unitxt/catalog/cards/global_mmlu/pt/logical_fallacies.json' 2026-01-06T13:30:42,301 adding 'unitxt/catalog/cards/global_mmlu/pt/machine_learning.json' 2026-01-06T13:30:42,302 adding 'unitxt/catalog/cards/global_mmlu/pt/management.json' 2026-01-06T13:30:42,303 adding 'unitxt/catalog/cards/global_mmlu/pt/marketing.json' 2026-01-06T13:30:42,305 adding 'unitxt/catalog/cards/global_mmlu/pt/medical_genetics.json' 2026-01-06T13:30:42,306 adding 'unitxt/catalog/cards/global_mmlu/pt/miscellaneous.json' 2026-01-06T13:30:42,307 adding 'unitxt/catalog/cards/global_mmlu/pt/moral_disputes.json' 2026-01-06T13:30:42,309 adding 'unitxt/catalog/cards/global_mmlu/pt/moral_scenarios.json' 2026-01-06T13:30:42,310 adding 'unitxt/catalog/cards/global_mmlu/pt/nutrition.json' 2026-01-06T13:30:42,311 adding 'unitxt/catalog/cards/global_mmlu/pt/philosophy.json' 2026-01-06T13:30:42,312 adding 'unitxt/catalog/cards/global_mmlu/pt/prehistory.json' 2026-01-06T13:30:42,314 adding 'unitxt/catalog/cards/global_mmlu/pt/professional_accounting.json' 2026-01-06T13:30:42,315 adding 'unitxt/catalog/cards/global_mmlu/pt/professional_law.json' 2026-01-06T13:30:42,316 adding 'unitxt/catalog/cards/global_mmlu/pt/professional_medicine.json' 2026-01-06T13:30:42,317 adding 'unitxt/catalog/cards/global_mmlu/pt/professional_psychology.json' 2026-01-06T13:30:42,319 adding 'unitxt/catalog/cards/global_mmlu/pt/public_relations.json' 2026-01-06T13:30:42,321 adding 'unitxt/catalog/cards/global_mmlu/pt/security_studies.json' 2026-01-06T13:30:42,322 adding 'unitxt/catalog/cards/global_mmlu/pt/sociology.json' 2026-01-06T13:30:42,323 adding 'unitxt/catalog/cards/global_mmlu/pt/us_foreign_policy.json' 2026-01-06T13:30:42,325 adding 'unitxt/catalog/cards/global_mmlu/pt/virology.json' 2026-01-06T13:30:42,326 adding 'unitxt/catalog/cards/global_mmlu/pt/world_religions.json' 2026-01-06T13:30:42,329 adding 'unitxt/catalog/cards/global_mmlu/ro/abstract_algebra.json' 2026-01-06T13:30:42,330 adding 'unitxt/catalog/cards/global_mmlu/ro/anatomy.json' 2026-01-06T13:30:42,331 adding 'unitxt/catalog/cards/global_mmlu/ro/astronomy.json' 2026-01-06T13:30:42,333 adding 'unitxt/catalog/cards/global_mmlu/ro/business_ethics.json' 2026-01-06T13:30:42,334 adding 'unitxt/catalog/cards/global_mmlu/ro/clinical_knowledge.json' 2026-01-06T13:30:42,335 adding 'unitxt/catalog/cards/global_mmlu/ro/college_biology.json' 2026-01-06T13:30:42,337 adding 'unitxt/catalog/cards/global_mmlu/ro/college_chemistry.json' 2026-01-06T13:30:42,338 adding 'unitxt/catalog/cards/global_mmlu/ro/college_computer_science.json' 2026-01-06T13:30:42,339 adding 'unitxt/catalog/cards/global_mmlu/ro/college_mathematics.json' 2026-01-06T13:30:42,341 adding 'unitxt/catalog/cards/global_mmlu/ro/college_medicine.json' 2026-01-06T13:30:42,342 adding 'unitxt/catalog/cards/global_mmlu/ro/college_physics.json' 2026-01-06T13:30:42,343 adding 'unitxt/catalog/cards/global_mmlu/ro/computer_security.json' 2026-01-06T13:30:42,345 adding 'unitxt/catalog/cards/global_mmlu/ro/conceptual_physics.json' 2026-01-06T13:30:42,346 adding 'unitxt/catalog/cards/global_mmlu/ro/econometrics.json' 2026-01-06T13:30:42,347 adding 'unitxt/catalog/cards/global_mmlu/ro/electrical_engineering.json' 2026-01-06T13:30:42,348 adding 'unitxt/catalog/cards/global_mmlu/ro/elementary_mathematics.json' 2026-01-06T13:30:42,350 adding 'unitxt/catalog/cards/global_mmlu/ro/formal_logic.json' 2026-01-06T13:30:42,351 adding 'unitxt/catalog/cards/global_mmlu/ro/global_facts.json' 2026-01-06T13:30:42,352 adding 'unitxt/catalog/cards/global_mmlu/ro/high_school_biology.json' 2026-01-06T13:30:42,354 adding 'unitxt/catalog/cards/global_mmlu/ro/high_school_chemistry.json' 2026-01-06T13:30:42,355 adding 'unitxt/catalog/cards/global_mmlu/ro/high_school_computer_science.json' 2026-01-06T13:30:42,356 adding 'unitxt/catalog/cards/global_mmlu/ro/high_school_european_history.json' 2026-01-06T13:30:42,357 adding 'unitxt/catalog/cards/global_mmlu/ro/high_school_geography.json' 2026-01-06T13:30:42,359 adding 'unitxt/catalog/cards/global_mmlu/ro/high_school_government_and_politics.json' 2026-01-06T13:30:42,360 adding 'unitxt/catalog/cards/global_mmlu/ro/high_school_macroeconomics.json' 2026-01-06T13:30:42,361 adding 'unitxt/catalog/cards/global_mmlu/ro/high_school_mathematics.json' 2026-01-06T13:30:42,362 adding 'unitxt/catalog/cards/global_mmlu/ro/high_school_microeconomics.json' 2026-01-06T13:30:42,363 adding 'unitxt/catalog/cards/global_mmlu/ro/high_school_physics.json' 2026-01-06T13:30:42,365 adding 'unitxt/catalog/cards/global_mmlu/ro/high_school_psychology.json' 2026-01-06T13:30:42,366 adding 'unitxt/catalog/cards/global_mmlu/ro/high_school_statistics.json' 2026-01-06T13:30:42,367 adding 'unitxt/catalog/cards/global_mmlu/ro/high_school_us_history.json' 2026-01-06T13:30:42,369 adding 'unitxt/catalog/cards/global_mmlu/ro/high_school_world_history.json' 2026-01-06T13:30:42,370 adding 'unitxt/catalog/cards/global_mmlu/ro/human_aging.json' 2026-01-06T13:30:42,371 adding 'unitxt/catalog/cards/global_mmlu/ro/human_sexuality.json' 2026-01-06T13:30:42,372 adding 'unitxt/catalog/cards/global_mmlu/ro/international_law.json' 2026-01-06T13:30:42,374 adding 'unitxt/catalog/cards/global_mmlu/ro/jurisprudence.json' 2026-01-06T13:30:42,375 adding 'unitxt/catalog/cards/global_mmlu/ro/logical_fallacies.json' 2026-01-06T13:30:42,376 adding 'unitxt/catalog/cards/global_mmlu/ro/machine_learning.json' 2026-01-06T13:30:42,378 adding 'unitxt/catalog/cards/global_mmlu/ro/management.json' 2026-01-06T13:30:42,379 adding 'unitxt/catalog/cards/global_mmlu/ro/marketing.json' 2026-01-06T13:30:42,380 adding 'unitxt/catalog/cards/global_mmlu/ro/medical_genetics.json' 2026-01-06T13:30:42,382 adding 'unitxt/catalog/cards/global_mmlu/ro/miscellaneous.json' 2026-01-06T13:30:42,383 adding 'unitxt/catalog/cards/global_mmlu/ro/moral_disputes.json' 2026-01-06T13:30:42,384 adding 'unitxt/catalog/cards/global_mmlu/ro/moral_scenarios.json' 2026-01-06T13:30:42,386 adding 'unitxt/catalog/cards/global_mmlu/ro/nutrition.json' 2026-01-06T13:30:42,387 adding 'unitxt/catalog/cards/global_mmlu/ro/philosophy.json' 2026-01-06T13:30:42,389 adding 'unitxt/catalog/cards/global_mmlu/ro/prehistory.json' 2026-01-06T13:30:42,390 adding 'unitxt/catalog/cards/global_mmlu/ro/professional_accounting.json' 2026-01-06T13:30:42,391 adding 'unitxt/catalog/cards/global_mmlu/ro/professional_law.json' 2026-01-06T13:30:42,393 adding 'unitxt/catalog/cards/global_mmlu/ro/professional_medicine.json' 2026-01-06T13:30:42,394 adding 'unitxt/catalog/cards/global_mmlu/ro/professional_psychology.json' 2026-01-06T13:30:42,395 adding 'unitxt/catalog/cards/global_mmlu/ro/public_relations.json' 2026-01-06T13:30:42,397 adding 'unitxt/catalog/cards/global_mmlu/ro/security_studies.json' 2026-01-06T13:30:42,398 adding 'unitxt/catalog/cards/global_mmlu/ro/sociology.json' 2026-01-06T13:30:42,399 adding 'unitxt/catalog/cards/global_mmlu/ro/us_foreign_policy.json' 2026-01-06T13:30:42,401 adding 'unitxt/catalog/cards/global_mmlu/ro/virology.json' 2026-01-06T13:30:42,402 adding 'unitxt/catalog/cards/global_mmlu/ro/world_religions.json' 2026-01-06T13:30:42,405 adding 'unitxt/catalog/cards/global_mmlu/ru/abstract_algebra.json' 2026-01-06T13:30:42,406 adding 'unitxt/catalog/cards/global_mmlu/ru/anatomy.json' 2026-01-06T13:30:42,407 adding 'unitxt/catalog/cards/global_mmlu/ru/astronomy.json' 2026-01-06T13:30:42,409 adding 'unitxt/catalog/cards/global_mmlu/ru/business_ethics.json' 2026-01-06T13:30:42,410 adding 'unitxt/catalog/cards/global_mmlu/ru/clinical_knowledge.json' 2026-01-06T13:30:42,412 adding 'unitxt/catalog/cards/global_mmlu/ru/college_biology.json' 2026-01-06T13:30:42,413 adding 'unitxt/catalog/cards/global_mmlu/ru/college_chemistry.json' 2026-01-06T13:30:42,414 adding 'unitxt/catalog/cards/global_mmlu/ru/college_computer_science.json' 2026-01-06T13:30:42,415 adding 'unitxt/catalog/cards/global_mmlu/ru/college_mathematics.json' 2026-01-06T13:30:42,416 adding 'unitxt/catalog/cards/global_mmlu/ru/college_medicine.json' 2026-01-06T13:30:42,417 adding 'unitxt/catalog/cards/global_mmlu/ru/college_physics.json' 2026-01-06T13:30:42,419 adding 'unitxt/catalog/cards/global_mmlu/ru/computer_security.json' 2026-01-06T13:30:42,420 adding 'unitxt/catalog/cards/global_mmlu/ru/conceptual_physics.json' 2026-01-06T13:30:42,421 adding 'unitxt/catalog/cards/global_mmlu/ru/econometrics.json' 2026-01-06T13:30:42,422 adding 'unitxt/catalog/cards/global_mmlu/ru/electrical_engineering.json' 2026-01-06T13:30:42,424 adding 'unitxt/catalog/cards/global_mmlu/ru/elementary_mathematics.json' 2026-01-06T13:30:42,425 adding 'unitxt/catalog/cards/global_mmlu/ru/formal_logic.json' 2026-01-06T13:30:42,426 adding 'unitxt/catalog/cards/global_mmlu/ru/global_facts.json' 2026-01-06T13:30:42,428 adding 'unitxt/catalog/cards/global_mmlu/ru/high_school_biology.json' 2026-01-06T13:30:42,429 adding 'unitxt/catalog/cards/global_mmlu/ru/high_school_chemistry.json' 2026-01-06T13:30:42,430 adding 'unitxt/catalog/cards/global_mmlu/ru/high_school_computer_science.json' 2026-01-06T13:30:42,432 adding 'unitxt/catalog/cards/global_mmlu/ru/high_school_european_history.json' 2026-01-06T13:30:42,433 adding 'unitxt/catalog/cards/global_mmlu/ru/high_school_geography.json' 2026-01-06T13:30:42,434 adding 'unitxt/catalog/cards/global_mmlu/ru/high_school_government_and_politics.json' 2026-01-06T13:30:42,435 adding 'unitxt/catalog/cards/global_mmlu/ru/high_school_macroeconomics.json' 2026-01-06T13:30:42,437 adding 'unitxt/catalog/cards/global_mmlu/ru/high_school_mathematics.json' 2026-01-06T13:30:42,438 adding 'unitxt/catalog/cards/global_mmlu/ru/high_school_microeconomics.json' 2026-01-06T13:30:42,439 adding 'unitxt/catalog/cards/global_mmlu/ru/high_school_physics.json' 2026-01-06T13:30:42,441 adding 'unitxt/catalog/cards/global_mmlu/ru/high_school_psychology.json' 2026-01-06T13:30:42,442 adding 'unitxt/catalog/cards/global_mmlu/ru/high_school_statistics.json' 2026-01-06T13:30:42,443 adding 'unitxt/catalog/cards/global_mmlu/ru/high_school_us_history.json' 2026-01-06T13:30:42,445 adding 'unitxt/catalog/cards/global_mmlu/ru/high_school_world_history.json' 2026-01-06T13:30:42,446 adding 'unitxt/catalog/cards/global_mmlu/ru/human_aging.json' 2026-01-06T13:30:42,447 adding 'unitxt/catalog/cards/global_mmlu/ru/human_sexuality.json' 2026-01-06T13:30:42,449 adding 'unitxt/catalog/cards/global_mmlu/ru/international_law.json' 2026-01-06T13:30:42,450 adding 'unitxt/catalog/cards/global_mmlu/ru/jurisprudence.json' 2026-01-06T13:30:42,451 adding 'unitxt/catalog/cards/global_mmlu/ru/logical_fallacies.json' 2026-01-06T13:30:42,453 adding 'unitxt/catalog/cards/global_mmlu/ru/machine_learning.json' 2026-01-06T13:30:42,454 adding 'unitxt/catalog/cards/global_mmlu/ru/management.json' 2026-01-06T13:30:42,455 adding 'unitxt/catalog/cards/global_mmlu/ru/marketing.json' 2026-01-06T13:30:42,456 adding 'unitxt/catalog/cards/global_mmlu/ru/medical_genetics.json' 2026-01-06T13:30:42,458 adding 'unitxt/catalog/cards/global_mmlu/ru/miscellaneous.json' 2026-01-06T13:30:42,459 adding 'unitxt/catalog/cards/global_mmlu/ru/moral_disputes.json' 2026-01-06T13:30:42,460 adding 'unitxt/catalog/cards/global_mmlu/ru/moral_scenarios.json' 2026-01-06T13:30:42,462 adding 'unitxt/catalog/cards/global_mmlu/ru/nutrition.json' 2026-01-06T13:30:42,463 adding 'unitxt/catalog/cards/global_mmlu/ru/philosophy.json' 2026-01-06T13:30:42,464 adding 'unitxt/catalog/cards/global_mmlu/ru/prehistory.json' 2026-01-06T13:30:42,466 adding 'unitxt/catalog/cards/global_mmlu/ru/professional_accounting.json' 2026-01-06T13:30:42,467 adding 'unitxt/catalog/cards/global_mmlu/ru/professional_law.json' 2026-01-06T13:30:42,468 adding 'unitxt/catalog/cards/global_mmlu/ru/professional_medicine.json' 2026-01-06T13:30:42,470 adding 'unitxt/catalog/cards/global_mmlu/ru/professional_psychology.json' 2026-01-06T13:30:42,471 adding 'unitxt/catalog/cards/global_mmlu/ru/public_relations.json' 2026-01-06T13:30:42,472 adding 'unitxt/catalog/cards/global_mmlu/ru/security_studies.json' 2026-01-06T13:30:42,473 adding 'unitxt/catalog/cards/global_mmlu/ru/sociology.json' 2026-01-06T13:30:42,474 adding 'unitxt/catalog/cards/global_mmlu/ru/us_foreign_policy.json' 2026-01-06T13:30:42,476 adding 'unitxt/catalog/cards/global_mmlu/ru/virology.json' 2026-01-06T13:30:42,477 adding 'unitxt/catalog/cards/global_mmlu/ru/world_religions.json' 2026-01-06T13:30:42,479 adding 'unitxt/catalog/cards/global_mmlu/si/abstract_algebra.json' 2026-01-06T13:30:42,481 adding 'unitxt/catalog/cards/global_mmlu/si/anatomy.json' 2026-01-06T13:30:42,482 adding 'unitxt/catalog/cards/global_mmlu/si/astronomy.json' 2026-01-06T13:30:42,483 adding 'unitxt/catalog/cards/global_mmlu/si/business_ethics.json' 2026-01-06T13:30:42,485 adding 'unitxt/catalog/cards/global_mmlu/si/clinical_knowledge.json' 2026-01-06T13:30:42,486 adding 'unitxt/catalog/cards/global_mmlu/si/college_biology.json' 2026-01-06T13:30:42,487 adding 'unitxt/catalog/cards/global_mmlu/si/college_chemistry.json' 2026-01-06T13:30:42,489 adding 'unitxt/catalog/cards/global_mmlu/si/college_computer_science.json' 2026-01-06T13:30:42,490 adding 'unitxt/catalog/cards/global_mmlu/si/college_mathematics.json' 2026-01-06T13:30:42,491 adding 'unitxt/catalog/cards/global_mmlu/si/college_medicine.json' 2026-01-06T13:30:42,492 adding 'unitxt/catalog/cards/global_mmlu/si/college_physics.json' 2026-01-06T13:30:42,494 adding 'unitxt/catalog/cards/global_mmlu/si/computer_security.json' 2026-01-06T13:30:42,495 adding 'unitxt/catalog/cards/global_mmlu/si/conceptual_physics.json' 2026-01-06T13:30:42,496 adding 'unitxt/catalog/cards/global_mmlu/si/econometrics.json' 2026-01-06T13:30:42,498 adding 'unitxt/catalog/cards/global_mmlu/si/electrical_engineering.json' 2026-01-06T13:30:42,499 adding 'unitxt/catalog/cards/global_mmlu/si/elementary_mathematics.json' 2026-01-06T13:30:42,500 adding 'unitxt/catalog/cards/global_mmlu/si/formal_logic.json' 2026-01-06T13:30:42,501 adding 'unitxt/catalog/cards/global_mmlu/si/global_facts.json' 2026-01-06T13:30:42,503 adding 'unitxt/catalog/cards/global_mmlu/si/high_school_biology.json' 2026-01-06T13:30:42,504 adding 'unitxt/catalog/cards/global_mmlu/si/high_school_chemistry.json' 2026-01-06T13:30:42,505 adding 'unitxt/catalog/cards/global_mmlu/si/high_school_computer_science.json' 2026-01-06T13:30:42,507 adding 'unitxt/catalog/cards/global_mmlu/si/high_school_european_history.json' 2026-01-06T13:30:42,508 adding 'unitxt/catalog/cards/global_mmlu/si/high_school_geography.json' 2026-01-06T13:30:42,509 adding 'unitxt/catalog/cards/global_mmlu/si/high_school_government_and_politics.json' 2026-01-06T13:30:42,511 adding 'unitxt/catalog/cards/global_mmlu/si/high_school_macroeconomics.json' 2026-01-06T13:30:42,512 adding 'unitxt/catalog/cards/global_mmlu/si/high_school_mathematics.json' 2026-01-06T13:30:42,513 adding 'unitxt/catalog/cards/global_mmlu/si/high_school_microeconomics.json' 2026-01-06T13:30:42,515 adding 'unitxt/catalog/cards/global_mmlu/si/high_school_physics.json' 2026-01-06T13:30:42,516 adding 'unitxt/catalog/cards/global_mmlu/si/high_school_psychology.json' 2026-01-06T13:30:42,517 adding 'unitxt/catalog/cards/global_mmlu/si/high_school_statistics.json' 2026-01-06T13:30:42,519 adding 'unitxt/catalog/cards/global_mmlu/si/high_school_us_history.json' 2026-01-06T13:30:42,520 adding 'unitxt/catalog/cards/global_mmlu/si/high_school_world_history.json' 2026-01-06T13:30:42,522 adding 'unitxt/catalog/cards/global_mmlu/si/human_aging.json' 2026-01-06T13:30:42,523 adding 'unitxt/catalog/cards/global_mmlu/si/human_sexuality.json' 2026-01-06T13:30:42,524 adding 'unitxt/catalog/cards/global_mmlu/si/international_law.json' 2026-01-06T13:30:42,525 adding 'unitxt/catalog/cards/global_mmlu/si/jurisprudence.json' 2026-01-06T13:30:42,527 adding 'unitxt/catalog/cards/global_mmlu/si/logical_fallacies.json' 2026-01-06T13:30:42,528 adding 'unitxt/catalog/cards/global_mmlu/si/machine_learning.json' 2026-01-06T13:30:42,529 adding 'unitxt/catalog/cards/global_mmlu/si/management.json' 2026-01-06T13:30:42,530 adding 'unitxt/catalog/cards/global_mmlu/si/marketing.json' 2026-01-06T13:30:42,532 adding 'unitxt/catalog/cards/global_mmlu/si/medical_genetics.json' 2026-01-06T13:30:42,533 adding 'unitxt/catalog/cards/global_mmlu/si/miscellaneous.json' 2026-01-06T13:30:42,534 adding 'unitxt/catalog/cards/global_mmlu/si/moral_disputes.json' 2026-01-06T13:30:42,535 adding 'unitxt/catalog/cards/global_mmlu/si/moral_scenarios.json' 2026-01-06T13:30:42,537 adding 'unitxt/catalog/cards/global_mmlu/si/nutrition.json' 2026-01-06T13:30:42,538 adding 'unitxt/catalog/cards/global_mmlu/si/philosophy.json' 2026-01-06T13:30:42,539 adding 'unitxt/catalog/cards/global_mmlu/si/prehistory.json' 2026-01-06T13:30:42,541 adding 'unitxt/catalog/cards/global_mmlu/si/professional_accounting.json' 2026-01-06T13:30:42,542 adding 'unitxt/catalog/cards/global_mmlu/si/professional_law.json' 2026-01-06T13:30:42,544 adding 'unitxt/catalog/cards/global_mmlu/si/professional_medicine.json' 2026-01-06T13:30:42,545 adding 'unitxt/catalog/cards/global_mmlu/si/professional_psychology.json' 2026-01-06T13:30:42,546 adding 'unitxt/catalog/cards/global_mmlu/si/public_relations.json' 2026-01-06T13:30:42,547 adding 'unitxt/catalog/cards/global_mmlu/si/security_studies.json' 2026-01-06T13:30:42,549 adding 'unitxt/catalog/cards/global_mmlu/si/sociology.json' 2026-01-06T13:30:42,550 adding 'unitxt/catalog/cards/global_mmlu/si/us_foreign_policy.json' 2026-01-06T13:30:42,551 adding 'unitxt/catalog/cards/global_mmlu/si/virology.json' 2026-01-06T13:30:42,553 adding 'unitxt/catalog/cards/global_mmlu/si/world_religions.json' 2026-01-06T13:30:42,555 adding 'unitxt/catalog/cards/global_mmlu/sn/abstract_algebra.json' 2026-01-06T13:30:42,557 adding 'unitxt/catalog/cards/global_mmlu/sn/anatomy.json' 2026-01-06T13:30:42,558 adding 'unitxt/catalog/cards/global_mmlu/sn/astronomy.json' 2026-01-06T13:30:42,559 adding 'unitxt/catalog/cards/global_mmlu/sn/business_ethics.json' 2026-01-06T13:30:42,561 adding 'unitxt/catalog/cards/global_mmlu/sn/clinical_knowledge.json' 2026-01-06T13:30:42,562 adding 'unitxt/catalog/cards/global_mmlu/sn/college_biology.json' 2026-01-06T13:30:42,563 adding 'unitxt/catalog/cards/global_mmlu/sn/college_chemistry.json' 2026-01-06T13:30:42,564 adding 'unitxt/catalog/cards/global_mmlu/sn/college_computer_science.json' 2026-01-06T13:30:42,566 adding 'unitxt/catalog/cards/global_mmlu/sn/college_mathematics.json' 2026-01-06T13:30:42,567 adding 'unitxt/catalog/cards/global_mmlu/sn/college_medicine.json' 2026-01-06T13:30:42,568 adding 'unitxt/catalog/cards/global_mmlu/sn/college_physics.json' 2026-01-06T13:30:42,570 adding 'unitxt/catalog/cards/global_mmlu/sn/computer_security.json' 2026-01-06T13:30:42,571 adding 'unitxt/catalog/cards/global_mmlu/sn/conceptual_physics.json' 2026-01-06T13:30:42,572 adding 'unitxt/catalog/cards/global_mmlu/sn/econometrics.json' 2026-01-06T13:30:42,574 adding 'unitxt/catalog/cards/global_mmlu/sn/electrical_engineering.json' 2026-01-06T13:30:42,575 adding 'unitxt/catalog/cards/global_mmlu/sn/elementary_mathematics.json' 2026-01-06T13:30:42,576 adding 'unitxt/catalog/cards/global_mmlu/sn/formal_logic.json' 2026-01-06T13:30:42,578 adding 'unitxt/catalog/cards/global_mmlu/sn/global_facts.json' 2026-01-06T13:30:42,579 adding 'unitxt/catalog/cards/global_mmlu/sn/high_school_biology.json' 2026-01-06T13:30:42,580 adding 'unitxt/catalog/cards/global_mmlu/sn/high_school_chemistry.json' 2026-01-06T13:30:42,582 adding 'unitxt/catalog/cards/global_mmlu/sn/high_school_computer_science.json' 2026-01-06T13:30:42,583 adding 'unitxt/catalog/cards/global_mmlu/sn/high_school_european_history.json' 2026-01-06T13:30:42,584 adding 'unitxt/catalog/cards/global_mmlu/sn/high_school_geography.json' 2026-01-06T13:30:42,585 adding 'unitxt/catalog/cards/global_mmlu/sn/high_school_government_and_politics.json' 2026-01-06T13:30:42,587 adding 'unitxt/catalog/cards/global_mmlu/sn/high_school_macroeconomics.json' 2026-01-06T13:30:42,588 adding 'unitxt/catalog/cards/global_mmlu/sn/high_school_mathematics.json' 2026-01-06T13:30:42,589 adding 'unitxt/catalog/cards/global_mmlu/sn/high_school_microeconomics.json' 2026-01-06T13:30:42,590 adding 'unitxt/catalog/cards/global_mmlu/sn/high_school_physics.json' 2026-01-06T13:30:42,592 adding 'unitxt/catalog/cards/global_mmlu/sn/high_school_psychology.json' 2026-01-06T13:30:42,593 adding 'unitxt/catalog/cards/global_mmlu/sn/high_school_statistics.json' 2026-01-06T13:30:42,594 adding 'unitxt/catalog/cards/global_mmlu/sn/high_school_us_history.json' 2026-01-06T13:30:42,595 adding 'unitxt/catalog/cards/global_mmlu/sn/high_school_world_history.json' 2026-01-06T13:30:42,597 adding 'unitxt/catalog/cards/global_mmlu/sn/human_aging.json' 2026-01-06T13:30:42,598 adding 'unitxt/catalog/cards/global_mmlu/sn/human_sexuality.json' 2026-01-06T13:30:42,599 adding 'unitxt/catalog/cards/global_mmlu/sn/international_law.json' 2026-01-06T13:30:42,601 adding 'unitxt/catalog/cards/global_mmlu/sn/jurisprudence.json' 2026-01-06T13:30:42,602 adding 'unitxt/catalog/cards/global_mmlu/sn/logical_fallacies.json' 2026-01-06T13:30:42,603 adding 'unitxt/catalog/cards/global_mmlu/sn/machine_learning.json' 2026-01-06T13:30:42,604 adding 'unitxt/catalog/cards/global_mmlu/sn/management.json' 2026-01-06T13:30:42,606 adding 'unitxt/catalog/cards/global_mmlu/sn/marketing.json' 2026-01-06T13:30:42,607 adding 'unitxt/catalog/cards/global_mmlu/sn/medical_genetics.json' 2026-01-06T13:30:42,608 adding 'unitxt/catalog/cards/global_mmlu/sn/miscellaneous.json' 2026-01-06T13:30:42,610 adding 'unitxt/catalog/cards/global_mmlu/sn/moral_disputes.json' 2026-01-06T13:30:42,611 adding 'unitxt/catalog/cards/global_mmlu/sn/moral_scenarios.json' 2026-01-06T13:30:42,612 adding 'unitxt/catalog/cards/global_mmlu/sn/nutrition.json' 2026-01-06T13:30:42,613 adding 'unitxt/catalog/cards/global_mmlu/sn/philosophy.json' 2026-01-06T13:30:42,615 adding 'unitxt/catalog/cards/global_mmlu/sn/prehistory.json' 2026-01-06T13:30:42,616 adding 'unitxt/catalog/cards/global_mmlu/sn/professional_accounting.json' 2026-01-06T13:30:42,617 adding 'unitxt/catalog/cards/global_mmlu/sn/professional_law.json' 2026-01-06T13:30:42,619 adding 'unitxt/catalog/cards/global_mmlu/sn/professional_medicine.json' 2026-01-06T13:30:42,620 adding 'unitxt/catalog/cards/global_mmlu/sn/professional_psychology.json' 2026-01-06T13:30:42,621 adding 'unitxt/catalog/cards/global_mmlu/sn/public_relations.json' 2026-01-06T13:30:42,623 adding 'unitxt/catalog/cards/global_mmlu/sn/security_studies.json' 2026-01-06T13:30:42,624 adding 'unitxt/catalog/cards/global_mmlu/sn/sociology.json' 2026-01-06T13:30:42,625 adding 'unitxt/catalog/cards/global_mmlu/sn/us_foreign_policy.json' 2026-01-06T13:30:42,626 adding 'unitxt/catalog/cards/global_mmlu/sn/virology.json' 2026-01-06T13:30:42,628 adding 'unitxt/catalog/cards/global_mmlu/sn/world_religions.json' 2026-01-06T13:30:42,630 adding 'unitxt/catalog/cards/global_mmlu/so/abstract_algebra.json' 2026-01-06T13:30:42,632 adding 'unitxt/catalog/cards/global_mmlu/so/anatomy.json' 2026-01-06T13:30:42,633 adding 'unitxt/catalog/cards/global_mmlu/so/astronomy.json' 2026-01-06T13:30:42,634 adding 'unitxt/catalog/cards/global_mmlu/so/business_ethics.json' 2026-01-06T13:30:42,636 adding 'unitxt/catalog/cards/global_mmlu/so/clinical_knowledge.json' 2026-01-06T13:30:42,637 adding 'unitxt/catalog/cards/global_mmlu/so/college_biology.json' 2026-01-06T13:30:42,638 adding 'unitxt/catalog/cards/global_mmlu/so/college_chemistry.json' 2026-01-06T13:30:42,640 adding 'unitxt/catalog/cards/global_mmlu/so/college_computer_science.json' 2026-01-06T13:30:42,641 adding 'unitxt/catalog/cards/global_mmlu/so/college_mathematics.json' 2026-01-06T13:30:42,642 adding 'unitxt/catalog/cards/global_mmlu/so/college_medicine.json' 2026-01-06T13:30:42,643 adding 'unitxt/catalog/cards/global_mmlu/so/college_physics.json' 2026-01-06T13:30:42,644 adding 'unitxt/catalog/cards/global_mmlu/so/computer_security.json' 2026-01-06T13:30:42,646 adding 'unitxt/catalog/cards/global_mmlu/so/conceptual_physics.json' 2026-01-06T13:30:42,647 adding 'unitxt/catalog/cards/global_mmlu/so/econometrics.json' 2026-01-06T13:30:42,648 adding 'unitxt/catalog/cards/global_mmlu/so/electrical_engineering.json' 2026-01-06T13:30:42,649 adding 'unitxt/catalog/cards/global_mmlu/so/elementary_mathematics.json' 2026-01-06T13:30:42,650 adding 'unitxt/catalog/cards/global_mmlu/so/formal_logic.json' 2026-01-06T13:30:42,652 adding 'unitxt/catalog/cards/global_mmlu/so/global_facts.json' 2026-01-06T13:30:42,653 adding 'unitxt/catalog/cards/global_mmlu/so/high_school_biology.json' 2026-01-06T13:30:42,654 adding 'unitxt/catalog/cards/global_mmlu/so/high_school_chemistry.json' 2026-01-06T13:30:42,656 adding 'unitxt/catalog/cards/global_mmlu/so/high_school_computer_science.json' 2026-01-06T13:30:42,657 adding 'unitxt/catalog/cards/global_mmlu/so/high_school_european_history.json' 2026-01-06T13:30:42,658 adding 'unitxt/catalog/cards/global_mmlu/so/high_school_geography.json' 2026-01-06T13:30:42,659 adding 'unitxt/catalog/cards/global_mmlu/so/high_school_government_and_politics.json' 2026-01-06T13:30:42,661 adding 'unitxt/catalog/cards/global_mmlu/so/high_school_macroeconomics.json' 2026-01-06T13:30:42,662 adding 'unitxt/catalog/cards/global_mmlu/so/high_school_mathematics.json' 2026-01-06T13:30:42,663 adding 'unitxt/catalog/cards/global_mmlu/so/high_school_microeconomics.json' 2026-01-06T13:30:42,664 adding 'unitxt/catalog/cards/global_mmlu/so/high_school_physics.json' 2026-01-06T13:30:42,666 adding 'unitxt/catalog/cards/global_mmlu/so/high_school_psychology.json' 2026-01-06T13:30:42,667 adding 'unitxt/catalog/cards/global_mmlu/so/high_school_statistics.json' 2026-01-06T13:30:42,668 adding 'unitxt/catalog/cards/global_mmlu/so/high_school_us_history.json' 2026-01-06T13:30:42,670 adding 'unitxt/catalog/cards/global_mmlu/so/high_school_world_history.json' 2026-01-06T13:30:42,671 adding 'unitxt/catalog/cards/global_mmlu/so/human_aging.json' 2026-01-06T13:30:42,672 adding 'unitxt/catalog/cards/global_mmlu/so/human_sexuality.json' 2026-01-06T13:30:42,673 adding 'unitxt/catalog/cards/global_mmlu/so/international_law.json' 2026-01-06T13:30:42,675 adding 'unitxt/catalog/cards/global_mmlu/so/jurisprudence.json' 2026-01-06T13:30:42,676 adding 'unitxt/catalog/cards/global_mmlu/so/logical_fallacies.json' 2026-01-06T13:30:42,677 adding 'unitxt/catalog/cards/global_mmlu/so/machine_learning.json' 2026-01-06T13:30:42,679 adding 'unitxt/catalog/cards/global_mmlu/so/management.json' 2026-01-06T13:30:42,680 adding 'unitxt/catalog/cards/global_mmlu/so/marketing.json' 2026-01-06T13:30:42,681 adding 'unitxt/catalog/cards/global_mmlu/so/medical_genetics.json' 2026-01-06T13:30:42,683 adding 'unitxt/catalog/cards/global_mmlu/so/miscellaneous.json' 2026-01-06T13:30:42,684 adding 'unitxt/catalog/cards/global_mmlu/so/moral_disputes.json' 2026-01-06T13:30:42,686 adding 'unitxt/catalog/cards/global_mmlu/so/moral_scenarios.json' 2026-01-06T13:30:42,687 adding 'unitxt/catalog/cards/global_mmlu/so/nutrition.json' 2026-01-06T13:30:42,688 adding 'unitxt/catalog/cards/global_mmlu/so/philosophy.json' 2026-01-06T13:30:42,690 adding 'unitxt/catalog/cards/global_mmlu/so/prehistory.json' 2026-01-06T13:30:42,691 adding 'unitxt/catalog/cards/global_mmlu/so/professional_accounting.json' 2026-01-06T13:30:42,692 adding 'unitxt/catalog/cards/global_mmlu/so/professional_law.json' 2026-01-06T13:30:42,694 adding 'unitxt/catalog/cards/global_mmlu/so/professional_medicine.json' 2026-01-06T13:30:42,695 adding 'unitxt/catalog/cards/global_mmlu/so/professional_psychology.json' 2026-01-06T13:30:42,696 adding 'unitxt/catalog/cards/global_mmlu/so/public_relations.json' 2026-01-06T13:30:42,698 adding 'unitxt/catalog/cards/global_mmlu/so/security_studies.json' 2026-01-06T13:30:42,699 adding 'unitxt/catalog/cards/global_mmlu/so/sociology.json' 2026-01-06T13:30:42,700 adding 'unitxt/catalog/cards/global_mmlu/so/us_foreign_policy.json' 2026-01-06T13:30:42,701 adding 'unitxt/catalog/cards/global_mmlu/so/virology.json' 2026-01-06T13:30:42,702 adding 'unitxt/catalog/cards/global_mmlu/so/world_religions.json' 2026-01-06T13:30:42,705 adding 'unitxt/catalog/cards/global_mmlu/sr/abstract_algebra.json' 2026-01-06T13:30:42,706 adding 'unitxt/catalog/cards/global_mmlu/sr/anatomy.json' 2026-01-06T13:30:42,707 adding 'unitxt/catalog/cards/global_mmlu/sr/astronomy.json' 2026-01-06T13:30:42,709 adding 'unitxt/catalog/cards/global_mmlu/sr/business_ethics.json' 2026-01-06T13:30:42,710 adding 'unitxt/catalog/cards/global_mmlu/sr/clinical_knowledge.json' 2026-01-06T13:30:42,711 adding 'unitxt/catalog/cards/global_mmlu/sr/college_biology.json' 2026-01-06T13:30:42,712 adding 'unitxt/catalog/cards/global_mmlu/sr/college_chemistry.json' 2026-01-06T13:30:42,714 adding 'unitxt/catalog/cards/global_mmlu/sr/college_computer_science.json' 2026-01-06T13:30:42,715 adding 'unitxt/catalog/cards/global_mmlu/sr/college_mathematics.json' 2026-01-06T13:30:42,716 adding 'unitxt/catalog/cards/global_mmlu/sr/college_medicine.json' 2026-01-06T13:30:42,717 adding 'unitxt/catalog/cards/global_mmlu/sr/college_physics.json' 2026-01-06T13:30:42,719 adding 'unitxt/catalog/cards/global_mmlu/sr/computer_security.json' 2026-01-06T13:30:42,720 adding 'unitxt/catalog/cards/global_mmlu/sr/conceptual_physics.json' 2026-01-06T13:30:42,721 adding 'unitxt/catalog/cards/global_mmlu/sr/econometrics.json' 2026-01-06T13:30:42,723 adding 'unitxt/catalog/cards/global_mmlu/sr/electrical_engineering.json' 2026-01-06T13:30:42,724 adding 'unitxt/catalog/cards/global_mmlu/sr/elementary_mathematics.json' 2026-01-06T13:30:42,725 adding 'unitxt/catalog/cards/global_mmlu/sr/formal_logic.json' 2026-01-06T13:30:42,727 adding 'unitxt/catalog/cards/global_mmlu/sr/global_facts.json' 2026-01-06T13:30:42,728 adding 'unitxt/catalog/cards/global_mmlu/sr/high_school_biology.json' 2026-01-06T13:30:42,729 adding 'unitxt/catalog/cards/global_mmlu/sr/high_school_chemistry.json' 2026-01-06T13:30:42,730 adding 'unitxt/catalog/cards/global_mmlu/sr/high_school_computer_science.json' 2026-01-06T13:30:42,732 adding 'unitxt/catalog/cards/global_mmlu/sr/high_school_european_history.json' 2026-01-06T13:30:42,733 adding 'unitxt/catalog/cards/global_mmlu/sr/high_school_geography.json' 2026-01-06T13:30:42,734 adding 'unitxt/catalog/cards/global_mmlu/sr/high_school_government_and_politics.json' 2026-01-06T13:30:42,736 adding 'unitxt/catalog/cards/global_mmlu/sr/high_school_macroeconomics.json' 2026-01-06T13:30:42,737 adding 'unitxt/catalog/cards/global_mmlu/sr/high_school_mathematics.json' 2026-01-06T13:30:42,738 adding 'unitxt/catalog/cards/global_mmlu/sr/high_school_microeconomics.json' 2026-01-06T13:30:42,740 adding 'unitxt/catalog/cards/global_mmlu/sr/high_school_physics.json' 2026-01-06T13:30:42,741 adding 'unitxt/catalog/cards/global_mmlu/sr/high_school_psychology.json' 2026-01-06T13:30:42,742 adding 'unitxt/catalog/cards/global_mmlu/sr/high_school_statistics.json' 2026-01-06T13:30:42,744 adding 'unitxt/catalog/cards/global_mmlu/sr/high_school_us_history.json' 2026-01-06T13:30:42,745 adding 'unitxt/catalog/cards/global_mmlu/sr/high_school_world_history.json' 2026-01-06T13:30:42,746 adding 'unitxt/catalog/cards/global_mmlu/sr/human_aging.json' 2026-01-06T13:30:42,748 adding 'unitxt/catalog/cards/global_mmlu/sr/human_sexuality.json' 2026-01-06T13:30:42,749 adding 'unitxt/catalog/cards/global_mmlu/sr/international_law.json' 2026-01-06T13:30:42,750 adding 'unitxt/catalog/cards/global_mmlu/sr/jurisprudence.json' 2026-01-06T13:30:42,752 adding 'unitxt/catalog/cards/global_mmlu/sr/logical_fallacies.json' 2026-01-06T13:30:42,753 adding 'unitxt/catalog/cards/global_mmlu/sr/machine_learning.json' 2026-01-06T13:30:42,754 adding 'unitxt/catalog/cards/global_mmlu/sr/management.json' 2026-01-06T13:30:42,755 adding 'unitxt/catalog/cards/global_mmlu/sr/marketing.json' 2026-01-06T13:30:42,757 adding 'unitxt/catalog/cards/global_mmlu/sr/medical_genetics.json' 2026-01-06T13:30:42,758 adding 'unitxt/catalog/cards/global_mmlu/sr/miscellaneous.json' 2026-01-06T13:30:42,759 adding 'unitxt/catalog/cards/global_mmlu/sr/moral_disputes.json' 2026-01-06T13:30:42,760 adding 'unitxt/catalog/cards/global_mmlu/sr/moral_scenarios.json' 2026-01-06T13:30:42,762 adding 'unitxt/catalog/cards/global_mmlu/sr/nutrition.json' 2026-01-06T13:30:42,763 adding 'unitxt/catalog/cards/global_mmlu/sr/philosophy.json' 2026-01-06T13:30:42,764 adding 'unitxt/catalog/cards/global_mmlu/sr/prehistory.json' 2026-01-06T13:30:42,766 adding 'unitxt/catalog/cards/global_mmlu/sr/professional_accounting.json' 2026-01-06T13:30:42,767 adding 'unitxt/catalog/cards/global_mmlu/sr/professional_law.json' 2026-01-06T13:30:42,768 adding 'unitxt/catalog/cards/global_mmlu/sr/professional_medicine.json' 2026-01-06T13:30:42,770 adding 'unitxt/catalog/cards/global_mmlu/sr/professional_psychology.json' 2026-01-06T13:30:42,771 adding 'unitxt/catalog/cards/global_mmlu/sr/public_relations.json' 2026-01-06T13:30:42,772 adding 'unitxt/catalog/cards/global_mmlu/sr/security_studies.json' 2026-01-06T13:30:42,773 adding 'unitxt/catalog/cards/global_mmlu/sr/sociology.json' 2026-01-06T13:30:42,775 adding 'unitxt/catalog/cards/global_mmlu/sr/us_foreign_policy.json' 2026-01-06T13:30:42,776 adding 'unitxt/catalog/cards/global_mmlu/sr/virology.json' 2026-01-06T13:30:42,777 adding 'unitxt/catalog/cards/global_mmlu/sr/world_religions.json' 2026-01-06T13:30:42,780 adding 'unitxt/catalog/cards/global_mmlu/sv/abstract_algebra.json' 2026-01-06T13:30:42,781 adding 'unitxt/catalog/cards/global_mmlu/sv/anatomy.json' 2026-01-06T13:30:42,782 adding 'unitxt/catalog/cards/global_mmlu/sv/astronomy.json' 2026-01-06T13:30:42,784 adding 'unitxt/catalog/cards/global_mmlu/sv/business_ethics.json' 2026-01-06T13:30:42,785 adding 'unitxt/catalog/cards/global_mmlu/sv/clinical_knowledge.json' 2026-01-06T13:30:42,786 adding 'unitxt/catalog/cards/global_mmlu/sv/college_biology.json' 2026-01-06T13:30:42,788 adding 'unitxt/catalog/cards/global_mmlu/sv/college_chemistry.json' 2026-01-06T13:30:42,789 adding 'unitxt/catalog/cards/global_mmlu/sv/college_computer_science.json' 2026-01-06T13:30:42,790 adding 'unitxt/catalog/cards/global_mmlu/sv/college_mathematics.json' 2026-01-06T13:30:42,792 adding 'unitxt/catalog/cards/global_mmlu/sv/college_medicine.json' 2026-01-06T13:30:42,793 adding 'unitxt/catalog/cards/global_mmlu/sv/college_physics.json' 2026-01-06T13:30:42,794 adding 'unitxt/catalog/cards/global_mmlu/sv/computer_security.json' 2026-01-06T13:30:42,796 adding 'unitxt/catalog/cards/global_mmlu/sv/conceptual_physics.json' 2026-01-06T13:30:42,797 adding 'unitxt/catalog/cards/global_mmlu/sv/econometrics.json' 2026-01-06T13:30:42,798 adding 'unitxt/catalog/cards/global_mmlu/sv/electrical_engineering.json' 2026-01-06T13:30:42,800 adding 'unitxt/catalog/cards/global_mmlu/sv/elementary_mathematics.json' 2026-01-06T13:30:42,801 adding 'unitxt/catalog/cards/global_mmlu/sv/formal_logic.json' 2026-01-06T13:30:42,802 adding 'unitxt/catalog/cards/global_mmlu/sv/global_facts.json' 2026-01-06T13:30:42,804 adding 'unitxt/catalog/cards/global_mmlu/sv/high_school_biology.json' 2026-01-06T13:30:42,805 adding 'unitxt/catalog/cards/global_mmlu/sv/high_school_chemistry.json' 2026-01-06T13:30:42,806 adding 'unitxt/catalog/cards/global_mmlu/sv/high_school_computer_science.json' 2026-01-06T13:30:42,808 adding 'unitxt/catalog/cards/global_mmlu/sv/high_school_european_history.json' 2026-01-06T13:30:42,809 adding 'unitxt/catalog/cards/global_mmlu/sv/high_school_geography.json' 2026-01-06T13:30:42,810 adding 'unitxt/catalog/cards/global_mmlu/sv/high_school_government_and_politics.json' 2026-01-06T13:30:42,812 adding 'unitxt/catalog/cards/global_mmlu/sv/high_school_macroeconomics.json' 2026-01-06T13:30:42,813 adding 'unitxt/catalog/cards/global_mmlu/sv/high_school_mathematics.json' 2026-01-06T13:30:42,814 adding 'unitxt/catalog/cards/global_mmlu/sv/high_school_microeconomics.json' 2026-01-06T13:30:42,815 adding 'unitxt/catalog/cards/global_mmlu/sv/high_school_physics.json' 2026-01-06T13:30:42,817 adding 'unitxt/catalog/cards/global_mmlu/sv/high_school_psychology.json' 2026-01-06T13:30:42,818 adding 'unitxt/catalog/cards/global_mmlu/sv/high_school_statistics.json' 2026-01-06T13:30:42,819 adding 'unitxt/catalog/cards/global_mmlu/sv/high_school_us_history.json' 2026-01-06T13:30:42,820 adding 'unitxt/catalog/cards/global_mmlu/sv/high_school_world_history.json' 2026-01-06T13:30:42,822 adding 'unitxt/catalog/cards/global_mmlu/sv/human_aging.json' 2026-01-06T13:30:42,823 adding 'unitxt/catalog/cards/global_mmlu/sv/human_sexuality.json' 2026-01-06T13:30:42,824 adding 'unitxt/catalog/cards/global_mmlu/sv/international_law.json' 2026-01-06T13:30:42,826 adding 'unitxt/catalog/cards/global_mmlu/sv/jurisprudence.json' 2026-01-06T13:30:42,827 adding 'unitxt/catalog/cards/global_mmlu/sv/logical_fallacies.json' 2026-01-06T13:30:42,828 adding 'unitxt/catalog/cards/global_mmlu/sv/machine_learning.json' 2026-01-06T13:30:42,830 adding 'unitxt/catalog/cards/global_mmlu/sv/management.json' 2026-01-06T13:30:42,831 adding 'unitxt/catalog/cards/global_mmlu/sv/marketing.json' 2026-01-06T13:30:42,832 adding 'unitxt/catalog/cards/global_mmlu/sv/medical_genetics.json' 2026-01-06T13:30:42,833 adding 'unitxt/catalog/cards/global_mmlu/sv/miscellaneous.json' 2026-01-06T13:30:42,835 adding 'unitxt/catalog/cards/global_mmlu/sv/moral_disputes.json' 2026-01-06T13:30:42,836 adding 'unitxt/catalog/cards/global_mmlu/sv/moral_scenarios.json' 2026-01-06T13:30:42,837 adding 'unitxt/catalog/cards/global_mmlu/sv/nutrition.json' 2026-01-06T13:30:42,839 adding 'unitxt/catalog/cards/global_mmlu/sv/philosophy.json' 2026-01-06T13:30:42,840 adding 'unitxt/catalog/cards/global_mmlu/sv/prehistory.json' 2026-01-06T13:30:42,841 adding 'unitxt/catalog/cards/global_mmlu/sv/professional_accounting.json' 2026-01-06T13:30:42,843 adding 'unitxt/catalog/cards/global_mmlu/sv/professional_law.json' 2026-01-06T13:30:42,844 adding 'unitxt/catalog/cards/global_mmlu/sv/professional_medicine.json' 2026-01-06T13:30:42,845 adding 'unitxt/catalog/cards/global_mmlu/sv/professional_psychology.json' 2026-01-06T13:30:42,847 adding 'unitxt/catalog/cards/global_mmlu/sv/public_relations.json' 2026-01-06T13:30:42,848 adding 'unitxt/catalog/cards/global_mmlu/sv/security_studies.json' 2026-01-06T13:30:42,849 adding 'unitxt/catalog/cards/global_mmlu/sv/sociology.json' 2026-01-06T13:30:42,851 adding 'unitxt/catalog/cards/global_mmlu/sv/us_foreign_policy.json' 2026-01-06T13:30:42,852 adding 'unitxt/catalog/cards/global_mmlu/sv/virology.json' 2026-01-06T13:30:42,853 adding 'unitxt/catalog/cards/global_mmlu/sv/world_religions.json' 2026-01-06T13:30:42,856 adding 'unitxt/catalog/cards/global_mmlu/sw/abstract_algebra.json' 2026-01-06T13:30:42,857 adding 'unitxt/catalog/cards/global_mmlu/sw/anatomy.json' 2026-01-06T13:30:42,859 adding 'unitxt/catalog/cards/global_mmlu/sw/astronomy.json' 2026-01-06T13:30:42,860 adding 'unitxt/catalog/cards/global_mmlu/sw/business_ethics.json' 2026-01-06T13:30:42,861 adding 'unitxt/catalog/cards/global_mmlu/sw/clinical_knowledge.json' 2026-01-06T13:30:42,863 adding 'unitxt/catalog/cards/global_mmlu/sw/college_biology.json' 2026-01-06T13:30:42,864 adding 'unitxt/catalog/cards/global_mmlu/sw/college_chemistry.json' 2026-01-06T13:30:42,865 adding 'unitxt/catalog/cards/global_mmlu/sw/college_computer_science.json' 2026-01-06T13:30:42,867 adding 'unitxt/catalog/cards/global_mmlu/sw/college_mathematics.json' 2026-01-06T13:30:42,868 adding 'unitxt/catalog/cards/global_mmlu/sw/college_medicine.json' 2026-01-06T13:30:42,869 adding 'unitxt/catalog/cards/global_mmlu/sw/college_physics.json' 2026-01-06T13:30:42,870 adding 'unitxt/catalog/cards/global_mmlu/sw/computer_security.json' 2026-01-06T13:30:42,872 adding 'unitxt/catalog/cards/global_mmlu/sw/conceptual_physics.json' 2026-01-06T13:30:42,873 adding 'unitxt/catalog/cards/global_mmlu/sw/econometrics.json' 2026-01-06T13:30:42,874 adding 'unitxt/catalog/cards/global_mmlu/sw/electrical_engineering.json' 2026-01-06T13:30:42,875 adding 'unitxt/catalog/cards/global_mmlu/sw/elementary_mathematics.json' 2026-01-06T13:30:42,876 adding 'unitxt/catalog/cards/global_mmlu/sw/formal_logic.json' 2026-01-06T13:30:42,878 adding 'unitxt/catalog/cards/global_mmlu/sw/global_facts.json' 2026-01-06T13:30:42,879 adding 'unitxt/catalog/cards/global_mmlu/sw/high_school_biology.json' 2026-01-06T13:30:42,880 adding 'unitxt/catalog/cards/global_mmlu/sw/high_school_chemistry.json' 2026-01-06T13:30:42,881 adding 'unitxt/catalog/cards/global_mmlu/sw/high_school_computer_science.json' 2026-01-06T13:30:42,883 adding 'unitxt/catalog/cards/global_mmlu/sw/high_school_european_history.json' 2026-01-06T13:30:42,884 adding 'unitxt/catalog/cards/global_mmlu/sw/high_school_geography.json' 2026-01-06T13:30:42,885 adding 'unitxt/catalog/cards/global_mmlu/sw/high_school_government_and_politics.json' 2026-01-06T13:30:42,887 adding 'unitxt/catalog/cards/global_mmlu/sw/high_school_macroeconomics.json' 2026-01-06T13:30:42,888 adding 'unitxt/catalog/cards/global_mmlu/sw/high_school_mathematics.json' 2026-01-06T13:30:42,889 adding 'unitxt/catalog/cards/global_mmlu/sw/high_school_microeconomics.json' 2026-01-06T13:30:42,890 adding 'unitxt/catalog/cards/global_mmlu/sw/high_school_physics.json' 2026-01-06T13:30:42,892 adding 'unitxt/catalog/cards/global_mmlu/sw/high_school_psychology.json' 2026-01-06T13:30:42,893 adding 'unitxt/catalog/cards/global_mmlu/sw/high_school_statistics.json' 2026-01-06T13:30:42,894 adding 'unitxt/catalog/cards/global_mmlu/sw/high_school_us_history.json' 2026-01-06T13:30:42,896 adding 'unitxt/catalog/cards/global_mmlu/sw/high_school_world_history.json' 2026-01-06T13:30:42,897 adding 'unitxt/catalog/cards/global_mmlu/sw/human_aging.json' 2026-01-06T13:30:42,898 adding 'unitxt/catalog/cards/global_mmlu/sw/human_sexuality.json' 2026-01-06T13:30:42,900 adding 'unitxt/catalog/cards/global_mmlu/sw/international_law.json' 2026-01-06T13:30:42,901 adding 'unitxt/catalog/cards/global_mmlu/sw/jurisprudence.json' 2026-01-06T13:30:42,902 adding 'unitxt/catalog/cards/global_mmlu/sw/logical_fallacies.json' 2026-01-06T13:30:42,904 adding 'unitxt/catalog/cards/global_mmlu/sw/machine_learning.json' 2026-01-06T13:30:42,905 adding 'unitxt/catalog/cards/global_mmlu/sw/management.json' 2026-01-06T13:30:42,906 adding 'unitxt/catalog/cards/global_mmlu/sw/marketing.json' 2026-01-06T13:30:42,908 adding 'unitxt/catalog/cards/global_mmlu/sw/medical_genetics.json' 2026-01-06T13:30:42,909 adding 'unitxt/catalog/cards/global_mmlu/sw/miscellaneous.json' 2026-01-06T13:30:42,910 adding 'unitxt/catalog/cards/global_mmlu/sw/moral_disputes.json' 2026-01-06T13:30:42,911 adding 'unitxt/catalog/cards/global_mmlu/sw/moral_scenarios.json' 2026-01-06T13:30:42,913 adding 'unitxt/catalog/cards/global_mmlu/sw/nutrition.json' 2026-01-06T13:30:42,914 adding 'unitxt/catalog/cards/global_mmlu/sw/philosophy.json' 2026-01-06T13:30:42,915 adding 'unitxt/catalog/cards/global_mmlu/sw/prehistory.json' 2026-01-06T13:30:42,917 adding 'unitxt/catalog/cards/global_mmlu/sw/professional_accounting.json' 2026-01-06T13:30:42,918 adding 'unitxt/catalog/cards/global_mmlu/sw/professional_law.json' 2026-01-06T13:30:42,919 adding 'unitxt/catalog/cards/global_mmlu/sw/professional_medicine.json' 2026-01-06T13:30:42,921 adding 'unitxt/catalog/cards/global_mmlu/sw/professional_psychology.json' 2026-01-06T13:30:42,922 adding 'unitxt/catalog/cards/global_mmlu/sw/public_relations.json' 2026-01-06T13:30:42,923 adding 'unitxt/catalog/cards/global_mmlu/sw/security_studies.json' 2026-01-06T13:30:42,925 adding 'unitxt/catalog/cards/global_mmlu/sw/sociology.json' 2026-01-06T13:30:42,926 adding 'unitxt/catalog/cards/global_mmlu/sw/us_foreign_policy.json' 2026-01-06T13:30:42,927 adding 'unitxt/catalog/cards/global_mmlu/sw/virology.json' 2026-01-06T13:30:42,928 adding 'unitxt/catalog/cards/global_mmlu/sw/world_religions.json' 2026-01-06T13:30:42,931 adding 'unitxt/catalog/cards/global_mmlu/te/abstract_algebra.json' 2026-01-06T13:30:42,932 adding 'unitxt/catalog/cards/global_mmlu/te/anatomy.json' 2026-01-06T13:30:42,933 adding 'unitxt/catalog/cards/global_mmlu/te/astronomy.json' 2026-01-06T13:30:42,935 adding 'unitxt/catalog/cards/global_mmlu/te/business_ethics.json' 2026-01-06T13:30:42,936 adding 'unitxt/catalog/cards/global_mmlu/te/clinical_knowledge.json' 2026-01-06T13:30:42,937 adding 'unitxt/catalog/cards/global_mmlu/te/college_biology.json' 2026-01-06T13:30:42,938 adding 'unitxt/catalog/cards/global_mmlu/te/college_chemistry.json' 2026-01-06T13:30:42,940 adding 'unitxt/catalog/cards/global_mmlu/te/college_computer_science.json' 2026-01-06T13:30:42,941 adding 'unitxt/catalog/cards/global_mmlu/te/college_mathematics.json' 2026-01-06T13:30:42,942 adding 'unitxt/catalog/cards/global_mmlu/te/college_medicine.json' 2026-01-06T13:30:42,944 adding 'unitxt/catalog/cards/global_mmlu/te/college_physics.json' 2026-01-06T13:30:42,945 adding 'unitxt/catalog/cards/global_mmlu/te/computer_security.json' 2026-01-06T13:30:42,946 adding 'unitxt/catalog/cards/global_mmlu/te/conceptual_physics.json' 2026-01-06T13:30:42,947 adding 'unitxt/catalog/cards/global_mmlu/te/econometrics.json' 2026-01-06T13:30:42,949 adding 'unitxt/catalog/cards/global_mmlu/te/electrical_engineering.json' 2026-01-06T13:30:42,950 adding 'unitxt/catalog/cards/global_mmlu/te/elementary_mathematics.json' 2026-01-06T13:30:42,951 adding 'unitxt/catalog/cards/global_mmlu/te/formal_logic.json' 2026-01-06T13:30:42,952 adding 'unitxt/catalog/cards/global_mmlu/te/global_facts.json' 2026-01-06T13:30:42,954 adding 'unitxt/catalog/cards/global_mmlu/te/high_school_biology.json' 2026-01-06T13:30:42,955 adding 'unitxt/catalog/cards/global_mmlu/te/high_school_chemistry.json' 2026-01-06T13:30:42,956 adding 'unitxt/catalog/cards/global_mmlu/te/high_school_computer_science.json' 2026-01-06T13:30:42,958 adding 'unitxt/catalog/cards/global_mmlu/te/high_school_european_history.json' 2026-01-06T13:30:42,959 adding 'unitxt/catalog/cards/global_mmlu/te/high_school_geography.json' 2026-01-06T13:30:42,960 adding 'unitxt/catalog/cards/global_mmlu/te/high_school_government_and_politics.json' 2026-01-06T13:30:42,962 adding 'unitxt/catalog/cards/global_mmlu/te/high_school_macroeconomics.json' 2026-01-06T13:30:42,963 adding 'unitxt/catalog/cards/global_mmlu/te/high_school_mathematics.json' 2026-01-06T13:30:42,964 adding 'unitxt/catalog/cards/global_mmlu/te/high_school_microeconomics.json' 2026-01-06T13:30:42,966 adding 'unitxt/catalog/cards/global_mmlu/te/high_school_physics.json' 2026-01-06T13:30:42,967 adding 'unitxt/catalog/cards/global_mmlu/te/high_school_psychology.json' 2026-01-06T13:30:42,968 adding 'unitxt/catalog/cards/global_mmlu/te/high_school_statistics.json' 2026-01-06T13:30:42,970 adding 'unitxt/catalog/cards/global_mmlu/te/high_school_us_history.json' 2026-01-06T13:30:42,971 adding 'unitxt/catalog/cards/global_mmlu/te/high_school_world_history.json' 2026-01-06T13:30:42,972 adding 'unitxt/catalog/cards/global_mmlu/te/human_aging.json' 2026-01-06T13:30:42,974 adding 'unitxt/catalog/cards/global_mmlu/te/human_sexuality.json' 2026-01-06T13:30:42,975 adding 'unitxt/catalog/cards/global_mmlu/te/international_law.json' 2026-01-06T13:30:42,976 adding 'unitxt/catalog/cards/global_mmlu/te/jurisprudence.json' 2026-01-06T13:30:42,977 adding 'unitxt/catalog/cards/global_mmlu/te/logical_fallacies.json' 2026-01-06T13:30:42,979 adding 'unitxt/catalog/cards/global_mmlu/te/machine_learning.json' 2026-01-06T13:30:42,980 adding 'unitxt/catalog/cards/global_mmlu/te/management.json' 2026-01-06T13:30:42,981 adding 'unitxt/catalog/cards/global_mmlu/te/marketing.json' 2026-01-06T13:30:42,983 adding 'unitxt/catalog/cards/global_mmlu/te/medical_genetics.json' 2026-01-06T13:30:42,984 adding 'unitxt/catalog/cards/global_mmlu/te/miscellaneous.json' 2026-01-06T13:30:42,985 adding 'unitxt/catalog/cards/global_mmlu/te/moral_disputes.json' 2026-01-06T13:30:42,986 adding 'unitxt/catalog/cards/global_mmlu/te/moral_scenarios.json' 2026-01-06T13:30:42,987 adding 'unitxt/catalog/cards/global_mmlu/te/nutrition.json' 2026-01-06T13:30:42,989 adding 'unitxt/catalog/cards/global_mmlu/te/philosophy.json' 2026-01-06T13:30:42,990 adding 'unitxt/catalog/cards/global_mmlu/te/prehistory.json' 2026-01-06T13:30:42,991 adding 'unitxt/catalog/cards/global_mmlu/te/professional_accounting.json' 2026-01-06T13:30:42,992 adding 'unitxt/catalog/cards/global_mmlu/te/professional_law.json' 2026-01-06T13:30:42,994 adding 'unitxt/catalog/cards/global_mmlu/te/professional_medicine.json' 2026-01-06T13:30:42,995 adding 'unitxt/catalog/cards/global_mmlu/te/professional_psychology.json' 2026-01-06T13:30:42,996 adding 'unitxt/catalog/cards/global_mmlu/te/public_relations.json' 2026-01-06T13:30:42,998 adding 'unitxt/catalog/cards/global_mmlu/te/security_studies.json' 2026-01-06T13:30:42,999 adding 'unitxt/catalog/cards/global_mmlu/te/sociology.json' 2026-01-06T13:30:43,000 adding 'unitxt/catalog/cards/global_mmlu/te/us_foreign_policy.json' 2026-01-06T13:30:43,001 adding 'unitxt/catalog/cards/global_mmlu/te/virology.json' 2026-01-06T13:30:43,003 adding 'unitxt/catalog/cards/global_mmlu/te/world_religions.json' 2026-01-06T13:30:43,005 adding 'unitxt/catalog/cards/global_mmlu/tr/abstract_algebra.json' 2026-01-06T13:30:43,007 adding 'unitxt/catalog/cards/global_mmlu/tr/anatomy.json' 2026-01-06T13:30:43,008 adding 'unitxt/catalog/cards/global_mmlu/tr/astronomy.json' 2026-01-06T13:30:43,009 adding 'unitxt/catalog/cards/global_mmlu/tr/business_ethics.json' 2026-01-06T13:30:43,010 adding 'unitxt/catalog/cards/global_mmlu/tr/clinical_knowledge.json' 2026-01-06T13:30:43,012 adding 'unitxt/catalog/cards/global_mmlu/tr/college_biology.json' 2026-01-06T13:30:43,013 adding 'unitxt/catalog/cards/global_mmlu/tr/college_chemistry.json' 2026-01-06T13:30:43,014 adding 'unitxt/catalog/cards/global_mmlu/tr/college_computer_science.json' 2026-01-06T13:30:43,016 adding 'unitxt/catalog/cards/global_mmlu/tr/college_mathematics.json' 2026-01-06T13:30:43,017 adding 'unitxt/catalog/cards/global_mmlu/tr/college_medicine.json' 2026-01-06T13:30:43,018 adding 'unitxt/catalog/cards/global_mmlu/tr/college_physics.json' 2026-01-06T13:30:43,020 adding 'unitxt/catalog/cards/global_mmlu/tr/computer_security.json' 2026-01-06T13:30:43,021 adding 'unitxt/catalog/cards/global_mmlu/tr/conceptual_physics.json' 2026-01-06T13:30:43,022 adding 'unitxt/catalog/cards/global_mmlu/tr/econometrics.json' 2026-01-06T13:30:43,023 adding 'unitxt/catalog/cards/global_mmlu/tr/electrical_engineering.json' 2026-01-06T13:30:43,025 adding 'unitxt/catalog/cards/global_mmlu/tr/elementary_mathematics.json' 2026-01-06T13:30:43,026 adding 'unitxt/catalog/cards/global_mmlu/tr/formal_logic.json' 2026-01-06T13:30:43,027 adding 'unitxt/catalog/cards/global_mmlu/tr/global_facts.json' 2026-01-06T13:30:43,029 adding 'unitxt/catalog/cards/global_mmlu/tr/high_school_biology.json' 2026-01-06T13:30:43,030 adding 'unitxt/catalog/cards/global_mmlu/tr/high_school_chemistry.json' 2026-01-06T13:30:43,031 adding 'unitxt/catalog/cards/global_mmlu/tr/high_school_computer_science.json' 2026-01-06T13:30:43,033 adding 'unitxt/catalog/cards/global_mmlu/tr/high_school_european_history.json' 2026-01-06T13:30:43,034 adding 'unitxt/catalog/cards/global_mmlu/tr/high_school_geography.json' 2026-01-06T13:30:43,035 adding 'unitxt/catalog/cards/global_mmlu/tr/high_school_government_and_politics.json' 2026-01-06T13:30:43,037 adding 'unitxt/catalog/cards/global_mmlu/tr/high_school_macroeconomics.json' 2026-01-06T13:30:43,038 adding 'unitxt/catalog/cards/global_mmlu/tr/high_school_mathematics.json' 2026-01-06T13:30:43,039 adding 'unitxt/catalog/cards/global_mmlu/tr/high_school_microeconomics.json' 2026-01-06T13:30:43,041 adding 'unitxt/catalog/cards/global_mmlu/tr/high_school_physics.json' 2026-01-06T13:30:43,042 adding 'unitxt/catalog/cards/global_mmlu/tr/high_school_psychology.json' 2026-01-06T13:30:43,043 adding 'unitxt/catalog/cards/global_mmlu/tr/high_school_statistics.json' 2026-01-06T13:30:43,044 adding 'unitxt/catalog/cards/global_mmlu/tr/high_school_us_history.json' 2026-01-06T13:30:43,045 adding 'unitxt/catalog/cards/global_mmlu/tr/high_school_world_history.json' 2026-01-06T13:30:43,047 adding 'unitxt/catalog/cards/global_mmlu/tr/human_aging.json' 2026-01-06T13:30:43,048 adding 'unitxt/catalog/cards/global_mmlu/tr/human_sexuality.json' 2026-01-06T13:30:43,049 adding 'unitxt/catalog/cards/global_mmlu/tr/international_law.json' 2026-01-06T13:30:43,050 adding 'unitxt/catalog/cards/global_mmlu/tr/jurisprudence.json' 2026-01-06T13:30:43,052 adding 'unitxt/catalog/cards/global_mmlu/tr/logical_fallacies.json' 2026-01-06T13:30:43,053 adding 'unitxt/catalog/cards/global_mmlu/tr/machine_learning.json' 2026-01-06T13:30:43,054 adding 'unitxt/catalog/cards/global_mmlu/tr/management.json' 2026-01-06T13:30:43,056 adding 'unitxt/catalog/cards/global_mmlu/tr/marketing.json' 2026-01-06T13:30:43,057 adding 'unitxt/catalog/cards/global_mmlu/tr/medical_genetics.json' 2026-01-06T13:30:43,058 adding 'unitxt/catalog/cards/global_mmlu/tr/miscellaneous.json' 2026-01-06T13:30:43,059 adding 'unitxt/catalog/cards/global_mmlu/tr/moral_disputes.json' 2026-01-06T13:30:43,061 adding 'unitxt/catalog/cards/global_mmlu/tr/moral_scenarios.json' 2026-01-06T13:30:43,062 adding 'unitxt/catalog/cards/global_mmlu/tr/nutrition.json' 2026-01-06T13:30:43,063 adding 'unitxt/catalog/cards/global_mmlu/tr/philosophy.json' 2026-01-06T13:30:43,064 adding 'unitxt/catalog/cards/global_mmlu/tr/prehistory.json' 2026-01-06T13:30:43,066 adding 'unitxt/catalog/cards/global_mmlu/tr/professional_accounting.json' 2026-01-06T13:30:43,067 adding 'unitxt/catalog/cards/global_mmlu/tr/professional_law.json' 2026-01-06T13:30:43,068 adding 'unitxt/catalog/cards/global_mmlu/tr/professional_medicine.json' 2026-01-06T13:30:43,070 adding 'unitxt/catalog/cards/global_mmlu/tr/professional_psychology.json' 2026-01-06T13:30:43,071 adding 'unitxt/catalog/cards/global_mmlu/tr/public_relations.json' 2026-01-06T13:30:43,072 adding 'unitxt/catalog/cards/global_mmlu/tr/security_studies.json' 2026-01-06T13:30:43,073 adding 'unitxt/catalog/cards/global_mmlu/tr/sociology.json' 2026-01-06T13:30:43,075 adding 'unitxt/catalog/cards/global_mmlu/tr/us_foreign_policy.json' 2026-01-06T13:30:43,076 adding 'unitxt/catalog/cards/global_mmlu/tr/virology.json' 2026-01-06T13:30:43,077 adding 'unitxt/catalog/cards/global_mmlu/tr/world_religions.json' 2026-01-06T13:30:43,080 adding 'unitxt/catalog/cards/global_mmlu/uk/abstract_algebra.json' 2026-01-06T13:30:43,081 adding 'unitxt/catalog/cards/global_mmlu/uk/anatomy.json' 2026-01-06T13:30:43,083 adding 'unitxt/catalog/cards/global_mmlu/uk/astronomy.json' 2026-01-06T13:30:43,084 adding 'unitxt/catalog/cards/global_mmlu/uk/business_ethics.json' 2026-01-06T13:30:43,085 adding 'unitxt/catalog/cards/global_mmlu/uk/clinical_knowledge.json' 2026-01-06T13:30:43,087 adding 'unitxt/catalog/cards/global_mmlu/uk/college_biology.json' 2026-01-06T13:30:43,088 adding 'unitxt/catalog/cards/global_mmlu/uk/college_chemistry.json' 2026-01-06T13:30:43,089 adding 'unitxt/catalog/cards/global_mmlu/uk/college_computer_science.json' 2026-01-06T13:30:43,091 adding 'unitxt/catalog/cards/global_mmlu/uk/college_mathematics.json' 2026-01-06T13:30:43,092 adding 'unitxt/catalog/cards/global_mmlu/uk/college_medicine.json' 2026-01-06T13:30:43,093 adding 'unitxt/catalog/cards/global_mmlu/uk/college_physics.json' 2026-01-06T13:30:43,095 adding 'unitxt/catalog/cards/global_mmlu/uk/computer_security.json' 2026-01-06T13:30:43,096 adding 'unitxt/catalog/cards/global_mmlu/uk/conceptual_physics.json' 2026-01-06T13:30:43,097 adding 'unitxt/catalog/cards/global_mmlu/uk/econometrics.json' 2026-01-06T13:30:43,098 adding 'unitxt/catalog/cards/global_mmlu/uk/electrical_engineering.json' 2026-01-06T13:30:43,100 adding 'unitxt/catalog/cards/global_mmlu/uk/elementary_mathematics.json' 2026-01-06T13:30:43,101 adding 'unitxt/catalog/cards/global_mmlu/uk/formal_logic.json' 2026-01-06T13:30:43,102 adding 'unitxt/catalog/cards/global_mmlu/uk/global_facts.json' 2026-01-06T13:30:43,103 adding 'unitxt/catalog/cards/global_mmlu/uk/high_school_biology.json' 2026-01-06T13:30:43,104 adding 'unitxt/catalog/cards/global_mmlu/uk/high_school_chemistry.json' 2026-01-06T13:30:43,106 adding 'unitxt/catalog/cards/global_mmlu/uk/high_school_computer_science.json' 2026-01-06T13:30:43,107 adding 'unitxt/catalog/cards/global_mmlu/uk/high_school_european_history.json' 2026-01-06T13:30:43,108 adding 'unitxt/catalog/cards/global_mmlu/uk/high_school_geography.json' 2026-01-06T13:30:43,109 adding 'unitxt/catalog/cards/global_mmlu/uk/high_school_government_and_politics.json' 2026-01-06T13:30:43,111 adding 'unitxt/catalog/cards/global_mmlu/uk/high_school_macroeconomics.json' 2026-01-06T13:30:43,112 adding 'unitxt/catalog/cards/global_mmlu/uk/high_school_mathematics.json' 2026-01-06T13:30:43,113 adding 'unitxt/catalog/cards/global_mmlu/uk/high_school_microeconomics.json' 2026-01-06T13:30:43,115 adding 'unitxt/catalog/cards/global_mmlu/uk/high_school_physics.json' 2026-01-06T13:30:43,116 adding 'unitxt/catalog/cards/global_mmlu/uk/high_school_psychology.json' 2026-01-06T13:30:43,117 adding 'unitxt/catalog/cards/global_mmlu/uk/high_school_statistics.json' 2026-01-06T13:30:43,119 adding 'unitxt/catalog/cards/global_mmlu/uk/high_school_us_history.json' 2026-01-06T13:30:43,120 adding 'unitxt/catalog/cards/global_mmlu/uk/high_school_world_history.json' 2026-01-06T13:30:43,121 adding 'unitxt/catalog/cards/global_mmlu/uk/human_aging.json' 2026-01-06T13:30:43,122 adding 'unitxt/catalog/cards/global_mmlu/uk/human_sexuality.json' 2026-01-06T13:30:43,124 adding 'unitxt/catalog/cards/global_mmlu/uk/international_law.json' 2026-01-06T13:30:43,125 adding 'unitxt/catalog/cards/global_mmlu/uk/jurisprudence.json' 2026-01-06T13:30:43,126 adding 'unitxt/catalog/cards/global_mmlu/uk/logical_fallacies.json' 2026-01-06T13:30:43,127 adding 'unitxt/catalog/cards/global_mmlu/uk/machine_learning.json' 2026-01-06T13:30:43,129 adding 'unitxt/catalog/cards/global_mmlu/uk/management.json' 2026-01-06T13:30:43,130 adding 'unitxt/catalog/cards/global_mmlu/uk/marketing.json' 2026-01-06T13:30:43,131 adding 'unitxt/catalog/cards/global_mmlu/uk/medical_genetics.json' 2026-01-06T13:30:43,133 adding 'unitxt/catalog/cards/global_mmlu/uk/miscellaneous.json' 2026-01-06T13:30:43,134 adding 'unitxt/catalog/cards/global_mmlu/uk/moral_disputes.json' 2026-01-06T13:30:43,135 adding 'unitxt/catalog/cards/global_mmlu/uk/moral_scenarios.json' 2026-01-06T13:30:43,137 adding 'unitxt/catalog/cards/global_mmlu/uk/nutrition.json' 2026-01-06T13:30:43,138 adding 'unitxt/catalog/cards/global_mmlu/uk/philosophy.json' 2026-01-06T13:30:43,139 adding 'unitxt/catalog/cards/global_mmlu/uk/prehistory.json' 2026-01-06T13:30:43,141 adding 'unitxt/catalog/cards/global_mmlu/uk/professional_accounting.json' 2026-01-06T13:30:43,142 adding 'unitxt/catalog/cards/global_mmlu/uk/professional_law.json' 2026-01-06T13:30:43,143 adding 'unitxt/catalog/cards/global_mmlu/uk/professional_medicine.json' 2026-01-06T13:30:43,144 adding 'unitxt/catalog/cards/global_mmlu/uk/professional_psychology.json' 2026-01-06T13:30:43,146 adding 'unitxt/catalog/cards/global_mmlu/uk/public_relations.json' 2026-01-06T13:30:43,147 adding 'unitxt/catalog/cards/global_mmlu/uk/security_studies.json' 2026-01-06T13:30:43,148 adding 'unitxt/catalog/cards/global_mmlu/uk/sociology.json' 2026-01-06T13:30:43,150 adding 'unitxt/catalog/cards/global_mmlu/uk/us_foreign_policy.json' 2026-01-06T13:30:43,151 adding 'unitxt/catalog/cards/global_mmlu/uk/virology.json' 2026-01-06T13:30:43,152 adding 'unitxt/catalog/cards/global_mmlu/uk/world_religions.json' 2026-01-06T13:30:43,155 adding 'unitxt/catalog/cards/global_mmlu/vi/abstract_algebra.json' 2026-01-06T13:30:43,156 adding 'unitxt/catalog/cards/global_mmlu/vi/anatomy.json' 2026-01-06T13:30:43,158 adding 'unitxt/catalog/cards/global_mmlu/vi/astronomy.json' 2026-01-06T13:30:43,159 adding 'unitxt/catalog/cards/global_mmlu/vi/business_ethics.json' 2026-01-06T13:30:43,160 adding 'unitxt/catalog/cards/global_mmlu/vi/clinical_knowledge.json' 2026-01-06T13:30:43,161 adding 'unitxt/catalog/cards/global_mmlu/vi/college_biology.json' 2026-01-06T13:30:43,163 adding 'unitxt/catalog/cards/global_mmlu/vi/college_chemistry.json' 2026-01-06T13:30:43,164 adding 'unitxt/catalog/cards/global_mmlu/vi/college_computer_science.json' 2026-01-06T13:30:43,165 adding 'unitxt/catalog/cards/global_mmlu/vi/college_mathematics.json' 2026-01-06T13:30:43,166 adding 'unitxt/catalog/cards/global_mmlu/vi/college_medicine.json' 2026-01-06T13:30:43,168 adding 'unitxt/catalog/cards/global_mmlu/vi/college_physics.json' 2026-01-06T13:30:43,169 adding 'unitxt/catalog/cards/global_mmlu/vi/computer_security.json' 2026-01-06T13:30:43,170 adding 'unitxt/catalog/cards/global_mmlu/vi/conceptual_physics.json' 2026-01-06T13:30:43,172 adding 'unitxt/catalog/cards/global_mmlu/vi/econometrics.json' 2026-01-06T13:30:43,173 adding 'unitxt/catalog/cards/global_mmlu/vi/electrical_engineering.json' 2026-01-06T13:30:43,174 adding 'unitxt/catalog/cards/global_mmlu/vi/elementary_mathematics.json' 2026-01-06T13:30:43,176 adding 'unitxt/catalog/cards/global_mmlu/vi/formal_logic.json' 2026-01-06T13:30:43,177 adding 'unitxt/catalog/cards/global_mmlu/vi/global_facts.json' 2026-01-06T13:30:43,178 adding 'unitxt/catalog/cards/global_mmlu/vi/high_school_biology.json' 2026-01-06T13:30:43,179 adding 'unitxt/catalog/cards/global_mmlu/vi/high_school_chemistry.json' 2026-01-06T13:30:43,181 adding 'unitxt/catalog/cards/global_mmlu/vi/high_school_computer_science.json' 2026-01-06T13:30:43,182 adding 'unitxt/catalog/cards/global_mmlu/vi/high_school_european_history.json' 2026-01-06T13:30:43,183 adding 'unitxt/catalog/cards/global_mmlu/vi/high_school_geography.json' 2026-01-06T13:30:43,184 adding 'unitxt/catalog/cards/global_mmlu/vi/high_school_government_and_politics.json' 2026-01-06T13:30:43,186 adding 'unitxt/catalog/cards/global_mmlu/vi/high_school_macroeconomics.json' 2026-01-06T13:30:43,187 adding 'unitxt/catalog/cards/global_mmlu/vi/high_school_mathematics.json' 2026-01-06T13:30:43,188 adding 'unitxt/catalog/cards/global_mmlu/vi/high_school_microeconomics.json' 2026-01-06T13:30:43,190 adding 'unitxt/catalog/cards/global_mmlu/vi/high_school_physics.json' 2026-01-06T13:30:43,191 adding 'unitxt/catalog/cards/global_mmlu/vi/high_school_psychology.json' 2026-01-06T13:30:43,192 adding 'unitxt/catalog/cards/global_mmlu/vi/high_school_statistics.json' 2026-01-06T13:30:43,194 adding 'unitxt/catalog/cards/global_mmlu/vi/high_school_us_history.json' 2026-01-06T13:30:43,195 adding 'unitxt/catalog/cards/global_mmlu/vi/high_school_world_history.json' 2026-01-06T13:30:43,196 adding 'unitxt/catalog/cards/global_mmlu/vi/human_aging.json' 2026-01-06T13:30:43,198 adding 'unitxt/catalog/cards/global_mmlu/vi/human_sexuality.json' 2026-01-06T13:30:43,199 adding 'unitxt/catalog/cards/global_mmlu/vi/international_law.json' 2026-01-06T13:30:43,200 adding 'unitxt/catalog/cards/global_mmlu/vi/jurisprudence.json' 2026-01-06T13:30:43,202 adding 'unitxt/catalog/cards/global_mmlu/vi/logical_fallacies.json' 2026-01-06T13:30:43,203 adding 'unitxt/catalog/cards/global_mmlu/vi/machine_learning.json' 2026-01-06T13:30:43,204 adding 'unitxt/catalog/cards/global_mmlu/vi/management.json' 2026-01-06T13:30:43,206 adding 'unitxt/catalog/cards/global_mmlu/vi/marketing.json' 2026-01-06T13:30:43,207 adding 'unitxt/catalog/cards/global_mmlu/vi/medical_genetics.json' 2026-01-06T13:30:43,208 adding 'unitxt/catalog/cards/global_mmlu/vi/miscellaneous.json' 2026-01-06T13:30:43,210 adding 'unitxt/catalog/cards/global_mmlu/vi/moral_disputes.json' 2026-01-06T13:30:43,211 adding 'unitxt/catalog/cards/global_mmlu/vi/moral_scenarios.json' 2026-01-06T13:30:43,212 adding 'unitxt/catalog/cards/global_mmlu/vi/nutrition.json' 2026-01-06T13:30:43,213 adding 'unitxt/catalog/cards/global_mmlu/vi/philosophy.json' 2026-01-06T13:30:43,215 adding 'unitxt/catalog/cards/global_mmlu/vi/prehistory.json' 2026-01-06T13:30:43,216 adding 'unitxt/catalog/cards/global_mmlu/vi/professional_accounting.json' 2026-01-06T13:30:43,217 adding 'unitxt/catalog/cards/global_mmlu/vi/professional_law.json' 2026-01-06T13:30:43,218 adding 'unitxt/catalog/cards/global_mmlu/vi/professional_medicine.json' 2026-01-06T13:30:43,219 adding 'unitxt/catalog/cards/global_mmlu/vi/professional_psychology.json' 2026-01-06T13:30:43,221 adding 'unitxt/catalog/cards/global_mmlu/vi/public_relations.json' 2026-01-06T13:30:43,222 adding 'unitxt/catalog/cards/global_mmlu/vi/security_studies.json' 2026-01-06T13:30:43,223 adding 'unitxt/catalog/cards/global_mmlu/vi/sociology.json' 2026-01-06T13:30:43,225 adding 'unitxt/catalog/cards/global_mmlu/vi/us_foreign_policy.json' 2026-01-06T13:30:43,226 adding 'unitxt/catalog/cards/global_mmlu/vi/virology.json' 2026-01-06T13:30:43,228 adding 'unitxt/catalog/cards/global_mmlu/vi/world_religions.json' 2026-01-06T13:30:43,231 adding 'unitxt/catalog/cards/global_mmlu/yo/abstract_algebra.json' 2026-01-06T13:30:43,232 adding 'unitxt/catalog/cards/global_mmlu/yo/anatomy.json' 2026-01-06T13:30:43,233 adding 'unitxt/catalog/cards/global_mmlu/yo/astronomy.json' 2026-01-06T13:30:43,234 adding 'unitxt/catalog/cards/global_mmlu/yo/business_ethics.json' 2026-01-06T13:30:43,236 adding 'unitxt/catalog/cards/global_mmlu/yo/clinical_knowledge.json' 2026-01-06T13:30:43,237 adding 'unitxt/catalog/cards/global_mmlu/yo/college_biology.json' 2026-01-06T13:30:43,238 adding 'unitxt/catalog/cards/global_mmlu/yo/college_chemistry.json' 2026-01-06T13:30:43,240 adding 'unitxt/catalog/cards/global_mmlu/yo/college_computer_science.json' 2026-01-06T13:30:43,241 adding 'unitxt/catalog/cards/global_mmlu/yo/college_mathematics.json' 2026-01-06T13:30:43,242 adding 'unitxt/catalog/cards/global_mmlu/yo/college_medicine.json' 2026-01-06T13:30:43,243 adding 'unitxt/catalog/cards/global_mmlu/yo/college_physics.json' 2026-01-06T13:30:43,245 adding 'unitxt/catalog/cards/global_mmlu/yo/computer_security.json' 2026-01-06T13:30:43,246 adding 'unitxt/catalog/cards/global_mmlu/yo/conceptual_physics.json' 2026-01-06T13:30:43,247 adding 'unitxt/catalog/cards/global_mmlu/yo/econometrics.json' 2026-01-06T13:30:43,249 adding 'unitxt/catalog/cards/global_mmlu/yo/electrical_engineering.json' 2026-01-06T13:30:43,250 adding 'unitxt/catalog/cards/global_mmlu/yo/elementary_mathematics.json' 2026-01-06T13:30:43,251 adding 'unitxt/catalog/cards/global_mmlu/yo/formal_logic.json' 2026-01-06T13:30:43,253 adding 'unitxt/catalog/cards/global_mmlu/yo/global_facts.json' 2026-01-06T13:30:43,254 adding 'unitxt/catalog/cards/global_mmlu/yo/high_school_biology.json' 2026-01-06T13:30:43,255 adding 'unitxt/catalog/cards/global_mmlu/yo/high_school_chemistry.json' 2026-01-06T13:30:43,257 adding 'unitxt/catalog/cards/global_mmlu/yo/high_school_computer_science.json' 2026-01-06T13:30:43,258 adding 'unitxt/catalog/cards/global_mmlu/yo/high_school_european_history.json' 2026-01-06T13:30:43,259 adding 'unitxt/catalog/cards/global_mmlu/yo/high_school_geography.json' 2026-01-06T13:30:43,261 adding 'unitxt/catalog/cards/global_mmlu/yo/high_school_government_and_politics.json' 2026-01-06T13:30:43,262 adding 'unitxt/catalog/cards/global_mmlu/yo/high_school_macroeconomics.json' 2026-01-06T13:30:43,263 adding 'unitxt/catalog/cards/global_mmlu/yo/high_school_mathematics.json' 2026-01-06T13:30:43,265 adding 'unitxt/catalog/cards/global_mmlu/yo/high_school_microeconomics.json' 2026-01-06T13:30:43,266 adding 'unitxt/catalog/cards/global_mmlu/yo/high_school_physics.json' 2026-01-06T13:30:43,267 adding 'unitxt/catalog/cards/global_mmlu/yo/high_school_psychology.json' 2026-01-06T13:30:43,269 adding 'unitxt/catalog/cards/global_mmlu/yo/high_school_statistics.json' 2026-01-06T13:30:43,270 adding 'unitxt/catalog/cards/global_mmlu/yo/high_school_us_history.json' 2026-01-06T13:30:43,271 adding 'unitxt/catalog/cards/global_mmlu/yo/high_school_world_history.json' 2026-01-06T13:30:43,272 adding 'unitxt/catalog/cards/global_mmlu/yo/human_aging.json' 2026-01-06T13:30:43,274 adding 'unitxt/catalog/cards/global_mmlu/yo/human_sexuality.json' 2026-01-06T13:30:43,275 adding 'unitxt/catalog/cards/global_mmlu/yo/international_law.json' 2026-01-06T13:30:43,276 adding 'unitxt/catalog/cards/global_mmlu/yo/jurisprudence.json' 2026-01-06T13:30:43,277 adding 'unitxt/catalog/cards/global_mmlu/yo/logical_fallacies.json' 2026-01-06T13:30:43,279 adding 'unitxt/catalog/cards/global_mmlu/yo/machine_learning.json' 2026-01-06T13:30:43,280 adding 'unitxt/catalog/cards/global_mmlu/yo/management.json' 2026-01-06T13:30:43,281 adding 'unitxt/catalog/cards/global_mmlu/yo/marketing.json' 2026-01-06T13:30:43,282 adding 'unitxt/catalog/cards/global_mmlu/yo/medical_genetics.json' 2026-01-06T13:30:43,284 adding 'unitxt/catalog/cards/global_mmlu/yo/miscellaneous.json' 2026-01-06T13:30:43,285 adding 'unitxt/catalog/cards/global_mmlu/yo/moral_disputes.json' 2026-01-06T13:30:43,286 adding 'unitxt/catalog/cards/global_mmlu/yo/moral_scenarios.json' 2026-01-06T13:30:43,287 adding 'unitxt/catalog/cards/global_mmlu/yo/nutrition.json' 2026-01-06T13:30:43,289 adding 'unitxt/catalog/cards/global_mmlu/yo/philosophy.json' 2026-01-06T13:30:43,290 adding 'unitxt/catalog/cards/global_mmlu/yo/prehistory.json' 2026-01-06T13:30:43,291 adding 'unitxt/catalog/cards/global_mmlu/yo/professional_accounting.json' 2026-01-06T13:30:43,293 adding 'unitxt/catalog/cards/global_mmlu/yo/professional_law.json' 2026-01-06T13:30:43,294 adding 'unitxt/catalog/cards/global_mmlu/yo/professional_medicine.json' 2026-01-06T13:30:43,295 adding 'unitxt/catalog/cards/global_mmlu/yo/professional_psychology.json' 2026-01-06T13:30:43,297 adding 'unitxt/catalog/cards/global_mmlu/yo/public_relations.json' 2026-01-06T13:30:43,298 adding 'unitxt/catalog/cards/global_mmlu/yo/security_studies.json' 2026-01-06T13:30:43,299 adding 'unitxt/catalog/cards/global_mmlu/yo/sociology.json' 2026-01-06T13:30:43,301 adding 'unitxt/catalog/cards/global_mmlu/yo/us_foreign_policy.json' 2026-01-06T13:30:43,302 adding 'unitxt/catalog/cards/global_mmlu/yo/virology.json' 2026-01-06T13:30:43,303 adding 'unitxt/catalog/cards/global_mmlu/yo/world_religions.json' 2026-01-06T13:30:43,306 adding 'unitxt/catalog/cards/global_mmlu/zh/abstract_algebra.json' 2026-01-06T13:30:43,307 adding 'unitxt/catalog/cards/global_mmlu/zh/anatomy.json' 2026-01-06T13:30:43,309 adding 'unitxt/catalog/cards/global_mmlu/zh/astronomy.json' 2026-01-06T13:30:43,310 adding 'unitxt/catalog/cards/global_mmlu/zh/business_ethics.json' 2026-01-06T13:30:43,311 adding 'unitxt/catalog/cards/global_mmlu/zh/clinical_knowledge.json' 2026-01-06T13:30:43,313 adding 'unitxt/catalog/cards/global_mmlu/zh/college_biology.json' 2026-01-06T13:30:43,314 adding 'unitxt/catalog/cards/global_mmlu/zh/college_chemistry.json' 2026-01-06T13:30:43,315 adding 'unitxt/catalog/cards/global_mmlu/zh/college_computer_science.json' 2026-01-06T13:30:43,317 adding 'unitxt/catalog/cards/global_mmlu/zh/college_mathematics.json' 2026-01-06T13:30:43,318 adding 'unitxt/catalog/cards/global_mmlu/zh/college_medicine.json' 2026-01-06T13:30:43,319 adding 'unitxt/catalog/cards/global_mmlu/zh/college_physics.json' 2026-01-06T13:30:43,320 adding 'unitxt/catalog/cards/global_mmlu/zh/computer_security.json' 2026-01-06T13:30:43,322 adding 'unitxt/catalog/cards/global_mmlu/zh/conceptual_physics.json' 2026-01-06T13:30:43,323 adding 'unitxt/catalog/cards/global_mmlu/zh/econometrics.json' 2026-01-06T13:30:43,324 adding 'unitxt/catalog/cards/global_mmlu/zh/electrical_engineering.json' 2026-01-06T13:30:43,326 adding 'unitxt/catalog/cards/global_mmlu/zh/elementary_mathematics.json' 2026-01-06T13:30:43,327 adding 'unitxt/catalog/cards/global_mmlu/zh/formal_logic.json' 2026-01-06T13:30:43,329 adding 'unitxt/catalog/cards/global_mmlu/zh/global_facts.json' 2026-01-06T13:30:43,330 adding 'unitxt/catalog/cards/global_mmlu/zh/high_school_biology.json' 2026-01-06T13:30:43,331 adding 'unitxt/catalog/cards/global_mmlu/zh/high_school_chemistry.json' 2026-01-06T13:30:43,332 adding 'unitxt/catalog/cards/global_mmlu/zh/high_school_computer_science.json' 2026-01-06T13:30:43,333 adding 'unitxt/catalog/cards/global_mmlu/zh/high_school_european_history.json' 2026-01-06T13:30:43,334 adding 'unitxt/catalog/cards/global_mmlu/zh/high_school_geography.json' 2026-01-06T13:30:43,336 adding 'unitxt/catalog/cards/global_mmlu/zh/high_school_government_and_politics.json' 2026-01-06T13:30:43,337 adding 'unitxt/catalog/cards/global_mmlu/zh/high_school_macroeconomics.json' 2026-01-06T13:30:43,338 adding 'unitxt/catalog/cards/global_mmlu/zh/high_school_mathematics.json' 2026-01-06T13:30:43,339 adding 'unitxt/catalog/cards/global_mmlu/zh/high_school_microeconomics.json' 2026-01-06T13:30:43,341 adding 'unitxt/catalog/cards/global_mmlu/zh/high_school_physics.json' 2026-01-06T13:30:43,342 adding 'unitxt/catalog/cards/global_mmlu/zh/high_school_psychology.json' 2026-01-06T13:30:43,343 adding 'unitxt/catalog/cards/global_mmlu/zh/high_school_statistics.json' 2026-01-06T13:30:43,345 adding 'unitxt/catalog/cards/global_mmlu/zh/high_school_us_history.json' 2026-01-06T13:30:43,346 adding 'unitxt/catalog/cards/global_mmlu/zh/high_school_world_history.json' 2026-01-06T13:30:43,347 adding 'unitxt/catalog/cards/global_mmlu/zh/human_aging.json' 2026-01-06T13:30:43,348 adding 'unitxt/catalog/cards/global_mmlu/zh/human_sexuality.json' 2026-01-06T13:30:43,350 adding 'unitxt/catalog/cards/global_mmlu/zh/international_law.json' 2026-01-06T13:30:43,351 adding 'unitxt/catalog/cards/global_mmlu/zh/jurisprudence.json' 2026-01-06T13:30:43,352 adding 'unitxt/catalog/cards/global_mmlu/zh/logical_fallacies.json' 2026-01-06T13:30:43,353 adding 'unitxt/catalog/cards/global_mmlu/zh/machine_learning.json' 2026-01-06T13:30:43,355 adding 'unitxt/catalog/cards/global_mmlu/zh/management.json' 2026-01-06T13:30:43,356 adding 'unitxt/catalog/cards/global_mmlu/zh/marketing.json' 2026-01-06T13:30:43,357 adding 'unitxt/catalog/cards/global_mmlu/zh/medical_genetics.json' 2026-01-06T13:30:43,359 adding 'unitxt/catalog/cards/global_mmlu/zh/miscellaneous.json' 2026-01-06T13:30:43,360 adding 'unitxt/catalog/cards/global_mmlu/zh/moral_disputes.json' 2026-01-06T13:30:43,361 adding 'unitxt/catalog/cards/global_mmlu/zh/moral_scenarios.json' 2026-01-06T13:30:43,362 adding 'unitxt/catalog/cards/global_mmlu/zh/nutrition.json' 2026-01-06T13:30:43,364 adding 'unitxt/catalog/cards/global_mmlu/zh/philosophy.json' 2026-01-06T13:30:43,365 adding 'unitxt/catalog/cards/global_mmlu/zh/prehistory.json' 2026-01-06T13:30:43,366 adding 'unitxt/catalog/cards/global_mmlu/zh/professional_accounting.json' 2026-01-06T13:30:43,368 adding 'unitxt/catalog/cards/global_mmlu/zh/professional_law.json' 2026-01-06T13:30:43,369 adding 'unitxt/catalog/cards/global_mmlu/zh/professional_medicine.json' 2026-01-06T13:30:43,370 adding 'unitxt/catalog/cards/global_mmlu/zh/professional_psychology.json' 2026-01-06T13:30:43,372 adding 'unitxt/catalog/cards/global_mmlu/zh/public_relations.json' 2026-01-06T13:30:43,373 adding 'unitxt/catalog/cards/global_mmlu/zh/security_studies.json' 2026-01-06T13:30:43,374 adding 'unitxt/catalog/cards/global_mmlu/zh/sociology.json' 2026-01-06T13:30:43,375 adding 'unitxt/catalog/cards/global_mmlu/zh/us_foreign_policy.json' 2026-01-06T13:30:43,377 adding 'unitxt/catalog/cards/global_mmlu/zh/virology.json' 2026-01-06T13:30:43,378 adding 'unitxt/catalog/cards/global_mmlu/zh/world_religions.json' 2026-01-06T13:30:43,380 adding 'unitxt/catalog/cards/global_mmlu_lite_ca/ar.json' 2026-01-06T13:30:43,382 adding 'unitxt/catalog/cards/global_mmlu_lite_ca/bn.json' 2026-01-06T13:30:43,384 adding 'unitxt/catalog/cards/global_mmlu_lite_ca/de.json' 2026-01-06T13:30:43,385 adding 'unitxt/catalog/cards/global_mmlu_lite_ca/es.json' 2026-01-06T13:30:43,386 adding 'unitxt/catalog/cards/global_mmlu_lite_ca/fr.json' 2026-01-06T13:30:43,388 adding 'unitxt/catalog/cards/global_mmlu_lite_ca/hi.json' 2026-01-06T13:30:43,389 adding 'unitxt/catalog/cards/global_mmlu_lite_ca/id.json' 2026-01-06T13:30:43,390 adding 'unitxt/catalog/cards/global_mmlu_lite_ca/it.json' 2026-01-06T13:30:43,392 adding 'unitxt/catalog/cards/global_mmlu_lite_ca/ja.json' 2026-01-06T13:30:43,393 adding 'unitxt/catalog/cards/global_mmlu_lite_ca/ko.json' 2026-01-06T13:30:43,394 adding 'unitxt/catalog/cards/global_mmlu_lite_ca/pt.json' 2026-01-06T13:30:43,396 adding 'unitxt/catalog/cards/global_mmlu_lite_ca/sw.json' 2026-01-06T13:30:43,397 adding 'unitxt/catalog/cards/global_mmlu_lite_ca/yo.json' 2026-01-06T13:30:43,399 adding 'unitxt/catalog/cards/global_mmlu_lite_ca/zh.json' 2026-01-06T13:30:43,401 adding 'unitxt/catalog/cards/global_mmlu_lite_cs/ar.json' 2026-01-06T13:30:43,402 adding 'unitxt/catalog/cards/global_mmlu_lite_cs/bn.json' 2026-01-06T13:30:43,404 adding 'unitxt/catalog/cards/global_mmlu_lite_cs/de.json' 2026-01-06T13:30:43,405 adding 'unitxt/catalog/cards/global_mmlu_lite_cs/es.json' 2026-01-06T13:30:43,407 adding 'unitxt/catalog/cards/global_mmlu_lite_cs/fr.json' 2026-01-06T13:30:43,408 adding 'unitxt/catalog/cards/global_mmlu_lite_cs/hi.json' 2026-01-06T13:30:43,410 adding 'unitxt/catalog/cards/global_mmlu_lite_cs/id.json' 2026-01-06T13:30:43,411 adding 'unitxt/catalog/cards/global_mmlu_lite_cs/it.json' 2026-01-06T13:30:43,412 adding 'unitxt/catalog/cards/global_mmlu_lite_cs/ja.json' 2026-01-06T13:30:43,414 adding 'unitxt/catalog/cards/global_mmlu_lite_cs/ko.json' 2026-01-06T13:30:43,415 adding 'unitxt/catalog/cards/global_mmlu_lite_cs/pt.json' 2026-01-06T13:30:43,417 adding 'unitxt/catalog/cards/global_mmlu_lite_cs/sw.json' 2026-01-06T13:30:43,418 adding 'unitxt/catalog/cards/global_mmlu_lite_cs/yo.json' 2026-01-06T13:30:43,420 adding 'unitxt/catalog/cards/global_mmlu_lite_cs/zh.json' 2026-01-06T13:30:43,422 adding 'unitxt/catalog/cards/go_emotions/simplified.json' 2026-01-06T13:30:43,424 adding 'unitxt/catalog/cards/gpqa/diamond.json' 2026-01-06T13:30:43,425 adding 'unitxt/catalog/cards/gpqa/extended.json' 2026-01-06T13:30:43,426 adding 'unitxt/catalog/cards/gpqa/main.json' 2026-01-06T13:30:43,428 adding 'unitxt/catalog/cards/head_qa/en.json' 2026-01-06T13:30:43,429 adding 'unitxt/catalog/cards/head_qa/es.json' 2026-01-06T13:30:43,431 adding 'unitxt/catalog/cards/head_qa/gl.json' 2026-01-06T13:30:43,432 adding 'unitxt/catalog/cards/head_qa/it.json' 2026-01-06T13:30:43,433 adding 'unitxt/catalog/cards/head_qa/ru.json' 2026-01-06T13:30:43,435 adding 'unitxt/catalog/cards/judge_bench/cola/grammaticality.json' 2026-01-06T13:30:43,437 adding 'unitxt/catalog/cards/judge_bench/dices/safety.json' 2026-01-06T13:30:43,439 adding 'unitxt/catalog/cards/judge_bench/inferential_strategies/sound_reasoning.json' 2026-01-06T13:30:43,441 adding 'unitxt/catalog/cards/judge_bench/newswoom/coherence.json' 2026-01-06T13:30:43,442 adding 'unitxt/catalog/cards/judge_bench/newswoom/fluency.json' 2026-01-06T13:30:43,443 adding 'unitxt/catalog/cards/judge_bench/newswoom/informativeness.json' 2026-01-06T13:30:43,445 adding 'unitxt/catalog/cards/judge_bench/newswoom/relevance.json' 2026-01-06T13:30:43,447 adding 'unitxt/catalog/cards/judge_bench/roscoe/overall/cosmos/coherence.json' 2026-01-06T13:30:43,449 adding 'unitxt/catalog/cards/judge_bench/roscoe/overall/cosmos/contradiction.json' 2026-01-06T13:30:43,450 adding 'unitxt/catalog/cards/judge_bench/roscoe/overall/cosmos/missing_steps.json' 2026-01-06T13:30:43,451 adding 'unitxt/catalog/cards/judge_bench/roscoe/overall/cosmos/overall_quality.json' 2026-01-06T13:30:43,453 adding 'unitxt/catalog/cards/judge_bench/roscoe/overall/drop/coherence.json' 2026-01-06T13:30:43,454 adding 'unitxt/catalog/cards/judge_bench/roscoe/overall/drop/contradiction.json' 2026-01-06T13:30:43,456 adding 'unitxt/catalog/cards/judge_bench/roscoe/overall/drop/missing_steps.json' 2026-01-06T13:30:43,457 adding 'unitxt/catalog/cards/judge_bench/roscoe/overall/drop/overall_quality.json' 2026-01-06T13:30:43,459 adding 'unitxt/catalog/cards/judge_bench/roscoe/overall/esnli/coherence.json' 2026-01-06T13:30:43,460 adding 'unitxt/catalog/cards/judge_bench/roscoe/overall/esnli/contradiction.json' 2026-01-06T13:30:43,461 adding 'unitxt/catalog/cards/judge_bench/roscoe/overall/esnli/missing_steps.json' 2026-01-06T13:30:43,462 adding 'unitxt/catalog/cards/judge_bench/roscoe/overall/esnli/overall_quality.json' 2026-01-06T13:30:43,465 adding 'unitxt/catalog/cards/judge_bench/roscoe/stepwise/cosmos/arithmetic.json' 2026-01-06T13:30:43,466 adding 'unitxt/catalog/cards/judge_bench/roscoe/stepwise/cosmos/coherency_and_logic.json' 2026-01-06T13:30:43,467 adding 'unitxt/catalog/cards/judge_bench/roscoe/stepwise/cosmos/commonsense.json' 2026-01-06T13:30:43,468 adding 'unitxt/catalog/cards/judge_bench/roscoe/stepwise/cosmos/factuality.json' 2026-01-06T13:30:43,470 adding 'unitxt/catalog/cards/judge_bench/roscoe/stepwise/cosmos/final_answer.json' 2026-01-06T13:30:43,471 adding 'unitxt/catalog/cards/judge_bench/roscoe/stepwise/cosmos/grammar.json' 2026-01-06T13:30:43,472 adding 'unitxt/catalog/cards/judge_bench/roscoe/stepwise/cosmos/hallucination.json' 2026-01-06T13:30:43,474 adding 'unitxt/catalog/cards/judge_bench/roscoe/stepwise/cosmos/redundancy.json' 2026-01-06T13:30:43,475 adding 'unitxt/catalog/cards/judge_bench/roscoe/stepwise/cosmos/repetition.json' 2026-01-06T13:30:43,477 adding 'unitxt/catalog/cards/judge_bench/roscoe/stepwise/drop/arithmetic.json' 2026-01-06T13:30:43,478 adding 'unitxt/catalog/cards/judge_bench/roscoe/stepwise/drop/coherency_and_logic.json' 2026-01-06T13:30:43,479 adding 'unitxt/catalog/cards/judge_bench/roscoe/stepwise/drop/commonsense.json' 2026-01-06T13:30:43,481 adding 'unitxt/catalog/cards/judge_bench/roscoe/stepwise/drop/factuality.json' 2026-01-06T13:30:43,482 adding 'unitxt/catalog/cards/judge_bench/roscoe/stepwise/drop/final_answer.json' 2026-01-06T13:30:43,483 adding 'unitxt/catalog/cards/judge_bench/roscoe/stepwise/drop/grammar.json' 2026-01-06T13:30:43,484 adding 'unitxt/catalog/cards/judge_bench/roscoe/stepwise/drop/hallucination.json' 2026-01-06T13:30:43,486 adding 'unitxt/catalog/cards/judge_bench/roscoe/stepwise/drop/redundancy.json' 2026-01-06T13:30:43,487 adding 'unitxt/catalog/cards/judge_bench/roscoe/stepwise/drop/repetition.json' 2026-01-06T13:30:43,489 adding 'unitxt/catalog/cards/judge_bench/roscoe/stepwise/esnli/arithmetic.json' 2026-01-06T13:30:43,490 adding 'unitxt/catalog/cards/judge_bench/roscoe/stepwise/esnli/coherency_and_logic.json' 2026-01-06T13:30:43,492 adding 'unitxt/catalog/cards/judge_bench/roscoe/stepwise/esnli/commonsense.json' 2026-01-06T13:30:43,493 adding 'unitxt/catalog/cards/judge_bench/roscoe/stepwise/esnli/factuality.json' 2026-01-06T13:30:43,494 adding 'unitxt/catalog/cards/judge_bench/roscoe/stepwise/esnli/final_answer.json' 2026-01-06T13:30:43,496 adding 'unitxt/catalog/cards/judge_bench/roscoe/stepwise/esnli/grammar.json' 2026-01-06T13:30:43,497 adding 'unitxt/catalog/cards/judge_bench/roscoe/stepwise/esnli/hallucination.json' 2026-01-06T13:30:43,498 adding 'unitxt/catalog/cards/judge_bench/roscoe/stepwise/esnli/redundancy.json' 2026-01-06T13:30:43,500 adding 'unitxt/catalog/cards/judge_bench/roscoe/stepwise/esnli/repetition.json' 2026-01-06T13:30:43,502 adding 'unitxt/catalog/cards/judge_bench/toxic_chat/jailbreaking.json' 2026-01-06T13:30:43,503 adding 'unitxt/catalog/cards/judge_bench/toxic_chat/toxicity.json' 2026-01-06T13:30:43,505 adding 'unitxt/catalog/cards/judge_bench/wmt_human/chinese_to_english/quality.json' 2026-01-06T13:30:43,507 adding 'unitxt/catalog/cards/judge_bench/wmt_human/english_to_german/quality.json' 2026-01-06T13:30:43,509 adding 'unitxt/catalog/cards/legalbench/abercrombie.json' 2026-01-06T13:30:43,510 adding 'unitxt/catalog/cards/legalbench/corporate_lobbying.json' 2026-01-06T13:30:43,511 adding 'unitxt/catalog/cards/legalbench/function_of_decision_section.json' 2026-01-06T13:30:43,513 adding 'unitxt/catalog/cards/legalbench/international_citizenship_questions.json' 2026-01-06T13:30:43,514 adding 'unitxt/catalog/cards/legalbench/proa.json' 2026-01-06T13:30:43,516 adding 'unitxt/catalog/cards/milu/Bengali/Arts_and_Humanities.json' 2026-01-06T13:30:43,518 adding 'unitxt/catalog/cards/milu/Bengali/Business_Studies.json' 2026-01-06T13:30:43,520 adding 'unitxt/catalog/cards/milu/Bengali/Engineering_and_Tech.json' 2026-01-06T13:30:43,521 adding 'unitxt/catalog/cards/milu/Bengali/Environmental_Sciences.json' 2026-01-06T13:30:43,522 adding 'unitxt/catalog/cards/milu/Bengali/Health_and_Medicine.json' 2026-01-06T13:30:43,523 adding 'unitxt/catalog/cards/milu/Bengali/Law_and_Governance.json' 2026-01-06T13:30:43,524 adding 'unitxt/catalog/cards/milu/Bengali/Science.json' 2026-01-06T13:30:43,526 adding 'unitxt/catalog/cards/milu/Bengali/Social_Sciences.json' 2026-01-06T13:30:43,528 adding 'unitxt/catalog/cards/milu/English/Arts_and_Humanities.json' 2026-01-06T13:30:43,529 adding 'unitxt/catalog/cards/milu/English/Business_Studies.json' 2026-01-06T13:30:43,530 adding 'unitxt/catalog/cards/milu/English/Engineering_and_Tech.json' 2026-01-06T13:30:43,532 adding 'unitxt/catalog/cards/milu/English/Environmental_Sciences.json' 2026-01-06T13:30:43,533 adding 'unitxt/catalog/cards/milu/English/Health_and_Medicine.json' 2026-01-06T13:30:43,534 adding 'unitxt/catalog/cards/milu/English/Law_and_Governance.json' 2026-01-06T13:30:43,535 adding 'unitxt/catalog/cards/milu/English/Science.json' 2026-01-06T13:30:43,537 adding 'unitxt/catalog/cards/milu/English/Social_Sciences.json' 2026-01-06T13:30:43,539 adding 'unitxt/catalog/cards/milu/Gujarati/Arts_and_Humanities.json' 2026-01-06T13:30:43,540 adding 'unitxt/catalog/cards/milu/Gujarati/Business_Studies.json' 2026-01-06T13:30:43,541 adding 'unitxt/catalog/cards/milu/Gujarati/Engineering_and_Tech.json' 2026-01-06T13:30:43,543 adding 'unitxt/catalog/cards/milu/Gujarati/Environmental_Sciences.json' 2026-01-06T13:30:43,544 adding 'unitxt/catalog/cards/milu/Gujarati/Health_and_Medicine.json' 2026-01-06T13:30:43,545 adding 'unitxt/catalog/cards/milu/Gujarati/Law_and_Governance.json' 2026-01-06T13:30:43,546 adding 'unitxt/catalog/cards/milu/Gujarati/Science.json' 2026-01-06T13:30:43,548 adding 'unitxt/catalog/cards/milu/Gujarati/Social_Sciences.json' 2026-01-06T13:30:43,550 adding 'unitxt/catalog/cards/milu/Hindi/Arts_and_Humanities.json' 2026-01-06T13:30:43,551 adding 'unitxt/catalog/cards/milu/Hindi/Business_Studies.json' 2026-01-06T13:30:43,552 adding 'unitxt/catalog/cards/milu/Hindi/Engineering_and_Tech.json' 2026-01-06T13:30:43,554 adding 'unitxt/catalog/cards/milu/Hindi/Environmental_Sciences.json' 2026-01-06T13:30:43,555 adding 'unitxt/catalog/cards/milu/Hindi/Health_and_Medicine.json' 2026-01-06T13:30:43,556 adding 'unitxt/catalog/cards/milu/Hindi/Law_and_Governance.json' 2026-01-06T13:30:43,558 adding 'unitxt/catalog/cards/milu/Hindi/Science.json' 2026-01-06T13:30:43,559 adding 'unitxt/catalog/cards/milu/Hindi/Social_Sciences.json' 2026-01-06T13:30:43,561 adding 'unitxt/catalog/cards/milu/Kannada/Arts_and_Humanities.json' 2026-01-06T13:30:43,562 adding 'unitxt/catalog/cards/milu/Kannada/Business_Studies.json' 2026-01-06T13:30:43,564 adding 'unitxt/catalog/cards/milu/Kannada/Engineering_and_Tech.json' 2026-01-06T13:30:43,565 adding 'unitxt/catalog/cards/milu/Kannada/Environmental_Sciences.json' 2026-01-06T13:30:43,566 adding 'unitxt/catalog/cards/milu/Kannada/Health_and_Medicine.json' 2026-01-06T13:30:43,567 adding 'unitxt/catalog/cards/milu/Kannada/Law_and_Governance.json' 2026-01-06T13:30:43,569 adding 'unitxt/catalog/cards/milu/Kannada/Science.json' 2026-01-06T13:30:43,570 adding 'unitxt/catalog/cards/milu/Kannada/Social_Sciences.json' 2026-01-06T13:30:43,572 adding 'unitxt/catalog/cards/milu/Malayalam/Arts_and_Humanities.json' 2026-01-06T13:30:43,573 adding 'unitxt/catalog/cards/milu/Malayalam/Business_Studies.json' 2026-01-06T13:30:43,575 adding 'unitxt/catalog/cards/milu/Malayalam/Engineering_and_Tech.json' 2026-01-06T13:30:43,576 adding 'unitxt/catalog/cards/milu/Malayalam/Environmental_Sciences.json' 2026-01-06T13:30:43,577 adding 'unitxt/catalog/cards/milu/Malayalam/Health_and_Medicine.json' 2026-01-06T13:30:43,578 adding 'unitxt/catalog/cards/milu/Malayalam/Law_and_Governance.json' 2026-01-06T13:30:43,580 adding 'unitxt/catalog/cards/milu/Malayalam/Science.json' 2026-01-06T13:30:43,581 adding 'unitxt/catalog/cards/milu/Malayalam/Social_Sciences.json' 2026-01-06T13:30:43,583 adding 'unitxt/catalog/cards/milu/Marathi/Arts_and_Humanities.json' 2026-01-06T13:30:43,584 adding 'unitxt/catalog/cards/milu/Marathi/Business_Studies.json' 2026-01-06T13:30:43,585 adding 'unitxt/catalog/cards/milu/Marathi/Engineering_and_Tech.json' 2026-01-06T13:30:43,586 adding 'unitxt/catalog/cards/milu/Marathi/Environmental_Sciences.json' 2026-01-06T13:30:43,588 adding 'unitxt/catalog/cards/milu/Marathi/Health_and_Medicine.json' 2026-01-06T13:30:43,589 adding 'unitxt/catalog/cards/milu/Marathi/Law_and_Governance.json' 2026-01-06T13:30:43,590 adding 'unitxt/catalog/cards/milu/Marathi/Science.json' 2026-01-06T13:30:43,592 adding 'unitxt/catalog/cards/milu/Marathi/Social_Sciences.json' 2026-01-06T13:30:43,593 adding 'unitxt/catalog/cards/milu/Odia/Arts_and_Humanities.json' 2026-01-06T13:30:43,595 adding 'unitxt/catalog/cards/milu/Odia/Business_Studies.json' 2026-01-06T13:30:43,596 adding 'unitxt/catalog/cards/milu/Odia/Engineering_and_Tech.json' 2026-01-06T13:30:43,597 adding 'unitxt/catalog/cards/milu/Odia/Environmental_Sciences.json' 2026-01-06T13:30:43,599 adding 'unitxt/catalog/cards/milu/Odia/Health_and_Medicine.json' 2026-01-06T13:30:43,600 adding 'unitxt/catalog/cards/milu/Odia/Law_and_Governance.json' 2026-01-06T13:30:43,601 adding 'unitxt/catalog/cards/milu/Odia/Science.json' 2026-01-06T13:30:43,602 adding 'unitxt/catalog/cards/milu/Odia/Social_Sciences.json' 2026-01-06T13:30:43,604 adding 'unitxt/catalog/cards/milu/Punjabi/Arts_and_Humanities.json' 2026-01-06T13:30:43,606 adding 'unitxt/catalog/cards/milu/Punjabi/Business_Studies.json' 2026-01-06T13:30:43,607 adding 'unitxt/catalog/cards/milu/Punjabi/Engineering_and_Tech.json' 2026-01-06T13:30:43,608 adding 'unitxt/catalog/cards/milu/Punjabi/Environmental_Sciences.json' 2026-01-06T13:30:43,610 adding 'unitxt/catalog/cards/milu/Punjabi/Health_and_Medicine.json' 2026-01-06T13:30:43,611 adding 'unitxt/catalog/cards/milu/Punjabi/Law_and_Governance.json' 2026-01-06T13:30:43,612 adding 'unitxt/catalog/cards/milu/Punjabi/Science.json' 2026-01-06T13:30:43,614 adding 'unitxt/catalog/cards/milu/Punjabi/Social_Sciences.json' 2026-01-06T13:30:43,616 adding 'unitxt/catalog/cards/milu/Tamil/Arts_and_Humanities.json' 2026-01-06T13:30:43,617 adding 'unitxt/catalog/cards/milu/Tamil/Business_Studies.json' 2026-01-06T13:30:43,618 adding 'unitxt/catalog/cards/milu/Tamil/Engineering_and_Tech.json' 2026-01-06T13:30:43,620 adding 'unitxt/catalog/cards/milu/Tamil/Environmental_Sciences.json' 2026-01-06T13:30:43,621 adding 'unitxt/catalog/cards/milu/Tamil/Health_and_Medicine.json' 2026-01-06T13:30:43,622 adding 'unitxt/catalog/cards/milu/Tamil/Law_and_Governance.json' 2026-01-06T13:30:43,624 adding 'unitxt/catalog/cards/milu/Tamil/Science.json' 2026-01-06T13:30:43,625 adding 'unitxt/catalog/cards/milu/Tamil/Social_Sciences.json' 2026-01-06T13:30:43,627 adding 'unitxt/catalog/cards/milu/Telugu/Arts_and_Humanities.json' 2026-01-06T13:30:43,628 adding 'unitxt/catalog/cards/milu/Telugu/Business_Studies.json' 2026-01-06T13:30:43,630 adding 'unitxt/catalog/cards/milu/Telugu/Engineering_and_Tech.json' 2026-01-06T13:30:43,631 adding 'unitxt/catalog/cards/milu/Telugu/Environmental_Sciences.json' 2026-01-06T13:30:43,632 adding 'unitxt/catalog/cards/milu/Telugu/Health_and_Medicine.json' 2026-01-06T13:30:43,634 adding 'unitxt/catalog/cards/milu/Telugu/Law_and_Governance.json' 2026-01-06T13:30:43,635 adding 'unitxt/catalog/cards/milu/Telugu/Science.json' 2026-01-06T13:30:43,636 adding 'unitxt/catalog/cards/milu/Telugu/Social_Sciences.json' 2026-01-06T13:30:43,638 adding 'unitxt/catalog/cards/mlsum/de.json' 2026-01-06T13:30:43,639 adding 'unitxt/catalog/cards/mlsum/es.json' 2026-01-06T13:30:43,640 adding 'unitxt/catalog/cards/mlsum/fr.json' 2026-01-06T13:30:43,642 adding 'unitxt/catalog/cards/mlsum/ru.json' 2026-01-06T13:30:43,643 adding 'unitxt/catalog/cards/mlsum/tu.json' 2026-01-06T13:30:43,645 adding 'unitxt/catalog/cards/mmlu/abstract_algebra.json' 2026-01-06T13:30:43,647 adding 'unitxt/catalog/cards/mmlu/anatomy.json' 2026-01-06T13:30:43,648 adding 'unitxt/catalog/cards/mmlu/astronomy.json' 2026-01-06T13:30:43,649 adding 'unitxt/catalog/cards/mmlu/business_ethics.json' 2026-01-06T13:30:43,651 adding 'unitxt/catalog/cards/mmlu/clinical_knowledge.json' 2026-01-06T13:30:43,652 adding 'unitxt/catalog/cards/mmlu/college_biology.json' 2026-01-06T13:30:43,653 adding 'unitxt/catalog/cards/mmlu/college_chemistry.json' 2026-01-06T13:30:43,655 adding 'unitxt/catalog/cards/mmlu/college_computer_science.json' 2026-01-06T13:30:43,656 adding 'unitxt/catalog/cards/mmlu/college_mathematics.json' 2026-01-06T13:30:43,657 adding 'unitxt/catalog/cards/mmlu/college_medicine.json' 2026-01-06T13:30:43,658 adding 'unitxt/catalog/cards/mmlu/college_physics.json' 2026-01-06T13:30:43,660 adding 'unitxt/catalog/cards/mmlu/computer_security.json' 2026-01-06T13:30:43,661 adding 'unitxt/catalog/cards/mmlu/conceptual_physics.json' 2026-01-06T13:30:43,662 adding 'unitxt/catalog/cards/mmlu/econometrics.json' 2026-01-06T13:30:43,663 adding 'unitxt/catalog/cards/mmlu/electrical_engineering.json' 2026-01-06T13:30:43,665 adding 'unitxt/catalog/cards/mmlu/elementary_mathematics.json' 2026-01-06T13:30:43,666 adding 'unitxt/catalog/cards/mmlu/formal_logic.json' 2026-01-06T13:30:43,667 adding 'unitxt/catalog/cards/mmlu/global_facts.json' 2026-01-06T13:30:43,668 adding 'unitxt/catalog/cards/mmlu/high_school_biology.json' 2026-01-06T13:30:43,670 adding 'unitxt/catalog/cards/mmlu/high_school_chemistry.json' 2026-01-06T13:30:43,671 adding 'unitxt/catalog/cards/mmlu/high_school_computer_science.json' 2026-01-06T13:30:43,672 adding 'unitxt/catalog/cards/mmlu/high_school_european_history.json' 2026-01-06T13:30:43,673 adding 'unitxt/catalog/cards/mmlu/high_school_geography.json' 2026-01-06T13:30:43,675 adding 'unitxt/catalog/cards/mmlu/high_school_government_and_politics.json' 2026-01-06T13:30:43,676 adding 'unitxt/catalog/cards/mmlu/high_school_macroeconomics.json' 2026-01-06T13:30:43,677 adding 'unitxt/catalog/cards/mmlu/high_school_mathematics.json' 2026-01-06T13:30:43,679 adding 'unitxt/catalog/cards/mmlu/high_school_microeconomics.json' 2026-01-06T13:30:43,680 adding 'unitxt/catalog/cards/mmlu/high_school_physics.json' 2026-01-06T13:30:43,681 adding 'unitxt/catalog/cards/mmlu/high_school_psychology.json' 2026-01-06T13:30:43,682 adding 'unitxt/catalog/cards/mmlu/high_school_statistics.json' 2026-01-06T13:30:43,684 adding 'unitxt/catalog/cards/mmlu/high_school_us_history.json' 2026-01-06T13:30:43,685 adding 'unitxt/catalog/cards/mmlu/high_school_world_history.json' 2026-01-06T13:30:43,686 adding 'unitxt/catalog/cards/mmlu/human_aging.json' 2026-01-06T13:30:43,688 adding 'unitxt/catalog/cards/mmlu/human_sexuality.json' 2026-01-06T13:30:43,689 adding 'unitxt/catalog/cards/mmlu/international_law.json' 2026-01-06T13:30:43,690 adding 'unitxt/catalog/cards/mmlu/jurisprudence.json' 2026-01-06T13:30:43,691 adding 'unitxt/catalog/cards/mmlu/logical_fallacies.json' 2026-01-06T13:30:43,693 adding 'unitxt/catalog/cards/mmlu/machine_learning.json' 2026-01-06T13:30:43,694 adding 'unitxt/catalog/cards/mmlu/management.json' 2026-01-06T13:30:43,695 adding 'unitxt/catalog/cards/mmlu/marketing.json' 2026-01-06T13:30:43,697 adding 'unitxt/catalog/cards/mmlu/medical_genetics.json' 2026-01-06T13:30:43,698 adding 'unitxt/catalog/cards/mmlu/miscellaneous.json' 2026-01-06T13:30:43,699 adding 'unitxt/catalog/cards/mmlu/moral_disputes.json' 2026-01-06T13:30:43,700 adding 'unitxt/catalog/cards/mmlu/moral_scenarios.json' 2026-01-06T13:30:43,701 adding 'unitxt/catalog/cards/mmlu/nutrition.json' 2026-01-06T13:30:43,703 adding 'unitxt/catalog/cards/mmlu/philosophy.json' 2026-01-06T13:30:43,704 adding 'unitxt/catalog/cards/mmlu/prehistory.json' 2026-01-06T13:30:43,705 adding 'unitxt/catalog/cards/mmlu/professional_accounting.json' 2026-01-06T13:30:43,706 adding 'unitxt/catalog/cards/mmlu/professional_law.json' 2026-01-06T13:30:43,707 adding 'unitxt/catalog/cards/mmlu/professional_medicine.json' 2026-01-06T13:30:43,708 adding 'unitxt/catalog/cards/mmlu/professional_psychology.json' 2026-01-06T13:30:43,710 adding 'unitxt/catalog/cards/mmlu/public_relations.json' 2026-01-06T13:30:43,711 adding 'unitxt/catalog/cards/mmlu/security_studies.json' 2026-01-06T13:30:43,712 adding 'unitxt/catalog/cards/mmlu/sociology.json' 2026-01-06T13:30:43,714 adding 'unitxt/catalog/cards/mmlu/us_foreign_policy.json' 2026-01-06T13:30:43,715 adding 'unitxt/catalog/cards/mmlu/virology.json' 2026-01-06T13:30:43,716 adding 'unitxt/catalog/cards/mmlu/world_religions.json' 2026-01-06T13:30:43,718 adding 'unitxt/catalog/cards/mmlu_pro/biology.json' 2026-01-06T13:30:43,719 adding 'unitxt/catalog/cards/mmlu_pro/business.json' 2026-01-06T13:30:43,720 adding 'unitxt/catalog/cards/mmlu_pro/chemistry.json' 2026-01-06T13:30:43,722 adding 'unitxt/catalog/cards/mmlu_pro/computer_science.json' 2026-01-06T13:30:43,723 adding 'unitxt/catalog/cards/mmlu_pro/economics.json' 2026-01-06T13:30:43,724 adding 'unitxt/catalog/cards/mmlu_pro/engineering.json' 2026-01-06T13:30:43,725 adding 'unitxt/catalog/cards/mmlu_pro/health.json' 2026-01-06T13:30:43,726 adding 'unitxt/catalog/cards/mmlu_pro/history.json' 2026-01-06T13:30:43,728 adding 'unitxt/catalog/cards/mmlu_pro/law.json' 2026-01-06T13:30:43,729 adding 'unitxt/catalog/cards/mmlu_pro/math.json' 2026-01-06T13:30:43,730 adding 'unitxt/catalog/cards/mmlu_pro/other.json' 2026-01-06T13:30:43,731 adding 'unitxt/catalog/cards/mmlu_pro/philosophy.json' 2026-01-06T13:30:43,733 adding 'unitxt/catalog/cards/mmlu_pro/physics.json' 2026-01-06T13:30:43,734 adding 'unitxt/catalog/cards/mmlu_pro/psychology.json' 2026-01-06T13:30:43,736 adding 'unitxt/catalog/cards/mmmu/accounting.json' 2026-01-06T13:30:43,737 adding 'unitxt/catalog/cards/mmmu/agriculture.json' 2026-01-06T13:30:43,739 adding 'unitxt/catalog/cards/mmmu/architecture_and_engineering.json' 2026-01-06T13:30:43,740 adding 'unitxt/catalog/cards/mmmu/art.json' 2026-01-06T13:30:43,741 adding 'unitxt/catalog/cards/mmmu/art_theory.json' 2026-01-06T13:30:43,743 adding 'unitxt/catalog/cards/mmmu/basic_medical_science.json' 2026-01-06T13:30:43,744 adding 'unitxt/catalog/cards/mmmu/biology.json' 2026-01-06T13:30:43,745 adding 'unitxt/catalog/cards/mmmu/chemistry.json' 2026-01-06T13:30:43,747 adding 'unitxt/catalog/cards/mmmu/clinical_medicine.json' 2026-01-06T13:30:43,748 adding 'unitxt/catalog/cards/mmmu/computer_science.json' 2026-01-06T13:30:43,749 adding 'unitxt/catalog/cards/mmmu/design.json' 2026-01-06T13:30:43,751 adding 'unitxt/catalog/cards/mmmu/diagnostics_and_laboratory_medicine.json' 2026-01-06T13:30:43,752 adding 'unitxt/catalog/cards/mmmu/economics.json' 2026-01-06T13:30:43,753 adding 'unitxt/catalog/cards/mmmu/electronics.json' 2026-01-06T13:30:43,755 adding 'unitxt/catalog/cards/mmmu/energy_and_power.json' 2026-01-06T13:30:43,756 adding 'unitxt/catalog/cards/mmmu/finance.json' 2026-01-06T13:30:43,757 adding 'unitxt/catalog/cards/mmmu/geography.json' 2026-01-06T13:30:43,759 adding 'unitxt/catalog/cards/mmmu/history.json' 2026-01-06T13:30:43,760 adding 'unitxt/catalog/cards/mmmu/literature.json' 2026-01-06T13:30:43,762 adding 'unitxt/catalog/cards/mmmu/manage.json' 2026-01-06T13:30:43,763 adding 'unitxt/catalog/cards/mmmu/marketing.json' 2026-01-06T13:30:43,764 adding 'unitxt/catalog/cards/mmmu/materials.json' 2026-01-06T13:30:43,766 adding 'unitxt/catalog/cards/mmmu/math.json' 2026-01-06T13:30:43,767 adding 'unitxt/catalog/cards/mmmu/mechanical_engineering.json' 2026-01-06T13:30:43,768 adding 'unitxt/catalog/cards/mmmu/music.json' 2026-01-06T13:30:43,769 adding 'unitxt/catalog/cards/mmmu/pharmacy.json' 2026-01-06T13:30:43,771 adding 'unitxt/catalog/cards/mmmu/physics.json' 2026-01-06T13:30:43,772 adding 'unitxt/catalog/cards/mmmu/psychology.json' 2026-01-06T13:30:43,773 adding 'unitxt/catalog/cards/mmmu/public_health.json' 2026-01-06T13:30:43,774 adding 'unitxt/catalog/cards/mmmu/sociology.json' 2026-01-06T13:30:43,776 adding 'unitxt/catalog/cards/mt/flores_101/ara_eng.json' 2026-01-06T13:30:43,778 adding 'unitxt/catalog/cards/mt/flores_101/deu_eng.json' 2026-01-06T13:30:43,779 adding 'unitxt/catalog/cards/mt/flores_101/eng_ara.json' 2026-01-06T13:30:43,780 adding 'unitxt/catalog/cards/mt/flores_101/eng_deu.json' 2026-01-06T13:30:43,781 adding 'unitxt/catalog/cards/mt/flores_101/eng_fra.json' 2026-01-06T13:30:43,782 adding 'unitxt/catalog/cards/mt/flores_101/eng_jpn.json' 2026-01-06T13:30:43,784 adding 'unitxt/catalog/cards/mt/flores_101/eng_kor.json' 2026-01-06T13:30:43,785 adding 'unitxt/catalog/cards/mt/flores_101/eng_por.json' 2026-01-06T13:30:43,786 adding 'unitxt/catalog/cards/mt/flores_101/eng_ron.json' 2026-01-06T13:30:43,787 adding 'unitxt/catalog/cards/mt/flores_101/eng_spa.json' 2026-01-06T13:30:43,788 adding 'unitxt/catalog/cards/mt/flores_101/fra_eng.json' 2026-01-06T13:30:43,790 adding 'unitxt/catalog/cards/mt/flores_101/jpn_eng.json' 2026-01-06T13:30:43,791 adding 'unitxt/catalog/cards/mt/flores_101/kor_eng.json' 2026-01-06T13:30:43,792 adding 'unitxt/catalog/cards/mt/flores_101/por_eng.json' 2026-01-06T13:30:43,793 adding 'unitxt/catalog/cards/mt/flores_101/ron_eng.json' 2026-01-06T13:30:43,794 adding 'unitxt/catalog/cards/mt/flores_101/spa_eng.json' 2026-01-06T13:30:43,796 adding 'unitxt/catalog/cards/mt_bench/generation/english_single_turn.json' 2026-01-06T13:30:43,798 adding 'unitxt/catalog/cards/mt_bench/generation/japanese_single_turn.json' 2026-01-06T13:30:43,800 adding 'unitxt/catalog/cards/mt_bench/response_assessment/pairwise_comparison/multi_turn_gpt4_judgement.json' 2026-01-06T13:30:43,801 adding 'unitxt/catalog/cards/mt_bench/response_assessment/pairwise_comparison/multi_turn_with_reference_gpt4_judgement.json' 2026-01-06T13:30:43,802 adding 'unitxt/catalog/cards/mt_bench/response_assessment/pairwise_comparison/single_turn_gpt4_judgement.json' 2026-01-06T13:30:43,804 adding 'unitxt/catalog/cards/mt_bench/response_assessment/pairwise_comparison/single_turn_with_reference_gpt4_judgement.json' 2026-01-06T13:30:43,805 adding 'unitxt/catalog/cards/mt_bench/response_assessment/rating/multi_turn_gpt4_judgement.json' 2026-01-06T13:30:43,807 adding 'unitxt/catalog/cards/mt_bench/response_assessment/rating/multi_turn_with_reference_gpt4_judgement.json' 2026-01-06T13:30:43,808 adding 'unitxt/catalog/cards/mt_bench/response_assessment/rating/single_turn_gpt4_judgement.json' 2026-01-06T13:30:43,809 adding 'unitxt/catalog/cards/mt_bench/response_assessment/rating/single_turn_with_reference_gpt4_judgement.json' 2026-01-06T13:30:43,811 adding 'unitxt/catalog/cards/multidoc2dial/abstractive.json' 2026-01-06T13:30:43,812 adding 'unitxt/catalog/cards/multidoc2dial/extractive.json' 2026-01-06T13:30:43,814 adding 'unitxt/catalog/cards/rag/mtrag.json' 2026-01-06T13:30:43,816 adding 'unitxt/catalog/cards/rag/benchmark/bioasq/en.json' 2026-01-06T13:30:43,818 adding 'unitxt/catalog/cards/rag/benchmark/clap_nq/en.json' 2026-01-06T13:30:43,820 adding 'unitxt/catalog/cards/rag/benchmark/hotpotqa/en.json' 2026-01-06T13:30:43,822 adding 'unitxt/catalog/cards/rag/benchmark/miniwiki/en.json' 2026-01-06T13:30:43,824 adding 'unitxt/catalog/cards/rag/benchmark/real_mm_rag_fin_report/en.json' 2026-01-06T13:30:43,826 adding 'unitxt/catalog/cards/rag/benchmark/real_mm_rag_fin_slides/en.json' 2026-01-06T13:30:43,827 adding 'unitxt/catalog/cards/rag/benchmark/real_mm_rag_tech_report/en.json' 2026-01-06T13:30:43,829 adding 'unitxt/catalog/cards/rag/benchmark/real_mm_rag_tech_slides/en.json' 2026-01-06T13:30:43,831 adding 'unitxt/catalog/cards/rag/benchmark/watsonxqa/en.json' 2026-01-06T13:30:43,833 adding 'unitxt/catalog/cards/rag/documents/bioasq/en.json' 2026-01-06T13:30:43,835 adding 'unitxt/catalog/cards/rag/documents/clap_nq/en.json' 2026-01-06T13:30:43,836 adding 'unitxt/catalog/cards/rag/documents/hotpotqa/en.json' 2026-01-06T13:30:43,838 adding 'unitxt/catalog/cards/rag/documents/miniwiki/en.json' 2026-01-06T13:30:43,840 adding 'unitxt/catalog/cards/rag/documents/real_mm_rag_fin_report/en.json' 2026-01-06T13:30:43,841 adding 'unitxt/catalog/cards/rag/documents/real_mm_rag_fin_slides/en.json' 2026-01-06T13:30:43,843 adding 'unitxt/catalog/cards/rag/documents/real_mm_rag_tech_report/en.json' 2026-01-06T13:30:43,845 adding 'unitxt/catalog/cards/rag/documents/real_mm_rag_tech_slides/en.json' 2026-01-06T13:30:43,846 adding 'unitxt/catalog/cards/rag/documents/watsonxqa/en.json' 2026-01-06T13:30:43,848 adding 'unitxt/catalog/cards/rag/mtrag/documents/clapnq.json' 2026-01-06T13:30:43,850 adding 'unitxt/catalog/cards/rag/mtrag/documents/cloud.json' 2026-01-06T13:30:43,851 adding 'unitxt/catalog/cards/rag/mtrag/documents/fiqa.json' 2026-01-06T13:30:43,852 adding 'unitxt/catalog/cards/rag/mtrag/documents/govt.json' 2026-01-06T13:30:43,854 adding 'unitxt/catalog/cards/rag/response_generation/clapnq.json' 2026-01-06T13:30:43,856 adding 'unitxt/catalog/cards/rag/response_generation/chat_rag_bench/train/user_assistant_format/doc2dial.json' 2026-01-06T13:30:43,857 adding 'unitxt/catalog/cards/rag/response_generation/chat_rag_bench/train/user_assistant_format/doqa_cooking.json' 2026-01-06T13:30:43,859 adding 'unitxt/catalog/cards/rag/response_generation/chat_rag_bench/train/user_assistant_format/doqa_movies.json' 2026-01-06T13:30:43,860 adding 'unitxt/catalog/cards/rag/response_generation/chat_rag_bench/train/user_assistant_format/doqa_travel.json' 2026-01-06T13:30:43,861 adding 'unitxt/catalog/cards/rag/response_generation/chat_rag_bench/train/user_assistant_format/hybridial.json' 2026-01-06T13:30:43,863 adding 'unitxt/catalog/cards/rag/response_generation/chat_rag_bench/user_assistant_format/doc2dial.json' 2026-01-06T13:30:43,864 adding 'unitxt/catalog/cards/rag/response_generation/chat_rag_bench/user_assistant_format/doqa_cooking.json' 2026-01-06T13:30:43,865 adding 'unitxt/catalog/cards/rag/response_generation/chat_rag_bench/user_assistant_format/doqa_movies.json' 2026-01-06T13:30:43,867 adding 'unitxt/catalog/cards/rag/response_generation/chat_rag_bench/user_assistant_format/doqa_travel.json' 2026-01-06T13:30:43,868 adding 'unitxt/catalog/cards/rag/response_generation/chat_rag_bench/user_assistant_format/hybridial.json' 2026-01-06T13:30:43,870 adding 'unitxt/catalog/cards/rag/response_generation/ragbench/covidqa.json' 2026-01-06T13:30:43,871 adding 'unitxt/catalog/cards/rag/response_generation/ragbench/cuad.json' 2026-01-06T13:30:43,872 adding 'unitxt/catalog/cards/rag/response_generation/ragbench/delucionqa.json' 2026-01-06T13:30:43,873 adding 'unitxt/catalog/cards/rag/response_generation/ragbench/emanual.json' 2026-01-06T13:30:43,874 adding 'unitxt/catalog/cards/rag/response_generation/ragbench/expertqa.json' 2026-01-06T13:30:43,875 adding 'unitxt/catalog/cards/rag/response_generation/ragbench/finqa.json' 2026-01-06T13:30:43,877 adding 'unitxt/catalog/cards/rag/response_generation/ragbench/hagrid.json' 2026-01-06T13:30:43,878 adding 'unitxt/catalog/cards/rag/response_generation/ragbench/hotpotqa.json' 2026-01-06T13:30:43,879 adding 'unitxt/catalog/cards/rag/response_generation/ragbench/msmarco.json' 2026-01-06T13:30:43,880 adding 'unitxt/catalog/cards/rag/response_generation/ragbench/pubmedqa.json' 2026-01-06T13:30:43,881 adding 'unitxt/catalog/cards/rag/response_generation/ragbench/tatqa.json' 2026-01-06T13:30:43,883 adding 'unitxt/catalog/cards/rag/response_generation/ragbench/techqa.json' 2026-01-06T13:30:43,884 adding 'unitxt/catalog/cards/rag/response_generation/train/clapnq.json' 2026-01-06T13:30:43,885 adding 'unitxt/catalog/cards/rag/response_generation/train/open_australian_legal_qa.json' 2026-01-06T13:30:43,888 adding 'unitxt/catalog/cards/rag_eval/faithfulness/ragbench/covidqa.json' 2026-01-06T13:30:43,889 adding 'unitxt/catalog/cards/rag_eval/faithfulness/ragbench/cuad.json' 2026-01-06T13:30:43,890 adding 'unitxt/catalog/cards/rag_eval/faithfulness/ragbench/delucionqa.json' 2026-01-06T13:30:43,891 adding 'unitxt/catalog/cards/rag_eval/faithfulness/ragbench/emanual.json' 2026-01-06T13:30:43,892 adding 'unitxt/catalog/cards/rag_eval/faithfulness/ragbench/expertqa.json' 2026-01-06T13:30:43,893 adding 'unitxt/catalog/cards/rag_eval/faithfulness/ragbench/finqa.json' 2026-01-06T13:30:43,895 adding 'unitxt/catalog/cards/rag_eval/faithfulness/ragbench/hagrid.json' 2026-01-06T13:30:43,896 adding 'unitxt/catalog/cards/rag_eval/faithfulness/ragbench/hotpotqa.json' 2026-01-06T13:30:43,897 adding 'unitxt/catalog/cards/rag_eval/faithfulness/ragbench/msmarco.json' 2026-01-06T13:30:43,898 adding 'unitxt/catalog/cards/rag_eval/faithfulness/ragbench/pubmedqa.json' 2026-01-06T13:30:43,899 adding 'unitxt/catalog/cards/rag_eval/faithfulness/ragbench/tatqa.json' 2026-01-06T13:30:43,900 adding 'unitxt/catalog/cards/rag_eval/faithfulness/ragbench/techqa.json' 2026-01-06T13:30:43,902 adding 'unitxt/catalog/cards/ragbench/covidqa.json' 2026-01-06T13:30:43,903 adding 'unitxt/catalog/cards/ragbench/cuad.json' 2026-01-06T13:30:43,904 adding 'unitxt/catalog/cards/ragbench/delucionqa.json' 2026-01-06T13:30:43,905 adding 'unitxt/catalog/cards/ragbench/emanual.json' 2026-01-06T13:30:43,907 adding 'unitxt/catalog/cards/ragbench/expertqa.json' 2026-01-06T13:30:43,908 adding 'unitxt/catalog/cards/ragbench/finqa.json' 2026-01-06T13:30:43,909 adding 'unitxt/catalog/cards/ragbench/hagrid.json' 2026-01-06T13:30:43,910 adding 'unitxt/catalog/cards/ragbench/hotpotqa.json' 2026-01-06T13:30:43,911 adding 'unitxt/catalog/cards/ragbench/msmarco.json' 2026-01-06T13:30:43,912 adding 'unitxt/catalog/cards/ragbench/pubmedqa.json' 2026-01-06T13:30:43,914 adding 'unitxt/catalog/cards/ragbench/tatqa.json' 2026-01-06T13:30:43,915 adding 'unitxt/catalog/cards/ragbench/techqa.json' 2026-01-06T13:30:43,917 adding 'unitxt/catalog/cards/reuters21578/ModApte.json' 2026-01-06T13:30:43,918 adding 'unitxt/catalog/cards/reuters21578/ModHayes.json' 2026-01-06T13:30:43,919 adding 'unitxt/catalog/cards/reuters21578/ModLewis.json' 2026-01-06T13:30:43,921 adding 'unitxt/catalog/cards/reward_bench/chat.json' 2026-01-06T13:30:43,923 adding 'unitxt/catalog/cards/reward_bench/chat_hard.json' 2026-01-06T13:30:43,924 adding 'unitxt/catalog/cards/reward_bench/reasoning.json' 2026-01-06T13:30:43,925 adding 'unitxt/catalog/cards/reward_bench/safety.json' 2026-01-06T13:30:43,930 adding 'unitxt/catalog/cards/safety/airbench2024.json' 2026-01-06T13:30:43,931 adding 'unitxt/catalog/cards/safety/mlcommons_ailuminate.json' 2026-01-06T13:30:43,932 adding 'unitxt/catalog/cards/safety/provoq.json' 2026-01-06T13:30:43,934 adding 'unitxt/catalog/cards/safety/simple_safety_tests.json' 2026-01-06T13:30:43,935 adding 'unitxt/catalog/cards/safety/truthful_qa.json' 2026-01-06T13:30:43,936 adding 'unitxt/catalog/cards/safety/xstest.json' 2026-01-06T13:30:43,938 adding 'unitxt/catalog/cards/safety/bbq/Age.json' 2026-01-06T13:30:43,939 adding 'unitxt/catalog/cards/safety/bbq/Disability_status.json' 2026-01-06T13:30:43,941 adding 'unitxt/catalog/cards/safety/bbq/Gender_identity.json' 2026-01-06T13:30:43,942 adding 'unitxt/catalog/cards/safety/bbq/Nationality.json' 2026-01-06T13:30:43,943 adding 'unitxt/catalog/cards/safety/bbq/Physical_appearance.json' 2026-01-06T13:30:43,944 adding 'unitxt/catalog/cards/safety/bbq/Race_ethnicity.json' 2026-01-06T13:30:43,946 adding 'unitxt/catalog/cards/safety/bbq/Race_x_SES.json' 2026-01-06T13:30:43,947 adding 'unitxt/catalog/cards/safety/bbq/Race_x_gender.json' 2026-01-06T13:30:43,948 adding 'unitxt/catalog/cards/safety/bbq/Religion.json' 2026-01-06T13:30:43,949 adding 'unitxt/catalog/cards/safety/bbq/SES.json' 2026-01-06T13:30:43,950 adding 'unitxt/catalog/cards/safety/bbq/Sexual_orientation.json' 2026-01-06T13:30:43,952 adding 'unitxt/catalog/cards/safety/discrim_eval/explicit.json' 2026-01-06T13:30:43,953 adding 'unitxt/catalog/cards/safety/discrim_eval/implicit.json' 2026-01-06T13:30:43,955 adding 'unitxt/catalog/cards/tablebench_data_analysis/legacy.json' 2026-01-06T13:30:43,957 adding 'unitxt/catalog/cards/tablebench_fact_checking/legacy.json' 2026-01-06T13:30:43,959 adding 'unitxt/catalog/cards/tablebench_numerical_reasoning/legacy.json' 2026-01-06T13:30:43,960 adding 'unitxt/catalog/cards/text2sql/bird.json' 2026-01-06T13:30:43,962 adding 'unitxt/catalog/cards/tot/arithmetic.json' 2026-01-06T13:30:43,963 adding 'unitxt/catalog/cards/tot/semantic.json' 2026-01-06T13:30:43,966 adding 'unitxt/catalog/cards/universal_ner/ceb/gja.json' 2026-01-06T13:30:43,968 adding 'unitxt/catalog/cards/universal_ner/da/ddt.json' 2026-01-06T13:30:43,969 adding 'unitxt/catalog/cards/universal_ner/de/pud.json' 2026-01-06T13:30:43,971 adding 'unitxt/catalog/cards/universal_ner/en/ewt.json' 2026-01-06T13:30:43,972 adding 'unitxt/catalog/cards/universal_ner/en/pud.json' 2026-01-06T13:30:43,974 adding 'unitxt/catalog/cards/universal_ner/hr/set.json' 2026-01-06T13:30:43,976 adding 'unitxt/catalog/cards/universal_ner/pt/bosque.json' 2026-01-06T13:30:43,977 adding 'unitxt/catalog/cards/universal_ner/pt/pud.json' 2026-01-06T13:30:43,979 adding 'unitxt/catalog/cards/universal_ner/ru/pud.json' 2026-01-06T13:30:43,981 adding 'unitxt/catalog/cards/universal_ner/sk/snk.json' 2026-01-06T13:30:43,983 adding 'unitxt/catalog/cards/universal_ner/sr/set.json' 2026-01-06T13:30:43,985 adding 'unitxt/catalog/cards/universal_ner/sv/pud.json' 2026-01-06T13:30:43,986 adding 'unitxt/catalog/cards/universal_ner/sv/talbanken.json' 2026-01-06T13:30:43,988 adding 'unitxt/catalog/cards/universal_ner/tl/trg.json' 2026-01-06T13:30:43,989 adding 'unitxt/catalog/cards/universal_ner/tl/ugnayan.json' 2026-01-06T13:30:43,991 adding 'unitxt/catalog/cards/universal_ner/zh/gsd.json' 2026-01-06T13:30:43,993 adding 'unitxt/catalog/cards/universal_ner/zh/gsdsimp.json' 2026-01-06T13:30:43,994 adding 'unitxt/catalog/cards/universal_ner/zh/pud.json' 2026-01-06T13:30:43,996 adding 'unitxt/catalog/cards/winogrande/debiased.json' 2026-01-06T13:30:43,997 adding 'unitxt/catalog/cards/winogrande/l.json' 2026-01-06T13:30:43,998 adding 'unitxt/catalog/cards/winogrande/m.json' 2026-01-06T13:30:44,000 adding 'unitxt/catalog/cards/winogrande/s.json' 2026-01-06T13:30:44,001 adding 'unitxt/catalog/cards/winogrande/xl.json' 2026-01-06T13:30:44,002 adding 'unitxt/catalog/cards/winogrande/xs.json' 2026-01-06T13:30:44,004 adding 'unitxt/catalog/cards/wmt/en_de.json' 2026-01-06T13:30:44,005 adding 'unitxt/catalog/cards/wmt/en_fr.json' 2026-01-06T13:30:44,006 adding 'unitxt/catalog/cards/wmt/en_ro.json' 2026-01-06T13:30:44,008 adding 'unitxt/catalog/cards/wnli/truthfulness.json' 2026-01-06T13:30:44,010 adding 'unitxt/catalog/cards/xlsum/amharic.json' 2026-01-06T13:30:44,012 adding 'unitxt/catalog/cards/xlsum/arabic.json' 2026-01-06T13:30:44,013 adding 'unitxt/catalog/cards/xlsum/azerbaijani.json' 2026-01-06T13:30:44,014 adding 'unitxt/catalog/cards/xlsum/bengali.json' 2026-01-06T13:30:44,015 adding 'unitxt/catalog/cards/xlsum/burmese.json' 2026-01-06T13:30:44,017 adding 'unitxt/catalog/cards/xlsum/chinese_simplified.json' 2026-01-06T13:30:44,018 adding 'unitxt/catalog/cards/xlsum/chinese_traditional.json' 2026-01-06T13:30:44,019 adding 'unitxt/catalog/cards/xlsum/english.json' 2026-01-06T13:30:44,021 adding 'unitxt/catalog/cards/xlsum/french.json' 2026-01-06T13:30:44,022 adding 'unitxt/catalog/cards/xlsum/gujarati.json' 2026-01-06T13:30:44,023 adding 'unitxt/catalog/cards/xlsum/hausa.json' 2026-01-06T13:30:44,024 adding 'unitxt/catalog/cards/xlsum/hindi.json' 2026-01-06T13:30:44,026 adding 'unitxt/catalog/cards/xlsum/igbo.json' 2026-01-06T13:30:44,027 adding 'unitxt/catalog/cards/xlsum/indonesian.json' 2026-01-06T13:30:44,028 adding 'unitxt/catalog/cards/xlsum/japanese.json' 2026-01-06T13:30:44,029 adding 'unitxt/catalog/cards/xlsum/kirundi.json' 2026-01-06T13:30:44,030 adding 'unitxt/catalog/cards/xlsum/korean.json' 2026-01-06T13:30:44,031 adding 'unitxt/catalog/cards/xlsum/kyrgyz.json' 2026-01-06T13:30:44,032 adding 'unitxt/catalog/cards/xlsum/marathi.json' 2026-01-06T13:30:44,034 adding 'unitxt/catalog/cards/xlsum/nepali.json' 2026-01-06T13:30:44,035 adding 'unitxt/catalog/cards/xlsum/oromo.json' 2026-01-06T13:30:44,036 adding 'unitxt/catalog/cards/xlsum/pashto.json' 2026-01-06T13:30:44,037 adding 'unitxt/catalog/cards/xlsum/persian.json' 2026-01-06T13:30:44,039 adding 'unitxt/catalog/cards/xlsum/pidgin.json' 2026-01-06T13:30:44,040 adding 'unitxt/catalog/cards/xlsum/portuguese.json' 2026-01-06T13:30:44,041 adding 'unitxt/catalog/cards/xlsum/punjabi.json' 2026-01-06T13:30:44,042 adding 'unitxt/catalog/cards/xlsum/russian.json' 2026-01-06T13:30:44,044 adding 'unitxt/catalog/cards/xlsum/scottish_gaelic.json' 2026-01-06T13:30:44,045 adding 'unitxt/catalog/cards/xlsum/serbian_cyrillic.json' 2026-01-06T13:30:44,046 adding 'unitxt/catalog/cards/xlsum/serbian_latin.json' 2026-01-06T13:30:44,048 adding 'unitxt/catalog/cards/xlsum/sinhala.json' 2026-01-06T13:30:44,049 adding 'unitxt/catalog/cards/xlsum/somali.json' 2026-01-06T13:30:44,050 adding 'unitxt/catalog/cards/xlsum/spanish.json' 2026-01-06T13:30:44,051 adding 'unitxt/catalog/cards/xlsum/swahili.json' 2026-01-06T13:30:44,052 adding 'unitxt/catalog/cards/xlsum/tamil.json' 2026-01-06T13:30:44,054 adding 'unitxt/catalog/cards/xlsum/telugu.json' 2026-01-06T13:30:44,055 adding 'unitxt/catalog/cards/xlsum/thai.json' 2026-01-06T13:30:44,056 adding 'unitxt/catalog/cards/xlsum/tigrinya.json' 2026-01-06T13:30:44,057 adding 'unitxt/catalog/cards/xlsum/turkish.json' 2026-01-06T13:30:44,059 adding 'unitxt/catalog/cards/xlsum/ukrainian.json' 2026-01-06T13:30:44,060 adding 'unitxt/catalog/cards/xlsum/urdu.json' 2026-01-06T13:30:44,061 adding 'unitxt/catalog/cards/xlsum/uzbek.json' 2026-01-06T13:30:44,063 adding 'unitxt/catalog/cards/xlsum/vietnamese.json' 2026-01-06T13:30:44,064 adding 'unitxt/catalog/cards/xlsum/welsh.json' 2026-01-06T13:30:44,065 adding 'unitxt/catalog/cards/xlsum/yoruba.json' 2026-01-06T13:30:44,067 adding 'unitxt/catalog/cards/xnli/ar.json' 2026-01-06T13:30:44,068 adding 'unitxt/catalog/cards/xnli/bg.json' 2026-01-06T13:30:44,070 adding 'unitxt/catalog/cards/xnli/de.json' 2026-01-06T13:30:44,071 adding 'unitxt/catalog/cards/xnli/el.json' 2026-01-06T13:30:44,072 adding 'unitxt/catalog/cards/xnli/en.json' 2026-01-06T13:30:44,073 adding 'unitxt/catalog/cards/xnli/es.json' 2026-01-06T13:30:44,075 adding 'unitxt/catalog/cards/xnli/fr.json' 2026-01-06T13:30:44,076 adding 'unitxt/catalog/cards/xnli/hi.json' 2026-01-06T13:30:44,077 adding 'unitxt/catalog/cards/xnli/ru.json' 2026-01-06T13:30:44,079 adding 'unitxt/catalog/cards/xnli/sw.json' 2026-01-06T13:30:44,080 adding 'unitxt/catalog/cards/xnli/th.json' 2026-01-06T13:30:44,081 adding 'unitxt/catalog/cards/xnli/tr.json' 2026-01-06T13:30:44,083 adding 'unitxt/catalog/cards/xnli/ur.json' 2026-01-06T13:30:44,084 adding 'unitxt/catalog/cards/xnli/vi.json' 2026-01-06T13:30:44,085 adding 'unitxt/catalog/cards/xnli/zh.json' 2026-01-06T13:30:44,087 adding 'unitxt/catalog/cards/xwinogrande/en.json' 2026-01-06T13:30:44,088 adding 'unitxt/catalog/cards/xwinogrande/jp.json' 2026-01-06T13:30:44,090 adding 'unitxt/catalog/cards/xwinogrande/pt.json' 2026-01-06T13:30:44,091 adding 'unitxt/catalog/cards/xwinogrande/ru.json' 2026-01-06T13:30:44,092 adding 'unitxt/catalog/cards/xwinogrande/zh.json' 2026-01-06T13:30:44,095 adding 'unitxt/catalog/engines/classification/gpt_4_turbo_2024_04_09_azure_openai.json' 2026-01-06T13:30:44,096 adding 'unitxt/catalog/engines/classification/gpt_4_turbo_open_ai.json' 2026-01-06T13:30:44,097 adding 'unitxt/catalog/engines/classification/gpt_4o_2024_08_06_azure_openai.json' 2026-01-06T13:30:44,098 adding 'unitxt/catalog/engines/classification/gpt_4o_open_ai.json' 2026-01-06T13:30:44,099 adding 'unitxt/catalog/engines/classification/gpt_oss_120b_rits.json' 2026-01-06T13:30:44,100 adding 'unitxt/catalog/engines/classification/gpt_oss_120b_watsonx.json' 2026-01-06T13:30:44,101 adding 'unitxt/catalog/engines/classification/llama3_3_ollama.json' 2026-01-06T13:30:44,102 adding 'unitxt/catalog/engines/classification/llama3_8b_ollama.json' 2026-01-06T13:30:44,103 adding 'unitxt/catalog/engines/classification/llama_3_1_405b_instruct_fp8_rits.json' 2026-01-06T13:30:44,104 adding 'unitxt/catalog/engines/classification/llama_3_1_70b_instruct_rits.json' 2026-01-06T13:30:44,105 adding 'unitxt/catalog/engines/classification/llama_3_1_70b_instruct_watsonx.json' 2026-01-06T13:30:44,107 adding 'unitxt/catalog/engines/classification/llama_3_1_70b_instruct_wml.json' 2026-01-06T13:30:44,108 adding 'unitxt/catalog/engines/classification/llama_3_3_70b_instruct_rits.json' 2026-01-06T13:30:44,109 adding 'unitxt/catalog/engines/classification/llama_3_3_70b_instruct_watsonx.json' 2026-01-06T13:30:44,110 adding 'unitxt/catalog/engines/classification/llama_3_3_70b_instruct_wml.json' 2026-01-06T13:30:44,111 adding 'unitxt/catalog/engines/classification/llama_3_405b_instruct_wml.json' 2026-01-06T13:30:44,112 adding 'unitxt/catalog/engines/classification/llama_4_maverick_17b_128e_instruct_fp8_rits.json' 2026-01-06T13:30:44,113 adding 'unitxt/catalog/engines/classification/llama_4_maverick_17b_128e_instruct_fp8_watsonx.json' 2026-01-06T13:30:44,114 adding 'unitxt/catalog/engines/classification/mistral_large_instruct_2407_rits.json' 2026-01-06T13:30:44,116 adding 'unitxt/catalog/engines/classification/mistral_large_watsonx.json' 2026-01-06T13:30:44,117 adding 'unitxt/catalog/engines/classification/mistral_small_3_1_24b_instruct_2503_wml.json' 2026-01-06T13:30:44,118 adding 'unitxt/catalog/engines/classification/mixtral_8x7b_instruct_v01_wml.json' 2026-01-06T13:30:44,119 adding 'unitxt/catalog/engines/cross_provider/llama_3_70b_instruct.json' 2026-01-06T13:30:44,120 adding 'unitxt/catalog/engines/cross_provider/llama_3_8b_instruct.json' 2026-01-06T13:30:44,122 adding 'unitxt/catalog/engines/ibm_wml/llama_3_3_70b_instruct.json' 2026-01-06T13:30:44,124 adding 'unitxt/catalog/engines/model/llama_3_8b_instruct.json' 2026-01-06T13:30:44,125 adding 'unitxt/catalog/engines/model/flan/t5_small/hf.json' 2026-01-06T13:30:44,127 adding 'unitxt/catalog/engines/ollama/llama2.json' 2026-01-06T13:30:44,129 adding 'unitxt/catalog/engines/openai/gpt_4o.json' 2026-01-06T13:30:44,130 adding 'unitxt/catalog/engines/rits/llama_3_1_405b_instruct_fp8.json' 2026-01-06T13:30:44,132 adding 'unitxt/catalog/engines/rits/llama_3_1_70b_instruct.json' 2026-01-06T13:30:44,133 adding 'unitxt/catalog/engines/rits/llama_3/1_8b_instruct.json' 2026-01-06T13:30:44,135 adding 'unitxt/catalog/formats/chat_api.json' 2026-01-06T13:30:44,136 adding 'unitxt/catalog/formats/chat_api_with_tokenizer_chat_template.json' 2026-01-06T13:30:44,137 adding 'unitxt/catalog/formats/deepseek_coder.json' 2026-01-06T13:30:44,138 adding 'unitxt/catalog/formats/empty.json' 2026-01-06T13:30:44,139 adding 'unitxt/catalog/formats/empty_input_output_separator.json' 2026-01-06T13:30:44,141 adding 'unitxt/catalog/formats/human_assistant.json' 2026-01-06T13:30:44,142 adding 'unitxt/catalog/formats/llama.json' 2026-01-06T13:30:44,143 adding 'unitxt/catalog/formats/llama2.json' 2026-01-06T13:30:44,144 adding 'unitxt/catalog/formats/llama3_instruct.json' 2026-01-06T13:30:44,145 adding 'unitxt/catalog/formats/llama3_instruct_all_demos_in_one_turn.json' 2026-01-06T13:30:44,146 adding 'unitxt/catalog/formats/llamaguard2.json' 2026-01-06T13:30:44,147 adding 'unitxt/catalog/formats/textual_assistant.json' 2026-01-06T13:30:44,149 adding 'unitxt/catalog/formats/user_agent.json' 2026-01-06T13:30:44,150 adding 'unitxt/catalog/formats/user_assistant.json' 2026-01-06T13:30:44,151 adding 'unitxt/catalog/formats/models/alpaca_instruct.json' 2026-01-06T13:30:44,152 adding 'unitxt/catalog/formats/models/granite_3_1_documents.json' 2026-01-06T13:30:44,153 adding 'unitxt/catalog/formats/models/llava.json' 2026-01-06T13:30:44,154 adding 'unitxt/catalog/formats/models/llava_interleave.json' 2026-01-06T13:30:44,155 adding 'unitxt/catalog/formats/models/phi_3.json' 2026-01-06T13:30:44,156 adding 'unitxt/catalog/formats/models/starling.json' 2026-01-06T13:30:44,158 adding 'unitxt/catalog/formats/models/flan/exq_exa.json' 2026-01-06T13:30:44,159 adding 'unitxt/catalog/formats/models/flan/few_shot.json' 2026-01-06T13:30:44,161 adding 'unitxt/catalog/formats/models/labradorite/few_shot.json' 2026-01-06T13:30:44,162 adding 'unitxt/catalog/formats/models/labradorite/zero_shot.json' 2026-01-06T13:30:44,163 adding 'unitxt/catalog/formats/models/mistral/instruction.json' 2026-01-06T13:30:44,165 adding 'unitxt/catalog/formats/models/mistral/instruction/with_system_prompt.json' 2026-01-06T13:30:44,167 adding 'unitxt/catalog/metrics/accuracy.json' 2026-01-06T13:30:44,168 adding 'unitxt/catalog/metrics/accuracy_binary.json' 2026-01-06T13:30:44,170 adding 'unitxt/catalog/metrics/anls.json' 2026-01-06T13:30:44,171 adding 'unitxt/catalog/metrics/bleu.json' 2026-01-06T13:30:44,172 adding 'unitxt/catalog/metrics/char_edit_dist_accuracy.json' 2026-01-06T13:30:44,173 adding 'unitxt/catalog/metrics/char_edit_distance.json' 2026-01-06T13:30:44,174 adding 'unitxt/catalog/metrics/exact_match_mm.json' 2026-01-06T13:30:44,175 adding 'unitxt/catalog/metrics/f1_binary.json' 2026-01-06T13:30:44,176 adding 'unitxt/catalog/metrics/f1_macro.json' 2026-01-06T13:30:44,177 adding 'unitxt/catalog/metrics/f1_macro_multi_label.json' 2026-01-06T13:30:44,178 adding 'unitxt/catalog/metrics/f1_micro.json' 2026-01-06T13:30:44,179 adding 'unitxt/catalog/metrics/f1_micro_multi_label.json' 2026-01-06T13:30:44,180 adding 'unitxt/catalog/metrics/f1_strings.json' 2026-01-06T13:30:44,181 adding 'unitxt/catalog/metrics/f1_weighted.json' 2026-01-06T13:30:44,182 adding 'unitxt/catalog/metrics/fin_qa_metric.json' 2026-01-06T13:30:44,183 adding 'unitxt/catalog/metrics/fuzzyner.json' 2026-01-06T13:30:44,184 adding 'unitxt/catalog/metrics/is_code_mixed.json' 2026-01-06T13:30:44,185 adding 'unitxt/catalog/metrics/jaccard_index.json' 2026-01-06T13:30:44,187 adding 'unitxt/catalog/metrics/jaccard_index_words.json' 2026-01-06T13:30:44,188 adding 'unitxt/catalog/metrics/kendalltau_b.json' 2026-01-06T13:30:44,189 adding 'unitxt/catalog/metrics/kpa.json' 2026-01-06T13:30:44,190 adding 'unitxt/catalog/metrics/map.json' 2026-01-06T13:30:44,191 adding 'unitxt/catalog/metrics/matthews_correlation.json' 2026-01-06T13:30:44,192 adding 'unitxt/catalog/metrics/max_accuracy_binary.json' 2026-01-06T13:30:44,193 adding 'unitxt/catalog/metrics/max_f1_binary.json' 2026-01-06T13:30:44,194 adding 'unitxt/catalog/metrics/mean_squared_error.json' 2026-01-06T13:30:44,195 adding 'unitxt/catalog/metrics/meteor.json' 2026-01-06T13:30:44,197 adding 'unitxt/catalog/metrics/meteor_hf.json' 2026-01-06T13:30:44,198 adding 'unitxt/catalog/metrics/metric_based_ner.json' 2026-01-06T13:30:44,199 adding 'unitxt/catalog/metrics/mrr.json' 2026-01-06T13:30:44,200 adding 'unitxt/catalog/metrics/ndcg.json' 2026-01-06T13:30:44,201 adding 'unitxt/catalog/metrics/ner.json' 2026-01-06T13:30:44,202 adding 'unitxt/catalog/metrics/normalized_sacrebleu.json' 2026-01-06T13:30:44,203 adding 'unitxt/catalog/metrics/pearson.json' 2026-01-06T13:30:44,205 adding 'unitxt/catalog/metrics/precision_binary.json' 2026-01-06T13:30:44,206 adding 'unitxt/catalog/metrics/precision_macro_multi_label.json' 2026-01-06T13:30:44,207 adding 'unitxt/catalog/metrics/precision_micro_multi_label.json' 2026-01-06T13:30:44,208 adding 'unitxt/catalog/metrics/prediction_length.json' 2026-01-06T13:30:44,209 adding 'unitxt/catalog/metrics/recall_binary.json' 2026-01-06T13:30:44,210 adding 'unitxt/catalog/metrics/recall_macro_multi_label.json' 2026-01-06T13:30:44,211 adding 'unitxt/catalog/metrics/recall_micro_multi_label.json' 2026-01-06T13:30:44,212 adding 'unitxt/catalog/metrics/regard_metric.json' 2026-01-06T13:30:44,213 adding 'unitxt/catalog/metrics/relaxed_correctness.json' 2026-01-06T13:30:44,214 adding 'unitxt/catalog/metrics/rerank_recall.json' 2026-01-06T13:30:44,215 adding 'unitxt/catalog/metrics/retrieval_at_k.json' 2026-01-06T13:30:44,216 adding 'unitxt/catalog/metrics/roc_auc.json' 2026-01-06T13:30:44,217 adding 'unitxt/catalog/metrics/root_mean_squared_error.json' 2026-01-06T13:30:44,218 adding 'unitxt/catalog/metrics/rouge.json' 2026-01-06T13:30:44,219 adding 'unitxt/catalog/metrics/rouge_with_confidence_intervals.json' 2026-01-06T13:30:44,221 adding 'unitxt/catalog/metrics/sacrebleu.json' 2026-01-06T13:30:44,222 adding 'unitxt/catalog/metrics/safety_metric.json' 2026-01-06T13:30:44,223 adding 'unitxt/catalog/metrics/spearman.json' 2026-01-06T13:30:44,224 adding 'unitxt/catalog/metrics/squad.json' 2026-01-06T13:30:44,225 adding 'unitxt/catalog/metrics/string_containment.json' 2026-01-06T13:30:44,226 adding 'unitxt/catalog/metrics/string_containment_ratio.json' 2026-01-06T13:30:44,227 adding 'unitxt/catalog/metrics/token_overlap.json' 2026-01-06T13:30:44,228 adding 'unitxt/catalog/metrics/token_overlap_with_context.json' 2026-01-06T13:30:44,230 adding 'unitxt/catalog/metrics/tool_calling.json' 2026-01-06T13:30:44,231 adding 'unitxt/catalog/metrics/unsorted_list_exact_match.json' 2026-01-06T13:30:44,232 adding 'unitxt/catalog/metrics/vectara_groundedness_hhem_2_1.json' 2026-01-06T13:30:44,233 adding 'unitxt/catalog/metrics/websrc_squad_f1.json' 2026-01-06T13:30:44,234 adding 'unitxt/catalog/metrics/weighted_win_rate_correlation.json' 2026-01-06T13:30:44,235 adding 'unitxt/catalog/metrics/wer.json' 2026-01-06T13:30:44,237 adding 'unitxt/catalog/metrics/bert_score/bert_base_uncased.json' 2026-01-06T13:30:44,238 adding 'unitxt/catalog/metrics/bert_score/deberta_base_mnli.json' 2026-01-06T13:30:44,239 adding 'unitxt/catalog/metrics/bert_score/deberta_large_mnli.json' 2026-01-06T13:30:44,240 adding 'unitxt/catalog/metrics/bert_score/deberta_v3_base_mnli_xnli_ml.json' 2026-01-06T13:30:44,241 adding 'unitxt/catalog/metrics/bert_score/deberta_xlarge_mnli.json' 2026-01-06T13:30:44,242 adding 'unitxt/catalog/metrics/bert_score/distilbert_base_uncased.json' 2026-01-06T13:30:44,244 adding 'unitxt/catalog/metrics/granite_guardian/agentic_risk/function_call.json' 2026-01-06T13:30:44,246 adding 'unitxt/catalog/metrics/granite_guardian/assistant_risk/harm.json' 2026-01-06T13:30:44,247 adding 'unitxt/catalog/metrics/granite_guardian/assistant_risk/profanity.json' 2026-01-06T13:30:44,248 adding 'unitxt/catalog/metrics/granite_guardian/assistant_risk/social_bias.json' 2026-01-06T13:30:44,249 adding 'unitxt/catalog/metrics/granite_guardian/assistant_risk/unethical_behavior.json' 2026-01-06T13:30:44,250 adding 'unitxt/catalog/metrics/granite_guardian/assistant_risk/violence.json' 2026-01-06T13:30:44,252 adding 'unitxt/catalog/metrics/granite_guardian/rag_risk/answer_relevance.json' 2026-01-06T13:30:44,253 adding 'unitxt/catalog/metrics/granite_guardian/rag_risk/context_relevance.json' 2026-01-06T13:30:44,254 adding 'unitxt/catalog/metrics/granite_guardian/rag_risk/groundedness.json' 2026-01-06T13:30:44,256 adding 'unitxt/catalog/metrics/granite_guardian/user_risk/harm.json' 2026-01-06T13:30:44,257 adding 'unitxt/catalog/metrics/granite_guardian/user_risk/jailbreak.json' 2026-01-06T13:30:44,258 adding 'unitxt/catalog/metrics/granite_guardian/user_risk/profanity.json' 2026-01-06T13:30:44,259 adding 'unitxt/catalog/metrics/granite_guardian/user_risk/social_bias.json' 2026-01-06T13:30:44,260 adding 'unitxt/catalog/metrics/granite_guardian/user_risk/unethical_behavior.json' 2026-01-06T13:30:44,262 adding 'unitxt/catalog/metrics/granite_guardian/user_risk/violence.json' 2026-01-06T13:30:44,263 adding 'unitxt/catalog/metrics/key_value_extraction/accuracy.json' 2026-01-06T13:30:44,264 adding 'unitxt/catalog/metrics/key_value_extraction/token_overlap.json' 2026-01-06T13:30:44,267 adding 'unitxt/catalog/metrics/llm_as_judge/binary/generic_inference_engine_answer_correctness_q_a_gt_loose.json' 2026-01-06T13:30:44,268 adding 'unitxt/catalog/metrics/llm_as_judge/binary/generic_inference_engine_answer_relevance_q_a.json' 2026-01-06T13:30:44,269 adding 'unitxt/catalog/metrics/llm_as_judge/binary/generic_inference_engine_context_relevance_q_c_ares.json' 2026-01-06T13:30:44,270 adding 'unitxt/catalog/metrics/llm_as_judge/binary/generic_inference_engine_correctness_holistic_q_c_a.json' 2026-01-06T13:30:44,271 adding 'unitxt/catalog/metrics/llm_as_judge/binary/generic_inference_engine_faithfulness_c_a.json' 2026-01-06T13:30:44,272 adding 'unitxt/catalog/metrics/llm_as_judge/binary/generic_inference_engine_faithfulness_q_c_a.json' 2026-01-06T13:30:44,273 adding 'unitxt/catalog/metrics/llm_as_judge/binary/llama_3_3_70b_instruct_wml_answer_correctness_q_a_gt_loose.json' 2026-01-06T13:30:44,274 adding 'unitxt/catalog/metrics/llm_as_judge/binary/llama_3_3_70b_instruct_wml_answer_correctness_q_a_gt_loose_logprobs.json' 2026-01-06T13:30:44,276 adding 'unitxt/catalog/metrics/llm_as_judge/binary/llama_3_3_70b_instruct_wml_answer_relevance_q_a.json' 2026-01-06T13:30:44,277 adding 'unitxt/catalog/metrics/llm_as_judge/binary/llama_3_3_70b_instruct_wml_answer_relevance_q_a_logprobs.json' 2026-01-06T13:30:44,278 adding 'unitxt/catalog/metrics/llm_as_judge/binary/llama_3_3_70b_instruct_wml_context_relevance_q_c_ares.json' 2026-01-06T13:30:44,279 adding 'unitxt/catalog/metrics/llm_as_judge/binary/llama_3_3_70b_instruct_wml_context_relevance_q_c_ares_logprobs.json' 2026-01-06T13:30:44,280 adding 'unitxt/catalog/metrics/llm_as_judge/binary/llama_3_3_70b_instruct_wml_correctness_holistic_q_c_a.json' 2026-01-06T13:30:44,281 adding 'unitxt/catalog/metrics/llm_as_judge/binary/llama_3_3_70b_instruct_wml_correctness_holistic_q_c_a_logprobs.json' 2026-01-06T13:30:44,282 adding 'unitxt/catalog/metrics/llm_as_judge/binary/llama_3_3_70b_instruct_wml_faithfulness_c_a.json' 2026-01-06T13:30:44,284 adding 'unitxt/catalog/metrics/llm_as_judge/binary/llama_3_3_70b_instruct_wml_faithfulness_c_a_logprobs.json' 2026-01-06T13:30:44,285 adding 'unitxt/catalog/metrics/llm_as_judge/binary/llama_3_3_70b_instruct_wml_faithfulness_q_c_a.json' 2026-01-06T13:30:44,286 adding 'unitxt/catalog/metrics/llm_as_judge/binary/llama_3_3_70b_instruct_wml_faithfulness_q_c_a_logprobs.json' 2026-01-06T13:30:44,288 adding 'unitxt/catalog/metrics/llm_as_judge/direct/aws/deepseek_v3.json' 2026-01-06T13:30:44,289 adding 'unitxt/catalog/metrics/llm_as_judge/direct/aws/llama3_1_405b.json' 2026-01-06T13:30:44,290 adding 'unitxt/catalog/metrics/llm_as_judge/direct/aws/llama3_3_70b.json' 2026-01-06T13:30:44,292 adding 'unitxt/catalog/metrics/llm_as_judge/direct/aws/llama4_maverick.json' 2026-01-06T13:30:44,293 adding 'unitxt/catalog/metrics/llm_as_judge/direct/aws/llama4_scout.json' 2026-01-06T13:30:44,294 adding 'unitxt/catalog/metrics/llm_as_judge/direct/aws/mixtral_large.json' 2026-01-06T13:30:44,296 adding 'unitxt/catalog/metrics/llm_as_judge/direct/azure_openai/gpt_4_1.json' 2026-01-06T13:30:44,297 adding 'unitxt/catalog/metrics/llm_as_judge/direct/azure_openai/gpt_4_1_mini.json' 2026-01-06T13:30:44,298 adding 'unitxt/catalog/metrics/llm_as_judge/direct/azure_openai/gpt_4_1_nano.json' 2026-01-06T13:30:44,299 adding 'unitxt/catalog/metrics/llm_as_judge/direct/azure_openai/gpt_4o.json' 2026-01-06T13:30:44,300 adding 'unitxt/catalog/metrics/llm_as_judge/direct/azure_openai/llama3_3_70b.json' 2026-01-06T13:30:44,302 adding 'unitxt/catalog/metrics/llm_as_judge/direct/azure_openai/llama4_maverick.json' 2026-01-06T13:30:44,303 adding 'unitxt/catalog/metrics/llm_as_judge/direct/azure_openai/llama4_scout.json' 2026-01-06T13:30:44,304 adding 'unitxt/catalog/metrics/llm_as_judge/direct/azure_openai/o1_mini.json' 2026-01-06T13:30:44,305 adding 'unitxt/catalog/metrics/llm_as_judge/direct/azure_openai/o1_preview.json' 2026-01-06T13:30:44,308 adding 'unitxt/catalog/metrics/llm_as_judge/direct/criteria/adherence_with_format.json' 2026-01-06T13:30:44,309 adding 'unitxt/catalog/metrics/llm_as_judge/direct/criteria/answer_completeness.json' 2026-01-06T13:30:44,310 adding 'unitxt/catalog/metrics/llm_as_judge/direct/criteria/answer_relevance.json' 2026-01-06T13:30:44,311 adding 'unitxt/catalog/metrics/llm_as_judge/direct/criteria/assistant_message_answer_relevance.json' 2026-01-06T13:30:44,313 adding 'unitxt/catalog/metrics/llm_as_judge/direct/criteria/assistant_message_compliance.json' 2026-01-06T13:30:44,314 adding 'unitxt/catalog/metrics/llm_as_judge/direct/criteria/assistant_message_general_harm.json' 2026-01-06T13:30:44,315 adding 'unitxt/catalog/metrics/llm_as_judge/direct/criteria/assistant_message_groundedness.json' 2026-01-06T13:30:44,316 adding 'unitxt/catalog/metrics/llm_as_judge/direct/criteria/assistant_message_profanity.json' 2026-01-06T13:30:44,317 adding 'unitxt/catalog/metrics/llm_as_judge/direct/criteria/assistant_message_social_bias.json' 2026-01-06T13:30:44,318 adding 'unitxt/catalog/metrics/llm_as_judge/direct/criteria/assistant_message_unethical_behavior.json' 2026-01-06T13:30:44,320 adding 'unitxt/catalog/metrics/llm_as_judge/direct/criteria/assistant_message_violence.json' 2026-01-06T13:30:44,321 adding 'unitxt/catalog/metrics/llm_as_judge/direct/criteria/coherence.json' 2026-01-06T13:30:44,322 adding 'unitxt/catalog/metrics/llm_as_judge/direct/criteria/conciseness.json' 2026-01-06T13:30:44,323 adding 'unitxt/catalog/metrics/llm_as_judge/direct/criteria/consistency.json' 2026-01-06T13:30:44,324 adding 'unitxt/catalog/metrics/llm_as_judge/direct/criteria/context_context_relevance.json' 2026-01-06T13:30:44,326 adding 'unitxt/catalog/metrics/llm_as_judge/direct/criteria/conversational.json' 2026-01-06T13:30:44,327 adding 'unitxt/catalog/metrics/llm_as_judge/direct/criteria/correctness_based_on_ground_truth.json' 2026-01-06T13:30:44,328 adding 'unitxt/catalog/metrics/llm_as_judge/direct/criteria/email_effectiveness.json' 2026-01-06T13:30:44,329 adding 'unitxt/catalog/metrics/llm_as_judge/direct/criteria/email_structure.json' 2026-01-06T13:30:44,330 adding 'unitxt/catalog/metrics/llm_as_judge/direct/criteria/empathy.json' 2026-01-06T13:30:44,332 adding 'unitxt/catalog/metrics/llm_as_judge/direct/criteria/engagement.json' 2026-01-06T13:30:44,333 adding 'unitxt/catalog/metrics/llm_as_judge/direct/criteria/examples_and_details.json' 2026-01-06T13:30:44,334 adding 'unitxt/catalog/metrics/llm_as_judge/direct/criteria/fluency.json' 2026-01-06T13:30:44,335 adding 'unitxt/catalog/metrics/llm_as_judge/direct/criteria/grammar_and_punctuation.json' 2026-01-06T13:30:44,336 adding 'unitxt/catalog/metrics/llm_as_judge/direct/criteria/harmfulness.json' 2026-01-06T13:30:44,338 adding 'unitxt/catalog/metrics/llm_as_judge/direct/criteria/information_from_reference.json' 2026-01-06T13:30:44,339 adding 'unitxt/catalog/metrics/llm_as_judge/direct/criteria/information_outside_reference.json' 2026-01-06T13:30:44,340 adding 'unitxt/catalog/metrics/llm_as_judge/direct/criteria/insensitivity.json' 2026-01-06T13:30:44,341 adding 'unitxt/catalog/metrics/llm_as_judge/direct/criteria/irrelevant_information.json' 2026-01-06T13:30:44,342 adding 'unitxt/catalog/metrics/llm_as_judge/direct/criteria/logical_validity_of_reasoning.json' 2026-01-06T13:30:44,344 adding 'unitxt/catalog/metrics/llm_as_judge/direct/criteria/manipulative_email.json' 2026-01-06T13:30:44,345 adding 'unitxt/catalog/metrics/llm_as_judge/direct/criteria/naturalness.json' 2026-01-06T13:30:44,346 adding 'unitxt/catalog/metrics/llm_as_judge/direct/criteria/objectivity.json' 2026-01-06T13:30:44,347 adding 'unitxt/catalog/metrics/llm_as_judge/direct/criteria/professional_tone.json' 2026-01-06T13:30:44,348 adding 'unitxt/catalog/metrics/llm_as_judge/direct/criteria/question_answer_quality.json' 2026-01-06T13:30:44,350 adding 'unitxt/catalog/metrics/llm_as_judge/direct/criteria/reference_document_faithfulness.json' 2026-01-06T13:30:44,351 adding 'unitxt/catalog/metrics/llm_as_judge/direct/criteria/relevance.json' 2026-01-06T13:30:44,352 adding 'unitxt/catalog/metrics/llm_as_judge/direct/criteria/step_by_step_reasoning_arithmetic.json' 2026-01-06T13:30:44,353 adding 'unitxt/catalog/metrics/llm_as_judge/direct/criteria/step_by_step_reasoning_bad_final_answer.json' 2026-01-06T13:30:44,354 adding 'unitxt/catalog/metrics/llm_as_judge/direct/criteria/step_by_step_reasoning_bad_grammar.json' 2026-01-06T13:30:44,355 adding 'unitxt/catalog/metrics/llm_as_judge/direct/criteria/step_by_step_reasoning_coherency.json' 2026-01-06T13:30:44,356 adding 'unitxt/catalog/metrics/llm_as_judge/direct/criteria/step_by_step_reasoning_commonsense.json' 2026-01-06T13:30:44,358 adding 'unitxt/catalog/metrics/llm_as_judge/direct/criteria/step_by_step_reasoning_contradiction.json' 2026-01-06T13:30:44,359 adding 'unitxt/catalog/metrics/llm_as_judge/direct/criteria/step_by_step_reasoning_hallucination.json' 2026-01-06T13:30:44,360 adding 'unitxt/catalog/metrics/llm_as_judge/direct/criteria/step_by_step_reasoning_missing_steps.json' 2026-01-06T13:30:44,361 adding 'unitxt/catalog/metrics/llm_as_judge/direct/criteria/step_by_step_reasoning_non_coherent.json' 2026-01-06T13:30:44,362 adding 'unitxt/catalog/metrics/llm_as_judge/direct/criteria/step_by_step_reasoning_non_factual.json' 2026-01-06T13:30:44,364 adding 'unitxt/catalog/metrics/llm_as_judge/direct/criteria/step_by_step_reasoning_overall_quality.json' 2026-01-06T13:30:44,365 adding 'unitxt/catalog/metrics/llm_as_judge/direct/criteria/step_by_step_reasoning_redundancy.json' 2026-01-06T13:30:44,366 adding 'unitxt/catalog/metrics/llm_as_judge/direct/criteria/step_by_step_reasoning_repetition.json' 2026-01-06T13:30:44,367 adding 'unitxt/catalog/metrics/llm_as_judge/direct/criteria/summarization_coherence.json' 2026-01-06T13:30:44,368 adding 'unitxt/catalog/metrics/llm_as_judge/direct/criteria/summarization_fluency.json' 2026-01-06T13:30:44,369 adding 'unitxt/catalog/metrics/llm_as_judge/direct/criteria/summarization_informativeness.json' 2026-01-06T13:30:44,371 adding 'unitxt/catalog/metrics/llm_as_judge/direct/criteria/summarization_preference.json' 2026-01-06T13:30:44,372 adding 'unitxt/catalog/metrics/llm_as_judge/direct/criteria/summarization_relevance.json' 2026-01-06T13:30:44,373 adding 'unitxt/catalog/metrics/llm_as_judge/direct/criteria/temperature_in_celsius_and_fahrenheit.json' 2026-01-06T13:30:44,374 adding 'unitxt/catalog/metrics/llm_as_judge/direct/criteria/tool_calling_correctness.json' 2026-01-06T13:30:44,376 adding 'unitxt/catalog/metrics/llm_as_judge/direct/criteria/toxicity.json' 2026-01-06T13:30:44,377 adding 'unitxt/catalog/metrics/llm_as_judge/direct/criteria/translation_quality.json' 2026-01-06T13:30:44,378 adding 'unitxt/catalog/metrics/llm_as_judge/direct/criteria/truthfulness.json' 2026-01-06T13:30:44,379 adding 'unitxt/catalog/metrics/llm_as_judge/direct/criteria/user_message_general_harm.json' 2026-01-06T13:30:44,381 adding 'unitxt/catalog/metrics/llm_as_judge/direct/criteria/user_message_jailbreak.json' 2026-01-06T13:30:44,382 adding 'unitxt/catalog/metrics/llm_as_judge/direct/criteria/user_message_profanity.json' 2026-01-06T13:30:44,383 adding 'unitxt/catalog/metrics/llm_as_judge/direct/criteria/user_message_social_bias.json' 2026-01-06T13:30:44,384 adding 'unitxt/catalog/metrics/llm_as_judge/direct/criteria/user_message_unethical_behavior.json' 2026-01-06T13:30:44,385 adding 'unitxt/catalog/metrics/llm_as_judge/direct/criteria/user_message_violence.json' 2026-01-06T13:30:44,387 adding 'unitxt/catalog/metrics/llm_as_judge/direct/ollama/granite3_3_8b.json' 2026-01-06T13:30:44,388 adding 'unitxt/catalog/metrics/llm_as_judge/direct/ollama/llama3_1_405b.json' 2026-01-06T13:30:44,389 adding 'unitxt/catalog/metrics/llm_as_judge/direct/ollama/llama3_1_70b.json' 2026-01-06T13:30:44,391 adding 'unitxt/catalog/metrics/llm_as_judge/direct/ollama/llama3_1_8b.json' 2026-01-06T13:30:44,392 adding 'unitxt/catalog/metrics/llm_as_judge/direct/ollama/llama3_3_70b.json' 2026-01-06T13:30:44,393 adding 'unitxt/catalog/metrics/llm_as_judge/direct/openai/gpt_4_1.json' 2026-01-06T13:30:44,395 adding 'unitxt/catalog/metrics/llm_as_judge/direct/openai/gpt_4_1_mini.json' 2026-01-06T13:30:44,396 adding 'unitxt/catalog/metrics/llm_as_judge/direct/openai/gpt_4_1_nano.json' 2026-01-06T13:30:44,397 adding 'unitxt/catalog/metrics/llm_as_judge/direct/openai/gpt_4o.json' 2026-01-06T13:30:44,398 adding 'unitxt/catalog/metrics/llm_as_judge/direct/openai/o1_mini.json' 2026-01-06T13:30:44,399 adding 'unitxt/catalog/metrics/llm_as_judge/direct/openai/o1_preview.json' 2026-01-06T13:30:44,400 adding 'unitxt/catalog/metrics/llm_as_judge/direct/replicate/gpt_4_1.json' 2026-01-06T13:30:44,401 adding 'unitxt/catalog/metrics/llm_as_judge/direct/replicate/llama4_maverick.json' 2026-01-06T13:30:44,402 adding 'unitxt/catalog/metrics/llm_as_judge/direct/replicate/llama4_scout.json' 2026-01-06T13:30:44,404 adding 'unitxt/catalog/metrics/llm_as_judge/direct/rits/deepseek_v3.json' 2026-01-06T13:30:44,405 adding 'unitxt/catalog/metrics/llm_as_judge/direct/rits/granite3_0_8b.json' 2026-01-06T13:30:44,407 adding 'unitxt/catalog/metrics/llm_as_judge/direct/rits/granite3_1_8b.json' 2026-01-06T13:30:44,408 adding 'unitxt/catalog/metrics/llm_as_judge/direct/rits/granite3_2_8b.json' 2026-01-06T13:30:44,409 adding 'unitxt/catalog/metrics/llm_as_judge/direct/rits/granite3_3_8b.json' 2026-01-06T13:30:44,410 adding 'unitxt/catalog/metrics/llm_as_judge/direct/rits/llama3_1_405b.json' 2026-01-06T13:30:44,411 adding 'unitxt/catalog/metrics/llm_as_judge/direct/rits/llama3_1_8b.json' 2026-01-06T13:30:44,412 adding 'unitxt/catalog/metrics/llm_as_judge/direct/rits/llama3_3_70b.json' 2026-01-06T13:30:44,413 adding 'unitxt/catalog/metrics/llm_as_judge/direct/rits/llama4_maverick.json' 2026-01-06T13:30:44,414 adding 'unitxt/catalog/metrics/llm_as_judge/direct/rits/llama4_scout.json' 2026-01-06T13:30:44,416 adding 'unitxt/catalog/metrics/llm_as_judge/direct/rits/mixtral8_7b.json' 2026-01-06T13:30:44,417 adding 'unitxt/catalog/metrics/llm_as_judge/direct/rits/mixtral_large.json' 2026-01-06T13:30:44,418 adding 'unitxt/catalog/metrics/llm_as_judge/direct/together_ai/deepseek_v3.json' 2026-01-06T13:30:44,420 adding 'unitxt/catalog/metrics/llm_as_judge/direct/together_ai/llama3_1_405b.json' 2026-01-06T13:30:44,421 adding 'unitxt/catalog/metrics/llm_as_judge/direct/together_ai/llama3_1_70b.json' 2026-01-06T13:30:44,422 adding 'unitxt/catalog/metrics/llm_as_judge/direct/together_ai/llama3_1_8b.json' 2026-01-06T13:30:44,423 adding 'unitxt/catalog/metrics/llm_as_judge/direct/together_ai/llama3_3_70b.json' 2026-01-06T13:30:44,424 adding 'unitxt/catalog/metrics/llm_as_judge/direct/together_ai/llama4_maverick.json' 2026-01-06T13:30:44,425 adding 'unitxt/catalog/metrics/llm_as_judge/direct/together_ai/llama4_scout.json' 2026-01-06T13:30:44,427 adding 'unitxt/catalog/metrics/llm_as_judge/direct/vertex_ai/gemini_2_5_flash.json' 2026-01-06T13:30:44,428 adding 'unitxt/catalog/metrics/llm_as_judge/direct/vertex_ai/gemmini_2_5_pro.json' 2026-01-06T13:30:44,430 adding 'unitxt/catalog/metrics/llm_as_judge/direct/watsonx/granite3_0_8b.json' 2026-01-06T13:30:44,431 adding 'unitxt/catalog/metrics/llm_as_judge/direct/watsonx/granite3_2_8b.json' 2026-01-06T13:30:44,432 adding 'unitxt/catalog/metrics/llm_as_judge/direct/watsonx/granite3_3_8b.json' 2026-01-06T13:30:44,434 adding 'unitxt/catalog/metrics/llm_as_judge/direct/watsonx/llama3_1_405b.json' 2026-01-06T13:30:44,435 adding 'unitxt/catalog/metrics/llm_as_judge/direct/watsonx/llama3_1_70b.json' 2026-01-06T13:30:44,436 adding 'unitxt/catalog/metrics/llm_as_judge/direct/watsonx/llama3_1_8b.json' 2026-01-06T13:30:44,437 adding 'unitxt/catalog/metrics/llm_as_judge/direct/watsonx/llama3_3_70b.json' 2026-01-06T13:30:44,438 adding 'unitxt/catalog/metrics/llm_as_judge/direct/watsonx/mixtral8_7b.json' 2026-01-06T13:30:44,440 adding 'unitxt/catalog/metrics/llm_as_judge/direct/watsonx/mixtral_large.json' 2026-01-06T13:30:44,442 adding 'unitxt/catalog/metrics/llm_as_judge/pairwise/aws/deepseek_v3.json' 2026-01-06T13:30:44,443 adding 'unitxt/catalog/metrics/llm_as_judge/pairwise/aws/llama3_1_405b.json' 2026-01-06T13:30:44,444 adding 'unitxt/catalog/metrics/llm_as_judge/pairwise/aws/llama3_3_70b.json' 2026-01-06T13:30:44,445 adding 'unitxt/catalog/metrics/llm_as_judge/pairwise/aws/llama4_maverick.json' 2026-01-06T13:30:44,446 adding 'unitxt/catalog/metrics/llm_as_judge/pairwise/aws/llama4_scout.json' 2026-01-06T13:30:44,447 adding 'unitxt/catalog/metrics/llm_as_judge/pairwise/aws/mixtral_large.json' 2026-01-06T13:30:44,449 adding 'unitxt/catalog/metrics/llm_as_judge/pairwise/azure_openai/gpt_4_1.json' 2026-01-06T13:30:44,450 adding 'unitxt/catalog/metrics/llm_as_judge/pairwise/azure_openai/gpt_4_1_mini.json' 2026-01-06T13:30:44,451 adding 'unitxt/catalog/metrics/llm_as_judge/pairwise/azure_openai/gpt_4_1_nano.json' 2026-01-06T13:30:44,452 adding 'unitxt/catalog/metrics/llm_as_judge/pairwise/azure_openai/gpt_4o.json' 2026-01-06T13:30:44,453 adding 'unitxt/catalog/metrics/llm_as_judge/pairwise/azure_openai/llama3_3_70b.json' 2026-01-06T13:30:44,454 adding 'unitxt/catalog/metrics/llm_as_judge/pairwise/azure_openai/llama4_maverick.json' 2026-01-06T13:30:44,455 adding 'unitxt/catalog/metrics/llm_as_judge/pairwise/azure_openai/llama4_scout.json' 2026-01-06T13:30:44,456 adding 'unitxt/catalog/metrics/llm_as_judge/pairwise/azure_openai/o1_mini.json' 2026-01-06T13:30:44,458 adding 'unitxt/catalog/metrics/llm_as_judge/pairwise/azure_openai/o1_preview.json' 2026-01-06T13:30:44,459 adding 'unitxt/catalog/metrics/llm_as_judge/pairwise/criteria/email_inclusivity.json' 2026-01-06T13:30:44,460 adding 'unitxt/catalog/metrics/llm_as_judge/pairwise/criteria/factually_consistent.json' 2026-01-06T13:30:44,462 adding 'unitxt/catalog/metrics/llm_as_judge/pairwise/criteria/funny_joke.json' 2026-01-06T13:30:44,463 adding 'unitxt/catalog/metrics/llm_as_judge/pairwise/criteria/inclusivity.json' 2026-01-06T13:30:44,464 adding 'unitxt/catalog/metrics/llm_as_judge/pairwise/criteria/reference_document_faithfulness.json' 2026-01-06T13:30:44,465 adding 'unitxt/catalog/metrics/llm_as_judge/pairwise/criteria/summarization_preference.json' 2026-01-06T13:30:44,466 adding 'unitxt/catalog/metrics/llm_as_judge/pairwise/criteria/temperature_in_celsius_and_fahrenheit.json' 2026-01-06T13:30:44,468 adding 'unitxt/catalog/metrics/llm_as_judge/pairwise/ollama/granite3_3_8b.json' 2026-01-06T13:30:44,469 adding 'unitxt/catalog/metrics/llm_as_judge/pairwise/ollama/llama3_1_405b.json' 2026-01-06T13:30:44,470 adding 'unitxt/catalog/metrics/llm_as_judge/pairwise/ollama/llama3_1_70b.json' 2026-01-06T13:30:44,472 adding 'unitxt/catalog/metrics/llm_as_judge/pairwise/ollama/llama3_1_8b.json' 2026-01-06T13:30:44,473 adding 'unitxt/catalog/metrics/llm_as_judge/pairwise/ollama/llama3_3_70b.json' 2026-01-06T13:30:44,475 adding 'unitxt/catalog/metrics/llm_as_judge/pairwise/openai/gpt_4_1.json' 2026-01-06T13:30:44,476 adding 'unitxt/catalog/metrics/llm_as_judge/pairwise/openai/gpt_4_1_mini.json' 2026-01-06T13:30:44,477 adding 'unitxt/catalog/metrics/llm_as_judge/pairwise/openai/gpt_4_1_nano.json' 2026-01-06T13:30:44,478 adding 'unitxt/catalog/metrics/llm_as_judge/pairwise/openai/gpt_4o.json' 2026-01-06T13:30:44,479 adding 'unitxt/catalog/metrics/llm_as_judge/pairwise/openai/o1_mini.json' 2026-01-06T13:30:44,480 adding 'unitxt/catalog/metrics/llm_as_judge/pairwise/openai/o1_preview.json' 2026-01-06T13:30:44,482 adding 'unitxt/catalog/metrics/llm_as_judge/pairwise/replicate/gpt_4_1.json' 2026-01-06T13:30:44,483 adding 'unitxt/catalog/metrics/llm_as_judge/pairwise/replicate/llama4_maverick.json' 2026-01-06T13:30:44,484 adding 'unitxt/catalog/metrics/llm_as_judge/pairwise/replicate/llama4_scout.json' 2026-01-06T13:30:44,486 adding 'unitxt/catalog/metrics/llm_as_judge/pairwise/rits/deepseek_v3.json' 2026-01-06T13:30:44,488 adding 'unitxt/catalog/metrics/llm_as_judge/pairwise/rits/granite3_0_8b.json' 2026-01-06T13:30:44,489 adding 'unitxt/catalog/metrics/llm_as_judge/pairwise/rits/granite3_1_8b.json' 2026-01-06T13:30:44,490 adding 'unitxt/catalog/metrics/llm_as_judge/pairwise/rits/granite3_2_8b.json' 2026-01-06T13:30:44,491 adding 'unitxt/catalog/metrics/llm_as_judge/pairwise/rits/granite3_3_8b.json' 2026-01-06T13:30:44,492 adding 'unitxt/catalog/metrics/llm_as_judge/pairwise/rits/llama3_1_405b.json' 2026-01-06T13:30:44,493 adding 'unitxt/catalog/metrics/llm_as_judge/pairwise/rits/llama3_1_8b.json' 2026-01-06T13:30:44,494 adding 'unitxt/catalog/metrics/llm_as_judge/pairwise/rits/llama3_3_70b.json' 2026-01-06T13:30:44,495 adding 'unitxt/catalog/metrics/llm_as_judge/pairwise/rits/llama4_maverick.json' 2026-01-06T13:30:44,496 adding 'unitxt/catalog/metrics/llm_as_judge/pairwise/rits/llama4_scout.json' 2026-01-06T13:30:44,497 adding 'unitxt/catalog/metrics/llm_as_judge/pairwise/rits/mixtral8_7b.json' 2026-01-06T13:30:44,499 adding 'unitxt/catalog/metrics/llm_as_judge/pairwise/rits/mixtral_large.json' 2026-01-06T13:30:44,500 adding 'unitxt/catalog/metrics/llm_as_judge/pairwise/together_ai/deepseek_v3.json' 2026-01-06T13:30:44,501 adding 'unitxt/catalog/metrics/llm_as_judge/pairwise/together_ai/llama3_1_405b.json' 2026-01-06T13:30:44,502 adding 'unitxt/catalog/metrics/llm_as_judge/pairwise/together_ai/llama3_1_70b.json' 2026-01-06T13:30:44,503 adding 'unitxt/catalog/metrics/llm_as_judge/pairwise/together_ai/llama3_1_8b.json' 2026-01-06T13:30:44,504 adding 'unitxt/catalog/metrics/llm_as_judge/pairwise/together_ai/llama3_3_70b.json' 2026-01-06T13:30:44,506 adding 'unitxt/catalog/metrics/llm_as_judge/pairwise/together_ai/llama4_maverick.json' 2026-01-06T13:30:44,507 adding 'unitxt/catalog/metrics/llm_as_judge/pairwise/together_ai/llama4_scout.json' 2026-01-06T13:30:44,509 adding 'unitxt/catalog/metrics/llm_as_judge/pairwise/vertex_ai/gemini_2_5_flash.json' 2026-01-06T13:30:44,510 adding 'unitxt/catalog/metrics/llm_as_judge/pairwise/vertex_ai/gemmini_2_5_pro.json' 2026-01-06T13:30:44,511 adding 'unitxt/catalog/metrics/llm_as_judge/pairwise/watsonx/granite3_0_8b.json' 2026-01-06T13:30:44,513 adding 'unitxt/catalog/metrics/llm_as_judge/pairwise/watsonx/granite3_2_8b.json' 2026-01-06T13:30:44,514 adding 'unitxt/catalog/metrics/llm_as_judge/pairwise/watsonx/granite3_3_8b.json' 2026-01-06T13:30:44,515 adding 'unitxt/catalog/metrics/llm_as_judge/pairwise/watsonx/llama3_1_405b.json' 2026-01-06T13:30:44,516 adding 'unitxt/catalog/metrics/llm_as_judge/pairwise/watsonx/llama3_1_70b.json' 2026-01-06T13:30:44,517 adding 'unitxt/catalog/metrics/llm_as_judge/pairwise/watsonx/llama3_1_8b.json' 2026-01-06T13:30:44,518 adding 'unitxt/catalog/metrics/llm_as_judge/pairwise/watsonx/llama3_3_70b.json' 2026-01-06T13:30:44,520 adding 'unitxt/catalog/metrics/llm_as_judge/pairwise/watsonx/mixtral8_7b.json' 2026-01-06T13:30:44,521 adding 'unitxt/catalog/metrics/llm_as_judge/pairwise/watsonx/mixtral_large.json' 2026-01-06T13:30:44,523 adding 'unitxt/catalog/metrics/llm_as_judge/pairwise_comparative_rating/llama_3_70b_instruct_generic_engine_template_arena_hard.json' 2026-01-06T13:30:44,524 adding 'unitxt/catalog/metrics/llm_as_judge/pairwise_comparative_rating/llama_3_70b_instruct_generic_engine_template_arena_hard_with_shuffling.json' 2026-01-06T13:30:44,525 adding 'unitxt/catalog/metrics/llm_as_judge/pairwise_comparative_rating/llama_3_70b_instruct_ibm_wml_template_arena_hard.json' 2026-01-06T13:30:44,526 adding 'unitxt/catalog/metrics/llm_as_judge/pairwise_comparative_rating/llama_3_70b_instruct_ibm_wml_template_arena_hard_with_shuffling.json' 2026-01-06T13:30:44,527 adding 'unitxt/catalog/metrics/llm_as_judge/pairwise_comparative_rating/llama_3_8b_instruct_generic_engine_template_arena_hard.json' 2026-01-06T13:30:44,529 adding 'unitxt/catalog/metrics/llm_as_judge/pairwise_comparative_rating/llama_3_8b_instruct_generic_engine_template_arena_hard_with_shuffling.json' 2026-01-06T13:30:44,530 adding 'unitxt/catalog/metrics/llm_as_judge/pairwise_comparative_rating/llama_3_3_70b_instruct/template_arena_hard.json' 2026-01-06T13:30:44,532 adding 'unitxt/catalog/metrics/llm_as_judge/pairwise_comparative_rating/llama_3_70b_instruct/template_arena_hard.json' 2026-01-06T13:30:44,534 adding 'unitxt/catalog/metrics/llm_as_judge/pairwise_comparative_rating/llama_3_8b_instruct/template_arena_hard.json' 2026-01-06T13:30:44,535 adding 'unitxt/catalog/metrics/llm_as_judge/rating/llama_3_1_70b_instruct_cross_provider_template_table2text_single_turn_with_reference.json' 2026-01-06T13:30:44,536 adding 'unitxt/catalog/metrics/llm_as_judge/rating/llama_3_70b_instruct_template_table2text_single_turn_with_reference.json' 2026-01-06T13:30:44,538 adding 'unitxt/catalog/metrics/llm_as_judge/rating/mistral_7b_instruct_v0_2_huggingface_template_mt_bench_single_turn.json' 2026-01-06T13:30:44,539 adding 'unitxt/catalog/metrics/llm_as_judge/rating/llama_3_70b_instruct/generic_single_turn.json' 2026-01-06T13:30:44,540 adding 'unitxt/catalog/metrics/llm_as_judge/rating/llama_3_70b_instruct/generic_single_turn_with_reference.json' 2026-01-06T13:30:44,541 adding 'unitxt/catalog/metrics/llm_as_judge/rating/llama_3_70b_instruct/mt_bench_single_turn.json' 2026-01-06T13:30:44,543 adding 'unitxt/catalog/metrics/llm_as_judge/rating/llama_3_8b_instruct/mt_bench_single_turn.json' 2026-01-06T13:30:44,545 adding 'unitxt/catalog/metrics/llm_as_judge/safety/llama_3_3_70b_instruct_ibm_watsonx_template_harm_rating.json' 2026-01-06T13:30:44,546 adding 'unitxt/catalog/metrics/llm_as_judge/safety/llamaguard.json' 2026-01-06T13:30:44,547 adding 'unitxt/catalog/metrics/multi_turn/accuracy.json' 2026-01-06T13:30:44,548 adding 'unitxt/catalog/metrics/multi_turn/sequential_success_accuracy.json' 2026-01-06T13:30:44,550 adding 'unitxt/catalog/metrics/perplexity/flan_t5_small.json' 2026-01-06T13:30:44,551 adding 'unitxt/catalog/metrics/perplexity_a/flan_t5_small.json' 2026-01-06T13:30:44,553 adding 'unitxt/catalog/metrics/perplexity_chat/flan_t5_small.json' 2026-01-06T13:30:44,555 adding 'unitxt/catalog/metrics/perplexity_nli/t5_nli_mixture.json' 2026-01-06T13:30:44,556 adding 'unitxt/catalog/metrics/perplexity_q/flan_t5_small.json' 2026-01-06T13:30:44,559 adding 'unitxt/catalog/metrics/qa/open/recommended_llm_as_judge.json' 2026-01-06T13:30:44,560 adding 'unitxt/catalog/metrics/qa/open/recommended_local_gpu.json' 2026-01-06T13:30:44,561 adding 'unitxt/catalog/metrics/qa/open/recommended_no_gpu.json' 2026-01-06T13:30:44,563 adding 'unitxt/catalog/metrics/rag/answer_correctness.json' 2026-01-06T13:30:44,564 adding 'unitxt/catalog/metrics/rag/answer_inference.json' 2026-01-06T13:30:44,566 adding 'unitxt/catalog/metrics/rag/answer_reward.json' 2026-01-06T13:30:44,567 adding 'unitxt/catalog/metrics/rag/context_correctness.json' 2026-01-06T13:30:44,568 adding 'unitxt/catalog/metrics/rag/context_perplexity.json' 2026-01-06T13:30:44,570 adding 'unitxt/catalog/metrics/rag/context_relevance.json' 2026-01-06T13:30:44,571 adding 'unitxt/catalog/metrics/rag/faithfulness.json' 2026-01-06T13:30:44,572 adding 'unitxt/catalog/metrics/rag/granite_guardian_answer_relevance.json' 2026-01-06T13:30:44,574 adding 'unitxt/catalog/metrics/rag/granite_guardian_context_relevance.json' 2026-01-06T13:30:44,575 adding 'unitxt/catalog/metrics/rag/granite_guardian_groundedness.json' 2026-01-06T13:30:44,577 adding 'unitxt/catalog/metrics/rag/answer_correctness/bert_score_recall.json' 2026-01-06T13:30:44,578 adding 'unitxt/catalog/metrics/rag/answer_correctness/bert_score_recall_ml.json' 2026-01-06T13:30:44,579 adding 'unitxt/catalog/metrics/rag/answer_correctness/generic_inference_engine_q_a_gt_loose.json' 2026-01-06T13:30:44,581 adding 'unitxt/catalog/metrics/rag/answer_correctness/generic_inference_engine_q_a_gt_loose_numeric.json' 2026-01-06T13:30:44,582 adding 'unitxt/catalog/metrics/rag/answer_correctness/llama_3_3_70b_instruct_wml_q_a_gt_loose.json' 2026-01-06T13:30:44,583 adding 'unitxt/catalog/metrics/rag/answer_correctness/llama_3_3_70b_instruct_wml_q_a_gt_loose_logprobs.json' 2026-01-06T13:30:44,584 adding 'unitxt/catalog/metrics/rag/answer_correctness/llama_3_3_70b_instruct_wml_q_a_gt_loose_numeric.json' 2026-01-06T13:30:44,586 adding 'unitxt/catalog/metrics/rag/answer_correctness/sentence_bert_bge.json' 2026-01-06T13:30:44,587 adding 'unitxt/catalog/metrics/rag/answer_correctness/sentence_bert_mini_lm.json' 2026-01-06T13:30:44,588 adding 'unitxt/catalog/metrics/rag/answer_correctness/token_recall.json' 2026-01-06T13:30:44,590 adding 'unitxt/catalog/metrics/rag/answer_relevance/generic_inference_engine_q_a.json' 2026-01-06T13:30:44,591 adding 'unitxt/catalog/metrics/rag/answer_relevance/generic_inference_engine_q_a_numeric.json' 2026-01-06T13:30:44,593 adding 'unitxt/catalog/metrics/rag/answer_relevance/llama_3_3_70b_instruct_wml_q_a.json' 2026-01-06T13:30:44,594 adding 'unitxt/catalog/metrics/rag/answer_relevance/llama_3_3_70b_instruct_wml_q_a_logprobs.json' 2026-01-06T13:30:44,595 adding 'unitxt/catalog/metrics/rag/answer_relevance/llama_3_3_70b_instruct_wml_q_a_numeric.json' 2026-01-06T13:30:44,596 adding 'unitxt/catalog/metrics/rag/answer_relevance/token_recall.json' 2026-01-06T13:30:44,598 adding 'unitxt/catalog/metrics/rag/context_correctness/map.json' 2026-01-06T13:30:44,600 adding 'unitxt/catalog/metrics/rag/context_correctness/mrr.json' 2026-01-06T13:30:44,601 adding 'unitxt/catalog/metrics/rag/context_correctness/retrieval_at_k.json' 2026-01-06T13:30:44,603 adding 'unitxt/catalog/metrics/rag/context_relevance/generic_inference_engine_q_c_ares.json' 2026-01-06T13:30:44,604 adding 'unitxt/catalog/metrics/rag/context_relevance/generic_inference_engine_q_c_ares_numeric.json' 2026-01-06T13:30:44,605 adding 'unitxt/catalog/metrics/rag/context_relevance/llama_3_3_70b_instruct_wml_q_c_ares.json' 2026-01-06T13:30:44,607 adding 'unitxt/catalog/metrics/rag/context_relevance/llama_3_3_70b_instruct_wml_q_c_ares_logprobs.json' 2026-01-06T13:30:44,608 adding 'unitxt/catalog/metrics/rag/context_relevance/llama_3_3_70b_instruct_wml_q_c_ares_numeric.json' 2026-01-06T13:30:44,609 adding 'unitxt/catalog/metrics/rag/context_relevance/perplexity_flan_t5_small.json' 2026-01-06T13:30:44,610 adding 'unitxt/catalog/metrics/rag/context_relevance/sentence_bert_bge.json' 2026-01-06T13:30:44,612 adding 'unitxt/catalog/metrics/rag/context_relevance/sentence_bert_mini_lm.json' 2026-01-06T13:30:44,613 adding 'unitxt/catalog/metrics/rag/context_relevance/token_precision.json' 2026-01-06T13:30:44,615 adding 'unitxt/catalog/metrics/rag/correctness/llama_index_by_gpt_3_5_turbo.json' 2026-01-06T13:30:44,616 adding 'unitxt/catalog/metrics/rag/correctness/llama_index_by_mock.json' 2026-01-06T13:30:44,618 adding 'unitxt/catalog/metrics/rag/correctness_holistic/generic_inference_engine_q_c_a.json' 2026-01-06T13:30:44,619 adding 'unitxt/catalog/metrics/rag/correctness_holistic/generic_inference_engine_q_c_a_numeric.json' 2026-01-06T13:30:44,621 adding 'unitxt/catalog/metrics/rag/correctness_holistic/llama_3_3_70b_instruct_wml_q_c_a.json' 2026-01-06T13:30:44,622 adding 'unitxt/catalog/metrics/rag/correctness_holistic/llama_3_3_70b_instruct_wml_q_c_a_logprobs.json' 2026-01-06T13:30:44,623 adding 'unitxt/catalog/metrics/rag/correctness_holistic/llama_3_3_70b_instruct_wml_q_c_a_numeric.json' 2026-01-06T13:30:44,625 adding 'unitxt/catalog/metrics/rag/end_to_end/answer_correctness.json' 2026-01-06T13:30:44,627 adding 'unitxt/catalog/metrics/rag/end_to_end/answer_faithfulness.json' 2026-01-06T13:30:44,628 adding 'unitxt/catalog/metrics/rag/end_to_end/answer_reward.json' 2026-01-06T13:30:44,629 adding 'unitxt/catalog/metrics/rag/end_to_end/context_correctness.json' 2026-01-06T13:30:44,630 adding 'unitxt/catalog/metrics/rag/end_to_end/context_relevance.json' 2026-01-06T13:30:44,633 adding 'unitxt/catalog/metrics/rag/end_to_end/answer_correctness/bert_score_recall.json' 2026-01-06T13:30:44,634 adding 'unitxt/catalog/metrics/rag/end_to_end/answer_correctness/bert_score_recall_ml.json' 2026-01-06T13:30:44,636 adding 'unitxt/catalog/metrics/rag/end_to_end/answer_correctness/generic_inference_engine_judge.json' 2026-01-06T13:30:44,637 adding 'unitxt/catalog/metrics/rag/end_to_end/answer_correctness/gpt_4o_azure_judge.json' 2026-01-06T13:30:44,638 adding 'unitxt/catalog/metrics/rag/end_to_end/answer_correctness/gpt_oss_120b_rits_judge.json' 2026-01-06T13:30:44,639 adding 'unitxt/catalog/metrics/rag/end_to_end/answer_correctness/gpt_oss_120b_watsonx_judge.json' 2026-01-06T13:30:44,641 adding 'unitxt/catalog/metrics/rag/end_to_end/answer_correctness/llama_3_3_70b_instruct_rits_judge.json' 2026-01-06T13:30:44,642 adding 'unitxt/catalog/metrics/rag/end_to_end/answer_correctness/llama_3_3_70b_instruct_watsonx_judge.json' 2026-01-06T13:30:44,643 adding 'unitxt/catalog/metrics/rag/end_to_end/answer_correctness/llama_4_maverick_rits_judge.json' 2026-01-06T13:30:44,645 adding 'unitxt/catalog/metrics/rag/end_to_end/answer_correctness/llama_4_maverick_watsonx_judge.json' 2026-01-06T13:30:44,646 adding 'unitxt/catalog/metrics/rag/end_to_end/answer_correctness/mistral_large_instruct_rits_judge.json' 2026-01-06T13:30:44,647 adding 'unitxt/catalog/metrics/rag/end_to_end/answer_correctness/mistral_large_instruct_watsonx_judge.json' 2026-01-06T13:30:44,649 adding 'unitxt/catalog/metrics/rag/end_to_end/answer_correctness/mistral_small_3_1_24b_instruct_2503_wml_judge.json' 2026-01-06T13:30:44,650 adding 'unitxt/catalog/metrics/rag/end_to_end/answer_correctness/sentence_bert_bge.json' 2026-01-06T13:30:44,651 adding 'unitxt/catalog/metrics/rag/end_to_end/answer_correctness/sentence_bert_mini_lm.json' 2026-01-06T13:30:44,652 adding 'unitxt/catalog/metrics/rag/end_to_end/answer_correctness/token_recall.json' 2026-01-06T13:30:44,654 adding 'unitxt/catalog/metrics/rag/end_to_end/answer_relevance/answer_reward.json' 2026-01-06T13:30:44,655 adding 'unitxt/catalog/metrics/rag/end_to_end/answer_relevance/generic_inference_engine_judge.json' 2026-01-06T13:30:44,657 adding 'unitxt/catalog/metrics/rag/end_to_end/answer_relevance/gpt_4o_azure_judge.json' 2026-01-06T13:30:44,658 adding 'unitxt/catalog/metrics/rag/end_to_end/answer_relevance/gpt_oss_120b_rits_judge.json' 2026-01-06T13:30:44,659 adding 'unitxt/catalog/metrics/rag/end_to_end/answer_relevance/gpt_oss_120b_watsonx_judge.json' 2026-01-06T13:30:44,660 adding 'unitxt/catalog/metrics/rag/end_to_end/answer_relevance/llama_3_3_70b_instruct_rits_judge.json' 2026-01-06T13:30:44,662 adding 'unitxt/catalog/metrics/rag/end_to_end/answer_relevance/llama_3_3_70b_instruct_watsonx_judge.json' 2026-01-06T13:30:44,663 adding 'unitxt/catalog/metrics/rag/end_to_end/answer_relevance/llama_4_maverick_rits_judge.json' 2026-01-06T13:30:44,664 adding 'unitxt/catalog/metrics/rag/end_to_end/answer_relevance/llama_4_maverick_watsonx_judge.json' 2026-01-06T13:30:44,665 adding 'unitxt/catalog/metrics/rag/end_to_end/answer_relevance/mistral_large_instruct_rits_judge.json' 2026-01-06T13:30:44,667 adding 'unitxt/catalog/metrics/rag/end_to_end/answer_relevance/mistral_large_instruct_watsonx_judge.json' 2026-01-06T13:30:44,668 adding 'unitxt/catalog/metrics/rag/end_to_end/answer_relevance/mistral_small_3_1_24b_instruct_2503_wml_judge.json' 2026-01-06T13:30:44,669 adding 'unitxt/catalog/metrics/rag/end_to_end/answer_relevance/token_recall.json' 2026-01-06T13:30:44,671 adding 'unitxt/catalog/metrics/rag/end_to_end/context_correctness/map.json' 2026-01-06T13:30:44,672 adding 'unitxt/catalog/metrics/rag/end_to_end/context_correctness/mrr.json' 2026-01-06T13:30:44,673 adding 'unitxt/catalog/metrics/rag/end_to_end/context_correctness/retrieval_at_k.json' 2026-01-06T13:30:44,675 adding 'unitxt/catalog/metrics/rag/end_to_end/context_relevance/generic_inference_engine_judge.json' 2026-01-06T13:30:44,676 adding 'unitxt/catalog/metrics/rag/end_to_end/context_relevance/gpt_4o_azure_judge.json' 2026-01-06T13:30:44,677 adding 'unitxt/catalog/metrics/rag/end_to_end/context_relevance/gpt_oss_120b_rits_judge.json' 2026-01-06T13:30:44,678 adding 'unitxt/catalog/metrics/rag/end_to_end/context_relevance/gpt_oss_120b_watsonx_judge.json' 2026-01-06T13:30:44,680 adding 'unitxt/catalog/metrics/rag/end_to_end/context_relevance/llama_3_3_70b_instruct_rits_judge.json' 2026-01-06T13:30:44,681 adding 'unitxt/catalog/metrics/rag/end_to_end/context_relevance/llama_3_3_70b_instruct_watsonx_judge.json' 2026-01-06T13:30:44,682 adding 'unitxt/catalog/metrics/rag/end_to_end/context_relevance/llama_4_maverick_rits_judge.json' 2026-01-06T13:30:44,683 adding 'unitxt/catalog/metrics/rag/end_to_end/context_relevance/llama_4_maverick_watsonx_judge.json' 2026-01-06T13:30:44,684 adding 'unitxt/catalog/metrics/rag/end_to_end/context_relevance/mistral_large_instruct_rits_judge.json' 2026-01-06T13:30:44,685 adding 'unitxt/catalog/metrics/rag/end_to_end/context_relevance/mistral_large_instruct_watsonx_judge.json' 2026-01-06T13:30:44,686 adding 'unitxt/catalog/metrics/rag/end_to_end/context_relevance/mistral_small_3_1_24b_instruct_2503_wml_judge.json' 2026-01-06T13:30:44,688 adding 'unitxt/catalog/metrics/rag/end_to_end/context_relevance/perplexity_flan_t5_small.json' 2026-01-06T13:30:44,689 adding 'unitxt/catalog/metrics/rag/end_to_end/context_relevance/sentence_bert_bge.json' 2026-01-06T13:30:44,690 adding 'unitxt/catalog/metrics/rag/end_to_end/context_relevance/sentence_bert_mini_lm.json' 2026-01-06T13:30:44,691 adding 'unitxt/catalog/metrics/rag/end_to_end/context_relevance/token_precision.json' 2026-01-06T13:30:44,693 adding 'unitxt/catalog/metrics/rag/end_to_end/faithfulness/bert_score_k_precision.json' 2026-01-06T13:30:44,694 adding 'unitxt/catalog/metrics/rag/end_to_end/faithfulness/bert_score_k_precision_ml.json' 2026-01-06T13:30:44,695 adding 'unitxt/catalog/metrics/rag/end_to_end/faithfulness/generic_inference_engine_judge.json' 2026-01-06T13:30:44,697 adding 'unitxt/catalog/metrics/rag/end_to_end/faithfulness/gpt_4o_azure_judge.json' 2026-01-06T13:30:44,698 adding 'unitxt/catalog/metrics/rag/end_to_end/faithfulness/gpt_oss_120b_rits_judge.json' 2026-01-06T13:30:44,699 adding 'unitxt/catalog/metrics/rag/end_to_end/faithfulness/gpt_oss_120b_watsonx_judge.json' 2026-01-06T13:30:44,700 adding 'unitxt/catalog/metrics/rag/end_to_end/faithfulness/llama_3_3_70b_instruct_rits_judge.json' 2026-01-06T13:30:44,701 adding 'unitxt/catalog/metrics/rag/end_to_end/faithfulness/llama_3_3_70b_instruct_watsonx_judge.json' 2026-01-06T13:30:44,702 adding 'unitxt/catalog/metrics/rag/end_to_end/faithfulness/llama_4_maverick_rits_judge.json' 2026-01-06T13:30:44,704 adding 'unitxt/catalog/metrics/rag/end_to_end/faithfulness/llama_4_maverick_watsonx_judge.json' 2026-01-06T13:30:44,705 adding 'unitxt/catalog/metrics/rag/end_to_end/faithfulness/mistral_large_instruct_rits_judge.json' 2026-01-06T13:30:44,706 adding 'unitxt/catalog/metrics/rag/end_to_end/faithfulness/mistral_large_instruct_watsonx_judge.json' 2026-01-06T13:30:44,707 adding 'unitxt/catalog/metrics/rag/end_to_end/faithfulness/mistral_small_3_1_24b_instruct_2503_wml_judge.json' 2026-01-06T13:30:44,708 adding 'unitxt/catalog/metrics/rag/end_to_end/faithfulness/sentence_bert_bge.json' 2026-01-06T13:30:44,709 adding 'unitxt/catalog/metrics/rag/end_to_end/faithfulness/sentence_bert_mini_lm.json' 2026-01-06T13:30:44,711 adding 'unitxt/catalog/metrics/rag/end_to_end/faithfulness/token_k_precision.json' 2026-01-06T13:30:44,712 adding 'unitxt/catalog/metrics/rag/end_to_end/faithfulness/vectara_hhem_2_1.json' 2026-01-06T13:30:44,714 adding 'unitxt/catalog/metrics/rag/end_to_end/recommended/cpu_only/all.json' 2026-01-06T13:30:44,716 adding 'unitxt/catalog/metrics/rag/end_to_end/recommended/llmaj_azure/all.json' 2026-01-06T13:30:44,717 adding 'unitxt/catalog/metrics/rag/end_to_end/recommended/llmaj_rits/all.json' 2026-01-06T13:30:44,719 adding 'unitxt/catalog/metrics/rag/end_to_end/recommended/llmaj_watsonx/all.json' 2026-01-06T13:30:44,721 adding 'unitxt/catalog/metrics/rag/end_to_end/recommended/small_llm/all.json' 2026-01-06T13:30:44,723 adding 'unitxt/catalog/metrics/rag/external_rag/answer_correctness.json' 2026-01-06T13:30:44,724 adding 'unitxt/catalog/metrics/rag/external_rag/answer_reward.json' 2026-01-06T13:30:44,725 adding 'unitxt/catalog/metrics/rag/external_rag/context_correctness.json' 2026-01-06T13:30:44,726 adding 'unitxt/catalog/metrics/rag/external_rag/context_relevance.json' 2026-01-06T13:30:44,727 adding 'unitxt/catalog/metrics/rag/external_rag/faithfulness.json' 2026-01-06T13:30:44,729 adding 'unitxt/catalog/metrics/rag/external_rag/answer_correctness/bert_score_recall.json' 2026-01-06T13:30:44,730 adding 'unitxt/catalog/metrics/rag/external_rag/answer_correctness/bert_score_recall_ml.json' 2026-01-06T13:30:44,731 adding 'unitxt/catalog/metrics/rag/external_rag/answer_correctness/generic_inference_engine_judge.json' 2026-01-06T13:30:44,732 adding 'unitxt/catalog/metrics/rag/external_rag/answer_correctness/gpt_4o_azure_judge.json' 2026-01-06T13:30:44,733 adding 'unitxt/catalog/metrics/rag/external_rag/answer_correctness/gpt_oss_120b_rits_judge.json' 2026-01-06T13:30:44,734 adding 'unitxt/catalog/metrics/rag/external_rag/answer_correctness/gpt_oss_120b_watsonx_judge.json' 2026-01-06T13:30:44,735 adding 'unitxt/catalog/metrics/rag/external_rag/answer_correctness/llama_3_3_70b_instruct_rits_judge.json' 2026-01-06T13:30:44,736 adding 'unitxt/catalog/metrics/rag/external_rag/answer_correctness/llama_3_3_70b_instruct_watsonx_judge.json' 2026-01-06T13:30:44,738 adding 'unitxt/catalog/metrics/rag/external_rag/answer_correctness/llama_4_maverick_rits_judge.json' 2026-01-06T13:30:44,739 adding 'unitxt/catalog/metrics/rag/external_rag/answer_correctness/llama_4_maverick_watsonx_judge.json' 2026-01-06T13:30:44,740 adding 'unitxt/catalog/metrics/rag/external_rag/answer_correctness/mistral_large_instruct_rits_judge.json' 2026-01-06T13:30:44,741 adding 'unitxt/catalog/metrics/rag/external_rag/answer_correctness/mistral_large_instruct_watsonx_judge.json' 2026-01-06T13:30:44,742 adding 'unitxt/catalog/metrics/rag/external_rag/answer_correctness/mistral_small_3_1_24b_instruct_2503_wml_judge.json' 2026-01-06T13:30:44,743 adding 'unitxt/catalog/metrics/rag/external_rag/answer_correctness/sentence_bert_bge.json' 2026-01-06T13:30:44,744 adding 'unitxt/catalog/metrics/rag/external_rag/answer_correctness/sentence_bert_mini_lm.json' 2026-01-06T13:30:44,745 adding 'unitxt/catalog/metrics/rag/external_rag/answer_correctness/token_recall.json' 2026-01-06T13:30:44,747 adding 'unitxt/catalog/metrics/rag/external_rag/answer_relevance/answer_reward.json' 2026-01-06T13:30:44,748 adding 'unitxt/catalog/metrics/rag/external_rag/answer_relevance/generic_inference_engine_judge.json' 2026-01-06T13:30:44,750 adding 'unitxt/catalog/metrics/rag/external_rag/answer_relevance/gpt_4o_azure_judge.json' 2026-01-06T13:30:44,751 adding 'unitxt/catalog/metrics/rag/external_rag/answer_relevance/gpt_oss_120b_rits_judge.json' 2026-01-06T13:30:44,752 adding 'unitxt/catalog/metrics/rag/external_rag/answer_relevance/gpt_oss_120b_watsonx_judge.json' 2026-01-06T13:30:44,753 adding 'unitxt/catalog/metrics/rag/external_rag/answer_relevance/llama_3_3_70b_instruct_rits_judge.json' 2026-01-06T13:30:44,754 adding 'unitxt/catalog/metrics/rag/external_rag/answer_relevance/llama_3_3_70b_instruct_watsonx_judge.json' 2026-01-06T13:30:44,755 adding 'unitxt/catalog/metrics/rag/external_rag/answer_relevance/llama_4_maverick_rits_judge.json' 2026-01-06T13:30:44,757 adding 'unitxt/catalog/metrics/rag/external_rag/answer_relevance/llama_4_maverick_watsonx_judge.json' 2026-01-06T13:30:44,758 adding 'unitxt/catalog/metrics/rag/external_rag/answer_relevance/mistral_large_instruct_rits_judge.json' 2026-01-06T13:30:44,759 adding 'unitxt/catalog/metrics/rag/external_rag/answer_relevance/mistral_large_instruct_watsonx_judge.json' 2026-01-06T13:30:44,760 adding 'unitxt/catalog/metrics/rag/external_rag/answer_relevance/mistral_small_3_1_24b_instruct_2503_wml_judge.json' 2026-01-06T13:30:44,761 adding 'unitxt/catalog/metrics/rag/external_rag/answer_relevance/token_recall.json' 2026-01-06T13:30:44,763 adding 'unitxt/catalog/metrics/rag/external_rag/context_correctness/map.json' 2026-01-06T13:30:44,764 adding 'unitxt/catalog/metrics/rag/external_rag/context_correctness/mrr.json' 2026-01-06T13:30:44,765 adding 'unitxt/catalog/metrics/rag/external_rag/context_correctness/retrieval_at_k.json' 2026-01-06T13:30:44,767 adding 'unitxt/catalog/metrics/rag/external_rag/context_relevance/generic_inference_engine_judge.json' 2026-01-06T13:30:44,768 adding 'unitxt/catalog/metrics/rag/external_rag/context_relevance/gpt_4o_azure_judge.json' 2026-01-06T13:30:44,769 adding 'unitxt/catalog/metrics/rag/external_rag/context_relevance/gpt_oss_120b_rits_judge.json' 2026-01-06T13:30:44,770 adding 'unitxt/catalog/metrics/rag/external_rag/context_relevance/gpt_oss_120b_watsonx_judge.json' 2026-01-06T13:30:44,771 adding 'unitxt/catalog/metrics/rag/external_rag/context_relevance/llama_3_3_70b_instruct_rits_judge.json' 2026-01-06T13:30:44,772 adding 'unitxt/catalog/metrics/rag/external_rag/context_relevance/llama_3_3_70b_instruct_watsonx_judge.json' 2026-01-06T13:30:44,773 adding 'unitxt/catalog/metrics/rag/external_rag/context_relevance/llama_4_maverick_rits_judge.json' 2026-01-06T13:30:44,775 adding 'unitxt/catalog/metrics/rag/external_rag/context_relevance/llama_4_maverick_watsonx_judge.json' 2026-01-06T13:30:44,776 adding 'unitxt/catalog/metrics/rag/external_rag/context_relevance/mistral_large_instruct_rits_judge.json' 2026-01-06T13:30:44,777 adding 'unitxt/catalog/metrics/rag/external_rag/context_relevance/mistral_large_instruct_watsonx_judge.json' 2026-01-06T13:30:44,778 adding 'unitxt/catalog/metrics/rag/external_rag/context_relevance/mistral_small_3_1_24b_instruct_2503_wml_judge.json' 2026-01-06T13:30:44,779 adding 'unitxt/catalog/metrics/rag/external_rag/context_relevance/perplexity_flan_t5_small.json' 2026-01-06T13:30:44,780 adding 'unitxt/catalog/metrics/rag/external_rag/context_relevance/sentence_bert_bge.json' 2026-01-06T13:30:44,781 adding 'unitxt/catalog/metrics/rag/external_rag/context_relevance/sentence_bert_mini_lm.json' 2026-01-06T13:30:44,782 adding 'unitxt/catalog/metrics/rag/external_rag/context_relevance/token_precision.json' 2026-01-06T13:30:44,784 adding 'unitxt/catalog/metrics/rag/external_rag/faithfulness/bert_score_k_precision.json' 2026-01-06T13:30:44,786 adding 'unitxt/catalog/metrics/rag/external_rag/faithfulness/bert_score_k_precision_ml.json' 2026-01-06T13:30:44,787 adding 'unitxt/catalog/metrics/rag/external_rag/faithfulness/generic_inference_engine_judge.json' 2026-01-06T13:30:44,788 adding 'unitxt/catalog/metrics/rag/external_rag/faithfulness/gpt_4o_azure_judge.json' 2026-01-06T13:30:44,789 adding 'unitxt/catalog/metrics/rag/external_rag/faithfulness/gpt_oss_120b_rits_judge.json' 2026-01-06T13:30:44,790 adding 'unitxt/catalog/metrics/rag/external_rag/faithfulness/gpt_oss_120b_watsonx_judge.json' 2026-01-06T13:30:44,791 adding 'unitxt/catalog/metrics/rag/external_rag/faithfulness/llama_3_3_70b_instruct_rits_judge.json' 2026-01-06T13:30:44,792 adding 'unitxt/catalog/metrics/rag/external_rag/faithfulness/llama_3_3_70b_instruct_watsonx_judge.json' 2026-01-06T13:30:44,794 adding 'unitxt/catalog/metrics/rag/external_rag/faithfulness/llama_4_maverick_rits_judge.json' 2026-01-06T13:30:44,795 adding 'unitxt/catalog/metrics/rag/external_rag/faithfulness/llama_4_maverick_watsonx_judge.json' 2026-01-06T13:30:44,796 adding 'unitxt/catalog/metrics/rag/external_rag/faithfulness/mistral_large_instruct_rits_judge.json' 2026-01-06T13:30:44,797 adding 'unitxt/catalog/metrics/rag/external_rag/faithfulness/mistral_large_instruct_watsonx_judge.json' 2026-01-06T13:30:44,798 adding 'unitxt/catalog/metrics/rag/external_rag/faithfulness/mistral_small_3_1_24b_instruct_2503_wml_judge.json' 2026-01-06T13:30:44,799 adding 'unitxt/catalog/metrics/rag/external_rag/faithfulness/sentence_bert_bge.json' 2026-01-06T13:30:44,801 adding 'unitxt/catalog/metrics/rag/external_rag/faithfulness/sentence_bert_mini_lm.json' 2026-01-06T13:30:44,802 adding 'unitxt/catalog/metrics/rag/external_rag/faithfulness/token_k_precision.json' 2026-01-06T13:30:44,803 adding 'unitxt/catalog/metrics/rag/external_rag/faithfulness/vectara_hhem_2_1.json' 2026-01-06T13:30:44,805 adding 'unitxt/catalog/metrics/rag/external_rag/recommended/cpu_only/all.json' 2026-01-06T13:30:44,807 adding 'unitxt/catalog/metrics/rag/external_rag/recommended/llmaj_azure/all.json' 2026-01-06T13:30:44,808 adding 'unitxt/catalog/metrics/rag/external_rag/recommended/llmaj_rits/all.json' 2026-01-06T13:30:44,810 adding 'unitxt/catalog/metrics/rag/external_rag/recommended/llmaj_watsonx/all.json' 2026-01-06T13:30:44,811 adding 'unitxt/catalog/metrics/rag/external_rag/recommended/small_llm/all.json' 2026-01-06T13:30:44,813 adding 'unitxt/catalog/metrics/rag/faithfulness/bert_score_k_precision.json' 2026-01-06T13:30:44,814 adding 'unitxt/catalog/metrics/rag/faithfulness/bert_score_k_precision_ml.json' 2026-01-06T13:30:44,815 adding 'unitxt/catalog/metrics/rag/faithfulness/generic_inference_engine_c_a.json' 2026-01-06T13:30:44,816 adding 'unitxt/catalog/metrics/rag/faithfulness/generic_inference_engine_c_a_verbal.json' 2026-01-06T13:30:44,817 adding 'unitxt/catalog/metrics/rag/faithfulness/generic_inference_engine_q_c_a.json' 2026-01-06T13:30:44,819 adding 'unitxt/catalog/metrics/rag/faithfulness/generic_inference_engine_q_c_a_verbal.json' 2026-01-06T13:30:44,820 adding 'unitxt/catalog/metrics/rag/faithfulness/llama_3_3_70b_instruct_wml_c_a.json' 2026-01-06T13:30:44,821 adding 'unitxt/catalog/metrics/rag/faithfulness/llama_3_3_70b_instruct_wml_c_a_logprobs.json' 2026-01-06T13:30:44,822 adding 'unitxt/catalog/metrics/rag/faithfulness/llama_3_3_70b_instruct_wml_c_a_verbal.json' 2026-01-06T13:30:44,823 adding 'unitxt/catalog/metrics/rag/faithfulness/llama_3_3_70b_instruct_wml_q_c_a.json' 2026-01-06T13:30:44,825 adding 'unitxt/catalog/metrics/rag/faithfulness/llama_3_3_70b_instruct_wml_q_c_a_logprobs.json' 2026-01-06T13:30:44,826 adding 'unitxt/catalog/metrics/rag/faithfulness/llama_3_3_70b_instruct_wml_q_c_a_verbal.json' 2026-01-06T13:30:44,827 adding 'unitxt/catalog/metrics/rag/faithfulness/llama_index_by_gpt_3_5_turbo.json' 2026-01-06T13:30:44,828 adding 'unitxt/catalog/metrics/rag/faithfulness/llama_index_by_mock.json' 2026-01-06T13:30:44,829 adding 'unitxt/catalog/metrics/rag/faithfulness/sentence_bert_bge.json' 2026-01-06T13:30:44,830 adding 'unitxt/catalog/metrics/rag/faithfulness/sentence_bert_mini_lm.json' 2026-01-06T13:30:44,832 adding 'unitxt/catalog/metrics/rag/faithfulness/token_k_precision.json' 2026-01-06T13:30:44,833 adding 'unitxt/catalog/metrics/rag/faithfulness/vectara_hhem_2_1.json' 2026-01-06T13:30:44,835 adding 'unitxt/catalog/metrics/rag/response_generation/adherence_with_format/llama_3_3_70b_instruct_judge.json' 2026-01-06T13:30:44,837 adding 'unitxt/catalog/metrics/rag/response_generation/answer_completeness/llama_3_3_70b_instruct_judge.json' 2026-01-06T13:30:44,839 adding 'unitxt/catalog/metrics/rag/response_generation/answer_correctness/bert_score_recall.json' 2026-01-06T13:30:44,840 adding 'unitxt/catalog/metrics/rag/response_generation/answer_correctness/bert_score_recall_ml.json' 2026-01-06T13:30:44,841 adding 'unitxt/catalog/metrics/rag/response_generation/answer_correctness/generic_inference_engine_judge.json' 2026-01-06T13:30:44,842 adding 'unitxt/catalog/metrics/rag/response_generation/answer_correctness/gpt_4o_azure_judge.json' 2026-01-06T13:30:44,843 adding 'unitxt/catalog/metrics/rag/response_generation/answer_correctness/gpt_oss_120b_rits_judge.json' 2026-01-06T13:30:44,845 adding 'unitxt/catalog/metrics/rag/response_generation/answer_correctness/gpt_oss_120b_watsonx_judge.json' 2026-01-06T13:30:44,846 adding 'unitxt/catalog/metrics/rag/response_generation/answer_correctness/llama_3_3_70b_instruct_rits_judge.json' 2026-01-06T13:30:44,847 adding 'unitxt/catalog/metrics/rag/response_generation/answer_correctness/llama_3_3_70b_instruct_watsonx_judge.json' 2026-01-06T13:30:44,848 adding 'unitxt/catalog/metrics/rag/response_generation/answer_correctness/llama_4_maverick_rits_judge.json' 2026-01-06T13:30:44,849 adding 'unitxt/catalog/metrics/rag/response_generation/answer_correctness/llama_4_maverick_watsonx_judge.json' 2026-01-06T13:30:44,851 adding 'unitxt/catalog/metrics/rag/response_generation/answer_correctness/mistral_large_instruct_rits_judge.json' 2026-01-06T13:30:44,852 adding 'unitxt/catalog/metrics/rag/response_generation/answer_correctness/mistral_large_instruct_watsonx_judge.json' 2026-01-06T13:30:44,853 adding 'unitxt/catalog/metrics/rag/response_generation/answer_correctness/mistral_small_3_1_24b_instruct_2503_wml_judge.json' 2026-01-06T13:30:44,854 adding 'unitxt/catalog/metrics/rag/response_generation/answer_correctness/sentence_bert_bge.json' 2026-01-06T13:30:44,855 adding 'unitxt/catalog/metrics/rag/response_generation/answer_correctness/sentence_bert_mini_lm.json' 2026-01-06T13:30:44,856 adding 'unitxt/catalog/metrics/rag/response_generation/answer_correctness/token_recall.json' 2026-01-06T13:30:44,858 adding 'unitxt/catalog/metrics/rag/response_generation/answer_relevance/answer_reward.json' 2026-01-06T13:30:44,859 adding 'unitxt/catalog/metrics/rag/response_generation/answer_relevance/generic_inference_engine_judge.json' 2026-01-06T13:30:44,860 adding 'unitxt/catalog/metrics/rag/response_generation/answer_relevance/gpt_4o_azure_judge.json' 2026-01-06T13:30:44,861 adding 'unitxt/catalog/metrics/rag/response_generation/answer_relevance/gpt_oss_120b_rits_judge.json' 2026-01-06T13:30:44,862 adding 'unitxt/catalog/metrics/rag/response_generation/answer_relevance/gpt_oss_120b_watsonx_judge.json' 2026-01-06T13:30:44,863 adding 'unitxt/catalog/metrics/rag/response_generation/answer_relevance/llama_3_3_70b_instruct_rits_judge.json' 2026-01-06T13:30:44,864 adding 'unitxt/catalog/metrics/rag/response_generation/answer_relevance/llama_3_3_70b_instruct_watsonx_judge.json' 2026-01-06T13:30:44,866 adding 'unitxt/catalog/metrics/rag/response_generation/answer_relevance/llama_4_maverick_rits_judge.json' 2026-01-06T13:30:44,867 adding 'unitxt/catalog/metrics/rag/response_generation/answer_relevance/llama_4_maverick_watsonx_judge.json' 2026-01-06T13:30:44,868 adding 'unitxt/catalog/metrics/rag/response_generation/answer_relevance/mistral_large_instruct_rits_judge.json' 2026-01-06T13:30:44,869 adding 'unitxt/catalog/metrics/rag/response_generation/answer_relevance/mistral_large_instruct_watsonx_judge.json' 2026-01-06T13:30:44,870 adding 'unitxt/catalog/metrics/rag/response_generation/answer_relevance/mistral_small_3_1_24b_instruct_2503_wml_judge.json' 2026-01-06T13:30:44,871 adding 'unitxt/catalog/metrics/rag/response_generation/answer_relevance/token_recall.json' 2026-01-06T13:30:44,873 adding 'unitxt/catalog/metrics/rag/response_generation/correctness/token_overlap.json' 2026-01-06T13:30:44,875 adding 'unitxt/catalog/metrics/rag/response_generation/correctness/bert_score/deberta_large_mnli.json' 2026-01-06T13:30:44,876 adding 'unitxt/catalog/metrics/rag/response_generation/correctness/bert_score/deberta_v3_base_mnli_xnli_ml.json' 2026-01-06T13:30:44,878 adding 'unitxt/catalog/metrics/rag/response_generation/faithfullness/token_overlap.json' 2026-01-06T13:30:44,880 adding 'unitxt/catalog/metrics/rag/response_generation/faithfulness/bert_score_k_precision.json' 2026-01-06T13:30:44,881 adding 'unitxt/catalog/metrics/rag/response_generation/faithfulness/bert_score_k_precision_ml.json' 2026-01-06T13:30:44,882 adding 'unitxt/catalog/metrics/rag/response_generation/faithfulness/generic_inference_engine_judge.json' 2026-01-06T13:30:44,883 adding 'unitxt/catalog/metrics/rag/response_generation/faithfulness/gpt_4o_azure_judge.json' 2026-01-06T13:30:44,884 adding 'unitxt/catalog/metrics/rag/response_generation/faithfulness/gpt_oss_120b_rits_judge.json' 2026-01-06T13:30:44,885 adding 'unitxt/catalog/metrics/rag/response_generation/faithfulness/gpt_oss_120b_watsonx_judge.json' 2026-01-06T13:30:44,887 adding 'unitxt/catalog/metrics/rag/response_generation/faithfulness/llama_3_3_70b_instruct_rits_judge.json' 2026-01-06T13:30:44,888 adding 'unitxt/catalog/metrics/rag/response_generation/faithfulness/llama_3_3_70b_instruct_watsonx_judge.json' 2026-01-06T13:30:44,889 adding 'unitxt/catalog/metrics/rag/response_generation/faithfulness/llama_4_maverick_rits_judge.json' 2026-01-06T13:30:44,890 adding 'unitxt/catalog/metrics/rag/response_generation/faithfulness/llama_4_maverick_watsonx_judge.json' 2026-01-06T13:30:44,891 adding 'unitxt/catalog/metrics/rag/response_generation/faithfulness/mistral_large_instruct_rits_judge.json' 2026-01-06T13:30:44,892 adding 'unitxt/catalog/metrics/rag/response_generation/faithfulness/mistral_large_instruct_watsonx_judge.json' 2026-01-06T13:30:44,893 adding 'unitxt/catalog/metrics/rag/response_generation/faithfulness/mistral_small_3_1_24b_instruct_2503_wml_judge.json' 2026-01-06T13:30:44,895 adding 'unitxt/catalog/metrics/rag/response_generation/faithfulness/sentence_bert_bge.json' 2026-01-06T13:30:44,896 adding 'unitxt/catalog/metrics/rag/response_generation/faithfulness/sentence_bert_mini_lm.json' 2026-01-06T13:30:44,897 adding 'unitxt/catalog/metrics/rag/response_generation/faithfulness/token_k_precision.json' 2026-01-06T13:30:44,898 adding 'unitxt/catalog/metrics/rag/response_generation/faithfulness/vectara_hhem_2_1.json' 2026-01-06T13:30:44,900 adding 'unitxt/catalog/metrics/rag/response_generation/recommended/cpu_only/all.json' 2026-01-06T13:30:44,901 adding 'unitxt/catalog/metrics/rag/response_generation/recommended/llmaj_azure/all.json' 2026-01-06T13:30:44,903 adding 'unitxt/catalog/metrics/rag/response_generation/recommended/llmaj_rits/all.json' 2026-01-06T13:30:44,905 adding 'unitxt/catalog/metrics/rag/response_generation/recommended/llmaj_watsonx/all.json' 2026-01-06T13:30:44,906 adding 'unitxt/catalog/metrics/rag/response_generation/recommended/small_llm/all.json' 2026-01-06T13:30:44,908 adding 'unitxt/catalog/metrics/reward/deberta_v3_large_v2.json' 2026-01-06T13:30:44,909 adding 'unitxt/catalog/metrics/robustness/fixed_group_absval_norm_cohens_h_paraphrase_accuracy.json' 2026-01-06T13:30:44,910 adding 'unitxt/catalog/metrics/robustness/fixed_group_absval_norm_cohens_h_paraphrase_string_containment.json' 2026-01-06T13:30:44,911 adding 'unitxt/catalog/metrics/robustness/fixed_group_absval_norm_hedges_g_paraphrase_accuracy.json' 2026-01-06T13:30:44,913 adding 'unitxt/catalog/metrics/robustness/fixed_group_absval_norm_hedges_g_paraphrase_string_containment.json' 2026-01-06T13:30:44,914 adding 'unitxt/catalog/metrics/robustness/fixed_group_mean_accuracy.json' 2026-01-06T13:30:44,915 adding 'unitxt/catalog/metrics/robustness/fixed_group_mean_baseline_accuracy.json' 2026-01-06T13:30:44,916 adding 'unitxt/catalog/metrics/robustness/fixed_group_mean_baseline_string_containment.json' 2026-01-06T13:30:44,917 adding 'unitxt/catalog/metrics/robustness/fixed_group_mean_paraphrase_accuracy.json' 2026-01-06T13:30:44,918 adding 'unitxt/catalog/metrics/robustness/fixed_group_mean_paraphrase_string_containment.json' 2026-01-06T13:30:44,919 adding 'unitxt/catalog/metrics/robustness/fixed_group_mean_string_containment.json' 2026-01-06T13:30:44,920 adding 'unitxt/catalog/metrics/robustness/fixed_group_norm_cohens_h_paraphrase_accuracy.json' 2026-01-06T13:30:44,921 adding 'unitxt/catalog/metrics/robustness/fixed_group_norm_cohens_h_paraphrase_string_containment.json' 2026-01-06T13:30:44,923 adding 'unitxt/catalog/metrics/robustness/fixed_group_norm_hedges_g_paraphrase_accuracy.json' 2026-01-06T13:30:44,924 adding 'unitxt/catalog/metrics/robustness/fixed_group_norm_hedges_g_paraphrase_string_containment.json' 2026-01-06T13:30:44,925 adding 'unitxt/catalog/metrics/robustness/fixed_group_pdr_paraphrase_accuracy.json' 2026-01-06T13:30:44,926 adding 'unitxt/catalog/metrics/robustness/fixed_group_pdr_paraphrase_string_containment.json' 2026-01-06T13:30:44,927 adding 'unitxt/catalog/metrics/robustness/group_mean_accuracy.json' 2026-01-06T13:30:44,928 adding 'unitxt/catalog/metrics/robustness/group_mean_string_containment.json' 2026-01-06T13:30:44,929 adding 'unitxt/catalog/metrics/robustness/group_mean_token_overlap.json' 2026-01-06T13:30:44,931 adding 'unitxt/catalog/metrics/sentence_bert/bge_large_en_1_5.json' 2026-01-06T13:30:44,932 adding 'unitxt/catalog/metrics/sentence_bert/minilm_l12_v2.json' 2026-01-06T13:30:44,933 adding 'unitxt/catalog/metrics/sentence_bert/mpnet_base_v2.json' 2026-01-06T13:30:44,934 adding 'unitxt/catalog/metrics/text2sql/execution_accuracy.json' 2026-01-06T13:30:44,935 adding 'unitxt/catalog/metrics/text2sql/execution_logic_accuracy.json' 2026-01-06T13:30:44,936 adding 'unitxt/catalog/metrics/text2sql/non_execution_accuracy.json' 2026-01-06T13:30:44,938 adding 'unitxt/catalog/metrics/tool_calling/reflection.json' 2026-01-06T13:30:44,940 adding 'unitxt/catalog/metrics/tool_calling/correctness/llama_3_3_70b_instruct_judge.json' 2026-01-06T13:30:44,941 adding 'unitxt/catalog/metrics/tool_calling/key_value/accuracy.json' 2026-01-06T13:30:44,942 adding 'unitxt/catalog/metrics/tool_calling/key_value/token_overlap.json' 2026-01-06T13:30:44,944 adding 'unitxt/catalog/metrics/tool_calling/multi_turn/validity.json' 2026-01-06T13:30:44,946 adding 'unitxt/catalog/metrics/tool_calling/multi_turn/correctness/llama_3_3_70b_instruct_judge.json' 2026-01-06T13:30:44,947 adding 'unitxt/catalog/metrics/tool_calling/reflection/syntactic.json' 2026-01-06T13:30:44,950 adding 'unitxt/catalog/operators/arena_hard_hf_space_processing_steps.json' 2026-01-06T13:30:44,951 adding 'unitxt/catalog/operators/capitalize.json' 2026-01-06T13:30:44,952 adding 'unitxt/catalog/operators/cast_to_float_return_0_5_if_failed.json' 2026-01-06T13:30:44,953 adding 'unitxt/catalog/operators/cast_to_float_return_nan_if_failed.json' 2026-01-06T13:30:44,954 adding 'unitxt/catalog/operators/cast_to_float_return_zero_if_failed.json' 2026-01-06T13:30:44,955 adding 'unitxt/catalog/operators/convert_to_boolean.json' 2026-01-06T13:30:44,956 adding 'unitxt/catalog/operators/extract_arena_hard_numerical_judgment.json' 2026-01-06T13:30:44,957 adding 'unitxt/catalog/operators/extract_from_double_brackets.json' 2026-01-06T13:30:44,958 adding 'unitxt/catalog/operators/extract_harm_rating_judgment.json' 2026-01-06T13:30:44,959 adding 'unitxt/catalog/operators/extract_mt_bench_label_judgment.json' 2026-01-06T13:30:44,960 adding 'unitxt/catalog/operators/extract_mt_bench_rating_judgment.json' 2026-01-06T13:30:44,961 adding 'unitxt/catalog/operators/extract_verbal_judgement.json' 2026-01-06T13:30:44,962 adding 'unitxt/catalog/operators/extract_verbal_judgement_bad_good.json' 2026-01-06T13:30:44,963 adding 'unitxt/catalog/operators/first_character.json' 2026-01-06T13:30:44,964 adding 'unitxt/catalog/operators/fix_json_schema.json' 2026-01-06T13:30:44,966 adding 'unitxt/catalog/operators/fix_whitespace.json' 2026-01-06T13:30:44,967 adding 'unitxt/catalog/operators/get_string_after_colon.json' 2026-01-06T13:30:44,968 adding 'unitxt/catalog/operators/hate_speech_or_not_hate_speech.json' 2026-01-06T13:30:44,969 adding 'unitxt/catalog/operators/literal_eval.json' 2026-01-06T13:30:44,970 adding 'unitxt/catalog/operators/lower_case.json' 2026-01-06T13:30:44,971 adding 'unitxt/catalog/operators/lower_case_till_punc.json' 2026-01-06T13:30:44,972 adding 'unitxt/catalog/operators/match_closest_option.json' 2026-01-06T13:30:44,973 adding 'unitxt/catalog/operators/predictions_yes_1_else_0.json' 2026-01-06T13:30:44,974 adding 'unitxt/catalog/operators/regex_parser.json' 2026-01-06T13:30:44,975 adding 'unitxt/catalog/operators/remove_articles.json' 2026-01-06T13:30:44,976 adding 'unitxt/catalog/operators/remove_none_from_list.json' 2026-01-06T13:30:44,978 adding 'unitxt/catalog/operators/remove_punctuations.json' 2026-01-06T13:30:44,979 adding 'unitxt/catalog/operators/scale_0_10_to_0_1.json' 2026-01-06T13:30:44,980 adding 'unitxt/catalog/operators/stance_to_pro_con.json' 2026-01-06T13:30:44,981 adding 'unitxt/catalog/operators/str_to_float_format.json' 2026-01-06T13:30:44,982 adding 'unitxt/catalog/operators/substring.json' 2026-01-06T13:30:44,983 adding 'unitxt/catalog/operators/take_first_non_empty_line.json' 2026-01-06T13:30:44,984 adding 'unitxt/catalog/operators/take_first_word.json' 2026-01-06T13:30:44,985 adding 'unitxt/catalog/operators/take_last_non_empty_line.json' 2026-01-06T13:30:44,986 adding 'unitxt/catalog/operators/to_yes_or_none.json' 2026-01-06T13:30:44,987 adding 'unitxt/catalog/operators/toxic_or_not_toxic.json' 2026-01-06T13:30:44,988 adding 'unitxt/catalog/operators/upper_case.json' 2026-01-06T13:30:44,989 adding 'unitxt/catalog/operators/yes_no_to_int.json' 2026-01-06T13:30:44,991 adding 'unitxt/catalog/operators/balancers/classification/by_label.json' 2026-01-06T13:30:44,992 adding 'unitxt/catalog/operators/balancers/classification/minimum_one_example_per_class.json' 2026-01-06T13:30:44,994 adding 'unitxt/catalog/operators/balancers/multi_label/zero_vs_many_labels.json' 2026-01-06T13:30:44,995 adding 'unitxt/catalog/operators/balancers/ner/zero_vs_many_entities.json' 2026-01-06T13:30:44,997 adding 'unitxt/catalog/operators/balancers/qa/by_answer.json' 2026-01-06T13:30:44,998 adding 'unitxt/catalog/operators/mt_bench/pairwise_hf_space_processing_steps.json' 2026-01-06T13:30:45,000 adding 'unitxt/catalog/operators/mt_bench/rating_hf_space_processing_steps.json' 2026-01-06T13:30:45,002 adding 'unitxt/catalog/processors/capitalize.json' 2026-01-06T13:30:45,003 adding 'unitxt/catalog/processors/cast_to_float_return_0_5_if_failed.json' 2026-01-06T13:30:45,004 adding 'unitxt/catalog/processors/cast_to_float_return_nan_if_failed.json' 2026-01-06T13:30:45,005 adding 'unitxt/catalog/processors/cast_to_float_return_zero_if_failed.json' 2026-01-06T13:30:45,007 adding 'unitxt/catalog/processors/convert_to_boolean.json' 2026-01-06T13:30:45,008 adding 'unitxt/catalog/processors/dict_of_lists_to_value_key_pairs.json' 2026-01-06T13:30:45,009 adding 'unitxt/catalog/processors/extract_arena_hard_numerical_judgment.json' 2026-01-06T13:30:45,010 adding 'unitxt/catalog/processors/extract_from_double_brackets.json' 2026-01-06T13:30:45,011 adding 'unitxt/catalog/processors/extract_harm_rating_judgment.json' 2026-01-06T13:30:45,012 adding 'unitxt/catalog/processors/extract_mt_bench_label_judgment.json' 2026-01-06T13:30:45,013 adding 'unitxt/catalog/processors/extract_mt_bench_rating_judgment.json' 2026-01-06T13:30:45,014 adding 'unitxt/catalog/processors/extract_verbal_judgement.json' 2026-01-06T13:30:45,016 adding 'unitxt/catalog/processors/extract_verbal_judgement_bad_good.json' 2026-01-06T13:30:45,017 adding 'unitxt/catalog/processors/first_character.json' 2026-01-06T13:30:45,018 adding 'unitxt/catalog/processors/fix_whitespace.json' 2026-01-06T13:30:45,019 adding 'unitxt/catalog/processors/get_string_after_colon.json' 2026-01-06T13:30:45,020 adding 'unitxt/catalog/processors/hate_speech_or_not_hate_speech.json' 2026-01-06T13:30:45,021 adding 'unitxt/catalog/processors/infer_last_token_logprobs_to_yes_no_probs.json' 2026-01-06T13:30:45,022 adding 'unitxt/catalog/processors/infer_logprobs_to_yes_no_probs.json' 2026-01-06T13:30:45,023 adding 'unitxt/catalog/processors/list_to_empty_entity_tuples.json' 2026-01-06T13:30:45,025 adding 'unitxt/catalog/processors/literal_eval.json' 2026-01-06T13:30:45,026 adding 'unitxt/catalog/processors/load_json.json' 2026-01-06T13:30:45,027 adding 'unitxt/catalog/processors/load_json_from_predictions.json' 2026-01-06T13:30:45,028 adding 'unitxt/catalog/processors/load_json_or_empty_tool_call.json' 2026-01-06T13:30:45,029 adding 'unitxt/catalog/processors/load_json_predictions.json' 2026-01-06T13:30:45,030 adding 'unitxt/catalog/processors/lower_case.json' 2026-01-06T13:30:45,031 adding 'unitxt/catalog/processors/lower_case_till_punc.json' 2026-01-06T13:30:45,032 adding 'unitxt/catalog/processors/match_closest_option.json' 2026-01-06T13:30:45,034 adding 'unitxt/catalog/processors/multi_tool_call.json' 2026-01-06T13:30:45,035 adding 'unitxt/catalog/processors/predictions_yes_1_else_0.json' 2026-01-06T13:30:45,036 adding 'unitxt/catalog/processors/regex_parser_from_prediction.json' 2026-01-06T13:30:45,037 adding 'unitxt/catalog/processors/remove_articles.json' 2026-01-06T13:30:45,038 adding 'unitxt/catalog/processors/remove_none_from_list.json' 2026-01-06T13:30:45,039 adding 'unitxt/catalog/processors/remove_punctuations.json' 2026-01-06T13:30:45,040 adding 'unitxt/catalog/processors/safe_unsafe.json' 2026-01-06T13:30:45,041 adding 'unitxt/catalog/processors/scale_0_10_to_0_1.json' 2026-01-06T13:30:45,042 adding 'unitxt/catalog/processors/stance_to_pro_con.json' 2026-01-06T13:30:45,043 adding 'unitxt/catalog/processors/str_to_float_format.json' 2026-01-06T13:30:45,044 adding 'unitxt/catalog/processors/substring.json' 2026-01-06T13:30:45,045 adding 'unitxt/catalog/processors/take_first_non_empty_line.json' 2026-01-06T13:30:45,046 adding 'unitxt/catalog/processors/take_first_word.json' 2026-01-06T13:30:45,047 adding 'unitxt/catalog/processors/take_last_non_empty_line.json' 2026-01-06T13:30:45,048 adding 'unitxt/catalog/processors/to_list_by_comma.json' 2026-01-06T13:30:45,049 adding 'unitxt/catalog/processors/to_list_by_comma_from_references.json' 2026-01-06T13:30:45,051 adding 'unitxt/catalog/processors/to_list_by_comma_space.json' 2026-01-06T13:30:45,052 adding 'unitxt/catalog/processors/to_list_by_hyphen_space.json' 2026-01-06T13:30:45,053 adding 'unitxt/catalog/processors/to_list_by_hyphen_space_from_references.json' 2026-01-06T13:30:45,054 adding 'unitxt/catalog/processors/to_span_label_pairs.json' 2026-01-06T13:30:45,055 adding 'unitxt/catalog/processors/to_span_label_pairs_surface_only.json' 2026-01-06T13:30:45,056 adding 'unitxt/catalog/processors/to_string.json' 2026-01-06T13:30:45,057 adding 'unitxt/catalog/processors/to_string_stripped.json' 2026-01-06T13:30:45,058 adding 'unitxt/catalog/processors/to_yes_or_none.json' 2026-01-06T13:30:45,059 adding 'unitxt/catalog/processors/toxic_or_not_toxic.json' 2026-01-06T13:30:45,060 adding 'unitxt/catalog/processors/upper_case.json' 2026-01-06T13:30:45,062 adding 'unitxt/catalog/processors/yes_no_to_int.json' 2026-01-06T13:30:45,063 adding 'unitxt/catalog/processors/text2sql/get_sql.json' 2026-01-06T13:30:45,066 adding 'unitxt/catalog/recipes/bluebench/bias/safety_bbq_age.json' 2026-01-06T13:30:45,067 adding 'unitxt/catalog/recipes/bluebench/bias/safety_bbq_disability_status.json' 2026-01-06T13:30:45,068 adding 'unitxt/catalog/recipes/bluebench/bias/safety_bbq_gender_identity.json' 2026-01-06T13:30:45,070 adding 'unitxt/catalog/recipes/bluebench/bias/safety_bbq_nationality.json' 2026-01-06T13:30:45,071 adding 'unitxt/catalog/recipes/bluebench/bias/safety_bbq_physical_appearance.json' 2026-01-06T13:30:45,072 adding 'unitxt/catalog/recipes/bluebench/bias/safety_bbq_race_ethnicity.json' 2026-01-06T13:30:45,073 adding 'unitxt/catalog/recipes/bluebench/bias/safety_bbq_race_x_gender.json' 2026-01-06T13:30:45,074 adding 'unitxt/catalog/recipes/bluebench/bias/safety_bbq_race_x_ses.json' 2026-01-06T13:30:45,075 adding 'unitxt/catalog/recipes/bluebench/bias/safety_bbq_religion.json' 2026-01-06T13:30:45,076 adding 'unitxt/catalog/recipes/bluebench/bias/safety_bbq_ses.json' 2026-01-06T13:30:45,078 adding 'unitxt/catalog/recipes/bluebench/bias/safety_bbq_sexual_orientation.json' 2026-01-06T13:30:45,079 adding 'unitxt/catalog/recipes/bluebench/chatbot_abilities/arena_hard_generation_english_gpt_4_0314_reference.json' 2026-01-06T13:30:45,081 adding 'unitxt/catalog/recipes/bluebench/entity_extraction/universal_ner_en_ewt.json' 2026-01-06T13:30:45,083 adding 'unitxt/catalog/recipes/bluebench/knowledge/mmlu_pro_biology.json' 2026-01-06T13:30:45,084 adding 'unitxt/catalog/recipes/bluebench/knowledge/mmlu_pro_business.json' 2026-01-06T13:30:45,085 adding 'unitxt/catalog/recipes/bluebench/knowledge/mmlu_pro_chemistry.json' 2026-01-06T13:30:45,086 adding 'unitxt/catalog/recipes/bluebench/knowledge/mmlu_pro_computer_science.json' 2026-01-06T13:30:45,088 adding 'unitxt/catalog/recipes/bluebench/knowledge/mmlu_pro_economics.json' 2026-01-06T13:30:45,089 adding 'unitxt/catalog/recipes/bluebench/knowledge/mmlu_pro_engineering.json' 2026-01-06T13:30:45,090 adding 'unitxt/catalog/recipes/bluebench/knowledge/mmlu_pro_health.json' 2026-01-06T13:30:45,091 adding 'unitxt/catalog/recipes/bluebench/knowledge/mmlu_pro_history.json' 2026-01-06T13:30:45,092 adding 'unitxt/catalog/recipes/bluebench/knowledge/mmlu_pro_law.json' 2026-01-06T13:30:45,093 adding 'unitxt/catalog/recipes/bluebench/knowledge/mmlu_pro_math.json' 2026-01-06T13:30:45,094 adding 'unitxt/catalog/recipes/bluebench/knowledge/mmlu_pro_other.json' 2026-01-06T13:30:45,095 adding 'unitxt/catalog/recipes/bluebench/knowledge/mmlu_pro_philosophy.json' 2026-01-06T13:30:45,096 adding 'unitxt/catalog/recipes/bluebench/knowledge/mmlu_pro_physics.json' 2026-01-06T13:30:45,097 adding 'unitxt/catalog/recipes/bluebench/knowledge/mmlu_pro_psychology.json' 2026-01-06T13:30:45,099 adding 'unitxt/catalog/recipes/bluebench/legal/legalbench_abercrombie.json' 2026-01-06T13:30:45,100 adding 'unitxt/catalog/recipes/bluebench/legal/legalbench_corporate_lobbying.json' 2026-01-06T13:30:45,101 adding 'unitxt/catalog/recipes/bluebench/legal/legalbench_function_of_decision_section.json' 2026-01-06T13:30:45,102 adding 'unitxt/catalog/recipes/bluebench/legal/legalbench_international_citizenship_questions.json' 2026-01-06T13:30:45,103 adding 'unitxt/catalog/recipes/bluebench/legal/legalbench_proa.json' 2026-01-06T13:30:45,105 adding 'unitxt/catalog/recipes/bluebench/news_classification/20_newsgroups_short.json' 2026-01-06T13:30:45,107 adding 'unitxt/catalog/recipes/bluebench/product_help/cfpb_product_2023.json' 2026-01-06T13:30:45,108 adding 'unitxt/catalog/recipes/bluebench/product_help/cfpb_product_watsonx.json' 2026-01-06T13:30:45,110 adding 'unitxt/catalog/recipes/bluebench/qa_finance/fin_qa.json' 2026-01-06T13:30:45,111 adding 'unitxt/catalog/recipes/bluebench/rag_general/rag_response_generation_clapnq.json' 2026-01-06T13:30:45,113 adding 'unitxt/catalog/recipes/bluebench/reasoning/hellaswag.json' 2026-01-06T13:30:45,114 adding 'unitxt/catalog/recipes/bluebench/reasoning/openbook_qa.json' 2026-01-06T13:30:45,115 adding 'unitxt/catalog/recipes/bluebench/safety/attaq_500.json' 2026-01-06T13:30:45,117 adding 'unitxt/catalog/recipes/bluebench/summarization/billsum_document_filtered_to_6000_chars.json' 2026-01-06T13:30:45,118 adding 'unitxt/catalog/recipes/bluebench/summarization/tldr_document_filtered_to_6000_chars.json' 2026-01-06T13:30:45,120 adding 'unitxt/catalog/recipes/bluebench/translation/mt_flores_101_ara_eng.json' 2026-01-06T13:30:45,121 adding 'unitxt/catalog/recipes/bluebench/translation/mt_flores_101_deu_eng.json' 2026-01-06T13:30:45,122 adding 'unitxt/catalog/recipes/bluebench/translation/mt_flores_101_eng_ara.json' 2026-01-06T13:30:45,123 adding 'unitxt/catalog/recipes/bluebench/translation/mt_flores_101_eng_deu.json' 2026-01-06T13:30:45,125 adding 'unitxt/catalog/recipes/bluebench/translation/mt_flores_101_eng_fra.json' 2026-01-06T13:30:45,126 adding 'unitxt/catalog/recipes/bluebench/translation/mt_flores_101_eng_kor.json' 2026-01-06T13:30:45,127 adding 'unitxt/catalog/recipes/bluebench/translation/mt_flores_101_eng_por.json' 2026-01-06T13:30:45,128 adding 'unitxt/catalog/recipes/bluebench/translation/mt_flores_101_eng_ron.json' 2026-01-06T13:30:45,129 adding 'unitxt/catalog/recipes/bluebench/translation/mt_flores_101_eng_spa.json' 2026-01-06T13:30:45,130 adding 'unitxt/catalog/recipes/bluebench/translation/mt_flores_101_fra_eng.json' 2026-01-06T13:30:45,131 adding 'unitxt/catalog/recipes/bluebench/translation/mt_flores_101_jpn_eng.json' 2026-01-06T13:30:45,133 adding 'unitxt/catalog/recipes/bluebench/translation/mt_flores_101_kor_eng.json' 2026-01-06T13:30:45,134 adding 'unitxt/catalog/recipes/bluebench/translation/mt_flores_101_por_eng.json' 2026-01-06T13:30:45,135 adding 'unitxt/catalog/recipes/bluebench/translation/mt_flores_101_ron_eng.json' 2026-01-06T13:30:45,136 adding 'unitxt/catalog/recipes/bluebench/translation/mt_flores_101_spa_eng.json' 2026-01-06T13:30:45,139 adding 'unitxt/catalog/recipes/torr/fin_qa/concat/insert_empty_rows_augmentation_5_demos.json' 2026-01-06T13:30:45,140 adding 'unitxt/catalog/recipes/torr/fin_qa/concat/no_augmentation_5_demos.json' 2026-01-06T13:30:45,141 adding 'unitxt/catalog/recipes/torr/fin_qa/concat/shuffle_cols_augmentation_5_demos.json' 2026-01-06T13:30:45,142 adding 'unitxt/catalog/recipes/torr/fin_qa/concat/shuffle_rows_augmentation_5_demos.json' 2026-01-06T13:30:45,143 adding 'unitxt/catalog/recipes/torr/fin_qa/concat/transpose_augmentation_5_demos.json' 2026-01-06T13:30:45,145 adding 'unitxt/catalog/recipes/torr/fin_qa/csv/insert_empty_rows_augmentation_5_demos.json' 2026-01-06T13:30:45,146 adding 'unitxt/catalog/recipes/torr/fin_qa/csv/no_augmentation_5_demos.json' 2026-01-06T13:30:45,147 adding 'unitxt/catalog/recipes/torr/fin_qa/csv/shuffle_cols_augmentation_5_demos.json' 2026-01-06T13:30:45,148 adding 'unitxt/catalog/recipes/torr/fin_qa/csv/shuffle_rows_augmentation_5_demos.json' 2026-01-06T13:30:45,149 adding 'unitxt/catalog/recipes/torr/fin_qa/csv/transpose_augmentation_5_demos.json' 2026-01-06T13:30:45,151 adding 'unitxt/catalog/recipes/torr/fin_qa/df/insert_empty_rows_augmentation_5_demos.json' 2026-01-06T13:30:45,152 adding 'unitxt/catalog/recipes/torr/fin_qa/df/no_augmentation_5_demos.json' 2026-01-06T13:30:45,153 adding 'unitxt/catalog/recipes/torr/fin_qa/df/shuffle_cols_augmentation_5_demos.json' 2026-01-06T13:30:45,154 adding 'unitxt/catalog/recipes/torr/fin_qa/df/shuffle_rows_augmentation_5_demos.json' 2026-01-06T13:30:45,155 adding 'unitxt/catalog/recipes/torr/fin_qa/df/transpose_augmentation_5_demos.json' 2026-01-06T13:30:45,157 adding 'unitxt/catalog/recipes/torr/fin_qa/html/insert_empty_rows_augmentation_5_demos.json' 2026-01-06T13:30:45,158 adding 'unitxt/catalog/recipes/torr/fin_qa/html/no_augmentation_5_demos.json' 2026-01-06T13:30:45,160 adding 'unitxt/catalog/recipes/torr/fin_qa/html/shuffle_cols_augmentation_5_demos.json' 2026-01-06T13:30:45,161 adding 'unitxt/catalog/recipes/torr/fin_qa/html/shuffle_rows_augmentation_5_demos.json' 2026-01-06T13:30:45,162 adding 'unitxt/catalog/recipes/torr/fin_qa/html/transpose_augmentation_5_demos.json' 2026-01-06T13:30:45,164 adding 'unitxt/catalog/recipes/torr/fin_qa/indexed_row_major/insert_empty_rows_augmentation_5_demos.json' 2026-01-06T13:30:45,165 adding 'unitxt/catalog/recipes/torr/fin_qa/indexed_row_major/no_augmentation_5_demos.json' 2026-01-06T13:30:45,166 adding 'unitxt/catalog/recipes/torr/fin_qa/indexed_row_major/shuffle_cols_augmentation_5_demos.json' 2026-01-06T13:30:45,167 adding 'unitxt/catalog/recipes/torr/fin_qa/indexed_row_major/shuffle_rows_augmentation_5_demos.json' 2026-01-06T13:30:45,168 adding 'unitxt/catalog/recipes/torr/fin_qa/indexed_row_major/transpose_augmentation_5_demos.json' 2026-01-06T13:30:45,170 adding 'unitxt/catalog/recipes/torr/fin_qa/json/insert_empty_rows_augmentation_5_demos.json' 2026-01-06T13:30:45,171 adding 'unitxt/catalog/recipes/torr/fin_qa/json/no_augmentation_5_demos.json' 2026-01-06T13:30:45,172 adding 'unitxt/catalog/recipes/torr/fin_qa/json/shuffle_cols_augmentation_5_demos.json' 2026-01-06T13:30:45,174 adding 'unitxt/catalog/recipes/torr/fin_qa/json/shuffle_rows_augmentation_5_demos.json' 2026-01-06T13:30:45,175 adding 'unitxt/catalog/recipes/torr/fin_qa/json/transpose_augmentation_5_demos.json' 2026-01-06T13:30:45,176 adding 'unitxt/catalog/recipes/torr/fin_qa/markdown/insert_empty_rows_augmentation_5_demos.json' 2026-01-06T13:30:45,178 adding 'unitxt/catalog/recipes/torr/fin_qa/markdown/no_augmentation_5_demos.json' 2026-01-06T13:30:45,179 adding 'unitxt/catalog/recipes/torr/fin_qa/markdown/shuffle_cols_augmentation_5_demos.json' 2026-01-06T13:30:45,180 adding 'unitxt/catalog/recipes/torr/fin_qa/markdown/shuffle_rows_augmentation_5_demos.json' 2026-01-06T13:30:45,181 adding 'unitxt/catalog/recipes/torr/fin_qa/markdown/transpose_augmentation_5_demos.json' 2026-01-06T13:30:45,183 adding 'unitxt/catalog/recipes/torr/numeric_nlg/concat/insert_empty_rows_augmentation_5_demos.json' 2026-01-06T13:30:45,184 adding 'unitxt/catalog/recipes/torr/numeric_nlg/concat/no_augmentation_5_demos.json' 2026-01-06T13:30:45,186 adding 'unitxt/catalog/recipes/torr/numeric_nlg/concat/shuffle_cols_augmentation_5_demos.json' 2026-01-06T13:30:45,187 adding 'unitxt/catalog/recipes/torr/numeric_nlg/concat/shuffle_rows_augmentation_5_demos.json' 2026-01-06T13:30:45,188 adding 'unitxt/catalog/recipes/torr/numeric_nlg/concat/transpose_augmentation_5_demos.json' 2026-01-06T13:30:45,189 adding 'unitxt/catalog/recipes/torr/numeric_nlg/csv/insert_empty_rows_augmentation_5_demos.json' 2026-01-06T13:30:45,190 adding 'unitxt/catalog/recipes/torr/numeric_nlg/csv/no_augmentation_5_demos.json' 2026-01-06T13:30:45,191 adding 'unitxt/catalog/recipes/torr/numeric_nlg/csv/shuffle_cols_augmentation_5_demos.json' 2026-01-06T13:30:45,193 adding 'unitxt/catalog/recipes/torr/numeric_nlg/csv/shuffle_rows_augmentation_5_demos.json' 2026-01-06T13:30:45,194 adding 'unitxt/catalog/recipes/torr/numeric_nlg/csv/transpose_augmentation_5_demos.json' 2026-01-06T13:30:45,195 adding 'unitxt/catalog/recipes/torr/numeric_nlg/df/insert_empty_rows_augmentation_5_demos.json' 2026-01-06T13:30:45,196 adding 'unitxt/catalog/recipes/torr/numeric_nlg/df/no_augmentation_5_demos.json' 2026-01-06T13:30:45,198 adding 'unitxt/catalog/recipes/torr/numeric_nlg/df/shuffle_cols_augmentation_5_demos.json' 2026-01-06T13:30:45,199 adding 'unitxt/catalog/recipes/torr/numeric_nlg/df/shuffle_rows_augmentation_5_demos.json' 2026-01-06T13:30:45,200 adding 'unitxt/catalog/recipes/torr/numeric_nlg/df/transpose_augmentation_5_demos.json' 2026-01-06T13:30:45,201 adding 'unitxt/catalog/recipes/torr/numeric_nlg/html/insert_empty_rows_augmentation_5_demos.json' 2026-01-06T13:30:45,203 adding 'unitxt/catalog/recipes/torr/numeric_nlg/html/no_augmentation_5_demos.json' 2026-01-06T13:30:45,204 adding 'unitxt/catalog/recipes/torr/numeric_nlg/html/shuffle_cols_augmentation_5_demos.json' 2026-01-06T13:30:45,205 adding 'unitxt/catalog/recipes/torr/numeric_nlg/html/shuffle_rows_augmentation_5_demos.json' 2026-01-06T13:30:45,206 adding 'unitxt/catalog/recipes/torr/numeric_nlg/html/transpose_augmentation_5_demos.json' 2026-01-06T13:30:45,208 adding 'unitxt/catalog/recipes/torr/numeric_nlg/indexed_row_major/insert_empty_rows_augmentation_5_demos.json' 2026-01-06T13:30:45,209 adding 'unitxt/catalog/recipes/torr/numeric_nlg/indexed_row_major/no_augmentation_5_demos.json' 2026-01-06T13:30:45,210 adding 'unitxt/catalog/recipes/torr/numeric_nlg/indexed_row_major/shuffle_cols_augmentation_5_demos.json' 2026-01-06T13:30:45,211 adding 'unitxt/catalog/recipes/torr/numeric_nlg/indexed_row_major/shuffle_rows_augmentation_5_demos.json' 2026-01-06T13:30:45,212 adding 'unitxt/catalog/recipes/torr/numeric_nlg/indexed_row_major/transpose_augmentation_5_demos.json' 2026-01-06T13:30:45,214 adding 'unitxt/catalog/recipes/torr/numeric_nlg/json/insert_empty_rows_augmentation_5_demos.json' 2026-01-06T13:30:45,215 adding 'unitxt/catalog/recipes/torr/numeric_nlg/json/no_augmentation_5_demos.json' 2026-01-06T13:30:45,216 adding 'unitxt/catalog/recipes/torr/numeric_nlg/json/shuffle_cols_augmentation_5_demos.json' 2026-01-06T13:30:45,217 adding 'unitxt/catalog/recipes/torr/numeric_nlg/json/shuffle_rows_augmentation_5_demos.json' 2026-01-06T13:30:45,219 adding 'unitxt/catalog/recipes/torr/numeric_nlg/json/transpose_augmentation_5_demos.json' 2026-01-06T13:30:45,220 adding 'unitxt/catalog/recipes/torr/numeric_nlg/markdown/insert_empty_rows_augmentation_5_demos.json' 2026-01-06T13:30:45,221 adding 'unitxt/catalog/recipes/torr/numeric_nlg/markdown/no_augmentation_5_demos.json' 2026-01-06T13:30:45,223 adding 'unitxt/catalog/recipes/torr/numeric_nlg/markdown/shuffle_cols_augmentation_5_demos.json' 2026-01-06T13:30:45,224 adding 'unitxt/catalog/recipes/torr/numeric_nlg/markdown/shuffle_rows_augmentation_5_demos.json' 2026-01-06T13:30:45,225 adding 'unitxt/catalog/recipes/torr/numeric_nlg/markdown/transpose_augmentation_5_demos.json' 2026-01-06T13:30:45,227 adding 'unitxt/catalog/recipes/torr/qtsumm/concat/insert_empty_rows_augmentation_5_demos.json' 2026-01-06T13:30:45,228 adding 'unitxt/catalog/recipes/torr/qtsumm/concat/no_augmentation_5_demos.json' 2026-01-06T13:30:45,229 adding 'unitxt/catalog/recipes/torr/qtsumm/concat/shuffle_cols_augmentation_5_demos.json' 2026-01-06T13:30:45,230 adding 'unitxt/catalog/recipes/torr/qtsumm/concat/shuffle_rows_augmentation_5_demos.json' 2026-01-06T13:30:45,231 adding 'unitxt/catalog/recipes/torr/qtsumm/concat/transpose_augmentation_5_demos.json' 2026-01-06T13:30:45,233 adding 'unitxt/catalog/recipes/torr/qtsumm/csv/insert_empty_rows_augmentation_5_demos.json' 2026-01-06T13:30:45,234 adding 'unitxt/catalog/recipes/torr/qtsumm/csv/no_augmentation_5_demos.json' 2026-01-06T13:30:45,235 adding 'unitxt/catalog/recipes/torr/qtsumm/csv/shuffle_cols_augmentation_5_demos.json' 2026-01-06T13:30:45,236 adding 'unitxt/catalog/recipes/torr/qtsumm/csv/shuffle_rows_augmentation_5_demos.json' 2026-01-06T13:30:45,237 adding 'unitxt/catalog/recipes/torr/qtsumm/csv/transpose_augmentation_5_demos.json' 2026-01-06T13:30:45,239 adding 'unitxt/catalog/recipes/torr/qtsumm/df/insert_empty_rows_augmentation_5_demos.json' 2026-01-06T13:30:45,240 adding 'unitxt/catalog/recipes/torr/qtsumm/df/no_augmentation_5_demos.json' 2026-01-06T13:30:45,241 adding 'unitxt/catalog/recipes/torr/qtsumm/df/shuffle_cols_augmentation_5_demos.json' 2026-01-06T13:30:45,242 adding 'unitxt/catalog/recipes/torr/qtsumm/df/shuffle_rows_augmentation_5_demos.json' 2026-01-06T13:30:45,243 adding 'unitxt/catalog/recipes/torr/qtsumm/df/transpose_augmentation_5_demos.json' 2026-01-06T13:30:45,245 adding 'unitxt/catalog/recipes/torr/qtsumm/html/insert_empty_rows_augmentation_5_demos.json' 2026-01-06T13:30:45,246 adding 'unitxt/catalog/recipes/torr/qtsumm/html/no_augmentation_5_demos.json' 2026-01-06T13:30:45,247 adding 'unitxt/catalog/recipes/torr/qtsumm/html/shuffle_cols_augmentation_5_demos.json' 2026-01-06T13:30:45,249 adding 'unitxt/catalog/recipes/torr/qtsumm/html/shuffle_rows_augmentation_5_demos.json' 2026-01-06T13:30:45,250 adding 'unitxt/catalog/recipes/torr/qtsumm/html/transpose_augmentation_5_demos.json' 2026-01-06T13:30:45,251 adding 'unitxt/catalog/recipes/torr/qtsumm/indexed_row_major/insert_empty_rows_augmentation_5_demos.json' 2026-01-06T13:30:45,253 adding 'unitxt/catalog/recipes/torr/qtsumm/indexed_row_major/no_augmentation_5_demos.json' 2026-01-06T13:30:45,254 adding 'unitxt/catalog/recipes/torr/qtsumm/indexed_row_major/shuffle_cols_augmentation_5_demos.json' 2026-01-06T13:30:45,255 adding 'unitxt/catalog/recipes/torr/qtsumm/indexed_row_major/shuffle_rows_augmentation_5_demos.json' 2026-01-06T13:30:45,256 adding 'unitxt/catalog/recipes/torr/qtsumm/indexed_row_major/transpose_augmentation_5_demos.json' 2026-01-06T13:30:45,258 adding 'unitxt/catalog/recipes/torr/qtsumm/json/insert_empty_rows_augmentation_5_demos.json' 2026-01-06T13:30:45,259 adding 'unitxt/catalog/recipes/torr/qtsumm/json/no_augmentation_5_demos.json' 2026-01-06T13:30:45,260 adding 'unitxt/catalog/recipes/torr/qtsumm/json/shuffle_cols_augmentation_5_demos.json' 2026-01-06T13:30:45,261 adding 'unitxt/catalog/recipes/torr/qtsumm/json/shuffle_rows_augmentation_5_demos.json' 2026-01-06T13:30:45,262 adding 'unitxt/catalog/recipes/torr/qtsumm/json/transpose_augmentation_5_demos.json' 2026-01-06T13:30:45,264 adding 'unitxt/catalog/recipes/torr/qtsumm/markdown/insert_empty_rows_augmentation_5_demos.json' 2026-01-06T13:30:45,265 adding 'unitxt/catalog/recipes/torr/qtsumm/markdown/no_augmentation_5_demos.json' 2026-01-06T13:30:45,266 adding 'unitxt/catalog/recipes/torr/qtsumm/markdown/shuffle_cols_augmentation_5_demos.json' 2026-01-06T13:30:45,268 adding 'unitxt/catalog/recipes/torr/qtsumm/markdown/shuffle_rows_augmentation_5_demos.json' 2026-01-06T13:30:45,269 adding 'unitxt/catalog/recipes/torr/qtsumm/markdown/transpose_augmentation_5_demos.json' 2026-01-06T13:30:45,271 adding 'unitxt/catalog/recipes/torr/scigen/concat/insert_empty_rows_augmentation_5_demos.json' 2026-01-06T13:30:45,272 adding 'unitxt/catalog/recipes/torr/scigen/concat/no_augmentation_5_demos.json' 2026-01-06T13:30:45,273 adding 'unitxt/catalog/recipes/torr/scigen/concat/shuffle_cols_augmentation_5_demos.json' 2026-01-06T13:30:45,274 adding 'unitxt/catalog/recipes/torr/scigen/concat/shuffle_rows_augmentation_5_demos.json' 2026-01-06T13:30:45,275 adding 'unitxt/catalog/recipes/torr/scigen/concat/transpose_augmentation_5_demos.json' 2026-01-06T13:30:45,277 adding 'unitxt/catalog/recipes/torr/scigen/csv/insert_empty_rows_augmentation_5_demos.json' 2026-01-06T13:30:45,278 adding 'unitxt/catalog/recipes/torr/scigen/csv/no_augmentation_5_demos.json' 2026-01-06T13:30:45,279 adding 'unitxt/catalog/recipes/torr/scigen/csv/shuffle_cols_augmentation_5_demos.json' 2026-01-06T13:30:45,280 adding 'unitxt/catalog/recipes/torr/scigen/csv/shuffle_rows_augmentation_5_demos.json' 2026-01-06T13:30:45,281 adding 'unitxt/catalog/recipes/torr/scigen/csv/transpose_augmentation_5_demos.json' 2026-01-06T13:30:45,283 adding 'unitxt/catalog/recipes/torr/scigen/df/insert_empty_rows_augmentation_5_demos.json' 2026-01-06T13:30:45,284 adding 'unitxt/catalog/recipes/torr/scigen/df/no_augmentation_5_demos.json' 2026-01-06T13:30:45,285 adding 'unitxt/catalog/recipes/torr/scigen/df/shuffle_cols_augmentation_5_demos.json' 2026-01-06T13:30:45,286 adding 'unitxt/catalog/recipes/torr/scigen/df/shuffle_rows_augmentation_5_demos.json' 2026-01-06T13:30:45,287 adding 'unitxt/catalog/recipes/torr/scigen/df/transpose_augmentation_5_demos.json' 2026-01-06T13:30:45,289 adding 'unitxt/catalog/recipes/torr/scigen/html/insert_empty_rows_augmentation_5_demos.json' 2026-01-06T13:30:45,290 adding 'unitxt/catalog/recipes/torr/scigen/html/no_augmentation_5_demos.json' 2026-01-06T13:30:45,291 adding 'unitxt/catalog/recipes/torr/scigen/html/shuffle_cols_augmentation_5_demos.json' 2026-01-06T13:30:45,292 adding 'unitxt/catalog/recipes/torr/scigen/html/shuffle_rows_augmentation_5_demos.json' 2026-01-06T13:30:45,294 adding 'unitxt/catalog/recipes/torr/scigen/html/transpose_augmentation_5_demos.json' 2026-01-06T13:30:45,295 adding 'unitxt/catalog/recipes/torr/scigen/indexed_row_major/insert_empty_rows_augmentation_5_demos.json' 2026-01-06T13:30:45,296 adding 'unitxt/catalog/recipes/torr/scigen/indexed_row_major/no_augmentation_5_demos.json' 2026-01-06T13:30:45,298 adding 'unitxt/catalog/recipes/torr/scigen/indexed_row_major/shuffle_cols_augmentation_5_demos.json' 2026-01-06T13:30:45,299 adding 'unitxt/catalog/recipes/torr/scigen/indexed_row_major/shuffle_rows_augmentation_5_demos.json' 2026-01-06T13:30:45,300 adding 'unitxt/catalog/recipes/torr/scigen/indexed_row_major/transpose_augmentation_5_demos.json' 2026-01-06T13:30:45,302 adding 'unitxt/catalog/recipes/torr/scigen/json/insert_empty_rows_augmentation_5_demos.json' 2026-01-06T13:30:45,303 adding 'unitxt/catalog/recipes/torr/scigen/json/no_augmentation_5_demos.json' 2026-01-06T13:30:45,304 adding 'unitxt/catalog/recipes/torr/scigen/json/shuffle_cols_augmentation_5_demos.json' 2026-01-06T13:30:45,305 adding 'unitxt/catalog/recipes/torr/scigen/json/shuffle_rows_augmentation_5_demos.json' 2026-01-06T13:30:45,306 adding 'unitxt/catalog/recipes/torr/scigen/json/transpose_augmentation_5_demos.json' 2026-01-06T13:30:45,308 adding 'unitxt/catalog/recipes/torr/scigen/markdown/insert_empty_rows_augmentation_5_demos.json' 2026-01-06T13:30:45,310 adding 'unitxt/catalog/recipes/torr/scigen/markdown/no_augmentation_5_demos.json' 2026-01-06T13:30:45,311 adding 'unitxt/catalog/recipes/torr/scigen/markdown/shuffle_cols_augmentation_5_demos.json' 2026-01-06T13:30:45,312 adding 'unitxt/catalog/recipes/torr/scigen/markdown/shuffle_rows_augmentation_5_demos.json' 2026-01-06T13:30:45,313 adding 'unitxt/catalog/recipes/torr/scigen/markdown/transpose_augmentation_5_demos.json' 2026-01-06T13:30:45,315 adding 'unitxt/catalog/recipes/torr/tab_fact/concat/insert_empty_rows_augmentation_5_demos.json' 2026-01-06T13:30:45,316 adding 'unitxt/catalog/recipes/torr/tab_fact/concat/no_augmentation_5_demos.json' 2026-01-06T13:30:45,318 adding 'unitxt/catalog/recipes/torr/tab_fact/concat/shuffle_cols_augmentation_5_demos.json' 2026-01-06T13:30:45,319 adding 'unitxt/catalog/recipes/torr/tab_fact/concat/shuffle_rows_augmentation_5_demos.json' 2026-01-06T13:30:45,320 adding 'unitxt/catalog/recipes/torr/tab_fact/concat/transpose_augmentation_5_demos.json' 2026-01-06T13:30:45,321 adding 'unitxt/catalog/recipes/torr/tab_fact/csv/insert_empty_rows_augmentation_5_demos.json' 2026-01-06T13:30:45,322 adding 'unitxt/catalog/recipes/torr/tab_fact/csv/no_augmentation_5_demos.json' 2026-01-06T13:30:45,323 adding 'unitxt/catalog/recipes/torr/tab_fact/csv/shuffle_cols_augmentation_5_demos.json' 2026-01-06T13:30:45,324 adding 'unitxt/catalog/recipes/torr/tab_fact/csv/shuffle_rows_augmentation_5_demos.json' 2026-01-06T13:30:45,325 adding 'unitxt/catalog/recipes/torr/tab_fact/csv/transpose_augmentation_5_demos.json' 2026-01-06T13:30:45,327 adding 'unitxt/catalog/recipes/torr/tab_fact/df/insert_empty_rows_augmentation_5_demos.json' 2026-01-06T13:30:45,328 adding 'unitxt/catalog/recipes/torr/tab_fact/df/no_augmentation_5_demos.json' 2026-01-06T13:30:45,329 adding 'unitxt/catalog/recipes/torr/tab_fact/df/shuffle_cols_augmentation_5_demos.json' 2026-01-06T13:30:45,330 adding 'unitxt/catalog/recipes/torr/tab_fact/df/shuffle_rows_augmentation_5_demos.json' 2026-01-06T13:30:45,332 adding 'unitxt/catalog/recipes/torr/tab_fact/df/transpose_augmentation_5_demos.json' 2026-01-06T13:30:45,333 adding 'unitxt/catalog/recipes/torr/tab_fact/html/insert_empty_rows_augmentation_5_demos.json' 2026-01-06T13:30:45,334 adding 'unitxt/catalog/recipes/torr/tab_fact/html/no_augmentation_5_demos.json' 2026-01-06T13:30:45,336 adding 'unitxt/catalog/recipes/torr/tab_fact/html/shuffle_cols_augmentation_5_demos.json' 2026-01-06T13:30:45,337 adding 'unitxt/catalog/recipes/torr/tab_fact/html/shuffle_rows_augmentation_5_demos.json' 2026-01-06T13:30:45,338 adding 'unitxt/catalog/recipes/torr/tab_fact/html/transpose_augmentation_5_demos.json' 2026-01-06T13:30:45,340 adding 'unitxt/catalog/recipes/torr/tab_fact/indexed_row_major/insert_empty_rows_augmentation_5_demos.json' 2026-01-06T13:30:45,341 adding 'unitxt/catalog/recipes/torr/tab_fact/indexed_row_major/no_augmentation_5_demos.json' 2026-01-06T13:30:45,342 adding 'unitxt/catalog/recipes/torr/tab_fact/indexed_row_major/shuffle_cols_augmentation_5_demos.json' 2026-01-06T13:30:45,343 adding 'unitxt/catalog/recipes/torr/tab_fact/indexed_row_major/shuffle_rows_augmentation_5_demos.json' 2026-01-06T13:30:45,344 adding 'unitxt/catalog/recipes/torr/tab_fact/indexed_row_major/transpose_augmentation_5_demos.json' 2026-01-06T13:30:45,346 adding 'unitxt/catalog/recipes/torr/tab_fact/json/insert_empty_rows_augmentation_5_demos.json' 2026-01-06T13:30:45,347 adding 'unitxt/catalog/recipes/torr/tab_fact/json/no_augmentation_5_demos.json' 2026-01-06T13:30:45,348 adding 'unitxt/catalog/recipes/torr/tab_fact/json/shuffle_cols_augmentation_5_demos.json' 2026-01-06T13:30:45,349 adding 'unitxt/catalog/recipes/torr/tab_fact/json/shuffle_rows_augmentation_5_demos.json' 2026-01-06T13:30:45,350 adding 'unitxt/catalog/recipes/torr/tab_fact/json/transpose_augmentation_5_demos.json' 2026-01-06T13:30:45,352 adding 'unitxt/catalog/recipes/torr/tab_fact/markdown/insert_empty_rows_augmentation_5_demos.json' 2026-01-06T13:30:45,353 adding 'unitxt/catalog/recipes/torr/tab_fact/markdown/no_augmentation_5_demos.json' 2026-01-06T13:30:45,355 adding 'unitxt/catalog/recipes/torr/tab_fact/markdown/shuffle_cols_augmentation_5_demos.json' 2026-01-06T13:30:45,356 adding 'unitxt/catalog/recipes/torr/tab_fact/markdown/shuffle_rows_augmentation_5_demos.json' 2026-01-06T13:30:45,357 adding 'unitxt/catalog/recipes/torr/tab_fact/markdown/transpose_augmentation_5_demos.json' 2026-01-06T13:30:45,359 adding 'unitxt/catalog/recipes/torr/tablebench_data_analysis/concat/insert_empty_rows_augmentation_5_demos.json' 2026-01-06T13:30:45,360 adding 'unitxt/catalog/recipes/torr/tablebench_data_analysis/concat/no_augmentation_5_demos.json' 2026-01-06T13:30:45,362 adding 'unitxt/catalog/recipes/torr/tablebench_data_analysis/concat/shuffle_cols_augmentation_5_demos.json' 2026-01-06T13:30:45,363 adding 'unitxt/catalog/recipes/torr/tablebench_data_analysis/concat/shuffle_rows_augmentation_5_demos.json' 2026-01-06T13:30:45,364 adding 'unitxt/catalog/recipes/torr/tablebench_data_analysis/concat/transpose_augmentation_5_demos.json' 2026-01-06T13:30:45,365 adding 'unitxt/catalog/recipes/torr/tablebench_data_analysis/csv/insert_empty_rows_augmentation_5_demos.json' 2026-01-06T13:30:45,366 adding 'unitxt/catalog/recipes/torr/tablebench_data_analysis/csv/no_augmentation_5_demos.json' 2026-01-06T13:30:45,367 adding 'unitxt/catalog/recipes/torr/tablebench_data_analysis/csv/shuffle_cols_augmentation_5_demos.json' 2026-01-06T13:30:45,368 adding 'unitxt/catalog/recipes/torr/tablebench_data_analysis/csv/shuffle_rows_augmentation_5_demos.json' 2026-01-06T13:30:45,370 adding 'unitxt/catalog/recipes/torr/tablebench_data_analysis/csv/transpose_augmentation_5_demos.json' 2026-01-06T13:30:45,371 adding 'unitxt/catalog/recipes/torr/tablebench_data_analysis/df/insert_empty_rows_augmentation_5_demos.json' 2026-01-06T13:30:45,372 adding 'unitxt/catalog/recipes/torr/tablebench_data_analysis/df/no_augmentation_5_demos.json' 2026-01-06T13:30:45,373 adding 'unitxt/catalog/recipes/torr/tablebench_data_analysis/df/shuffle_cols_augmentation_5_demos.json' 2026-01-06T13:30:45,374 adding 'unitxt/catalog/recipes/torr/tablebench_data_analysis/df/shuffle_rows_augmentation_5_demos.json' 2026-01-06T13:30:45,376 adding 'unitxt/catalog/recipes/torr/tablebench_data_analysis/df/transpose_augmentation_5_demos.json' 2026-01-06T13:30:45,377 adding 'unitxt/catalog/recipes/torr/tablebench_data_analysis/html/insert_empty_rows_augmentation_5_demos.json' 2026-01-06T13:30:45,379 adding 'unitxt/catalog/recipes/torr/tablebench_data_analysis/html/no_augmentation_5_demos.json' 2026-01-06T13:30:45,380 adding 'unitxt/catalog/recipes/torr/tablebench_data_analysis/html/shuffle_cols_augmentation_5_demos.json' 2026-01-06T13:30:45,381 adding 'unitxt/catalog/recipes/torr/tablebench_data_analysis/html/shuffle_rows_augmentation_5_demos.json' 2026-01-06T13:30:45,382 adding 'unitxt/catalog/recipes/torr/tablebench_data_analysis/html/transpose_augmentation_5_demos.json' 2026-01-06T13:30:45,384 adding 'unitxt/catalog/recipes/torr/tablebench_data_analysis/indexed_row_major/insert_empty_rows_augmentation_5_demos.json' 2026-01-06T13:30:45,385 adding 'unitxt/catalog/recipes/torr/tablebench_data_analysis/indexed_row_major/no_augmentation_5_demos.json' 2026-01-06T13:30:45,386 adding 'unitxt/catalog/recipes/torr/tablebench_data_analysis/indexed_row_major/shuffle_cols_augmentation_5_demos.json' 2026-01-06T13:30:45,387 adding 'unitxt/catalog/recipes/torr/tablebench_data_analysis/indexed_row_major/shuffle_rows_augmentation_5_demos.json' 2026-01-06T13:30:45,389 adding 'unitxt/catalog/recipes/torr/tablebench_data_analysis/indexed_row_major/transpose_augmentation_5_demos.json' 2026-01-06T13:30:45,390 adding 'unitxt/catalog/recipes/torr/tablebench_data_analysis/json/insert_empty_rows_augmentation_5_demos.json' 2026-01-06T13:30:45,391 adding 'unitxt/catalog/recipes/torr/tablebench_data_analysis/json/no_augmentation_5_demos.json' 2026-01-06T13:30:45,393 adding 'unitxt/catalog/recipes/torr/tablebench_data_analysis/json/shuffle_cols_augmentation_5_demos.json' 2026-01-06T13:30:45,394 adding 'unitxt/catalog/recipes/torr/tablebench_data_analysis/json/shuffle_rows_augmentation_5_demos.json' 2026-01-06T13:30:45,395 adding 'unitxt/catalog/recipes/torr/tablebench_data_analysis/json/transpose_augmentation_5_demos.json' 2026-01-06T13:30:45,397 adding 'unitxt/catalog/recipes/torr/tablebench_data_analysis/markdown/insert_empty_rows_augmentation_5_demos.json' 2026-01-06T13:30:45,398 adding 'unitxt/catalog/recipes/torr/tablebench_data_analysis/markdown/no_augmentation_5_demos.json' 2026-01-06T13:30:45,399 adding 'unitxt/catalog/recipes/torr/tablebench_data_analysis/markdown/shuffle_cols_augmentation_5_demos.json' 2026-01-06T13:30:45,401 adding 'unitxt/catalog/recipes/torr/tablebench_data_analysis/markdown/shuffle_rows_augmentation_5_demos.json' 2026-01-06T13:30:45,402 adding 'unitxt/catalog/recipes/torr/tablebench_data_analysis/markdown/transpose_augmentation_5_demos.json' 2026-01-06T13:30:45,404 adding 'unitxt/catalog/recipes/torr/tablebench_fact_checking/concat/insert_empty_rows_augmentation_5_demos.json' 2026-01-06T13:30:45,405 adding 'unitxt/catalog/recipes/torr/tablebench_fact_checking/concat/no_augmentation_5_demos.json' 2026-01-06T13:30:45,406 adding 'unitxt/catalog/recipes/torr/tablebench_fact_checking/concat/shuffle_cols_augmentation_5_demos.json' 2026-01-06T13:30:45,407 adding 'unitxt/catalog/recipes/torr/tablebench_fact_checking/concat/shuffle_rows_augmentation_5_demos.json' 2026-01-06T13:30:45,408 adding 'unitxt/catalog/recipes/torr/tablebench_fact_checking/concat/transpose_augmentation_5_demos.json' 2026-01-06T13:30:45,410 adding 'unitxt/catalog/recipes/torr/tablebench_fact_checking/csv/insert_empty_rows_augmentation_5_demos.json' 2026-01-06T13:30:45,411 adding 'unitxt/catalog/recipes/torr/tablebench_fact_checking/csv/no_augmentation_5_demos.json' 2026-01-06T13:30:45,412 adding 'unitxt/catalog/recipes/torr/tablebench_fact_checking/csv/shuffle_cols_augmentation_5_demos.json' 2026-01-06T13:30:45,413 adding 'unitxt/catalog/recipes/torr/tablebench_fact_checking/csv/shuffle_rows_augmentation_5_demos.json' 2026-01-06T13:30:45,414 adding 'unitxt/catalog/recipes/torr/tablebench_fact_checking/csv/transpose_augmentation_5_demos.json' 2026-01-06T13:30:45,416 adding 'unitxt/catalog/recipes/torr/tablebench_fact_checking/df/insert_empty_rows_augmentation_5_demos.json' 2026-01-06T13:30:45,417 adding 'unitxt/catalog/recipes/torr/tablebench_fact_checking/df/no_augmentation_5_demos.json' 2026-01-06T13:30:45,418 adding 'unitxt/catalog/recipes/torr/tablebench_fact_checking/df/shuffle_cols_augmentation_5_demos.json' 2026-01-06T13:30:45,419 adding 'unitxt/catalog/recipes/torr/tablebench_fact_checking/df/shuffle_rows_augmentation_5_demos.json' 2026-01-06T13:30:45,421 adding 'unitxt/catalog/recipes/torr/tablebench_fact_checking/df/transpose_augmentation_5_demos.json' 2026-01-06T13:30:45,422 adding 'unitxt/catalog/recipes/torr/tablebench_fact_checking/html/insert_empty_rows_augmentation_5_demos.json' 2026-01-06T13:30:45,423 adding 'unitxt/catalog/recipes/torr/tablebench_fact_checking/html/no_augmentation_5_demos.json' 2026-01-06T13:30:45,425 adding 'unitxt/catalog/recipes/torr/tablebench_fact_checking/html/shuffle_cols_augmentation_5_demos.json' 2026-01-06T13:30:45,426 adding 'unitxt/catalog/recipes/torr/tablebench_fact_checking/html/shuffle_rows_augmentation_5_demos.json' 2026-01-06T13:30:45,427 adding 'unitxt/catalog/recipes/torr/tablebench_fact_checking/html/transpose_augmentation_5_demos.json' 2026-01-06T13:30:45,429 adding 'unitxt/catalog/recipes/torr/tablebench_fact_checking/indexed_row_major/insert_empty_rows_augmentation_5_demos.json' 2026-01-06T13:30:45,430 adding 'unitxt/catalog/recipes/torr/tablebench_fact_checking/indexed_row_major/no_augmentation_5_demos.json' 2026-01-06T13:30:45,431 adding 'unitxt/catalog/recipes/torr/tablebench_fact_checking/indexed_row_major/shuffle_cols_augmentation_5_demos.json' 2026-01-06T13:30:45,432 adding 'unitxt/catalog/recipes/torr/tablebench_fact_checking/indexed_row_major/shuffle_rows_augmentation_5_demos.json' 2026-01-06T13:30:45,433 adding 'unitxt/catalog/recipes/torr/tablebench_fact_checking/indexed_row_major/transpose_augmentation_5_demos.json' 2026-01-06T13:30:45,435 adding 'unitxt/catalog/recipes/torr/tablebench_fact_checking/json/insert_empty_rows_augmentation_5_demos.json' 2026-01-06T13:30:45,436 adding 'unitxt/catalog/recipes/torr/tablebench_fact_checking/json/no_augmentation_5_demos.json' 2026-01-06T13:30:45,437 adding 'unitxt/catalog/recipes/torr/tablebench_fact_checking/json/shuffle_cols_augmentation_5_demos.json' 2026-01-06T13:30:45,439 adding 'unitxt/catalog/recipes/torr/tablebench_fact_checking/json/shuffle_rows_augmentation_5_demos.json' 2026-01-06T13:30:45,440 adding 'unitxt/catalog/recipes/torr/tablebench_fact_checking/json/transpose_augmentation_5_demos.json' 2026-01-06T13:30:45,441 adding 'unitxt/catalog/recipes/torr/tablebench_fact_checking/markdown/insert_empty_rows_augmentation_5_demos.json' 2026-01-06T13:30:45,442 adding 'unitxt/catalog/recipes/torr/tablebench_fact_checking/markdown/no_augmentation_5_demos.json' 2026-01-06T13:30:45,443 adding 'unitxt/catalog/recipes/torr/tablebench_fact_checking/markdown/shuffle_cols_augmentation_5_demos.json' 2026-01-06T13:30:45,445 adding 'unitxt/catalog/recipes/torr/tablebench_fact_checking/markdown/shuffle_rows_augmentation_5_demos.json' 2026-01-06T13:30:45,446 adding 'unitxt/catalog/recipes/torr/tablebench_fact_checking/markdown/transpose_augmentation_5_demos.json' 2026-01-06T13:30:45,448 adding 'unitxt/catalog/recipes/torr/tablebench_numerical_reasoning/concat/insert_empty_rows_augmentation_5_demos.json' 2026-01-06T13:30:45,449 adding 'unitxt/catalog/recipes/torr/tablebench_numerical_reasoning/concat/no_augmentation_5_demos.json' 2026-01-06T13:30:45,450 adding 'unitxt/catalog/recipes/torr/tablebench_numerical_reasoning/concat/shuffle_cols_augmentation_5_demos.json' 2026-01-06T13:30:45,451 adding 'unitxt/catalog/recipes/torr/tablebench_numerical_reasoning/concat/shuffle_rows_augmentation_5_demos.json' 2026-01-06T13:30:45,452 adding 'unitxt/catalog/recipes/torr/tablebench_numerical_reasoning/concat/transpose_augmentation_5_demos.json' 2026-01-06T13:30:45,454 adding 'unitxt/catalog/recipes/torr/tablebench_numerical_reasoning/csv/insert_empty_rows_augmentation_5_demos.json' 2026-01-06T13:30:45,455 adding 'unitxt/catalog/recipes/torr/tablebench_numerical_reasoning/csv/no_augmentation_5_demos.json' 2026-01-06T13:30:45,456 adding 'unitxt/catalog/recipes/torr/tablebench_numerical_reasoning/csv/shuffle_cols_augmentation_5_demos.json' 2026-01-06T13:30:45,458 adding 'unitxt/catalog/recipes/torr/tablebench_numerical_reasoning/csv/shuffle_rows_augmentation_5_demos.json' 2026-01-06T13:30:45,459 adding 'unitxt/catalog/recipes/torr/tablebench_numerical_reasoning/csv/transpose_augmentation_5_demos.json' 2026-01-06T13:30:45,461 adding 'unitxt/catalog/recipes/torr/tablebench_numerical_reasoning/df/insert_empty_rows_augmentation_5_demos.json' 2026-01-06T13:30:45,462 adding 'unitxt/catalog/recipes/torr/tablebench_numerical_reasoning/df/no_augmentation_5_demos.json' 2026-01-06T13:30:45,463 adding 'unitxt/catalog/recipes/torr/tablebench_numerical_reasoning/df/shuffle_cols_augmentation_5_demos.json' 2026-01-06T13:30:45,464 adding 'unitxt/catalog/recipes/torr/tablebench_numerical_reasoning/df/shuffle_rows_augmentation_5_demos.json' 2026-01-06T13:30:45,465 adding 'unitxt/catalog/recipes/torr/tablebench_numerical_reasoning/df/transpose_augmentation_5_demos.json' 2026-01-06T13:30:45,467 adding 'unitxt/catalog/recipes/torr/tablebench_numerical_reasoning/html/insert_empty_rows_augmentation_5_demos.json' 2026-01-06T13:30:45,468 adding 'unitxt/catalog/recipes/torr/tablebench_numerical_reasoning/html/no_augmentation_5_demos.json' 2026-01-06T13:30:45,469 adding 'unitxt/catalog/recipes/torr/tablebench_numerical_reasoning/html/shuffle_cols_augmentation_5_demos.json' 2026-01-06T13:30:45,470 adding 'unitxt/catalog/recipes/torr/tablebench_numerical_reasoning/html/shuffle_rows_augmentation_5_demos.json' 2026-01-06T13:30:45,471 adding 'unitxt/catalog/recipes/torr/tablebench_numerical_reasoning/html/transpose_augmentation_5_demos.json' 2026-01-06T13:30:45,473 adding 'unitxt/catalog/recipes/torr/tablebench_numerical_reasoning/indexed_row_major/insert_empty_rows_augmentation_5_demos.json' 2026-01-06T13:30:45,474 adding 'unitxt/catalog/recipes/torr/tablebench_numerical_reasoning/indexed_row_major/no_augmentation_5_demos.json' 2026-01-06T13:30:45,475 adding 'unitxt/catalog/recipes/torr/tablebench_numerical_reasoning/indexed_row_major/shuffle_cols_augmentation_5_demos.json' 2026-01-06T13:30:45,476 adding 'unitxt/catalog/recipes/torr/tablebench_numerical_reasoning/indexed_row_major/shuffle_rows_augmentation_5_demos.json' 2026-01-06T13:30:45,478 adding 'unitxt/catalog/recipes/torr/tablebench_numerical_reasoning/indexed_row_major/transpose_augmentation_5_demos.json' 2026-01-06T13:30:45,479 adding 'unitxt/catalog/recipes/torr/tablebench_numerical_reasoning/json/insert_empty_rows_augmentation_5_demos.json' 2026-01-06T13:30:45,480 adding 'unitxt/catalog/recipes/torr/tablebench_numerical_reasoning/json/no_augmentation_5_demos.json' 2026-01-06T13:30:45,481 adding 'unitxt/catalog/recipes/torr/tablebench_numerical_reasoning/json/shuffle_cols_augmentation_5_demos.json' 2026-01-06T13:30:45,483 adding 'unitxt/catalog/recipes/torr/tablebench_numerical_reasoning/json/shuffle_rows_augmentation_5_demos.json' 2026-01-06T13:30:45,484 adding 'unitxt/catalog/recipes/torr/tablebench_numerical_reasoning/json/transpose_augmentation_5_demos.json' 2026-01-06T13:30:45,485 adding 'unitxt/catalog/recipes/torr/tablebench_numerical_reasoning/markdown/insert_empty_rows_augmentation_5_demos.json' 2026-01-06T13:30:45,486 adding 'unitxt/catalog/recipes/torr/tablebench_numerical_reasoning/markdown/no_augmentation_5_demos.json' 2026-01-06T13:30:45,488 adding 'unitxt/catalog/recipes/torr/tablebench_numerical_reasoning/markdown/shuffle_cols_augmentation_5_demos.json' 2026-01-06T13:30:45,489 adding 'unitxt/catalog/recipes/torr/tablebench_numerical_reasoning/markdown/shuffle_rows_augmentation_5_demos.json' 2026-01-06T13:30:45,490 adding 'unitxt/catalog/recipes/torr/tablebench_numerical_reasoning/markdown/transpose_augmentation_5_demos.json' 2026-01-06T13:30:45,492 adding 'unitxt/catalog/recipes/torr/turl_col_type/concat/insert_empty_rows_augmentation_5_demos.json' 2026-01-06T13:30:45,493 adding 'unitxt/catalog/recipes/torr/turl_col_type/concat/no_augmentation_5_demos.json' 2026-01-06T13:30:45,495 adding 'unitxt/catalog/recipes/torr/turl_col_type/concat/shuffle_cols_augmentation_5_demos.json' 2026-01-06T13:30:45,496 adding 'unitxt/catalog/recipes/torr/turl_col_type/concat/shuffle_rows_augmentation_5_demos.json' 2026-01-06T13:30:45,497 adding 'unitxt/catalog/recipes/torr/turl_col_type/concat/transpose_augmentation_5_demos.json' 2026-01-06T13:30:45,499 adding 'unitxt/catalog/recipes/torr/turl_col_type/csv/insert_empty_rows_augmentation_5_demos.json' 2026-01-06T13:30:45,500 adding 'unitxt/catalog/recipes/torr/turl_col_type/csv/no_augmentation_5_demos.json' 2026-01-06T13:30:45,501 adding 'unitxt/catalog/recipes/torr/turl_col_type/csv/shuffle_cols_augmentation_5_demos.json' 2026-01-06T13:30:45,502 adding 'unitxt/catalog/recipes/torr/turl_col_type/csv/shuffle_rows_augmentation_5_demos.json' 2026-01-06T13:30:45,503 adding 'unitxt/catalog/recipes/torr/turl_col_type/csv/transpose_augmentation_5_demos.json' 2026-01-06T13:30:45,505 adding 'unitxt/catalog/recipes/torr/turl_col_type/df/insert_empty_rows_augmentation_5_demos.json' 2026-01-06T13:30:45,506 adding 'unitxt/catalog/recipes/torr/turl_col_type/df/no_augmentation_5_demos.json' 2026-01-06T13:30:45,507 adding 'unitxt/catalog/recipes/torr/turl_col_type/df/shuffle_cols_augmentation_5_demos.json' 2026-01-06T13:30:45,509 adding 'unitxt/catalog/recipes/torr/turl_col_type/df/shuffle_rows_augmentation_5_demos.json' 2026-01-06T13:30:45,510 adding 'unitxt/catalog/recipes/torr/turl_col_type/df/transpose_augmentation_5_demos.json' 2026-01-06T13:30:45,511 adding 'unitxt/catalog/recipes/torr/turl_col_type/html/insert_empty_rows_augmentation_5_demos.json' 2026-01-06T13:30:45,513 adding 'unitxt/catalog/recipes/torr/turl_col_type/html/no_augmentation_5_demos.json' 2026-01-06T13:30:45,514 adding 'unitxt/catalog/recipes/torr/turl_col_type/html/shuffle_cols_augmentation_5_demos.json' 2026-01-06T13:30:45,515 adding 'unitxt/catalog/recipes/torr/turl_col_type/html/shuffle_rows_augmentation_5_demos.json' 2026-01-06T13:30:45,516 adding 'unitxt/catalog/recipes/torr/turl_col_type/html/transpose_augmentation_5_demos.json' 2026-01-06T13:30:45,518 adding 'unitxt/catalog/recipes/torr/turl_col_type/indexed_row_major/insert_empty_rows_augmentation_5_demos.json' 2026-01-06T13:30:45,519 adding 'unitxt/catalog/recipes/torr/turl_col_type/indexed_row_major/no_augmentation_5_demos.json' 2026-01-06T13:30:45,520 adding 'unitxt/catalog/recipes/torr/turl_col_type/indexed_row_major/shuffle_cols_augmentation_5_demos.json' 2026-01-06T13:30:45,521 adding 'unitxt/catalog/recipes/torr/turl_col_type/indexed_row_major/shuffle_rows_augmentation_5_demos.json' 2026-01-06T13:30:45,522 adding 'unitxt/catalog/recipes/torr/turl_col_type/indexed_row_major/transpose_augmentation_5_demos.json' 2026-01-06T13:30:45,524 adding 'unitxt/catalog/recipes/torr/turl_col_type/json/insert_empty_rows_augmentation_5_demos.json' 2026-01-06T13:30:45,525 adding 'unitxt/catalog/recipes/torr/turl_col_type/json/no_augmentation_5_demos.json' 2026-01-06T13:30:45,526 adding 'unitxt/catalog/recipes/torr/turl_col_type/json/shuffle_cols_augmentation_5_demos.json' 2026-01-06T13:30:45,527 adding 'unitxt/catalog/recipes/torr/turl_col_type/json/shuffle_rows_augmentation_5_demos.json' 2026-01-06T13:30:45,528 adding 'unitxt/catalog/recipes/torr/turl_col_type/json/transpose_augmentation_5_demos.json' 2026-01-06T13:30:45,530 adding 'unitxt/catalog/recipes/torr/turl_col_type/markdown/insert_empty_rows_augmentation_5_demos.json' 2026-01-06T13:30:45,531 adding 'unitxt/catalog/recipes/torr/turl_col_type/markdown/no_augmentation_5_demos.json' 2026-01-06T13:30:45,532 adding 'unitxt/catalog/recipes/torr/turl_col_type/markdown/shuffle_cols_augmentation_5_demos.json' 2026-01-06T13:30:45,533 adding 'unitxt/catalog/recipes/torr/turl_col_type/markdown/shuffle_rows_augmentation_5_demos.json' 2026-01-06T13:30:45,535 adding 'unitxt/catalog/recipes/torr/turl_col_type/markdown/transpose_augmentation_5_demos.json' 2026-01-06T13:30:45,537 adding 'unitxt/catalog/recipes/torr/wikitq/concat/insert_empty_rows_augmentation_1_demos.json' 2026-01-06T13:30:45,538 adding 'unitxt/catalog/recipes/torr/wikitq/concat/no_augmentation_1_demos.json' 2026-01-06T13:30:45,539 adding 'unitxt/catalog/recipes/torr/wikitq/concat/shuffle_cols_augmentation_1_demos.json' 2026-01-06T13:30:45,540 adding 'unitxt/catalog/recipes/torr/wikitq/concat/shuffle_rows_augmentation_1_demos.json' 2026-01-06T13:30:45,542 adding 'unitxt/catalog/recipes/torr/wikitq/concat/transpose_augmentation_1_demos.json' 2026-01-06T13:30:45,543 adding 'unitxt/catalog/recipes/torr/wikitq/csv/insert_empty_rows_augmentation_1_demos.json' 2026-01-06T13:30:45,545 adding 'unitxt/catalog/recipes/torr/wikitq/csv/no_augmentation_1_demos.json' 2026-01-06T13:30:45,546 adding 'unitxt/catalog/recipes/torr/wikitq/csv/shuffle_cols_augmentation_1_demos.json' 2026-01-06T13:30:45,547 adding 'unitxt/catalog/recipes/torr/wikitq/csv/shuffle_rows_augmentation_1_demos.json' 2026-01-06T13:30:45,548 adding 'unitxt/catalog/recipes/torr/wikitq/csv/transpose_augmentation_1_demos.json' 2026-01-06T13:30:45,550 adding 'unitxt/catalog/recipes/torr/wikitq/df/insert_empty_rows_augmentation_1_demos.json' 2026-01-06T13:30:45,551 adding 'unitxt/catalog/recipes/torr/wikitq/df/no_augmentation_1_demos.json' 2026-01-06T13:30:45,553 adding 'unitxt/catalog/recipes/torr/wikitq/df/shuffle_cols_augmentation_1_demos.json' 2026-01-06T13:30:45,554 adding 'unitxt/catalog/recipes/torr/wikitq/df/shuffle_rows_augmentation_1_demos.json' 2026-01-06T13:30:45,555 adding 'unitxt/catalog/recipes/torr/wikitq/df/transpose_augmentation_1_demos.json' 2026-01-06T13:30:45,557 adding 'unitxt/catalog/recipes/torr/wikitq/html/insert_empty_rows_augmentation_1_demos.json' 2026-01-06T13:30:45,559 adding 'unitxt/catalog/recipes/torr/wikitq/html/no_augmentation_1_demos.json' 2026-01-06T13:30:45,560 adding 'unitxt/catalog/recipes/torr/wikitq/html/shuffle_cols_augmentation_1_demos.json' 2026-01-06T13:30:45,561 adding 'unitxt/catalog/recipes/torr/wikitq/html/shuffle_rows_augmentation_1_demos.json' 2026-01-06T13:30:45,562 adding 'unitxt/catalog/recipes/torr/wikitq/html/transpose_augmentation_1_demos.json' 2026-01-06T13:30:45,564 adding 'unitxt/catalog/recipes/torr/wikitq/indexed_row_major/insert_empty_rows_augmentation_1_demos.json' 2026-01-06T13:30:45,565 adding 'unitxt/catalog/recipes/torr/wikitq/indexed_row_major/no_augmentation_1_demos.json' 2026-01-06T13:30:45,566 adding 'unitxt/catalog/recipes/torr/wikitq/indexed_row_major/shuffle_cols_augmentation_1_demos.json' 2026-01-06T13:30:45,568 adding 'unitxt/catalog/recipes/torr/wikitq/indexed_row_major/shuffle_rows_augmentation_1_demos.json' 2026-01-06T13:30:45,569 adding 'unitxt/catalog/recipes/torr/wikitq/indexed_row_major/transpose_augmentation_1_demos.json' 2026-01-06T13:30:45,570 adding 'unitxt/catalog/recipes/torr/wikitq/json/insert_empty_rows_augmentation_1_demos.json' 2026-01-06T13:30:45,571 adding 'unitxt/catalog/recipes/torr/wikitq/json/no_augmentation_1_demos.json' 2026-01-06T13:30:45,572 adding 'unitxt/catalog/recipes/torr/wikitq/json/shuffle_cols_augmentation_1_demos.json' 2026-01-06T13:30:45,574 adding 'unitxt/catalog/recipes/torr/wikitq/json/shuffle_rows_augmentation_1_demos.json' 2026-01-06T13:30:45,575 adding 'unitxt/catalog/recipes/torr/wikitq/json/transpose_augmentation_1_demos.json' 2026-01-06T13:30:45,576 adding 'unitxt/catalog/recipes/torr/wikitq/markdown/insert_empty_rows_augmentation_1_demos.json' 2026-01-06T13:30:45,577 adding 'unitxt/catalog/recipes/torr/wikitq/markdown/no_augmentation_1_demos.json' 2026-01-06T13:30:45,579 adding 'unitxt/catalog/recipes/torr/wikitq/markdown/shuffle_cols_augmentation_1_demos.json' 2026-01-06T13:30:45,580 adding 'unitxt/catalog/recipes/torr/wikitq/markdown/shuffle_rows_augmentation_1_demos.json' 2026-01-06T13:30:45,581 adding 'unitxt/catalog/recipes/torr/wikitq/markdown/transpose_augmentation_1_demos.json' 2026-01-06T13:30:45,583 adding 'unitxt/catalog/serializers/table/concat.json' 2026-01-06T13:30:45,584 adding 'unitxt/catalog/serializers/table/df.json' 2026-01-06T13:30:45,585 adding 'unitxt/catalog/serializers/table/html.json' 2026-01-06T13:30:45,586 adding 'unitxt/catalog/serializers/table/image.json' 2026-01-06T13:30:45,587 adding 'unitxt/catalog/serializers/table/indexed_row_major.json' 2026-01-06T13:30:45,588 adding 'unitxt/catalog/serializers/table/json.json' 2026-01-06T13:30:45,589 adding 'unitxt/catalog/serializers/table/markdown.json' 2026-01-06T13:30:45,591 adding 'unitxt/catalog/serializers/text2sql/schema.json' 2026-01-06T13:30:45,593 adding 'unitxt/catalog/splitters/diverse_labels_sampler.json' 2026-01-06T13:30:45,594 adding 'unitxt/catalog/splitters/large_no_dev.json' 2026-01-06T13:30:45,595 adding 'unitxt/catalog/splitters/large_no_test.json' 2026-01-06T13:30:45,596 adding 'unitxt/catalog/splitters/small_no_dev.json' 2026-01-06T13:30:45,597 adding 'unitxt/catalog/splitters/small_no_test.json' 2026-01-06T13:30:45,599 adding 'unitxt/catalog/splitters/test_only.json' 2026-01-06T13:30:45,600 adding 'unitxt/catalog/system_prompts/boolqa.json' 2026-01-06T13:30:45,601 adding 'unitxt/catalog/system_prompts/empty.json' 2026-01-06T13:30:45,603 adding 'unitxt/catalog/system_prompts/general/be_concise.json' 2026-01-06T13:30:45,605 adding 'unitxt/catalog/system_prompts/model/granite.json' 2026-01-06T13:30:45,606 adding 'unitxt/catalog/system_prompts/models/alpaca.json' 2026-01-06T13:30:45,607 adding 'unitxt/catalog/system_prompts/models/deepseek_coder.json' 2026-01-06T13:30:45,609 adding 'unitxt/catalog/system_prompts/models/japanese_llama.json' 2026-01-06T13:30:45,610 adding 'unitxt/catalog/system_prompts/models/labradorite.json' 2026-01-06T13:30:45,611 adding 'unitxt/catalog/system_prompts/models/llama.json' 2026-01-06T13:30:45,612 adding 'unitxt/catalog/system_prompts/models/llama2.json' 2026-01-06T13:30:45,613 adding 'unitxt/catalog/system_prompts/models/llava_next_llama3_8b.json' 2026-01-06T13:30:45,615 adding 'unitxt/catalog/tasks/generation.json' 2026-01-06T13:30:45,617 adding 'unitxt/catalog/tasks/grammatical_error_correction.json' 2026-01-06T13:30:45,618 adding 'unitxt/catalog/tasks/key_value_extraction.json' 2026-01-06T13:30:45,619 adding 'unitxt/catalog/tasks/language_identification.json' 2026-01-06T13:30:45,620 adding 'unitxt/catalog/tasks/schema_linking.json' 2026-01-06T13:30:45,621 adding 'unitxt/catalog/tasks/text2sql.json' 2026-01-06T13:30:45,622 adding 'unitxt/catalog/tasks/text2sql_logic.json' 2026-01-06T13:30:45,624 adding 'unitxt/catalog/tasks/classification/binary.json' 2026-01-06T13:30:45,625 adding 'unitxt/catalog/tasks/classification/multi_class.json' 2026-01-06T13:30:45,626 adding 'unitxt/catalog/tasks/classification/multi_label.json' 2026-01-06T13:30:45,628 adding 'unitxt/catalog/tasks/classification/binary/zero_or_one.json' 2026-01-06T13:30:45,629 adding 'unitxt/catalog/tasks/classification/multi_class/relation.json' 2026-01-06T13:30:45,630 adding 'unitxt/catalog/tasks/classification/multi_class/topic_classification.json' 2026-01-06T13:30:45,632 adding 'unitxt/catalog/tasks/classification/multi_class/with_classes_descriptions.json' 2026-01-06T13:30:45,633 adding 'unitxt/catalog/tasks/completion/abstractive.json' 2026-01-06T13:30:45,634 adding 'unitxt/catalog/tasks/completion/extractive.json' 2026-01-06T13:30:45,635 adding 'unitxt/catalog/tasks/completion/multiple_choice.json' 2026-01-06T13:30:45,637 adding 'unitxt/catalog/tasks/evaluation/preference.json' 2026-01-06T13:30:45,639 adding 'unitxt/catalog/tasks/generation/from_pair.json' 2026-01-06T13:30:45,640 adding 'unitxt/catalog/tasks/ner/all_entity_types.json' 2026-01-06T13:30:45,641 adding 'unitxt/catalog/tasks/ner/single_entity_type.json' 2026-01-06T13:30:45,643 adding 'unitxt/catalog/tasks/qa/extractive.json' 2026-01-06T13:30:45,644 adding 'unitxt/catalog/tasks/qa/open.json' 2026-01-06T13:30:45,645 adding 'unitxt/catalog/tasks/qa/with_context.json' 2026-01-06T13:30:45,647 adding 'unitxt/catalog/tasks/qa/extractive/multi_turn.json' 2026-01-06T13:30:45,649 adding 'unitxt/catalog/tasks/qa/multiple_choice/open.json' 2026-01-06T13:30:45,650 adding 'unitxt/catalog/tasks/qa/multiple_choice/with_context.json' 2026-01-06T13:30:45,651 adding 'unitxt/catalog/tasks/qa/multiple_choice/with_topic.json' 2026-01-06T13:30:45,653 adding 'unitxt/catalog/tasks/qa/multiple_choice/with_context/with_topic.json' 2026-01-06T13:30:45,654 adding 'unitxt/catalog/tasks/qa/with_context/abstractive.json' 2026-01-06T13:30:45,655 adding 'unitxt/catalog/tasks/qa/with_context/extractive.json' 2026-01-06T13:30:45,657 adding 'unitxt/catalog/tasks/qa/with_context/with_domain.json' 2026-01-06T13:30:45,658 adding 'unitxt/catalog/tasks/qa/with_context/with_type.json' 2026-01-06T13:30:45,659 adding 'unitxt/catalog/tasks/rag/corpora.json' 2026-01-06T13:30:45,661 adding 'unitxt/catalog/tasks/rag/end_to_end.json' 2026-01-06T13:30:45,662 adding 'unitxt/catalog/tasks/rag/response_generation.json' 2026-01-06T13:30:45,664 adding 'unitxt/catalog/tasks/rag_eval/answer_correctness/binary.json' 2026-01-06T13:30:45,665 adding 'unitxt/catalog/tasks/rag_eval/answer_correctness/non_binary.json' 2026-01-06T13:30:45,667 adding 'unitxt/catalog/tasks/rag_eval/answer_relevance/binary.json' 2026-01-06T13:30:45,668 adding 'unitxt/catalog/tasks/rag_eval/answer_relevance/non_binary.json' 2026-01-06T13:30:45,670 adding 'unitxt/catalog/tasks/rag_eval/context_relevance/binary.json' 2026-01-06T13:30:45,671 adding 'unitxt/catalog/tasks/rag_eval/context_relevance/non_binary.json' 2026-01-06T13:30:45,673 adding 'unitxt/catalog/tasks/rag_eval/correctness_holistic/binary.json' 2026-01-06T13:30:45,674 adding 'unitxt/catalog/tasks/rag_eval/correctness_holistic/non_binary.json' 2026-01-06T13:30:45,676 adding 'unitxt/catalog/tasks/rag_eval/faithfulness/binary.json' 2026-01-06T13:30:45,677 adding 'unitxt/catalog/tasks/rag_eval/faithfulness/non_binary.json' 2026-01-06T13:30:45,679 adding 'unitxt/catalog/tasks/regression/single_text.json' 2026-01-06T13:30:45,680 adding 'unitxt/catalog/tasks/regression/two_texts.json' 2026-01-06T13:30:45,682 adding 'unitxt/catalog/tasks/regression/two_texts/similarity.json' 2026-01-06T13:30:45,684 adding 'unitxt/catalog/tasks/response_assessment/pairwise_comparative_rating/single_turn.json' 2026-01-06T13:30:45,686 adding 'unitxt/catalog/tasks/response_assessment/pairwise_comparison/multi_turn.json' 2026-01-06T13:30:45,687 adding 'unitxt/catalog/tasks/response_assessment/pairwise_comparison/multi_turn_with_reference.json' 2026-01-06T13:30:45,688 adding 'unitxt/catalog/tasks/response_assessment/pairwise_comparison/single_turn.json' 2026-01-06T13:30:45,689 adding 'unitxt/catalog/tasks/response_assessment/pairwise_comparison/single_turn_with_reference.json' 2026-01-06T13:30:45,690 adding 'unitxt/catalog/tasks/response_assessment/rating/multi_turn.json' 2026-01-06T13:30:45,692 adding 'unitxt/catalog/tasks/response_assessment/rating/multi_turn_with_reference.json' 2026-01-06T13:30:45,693 adding 'unitxt/catalog/tasks/response_assessment/rating/single_turn.json' 2026-01-06T13:30:45,694 adding 'unitxt/catalog/tasks/response_assessment/rating/single_turn_with_reference.json' 2026-01-06T13:30:45,695 adding 'unitxt/catalog/tasks/rewriting/by_attribute.json' 2026-01-06T13:30:45,696 adding 'unitxt/catalog/tasks/rewriting/paraphrase.json' 2026-01-06T13:30:45,698 adding 'unitxt/catalog/tasks/selection/by_attribute.json' 2026-01-06T13:30:45,700 adding 'unitxt/catalog/tasks/span_labeling/extraction.json' 2026-01-06T13:30:45,701 adding 'unitxt/catalog/tasks/summarization/abstractive.json' 2026-01-06T13:30:45,703 adding 'unitxt/catalog/tasks/targeted_sentiment_extraction/all_sentiment_classes.json' 2026-01-06T13:30:45,704 adding 'unitxt/catalog/tasks/targeted_sentiment_extraction/single_sentiment_class.json' 2026-01-06T13:30:45,706 adding 'unitxt/catalog/tasks/tool_calling/multi_turn.json' 2026-01-06T13:30:45,707 adding 'unitxt/catalog/tasks/tool_calling/supervised.json' 2026-01-06T13:30:45,709 adding 'unitxt/catalog/tasks/translation/directed.json' 2026-01-06T13:30:45,711 adding 'unitxt/catalog/templates/empty.json' 2026-01-06T13:30:45,712 adding 'unitxt/catalog/templates/key_val.json' 2026-01-06T13:30:45,713 adding 'unitxt/catalog/templates/key_val_with_new_lines.json' 2026-01-06T13:30:45,715 adding 'unitxt/catalog/templates/classification/multi_class/all.json' 2026-01-06T13:30:45,716 adding 'unitxt/catalog/templates/classification/multi_class/bluebench.json' 2026-01-06T13:30:45,718 adding 'unitxt/catalog/templates/classification/multi_class/default.json' 2026-01-06T13:30:45,719 adding 'unitxt/catalog/templates/classification/multi_class/empty.json' 2026-01-06T13:30:45,720 adding 'unitxt/catalog/templates/classification/multi_class/instruct_question_select_i_think.json' 2026-01-06T13:30:45,721 adding 'unitxt/catalog/templates/classification/multi_class/instruct_question_selects.json' 2026-01-06T13:30:45,722 adding 'unitxt/catalog/templates/classification/multi_class/instruct_select_question.json' 2026-01-06T13:30:45,723 adding 'unitxt/catalog/templates/classification/multi_class/instruction.json' 2026-01-06T13:30:45,724 adding 'unitxt/catalog/templates/classification/multi_class/title.json' 2026-01-06T13:30:45,726 adding 'unitxt/catalog/templates/classification/multi_class/relation/all.json' 2026-01-06T13:30:45,727 adding 'unitxt/catalog/templates/classification/multi_class/relation/default.json' 2026-01-06T13:30:45,728 adding 'unitxt/catalog/templates/classification/multi_class/relation/simple.json' 2026-01-06T13:30:45,730 adding 'unitxt/catalog/templates/classification/multi_class/relation/truthfulness/all.json' 2026-01-06T13:30:45,731 adding 'unitxt/catalog/templates/classification/multi_class/relation/truthfulness/flan_1.json' 2026-01-06T13:30:45,733 adding 'unitxt/catalog/templates/classification/multi_class/relation/truthfulness/flan_2.json' 2026-01-06T13:30:45,734 adding 'unitxt/catalog/templates/classification/multi_class/relation/truthfulness/flan_3.json' 2026-01-06T13:30:45,735 adding 'unitxt/catalog/templates/classification/multi_class/relation/truthfulness/flan_4.json' 2026-01-06T13:30:45,736 adding 'unitxt/catalog/templates/classification/multi_class/relation/truthfulness/flan_5.json' 2026-01-06T13:30:45,737 adding 'unitxt/catalog/templates/classification/multi_class/relation/truthfulness/flan_6.json' 2026-01-06T13:30:45,738 adding 'unitxt/catalog/templates/classification/multi_class/relation/truthfulness/flan_7.json' 2026-01-06T13:30:45,740 adding 'unitxt/catalog/templates/classification/multi_label/all.json' 2026-01-06T13:30:45,741 adding 'unitxt/catalog/templates/classification/multi_label/default.json' 2026-01-06T13:30:45,742 adding 'unitxt/catalog/templates/classification/multi_label/empty.json' 2026-01-06T13:30:45,743 adding 'unitxt/catalog/templates/classification/multi_label/instruction.json' 2026-01-06T13:30:45,744 adding 'unitxt/catalog/templates/classification/multi_label/title.json' 2026-01-06T13:30:45,746 adding 'unitxt/catalog/templates/completion/abstractive/all.json' 2026-01-06T13:30:45,747 adding 'unitxt/catalog/templates/completion/abstractive/empty.json' 2026-01-06T13:30:45,748 adding 'unitxt/catalog/templates/completion/abstractive/standard.json' 2026-01-06T13:30:45,750 adding 'unitxt/catalog/templates/completion/multiple_choice/all.json' 2026-01-06T13:30:45,751 adding 'unitxt/catalog/templates/completion/multiple_choice/bluebench.json' 2026-01-06T13:30:45,752 adding 'unitxt/catalog/templates/completion/multiple_choice/enumerated.json' 2026-01-06T13:30:45,753 adding 'unitxt/catalog/templates/completion/multiple_choice/simple.json' 2026-01-06T13:30:45,754 adding 'unitxt/catalog/templates/completion/multiple_choice/standard.json' 2026-01-06T13:30:45,755 adding 'unitxt/catalog/templates/completion/multiple_choice/title.json' 2026-01-06T13:30:45,757 adding 'unitxt/catalog/templates/evaluation/preference/all.json' 2026-01-06T13:30:45,758 adding 'unitxt/catalog/templates/evaluation/preference/default.json' 2026-01-06T13:30:45,760 adding 'unitxt/catalog/templates/generation/all.json' 2026-01-06T13:30:45,761 adding 'unitxt/catalog/templates/generation/default.json' 2026-01-06T13:30:45,762 adding 'unitxt/catalog/templates/generation/empty.json' 2026-01-06T13:30:45,764 adding 'unitxt/catalog/templates/generation/from_pair/all.json' 2026-01-06T13:30:45,765 adding 'unitxt/catalog/templates/generation/from_pair/default.json' 2026-01-06T13:30:45,767 adding 'unitxt/catalog/templates/grammatical_error_correction/all.json' 2026-01-06T13:30:45,768 adding 'unitxt/catalog/templates/grammatical_error_correction/simple.json' 2026-01-06T13:30:45,770 adding 'unitxt/catalog/templates/grammatical_error_detection/all.json' 2026-01-06T13:30:45,771 adding 'unitxt/catalog/templates/grammatical_error_detection/yes_no.json' 2026-01-06T13:30:45,773 adding 'unitxt/catalog/templates/key_value_extraction/extract_in_json_format.json' 2026-01-06T13:30:45,774 adding 'unitxt/catalog/templates/language_identification/all.json' 2026-01-06T13:30:45,775 adding 'unitxt/catalog/templates/language_identification/simple.json' 2026-01-06T13:30:45,777 adding 'unitxt/catalog/templates/qa/extractive.json' 2026-01-06T13:30:45,778 adding 'unitxt/catalog/templates/qa/open.json' 2026-01-06T13:30:45,780 adding 'unitxt/catalog/templates/qa/with_context.json' 2026-01-06T13:30:45,782 adding 'unitxt/catalog/templates/qa/llama_vision/multiple_choice/with_context/ai2d.json' 2026-01-06T13:30:45,784 adding 'unitxt/catalog/templates/qa/llama_vision/with_context/chart_qa.json' 2026-01-06T13:30:45,785 adding 'unitxt/catalog/templates/qa/llama_vision/with_context/doc_vqa.json' 2026-01-06T13:30:45,786 adding 'unitxt/catalog/templates/qa/llama_vision/with_context/info_vqa.json' 2026-01-06T13:30:45,788 adding 'unitxt/catalog/templates/qa/multi_turn/with_context/simple.json' 2026-01-06T13:30:45,790 adding 'unitxt/catalog/templates/qa/multiple_choice/helm.json' 2026-01-06T13:30:45,791 adding 'unitxt/catalog/templates/qa/multiple_choice/lm_eval_harness.json' 2026-01-06T13:30:45,792 adding 'unitxt/catalog/templates/qa/multiple_choice/match.json' 2026-01-06T13:30:45,793 adding 'unitxt/catalog/templates/qa/multiple_choice/title.json' 2026-01-06T13:30:45,795 adding 'unitxt/catalog/templates/qa/multiple_choice/open/all.json' 2026-01-06T13:30:45,797 adding 'unitxt/catalog/templates/qa/multiple_choice/open/bluebench.json' 2026-01-06T13:30:45,798 adding 'unitxt/catalog/templates/qa/multiple_choice/open/helm.json' 2026-01-06T13:30:45,799 adding 'unitxt/catalog/templates/qa/multiple_choice/open/lm_eval_harness.json' 2026-01-06T13:30:45,800 adding 'unitxt/catalog/templates/qa/multiple_choice/open/mmlu.json' 2026-01-06T13:30:45,801 adding 'unitxt/catalog/templates/qa/multiple_choice/open/de/all.json' 2026-01-06T13:30:45,802 adding 'unitxt/catalog/templates/qa/multiple_choice/open/de/helm.json' 2026-01-06T13:30:45,804 adding 'unitxt/catalog/templates/qa/multiple_choice/open/de/lm_eval_harness.json' 2026-01-06T13:30:45,805 adding 'unitxt/catalog/templates/qa/multiple_choice/open/de/mmlu.json' 2026-01-06T13:30:45,806 adding 'unitxt/catalog/templates/qa/multiple_choice/open/es/all.json' 2026-01-06T13:30:45,807 adding 'unitxt/catalog/templates/qa/multiple_choice/open/es/helm.json' 2026-01-06T13:30:45,808 adding 'unitxt/catalog/templates/qa/multiple_choice/open/es/lm_eval_harness.json' 2026-01-06T13:30:45,810 adding 'unitxt/catalog/templates/qa/multiple_choice/open/es/mmlu.json' 2026-01-06T13:30:45,811 adding 'unitxt/catalog/templates/qa/multiple_choice/open/fr/all.json' 2026-01-06T13:30:45,812 adding 'unitxt/catalog/templates/qa/multiple_choice/open/fr/helm.json' 2026-01-06T13:30:45,813 adding 'unitxt/catalog/templates/qa/multiple_choice/open/fr/lm_eval_harness.json' 2026-01-06T13:30:45,814 adding 'unitxt/catalog/templates/qa/multiple_choice/open/fr/mmlu.json' 2026-01-06T13:30:45,816 adding 'unitxt/catalog/templates/qa/multiple_choice/open/ja/all.json' 2026-01-06T13:30:45,817 adding 'unitxt/catalog/templates/qa/multiple_choice/open/ja/helm.json' 2026-01-06T13:30:45,818 adding 'unitxt/catalog/templates/qa/multiple_choice/open/ja/lm_eval_harness.json' 2026-01-06T13:30:45,820 adding 'unitxt/catalog/templates/qa/multiple_choice/open/ja/mmlu.json' 2026-01-06T13:30:45,821 adding 'unitxt/catalog/templates/qa/multiple_choice/open/pt/all.json' 2026-01-06T13:30:45,822 adding 'unitxt/catalog/templates/qa/multiple_choice/open/pt/helm.json' 2026-01-06T13:30:45,824 adding 'unitxt/catalog/templates/qa/multiple_choice/open/pt/lm_eval_harness.json' 2026-01-06T13:30:45,825 adding 'unitxt/catalog/templates/qa/multiple_choice/open/pt/mmlu.json' 2026-01-06T13:30:45,827 adding 'unitxt/catalog/templates/qa/multiple_choice/with_context/ai2d.json' 2026-01-06T13:30:45,828 adding 'unitxt/catalog/templates/qa/multiple_choice/with_context/all.json' 2026-01-06T13:30:45,829 adding 'unitxt/catalog/templates/qa/multiple_choice/with_context/bluebench.json' 2026-01-06T13:30:45,830 adding 'unitxt/catalog/templates/qa/multiple_choice/with_context/exact_answer_instruct.json' 2026-01-06T13:30:45,831 adding 'unitxt/catalog/templates/qa/multiple_choice/with_context/lm_eval_harness.json' 2026-01-06T13:30:45,832 adding 'unitxt/catalog/templates/qa/multiple_choice/with_context/lmms_eval.json' 2026-01-06T13:30:45,834 adding 'unitxt/catalog/templates/qa/multiple_choice/with_context/match.json' 2026-01-06T13:30:45,835 adding 'unitxt/catalog/templates/qa/multiple_choice/with_context/title.json' 2026-01-06T13:30:45,836 adding 'unitxt/catalog/templates/qa/multiple_choice/with_context/no_intro/all.json' 2026-01-06T13:30:45,838 adding 'unitxt/catalog/templates/qa/multiple_choice/with_context/no_intro/helm.json' 2026-01-06T13:30:45,839 adding 'unitxt/catalog/templates/qa/multiple_choice/with_context/no_intro/lm_eval_harness.json' 2026-01-06T13:30:45,840 adding 'unitxt/catalog/templates/qa/multiple_choice/with_context/no_intro/mmlu.json' 2026-01-06T13:30:45,842 adding 'unitxt/catalog/templates/qa/multiple_choice/with_context/no_intro/de/all.json' 2026-01-06T13:30:45,843 adding 'unitxt/catalog/templates/qa/multiple_choice/with_context/no_intro/de/helm.json' 2026-01-06T13:30:45,844 adding 'unitxt/catalog/templates/qa/multiple_choice/with_context/no_intro/de/lm_eval_harness.json' 2026-01-06T13:30:45,845 adding 'unitxt/catalog/templates/qa/multiple_choice/with_context/no_intro/de/mmlu.json' 2026-01-06T13:30:45,847 adding 'unitxt/catalog/templates/qa/multiple_choice/with_context/no_intro/es/all.json' 2026-01-06T13:30:45,848 adding 'unitxt/catalog/templates/qa/multiple_choice/with_context/no_intro/es/helm.json' 2026-01-06T13:30:45,849 adding 'unitxt/catalog/templates/qa/multiple_choice/with_context/no_intro/es/lm_eval_harness.json' 2026-01-06T13:30:45,850 adding 'unitxt/catalog/templates/qa/multiple_choice/with_context/no_intro/es/mmlu.json' 2026-01-06T13:30:45,852 adding 'unitxt/catalog/templates/qa/multiple_choice/with_context/no_intro/fr/all.json' 2026-01-06T13:30:45,853 adding 'unitxt/catalog/templates/qa/multiple_choice/with_context/no_intro/fr/helm.json' 2026-01-06T13:30:45,854 adding 'unitxt/catalog/templates/qa/multiple_choice/with_context/no_intro/fr/lm_eval_harness.json' 2026-01-06T13:30:45,855 adding 'unitxt/catalog/templates/qa/multiple_choice/with_context/no_intro/fr/mmlu.json' 2026-01-06T13:30:45,856 adding 'unitxt/catalog/templates/qa/multiple_choice/with_context/no_intro/ja/all.json' 2026-01-06T13:30:45,858 adding 'unitxt/catalog/templates/qa/multiple_choice/with_context/no_intro/ja/helm.json' 2026-01-06T13:30:45,859 adding 'unitxt/catalog/templates/qa/multiple_choice/with_context/no_intro/ja/lm_eval_harness.json' 2026-01-06T13:30:45,860 adding 'unitxt/catalog/templates/qa/multiple_choice/with_context/no_intro/ja/mmlu.json' 2026-01-06T13:30:45,861 adding 'unitxt/catalog/templates/qa/multiple_choice/with_context/no_intro/pt/all.json' 2026-01-06T13:30:45,863 adding 'unitxt/catalog/templates/qa/multiple_choice/with_context/no_intro/pt/helm.json' 2026-01-06T13:30:45,864 adding 'unitxt/catalog/templates/qa/multiple_choice/with_context/no_intro/pt/lm_eval_harness.json' 2026-01-06T13:30:45,865 adding 'unitxt/catalog/templates/qa/multiple_choice/with_context/no_intro/pt/mmlu.json' 2026-01-06T13:30:45,867 adding 'unitxt/catalog/templates/qa/multiple_choice/with_context/with_topic/all.json' 2026-01-06T13:30:45,868 adding 'unitxt/catalog/templates/qa/multiple_choice/with_context/with_topic/fm_eval.json' 2026-01-06T13:30:45,869 adding 'unitxt/catalog/templates/qa/multiple_choice/with_context/with_topic/helm.json' 2026-01-06T13:30:45,870 adding 'unitxt/catalog/templates/qa/multiple_choice/with_context/with_topic/lm_eval_harness.json' 2026-01-06T13:30:45,871 adding 'unitxt/catalog/templates/qa/multiple_choice/with_context/with_topic/match.json' 2026-01-06T13:30:45,872 adding 'unitxt/catalog/templates/qa/multiple_choice/with_context/with_topic/mmlu.json' 2026-01-06T13:30:45,873 adding 'unitxt/catalog/templates/qa/multiple_choice/with_context/with_topic/title.json' 2026-01-06T13:30:45,875 adding 'unitxt/catalog/templates/qa/multiple_choice/with_context/with_topic/de/all.json' 2026-01-06T13:30:45,876 adding 'unitxt/catalog/templates/qa/multiple_choice/with_context/with_topic/de/helm.json' 2026-01-06T13:30:45,878 adding 'unitxt/catalog/templates/qa/multiple_choice/with_context/with_topic/de/lm_eval_harness.json' 2026-01-06T13:30:45,879 adding 'unitxt/catalog/templates/qa/multiple_choice/with_context/with_topic/de/mmlu.json' 2026-01-06T13:30:45,880 adding 'unitxt/catalog/templates/qa/multiple_choice/with_context/with_topic/es/all.json' 2026-01-06T13:30:45,882 adding 'unitxt/catalog/templates/qa/multiple_choice/with_context/with_topic/es/helm.json' 2026-01-06T13:30:45,883 adding 'unitxt/catalog/templates/qa/multiple_choice/with_context/with_topic/es/lm_eval_harness.json' 2026-01-06T13:30:45,884 adding 'unitxt/catalog/templates/qa/multiple_choice/with_context/with_topic/es/mmlu.json' 2026-01-06T13:30:45,886 adding 'unitxt/catalog/templates/qa/multiple_choice/with_context/with_topic/fr/all.json' 2026-01-06T13:30:45,887 adding 'unitxt/catalog/templates/qa/multiple_choice/with_context/with_topic/fr/helm.json' 2026-01-06T13:30:45,888 adding 'unitxt/catalog/templates/qa/multiple_choice/with_context/with_topic/fr/lm_eval_harness.json' 2026-01-06T13:30:45,889 adding 'unitxt/catalog/templates/qa/multiple_choice/with_context/with_topic/fr/mmlu.json' 2026-01-06T13:30:45,891 adding 'unitxt/catalog/templates/qa/multiple_choice/with_context/with_topic/ja/all.json' 2026-01-06T13:30:45,892 adding 'unitxt/catalog/templates/qa/multiple_choice/with_context/with_topic/ja/helm.json' 2026-01-06T13:30:45,893 adding 'unitxt/catalog/templates/qa/multiple_choice/with_context/with_topic/ja/lm_eval_harness.json' 2026-01-06T13:30:45,894 adding 'unitxt/catalog/templates/qa/multiple_choice/with_context/with_topic/ja/mmlu.json' 2026-01-06T13:30:45,896 adding 'unitxt/catalog/templates/qa/multiple_choice/with_context/with_topic/pt/all.json' 2026-01-06T13:30:45,897 adding 'unitxt/catalog/templates/qa/multiple_choice/with_context/with_topic/pt/helm.json' 2026-01-06T13:30:45,898 adding 'unitxt/catalog/templates/qa/multiple_choice/with_context/with_topic/pt/lm_eval_harness.json' 2026-01-06T13:30:45,900 adding 'unitxt/catalog/templates/qa/multiple_choice/with_context/with_topic/pt/mmlu.json' 2026-01-06T13:30:45,901 adding 'unitxt/catalog/templates/qa/multiple_choice/with_topic/all.json' 2026-01-06T13:30:45,902 adding 'unitxt/catalog/templates/qa/multiple_choice/with_topic/bluebench.json' 2026-01-06T13:30:45,904 adding 'unitxt/catalog/templates/qa/multiple_choice/with_topic/fm_eval.json' 2026-01-06T13:30:45,905 adding 'unitxt/catalog/templates/qa/multiple_choice/with_topic/helm.json' 2026-01-06T13:30:45,906 adding 'unitxt/catalog/templates/qa/multiple_choice/with_topic/lm_eval_harness.json' 2026-01-06T13:30:45,907 adding 'unitxt/catalog/templates/qa/multiple_choice/with_topic/match.json' 2026-01-06T13:30:45,908 adding 'unitxt/catalog/templates/qa/multiple_choice/with_topic/mmlu.json' 2026-01-06T13:30:45,909 adding 'unitxt/catalog/templates/qa/multiple_choice/with_topic/title.json' 2026-01-06T13:30:45,911 adding 'unitxt/catalog/templates/qa/multiple_choice/with_topic/de/all.json' 2026-01-06T13:30:45,912 adding 'unitxt/catalog/templates/qa/multiple_choice/with_topic/de/helm.json' 2026-01-06T13:30:45,913 adding 'unitxt/catalog/templates/qa/multiple_choice/with_topic/de/lm_eval_harness.json' 2026-01-06T13:30:45,914 adding 'unitxt/catalog/templates/qa/multiple_choice/with_topic/de/mmlu.json' 2026-01-06T13:30:45,916 adding 'unitxt/catalog/templates/qa/multiple_choice/with_topic/es/all.json' 2026-01-06T13:30:45,917 adding 'unitxt/catalog/templates/qa/multiple_choice/with_topic/es/helm.json' 2026-01-06T13:30:45,918 adding 'unitxt/catalog/templates/qa/multiple_choice/with_topic/es/lm_eval_harness.json' 2026-01-06T13:30:45,920 adding 'unitxt/catalog/templates/qa/multiple_choice/with_topic/es/mmlu.json' 2026-01-06T13:30:45,921 adding 'unitxt/catalog/templates/qa/multiple_choice/with_topic/fr/all.json' 2026-01-06T13:30:45,923 adding 'unitxt/catalog/templates/qa/multiple_choice/with_topic/fr/helm.json' 2026-01-06T13:30:45,924 adding 'unitxt/catalog/templates/qa/multiple_choice/with_topic/fr/lm_eval_harness.json' 2026-01-06T13:30:45,925 adding 'unitxt/catalog/templates/qa/multiple_choice/with_topic/fr/mmlu.json' 2026-01-06T13:30:45,927 adding 'unitxt/catalog/templates/qa/multiple_choice/with_topic/ja/all.json' 2026-01-06T13:30:45,928 adding 'unitxt/catalog/templates/qa/multiple_choice/with_topic/ja/helm.json' 2026-01-06T13:30:45,929 adding 'unitxt/catalog/templates/qa/multiple_choice/with_topic/ja/lm_eval_harness.json' 2026-01-06T13:30:45,930 adding 'unitxt/catalog/templates/qa/multiple_choice/with_topic/ja/mmlu.json' 2026-01-06T13:30:45,932 adding 'unitxt/catalog/templates/qa/multiple_choice/with_topic/pt/all.json' 2026-01-06T13:30:45,933 adding 'unitxt/catalog/templates/qa/multiple_choice/with_topic/pt/helm.json' 2026-01-06T13:30:45,934 adding 'unitxt/catalog/templates/qa/multiple_choice/with_topic/pt/lm_eval_harness.json' 2026-01-06T13:30:45,935 adding 'unitxt/catalog/templates/qa/multiple_choice/with_topic/pt/mmlu.json' 2026-01-06T13:30:45,937 adding 'unitxt/catalog/templates/qa/open/all.json' 2026-01-06T13:30:45,938 adding 'unitxt/catalog/templates/qa/open/empty.json' 2026-01-06T13:30:45,940 adding 'unitxt/catalog/templates/qa/open/simple.json' 2026-01-06T13:30:45,941 adding 'unitxt/catalog/templates/qa/open/simple2.json' 2026-01-06T13:30:45,942 adding 'unitxt/catalog/templates/qa/open/title.json' 2026-01-06T13:30:45,943 adding 'unitxt/catalog/templates/qa/with_context/all.json' 2026-01-06T13:30:45,944 adding 'unitxt/catalog/templates/qa/with_context/chart_qa.json' 2026-01-06T13:30:45,945 adding 'unitxt/catalog/templates/qa/with_context/doc_vqa.json' 2026-01-06T13:30:45,946 adding 'unitxt/catalog/templates/qa/with_context/ffqa.json' 2026-01-06T13:30:45,947 adding 'unitxt/catalog/templates/qa/with_context/info_vqa.json' 2026-01-06T13:30:45,949 adding 'unitxt/catalog/templates/qa/with_context/lmms_eval.json' 2026-01-06T13:30:45,950 adding 'unitxt/catalog/templates/qa/with_context/qtsumm.json' 2026-01-06T13:30:45,951 adding 'unitxt/catalog/templates/qa/with_context/question_first.json' 2026-01-06T13:30:45,952 adding 'unitxt/catalog/templates/qa/with_context/simple.json' 2026-01-06T13:30:45,953 adding 'unitxt/catalog/templates/qa/with_context/simple2.json' 2026-01-06T13:30:45,954 adding 'unitxt/catalog/templates/qa/with_context/title.json' 2026-01-06T13:30:45,955 adding 'unitxt/catalog/templates/qa/with_context/websrc.json' 2026-01-06T13:30:45,957 adding 'unitxt/catalog/templates/qa/with_context/with_type.json' 2026-01-06T13:30:45,959 adding 'unitxt/catalog/templates/rag/end_to_end/json_predictions.json' 2026-01-06T13:30:45,960 adding 'unitxt/catalog/templates/rag/response_generation/answer_based_on_context.json' 2026-01-06T13:30:45,961 adding 'unitxt/catalog/templates/rag/response_generation/answer_based_on_context_inverted.json' 2026-01-06T13:30:45,962 adding 'unitxt/catalog/templates/rag/response_generation/bluebench.json' 2026-01-06T13:30:45,964 adding 'unitxt/catalog/templates/rag/response_generation/please_respond.json' 2026-01-06T13:30:45,965 adding 'unitxt/catalog/templates/rag/response_generation/please_respond_chat.json' 2026-01-06T13:30:45,967 adding 'unitxt/catalog/templates/rag_eval/answer_correctness/all.json' 2026-01-06T13:30:45,968 adding 'unitxt/catalog/templates/rag_eval/answer_correctness/judge_instruct_qa_format.json' 2026-01-06T13:30:45,969 adding 'unitxt/catalog/templates/rag_eval/answer_correctness/judge_instruct_qa_format_logprobs.json' 2026-01-06T13:30:45,971 adding 'unitxt/catalog/templates/rag_eval/answer_correctness/judge_loose_match_no_context.json' 2026-01-06T13:30:45,972 adding 'unitxt/catalog/templates/rag_eval/answer_correctness/judge_loose_match_no_context_logprobs.json' 2026-01-06T13:30:45,973 adding 'unitxt/catalog/templates/rag_eval/answer_correctness/judge_loose_match_no_context_numeric.json' 2026-01-06T13:30:45,975 adding 'unitxt/catalog/templates/rag_eval/answer_correctness/judge_loose_match_no_context_verbal.json' 2026-01-06T13:30:45,976 adding 'unitxt/catalog/templates/rag_eval/answer_correctness/judge_loose_match_no_context_verbal_good_bad.json' 2026-01-06T13:30:45,977 adding 'unitxt/catalog/templates/rag_eval/answer_correctness/judge_simplified_format.json' 2026-01-06T13:30:45,978 adding 'unitxt/catalog/templates/rag_eval/answer_correctness/judge_simplified_format_logprobs.json' 2026-01-06T13:30:45,980 adding 'unitxt/catalog/templates/rag_eval/answer_correctness/judge_simplified_no_context.json' 2026-01-06T13:30:45,981 adding 'unitxt/catalog/templates/rag_eval/answer_correctness/judge_simplified_no_context_logprobs.json' 2026-01-06T13:30:45,982 adding 'unitxt/catalog/templates/rag_eval/answer_correctness/judge_simplified_with_context.json' 2026-01-06T13:30:45,983 adding 'unitxt/catalog/templates/rag_eval/answer_correctness/judge_simplified_with_context_logprobs.json' 2026-01-06T13:30:45,984 adding 'unitxt/catalog/templates/rag_eval/answer_correctness/metric_template.json' 2026-01-06T13:30:45,986 adding 'unitxt/catalog/templates/rag_eval/answer_relevance/all.json' 2026-01-06T13:30:45,988 adding 'unitxt/catalog/templates/rag_eval/answer_relevance/judge_answer_relevance.json' 2026-01-06T13:30:45,989 adding 'unitxt/catalog/templates/rag_eval/answer_relevance/judge_answer_relevance_logprobs.json' 2026-01-06T13:30:45,990 adding 'unitxt/catalog/templates/rag_eval/answer_relevance/judge_answer_relevance_numeric.json' 2026-01-06T13:30:45,991 adding 'unitxt/catalog/templates/rag_eval/answer_relevance/judge_answer_relevance_verbal_good_bad.json' 2026-01-06T13:30:45,992 adding 'unitxt/catalog/templates/rag_eval/answer_relevance/metric_template.json' 2026-01-06T13:30:45,994 adding 'unitxt/catalog/templates/rag_eval/context_relevance/all.json' 2026-01-06T13:30:45,995 adding 'unitxt/catalog/templates/rag_eval/context_relevance/judge_context_relevance.json' 2026-01-06T13:30:45,996 adding 'unitxt/catalog/templates/rag_eval/context_relevance/judge_context_relevance_ares.json' 2026-01-06T13:30:45,997 adding 'unitxt/catalog/templates/rag_eval/context_relevance/judge_context_relevance_ares_logprobs.json' 2026-01-06T13:30:45,998 adding 'unitxt/catalog/templates/rag_eval/context_relevance/judge_context_relevance_ares_numeric.json' 2026-01-06T13:30:46,000 adding 'unitxt/catalog/templates/rag_eval/context_relevance/judge_context_relevance_ares_verbal.json' 2026-01-06T13:30:46,001 adding 'unitxt/catalog/templates/rag_eval/context_relevance/judge_context_relevance_ares_verbal_good_bad.json' 2026-01-06T13:30:46,002 adding 'unitxt/catalog/templates/rag_eval/context_relevance/judge_context_relevance_logprobs.json' 2026-01-06T13:30:46,003 adding 'unitxt/catalog/templates/rag_eval/context_relevance/metric_template.json' 2026-01-06T13:30:46,005 adding 'unitxt/catalog/templates/rag_eval/correctness_holistic/all.json' 2026-01-06T13:30:46,006 adding 'unitxt/catalog/templates/rag_eval/correctness_holistic/judge_correctness_explain_first.json' 2026-01-06T13:30:46,007 adding 'unitxt/catalog/templates/rag_eval/correctness_holistic/judge_correctness_explain_first_logprobs.json' 2026-01-06T13:30:46,009 adding 'unitxt/catalog/templates/rag_eval/correctness_holistic/judge_correctness_simple.json' 2026-01-06T13:30:46,010 adding 'unitxt/catalog/templates/rag_eval/correctness_holistic/judge_correctness_simple_logprobs.json' 2026-01-06T13:30:46,011 adding 'unitxt/catalog/templates/rag_eval/correctness_holistic/judge_correctness_simple_numeric.json' 2026-01-06T13:30:46,012 adding 'unitxt/catalog/templates/rag_eval/correctness_holistic/metric_template.json' 2026-01-06T13:30:46,014 adding 'unitxt/catalog/templates/rag_eval/faithfulness/all.json' 2026-01-06T13:30:46,015 adding 'unitxt/catalog/templates/rag_eval/faithfulness/judge_no_question_full.json' 2026-01-06T13:30:46,017 adding 'unitxt/catalog/templates/rag_eval/faithfulness/judge_no_question_full_logprobs.json' 2026-01-06T13:30:46,018 adding 'unitxt/catalog/templates/rag_eval/faithfulness/judge_no_question_simplified.json' 2026-01-06T13:30:46,019 adding 'unitxt/catalog/templates/rag_eval/faithfulness/judge_no_question_simplified_explain.json' 2026-01-06T13:30:46,020 adding 'unitxt/catalog/templates/rag_eval/faithfulness/judge_no_question_simplified_explain_logprobs.json' 2026-01-06T13:30:46,021 adding 'unitxt/catalog/templates/rag_eval/faithfulness/judge_no_question_simplified_logprobs.json' 2026-01-06T13:30:46,023 adding 'unitxt/catalog/templates/rag_eval/faithfulness/judge_no_question_simplified_numeric.json' 2026-01-06T13:30:46,024 adding 'unitxt/catalog/templates/rag_eval/faithfulness/judge_no_question_simplified_verbal.json' 2026-01-06T13:30:46,025 adding 'unitxt/catalog/templates/rag_eval/faithfulness/judge_no_question_simplified_verbal_good_bad.json' 2026-01-06T13:30:46,026 adding 'unitxt/catalog/templates/rag_eval/faithfulness/judge_with_question_full.json' 2026-01-06T13:30:46,028 adding 'unitxt/catalog/templates/rag_eval/faithfulness/judge_with_question_full_logprobs.json' 2026-01-06T13:30:46,029 adding 'unitxt/catalog/templates/rag_eval/faithfulness/judge_with_question_simplified.json' 2026-01-06T13:30:46,030 adding 'unitxt/catalog/templates/rag_eval/faithfulness/judge_with_question_simplified_logprobs.json' 2026-01-06T13:30:46,031 adding 'unitxt/catalog/templates/rag_eval/faithfulness/judge_with_question_simplified_numeric.json' 2026-01-06T13:30:46,033 adding 'unitxt/catalog/templates/rag_eval/faithfulness/judge_with_question_simplified_verbal.json' 2026-01-06T13:30:46,034 adding 'unitxt/catalog/templates/rag_eval/faithfulness/judge_with_question_simplified_verbal_good_bad.json' 2026-01-06T13:30:46,035 adding 'unitxt/catalog/templates/rag_eval/faithfulness/metric_template.json' 2026-01-06T13:30:46,037 adding 'unitxt/catalog/templates/regression/single_text/all.json' 2026-01-06T13:30:46,038 adding 'unitxt/catalog/templates/regression/single_text/simple.json' 2026-01-06T13:30:46,039 adding 'unitxt/catalog/templates/regression/single_text/title.json' 2026-01-06T13:30:46,041 adding 'unitxt/catalog/templates/regression/two_texts/all.json' 2026-01-06T13:30:46,042 adding 'unitxt/catalog/templates/regression/two_texts/simple.json' 2026-01-06T13:30:46,043 adding 'unitxt/catalog/templates/regression/two_texts/title.json' 2026-01-06T13:30:46,045 adding 'unitxt/catalog/templates/regression/two_texts/similarity/flan.json' 2026-01-06T13:30:46,047 adding 'unitxt/catalog/templates/response_assessment/pairwise_comparative_rating/arena_hard.json' 2026-01-06T13:30:46,048 adding 'unitxt/catalog/templates/response_assessment/pairwise_comparative_rating/arena_hard_with_shuffling.json' 2026-01-06T13:30:46,050 adding 'unitxt/catalog/templates/response_assessment/pairwise_comparative_rating/prometheus_arena_hard.json' 2026-01-06T13:30:46,051 adding 'unitxt/catalog/templates/response_assessment/pairwise_comparative_rating/prometheus_arena_hard_with_shuffling.json' 2026-01-06T13:30:46,053 adding 'unitxt/catalog/templates/response_assessment/pairwise_comparison/mt_bench_multi_turn.json' 2026-01-06T13:30:46,054 adding 'unitxt/catalog/templates/response_assessment/pairwise_comparison/mt_bench_multi_turn_with_reference.json' 2026-01-06T13:30:46,056 adding 'unitxt/catalog/templates/response_assessment/pairwise_comparison/mt_bench_multi_turn_with_reference_with_shuffling.json' 2026-01-06T13:30:46,057 adding 'unitxt/catalog/templates/response_assessment/pairwise_comparison/mt_bench_multi_turn_with_shuffling.json' 2026-01-06T13:30:46,058 adding 'unitxt/catalog/templates/response_assessment/pairwise_comparison/mt_bench_single_turn.json' 2026-01-06T13:30:46,059 adding 'unitxt/catalog/templates/response_assessment/pairwise_comparison/mt_bench_single_turn_with_reference.json' 2026-01-06T13:30:46,061 adding 'unitxt/catalog/templates/response_assessment/pairwise_comparison/mt_bench_single_turn_with_reference_with_shuffling.json' 2026-01-06T13:30:46,062 adding 'unitxt/catalog/templates/response_assessment/pairwise_comparison/mt_bench_single_turn_with_shuffling.json' 2026-01-06T13:30:46,064 adding 'unitxt/catalog/templates/response_assessment/rating/generic_single_turn.json' 2026-01-06T13:30:46,065 adding 'unitxt/catalog/templates/response_assessment/rating/generic_single_turn_with_reference.json' 2026-01-06T13:30:46,066 adding 'unitxt/catalog/templates/response_assessment/rating/mt_bench_multi_turn.json' 2026-01-06T13:30:46,068 adding 'unitxt/catalog/templates/response_assessment/rating/mt_bench_multi_turn_with_reference.json' 2026-01-06T13:30:46,069 adding 'unitxt/catalog/templates/response_assessment/rating/mt_bench_single_turn.json' 2026-01-06T13:30:46,070 adding 'unitxt/catalog/templates/response_assessment/rating/mt_bench_single_turn_with_reference.json' 2026-01-06T13:30:46,071 adding 'unitxt/catalog/templates/response_assessment/rating/table2text_single_turn_with_reference.json' 2026-01-06T13:30:46,073 adding 'unitxt/catalog/templates/rewriting/by_attribute/all.json' 2026-01-06T13:30:46,074 adding 'unitxt/catalog/templates/rewriting/by_attribute/default.json' 2026-01-06T13:30:46,076 adding 'unitxt/catalog/templates/rewriting/paraphrase/all.json' 2026-01-06T13:30:46,077 adding 'unitxt/catalog/templates/rewriting/paraphrase/default.json' 2026-01-06T13:30:46,079 adding 'unitxt/catalog/templates/safety/harm_rating.json' 2026-01-06T13:30:46,080 adding 'unitxt/catalog/templates/safety/llamaguard.json' 2026-01-06T13:30:46,082 adding 'unitxt/catalog/templates/schema_linking/all.json' 2026-01-06T13:30:46,083 adding 'unitxt/catalog/templates/schema_linking/default.json' 2026-01-06T13:30:46,084 adding 'unitxt/catalog/templates/schema_linking/with_hint.json' 2026-01-06T13:30:46,086 adding 'unitxt/catalog/templates/selection/by_attribute/all.json' 2026-01-06T13:30:46,087 adding 'unitxt/catalog/templates/selection/by_attribute/default.json' 2026-01-06T13:30:46,089 adding 'unitxt/catalog/templates/span_labeling/extraction/all.json' 2026-01-06T13:30:46,090 adding 'unitxt/catalog/templates/span_labeling/extraction/carry.json' 2026-01-06T13:30:46,091 adding 'unitxt/catalog/templates/span_labeling/extraction/detailed.json' 2026-01-06T13:30:46,092 adding 'unitxt/catalog/templates/span_labeling/extraction/empty.json' 2026-01-06T13:30:46,094 adding 'unitxt/catalog/templates/span_labeling/extraction/extract.json' 2026-01-06T13:30:46,095 adding 'unitxt/catalog/templates/span_labeling/extraction/having.json' 2026-01-06T13:30:46,096 adding 'unitxt/catalog/templates/span_labeling/extraction/identify.json' 2026-01-06T13:30:46,097 adding 'unitxt/catalog/templates/span_labeling/extraction/title.json' 2026-01-06T13:30:46,099 adding 'unitxt/catalog/templates/summarization/abstractive/all.json' 2026-01-06T13:30:46,101 adding 'unitxt/catalog/templates/summarization/abstractive/bluebench.json' 2026-01-06T13:30:46,102 adding 'unitxt/catalog/templates/summarization/abstractive/casual.json' 2026-01-06T13:30:46,103 adding 'unitxt/catalog/templates/summarization/abstractive/formal.json' 2026-01-06T13:30:46,104 adding 'unitxt/catalog/templates/summarization/abstractive/formal_without_label.json' 2026-01-06T13:30:46,105 adding 'unitxt/catalog/templates/summarization/abstractive/full.json' 2026-01-06T13:30:46,106 adding 'unitxt/catalog/templates/summarization/abstractive/instruct_full.json' 2026-01-06T13:30:46,107 adding 'unitxt/catalog/templates/summarization/abstractive/instruct_one_sentence.json' 2026-01-06T13:30:46,109 adding 'unitxt/catalog/templates/summarization/abstractive/instruct_passive.json' 2026-01-06T13:30:46,110 adding 'unitxt/catalog/templates/summarization/abstractive/instruct_tldr.json' 2026-01-06T13:30:46,111 adding 'unitxt/catalog/templates/summarization/abstractive/instruct_write_succinct.json' 2026-01-06T13:30:46,112 adding 'unitxt/catalog/templates/summarization/abstractive/instructive.json' 2026-01-06T13:30:46,113 adding 'unitxt/catalog/templates/summarization/abstractive/one_sentence.json' 2026-01-06T13:30:46,114 adding 'unitxt/catalog/templates/summarization/abstractive/passive.json' 2026-01-06T13:30:46,116 adding 'unitxt/catalog/templates/summarization/abstractive/professional.json' 2026-01-06T13:30:46,117 adding 'unitxt/catalog/templates/summarization/abstractive/title.json' 2026-01-06T13:30:46,118 adding 'unitxt/catalog/templates/summarization/abstractive/write_succinct.json' 2026-01-06T13:30:46,120 adding 'unitxt/catalog/templates/targeted_sentiment_extraction/all.json' 2026-01-06T13:30:46,121 adding 'unitxt/catalog/templates/targeted_sentiment_extraction/carry_sentiment.json' 2026-01-06T13:30:46,122 adding 'unitxt/catalog/templates/targeted_sentiment_extraction/empty.json' 2026-01-06T13:30:46,123 adding 'unitxt/catalog/templates/targeted_sentiment_extraction/entities_sentiment.json' 2026-01-06T13:30:46,125 adding 'unitxt/catalog/templates/targeted_sentiment_extraction/extract_sentiment.json' 2026-01-06T13:30:46,126 adding 'unitxt/catalog/templates/targeted_sentiment_extraction/having_sentiment.json' 2026-01-06T13:30:46,127 adding 'unitxt/catalog/templates/targeted_sentiment_extraction/as_json/convert_with_explicit_keys.json' 2026-01-06T13:30:46,129 adding 'unitxt/catalog/templates/targeted_sentiment_extraction/as_json/convert_with_implicit_keys.json' 2026-01-06T13:30:46,130 adding 'unitxt/catalog/templates/targeted_sentiment_extraction/as_json/empty.json' 2026-01-06T13:30:46,131 adding 'unitxt/catalog/templates/targeted_sentiment_extraction/negative/all.json' 2026-01-06T13:30:46,132 adding 'unitxt/catalog/templates/targeted_sentiment_extraction/negative/empty.json' 2026-01-06T13:30:46,133 adding 'unitxt/catalog/templates/targeted_sentiment_extraction/negative/having_sentiment.json' 2026-01-06T13:30:46,134 adding 'unitxt/catalog/templates/targeted_sentiment_extraction/negative/sentiment_extracted.json' 2026-01-06T13:30:46,136 adding 'unitxt/catalog/templates/targeted_sentiment_extraction/neutral/all.json' 2026-01-06T13:30:46,137 adding 'unitxt/catalog/templates/targeted_sentiment_extraction/neutral/empty.json' 2026-01-06T13:30:46,138 adding 'unitxt/catalog/templates/targeted_sentiment_extraction/neutral/having_sentiment.json' 2026-01-06T13:30:46,139 adding 'unitxt/catalog/templates/targeted_sentiment_extraction/neutral/sentiment_extracted.json' 2026-01-06T13:30:46,141 adding 'unitxt/catalog/templates/targeted_sentiment_extraction/positive/all.json' 2026-01-06T13:30:46,142 adding 'unitxt/catalog/templates/targeted_sentiment_extraction/positive/empty.json' 2026-01-06T13:30:46,143 adding 'unitxt/catalog/templates/targeted_sentiment_extraction/positive/having_sentiment.json' 2026-01-06T13:30:46,145 adding 'unitxt/catalog/templates/targeted_sentiment_extraction/positive/sentiment_extracted.json' 2026-01-06T13:30:46,146 adding 'unitxt/catalog/templates/text2sql/all.json' 2026-01-06T13:30:46,147 adding 'unitxt/catalog/templates/text2sql/empty.json' 2026-01-06T13:30:46,149 adding 'unitxt/catalog/templates/text2sql/you_are_given.json' 2026-01-06T13:30:46,150 adding 'unitxt/catalog/templates/text2sql/you_are_given_no_system.json' 2026-01-06T13:30:46,151 adding 'unitxt/catalog/templates/text2sql/you_are_given_no_system_with_hint.json' 2026-01-06T13:30:46,152 adding 'unitxt/catalog/templates/text2sql/you_are_given_with_hint.json' 2026-01-06T13:30:46,153 adding 'unitxt/catalog/templates/text2sql/you_are_given_with_hint_answer_sql_prefix_no_inst.json' 2026-01-06T13:30:46,154 adding 'unitxt/catalog/templates/text2sql/you_are_given_with_hint_with_out_sql_prefix.json' 2026-01-06T13:30:46,155 adding 'unitxt/catalog/templates/text2sql/you_are_given_with_hint_with_sql_prefix.json' 2026-01-06T13:30:46,157 adding 'unitxt/catalog/templates/text2sql/you_are_given_with_sql_prefix.json' 2026-01-06T13:30:46,158 adding 'unitxt/catalog/templates/tool_calling/base.json' 2026-01-06T13:30:46,159 adding 'unitxt/catalog/templates/tool_calling/multi_turn.json' 2026-01-06T13:30:46,161 adding 'unitxt/catalog/templates/translation/directed/all.json' 2026-01-06T13:30:46,163 adding 'unitxt/catalog/templates/translation/directed/bluebench.json' 2026-01-06T13:30:46,164 adding 'unitxt/catalog/templates/translation/directed/casual.json' 2026-01-06T13:30:46,165 adding 'unitxt/catalog/templates/translation/directed/formal.json' 2026-01-06T13:30:46,166 adding 'unitxt/catalog/templates/translation/directed/instructional.json' 2026-01-06T13:30:46,167 adding 'unitxt/catalog/templates/translation/directed/playful.json' 2026-01-06T13:30:46,169 adding 'unitxt/catalog/templates/translation/directed/simple.json' 2026-01-06T13:30:46,170 adding 'unitxt/catalog/templates/translation/directed/title.json' 2026-01-06T13:30:46,172 adding 'unitxt/service/__init__.py' 2026-01-06T13:30:46,173 adding 'unitxt/service/metrics/__init__.py' 2026-01-06T13:30:46,175 adding 'unitxt/service/metrics/main.py' 2026-01-06T13:30:46,176 adding 'unitxt/service/metrics/tokens.py' 2026-01-06T13:30:46,178 adding 'unitxt/test_utils/__init__.py' 2026-01-06T13:30:46,179 adding 'unitxt/test_utils/artifact.py' 2026-01-06T13:30:46,181 adding 'unitxt/test_utils/card.py' 2026-01-06T13:30:46,182 adding 'unitxt/test_utils/catalog.py' 2026-01-06T13:30:46,184 adding 'unitxt/test_utils/metrics.py' 2026-01-06T13:30:46,185 adding 'unitxt/test_utils/operators.py' 2026-01-06T13:30:46,186 adding 'unitxt/test_utils/storage.py' 2026-01-06T13:30:46,188 adding 'unitxt/ui/__init__.py' 2026-01-06T13:30:46,200 adding 'unitxt/ui/banner.png' 2026-01-06T13:30:46,202 adding 'unitxt/ui/gradio_utils.py' 2026-01-06T13:30:46,204 adding 'unitxt/ui/load_catalog_data.py' 2026-01-06T13:30:46,206 adding 'unitxt/ui/run.py' 2026-01-06T13:30:46,207 adding 'unitxt/ui/settings.py' 2026-01-06T13:30:46,208 adding 'unitxt/ui/ui_tester.py' 2026-01-06T13:30:46,210 adding 'unitxt/ui/ui_utils.py' 2026-01-06T13:30:46,213 adding 'unitxt-1.26.8.dist-info/licenses/LICENSE' 2026-01-06T13:30:46,216 adding 'unitxt-1.26.8.dist-info/METADATA' 2026-01-06T13:30:46,217 adding 'unitxt-1.26.8.dist-info/WHEEL' 2026-01-06T13:30:46,218 adding 'unitxt-1.26.8.dist-info/entry_points.txt' 2026-01-06T13:30:46,219 adding 'unitxt-1.26.8.dist-info/top_level.txt' 2026-01-06T13:30:46,307 adding 'unitxt-1.26.8.dist-info/RECORD' 2026-01-06T13:30:46,674 removing build/bdist.linux-armv7l/wheel 2026-01-06T13:30:48,055 Building wheel for unitxt (pyproject.toml): finished with status 'done' 2026-01-06T13:30:48,755 Created wheel for unitxt: filename=unitxt-1.26.8-py3-none-any.whl size=32886105 sha256=abc967e670a81c20b6c1fe69a6a23a6861304793df40d094d5fa4ba4a5112a80 2026-01-06T13:30:48,757 Stored in directory: /tmp/pip-ephem-wheel-cache-ctv2sb2w/wheels/6f/81/e9/d8dd6273e9272463cde0acec84f8f0f023406f89d47dcb9cd3 2026-01-06T13:30:48,943 Successfully built unitxt 2026-01-06T13:30:49,980 Removed build tracker: '/tmp/pip-build-tracker-_kpo56qn'