2026-05-27T11:52:55,368 Created temporary directory: /tmp/pip-ephem-wheel-cache-jkzh10pr 2026-05-27T11:52:55,370 Created temporary directory: /tmp/pip-build-tracker-rbf86q8p 2026-05-27T11:52:55,370 Initialized build tracking at /tmp/pip-build-tracker-rbf86q8p 2026-05-27T11:52:55,371 Created build tracker: /tmp/pip-build-tracker-rbf86q8p 2026-05-27T11:52:55,371 Entered build tracker: /tmp/pip-build-tracker-rbf86q8p 2026-05-27T11:52:55,372 Created temporary directory: /tmp/pip-wheel-fnszrdac 2026-05-27T11:52:55,375 DEPRECATION: --no-binary currently disables reading from the cache of locally built wheels. In the future --no-binary will not influence the wheel cache. pip 23.1 will enforce this behaviour change. A possible replacement is to use the --no-cache-dir option. You can use the flag --use-feature=no-binary-enable-wheel-cache to test the upcoming behaviour. Discussion can be found at https://github.com/pypa/pip/issues/11453 2026-05-27T11:52:55,378 Created temporary directory: /tmp/pip-ephem-wheel-cache-1g49g95g 2026-05-27T11:52:55,399 Looking in indexes: https://pypi.org/simple, https://www.piwheels.org/simple 2026-05-27T11:52:55,403 2 location(s) to search for versions of unitxt: 2026-05-27T11:52:55,403 * https://pypi.org/simple/unitxt/ 2026-05-27T11:52:55,403 * https://www.piwheels.org/simple/unitxt/ 2026-05-27T11:52:55,404 Fetching project page and analyzing links: https://pypi.org/simple/unitxt/ 2026-05-27T11:52:55,404 Getting page https://pypi.org/simple/unitxt/ 2026-05-27T11:52:55,406 Found index url https://pypi.org/simple 2026-05-27T11:52:55,660 Fetched page https://pypi.org/simple/unitxt/ as application/vnd.pypi.simple.v1+json 2026-05-27T11:52:55,700 Skipping link: No binaries permitted for unitxt: https://files.pythonhosted.org/packages/b1/60/14353836d07d1f605e224223440d78bdf0845cafcf6cf7ab18f3240f467f/unitxt-0.0.1-py3-none-any.whl (from https://pypi.org/simple/unitxt/) 2026-05-27T11:52:55,701 Found link https://files.pythonhosted.org/packages/58/3a/c92912f61ff66cbcc9341759a2135bae9f5006f7b0e43a12839f6bfd6558/unitxt-0.0.1.tar.gz (from https://pypi.org/simple/unitxt/), version: 0.0.1 2026-05-27T11:52:55,701 Skipping link: No binaries permitted for unitxt: https://files.pythonhosted.org/packages/f8/a1/bff27d252e99f95ccffc0ed3fd42bb3d5adca047f6be92150f1c12aec0d3/unitxt-1.0.0-py3-none-any.whl (from https://pypi.org/simple/unitxt/) (requires-python:>=3.8) 2026-05-27T11:52:55,702 Found link https://files.pythonhosted.org/packages/80/e9/b54fdcc623c84d7298dc1bd073e5c84bfbbaf62aa2ac92bd4db2c98d7389/unitxt-1.0.0.tar.gz (from https://pypi.org/simple/unitxt/) (requires-python:>=3.8), version: 1.0.0 2026-05-27T11:52:55,703 Skipping link: No binaries permitted for unitxt: https://files.pythonhosted.org/packages/22/94/185e566601e713c8e35d15be46b80c4723acc01b70c36144d97129b8df4a/unitxt-1.0.2-py3-none-any.whl (from https://pypi.org/simple/unitxt/) (requires-python:>=3.8) 2026-05-27T11:52:55,704 Found link https://files.pythonhosted.org/packages/3c/cc/f7fdd45973958bfdfaf685714a5d1b64b40aefa2c43fce9614af53c9aabc/unitxt-1.0.2.tar.gz (from https://pypi.org/simple/unitxt/) (requires-python:>=3.8), version: 1.0.2 2026-05-27T11:52:55,705 Skipping link: No binaries permitted for unitxt: https://files.pythonhosted.org/packages/0e/ec/47b4c890389c9146714ccbf60c6c1895402885047cc56a09efee064d88cd/unitxt-1.0.3-py3-none-any.whl (from https://pypi.org/simple/unitxt/) (requires-python:>=3.8) 2026-05-27T11:52:55,706 Found link https://files.pythonhosted.org/packages/4f/ff/c37d78e0e45fb81dd94704314c9523413bdd6b65e9ed2f2ac77d869ea9ec/unitxt-1.0.3.tar.gz (from https://pypi.org/simple/unitxt/) (requires-python:>=3.8), version: 1.0.3 2026-05-27T11:52:55,706 Skipping link: No binaries permitted for unitxt: https://files.pythonhosted.org/packages/c4/e9/8a362c68a5ee3fc5ca8a4d8555154aedef518bfc658ba58f5dbd57ce4118/unitxt-1.0.7-py3-none-any.whl (from https://pypi.org/simple/unitxt/) (requires-python:>=3.8) 2026-05-27T11:52:55,707 Found link https://files.pythonhosted.org/packages/11/d1/d3b62f8baf803050688a5209b7a249f450e3b915906be3b8636049f44de2/unitxt-1.0.7.tar.gz (from https://pypi.org/simple/unitxt/) (requires-python:>=3.8), version: 1.0.7 2026-05-27T11:52:55,708 Skipping link: No binaries permitted for unitxt: https://files.pythonhosted.org/packages/54/31/e55bb57ce60745be009f8562e320edc214555002f6ad801355acfa04befb/unitxt-1.0.9-py3-none-any.whl (from https://pypi.org/simple/unitxt/) (requires-python:>=3.8) 2026-05-27T11:52:55,709 Found link https://files.pythonhosted.org/packages/0e/ad/4d0c5d55831a7fd66fbaca1667f8f31321026e46d5f9444cb997646d2fe7/unitxt-1.0.9.tar.gz (from https://pypi.org/simple/unitxt/) (requires-python:>=3.8), version: 1.0.9 2026-05-27T11:52:55,710 Skipping link: No binaries permitted for unitxt: https://files.pythonhosted.org/packages/46/9b/479b42629f534961d580476c9e0584b9d7f3847b874edffaeacd177f9751/unitxt-1.0.10-py3-none-any.whl (from https://pypi.org/simple/unitxt/) (requires-python:>=3.8) 2026-05-27T11:52:55,710 Found link https://files.pythonhosted.org/packages/ce/c3/d13d529a093821f4f9aac0aacfbda93a31a3c0fb5e4e764434826ded2674/unitxt-1.0.10.tar.gz (from https://pypi.org/simple/unitxt/) (requires-python:>=3.8), version: 1.0.10 2026-05-27T11:52:55,711 Skipping link: No binaries permitted for unitxt: https://files.pythonhosted.org/packages/b5/ad/7d55a38344db877cd52f6fe417f3b1245297083ce61536f3f864d53f1fd1/unitxt-1.0.11-py3-none-any.whl (from https://pypi.org/simple/unitxt/) (requires-python:>=3.8) 2026-05-27T11:52:55,712 Found link https://files.pythonhosted.org/packages/02/50/85cf98c6c362866a7226f69eff6fbfab7827314b2b7151756f27537c8c5f/unitxt-1.0.11.tar.gz (from https://pypi.org/simple/unitxt/) (requires-python:>=3.8), version: 1.0.11 2026-05-27T11:52:55,712 Skipping link: No binaries permitted for unitxt: https://files.pythonhosted.org/packages/93/39/d0b0e6376073122dd4eb91f68979b954fd1286f0e5e8561619cc4a57f3ca/unitxt-1.0.12-py3-none-any.whl (from https://pypi.org/simple/unitxt/) (requires-python:>=3.8) 2026-05-27T11:52:55,713 Found link https://files.pythonhosted.org/packages/be/1d/a00bb5629d15c115a5d71104e1bf9d051123f26eb698bf87337b36215270/unitxt-1.0.12.tar.gz (from https://pypi.org/simple/unitxt/) (requires-python:>=3.8), version: 1.0.12 2026-05-27T11:52:55,714 Skipping link: No binaries permitted for unitxt: https://files.pythonhosted.org/packages/b8/ac/5b7fc2277dd86b4468bca84dd52586084c857b5cacb78924f2c9764c4f95/unitxt-1.0.13-py3-none-any.whl (from https://pypi.org/simple/unitxt/) (requires-python:>=3.8) 2026-05-27T11:52:55,715 Found link https://files.pythonhosted.org/packages/dc/a2/6f56a775b858fac1b24abb26b289609df00ce2c23401f9e457d239707032/unitxt-1.0.13.tar.gz (from https://pypi.org/simple/unitxt/) (requires-python:>=3.8), version: 1.0.13 2026-05-27T11:52:55,715 Skipping link: No binaries permitted for unitxt: https://files.pythonhosted.org/packages/86/55/a190f86d68179b80a837e85fea21a2f0fb29f42efab6f800b18fe9386292/unitxt-1.0.14-py3-none-any.whl (from https://pypi.org/simple/unitxt/) (requires-python:>=3.8) 2026-05-27T11:52:55,716 Found link https://files.pythonhosted.org/packages/46/67/d0446e57188ad1d91e6bfa95052fe5106212978fcba1049d9ab36ebe46a9/unitxt-1.0.14.tar.gz (from https://pypi.org/simple/unitxt/) (requires-python:>=3.8), version: 1.0.14 2026-05-27T11:52:55,717 Skipping link: No binaries permitted for unitxt: https://files.pythonhosted.org/packages/51/69/866ccefee1433cc9376c9288bc207222fd81277b2ea305e749144b840b0d/unitxt-1.0.15-py3-none-any.whl (from https://pypi.org/simple/unitxt/) (requires-python:>=3.8) 2026-05-27T11:52:55,718 Found link https://files.pythonhosted.org/packages/90/6c/e54f7ce50e4fc8981f7e4989de137e0100acdfe9f03b6582aeefe7d52709/unitxt-1.0.15.tar.gz (from https://pypi.org/simple/unitxt/) (requires-python:>=3.8), version: 1.0.15 2026-05-27T11:52:55,719 Skipping link: No binaries permitted for unitxt: https://files.pythonhosted.org/packages/61/d9/f56c6ed3470dc8b74dd02b7466ae594ba283fd460f5f7c8fe70383971270/unitxt-1.0.16-py3-none-any.whl (from https://pypi.org/simple/unitxt/) (requires-python:>=3.8) 2026-05-27T11:52:55,720 Found link https://files.pythonhosted.org/packages/58/f5/c3f7db40d92686e6b7e6e111c080f8a4ef9184adb95b2c2accaf9d7bdddd/unitxt-1.0.16.tar.gz (from https://pypi.org/simple/unitxt/) (requires-python:>=3.8), version: 1.0.16 2026-05-27T11:52:55,720 Skipping link: No binaries permitted for unitxt: https://files.pythonhosted.org/packages/a1/a1/e9e5020dd816fe50263594e47f4cbb806e2ad7b6bd8dd8c63bcdc6bf947d/unitxt-1.0.17-py3-none-any.whl (from https://pypi.org/simple/unitxt/) (requires-python:>=3.8) 2026-05-27T11:52:55,722 Found link https://files.pythonhosted.org/packages/2b/d1/e1ec41ce037e829604b1ac777dd3156546b08cf98c9745a26637406db4f5/unitxt-1.0.17.tar.gz (from https://pypi.org/simple/unitxt/) (requires-python:>=3.8), version: 1.0.17 2026-05-27T11:52:55,722 Skipping link: No binaries permitted for unitxt: https://files.pythonhosted.org/packages/96/f5/c71d8308182f8ac306a93f26b457de8b45ceacd5a65cda26687bbfdc6dab/unitxt-1.0.18-py3-none-any.whl (from https://pypi.org/simple/unitxt/) (requires-python:>=3.8) 2026-05-27T11:52:55,723 Found link https://files.pythonhosted.org/packages/8c/6b/fcb61b4b108d949b8754ccafd1cc4d604383e4cbbcc35086a353130adc7c/unitxt-1.0.18.tar.gz (from https://pypi.org/simple/unitxt/) (requires-python:>=3.8), version: 1.0.18 2026-05-27T11:52:55,724 Skipping link: No binaries permitted for unitxt: https://files.pythonhosted.org/packages/56/b4/da7cec834fce00d5ad095e51738429d5cb07194c1a7bf4bf31a47ae49528/unitxt-1.0.19-py3-none-any.whl (from https://pypi.org/simple/unitxt/) (requires-python:>=3.8) 2026-05-27T11:52:55,724 Found link https://files.pythonhosted.org/packages/11/e0/13e4f60aff6d6bf5aa67eea1b341a826d6bec316a3c02bfa713b2e2fc818/unitxt-1.0.19.tar.gz (from https://pypi.org/simple/unitxt/) (requires-python:>=3.8), version: 1.0.19 2026-05-27T11:52:55,725 Skipping link: No binaries permitted for unitxt: https://files.pythonhosted.org/packages/fc/a3/11450554e4ff01ac93a6eb342d4e57c6795051e1450c96eebf19e4b590ab/unitxt-1.0.20-py3-none-any.whl (from https://pypi.org/simple/unitxt/) (requires-python:>=3.8) 2026-05-27T11:52:55,726 Found link https://files.pythonhosted.org/packages/50/a3/a7bb75377e16d1f94c7dcabfb9b31744a05a52b12aada20576e76ab85e5e/unitxt-1.0.20.tar.gz (from https://pypi.org/simple/unitxt/) (requires-python:>=3.8), version: 1.0.20 2026-05-27T11:52:55,727 Skipping link: No binaries permitted for unitxt: https://files.pythonhosted.org/packages/01/49/cc9f2c575f95fa5be4b14a2d361fffad4acfa80ff3d67cd27fac37236f33/unitxt-1.0.31-py3-none-any.whl (from https://pypi.org/simple/unitxt/) (requires-python:>=3.8) 2026-05-27T11:52:55,727 Found link https://files.pythonhosted.org/packages/f3/42/772959850a2c96ae29dd9c910d7fb58a66183b445350cfe6d5ea0c29a328/unitxt-1.0.31.tar.gz (from https://pypi.org/simple/unitxt/) (requires-python:>=3.8), version: 1.0.31 2026-05-27T11:52:55,728 Skipping link: No binaries permitted for unitxt: https://files.pythonhosted.org/packages/bf/5e/203dd2dd6c3288a8fd53519380a526730510bcc1d6c4aa1889265866b379/unitxt-1.0.34-py3-none-any.whl (from https://pypi.org/simple/unitxt/) (requires-python:>=3.8) 2026-05-27T11:52:55,729 Found link https://files.pythonhosted.org/packages/dc/22/4a766be66b6ef9c208ab2458587b8a870b4ad87fa1817319b25b6c8b4517/unitxt-1.0.34.tar.gz (from https://pypi.org/simple/unitxt/) (requires-python:>=3.8), version: 1.0.34 2026-05-27T11:52:55,730 Skipping link: No binaries permitted for unitxt: https://files.pythonhosted.org/packages/b1/91/36ffd960eedbd4e9f5eeb2cdba190f76964fb08f030f0d2bdace209db64f/unitxt-1.0.35-py3-none-any.whl (from https://pypi.org/simple/unitxt/) (requires-python:>=3.8) 2026-05-27T11:52:55,731 Found link https://files.pythonhosted.org/packages/8f/bf/522102de1b48ac6a2db4830c21771a131add76b01ccc974046f5070c6b7e/unitxt-1.0.35.tar.gz (from https://pypi.org/simple/unitxt/) (requires-python:>=3.8), version: 1.0.35 2026-05-27T11:52:55,732 Skipping link: No binaries permitted for unitxt: https://files.pythonhosted.org/packages/b9/ad/e1fcdc69839eddf8e616a528ff6c60231c5b0d615f67bdb78a49e372df38/unitxt-1.0.38-py3-none-any.whl (from https://pypi.org/simple/unitxt/) (requires-python:>=3.8) 2026-05-27T11:52:55,733 Found link https://files.pythonhosted.org/packages/84/66/0077b202a4de4e41b550914a7eb35c436be1c8a3e3fa9e1ba3b6df23df26/unitxt-1.0.38.tar.gz (from https://pypi.org/simple/unitxt/) (requires-python:>=3.8), version: 1.0.38 2026-05-27T11:52:55,734 Skipping link: No binaries permitted for unitxt: https://files.pythonhosted.org/packages/34/0f/59863844b834fec261bf6532057da64f88ac2a04c7c4759f67dabdd4069b/unitxt-1.0.42-py3-none-any.whl (from https://pypi.org/simple/unitxt/) (requires-python:>=3.8) 2026-05-27T11:52:55,734 Found link https://files.pythonhosted.org/packages/03/3b/c4aed7e4b23a65097439256a03eb0a756fca50de458082a4b9e8a0945189/unitxt-1.0.42.tar.gz (from https://pypi.org/simple/unitxt/) (requires-python:>=3.8), version: 1.0.42 2026-05-27T11:52:55,735 Skipping link: No binaries permitted for unitxt: https://files.pythonhosted.org/packages/cb/d5/321ba31c9b7fa9da776051a5b5b1fb8373ab0323fbafcc534a3d52933cb5/unitxt-1.0.43-py3-none-any.whl (from https://pypi.org/simple/unitxt/) (requires-python:>=3.8) 2026-05-27T11:52:55,736 Found link https://files.pythonhosted.org/packages/cb/3c/4b43d8ffb77f6b87cdd3accb0c24cd27c73394100ceede652de3efd4e0e7/unitxt-1.0.43.tar.gz (from https://pypi.org/simple/unitxt/) (requires-python:>=3.8), version: 1.0.43 2026-05-27T11:52:55,737 Skipping link: No binaries permitted for unitxt: https://files.pythonhosted.org/packages/20/9a/03d23b55637ee7f2a12fe0773f9d63c297b954ba08bd1d61a678bde7c698/unitxt-1.0.45-py3-none-any.whl (from https://pypi.org/simple/unitxt/) (requires-python:>=3.8) 2026-05-27T11:52:55,737 Found link https://files.pythonhosted.org/packages/19/b1/3fc705d8ebf98b8067f9e86b83f9a36792faeb87499ca17348fe73fb85ca/unitxt-1.0.45.tar.gz (from https://pypi.org/simple/unitxt/) (requires-python:>=3.8), version: 1.0.45 2026-05-27T11:52:55,738 Skipping link: No binaries permitted for unitxt: https://files.pythonhosted.org/packages/89/49/a27337aeac942ee84c446172dc06f034a5eda441038c37c9843dab1f0712/unitxt-1.0.47-py3-none-any.whl (from https://pypi.org/simple/unitxt/) (requires-python:>=3.8) 2026-05-27T11:52:55,739 Found link https://files.pythonhosted.org/packages/a8/d9/9cf334e39b78b62817263483602ca67544b470cd58db04aefdfd3c2e3f5f/unitxt-1.0.47.tar.gz (from https://pypi.org/simple/unitxt/) (requires-python:>=3.8), version: 1.0.47 2026-05-27T11:52:55,740 Skipping link: No binaries permitted for unitxt: https://files.pythonhosted.org/packages/ba/32/31bb58c1b7aff52305232cfcc87c6f7495035ada82c39b27402873807eff/unitxt-1.1.1-py3-none-any.whl (from https://pypi.org/simple/unitxt/) (requires-python:>=3.8) 2026-05-27T11:52:55,740 Found link https://files.pythonhosted.org/packages/93/d5/54d6fe9b9a249ee722e5c504d88d802658eee941975b1c06b234a69b6569/unitxt-1.1.1.tar.gz (from https://pypi.org/simple/unitxt/) (requires-python:>=3.8), version: 1.1.1 2026-05-27T11:52:55,741 Skipping link: No binaries permitted for unitxt: https://files.pythonhosted.org/packages/90/1c/73066e4afcf84c60e783b5bd113c4990368af34e9a19a8c11a848f7d038a/unitxt-1.1.3-py3-none-any.whl (from https://pypi.org/simple/unitxt/) (requires-python:>=3.8) 2026-05-27T11:52:55,742 Found link https://files.pythonhosted.org/packages/69/33/9c606d674b66aad293649180045deb0522c4f0a35fb4b80b722d2eb43c13/unitxt-1.1.3.tar.gz (from https://pypi.org/simple/unitxt/) (requires-python:>=3.8), version: 1.1.3 2026-05-27T11:52:55,743 Skipping link: No binaries permitted for unitxt: https://files.pythonhosted.org/packages/6f/0d/d23cc17a47ebb2f9469d5db65bf6ee39d742c50302fd7bad40747f4f76ba/unitxt-1.1.4-py3-none-any.whl (from https://pypi.org/simple/unitxt/) (requires-python:>=3.8) 2026-05-27T11:52:55,744 Found link https://files.pythonhosted.org/packages/91/d7/5c1dc940d3555c20c052ad6fc05f4d7851639db8f57aa27e05403701310f/unitxt-1.1.4.tar.gz (from https://pypi.org/simple/unitxt/) (requires-python:>=3.8), version: 1.1.4 2026-05-27T11:52:55,745 Skipping link: No binaries permitted for unitxt: https://files.pythonhosted.org/packages/74/1f/f302733369b7becec09481ee735fe516634a56065f29da0d52b6bb398fcf/unitxt-1.2.0-py3-none-any.whl (from https://pypi.org/simple/unitxt/) (requires-python:>=3.8) 2026-05-27T11:52:55,746 Found link https://files.pythonhosted.org/packages/09/cd/3803e5f96e21e54924cf1b13e0743902c3969f5be622c25b4c9343cfb037/unitxt-1.2.0.tar.gz (from https://pypi.org/simple/unitxt/) (requires-python:>=3.8), version: 1.2.0 2026-05-27T11:52:55,747 Skipping link: No binaries permitted for unitxt: https://files.pythonhosted.org/packages/ad/d4/6c3082daa56aafffb35420df69ffd4a94105ffe44be30a61d34f8897e0a7/unitxt-1.3.0-py3-none-any.whl (from https://pypi.org/simple/unitxt/) (requires-python:>=3.8) 2026-05-27T11:52:55,748 Found link https://files.pythonhosted.org/packages/73/65/62cbb295c17a2f6d1dbaab82687cd8c74094e40aa9a9576a7050d26e9755/unitxt-1.3.0.tar.gz (from https://pypi.org/simple/unitxt/) (requires-python:>=3.8), version: 1.3.0 2026-05-27T11:52:55,748 Skipping link: No binaries permitted for unitxt: https://files.pythonhosted.org/packages/3f/4c/f7709ad6c10c3644b8edcbf00f3e9cc74a8f49b80bf303dd3e2b349f3e7c/unitxt-1.3.1-py3-none-any.whl (from https://pypi.org/simple/unitxt/) (requires-python:>=3.8) 2026-05-27T11:52:55,749 Found link https://files.pythonhosted.org/packages/32/53/645acf4c60882182d6df8de987bf00fa5e5a76ce60c253d6e87681d47751/unitxt-1.3.1.tar.gz (from https://pypi.org/simple/unitxt/) (requires-python:>=3.8), version: 1.3.1 2026-05-27T11:52:55,750 Skipping link: No binaries permitted for unitxt: https://files.pythonhosted.org/packages/22/39/16447931efc16cdd889a0ef9ef842e4cbcb87cecb1cffa62a0d6ab9b8908/unitxt-1.3.2-py3-none-any.whl (from https://pypi.org/simple/unitxt/) (requires-python:>=3.8) 2026-05-27T11:52:55,750 Found link https://files.pythonhosted.org/packages/cb/76/d8c5fb8205f44581208752c91c553c2992bac7bfd817f44d48b107b9ef6a/unitxt-1.3.2.tar.gz (from https://pypi.org/simple/unitxt/) (requires-python:>=3.8), version: 1.3.2 2026-05-27T11:52:55,751 Skipping link: No binaries permitted for unitxt: https://files.pythonhosted.org/packages/98/4b/d28bec99cab3081a7c93db04ab16db69fb3e19ff1dbced22fd944313f3d4/unitxt-1.4.0-py3-none-any.whl (from https://pypi.org/simple/unitxt/) (requires-python:>=3.8) 2026-05-27T11:52:55,752 Found link https://files.pythonhosted.org/packages/64/1a/9f84ced25db7db742586c1c84767a1b8c8ea8121a3329d2e7111fe5841fc/unitxt-1.4.0.tar.gz (from https://pypi.org/simple/unitxt/) (requires-python:>=3.8), version: 1.4.0 2026-05-27T11:52:55,753 Skipping link: No binaries permitted for unitxt: https://files.pythonhosted.org/packages/f6/ab/a0ab8ad956c9935d2f6fdd01cf85268bf1e3112fef1d937c6596bb687c43/unitxt-1.4.1-py3-none-any.whl (from https://pypi.org/simple/unitxt/) (requires-python:>=3.8) 2026-05-27T11:52:55,754 Found link https://files.pythonhosted.org/packages/37/5a/c8a4e5aa2f19fe163817b4aa2dea50c025dc51963f7d1acb384eebd6ab63/unitxt-1.4.1.tar.gz (from https://pypi.org/simple/unitxt/) (requires-python:>=3.8), version: 1.4.1 2026-05-27T11:52:55,754 Skipping link: No binaries permitted for unitxt: https://files.pythonhosted.org/packages/2a/0c/3d5833c1b0f22bf42fcb0d19942602602568f9b3ae2d3e71ddea929b4dde/unitxt-1.4.2-py3-none-any.whl (from https://pypi.org/simple/unitxt/) (requires-python:>=3.8) 2026-05-27T11:52:55,755 Found link https://files.pythonhosted.org/packages/9b/18/ae9a17a4e7be0d7dbd8fcc84f494b67ccad88118f518faf3c040cf692127/unitxt-1.4.2.tar.gz (from https://pypi.org/simple/unitxt/) (requires-python:>=3.8), version: 1.4.2 2026-05-27T11:52:55,756 Skipping link: No binaries permitted for unitxt: https://files.pythonhosted.org/packages/bd/e3/c232012723f1fbaed61dc0968e80887d6a8344d7914ea415e0bed567fe93/unitxt-1.4.3-py3-none-any.whl (from https://pypi.org/simple/unitxt/) (requires-python:>=3.8) 2026-05-27T11:52:55,757 Found link https://files.pythonhosted.org/packages/56/86/226dd18b4d8ce1f2d32361d0e62d325c689faf3b29767ee5f94ca1b901ab/unitxt-1.4.3.tar.gz (from https://pypi.org/simple/unitxt/) (requires-python:>=3.8), version: 1.4.3 2026-05-27T11:52:55,758 Skipping link: No binaries permitted for unitxt: https://files.pythonhosted.org/packages/3d/e8/c8ddc4127f002b8c5eb3f17ab0d2950a8a8bcb1f2f0d63259d8717dcac16/unitxt-1.4.4-py3-none-any.whl (from https://pypi.org/simple/unitxt/) (requires-python:>=3.8) 2026-05-27T11:52:55,759 Found link https://files.pythonhosted.org/packages/86/c3/b1b31fdb53b11adbe576820edf7ade73f75cf6297c5175989d6003be83bc/unitxt-1.4.4.tar.gz (from https://pypi.org/simple/unitxt/) (requires-python:>=3.8), version: 1.4.4 2026-05-27T11:52:55,760 Skipping link: No binaries permitted for unitxt: https://files.pythonhosted.org/packages/52/45/afed7aabb6e0a642a7311c4a4fc0aa9096946da528e88d8dbc006aa8d452/unitxt-1.4.5-py3-none-any.whl (from https://pypi.org/simple/unitxt/) (requires-python:>=3.8) 2026-05-27T11:52:55,760 Found link https://files.pythonhosted.org/packages/a4/54/d3fc1e45b47c941b0adf4fd7740cd3a92007e3860f7ba8bcace66c813369/unitxt-1.4.5.tar.gz (from https://pypi.org/simple/unitxt/) (requires-python:>=3.8), version: 1.4.5 2026-05-27T11:52:55,761 Skipping link: No binaries permitted for unitxt: https://files.pythonhosted.org/packages/49/5f/6b1d8130c1f0d56187fc918cdabd697417ef95c4285799f11dfb7cbfe8aa/unitxt-1.4.6-py3-none-any.whl (from https://pypi.org/simple/unitxt/) (requires-python:>=3.8) 2026-05-27T11:52:55,762 Found link https://files.pythonhosted.org/packages/a5/0f/0295e4722eb7a3098cc1b9f62f2b39bf3972dfd6544a447980213b061cad/unitxt-1.4.6.tar.gz (from https://pypi.org/simple/unitxt/) (requires-python:>=3.8), version: 1.4.6 2026-05-27T11:52:55,762 Skipping link: No binaries permitted for unitxt: https://files.pythonhosted.org/packages/57/59/c81dc1337ac379c70b92bc3e69f82eecee8883b4b6d474703047ead2b8bf/unitxt-1.5.0-py3-none-any.whl (from https://pypi.org/simple/unitxt/) (requires-python:>=3.8) 2026-05-27T11:52:55,763 Found link https://files.pythonhosted.org/packages/c2/fc/75d869a8b0fa48c0f30309a8abb4bf36b2e5f924bfa4afab92d17da201e7/unitxt-1.5.0.tar.gz (from https://pypi.org/simple/unitxt/) (requires-python:>=3.8), version: 1.5.0 2026-05-27T11:52:55,764 Skipping link: No binaries permitted for unitxt: https://files.pythonhosted.org/packages/50/f6/719d57e6078cc25b2af211c3387d01c7fe4357f86c832e4474385dca1bf0/unitxt-1.5.1-py3-none-any.whl (from https://pypi.org/simple/unitxt/) (requires-python:>=3.8) 2026-05-27T11:52:55,765 Found link https://files.pythonhosted.org/packages/70/bf/c817e0d0ebd5ebc9150fc760d1959d981a9062cc5929a3fee2da82c78bc2/unitxt-1.5.1.tar.gz (from https://pypi.org/simple/unitxt/) (requires-python:>=3.8), version: 1.5.1 2026-05-27T11:52:55,765 Skipping link: No binaries permitted for unitxt: https://files.pythonhosted.org/packages/9e/01/58cbc78cd7cb05e39809983d2cb9ad5ae60850c1e032c9909ea090b60c72/unitxt-1.5.2-py3-none-any.whl (from https://pypi.org/simple/unitxt/) (requires-python:>=3.8) 2026-05-27T11:52:55,766 Found link https://files.pythonhosted.org/packages/20/a4/d279ec7c566ffe56ad2773f4baf4e1ee7156c1127616131d30b5b840eb5c/unitxt-1.5.2.tar.gz (from https://pypi.org/simple/unitxt/) (requires-python:>=3.8), version: 1.5.2 2026-05-27T11:52:55,767 Skipping link: No binaries permitted for unitxt: https://files.pythonhosted.org/packages/0d/ae/c094bd4e161d89d21c5b8dcbe1178307a56eee3754f882ac78b9ea7d6eb0/unitxt-1.5.3-py3-none-any.whl (from https://pypi.org/simple/unitxt/) (requires-python:>=3.8) 2026-05-27T11:52:55,768 Found link https://files.pythonhosted.org/packages/5f/54/209ba8eae604f8d96ff4f4cf5b59eb462b942fd891bf37c0a5170a3efda5/unitxt-1.5.3.tar.gz (from https://pypi.org/simple/unitxt/) (requires-python:>=3.8), version: 1.5.3 2026-05-27T11:52:55,769 Skipping link: No binaries permitted for unitxt: https://files.pythonhosted.org/packages/48/c4/4d9be75082fb4ac0a20f208f16f606c81af9e2d3a8ca2e10d00a01907a5e/unitxt-1.6.0-py3-none-any.whl (from https://pypi.org/simple/unitxt/) (requires-python:>=3.8) 2026-05-27T11:52:55,770 Found link https://files.pythonhosted.org/packages/9b/0b/4112e4a959d3ba21750a69de68130b4b7bf8875e7497320ea2d8972dbbcf/unitxt-1.6.0.tar.gz (from https://pypi.org/simple/unitxt/) (requires-python:>=3.8), version: 1.6.0 2026-05-27T11:52:55,770 Skipping link: No binaries permitted for unitxt: https://files.pythonhosted.org/packages/e4/85/35d17f95e0c03d334fd146352f7a9848c46a2b705075eb99518617a6ac87/unitxt-1.6.1-py3-none-any.whl (from https://pypi.org/simple/unitxt/) (requires-python:>=3.8) 2026-05-27T11:52:55,771 Found link https://files.pythonhosted.org/packages/2f/09/1b17e594bcbcdefa162a51fe2b6a6e9ddc01bf95968d3bc8013252f76c47/unitxt-1.6.1.tar.gz (from https://pypi.org/simple/unitxt/) (requires-python:>=3.8), version: 1.6.1 2026-05-27T11:52:55,772 Skipping link: No binaries permitted for unitxt: https://files.pythonhosted.org/packages/5c/4e/a7a9c682050216382c3b59daf758c368ac5990db827bd71fd0f40867b72b/unitxt-1.6.2-py3-none-any.whl (from https://pypi.org/simple/unitxt/) (requires-python:>=3.8) 2026-05-27T11:52:55,773 Found link https://files.pythonhosted.org/packages/77/ca/76ad0c2aec3195f05513c5e524e44684dfdb6b50509217fc92cc63654b89/unitxt-1.6.2.tar.gz (from https://pypi.org/simple/unitxt/) (requires-python:>=3.8), version: 1.6.2 2026-05-27T11:52:55,774 Skipping link: No binaries permitted for unitxt: https://files.pythonhosted.org/packages/fb/df/1d62d1d50ac198ceb4029919403afffc2e8447924fa8a7dccacae2fbe254/unitxt-1.6.3-py3-none-any.whl (from https://pypi.org/simple/unitxt/) (requires-python:>=3.8) 2026-05-27T11:52:55,774 Found link https://files.pythonhosted.org/packages/0a/ff/fb18ad9a68114ebec6d83c4692bf76e798be8cb704601927b83c43e77468/unitxt-1.6.3.tar.gz (from https://pypi.org/simple/unitxt/) (requires-python:>=3.8), version: 1.6.3 2026-05-27T11:52:55,775 Skipping link: No binaries permitted for unitxt: https://files.pythonhosted.org/packages/f8/3c/00f9689dc044aefeb12cf6d1711be8b356c1b4a9e9064afbbf8ad3a0386a/unitxt-1.6.4-py3-none-any.whl (from https://pypi.org/simple/unitxt/) (requires-python:>=3.8) 2026-05-27T11:52:55,776 Found link https://files.pythonhosted.org/packages/d9/ce/e0a235cc4c3c4206dace6e136c2185c619e96cffaa8a89ce5c6b29d4d1d2/unitxt-1.6.4.tar.gz (from https://pypi.org/simple/unitxt/) (requires-python:>=3.8), version: 1.6.4 2026-05-27T11:52:55,776 Skipping link: No binaries permitted for unitxt: https://files.pythonhosted.org/packages/c9/6f/1e3cf56c018e921e962833129e9b2e3fdb217d13446069d14947226aa6ff/unitxt-1.6.5-py3-none-any.whl (from https://pypi.org/simple/unitxt/) (requires-python:>=3.8) 2026-05-27T11:52:55,777 Found link https://files.pythonhosted.org/packages/53/89/6402b06a2ee9c183e233fcb3ddf5e94acae69f3469db0dd4b9c832e1de06/unitxt-1.6.5.tar.gz (from https://pypi.org/simple/unitxt/) (requires-python:>=3.8), version: 1.6.5 2026-05-27T11:52:55,778 Skipping link: No binaries permitted for unitxt: https://files.pythonhosted.org/packages/a1/3a/38a54ad28c6001f2ed1cf9b473397d2e50b84562fbb6fc7ef8b12e2f8816/unitxt-1.6.6-py3-none-any.whl (from https://pypi.org/simple/unitxt/) (requires-python:>=3.8) 2026-05-27T11:52:55,779 Found link https://files.pythonhosted.org/packages/2b/68/686ca788728a7b0d9aed1e4554890249bf3b8913157f0af726dd001b6171/unitxt-1.6.6.tar.gz (from https://pypi.org/simple/unitxt/) (requires-python:>=3.8), version: 1.6.6 2026-05-27T11:52:55,779 Skipping link: No binaries permitted for unitxt: https://files.pythonhosted.org/packages/7c/b3/74575ea394250bbdc8cbec7bdee89e1dd256b98bd33c921fa3fb1c6da0de/unitxt-1.7.0-py3-none-any.whl (from https://pypi.org/simple/unitxt/) (requires-python:>=3.8) 2026-05-27T11:52:55,780 Found link https://files.pythonhosted.org/packages/7d/61/def0db05f178011014f52a1c6262782608f445d401aa9038cf7558df5501/unitxt-1.7.0.tar.gz (from https://pypi.org/simple/unitxt/) (requires-python:>=3.8), version: 1.7.0 2026-05-27T11:52:55,781 Skipping link: No binaries permitted for unitxt: https://files.pythonhosted.org/packages/96/3f/74f7b113d7374bae178602cd509611f4e22b71c4c2108b0a0cdb612478bb/unitxt-1.7.1-py3-none-any.whl (from https://pypi.org/simple/unitxt/) (requires-python:>=3.8) 2026-05-27T11:52:55,782 Found link https://files.pythonhosted.org/packages/03/4a/771ffed7a13ed4a5125a2f9b1a3f9bd8ca92bba1efce70816dfad2a3c847/unitxt-1.7.1.tar.gz (from https://pypi.org/simple/unitxt/) (requires-python:>=3.8), version: 1.7.1 2026-05-27T11:52:55,783 Skipping link: No binaries permitted for unitxt: https://files.pythonhosted.org/packages/77/4b/958241779f9e39e2a725e0c5a3b42a30093be8ed979bf3450a33d895eef0/unitxt-1.7.2-py3-none-any.whl (from https://pypi.org/simple/unitxt/) (requires-python:>=3.8) 2026-05-27T11:52:55,783 Found link https://files.pythonhosted.org/packages/71/e8/377300138eea7ddf4e8aca9e5fe027f726d79daea68ff3e5d507d839dc4d/unitxt-1.7.2.tar.gz (from https://pypi.org/simple/unitxt/) (requires-python:>=3.8), version: 1.7.2 2026-05-27T11:52:55,784 Skipping link: No binaries permitted for unitxt: https://files.pythonhosted.org/packages/6b/b5/144bcad686fd0856d5e55afa832af65c5a0ab1cd68e3f5810f99ecad6bbd/unitxt-1.7.3-py3-none-any.whl (from https://pypi.org/simple/unitxt/) (requires-python:>=3.8) 2026-05-27T11:52:55,785 Found link https://files.pythonhosted.org/packages/18/2d/285793d136c1b46181c23c8d5151f19c7f7bbd19df3aaca87c2feea32264/unitxt-1.7.3.tar.gz (from https://pypi.org/simple/unitxt/) (requires-python:>=3.8), version: 1.7.3 2026-05-27T11:52:55,785 Skipping link: No binaries permitted for unitxt: https://files.pythonhosted.org/packages/48/eb/08cbd79d2647219bc56b29fda798ac8f396447abe04ef3918bf209921fa5/unitxt-1.7.4-py3-none-any.whl (from https://pypi.org/simple/unitxt/) (requires-python:>=3.8) 2026-05-27T11:52:55,786 Found link https://files.pythonhosted.org/packages/8c/4e/07f3da23342b34a21bba87a3823a5b07fd9bb57ff000b9f4ca8a25a304a9/unitxt-1.7.4.tar.gz (from https://pypi.org/simple/unitxt/) (requires-python:>=3.8), version: 1.7.4 2026-05-27T11:52:55,787 Skipping link: No binaries permitted for unitxt: https://files.pythonhosted.org/packages/5f/1b/d91ad58df97b9d4abffe3fdb1ecc06f605100d4fc68aa0c648879dc17220/unitxt-1.7.6-py3-none-any.whl (from https://pypi.org/simple/unitxt/) (requires-python:>=3.8) 2026-05-27T11:52:55,788 Found link https://files.pythonhosted.org/packages/8e/cc/ca7a3f531f42997e7b57f60f863813242b20f75fedcf3680098b0564f7f0/unitxt-1.7.6.tar.gz (from https://pypi.org/simple/unitxt/) (requires-python:>=3.8), version: 1.7.6 2026-05-27T11:52:55,788 Skipping link: No binaries permitted for unitxt: https://files.pythonhosted.org/packages/c0/50/130797cf6027e03e31ced6dba58431c112dca7cb0d77aff444d152d5a9ee/unitxt-1.7.7-py3-none-any.whl (from https://pypi.org/simple/unitxt/) (requires-python:>=3.8) 2026-05-27T11:52:55,789 Found link https://files.pythonhosted.org/packages/11/90/50793b6f9dcde0a23dcf8de3e1d051835f23c76b66918248e21964456570/unitxt-1.7.7.tar.gz (from https://pypi.org/simple/unitxt/) (requires-python:>=3.8), version: 1.7.7 2026-05-27T11:52:55,790 Skipping link: No binaries permitted for unitxt: https://files.pythonhosted.org/packages/db/69/b40831baf977a856f684c3b17ba3b93cd7286a0711780f1669e44ef1cf87/unitxt-1.7.8-py3-none-any.whl (from https://pypi.org/simple/unitxt/) (requires-python:>=3.8) 2026-05-27T11:52:55,791 Found link https://files.pythonhosted.org/packages/2a/65/c423c9142c37ca5e6c04b07856aa4403cc8e7cd1ac082986c349bbba8d11/unitxt-1.7.8.tar.gz (from https://pypi.org/simple/unitxt/) (requires-python:>=3.8), version: 1.7.8 2026-05-27T11:52:55,792 Skipping link: No binaries permitted for unitxt: https://files.pythonhosted.org/packages/65/a4/082a98d142a50b232009deb8870060ed1159bef7c7700fc945a5e1b1c576/unitxt-1.7.9-py3-none-any.whl (from https://pypi.org/simple/unitxt/) (requires-python:>=3.8) 2026-05-27T11:52:55,792 Found link https://files.pythonhosted.org/packages/2c/74/aeb29b7ea4c2c5164d7ad2db78380dc0dafff3fb110e55f40990b7dfeb5f/unitxt-1.7.9.tar.gz (from https://pypi.org/simple/unitxt/) (requires-python:>=3.8), version: 1.7.9 2026-05-27T11:52:55,793 Skipping link: No binaries permitted for unitxt: https://files.pythonhosted.org/packages/40/22/f66ec5af55ff05232ceed6000fbdf9c0f9dd75440315c7d7db379484400a/unitxt-1.8.0-py3-none-any.whl (from https://pypi.org/simple/unitxt/) (requires-python:>=3.8) 2026-05-27T11:52:55,794 Found link https://files.pythonhosted.org/packages/f1/70/1567cb0df5f1ecb0b57b7af412afa3d4c6f4d55b13174287215027f78ee0/unitxt-1.8.0.tar.gz (from https://pypi.org/simple/unitxt/) (requires-python:>=3.8), version: 1.8.0 2026-05-27T11:52:55,795 Skipping link: No binaries permitted for unitxt: https://files.pythonhosted.org/packages/45/4f/35ddea885fbf44ed77f59878a8aeeb42bee610ef5c7816cd5686fe11c9e7/unitxt-1.8.1-py3-none-any.whl (from https://pypi.org/simple/unitxt/) (requires-python:>=3.8) 2026-05-27T11:52:55,796 Found link https://files.pythonhosted.org/packages/cf/47/2c4684544ff10770059aa0841f7c1c9f3749c5b0af58854b4199cf75c724/unitxt-1.8.1.tar.gz (from https://pypi.org/simple/unitxt/) (requires-python:>=3.8), version: 1.8.1 2026-05-27T11:52:55,797 Skipping link: No binaries permitted for unitxt: https://files.pythonhosted.org/packages/49/e2/99691f526c7e639ed85a90b7528e26d5ad78813f6f135ec3ae09243e074f/unitxt-1.9.0-py3-none-any.whl (from https://pypi.org/simple/unitxt/) (requires-python:>=3.8) 2026-05-27T11:52:55,797 Found link https://files.pythonhosted.org/packages/e2/98/69dd3bc53ec1d69f15725badf2b4d09e4f59c880d31d391b77e87271e189/unitxt-1.9.0.tar.gz (from https://pypi.org/simple/unitxt/) (requires-python:>=3.8), version: 1.9.0 2026-05-27T11:52:55,798 Skipping link: No binaries permitted for unitxt: https://files.pythonhosted.org/packages/b2/93/cf4654da1a4287252ef58b4ecc282652a22ae0e9e699489a59d8eb6c4770/unitxt-1.10.0-py3-none-any.whl (from https://pypi.org/simple/unitxt/) (requires-python:>=3.8) 2026-05-27T11:52:55,799 Found link https://files.pythonhosted.org/packages/e2/05/b391af435d7374e32801695929e2fff7b2b38c37269fa6f24ad88c5c1e1d/unitxt-1.10.0.tar.gz (from https://pypi.org/simple/unitxt/) (requires-python:>=3.8), version: 1.10.0 2026-05-27T11:52:55,799 Skipping link: No binaries permitted for unitxt: https://files.pythonhosted.org/packages/5b/78/1fd132e1b142d1d5b9fa0f45c1abee0f6f11845ec0383da05270641c714a/unitxt-1.10.1-py3-none-any.whl (from https://pypi.org/simple/unitxt/) (requires-python:>=3.8) 2026-05-27T11:52:55,800 Found link https://files.pythonhosted.org/packages/aa/2c/ff867c9050c46fe0ef969c854e8283395bcea3a9422699783daab29a65ce/unitxt-1.10.1.tar.gz (from https://pypi.org/simple/unitxt/) (requires-python:>=3.8), version: 1.10.1 2026-05-27T11:52:55,801 Skipping link: No binaries permitted for unitxt: https://files.pythonhosted.org/packages/c6/6b/15a29c9c043b70f10bcfe734e69738868cc02ba854d27d5dc3c38148d638/unitxt-1.10.2-py3-none-any.whl (from https://pypi.org/simple/unitxt/) (requires-python:>=3.8) 2026-05-27T11:52:55,802 Found link https://files.pythonhosted.org/packages/ca/bb/36c17130bed6f135a9c8134171f24ce088116ec7e181fb20cdc010d236e1/unitxt-1.10.2.tar.gz (from https://pypi.org/simple/unitxt/) (requires-python:>=3.8), version: 1.10.2 2026-05-27T11:52:55,802 Skipping link: No binaries permitted for unitxt: https://files.pythonhosted.org/packages/ec/59/9f689da2b9d027dc6154a1584e73bcfd395d2ea21f87b89a331920de39f2/unitxt-1.10.3-py3-none-any.whl (from https://pypi.org/simple/unitxt/) (requires-python:>=3.8) 2026-05-27T11:52:55,803 Found link https://files.pythonhosted.org/packages/a5/c2/3502bc5d54fce05e84631015febc3009accf02fe17ebcfe21f8957b41038/unitxt-1.10.3.tar.gz (from https://pypi.org/simple/unitxt/) (requires-python:>=3.8), version: 1.10.3 2026-05-27T11:52:55,804 Skipping link: No binaries permitted for unitxt: https://files.pythonhosted.org/packages/ba/72/38562d593bfbad59884388397d349c02a43f506522a6c38f5f880e33a5c0/unitxt-1.11.0-py3-none-any.whl (from https://pypi.org/simple/unitxt/) (requires-python:>=3.8) 2026-05-27T11:52:55,805 Found link https://files.pythonhosted.org/packages/15/c1/f5691d721631c0dfda9081520048d9f5040006c94bf58a71589448b70ce7/unitxt-1.11.0.tar.gz (from https://pypi.org/simple/unitxt/) (requires-python:>=3.8), version: 1.11.0 2026-05-27T11:52:55,805 Skipping link: No binaries permitted for unitxt: https://files.pythonhosted.org/packages/26/22/9a3ee0912f98885f654beebb03f90294c0fd957c8114ca69bf29e12ad1f6/unitxt-1.11.1-py3-none-any.whl (from https://pypi.org/simple/unitxt/) (requires-python:>=3.8) 2026-05-27T11:52:55,806 Found link https://files.pythonhosted.org/packages/8b/a3/98734125bc1418eff9a00cd296ae17fa485778e8d652a3c245d7a1f73fef/unitxt-1.11.1.tar.gz (from https://pypi.org/simple/unitxt/) (requires-python:>=3.8), version: 1.11.1 2026-05-27T11:52:55,807 Skipping link: No binaries permitted for unitxt: https://files.pythonhosted.org/packages/e1/6e/302b606ffd159dab1261e61aa1f0fe64a7ed6158318ac867b5c832b51e97/unitxt-1.12.0-py3-none-any.whl (from https://pypi.org/simple/unitxt/) (requires-python:>=3.8) 2026-05-27T11:52:55,808 Found link https://files.pythonhosted.org/packages/0c/4a/c0fbee3975ec2fd18df6953120dc221a6191d4d29d89bc52ce4ec3c4718a/unitxt-1.12.0.tar.gz (from https://pypi.org/simple/unitxt/) (requires-python:>=3.8), version: 1.12.0 2026-05-27T11:52:55,808 Skipping link: No binaries permitted for unitxt: https://files.pythonhosted.org/packages/53/aa/fcc64d0486e683ee91b098729a57cdee00b551feae7c3c906c04aa8c082c/unitxt-1.12.2-py3-none-any.whl (from https://pypi.org/simple/unitxt/) (requires-python:>=3.8) 2026-05-27T11:52:55,809 Found link https://files.pythonhosted.org/packages/61/c2/6788469e9954b4d1dc725ea03b8a8d849c3484943bc4f56f33a7b5590311/unitxt-1.12.2.tar.gz (from https://pypi.org/simple/unitxt/) (requires-python:>=3.8), version: 1.12.2 2026-05-27T11:52:55,810 Skipping link: No binaries permitted for unitxt: https://files.pythonhosted.org/packages/34/ca/f36cf428780f82b96cfddf15e66ab362a0f5e67689758cbf16109b49f23d/unitxt-1.12.3-py3-none-any.whl (from https://pypi.org/simple/unitxt/) (requires-python:>=3.8) 2026-05-27T11:52:55,811 Found link https://files.pythonhosted.org/packages/2e/a0/129850543fe0585c455d5d473e7d65a6c510ff9d562e2601ba2945052382/unitxt-1.12.3.tar.gz (from https://pypi.org/simple/unitxt/) (requires-python:>=3.8), version: 1.12.3 2026-05-27T11:52:55,811 Skipping link: No binaries permitted for unitxt: https://files.pythonhosted.org/packages/a4/0e/5ce073bfde80fb99cd1b6ef3725627ebc03221170fc6d7b669d464466e9d/unitxt-1.12.4-py3-none-any.whl (from https://pypi.org/simple/unitxt/) (requires-python:>=3.8) 2026-05-27T11:52:55,812 Found link https://files.pythonhosted.org/packages/e8/0b/f1be5a140bf9b321b27446182f0a0d1d36815ba2d4ca01ab7c5e7a186bba/unitxt-1.12.4.tar.gz (from https://pypi.org/simple/unitxt/) (requires-python:>=3.8), version: 1.12.4 2026-05-27T11:52:55,813 Skipping link: No binaries permitted for unitxt: https://files.pythonhosted.org/packages/ce/22/9eb17d4ffd417aaee5bc2d92b1846237b96198bba297f98ff87d07e1a345/unitxt-1.13.0-py3-none-any.whl (from https://pypi.org/simple/unitxt/) (requires-python:>=3.8) 2026-05-27T11:52:55,814 Found link https://files.pythonhosted.org/packages/f6/85/10188d25411e97b47f42a6e1d58dc7ca68537a6cf26acfc3089e8608a98c/unitxt-1.13.0.tar.gz (from https://pypi.org/simple/unitxt/) (requires-python:>=3.8), version: 1.13.0 2026-05-27T11:52:55,814 Skipping link: No binaries permitted for unitxt: https://files.pythonhosted.org/packages/da/61/1e51d544f85194f8c2d614ddb8f33a0d6b9cce39e3419b7d0cd6a02a17dc/unitxt-1.13.1-py3-none-any.whl (from https://pypi.org/simple/unitxt/) (requires-python:>=3.8) 2026-05-27T11:52:55,815 Found link https://files.pythonhosted.org/packages/cc/b1/fab39a111d07c512f66ecca4e34f887539b1c1cf3251c6e4bd3c3c1535b2/unitxt-1.13.1.tar.gz (from https://pypi.org/simple/unitxt/) (requires-python:>=3.8), version: 1.13.1 2026-05-27T11:52:55,816 Skipping link: No binaries permitted for unitxt: https://files.pythonhosted.org/packages/07/bc/91c014790d9cfb9742766c0c76928dac7313c183fac30e40a158bcbe5fc7/unitxt-1.14.0-py3-none-any.whl (from https://pypi.org/simple/unitxt/) (requires-python:>=3.8) 2026-05-27T11:52:55,817 Found link https://files.pythonhosted.org/packages/70/24/78cc6337efc8e99c168dac278e70eccfa344669e06e89403bc77e526bec9/unitxt-1.14.0.tar.gz (from https://pypi.org/simple/unitxt/) (requires-python:>=3.8), version: 1.14.0 2026-05-27T11:52:55,818 Skipping link: No binaries permitted for unitxt: https://files.pythonhosted.org/packages/f7/de/756bf8d48d4b998e3a16c3c754231d6655be5ba2784f50014e138975279f/unitxt-1.14.1-py3-none-any.whl (from https://pypi.org/simple/unitxt/) (requires-python:>=3.8) 2026-05-27T11:52:55,818 Found link https://files.pythonhosted.org/packages/4a/68/dfc467083e42ee09998e108b4347c740121c9c22940dbef280f52d55facf/unitxt-1.14.1.tar.gz (from https://pypi.org/simple/unitxt/) (requires-python:>=3.8), version: 1.14.1 2026-05-27T11:52:55,819 Skipping link: No binaries permitted for unitxt: https://files.pythonhosted.org/packages/c7/77/4f5ddf5e206df145db14fb61687457f082c9797da4e96ca54b7685245718/unitxt-1.15.6-py3-none-any.whl (from https://pypi.org/simple/unitxt/) (requires-python:>=3.8) 2026-05-27T11:52:55,820 Found link https://files.pythonhosted.org/packages/b9/f0/de2fba113f54a3da5bba12b570d95591dca28b05fb98209a54a1c0f7a4bd/unitxt-1.15.6.tar.gz (from https://pypi.org/simple/unitxt/) (requires-python:>=3.8), version: 1.15.6 2026-05-27T11:52:55,821 Skipping link: No binaries permitted for unitxt: https://files.pythonhosted.org/packages/48/3f/dee7f199ed4b28c0cad74bce821b3a94f45470535f496b4578c267144ec7/unitxt-1.15.7-py3-none-any.whl (from https://pypi.org/simple/unitxt/) (requires-python:>=3.8) 2026-05-27T11:52:55,822 Found link https://files.pythonhosted.org/packages/0b/6d/f1a559b32a7c43e7804936b1e51cafd0b04fcf31a72b28cd1989e7a0680c/unitxt-1.15.7.tar.gz (from https://pypi.org/simple/unitxt/) (requires-python:>=3.8), version: 1.15.7 2026-05-27T11:52:55,822 Skipping link: No binaries permitted for unitxt: https://files.pythonhosted.org/packages/c5/20/0f408a271a4b7496cc9351196dfaf0d4eb21ed443a4c0bdf6a8f224bcb15/unitxt-1.15.8-py3-none-any.whl (from https://pypi.org/simple/unitxt/) (requires-python:>=3.8) 2026-05-27T11:52:55,823 Found link https://files.pythonhosted.org/packages/a1/7e/aee80d7b5565d02a012070d7fd37631a47b70da99976d58fd2c7980d8d9a/unitxt-1.15.8.tar.gz (from https://pypi.org/simple/unitxt/) (requires-python:>=3.8), version: 1.15.8 2026-05-27T11:52:55,824 Skipping link: No binaries permitted for unitxt: https://files.pythonhosted.org/packages/39/e7/4c4ae5000ffaafcaec7644dcaad1afee8ef4baf035a1c0ed52f0df988c6b/unitxt-1.15.9-py3-none-any.whl (from https://pypi.org/simple/unitxt/) (requires-python:>=3.8) 2026-05-27T11:52:55,825 Found link https://files.pythonhosted.org/packages/ba/e2/45cd1839c84b9c0651451e9abd364f058aed4b0a4a725573ad2e6d3b87aa/unitxt-1.15.9.tar.gz (from https://pypi.org/simple/unitxt/) (requires-python:>=3.8), version: 1.15.9 2026-05-27T11:52:55,825 Skipping link: No binaries permitted for unitxt: https://files.pythonhosted.org/packages/dc/ef/9cffc953f5ea4eb17698c1163819afa181a9d8892672114131ccffcb9699/unitxt-1.15.10-py3-none-any.whl (from https://pypi.org/simple/unitxt/) (requires-python:>=3.8) 2026-05-27T11:52:55,826 Found link https://files.pythonhosted.org/packages/7a/8a/eb348a8a441071e738673e838766135dbe85971aab5bf5647b648bd8f9b1/unitxt-1.15.10.tar.gz (from https://pypi.org/simple/unitxt/) (requires-python:>=3.8), version: 1.15.10 2026-05-27T11:52:55,827 Skipping link: No binaries permitted for unitxt: https://files.pythonhosted.org/packages/c1/a1/5101918d00f623986322f755d775ababff05c0d9efd469a6d8b289e4af28/unitxt-1.16.0-py3-none-any.whl (from https://pypi.org/simple/unitxt/) (requires-python:>=3.8) 2026-05-27T11:52:55,828 Found link https://files.pythonhosted.org/packages/af/52/fa432517d161487482a062fe1bce3dfebf532e5d5a9a3571af65ef2642ea/unitxt-1.16.0.tar.gz (from https://pypi.org/simple/unitxt/) (requires-python:>=3.8), version: 1.16.0 2026-05-27T11:52:55,828 Skipping link: No binaries permitted for unitxt: https://files.pythonhosted.org/packages/68/39/ec4043f2009ac9ca7ab6920384e9b7eed0dc83f6629cce3c157528838cc8/unitxt-1.16.1-py3-none-any.whl (from https://pypi.org/simple/unitxt/) (requires-python:>=3.8) 2026-05-27T11:52:55,829 Found link https://files.pythonhosted.org/packages/05/7a/795a963d77756283170bb036ffbabcd4558637addc387164fd05b5307ec8/unitxt-1.16.1.tar.gz (from https://pypi.org/simple/unitxt/) (requires-python:>=3.8), version: 1.16.1 2026-05-27T11:52:55,830 Skipping link: No binaries permitted for unitxt: https://files.pythonhosted.org/packages/eb/82/36c6929e0098c2a8dbbf0c87e4d0dc3c57e82e88446a42a2195e3bf714c6/unitxt-1.16.2-py3-none-any.whl (from https://pypi.org/simple/unitxt/) (requires-python:>=3.8) 2026-05-27T11:52:55,831 Found link https://files.pythonhosted.org/packages/39/6e/b9d2ec30ad363fee9f5b9af3a9cbeaa1ff17552617acf55a37825663ebcc/unitxt-1.16.2.tar.gz (from https://pypi.org/simple/unitxt/) (requires-python:>=3.8), version: 1.16.2 2026-05-27T11:52:55,832 Skipping link: No binaries permitted for unitxt: https://files.pythonhosted.org/packages/d5/7a/10608d7223e148fd77fbe44a8c50e9069dcdce3331c0f561bf7ddcae791d/unitxt-1.16.3-py3-none-any.whl (from https://pypi.org/simple/unitxt/) (requires-python:>=3.8) 2026-05-27T11:52:55,833 Found link https://files.pythonhosted.org/packages/70/99/c9af119e0ee12a03e4eb1aba238de3cbdcedee4428389f6729631f0accba/unitxt-1.16.3.tar.gz (from https://pypi.org/simple/unitxt/) (requires-python:>=3.8), version: 1.16.3 2026-05-27T11:52:55,834 Skipping link: No binaries permitted for unitxt: https://files.pythonhosted.org/packages/12/4b/f32a0b0faaff9f9313b7c545ff694c388c049bf94b065440d4c385c92ef5/unitxt-1.16.4-py3-none-any.whl (from https://pypi.org/simple/unitxt/) (requires-python:>=3.8) 2026-05-27T11:52:55,834 Found link https://files.pythonhosted.org/packages/95/81/aa5f10427622f38453ac1886ac01e15cbcc2f1c9ff18d94c347ae2a8095a/unitxt-1.16.4.tar.gz (from https://pypi.org/simple/unitxt/) (requires-python:>=3.8), version: 1.16.4 2026-05-27T11:52:55,835 Skipping link: No binaries permitted for unitxt: https://files.pythonhosted.org/packages/dc/7f/1326785089371de1104510f16bdca0ae45b8f15323d0eddf73d8d8a8a4ac/unitxt-1.17.0-py3-none-any.whl (from https://pypi.org/simple/unitxt/) (requires-python:>=3.8) 2026-05-27T11:52:55,836 Found link https://files.pythonhosted.org/packages/4e/58/186b6b1966401921b2f1f28a3fec113271eb9fb07e404b034aa11314950a/unitxt-1.17.0.tar.gz (from https://pypi.org/simple/unitxt/) (requires-python:>=3.8), version: 1.17.0 2026-05-27T11:52:55,836 Skipping link: No binaries permitted for unitxt: https://files.pythonhosted.org/packages/4f/e3/a56211d050bab7c9f47d66a3ae79341504068c57afdafdc198ac9d3e8423/unitxt-1.17.1-py3-none-any.whl (from https://pypi.org/simple/unitxt/) (requires-python:>=3.8) 2026-05-27T11:52:55,837 Found link https://files.pythonhosted.org/packages/0a/fe/3840438766376433e26ee3bcfae015aa54bb90b81d1f908e3f43efe1aec3/unitxt-1.17.1.tar.gz (from https://pypi.org/simple/unitxt/) (requires-python:>=3.8), version: 1.17.1 2026-05-27T11:52:55,838 Skipping link: No binaries permitted for unitxt: https://files.pythonhosted.org/packages/c1/f7/331ef88d7a201fa6fab7aa3c4da5e362dbc42ee7cb438f4598289ef4173c/unitxt-1.17.2-py3-none-any.whl (from https://pypi.org/simple/unitxt/) (requires-python:>=3.8) 2026-05-27T11:52:55,839 Found link https://files.pythonhosted.org/packages/96/cb/bf79447be5333489a539cb339caa4755990a03ea1f0a72b06d4fd5cad91a/unitxt-1.17.2.tar.gz (from https://pypi.org/simple/unitxt/) (requires-python:>=3.8), version: 1.17.2 2026-05-27T11:52:55,840 Skipping link: No binaries permitted for unitxt: https://files.pythonhosted.org/packages/7f/54/c07931fdfde9216bfdbfc0f750c6ac4b4dac699b45f2743750097f3c3282/unitxt-1.18.0-py3-none-any.whl (from https://pypi.org/simple/unitxt/) (requires-python:>=3.8) 2026-05-27T11:52:55,841 Found link https://files.pythonhosted.org/packages/7f/b9/40673c1639ea52b808066a58c2a6d7728760c720a7a67189a05126c62eec/unitxt-1.18.0.tar.gz (from https://pypi.org/simple/unitxt/) (requires-python:>=3.8), version: 1.18.0 2026-05-27T11:52:55,841 Skipping link: No binaries permitted for unitxt: https://files.pythonhosted.org/packages/8f/be/5b04f2a962f443fb1232385056a66030703a1ea5eb0668717a50f4624950/unitxt-1.19.0-py3-none-any.whl (from https://pypi.org/simple/unitxt/) (requires-python:>=3.8) 2026-05-27T11:52:55,842 Found link https://files.pythonhosted.org/packages/84/0c/7bbf65409b22d468f9263d527a51530a489f3fccb8faba33ab6b151b0c09/unitxt-1.19.0.tar.gz (from https://pypi.org/simple/unitxt/) (requires-python:>=3.8), version: 1.19.0 2026-05-27T11:52:55,843 Skipping link: No binaries permitted for unitxt: https://files.pythonhosted.org/packages/a7/65/6d51e684ab355851a671f1277aec67c3f202bef15657b6e2e03d9fc035c6/unitxt-1.20.0-py3-none-any.whl (from https://pypi.org/simple/unitxt/) (requires-python:>=3.8) 2026-05-27T11:52:55,844 Found link https://files.pythonhosted.org/packages/95/ea/67cb2f1c98950176d24cf36aaa708e8574df868c62f9c244839c1757d3bc/unitxt-1.20.0.tar.gz (from https://pypi.org/simple/unitxt/) (requires-python:>=3.8), version: 1.20.0 2026-05-27T11:52:55,845 Skipping link: No binaries permitted for unitxt: https://files.pythonhosted.org/packages/51/22/104bc58e591adf8c1ab5aa7394dac2f4b8c9d6d049864c06ff5f0761d0bd/unitxt-1.21.0-py3-none-any.whl (from https://pypi.org/simple/unitxt/) (requires-python:>=3.8) 2026-05-27T11:52:55,846 Found link https://files.pythonhosted.org/packages/07/11/212b1d9b9a0125adf6df3fc61f764f7779a5722fc3a7800346669e591300/unitxt-1.21.0.tar.gz (from https://pypi.org/simple/unitxt/) (requires-python:>=3.8), version: 1.21.0 2026-05-27T11:52:55,846 Skipping link: No binaries permitted for unitxt: https://files.pythonhosted.org/packages/35/b0/31d6a49431770663f238eca5d76c0bafe7d094c0cb6c8a0fe7142b7c3f14/unitxt-1.22.0-py3-none-any.whl (from https://pypi.org/simple/unitxt/) (requires-python:>=3.8) 2026-05-27T11:52:55,847 Found link https://files.pythonhosted.org/packages/65/dc/648810f78839db26139e88b7388f9f3481578e0005c406adb7727227e0b1/unitxt-1.22.0.tar.gz (from https://pypi.org/simple/unitxt/) (requires-python:>=3.8), version: 1.22.0 2026-05-27T11:52:55,848 Skipping link: No binaries permitted for unitxt: https://files.pythonhosted.org/packages/20/47/c7fc9adca33de9c0183d4be4a6a0f4ef204cbe08395aed0f34910738b0f1/unitxt-1.22.1-py3-none-any.whl (from https://pypi.org/simple/unitxt/) (requires-python:>=3.8) 2026-05-27T11:52:55,849 Found link https://files.pythonhosted.org/packages/9a/bb/31f76a0c74d78150a845cd4e46c5a385d41cd25aa189e2665c249b81c775/unitxt-1.22.1.tar.gz (from https://pypi.org/simple/unitxt/) (requires-python:>=3.8), version: 1.22.1 2026-05-27T11:52:55,849 Skipping link: No binaries permitted for unitxt: https://files.pythonhosted.org/packages/71/25/7381055a00d191f137f01c85ba18ab1c78317a68fbe1d2695862134211bf/unitxt-1.22.2-py3-none-any.whl (from https://pypi.org/simple/unitxt/) (requires-python:>=3.8) 2026-05-27T11:52:55,850 Found link https://files.pythonhosted.org/packages/50/b8/3605637a5a8632e761261c15f586f45055871dea28db9196bc813d98acbd/unitxt-1.22.2.tar.gz (from https://pypi.org/simple/unitxt/) (requires-python:>=3.8), version: 1.22.2 2026-05-27T11:52:55,851 Skipping link: No binaries permitted for unitxt: https://files.pythonhosted.org/packages/6e/9e/53c5da526410e603534303eb0a8d317c00a448f0ce284dee30c8e1e81a0c/unitxt-1.22.3-py3-none-any.whl (from https://pypi.org/simple/unitxt/) (requires-python:>=3.8) 2026-05-27T11:52:55,852 Found link https://files.pythonhosted.org/packages/a9/a1/c0863aee6a05bde3d3cc2bd4334483cd5198f1a8dff3c662d0744800af78/unitxt-1.22.3.tar.gz (from https://pypi.org/simple/unitxt/) (requires-python:>=3.8), version: 1.22.3 2026-05-27T11:52:55,853 Skipping link: No binaries permitted for unitxt: https://files.pythonhosted.org/packages/0f/87/03ed3b5edfd7b5d34d4deb6a12ef02e7834b1db0c873acbe69096b1fa8ba/unitxt-1.22.4-py3-none-any.whl (from https://pypi.org/simple/unitxt/) (requires-python:>=3.8) 2026-05-27T11:52:55,854 Found link https://files.pythonhosted.org/packages/db/bf/7b3fba584153936ba717c3865374633bc451e3ba420f71e617b71b478f18/unitxt-1.22.4.tar.gz (from https://pypi.org/simple/unitxt/) (requires-python:>=3.8), version: 1.22.4 2026-05-27T11:52:55,854 Skipping link: No binaries permitted for unitxt: https://files.pythonhosted.org/packages/36/47/65d15e6072dff8f6df1a263d047d7c07c75f364cb4baf286aa369409c9a0/unitxt-1.23.0-py3-none-any.whl (from https://pypi.org/simple/unitxt/) (requires-python:>=3.8) 2026-05-27T11:52:55,855 Found link https://files.pythonhosted.org/packages/28/06/90d21fd59a884150b97d2439e879c1ab1655d49ab125b696b66d371a56d1/unitxt-1.23.0.tar.gz (from https://pypi.org/simple/unitxt/) (requires-python:>=3.8), version: 1.23.0 2026-05-27T11:52:55,856 Skipping link: No binaries permitted for unitxt: https://files.pythonhosted.org/packages/62/de/a84986a8c771bd8c2de4d82b9ec9654eec0701db30b5269a1c98b0b40e72/unitxt-1.23.1-py3-none-any.whl (from https://pypi.org/simple/unitxt/) (requires-python:>=3.8) 2026-05-27T11:52:55,857 Found link https://files.pythonhosted.org/packages/c2/09/8d2aed1843a291ebc1ee82ce32bf8815a9eb65fcd6bacc70d38f23cc2e44/unitxt-1.23.1.tar.gz (from https://pypi.org/simple/unitxt/) (requires-python:>=3.8), version: 1.23.1 2026-05-27T11:52:55,858 Skipping link: No binaries permitted for unitxt: https://files.pythonhosted.org/packages/d7/61/73e8fcb9a33dfaed609eb52301656bccc21a4e372a970d98706c948e2ce9/unitxt-1.24.0-py3-none-any.whl (from https://pypi.org/simple/unitxt/) (requires-python:>=3.8) 2026-05-27T11:52:55,859 Found link https://files.pythonhosted.org/packages/3d/2e/abf220721625586c937585370a93bb0e6e9bd6462cf8313565c5c7107a64/unitxt-1.24.0.tar.gz (from https://pypi.org/simple/unitxt/) (requires-python:>=3.8), version: 1.24.0 2026-05-27T11:52:55,859 Skipping link: No binaries permitted for unitxt: https://files.pythonhosted.org/packages/27/f5/0b39aa090e8e3f431ca9cdb56da92af77982a0497f7853cb1aa60f1c1943/unitxt-1.25.0-py3-none-any.whl (from https://pypi.org/simple/unitxt/) (requires-python:>=3.8) 2026-05-27T11:52:55,860 Found link https://files.pythonhosted.org/packages/d1/35/4f3bb7d13a262470c6cde689b3ded940988220a2140f4781c747fac6654c/unitxt-1.25.0.tar.gz (from https://pypi.org/simple/unitxt/) (requires-python:>=3.8), version: 1.25.0 2026-05-27T11:52:55,861 Skipping link: No binaries permitted for unitxt: https://files.pythonhosted.org/packages/3f/df/cd7c2bb8bafe0fc13e825f9b2d93c205804642a7460637c3d4b595d976c9/unitxt-1.26.0-py3-none-any.whl (from https://pypi.org/simple/unitxt/) (requires-python:>=3.8) 2026-05-27T11:52:55,862 Found link https://files.pythonhosted.org/packages/8e/88/434ccf056e5899cdb0664793110f8865bfa76af5ad0b801edbfdb756e937/unitxt-1.26.0.tar.gz (from https://pypi.org/simple/unitxt/) (requires-python:>=3.8), version: 1.26.0 2026-05-27T11:52:55,862 Skipping link: No binaries permitted for unitxt: https://files.pythonhosted.org/packages/ba/93/2d917b7d44136fcecbe432242b3f862e282afb06a3cebdf3b7a80c2fd97d/unitxt-1.26.1-py3-none-any.whl (from https://pypi.org/simple/unitxt/) (requires-python:>=3.8) 2026-05-27T11:52:55,863 Found link https://files.pythonhosted.org/packages/9b/df/e79513c8324b6e06982e5f951a5ce10d529261f6c4018d83148f1d0aae34/unitxt-1.26.1.tar.gz (from https://pypi.org/simple/unitxt/) (requires-python:>=3.8), version: 1.26.1 2026-05-27T11:52:55,864 Skipping link: No binaries permitted for unitxt: https://files.pythonhosted.org/packages/b4/18/b5e41a3e4c3f932cf3b85aa07f9946c58002ac0197a388e764cedf270521/unitxt-1.26.2-py3-none-any.whl (from https://pypi.org/simple/unitxt/) (requires-python:>=3.8) 2026-05-27T11:52:55,865 Found link https://files.pythonhosted.org/packages/c4/3e/327710b0d0b2d3486c91dc6fd19c788373f48ec5819ae4a8c4d8df2af22b/unitxt-1.26.2.tar.gz (from https://pypi.org/simple/unitxt/) (requires-python:>=3.8), version: 1.26.2 2026-05-27T11:52:55,866 Skipping link: No binaries permitted for unitxt: https://files.pythonhosted.org/packages/c3/8a/2b2328bb2ca0a7521de1c77b168081738ed27a43b0b24c35c438f73e33d3/unitxt-1.26.3-py3-none-any.whl (from https://pypi.org/simple/unitxt/) (requires-python:>=3.8) 2026-05-27T11:52:55,867 Found link https://files.pythonhosted.org/packages/8d/71/0026f05fa1b0bfc72d541f4225301b174ff498a9f31ce4c43f4aeb30991a/unitxt-1.26.3.tar.gz (from https://pypi.org/simple/unitxt/) (requires-python:>=3.8), version: 1.26.3 2026-05-27T11:52:55,867 Skipping link: No binaries permitted for unitxt: https://files.pythonhosted.org/packages/21/8e/6b80f38968d2028d29cfd73a4e35f88deb7b9b25d6560ec0321dfefba17a/unitxt-1.26.4-py3-none-any.whl (from https://pypi.org/simple/unitxt/) (requires-python:>=3.8) 2026-05-27T11:52:55,868 Found link https://files.pythonhosted.org/packages/8b/63/25be472438554113d73bd0ba6376796896a681d39eefbf6c84f360c4513d/unitxt-1.26.4.tar.gz (from https://pypi.org/simple/unitxt/) (requires-python:>=3.8), version: 1.26.4 2026-05-27T11:52:55,869 Skipping link: No binaries permitted for unitxt: https://files.pythonhosted.org/packages/a6/c0/f71a77e934bdbf92d27e4aaa43f5fb2a7344cb9a3b5da54ba4c307803f21/unitxt-1.26.5-py3-none-any.whl (from https://pypi.org/simple/unitxt/) (requires-python:>=3.8) 2026-05-27T11:52:55,870 Found link https://files.pythonhosted.org/packages/b7/a6/f340d3caad1c471163ff69e4887e9fe268531e3e2923fab16c1d72708d5f/unitxt-1.26.5.tar.gz (from https://pypi.org/simple/unitxt/) (requires-python:>=3.8), version: 1.26.5 2026-05-27T11:52:55,871 Skipping link: No binaries permitted for unitxt: https://files.pythonhosted.org/packages/61/b8/94feb68e8c5b41218d6628669f5810d6b355dfa06d1db9ced22025b1b28c/unitxt-1.26.6-py3-none-any.whl (from https://pypi.org/simple/unitxt/) (requires-python:>=3.8) 2026-05-27T11:52:55,872 Found link https://files.pythonhosted.org/packages/d8/7e/db3a123bd5e8220299d10e9b7d6f7d3072b8f878708a13113bd5dc61e52a/unitxt-1.26.6.tar.gz (from https://pypi.org/simple/unitxt/) (requires-python:>=3.8), version: 1.26.6 2026-05-27T11:52:55,873 Skipping link: No binaries permitted for unitxt: https://files.pythonhosted.org/packages/22/0a/36d6c355c916eb5082323c8458f3185018d826956e673a6c09cd033e801a/unitxt-1.26.7-py3-none-any.whl (from https://pypi.org/simple/unitxt/) (requires-python:>=3.8) 2026-05-27T11:52:55,873 Found link https://files.pythonhosted.org/packages/aa/b1/e123a7cabdda6c77cce021925e68b3c6b420a8017884736181f147f1ca33/unitxt-1.26.7.tar.gz (from https://pypi.org/simple/unitxt/) (requires-python:>=3.8), version: 1.26.7 2026-05-27T11:52:55,874 Skipping link: No binaries permitted for unitxt: https://files.pythonhosted.org/packages/50/85/094363f7f5da524949ed6c4ab16024f36c3d3a2ec60e25291f7a32d2f5c6/unitxt-1.26.8-py3-none-any.whl (from https://pypi.org/simple/unitxt/) (requires-python:>=3.8) 2026-05-27T11:52:55,875 Found link https://files.pythonhosted.org/packages/45/a0/2498b08680bf78163321840c236322cf49422fac1f7afd0eebc7b4aa643d/unitxt-1.26.8.tar.gz (from https://pypi.org/simple/unitxt/) (requires-python:>=3.8), version: 1.26.8 2026-05-27T11:52:55,876 Skipping link: No binaries permitted for unitxt: https://files.pythonhosted.org/packages/fe/2d/1c720fbb87b82ba7d13334c95e02ebaf8c476bde3753ada39d2acd65093e/unitxt-1.26.9-py3-none-any.whl (from https://pypi.org/simple/unitxt/) (requires-python:>=3.8) 2026-05-27T11:52:55,876 Found link https://files.pythonhosted.org/packages/7a/0c/01cd186889d2b44f8ddc51c5992b5d9e37fcd2d93e92ba7c6739a9c3fa52/unitxt-1.26.9.tar.gz (from https://pypi.org/simple/unitxt/) (requires-python:>=3.8), version: 1.26.9 2026-05-27T11:52:55,877 Skipping link: No binaries permitted for unitxt: https://files.pythonhosted.org/packages/70/9f/a22c18b83d345b1651eb245ddc03c77e94f6d2294d7cd041c6dc98978af8/unitxt-1.26.10-py3-none-any.whl (from https://pypi.org/simple/unitxt/) (requires-python:>=3.8) 2026-05-27T11:52:55,878 Found link https://files.pythonhosted.org/packages/8d/68/cda80f4fdc32aa5f8753d5ffe70d5110b9dc25956b15a8b579c72e033c95/unitxt-1.26.10.tar.gz (from https://pypi.org/simple/unitxt/) (requires-python:>=3.8), version: 1.26.10 2026-05-27T11:52:55,879 Fetching project page and analyzing links: https://www.piwheels.org/simple/unitxt/ 2026-05-27T11:52:55,880 Getting page https://www.piwheels.org/simple/unitxt/ 2026-05-27T11:52:55,881 Found index url https://www.piwheels.org/simple 2026-05-27T11:52:56,056 Fetched page https://www.piwheels.org/simple/unitxt/ as text/html 2026-05-27T11:52:56,068 Skipping link: No binaries permitted for unitxt: https://archive1.piwheels.org/simple/unitxt/unitxt-1.26.9-py3-none-any.whl#sha256=5fe92873dfcbcd84bd82e870085e9f280d68b7de9948a1d2e1e75a4ab07ba5c4 (from https://www.piwheels.org/simple/unitxt/) (requires-python:>=3.8) 2026-05-27T11:52:56,068 Skipping link: No binaries permitted for unitxt: https://archive1.piwheels.org/simple/unitxt/unitxt-1.26.8-py3-none-any.whl#sha256=abc967e670a81c20b6c1fe69a6a23a6861304793df40d094d5fa4ba4a5112a80 (from https://www.piwheels.org/simple/unitxt/) (requires-python:>=3.8) 2026-05-27T11:52:56,069 Skipping link: No binaries permitted for unitxt: https://archive1.piwheels.org/simple/unitxt/unitxt-1.26.7-py3-none-any.whl#sha256=1bf931de32df61cc6593135d9767737307d7fde8765e0b15dcacd20bd488e53e (from https://www.piwheels.org/simple/unitxt/) (requires-python:>=3.8) 2026-05-27T11:52:56,070 Skipping link: No binaries permitted for unitxt: https://archive1.piwheels.org/simple/unitxt/unitxt-1.26.6-py3-none-any.whl#sha256=5cdb7b8221f1a7997250d9aaf8b089439479a9c547e674573b4b22a7003ba664 (from https://www.piwheels.org/simple/unitxt/) (requires-python:>=3.8) 2026-05-27T11:52:56,070 Skipping link: No binaries permitted for unitxt: https://archive1.piwheels.org/simple/unitxt/unitxt-1.26.5-py3-none-any.whl#sha256=50928ba0f2db3e11d754b5d360806bcaed7889def23311e08bb674682bf82dad (from https://www.piwheels.org/simple/unitxt/) (requires-python:>=3.8) 2026-05-27T11:52:56,071 Skipping link: No binaries permitted for unitxt: https://archive1.piwheels.org/simple/unitxt/unitxt-1.26.4-py3-none-any.whl#sha256=ba799ee72a97c6a21a9fe89d07ca84bb12e95396e4580f01022d6ebc8f22b052 (from https://www.piwheels.org/simple/unitxt/) (requires-python:>=3.8) 2026-05-27T11:52:56,071 Skipping link: No binaries permitted for unitxt: https://archive1.piwheels.org/simple/unitxt/unitxt-1.26.3-py3-none-any.whl#sha256=41b3345e5e9aa9442e972ec1061914f96fca699935837596049f55fdbff8a352 (from https://www.piwheels.org/simple/unitxt/) (requires-python:>=3.8) 2026-05-27T11:52:56,072 Skipping link: No binaries permitted for unitxt: https://archive1.piwheels.org/simple/unitxt/unitxt-1.26.2-py3-none-any.whl#sha256=8938710761272f29708076f5ff3eb69284a2bdd3efccb7c71f3d58266d696d0a (from https://www.piwheels.org/simple/unitxt/) (requires-python:>=3.8) 2026-05-27T11:52:56,072 Skipping link: No binaries permitted for unitxt: https://archive1.piwheels.org/simple/unitxt/unitxt-1.26.1-py3-none-any.whl#sha256=249aef3d72d6087909fcfe44da337c0d4329a8d850752bf782a8a48963f9e315 (from https://www.piwheels.org/simple/unitxt/) (requires-python:>=3.8) 2026-05-27T11:52:56,073 Skipping link: No binaries permitted for unitxt: https://archive1.piwheels.org/simple/unitxt/unitxt-1.26.0-py3-none-any.whl#sha256=d975f99895a416a4b8592ad4981ce05a0b2ebfce1468171716ccaebc27144fe9 (from https://www.piwheels.org/simple/unitxt/) (requires-python:>=3.8) 2026-05-27T11:52:56,073 Skipping link: No binaries permitted for unitxt: https://archive1.piwheels.org/simple/unitxt/unitxt-1.25.0-py3-none-any.whl#sha256=7f29296002a9df0ee50f136d9c64fa48921c3e6b91a182b9c47494bbb39fba36 (from https://www.piwheels.org/simple/unitxt/) (requires-python:>=3.8) 2026-05-27T11:52:56,074 Skipping link: No binaries permitted for unitxt: https://archive1.piwheels.org/simple/unitxt/unitxt-1.24.0-py3-none-any.whl#sha256=5faab657fe934ff3e9ef545f8570b89629cd01f269b0d87ecd29dff92474cb51 (from https://www.piwheels.org/simple/unitxt/) (requires-python:>=3.8) 2026-05-27T11:52:56,074 Skipping link: No binaries permitted for unitxt: https://archive1.piwheels.org/simple/unitxt/unitxt-1.23.1-py3-none-any.whl#sha256=202aad8b827cecf0fd794c2f70e17200f1f59ef2d7bdeb5e85889aac1cf7f19f (from https://www.piwheels.org/simple/unitxt/) (requires-python:>=3.8) 2026-05-27T11:52:56,075 Skipping link: No binaries permitted for unitxt: https://archive1.piwheels.org/simple/unitxt/unitxt-1.23.0-py3-none-any.whl#sha256=6ca125bcf7a402049bfe28fecc5175862e0e94d0ae119e711c65a5788a2bda98 (from https://www.piwheels.org/simple/unitxt/) (requires-python:>=3.8) 2026-05-27T11:52:56,075 Skipping link: No binaries permitted for unitxt: https://archive1.piwheels.org/simple/unitxt/unitxt-1.22.4-py3-none-any.whl#sha256=d7b3fb369e39eea3f7a9020d0de002c2159da1d7e0e59f05188e353627488e42 (from https://www.piwheels.org/simple/unitxt/) (requires-python:>=3.8) 2026-05-27T11:52:56,076 Skipping link: No binaries permitted for unitxt: https://archive1.piwheels.org/simple/unitxt/unitxt-1.22.3-py3-none-any.whl#sha256=6191b273b617bd2ece88767dd8b16f8318517ba0810377d27d16dc7b9e590dcb (from https://www.piwheels.org/simple/unitxt/) (requires-python:>=3.8) 2026-05-27T11:52:56,077 Skipping link: No binaries permitted for unitxt: https://archive1.piwheels.org/simple/unitxt/unitxt-1.22.2-py3-none-any.whl#sha256=79a2fafd79be53d90c8a302f6b9b3fc6caa47004bae9e29dc945b75d7f1f5ac7 (from https://www.piwheels.org/simple/unitxt/) (requires-python:>=3.8) 2026-05-27T11:52:56,077 Skipping link: No binaries permitted for unitxt: https://archive1.piwheels.org/simple/unitxt/unitxt-1.22.1-py3-none-any.whl#sha256=d04567b442c00815adab0efd3d9079b6401e960507f80c070fa30dec72bc3286 (from https://www.piwheels.org/simple/unitxt/) (requires-python:>=3.8) 2026-05-27T11:52:56,078 Skipping link: No binaries permitted for unitxt: https://archive1.piwheels.org/simple/unitxt/unitxt-1.22.0-py3-none-any.whl#sha256=8fe219da3d2fba763d78b017bb9e0afb4ed7d3b66a942496ac11f903a9f6c3a4 (from https://www.piwheels.org/simple/unitxt/) (requires-python:>=3.8) 2026-05-27T11:52:56,078 Skipping link: No binaries permitted for unitxt: https://archive1.piwheels.org/simple/unitxt/unitxt-1.21.0-py3-none-any.whl#sha256=a3cc0d8765d375b7811431310b10f25538c06d930c20533ea5b33e3a6e7e9d6e (from https://www.piwheels.org/simple/unitxt/) (requires-python:>=3.8) 2026-05-27T11:52:56,079 Skipping link: No binaries permitted for unitxt: https://archive1.piwheels.org/simple/unitxt/unitxt-1.20.0-py3-none-any.whl#sha256=4f2d951df83d84af78a712031e5a7b50267ed7414506901c1027b838340f1b1e (from https://www.piwheels.org/simple/unitxt/) (requires-python:>=3.8) 2026-05-27T11:52:56,079 Skipping link: No binaries permitted for unitxt: https://archive1.piwheels.org/simple/unitxt/unitxt-1.19.0-py3-none-any.whl#sha256=9a50ce6821619c85e41b78b2f7ad1a27f95ea27e62c988ef658d47a88077ad2b (from https://www.piwheels.org/simple/unitxt/) (requires-python:>=3.8) 2026-05-27T11:52:56,080 Skipping link: No binaries permitted for unitxt: https://archive1.piwheels.org/simple/unitxt/unitxt-1.18.0-py3-none-any.whl#sha256=bd53260ec29c82abef68c7b2a955d8c397ba0b64f5b92e0bdcfc7a9b887c053d (from https://www.piwheels.org/simple/unitxt/) (requires-python:>=3.8) 2026-05-27T11:52:56,080 Skipping link: No binaries permitted for unitxt: https://archive1.piwheels.org/simple/unitxt/unitxt-1.17.2-py3-none-any.whl#sha256=37ba61972e9bdc1014f633b3df104fd56e0b77989263a033aac14fbf57a1f534 (from https://www.piwheels.org/simple/unitxt/) (requires-python:>=3.8) 2026-05-27T11:52:56,081 Skipping link: No binaries permitted for unitxt: https://archive1.piwheels.org/simple/unitxt/unitxt-1.17.1-py3-none-any.whl#sha256=a3fdf135f154ad6dff3e6d9deba685dbf94bf9968382f93fdbc43a64fea27d45 (from https://www.piwheels.org/simple/unitxt/) (requires-python:>=3.8) 2026-05-27T11:52:56,081 Skipping link: No binaries permitted for unitxt: https://archive1.piwheels.org/simple/unitxt/unitxt-1.17.0-py3-none-any.whl#sha256=d029e01585bc1ee13c3ad96dbdcb8921036d0f2752716e1477bf757d84b6c6cc (from https://www.piwheels.org/simple/unitxt/) (requires-python:>=3.8) 2026-05-27T11:52:56,082 Skipping link: No binaries permitted for unitxt: https://archive1.piwheels.org/simple/unitxt/unitxt-1.16.4-py3-none-any.whl#sha256=70026ae1118327261b6a997a655dd60f50db2f637dcbbdeb423b214739e60712 (from https://www.piwheels.org/simple/unitxt/) (requires-python:>=3.8) 2026-05-27T11:52:56,082 Skipping link: No binaries permitted for unitxt: https://archive1.piwheels.org/simple/unitxt/unitxt-1.16.3-py3-none-any.whl#sha256=cc4627f40b27ccf86d3e148d37bf12b3a58cf72bcf4b4dd3a8e95a6484856643 (from https://www.piwheels.org/simple/unitxt/) (requires-python:>=3.8) 2026-05-27T11:52:56,083 Skipping link: No binaries permitted for unitxt: https://archive1.piwheels.org/simple/unitxt/unitxt-1.16.2-py3-none-any.whl#sha256=4f6b72a4c34b5bd05a87007f84b86ce3d4bc645639deb85aebceab2b360eb806 (from https://www.piwheels.org/simple/unitxt/) (requires-python:>=3.8) 2026-05-27T11:52:56,083 Skipping link: No binaries permitted for unitxt: https://archive1.piwheels.org/simple/unitxt/unitxt-1.16.1-py3-none-any.whl#sha256=70aaf53f2794be1a7d22cd8c65957b9afdf8dda58efc09a723320274ac5ecb30 (from https://www.piwheels.org/simple/unitxt/) (requires-python:>=3.8) 2026-05-27T11:52:56,084 Skipping link: No binaries permitted for unitxt: https://archive1.piwheels.org/simple/unitxt/unitxt-1.16.0-py3-none-any.whl#sha256=498d60de1829c4369a67ffc748a7149accca692ce10b969d968510a6d5e6b9f2 (from https://www.piwheels.org/simple/unitxt/) (requires-python:>=3.8) 2026-05-27T11:52:56,084 Skipping link: No binaries permitted for unitxt: https://archive1.piwheels.org/simple/unitxt/unitxt-1.15.10-py3-none-any.whl#sha256=e8330cccf455567c9a9a2e7e8442bd29c13fa52d4347ed40d1863d5d8251b106 (from https://www.piwheels.org/simple/unitxt/) (requires-python:>=3.8) 2026-05-27T11:52:56,085 Skipping link: No binaries permitted for unitxt: https://archive1.piwheels.org/simple/unitxt/unitxt-1.15.9-py3-none-any.whl#sha256=e3f95b0317a6814314667a949ef664c63f77c3205c50469a073bda29ffa237ee (from https://www.piwheels.org/simple/unitxt/) (requires-python:>=3.8) 2026-05-27T11:52:56,086 Skipping link: No binaries permitted for unitxt: https://archive1.piwheels.org/simple/unitxt/unitxt-1.15.8-py3-none-any.whl#sha256=e60b21e2a67ecbd56e8f2d62b53bfe224d64fa8ff94f01eea74d9e54712d0b2c (from https://www.piwheels.org/simple/unitxt/) (requires-python:>=3.8) 2026-05-27T11:52:56,086 Skipping link: No binaries permitted for unitxt: https://archive1.piwheels.org/simple/unitxt/unitxt-1.15.7-py3-none-any.whl#sha256=c1324bdeeda9f2e18f5d84e0d7b4bf4edf46ca79b959180993472ecaa0fba2a0 (from https://www.piwheels.org/simple/unitxt/) (requires-python:>=3.8) 2026-05-27T11:52:56,087 Skipping link: No binaries permitted for unitxt: https://archive1.piwheels.org/simple/unitxt/unitxt-1.15.6-py3-none-any.whl#sha256=614a1b437c499d5c5525bbf96dab1a1ad9e1c9c102ee14199dfbced6ed5ef464 (from https://www.piwheels.org/simple/unitxt/) (requires-python:>=3.8) 2026-05-27T11:52:56,087 Skipping link: No binaries permitted for unitxt: https://archive1.piwheels.org/simple/unitxt/unitxt-0.0.1-py3-none-any.whl#sha256=d5db4950544d2741808be98b6a40f37b95b9eef3012027ea5ed4093d8d4fe688 (from https://www.piwheels.org/simple/unitxt/) 2026-05-27T11:52:56,088 Skipping link: not a file: https://www.piwheels.org/simple/unitxt/ 2026-05-27T11:52:56,088 Skipping link: not a file: https://pypi.org/simple/unitxt/ 2026-05-27T11:52:56,121 Given no hashes to check 1 links for project 'unitxt': discarding no candidates 2026-05-27T11:52:56,139 Collecting unitxt==1.26.10 2026-05-27T11:52:56,141 Created temporary directory: /tmp/pip-unpack-iwnhmzd0 2026-05-27T11:52:56,390 Downloading unitxt-1.26.10.tar.gz (28.8 MB) 2026-05-27T11:53:08,905 Added unitxt==1.26.10 from https://files.pythonhosted.org/packages/8d/68/cda80f4fdc32aa5f8753d5ffe70d5110b9dc25956b15a8b579c72e033c95/unitxt-1.26.10.tar.gz to build tracker '/tmp/pip-build-tracker-rbf86q8p' 2026-05-27T11:53:08,915 Created temporary directory: /tmp/pip-build-env-jg6_kbbu 2026-05-27T11:53:08,921 Installing build dependencies: started 2026-05-27T11:53:08,922 Running command pip subprocess to install build dependencies 2026-05-27T11:53:10,115 Using pip 23.0.1 from /usr/lib/python3/dist-packages/pip (python 3.11) 2026-05-27T11:53:10,559 DEPRECATION: --no-binary currently disables reading from the cache of locally built wheels. In the future --no-binary will not influence the wheel cache. pip 23.1 will enforce this behaviour change. A possible replacement is to use the --no-cache-dir option. You can use the flag --use-feature=no-binary-enable-wheel-cache to test the upcoming behaviour. Discussion can be found at https://github.com/pypa/pip/issues/11453 2026-05-27T11:53:10,583 Looking in indexes: https://pypi.org/simple, https://www.piwheels.org/simple 2026-05-27T11:53:12,348 Collecting setuptools 2026-05-27T11:53:12,349 Obtaining dependency information for setuptools from https://www.piwheels.org/simple/setuptools/setuptools-82.0.1-py3-none-any.whl.metadata 2026-05-27T11:53:12,365 Using cached https://www.piwheels.org/simple/setuptools/setuptools-82.0.1-py3-none-any.whl.metadata (6.5 kB) 2026-05-27T11:53:12,597 Collecting wheel 2026-05-27T11:53:12,598 Obtaining dependency information for wheel from https://www.piwheels.org/simple/wheel/wheel-0.47.0-py3-none-any.whl.metadata 2026-05-27T11:53:12,613 Using cached https://www.piwheels.org/simple/wheel/wheel-0.47.0-py3-none-any.whl.metadata (2.3 kB) 2026-05-27T11:53:12,795 Collecting packaging>=24.0 2026-05-27T11:53:12,796 Obtaining dependency information for packaging>=24.0 from https://www.piwheels.org/simple/packaging/packaging-26.2-py3-none-any.whl.metadata 2026-05-27T11:53:12,810 Using cached https://www.piwheels.org/simple/packaging/packaging-26.2-py3-none-any.whl.metadata (3.5 kB) 2026-05-27T11:53:12,999 Using cached https://www.piwheels.org/simple/wheel/wheel-0.47.0-py3-none-any.whl (32 kB) 2026-05-27T11:53:13,019 Using cached https://www.piwheels.org/simple/packaging/packaging-26.2-py3-none-any.whl (100 kB) 2026-05-27T11:53:13,112 Using cached https://www.piwheels.org/simple/setuptools/setuptools-82.0.1-py3-none-any.whl (1.0 MB) 2026-05-27T11:53:13,147 Using cached https://www.piwheels.org/simple/wheel/wheel-0.47.0-py3-none-any.whl (32 kB) 2026-05-27T11:53:13,173 Using cached https://www.piwheels.org/simple/packaging/packaging-26.2-py3-none-any.whl (100 kB) 2026-05-27T11:53:13,272 Using cached https://www.piwheels.org/simple/setuptools/setuptools-82.0.1-py3-none-any.whl (1.0 MB) 2026-05-27T11:53:16,016 Installing collected packages: setuptools, packaging, wheel 2026-05-27T11:53:19,540 Creating /tmp/pip-build-env-jg6_kbbu/overlay/local/bin 2026-05-27T11:53:19,543 changing mode of /tmp/pip-build-env-jg6_kbbu/overlay/local/bin/wheel to 755 2026-05-27T11:53:19,563 Successfully installed packaging-26.2 setuptools-82.0.1 wheel-0.47.0 2026-05-27T11:53:19,843 Installing build dependencies: finished with status 'done' 2026-05-27T11:53:19,849 Getting requirements to build wheel: started 2026-05-27T11:53:19,850 Running command Getting requirements to build wheel 2026-05-27T11:53:20,838 /tmp/pip-build-env-jg6_kbbu/overlay/local/lib/python3.11/dist-packages/setuptools/config/_apply_pyprojecttoml.py:82: SetuptoolsDeprecationWarning: `project.license` as a TOML table is deprecated 2026-05-27T11:53:20,838 !! 2026-05-27T11:53:20,839 ******************************************************************************** 2026-05-27T11:53:20,840 Please use a simple string containing a SPDX expression for `project.license`. You can also use `project.license-files`. (Both options available on setuptools>=77.0.0). 2026-05-27T11:53:20,841 By 2027-Feb-18, you need to update your project and remove deprecated calls 2026-05-27T11:53:20,842 or your builds will no longer be supported. 2026-05-27T11:53:20,843 See https://packaging.python.org/en/latest/guides/writing-pyproject-toml/#license for details. 2026-05-27T11:53:20,843 ******************************************************************************** 2026-05-27T11:53:20,844 !! 2026-05-27T11:53:20,845 corresp(dist, value, root_dir) 2026-05-27T11:53:20,934 running egg_info 2026-05-27T11:53:20,940 writing src/unitxt.egg-info/PKG-INFO 2026-05-27T11:53:20,963 writing dependency_links to src/unitxt.egg-info/dependency_links.txt 2026-05-27T11:53:20,966 writing entry points to src/unitxt.egg-info/entry_points.txt 2026-05-27T11:53:20,977 writing requirements to src/unitxt.egg-info/requires.txt 2026-05-27T11:53:20,979 writing top-level names to src/unitxt.egg-info/top_level.txt 2026-05-27T11:53:22,386 reading manifest file 'src/unitxt.egg-info/SOURCES.txt' 2026-05-27T11:53:22,649 adding license file 'LICENSE' 2026-05-27T11:53:22,905 writing manifest file 'src/unitxt.egg-info/SOURCES.txt' 2026-05-27T11:53:23,012 Getting requirements to build wheel: finished with status 'done' 2026-05-27T11:53:23,015 Created temporary directory: /tmp/pip-modern-metadata-pmpbsms4 2026-05-27T11:53:23,018 Preparing metadata (pyproject.toml): started 2026-05-27T11:53:23,019 Running command Preparing metadata (pyproject.toml) 2026-05-27T11:53:23,758 /tmp/pip-build-env-jg6_kbbu/overlay/local/lib/python3.11/dist-packages/setuptools/config/_apply_pyprojecttoml.py:82: SetuptoolsDeprecationWarning: `project.license` as a TOML table is deprecated 2026-05-27T11:53:23,758 !! 2026-05-27T11:53:23,759 ******************************************************************************** 2026-05-27T11:53:23,760 Please use a simple string containing a SPDX expression for `project.license`. You can also use `project.license-files`. (Both options available on setuptools>=77.0.0). 2026-05-27T11:53:23,761 By 2027-Feb-18, you need to update your project and remove deprecated calls 2026-05-27T11:53:23,761 or your builds will no longer be supported. 2026-05-27T11:53:23,762 See https://packaging.python.org/en/latest/guides/writing-pyproject-toml/#license for details. 2026-05-27T11:53:23,763 ******************************************************************************** 2026-05-27T11:53:23,764 !! 2026-05-27T11:53:23,764 corresp(dist, value, root_dir) 2026-05-27T11:53:23,854 running dist_info 2026-05-27T11:53:23,865 creating /tmp/pip-modern-metadata-pmpbsms4/unitxt.egg-info 2026-05-27T11:53:23,866 writing /tmp/pip-modern-metadata-pmpbsms4/unitxt.egg-info/PKG-INFO 2026-05-27T11:53:23,889 writing dependency_links to /tmp/pip-modern-metadata-pmpbsms4/unitxt.egg-info/dependency_links.txt 2026-05-27T11:53:23,891 writing entry points to /tmp/pip-modern-metadata-pmpbsms4/unitxt.egg-info/entry_points.txt 2026-05-27T11:53:23,902 writing requirements to /tmp/pip-modern-metadata-pmpbsms4/unitxt.egg-info/requires.txt 2026-05-27T11:53:23,904 writing top-level names to /tmp/pip-modern-metadata-pmpbsms4/unitxt.egg-info/top_level.txt 2026-05-27T11:53:23,906 writing manifest file '/tmp/pip-modern-metadata-pmpbsms4/unitxt.egg-info/SOURCES.txt' 2026-05-27T11:53:25,062 reading manifest file '/tmp/pip-modern-metadata-pmpbsms4/unitxt.egg-info/SOURCES.txt' 2026-05-27T11:53:25,064 adding license file 'LICENSE' 2026-05-27T11:53:25,234 writing manifest file '/tmp/pip-modern-metadata-pmpbsms4/unitxt.egg-info/SOURCES.txt' 2026-05-27T11:53:25,243 creating '/tmp/pip-modern-metadata-pmpbsms4/unitxt-1.26.10.dist-info' 2026-05-27T11:53:25,379 Preparing metadata (pyproject.toml): finished with status 'done' 2026-05-27T11:53:25,387 Source in /tmp/pip-wheel-fnszrdac/unitxt_a7d96e37f0eb4b94b39ec6391d399b5c has version 1.26.10, which satisfies requirement unitxt==1.26.10 from https://files.pythonhosted.org/packages/8d/68/cda80f4fdc32aa5f8753d5ffe70d5110b9dc25956b15a8b579c72e033c95/unitxt-1.26.10.tar.gz 2026-05-27T11:53:25,388 Removed unitxt==1.26.10 from https://files.pythonhosted.org/packages/8d/68/cda80f4fdc32aa5f8753d5ffe70d5110b9dc25956b15a8b579c72e033c95/unitxt-1.26.10.tar.gz from build tracker '/tmp/pip-build-tracker-rbf86q8p' 2026-05-27T11:53:25,401 Created temporary directory: /tmp/pip-unpack-zcq9s05j 2026-05-27T11:53:25,402 Building wheels for collected packages: unitxt 2026-05-27T11:53:25,406 Created temporary directory: /tmp/pip-wheel-_kdcodhj 2026-05-27T11:53:25,407 Destination directory: /tmp/pip-wheel-_kdcodhj 2026-05-27T11:53:25,410 Building wheel for unitxt (pyproject.toml): started 2026-05-27T11:53:25,411 Running command Building wheel for unitxt (pyproject.toml) 2026-05-27T11:53:26,132 /tmp/pip-build-env-jg6_kbbu/overlay/local/lib/python3.11/dist-packages/setuptools/config/_apply_pyprojecttoml.py:82: SetuptoolsDeprecationWarning: `project.license` as a TOML table is deprecated 2026-05-27T11:53:26,132 !! 2026-05-27T11:53:26,133 ******************************************************************************** 2026-05-27T11:53:26,134 Please use a simple string containing a SPDX expression for `project.license`. You can also use `project.license-files`. (Both options available on setuptools>=77.0.0). 2026-05-27T11:53:26,135 By 2027-Feb-18, you need to update your project and remove deprecated calls 2026-05-27T11:53:26,136 or your builds will no longer be supported. 2026-05-27T11:53:26,137 See https://packaging.python.org/en/latest/guides/writing-pyproject-toml/#license for details. 2026-05-27T11:53:26,138 ******************************************************************************** 2026-05-27T11:53:26,139 !! 2026-05-27T11:53:26,140 corresp(dist, value, root_dir) 2026-05-27T11:53:26,222 running bdist_wheel 2026-05-27T11:53:26,241 running build 2026-05-27T11:53:26,242 running build_py 2026-05-27T11:53:26,250 creating build/lib/unitxt 2026-05-27T11:53:26,252 copying src/unitxt/parsing_utils.py -> build/lib/unitxt 2026-05-27T11:53:26,255 copying src/unitxt/dataset_utils.py -> build/lib/unitxt 2026-05-27T11:53:26,257 copying src/unitxt/inference.py -> build/lib/unitxt 2026-05-27T11:53:26,263 copying src/unitxt/evaluate_cli.py -> build/lib/unitxt 2026-05-27T11:53:26,266 copying src/unitxt/benchmark.py -> build/lib/unitxt 2026-05-27T11:53:26,268 copying src/unitxt/span_lableing_operators.py -> build/lib/unitxt 2026-05-27T11:53:26,270 copying src/unitxt/processors.py -> build/lib/unitxt 2026-05-27T11:53:26,273 copying src/unitxt/error_utils.py -> build/lib/unitxt 2026-05-27T11:53:26,276 copying src/unitxt/artifact.py -> build/lib/unitxt 2026-05-27T11:53:26,279 copying src/unitxt/hf_utils.py -> build/lib/unitxt 2026-05-27T11:53:26,281 copying src/unitxt/utils.py -> build/lib/unitxt 2026-05-27T11:53:26,283 copying src/unitxt/api.py -> build/lib/unitxt 2026-05-27T11:53:26,286 copying src/unitxt/serializers.py -> build/lib/unitxt 2026-05-27T11:53:26,288 copying src/unitxt/validate.py -> build/lib/unitxt 2026-05-27T11:53:26,290 copying src/unitxt/dataclass.py -> build/lib/unitxt 2026-05-27T11:53:26,293 copying src/unitxt/operator.py -> build/lib/unitxt 2026-05-27T11:53:26,296 copying src/unitxt/llm_as_judge.py -> build/lib/unitxt 2026-05-27T11:53:26,300 copying src/unitxt/splitters.py -> build/lib/unitxt 2026-05-27T11:53:26,303 copying src/unitxt/llm_as_judge_operators.py -> build/lib/unitxt 2026-05-27T11:53:26,305 copying src/unitxt/templates.py -> build/lib/unitxt 2026-05-27T11:53:26,308 copying src/unitxt/system_prompts.py -> build/lib/unitxt 2026-05-27T11:53:26,310 copying src/unitxt/schema.py -> build/lib/unitxt 2026-05-27T11:53:26,312 copying src/unitxt/deprecation_utils.py -> build/lib/unitxt 2026-05-27T11:53:26,315 copying src/unitxt/dialog_operators.py -> build/lib/unitxt 2026-05-27T11:53:26,317 copying src/unitxt/catalog.py -> build/lib/unitxt 2026-05-27T11:53:26,320 copying src/unitxt/formats.py -> build/lib/unitxt 2026-05-27T11:53:26,322 copying src/unitxt/generator_utils.py -> build/lib/unitxt 2026-05-27T11:53:26,324 copying src/unitxt/collections_operators.py -> build/lib/unitxt 2026-05-27T11:53:26,327 copying src/unitxt/file_utils.py -> build/lib/unitxt 2026-05-27T11:53:26,329 copying src/unitxt/operators.py -> build/lib/unitxt 2026-05-27T11:53:26,333 copying src/unitxt/card.py -> build/lib/unitxt 2026-05-27T11:53:26,335 copying src/unitxt/types.py -> build/lib/unitxt 2026-05-27T11:53:26,337 copying src/unitxt/metric_utils.py -> build/lib/unitxt 2026-05-27T11:53:26,339 copying src/unitxt/loaders.py -> build/lib/unitxt 2026-05-27T11:53:26,343 copying src/unitxt/settings_utils.py -> build/lib/unitxt 2026-05-27T11:53:26,346 copying src/unitxt/fusion.py -> build/lib/unitxt 2026-05-27T11:53:26,349 copying src/unitxt/version.py -> build/lib/unitxt 2026-05-27T11:53:26,350 copying src/unitxt/augmentors.py -> build/lib/unitxt 2026-05-27T11:53:26,353 copying src/unitxt/logging_utils.py -> build/lib/unitxt 2026-05-27T11:53:26,355 copying src/unitxt/llm_as_judge_from_template.py -> build/lib/unitxt 2026-05-27T11:53:26,358 copying src/unitxt/llm_as_judge_utils.py -> build/lib/unitxt 2026-05-27T11:53:26,360 copying src/unitxt/dict_utils.py -> build/lib/unitxt 2026-05-27T11:53:26,362 copying src/unitxt/collections.py -> build/lib/unitxt 2026-05-27T11:53:26,364 copying src/unitxt/dataset.py -> build/lib/unitxt 2026-05-27T11:53:26,367 copying src/unitxt/image_operators.py -> build/lib/unitxt 2026-05-27T11:53:26,370 copying src/unitxt/standard.py -> build/lib/unitxt 2026-05-27T11:53:26,373 copying src/unitxt/instructions.py -> build/lib/unitxt 2026-05-27T11:53:26,374 copying src/unitxt/llm_as_judge_chat_templates.py -> build/lib/unitxt 2026-05-27T11:53:26,376 copying src/unitxt/split_utils.py -> build/lib/unitxt 2026-05-27T11:53:26,379 copying src/unitxt/text2sql_utils.py -> build/lib/unitxt 2026-05-27T11:53:26,382 copying src/unitxt/llm_as_judge_constants.py -> build/lib/unitxt 2026-05-27T11:53:26,386 copying src/unitxt/stream.py -> build/lib/unitxt 2026-05-27T11:53:26,389 copying src/unitxt/text_utils.py -> build/lib/unitxt 2026-05-27T11:53:26,391 copying src/unitxt/blocks.py -> build/lib/unitxt 2026-05-27T11:53:26,393 copying src/unitxt/normalizers.py -> build/lib/unitxt 2026-05-27T11:53:26,395 copying src/unitxt/struct_data_operators.py -> build/lib/unitxt 2026-05-27T11:53:26,398 copying src/unitxt/register.py -> build/lib/unitxt 2026-05-27T11:53:26,400 copying src/unitxt/base_metric.py -> build/lib/unitxt 2026-05-27T11:53:26,402 copying src/unitxt/string_operators.py -> build/lib/unitxt 2026-05-27T11:53:26,404 copying src/unitxt/__init__.py -> build/lib/unitxt 2026-05-27T11:53:26,406 copying src/unitxt/metric.py -> build/lib/unitxt 2026-05-27T11:53:26,408 copying src/unitxt/type_utils.py -> build/lib/unitxt 2026-05-27T11:53:26,412 copying src/unitxt/recipe.py -> build/lib/unitxt 2026-05-27T11:53:26,413 copying src/unitxt/eval_utils.py -> build/lib/unitxt 2026-05-27T11:53:26,415 copying src/unitxt/task.py -> build/lib/unitxt 2026-05-27T11:53:26,418 copying src/unitxt/stream_operators.py -> build/lib/unitxt 2026-05-27T11:53:26,420 copying src/unitxt/random_utils.py -> build/lib/unitxt 2026-05-27T11:53:26,422 copying src/unitxt/metrics.py -> build/lib/unitxt 2026-05-27T11:53:26,434 creating build/lib/unitxt/service 2026-05-27T11:53:26,435 copying src/unitxt/service/__init__.py -> build/lib/unitxt/service 2026-05-27T11:53:26,437 creating build/lib/unitxt/test_utils 2026-05-27T11:53:26,439 copying src/unitxt/test_utils/artifact.py -> build/lib/unitxt/test_utils 2026-05-27T11:53:26,441 copying src/unitxt/test_utils/catalog.py -> build/lib/unitxt/test_utils 2026-05-27T11:53:26,443 copying src/unitxt/test_utils/operators.py -> build/lib/unitxt/test_utils 2026-05-27T11:53:26,445 copying src/unitxt/test_utils/card.py -> build/lib/unitxt/test_utils 2026-05-27T11:53:26,447 copying src/unitxt/test_utils/storage.py -> build/lib/unitxt/test_utils 2026-05-27T11:53:26,449 copying src/unitxt/test_utils/__init__.py -> build/lib/unitxt/test_utils 2026-05-27T11:53:26,451 copying src/unitxt/test_utils/metrics.py -> build/lib/unitxt/test_utils 2026-05-27T11:53:26,454 creating build/lib/unitxt/ui 2026-05-27T11:53:26,455 copying src/unitxt/ui/run.py -> build/lib/unitxt/ui 2026-05-27T11:53:26,458 copying src/unitxt/ui/ui_tester.py -> build/lib/unitxt/ui 2026-05-27T11:53:26,460 copying src/unitxt/ui/settings.py -> build/lib/unitxt/ui 2026-05-27T11:53:26,462 copying src/unitxt/ui/gradio_utils.py -> build/lib/unitxt/ui 2026-05-27T11:53:26,463 copying src/unitxt/ui/ui_utils.py -> build/lib/unitxt/ui 2026-05-27T11:53:26,466 copying src/unitxt/ui/__init__.py -> build/lib/unitxt/ui 2026-05-27T11:53:26,468 copying src/unitxt/ui/load_catalog_data.py -> build/lib/unitxt/ui 2026-05-27T11:53:26,470 creating build/lib/unitxt/assistant 2026-05-27T11:53:26,471 copying src/unitxt/assistant/app.py -> build/lib/unitxt/assistant 2026-05-27T11:53:26,474 copying src/unitxt/assistant/index.py -> build/lib/unitxt/assistant 2026-05-27T11:53:26,476 copying src/unitxt/assistant/__init__.py -> build/lib/unitxt/assistant 2026-05-27T11:53:26,478 creating build/lib/unitxt/service/metrics 2026-05-27T11:53:26,479 copying src/unitxt/service/metrics/tokens.py -> build/lib/unitxt/service/metrics 2026-05-27T11:53:26,482 copying src/unitxt/service/metrics/__init__.py -> build/lib/unitxt/service/metrics 2026-05-27T11:53:26,483 copying src/unitxt/service/metrics/main.py -> build/lib/unitxt/service/metrics 2026-05-27T11:53:26,703 creating build/lib/unitxt/assistant/assessment 2026-05-27T11:53:26,704 copying src/unitxt/assistant/assessment/my_pretty_table.py -> build/lib/unitxt/assistant/assessment 2026-05-27T11:53:26,707 copying src/unitxt/assistant/assessment/assistant_inference_engine.py -> build/lib/unitxt/assistant/assessment 2026-05-27T11:53:26,709 copying src/unitxt/assistant/assessment/__init__.py -> build/lib/unitxt/assistant/assessment 2026-05-27T11:53:26,727 running egg_info 2026-05-27T11:53:26,737 writing src/unitxt.egg-info/PKG-INFO 2026-05-27T11:53:26,759 writing dependency_links to src/unitxt.egg-info/dependency_links.txt 2026-05-27T11:53:26,761 writing entry points to src/unitxt.egg-info/entry_points.txt 2026-05-27T11:53:26,771 writing requirements to src/unitxt.egg-info/requires.txt 2026-05-27T11:53:26,773 writing top-level names to src/unitxt.egg-info/top_level.txt 2026-05-27T11:53:28,603 reading manifest file 'src/unitxt.egg-info/SOURCES.txt' 2026-05-27T11:53:28,868 adding license file 'LICENSE' 2026-05-27T11:53:29,121 writing manifest file 'src/unitxt.egg-info/SOURCES.txt' 2026-05-27T11:53:30,238 creating build/lib/unitxt/catalog/benchmarks 2026-05-27T11:53:30,239 copying src/unitxt/catalog/benchmarks/tool_calling.json -> build/lib/unitxt/catalog/benchmarks 2026-05-27T11:53:30,242 copying src/unitxt/catalog/benchmarks/vision_default.json -> build/lib/unitxt/catalog/benchmarks 2026-05-27T11:53:30,244 copying src/unitxt/catalog/benchmarks/torr.json -> build/lib/unitxt/catalog/benchmarks 2026-05-27T11:53:30,248 copying src/unitxt/catalog/benchmarks/vision_full.json -> build/lib/unitxt/catalog/benchmarks 2026-05-27T11:53:30,250 copying src/unitxt/catalog/benchmarks/llama_vision.json -> build/lib/unitxt/catalog/benchmarks 2026-05-27T11:53:30,252 copying src/unitxt/catalog/benchmarks/bluebench.json -> build/lib/unitxt/catalog/benchmarks 2026-05-27T11:53:30,255 copying src/unitxt/catalog/benchmarks/glue.json -> build/lib/unitxt/catalog/benchmarks 2026-05-27T11:53:30,257 creating build/lib/unitxt/catalog/templates 2026-05-27T11:53:30,258 copying src/unitxt/catalog/templates/key_val_with_new_lines.json -> build/lib/unitxt/catalog/templates 2026-05-27T11:53:30,260 copying src/unitxt/catalog/templates/key_val.json -> build/lib/unitxt/catalog/templates 2026-05-27T11:53:30,262 copying src/unitxt/catalog/templates/empty.json -> build/lib/unitxt/catalog/templates 2026-05-27T11:53:30,264 creating build/lib/unitxt/catalog/templates/schema_linking 2026-05-27T11:53:30,265 copying src/unitxt/catalog/templates/schema_linking/default.json -> build/lib/unitxt/catalog/templates/schema_linking 2026-05-27T11:53:30,268 copying src/unitxt/catalog/templates/schema_linking/with_hint.json -> build/lib/unitxt/catalog/templates/schema_linking 2026-05-27T11:53:30,270 copying src/unitxt/catalog/templates/schema_linking/all.json -> build/lib/unitxt/catalog/templates/schema_linking 2026-05-27T11:53:30,272 creating build/lib/unitxt/catalog/templates/summarization/abstractive 2026-05-27T11:53:30,273 copying src/unitxt/catalog/templates/summarization/abstractive/professional.json -> build/lib/unitxt/catalog/templates/summarization/abstractive 2026-05-27T11:53:30,276 copying src/unitxt/catalog/templates/summarization/abstractive/instruct_passive.json -> build/lib/unitxt/catalog/templates/summarization/abstractive 2026-05-27T11:53:30,278 copying src/unitxt/catalog/templates/summarization/abstractive/casual.json -> build/lib/unitxt/catalog/templates/summarization/abstractive 2026-05-27T11:53:30,280 copying src/unitxt/catalog/templates/summarization/abstractive/one_sentence.json -> build/lib/unitxt/catalog/templates/summarization/abstractive 2026-05-27T11:53:30,282 copying src/unitxt/catalog/templates/summarization/abstractive/formal.json -> build/lib/unitxt/catalog/templates/summarization/abstractive 2026-05-27T11:53:30,284 copying src/unitxt/catalog/templates/summarization/abstractive/title.json -> build/lib/unitxt/catalog/templates/summarization/abstractive 2026-05-27T11:53:30,287 copying src/unitxt/catalog/templates/summarization/abstractive/instruct_write_succinct.json -> build/lib/unitxt/catalog/templates/summarization/abstractive 2026-05-27T11:53:30,289 copying src/unitxt/catalog/templates/summarization/abstractive/instruct_tldr.json -> build/lib/unitxt/catalog/templates/summarization/abstractive 2026-05-27T11:53:30,291 copying src/unitxt/catalog/templates/summarization/abstractive/bluebench.json -> build/lib/unitxt/catalog/templates/summarization/abstractive 2026-05-27T11:53:30,293 copying src/unitxt/catalog/templates/summarization/abstractive/instruct_full.json -> build/lib/unitxt/catalog/templates/summarization/abstractive 2026-05-27T11:53:30,296 copying src/unitxt/catalog/templates/summarization/abstractive/instruct_one_sentence.json -> build/lib/unitxt/catalog/templates/summarization/abstractive 2026-05-27T11:53:30,298 copying src/unitxt/catalog/templates/summarization/abstractive/formal_without_label.json -> build/lib/unitxt/catalog/templates/summarization/abstractive 2026-05-27T11:53:30,300 copying src/unitxt/catalog/templates/summarization/abstractive/passive.json -> build/lib/unitxt/catalog/templates/summarization/abstractive 2026-05-27T11:53:30,302 copying src/unitxt/catalog/templates/summarization/abstractive/all.json -> build/lib/unitxt/catalog/templates/summarization/abstractive 2026-05-27T11:53:30,304 copying src/unitxt/catalog/templates/summarization/abstractive/write_succinct.json -> build/lib/unitxt/catalog/templates/summarization/abstractive 2026-05-27T11:53:30,307 copying src/unitxt/catalog/templates/summarization/abstractive/full.json -> build/lib/unitxt/catalog/templates/summarization/abstractive 2026-05-27T11:53:30,309 copying src/unitxt/catalog/templates/summarization/abstractive/instructive.json -> build/lib/unitxt/catalog/templates/summarization/abstractive 2026-05-27T11:53:30,311 creating build/lib/unitxt/catalog/templates/translation/directed 2026-05-27T11:53:30,312 copying src/unitxt/catalog/templates/translation/directed/casual.json -> build/lib/unitxt/catalog/templates/translation/directed 2026-05-27T11:53:30,315 copying src/unitxt/catalog/templates/translation/directed/formal.json -> build/lib/unitxt/catalog/templates/translation/directed 2026-05-27T11:53:30,317 copying src/unitxt/catalog/templates/translation/directed/instructional.json -> build/lib/unitxt/catalog/templates/translation/directed 2026-05-27T11:53:30,319 copying src/unitxt/catalog/templates/translation/directed/title.json -> build/lib/unitxt/catalog/templates/translation/directed 2026-05-27T11:53:30,321 copying src/unitxt/catalog/templates/translation/directed/playful.json -> build/lib/unitxt/catalog/templates/translation/directed 2026-05-27T11:53:30,323 copying src/unitxt/catalog/templates/translation/directed/bluebench.json -> build/lib/unitxt/catalog/templates/translation/directed 2026-05-27T11:53:30,325 copying src/unitxt/catalog/templates/translation/directed/simple.json -> build/lib/unitxt/catalog/templates/translation/directed 2026-05-27T11:53:30,328 copying src/unitxt/catalog/templates/translation/directed/all.json -> build/lib/unitxt/catalog/templates/translation/directed 2026-05-27T11:53:30,330 creating build/lib/unitxt/catalog/templates/tool_calling 2026-05-27T11:53:30,331 copying src/unitxt/catalog/templates/tool_calling/base.json -> build/lib/unitxt/catalog/templates/tool_calling 2026-05-27T11:53:30,334 copying src/unitxt/catalog/templates/tool_calling/multi_turn.json -> build/lib/unitxt/catalog/templates/tool_calling 2026-05-27T11:53:30,336 creating build/lib/unitxt/catalog/templates/generation 2026-05-27T11:53:30,337 copying src/unitxt/catalog/templates/generation/default.json -> build/lib/unitxt/catalog/templates/generation 2026-05-27T11:53:30,340 copying src/unitxt/catalog/templates/generation/empty.json -> build/lib/unitxt/catalog/templates/generation 2026-05-27T11:53:30,343 copying src/unitxt/catalog/templates/generation/all.json -> build/lib/unitxt/catalog/templates/generation 2026-05-27T11:53:30,345 creating build/lib/unitxt/catalog/templates/generation/from_pair 2026-05-27T11:53:30,346 copying src/unitxt/catalog/templates/generation/from_pair/default.json -> build/lib/unitxt/catalog/templates/generation/from_pair 2026-05-27T11:53:30,349 copying src/unitxt/catalog/templates/generation/from_pair/all.json -> build/lib/unitxt/catalog/templates/generation/from_pair 2026-05-27T11:53:30,352 creating build/lib/unitxt/catalog/templates/rag/end_to_end 2026-05-27T11:53:30,354 copying src/unitxt/catalog/templates/rag/end_to_end/json_predictions.json -> build/lib/unitxt/catalog/templates/rag/end_to_end 2026-05-27T11:53:30,357 creating build/lib/unitxt/catalog/templates/rag/response_generation 2026-05-27T11:53:30,358 copying src/unitxt/catalog/templates/rag/response_generation/please_respond_chat.json -> build/lib/unitxt/catalog/templates/rag/response_generation 2026-05-27T11:53:30,361 copying src/unitxt/catalog/templates/rag/response_generation/please_respond.json -> build/lib/unitxt/catalog/templates/rag/response_generation 2026-05-27T11:53:30,363 copying src/unitxt/catalog/templates/rag/response_generation/answer_based_on_context.json -> build/lib/unitxt/catalog/templates/rag/response_generation 2026-05-27T11:53:30,366 copying src/unitxt/catalog/templates/rag/response_generation/bluebench.json -> build/lib/unitxt/catalog/templates/rag/response_generation 2026-05-27T11:53:30,369 copying src/unitxt/catalog/templates/rag/response_generation/answer_based_on_context_inverted.json -> build/lib/unitxt/catalog/templates/rag/response_generation 2026-05-27T11:53:30,371 creating build/lib/unitxt/catalog/templates/grammatical_error_detection 2026-05-27T11:53:30,372 copying src/unitxt/catalog/templates/grammatical_error_detection/all.json -> build/lib/unitxt/catalog/templates/grammatical_error_detection 2026-05-27T11:53:30,376 copying src/unitxt/catalog/templates/grammatical_error_detection/yes_no.json -> build/lib/unitxt/catalog/templates/grammatical_error_detection 2026-05-27T11:53:30,378 creating build/lib/unitxt/catalog/templates/rewriting/by_attribute 2026-05-27T11:53:30,380 copying src/unitxt/catalog/templates/rewriting/by_attribute/default.json -> build/lib/unitxt/catalog/templates/rewriting/by_attribute 2026-05-27T11:53:30,383 copying src/unitxt/catalog/templates/rewriting/by_attribute/all.json -> build/lib/unitxt/catalog/templates/rewriting/by_attribute 2026-05-27T11:53:30,386 creating build/lib/unitxt/catalog/templates/rewriting/paraphrase 2026-05-27T11:53:30,387 copying src/unitxt/catalog/templates/rewriting/paraphrase/default.json -> build/lib/unitxt/catalog/templates/rewriting/paraphrase 2026-05-27T11:53:30,390 copying src/unitxt/catalog/templates/rewriting/paraphrase/all.json -> build/lib/unitxt/catalog/templates/rewriting/paraphrase 2026-05-27T11:53:30,392 creating build/lib/unitxt/catalog/templates/classification/multi_class 2026-05-27T11:53:30,393 copying src/unitxt/catalog/templates/classification/multi_class/default.json -> build/lib/unitxt/catalog/templates/classification/multi_class 2026-05-27T11:53:30,396 copying src/unitxt/catalog/templates/classification/multi_class/instruction.json -> build/lib/unitxt/catalog/templates/classification/multi_class 2026-05-27T11:53:30,398 copying src/unitxt/catalog/templates/classification/multi_class/title.json -> build/lib/unitxt/catalog/templates/classification/multi_class 2026-05-27T11:53:30,400 copying src/unitxt/catalog/templates/classification/multi_class/instruct_question_selects.json -> build/lib/unitxt/catalog/templates/classification/multi_class 2026-05-27T11:53:30,402 copying src/unitxt/catalog/templates/classification/multi_class/instruct_select_question.json -> build/lib/unitxt/catalog/templates/classification/multi_class 2026-05-27T11:53:30,404 copying src/unitxt/catalog/templates/classification/multi_class/bluebench.json -> build/lib/unitxt/catalog/templates/classification/multi_class 2026-05-27T11:53:30,407 copying src/unitxt/catalog/templates/classification/multi_class/empty.json -> build/lib/unitxt/catalog/templates/classification/multi_class 2026-05-27T11:53:30,409 copying src/unitxt/catalog/templates/classification/multi_class/instruct_question_select_i_think.json -> build/lib/unitxt/catalog/templates/classification/multi_class 2026-05-27T11:53:30,411 copying src/unitxt/catalog/templates/classification/multi_class/all.json -> build/lib/unitxt/catalog/templates/classification/multi_class 2026-05-27T11:53:30,413 creating build/lib/unitxt/catalog/templates/classification/multi_class/relation 2026-05-27T11:53:30,414 copying src/unitxt/catalog/templates/classification/multi_class/relation/default.json -> build/lib/unitxt/catalog/templates/classification/multi_class/relation 2026-05-27T11:53:30,416 copying src/unitxt/catalog/templates/classification/multi_class/relation/simple.json -> build/lib/unitxt/catalog/templates/classification/multi_class/relation 2026-05-27T11:53:30,418 copying src/unitxt/catalog/templates/classification/multi_class/relation/all.json -> build/lib/unitxt/catalog/templates/classification/multi_class/relation 2026-05-27T11:53:30,420 creating build/lib/unitxt/catalog/templates/classification/multi_class/relation/truthfulness 2026-05-27T11:53:30,421 copying src/unitxt/catalog/templates/classification/multi_class/relation/truthfulness/flan_4.json -> build/lib/unitxt/catalog/templates/classification/multi_class/relation/truthfulness 2026-05-27T11:53:30,423 copying src/unitxt/catalog/templates/classification/multi_class/relation/truthfulness/flan_1.json -> build/lib/unitxt/catalog/templates/classification/multi_class/relation/truthfulness 2026-05-27T11:53:30,426 copying src/unitxt/catalog/templates/classification/multi_class/relation/truthfulness/flan_3.json -> build/lib/unitxt/catalog/templates/classification/multi_class/relation/truthfulness 2026-05-27T11:53:30,428 copying src/unitxt/catalog/templates/classification/multi_class/relation/truthfulness/flan_6.json -> build/lib/unitxt/catalog/templates/classification/multi_class/relation/truthfulness 2026-05-27T11:53:30,430 copying src/unitxt/catalog/templates/classification/multi_class/relation/truthfulness/flan_7.json -> build/lib/unitxt/catalog/templates/classification/multi_class/relation/truthfulness 2026-05-27T11:53:30,432 copying src/unitxt/catalog/templates/classification/multi_class/relation/truthfulness/flan_2.json -> build/lib/unitxt/catalog/templates/classification/multi_class/relation/truthfulness 2026-05-27T11:53:30,434 copying src/unitxt/catalog/templates/classification/multi_class/relation/truthfulness/all.json -> build/lib/unitxt/catalog/templates/classification/multi_class/relation/truthfulness 2026-05-27T11:53:30,436 copying src/unitxt/catalog/templates/classification/multi_class/relation/truthfulness/flan_5.json -> build/lib/unitxt/catalog/templates/classification/multi_class/relation/truthfulness 2026-05-27T11:53:30,439 creating build/lib/unitxt/catalog/templates/classification/multi_label 2026-05-27T11:53:30,439 copying src/unitxt/catalog/templates/classification/multi_label/default.json -> build/lib/unitxt/catalog/templates/classification/multi_label 2026-05-27T11:53:30,442 copying src/unitxt/catalog/templates/classification/multi_label/instruction.json -> build/lib/unitxt/catalog/templates/classification/multi_label 2026-05-27T11:53:30,444 copying src/unitxt/catalog/templates/classification/multi_label/title.json -> build/lib/unitxt/catalog/templates/classification/multi_label 2026-05-27T11:53:30,446 copying src/unitxt/catalog/templates/classification/multi_label/empty.json -> build/lib/unitxt/catalog/templates/classification/multi_label 2026-05-27T11:53:30,448 copying src/unitxt/catalog/templates/classification/multi_label/all.json -> build/lib/unitxt/catalog/templates/classification/multi_label 2026-05-27T11:53:30,450 creating build/lib/unitxt/catalog/templates/safety 2026-05-27T11:53:30,451 copying src/unitxt/catalog/templates/safety/llamaguard.json -> build/lib/unitxt/catalog/templates/safety 2026-05-27T11:53:30,453 copying src/unitxt/catalog/templates/safety/harm_rating.json -> build/lib/unitxt/catalog/templates/safety 2026-05-27T11:53:30,455 creating build/lib/unitxt/catalog/templates/rag_eval/correctness_holistic 2026-05-27T11:53:30,457 copying src/unitxt/catalog/templates/rag_eval/correctness_holistic/judge_correctness_simple_numeric.json -> build/lib/unitxt/catalog/templates/rag_eval/correctness_holistic 2026-05-27T11:53:30,459 copying src/unitxt/catalog/templates/rag_eval/correctness_holistic/metric_template.json -> build/lib/unitxt/catalog/templates/rag_eval/correctness_holistic 2026-05-27T11:53:30,462 copying src/unitxt/catalog/templates/rag_eval/correctness_holistic/judge_correctness_simple.json -> build/lib/unitxt/catalog/templates/rag_eval/correctness_holistic 2026-05-27T11:53:30,464 copying src/unitxt/catalog/templates/rag_eval/correctness_holistic/judge_correctness_explain_first_logprobs.json -> build/lib/unitxt/catalog/templates/rag_eval/correctness_holistic 2026-05-27T11:53:30,466 copying src/unitxt/catalog/templates/rag_eval/correctness_holistic/judge_correctness_simple_logprobs.json -> build/lib/unitxt/catalog/templates/rag_eval/correctness_holistic 2026-05-27T11:53:30,468 copying src/unitxt/catalog/templates/rag_eval/correctness_holistic/judge_correctness_explain_first.json -> build/lib/unitxt/catalog/templates/rag_eval/correctness_holistic 2026-05-27T11:53:30,470 copying src/unitxt/catalog/templates/rag_eval/correctness_holistic/all.json -> build/lib/unitxt/catalog/templates/rag_eval/correctness_holistic 2026-05-27T11:53:30,472 creating build/lib/unitxt/catalog/templates/rag_eval/context_relevance 2026-05-27T11:53:30,473 copying src/unitxt/catalog/templates/rag_eval/context_relevance/judge_context_relevance_ares_verbal.json -> build/lib/unitxt/catalog/templates/rag_eval/context_relevance 2026-05-27T11:53:30,475 copying src/unitxt/catalog/templates/rag_eval/context_relevance/judge_context_relevance.json -> build/lib/unitxt/catalog/templates/rag_eval/context_relevance 2026-05-27T11:53:30,478 copying src/unitxt/catalog/templates/rag_eval/context_relevance/metric_template.json -> build/lib/unitxt/catalog/templates/rag_eval/context_relevance 2026-05-27T11:53:30,480 copying src/unitxt/catalog/templates/rag_eval/context_relevance/judge_context_relevance_ares.json -> build/lib/unitxt/catalog/templates/rag_eval/context_relevance 2026-05-27T11:53:30,482 copying src/unitxt/catalog/templates/rag_eval/context_relevance/judge_context_relevance_ares_logprobs.json -> build/lib/unitxt/catalog/templates/rag_eval/context_relevance 2026-05-27T11:53:30,484 copying src/unitxt/catalog/templates/rag_eval/context_relevance/judge_context_relevance_ares_verbal_good_bad.json -> build/lib/unitxt/catalog/templates/rag_eval/context_relevance 2026-05-27T11:53:30,486 copying src/unitxt/catalog/templates/rag_eval/context_relevance/judge_context_relevance_logprobs.json -> build/lib/unitxt/catalog/templates/rag_eval/context_relevance 2026-05-27T11:53:30,488 copying src/unitxt/catalog/templates/rag_eval/context_relevance/judge_context_relevance_ares_numeric.json -> build/lib/unitxt/catalog/templates/rag_eval/context_relevance 2026-05-27T11:53:30,490 copying src/unitxt/catalog/templates/rag_eval/context_relevance/all.json -> build/lib/unitxt/catalog/templates/rag_eval/context_relevance 2026-05-27T11:53:30,492 creating build/lib/unitxt/catalog/templates/rag_eval/answer_correctness 2026-05-27T11:53:30,493 copying src/unitxt/catalog/templates/rag_eval/answer_correctness/judge_simplified_no_context.json -> build/lib/unitxt/catalog/templates/rag_eval/answer_correctness 2026-05-27T11:53:30,495 copying src/unitxt/catalog/templates/rag_eval/answer_correctness/metric_template.json -> build/lib/unitxt/catalog/templates/rag_eval/answer_correctness 2026-05-27T11:53:30,497 copying src/unitxt/catalog/templates/rag_eval/answer_correctness/judge_instruct_qa_format_logprobs.json -> build/lib/unitxt/catalog/templates/rag_eval/answer_correctness 2026-05-27T11:53:30,500 copying src/unitxt/catalog/templates/rag_eval/answer_correctness/judge_loose_match_no_context_verbal_good_bad.json -> build/lib/unitxt/catalog/templates/rag_eval/answer_correctness 2026-05-27T11:53:30,502 copying src/unitxt/catalog/templates/rag_eval/answer_correctness/judge_simplified_with_context_logprobs.json -> build/lib/unitxt/catalog/templates/rag_eval/answer_correctness 2026-05-27T11:53:30,504 copying src/unitxt/catalog/templates/rag_eval/answer_correctness/judge_simplified_format.json -> build/lib/unitxt/catalog/templates/rag_eval/answer_correctness 2026-05-27T11:53:30,506 copying src/unitxt/catalog/templates/rag_eval/answer_correctness/judge_simplified_format_logprobs.json -> build/lib/unitxt/catalog/templates/rag_eval/answer_correctness 2026-05-27T11:53:30,508 copying src/unitxt/catalog/templates/rag_eval/answer_correctness/judge_loose_match_no_context_numeric.json -> build/lib/unitxt/catalog/templates/rag_eval/answer_correctness 2026-05-27T11:53:30,510 copying src/unitxt/catalog/templates/rag_eval/answer_correctness/judge_loose_match_no_context_logprobs.json -> build/lib/unitxt/catalog/templates/rag_eval/answer_correctness 2026-05-27T11:53:30,512 copying src/unitxt/catalog/templates/rag_eval/answer_correctness/judge_simplified_no_context_logprobs.json -> build/lib/unitxt/catalog/templates/rag_eval/answer_correctness 2026-05-27T11:53:30,514 copying src/unitxt/catalog/templates/rag_eval/answer_correctness/judge_loose_match_no_context_verbal.json -> build/lib/unitxt/catalog/templates/rag_eval/answer_correctness 2026-05-27T11:53:30,516 copying src/unitxt/catalog/templates/rag_eval/answer_correctness/all.json -> build/lib/unitxt/catalog/templates/rag_eval/answer_correctness 2026-05-27T11:53:30,518 copying src/unitxt/catalog/templates/rag_eval/answer_correctness/judge_instruct_qa_format.json -> build/lib/unitxt/catalog/templates/rag_eval/answer_correctness 2026-05-27T11:53:30,520 copying src/unitxt/catalog/templates/rag_eval/answer_correctness/judge_simplified_with_context.json -> build/lib/unitxt/catalog/templates/rag_eval/answer_correctness 2026-05-27T11:53:30,522 copying src/unitxt/catalog/templates/rag_eval/answer_correctness/judge_loose_match_no_context.json -> build/lib/unitxt/catalog/templates/rag_eval/answer_correctness 2026-05-27T11:53:30,525 creating build/lib/unitxt/catalog/templates/rag_eval/answer_relevance 2026-05-27T11:53:30,525 copying src/unitxt/catalog/templates/rag_eval/answer_relevance/metric_template.json -> build/lib/unitxt/catalog/templates/rag_eval/answer_relevance 2026-05-27T11:53:30,528 copying src/unitxt/catalog/templates/rag_eval/answer_relevance/judge_answer_relevance_logprobs.json -> build/lib/unitxt/catalog/templates/rag_eval/answer_relevance 2026-05-27T11:53:30,530 copying src/unitxt/catalog/templates/rag_eval/answer_relevance/judge_answer_relevance.json -> build/lib/unitxt/catalog/templates/rag_eval/answer_relevance 2026-05-27T11:53:30,532 copying src/unitxt/catalog/templates/rag_eval/answer_relevance/judge_answer_relevance_numeric.json -> build/lib/unitxt/catalog/templates/rag_eval/answer_relevance 2026-05-27T11:53:30,534 copying src/unitxt/catalog/templates/rag_eval/answer_relevance/judge_answer_relevance_verbal_good_bad.json -> build/lib/unitxt/catalog/templates/rag_eval/answer_relevance 2026-05-27T11:53:30,536 copying src/unitxt/catalog/templates/rag_eval/answer_relevance/all.json -> build/lib/unitxt/catalog/templates/rag_eval/answer_relevance 2026-05-27T11:53:30,538 creating build/lib/unitxt/catalog/templates/rag_eval/faithfulness 2026-05-27T11:53:30,539 copying src/unitxt/catalog/templates/rag_eval/faithfulness/judge_no_question_simplified_explain_logprobs.json -> build/lib/unitxt/catalog/templates/rag_eval/faithfulness 2026-05-27T11:53:30,542 copying src/unitxt/catalog/templates/rag_eval/faithfulness/judge_with_question_simplified_verbal.json -> build/lib/unitxt/catalog/templates/rag_eval/faithfulness 2026-05-27T11:53:30,544 copying src/unitxt/catalog/templates/rag_eval/faithfulness/judge_no_question_simplified_verbal_good_bad.json -> build/lib/unitxt/catalog/templates/rag_eval/faithfulness 2026-05-27T11:53:30,546 copying src/unitxt/catalog/templates/rag_eval/faithfulness/metric_template.json -> build/lib/unitxt/catalog/templates/rag_eval/faithfulness 2026-05-27T11:53:30,548 copying src/unitxt/catalog/templates/rag_eval/faithfulness/judge_with_question_full.json -> build/lib/unitxt/catalog/templates/rag_eval/faithfulness 2026-05-27T11:53:30,551 copying src/unitxt/catalog/templates/rag_eval/faithfulness/judge_no_question_simplified_logprobs.json -> build/lib/unitxt/catalog/templates/rag_eval/faithfulness 2026-05-27T11:53:30,553 copying src/unitxt/catalog/templates/rag_eval/faithfulness/judge_no_question_simplified_verbal.json -> build/lib/unitxt/catalog/templates/rag_eval/faithfulness 2026-05-27T11:53:30,555 copying src/unitxt/catalog/templates/rag_eval/faithfulness/judge_no_question_simplified.json -> build/lib/unitxt/catalog/templates/rag_eval/faithfulness 2026-05-27T11:53:30,557 copying src/unitxt/catalog/templates/rag_eval/faithfulness/judge_with_question_simplified_logprobs.json -> build/lib/unitxt/catalog/templates/rag_eval/faithfulness 2026-05-27T11:53:30,559 copying src/unitxt/catalog/templates/rag_eval/faithfulness/judge_with_question_full_logprobs.json -> build/lib/unitxt/catalog/templates/rag_eval/faithfulness 2026-05-27T11:53:30,561 copying src/unitxt/catalog/templates/rag_eval/faithfulness/judge_with_question_simplified.json -> build/lib/unitxt/catalog/templates/rag_eval/faithfulness 2026-05-27T11:53:30,563 copying src/unitxt/catalog/templates/rag_eval/faithfulness/judge_no_question_simplified_explain.json -> build/lib/unitxt/catalog/templates/rag_eval/faithfulness 2026-05-27T11:53:30,565 copying src/unitxt/catalog/templates/rag_eval/faithfulness/judge_with_question_simplified_numeric.json -> build/lib/unitxt/catalog/templates/rag_eval/faithfulness 2026-05-27T11:53:30,568 copying src/unitxt/catalog/templates/rag_eval/faithfulness/judge_with_question_simplified_verbal_good_bad.json -> build/lib/unitxt/catalog/templates/rag_eval/faithfulness 2026-05-27T11:53:30,570 copying src/unitxt/catalog/templates/rag_eval/faithfulness/judge_no_question_simplified_numeric.json -> build/lib/unitxt/catalog/templates/rag_eval/faithfulness 2026-05-27T11:53:30,572 copying src/unitxt/catalog/templates/rag_eval/faithfulness/judge_no_question_full.json -> build/lib/unitxt/catalog/templates/rag_eval/faithfulness 2026-05-27T11:53:30,574 copying src/unitxt/catalog/templates/rag_eval/faithfulness/all.json -> build/lib/unitxt/catalog/templates/rag_eval/faithfulness 2026-05-27T11:53:30,576 copying src/unitxt/catalog/templates/rag_eval/faithfulness/judge_no_question_full_logprobs.json -> build/lib/unitxt/catalog/templates/rag_eval/faithfulness 2026-05-27T11:53:30,579 creating build/lib/unitxt/catalog/templates/text2sql 2026-05-27T11:53:30,580 copying src/unitxt/catalog/templates/text2sql/you_are_given.json -> build/lib/unitxt/catalog/templates/text2sql 2026-05-27T11:53:30,582 copying src/unitxt/catalog/templates/text2sql/you_are_given_no_system_with_hint.json -> build/lib/unitxt/catalog/templates/text2sql 2026-05-27T11:53:30,584 copying src/unitxt/catalog/templates/text2sql/you_are_given_no_system.json -> build/lib/unitxt/catalog/templates/text2sql 2026-05-27T11:53:30,586 copying src/unitxt/catalog/templates/text2sql/empty.json -> build/lib/unitxt/catalog/templates/text2sql 2026-05-27T11:53:30,588 copying src/unitxt/catalog/templates/text2sql/you_are_given_with_hint.json -> build/lib/unitxt/catalog/templates/text2sql 2026-05-27T11:53:30,591 copying src/unitxt/catalog/templates/text2sql/you_are_given_with_hint_answer_sql_prefix_no_inst.json -> build/lib/unitxt/catalog/templates/text2sql 2026-05-27T11:53:30,593 copying src/unitxt/catalog/templates/text2sql/all.json -> build/lib/unitxt/catalog/templates/text2sql 2026-05-27T11:53:30,595 copying src/unitxt/catalog/templates/text2sql/you_are_given_with_hint_with_out_sql_prefix.json -> build/lib/unitxt/catalog/templates/text2sql 2026-05-27T11:53:30,597 copying src/unitxt/catalog/templates/text2sql/you_are_given_with_hint_with_sql_prefix.json -> build/lib/unitxt/catalog/templates/text2sql 2026-05-27T11:53:30,599 copying src/unitxt/catalog/templates/text2sql/you_are_given_with_sql_prefix.json -> build/lib/unitxt/catalog/templates/text2sql 2026-05-27T11:53:30,601 creating build/lib/unitxt/catalog/templates/response_assessment/pairwise_comparison 2026-05-27T11:53:30,603 copying src/unitxt/catalog/templates/response_assessment/pairwise_comparison/mt_bench_single_turn_with_reference_with_shuffling.json -> build/lib/unitxt/catalog/templates/response_assessment/pairwise_comparison 2026-05-27T11:53:30,606 copying src/unitxt/catalog/templates/response_assessment/pairwise_comparison/mt_bench_single_turn_with_shuffling.json -> build/lib/unitxt/catalog/templates/response_assessment/pairwise_comparison 2026-05-27T11:53:30,608 copying src/unitxt/catalog/templates/response_assessment/pairwise_comparison/mt_bench_multi_turn.json -> build/lib/unitxt/catalog/templates/response_assessment/pairwise_comparison 2026-05-27T11:53:30,610 copying src/unitxt/catalog/templates/response_assessment/pairwise_comparison/mt_bench_multi_turn_with_shuffling.json -> build/lib/unitxt/catalog/templates/response_assessment/pairwise_comparison 2026-05-27T11:53:30,612 copying src/unitxt/catalog/templates/response_assessment/pairwise_comparison/mt_bench_multi_turn_with_reference_with_shuffling.json -> build/lib/unitxt/catalog/templates/response_assessment/pairwise_comparison 2026-05-27T11:53:30,614 copying src/unitxt/catalog/templates/response_assessment/pairwise_comparison/mt_bench_single_turn.json -> build/lib/unitxt/catalog/templates/response_assessment/pairwise_comparison 2026-05-27T11:53:30,616 copying src/unitxt/catalog/templates/response_assessment/pairwise_comparison/mt_bench_single_turn_with_reference.json -> build/lib/unitxt/catalog/templates/response_assessment/pairwise_comparison 2026-05-27T11:53:30,618 copying src/unitxt/catalog/templates/response_assessment/pairwise_comparison/mt_bench_multi_turn_with_reference.json -> build/lib/unitxt/catalog/templates/response_assessment/pairwise_comparison 2026-05-27T11:53:30,621 creating build/lib/unitxt/catalog/templates/response_assessment/pairwise_comparative_rating 2026-05-27T11:53:30,622 copying src/unitxt/catalog/templates/response_assessment/pairwise_comparative_rating/prometheus_arena_hard_with_shuffling.json -> build/lib/unitxt/catalog/templates/response_assessment/pairwise_comparative_rating 2026-05-27T11:53:30,624 copying src/unitxt/catalog/templates/response_assessment/pairwise_comparative_rating/arena_hard_with_shuffling.json -> build/lib/unitxt/catalog/templates/response_assessment/pairwise_comparative_rating 2026-05-27T11:53:30,626 copying src/unitxt/catalog/templates/response_assessment/pairwise_comparative_rating/arena_hard.json -> build/lib/unitxt/catalog/templates/response_assessment/pairwise_comparative_rating 2026-05-27T11:53:30,629 copying src/unitxt/catalog/templates/response_assessment/pairwise_comparative_rating/prometheus_arena_hard.json -> build/lib/unitxt/catalog/templates/response_assessment/pairwise_comparative_rating 2026-05-27T11:53:30,631 creating build/lib/unitxt/catalog/templates/response_assessment/rating 2026-05-27T11:53:30,632 copying src/unitxt/catalog/templates/response_assessment/rating/mt_bench_multi_turn.json -> build/lib/unitxt/catalog/templates/response_assessment/rating 2026-05-27T11:53:30,634 copying src/unitxt/catalog/templates/response_assessment/rating/table2text_single_turn_with_reference.json -> build/lib/unitxt/catalog/templates/response_assessment/rating 2026-05-27T11:53:30,636 copying src/unitxt/catalog/templates/response_assessment/rating/generic_single_turn_with_reference.json -> build/lib/unitxt/catalog/templates/response_assessment/rating 2026-05-27T11:53:30,639 copying src/unitxt/catalog/templates/response_assessment/rating/generic_single_turn.json -> build/lib/unitxt/catalog/templates/response_assessment/rating 2026-05-27T11:53:30,641 copying src/unitxt/catalog/templates/response_assessment/rating/mt_bench_single_turn.json -> build/lib/unitxt/catalog/templates/response_assessment/rating 2026-05-27T11:53:30,643 copying src/unitxt/catalog/templates/response_assessment/rating/mt_bench_single_turn_with_reference.json -> build/lib/unitxt/catalog/templates/response_assessment/rating 2026-05-27T11:53:30,645 copying src/unitxt/catalog/templates/response_assessment/rating/mt_bench_multi_turn_with_reference.json -> build/lib/unitxt/catalog/templates/response_assessment/rating 2026-05-27T11:53:30,647 creating build/lib/unitxt/catalog/templates/language_identification 2026-05-27T11:53:30,648 copying src/unitxt/catalog/templates/language_identification/simple.json -> build/lib/unitxt/catalog/templates/language_identification 2026-05-27T11:53:30,651 copying src/unitxt/catalog/templates/language_identification/all.json -> build/lib/unitxt/catalog/templates/language_identification 2026-05-27T11:53:30,653 creating build/lib/unitxt/catalog/templates/qa 2026-05-27T11:53:30,653 copying src/unitxt/catalog/templates/qa/open.json -> build/lib/unitxt/catalog/templates/qa 2026-05-27T11:53:30,656 copying src/unitxt/catalog/templates/qa/extractive.json -> build/lib/unitxt/catalog/templates/qa 2026-05-27T11:53:30,658 copying src/unitxt/catalog/templates/qa/with_context.json -> build/lib/unitxt/catalog/templates/qa 2026-05-27T11:53:30,660 creating build/lib/unitxt/catalog/templates/qa/with_context 2026-05-27T11:53:30,661 copying src/unitxt/catalog/templates/qa/with_context/with_type.json -> build/lib/unitxt/catalog/templates/qa/with_context 2026-05-27T11:53:30,663 copying src/unitxt/catalog/templates/qa/with_context/info_vqa.json -> build/lib/unitxt/catalog/templates/qa/with_context 2026-05-27T11:53:30,665 copying src/unitxt/catalog/templates/qa/with_context/doc_vqa.json -> build/lib/unitxt/catalog/templates/qa/with_context 2026-05-27T11:53:30,668 copying src/unitxt/catalog/templates/qa/with_context/qtsumm.json -> build/lib/unitxt/catalog/templates/qa/with_context 2026-05-27T11:53:30,670 copying src/unitxt/catalog/templates/qa/with_context/title.json -> build/lib/unitxt/catalog/templates/qa/with_context 2026-05-27T11:53:30,672 copying src/unitxt/catalog/templates/qa/with_context/ffqa.json -> build/lib/unitxt/catalog/templates/qa/with_context 2026-05-27T11:53:30,674 copying src/unitxt/catalog/templates/qa/with_context/question_first.json -> build/lib/unitxt/catalog/templates/qa/with_context 2026-05-27T11:53:30,676 copying src/unitxt/catalog/templates/qa/with_context/chart_qa.json -> build/lib/unitxt/catalog/templates/qa/with_context 2026-05-27T11:53:30,678 copying src/unitxt/catalog/templates/qa/with_context/lmms_eval.json -> build/lib/unitxt/catalog/templates/qa/with_context 2026-05-27T11:53:30,680 copying src/unitxt/catalog/templates/qa/with_context/websrc.json -> build/lib/unitxt/catalog/templates/qa/with_context 2026-05-27T11:53:30,682 copying src/unitxt/catalog/templates/qa/with_context/simple2.json -> build/lib/unitxt/catalog/templates/qa/with_context 2026-05-27T11:53:30,684 copying src/unitxt/catalog/templates/qa/with_context/simple.json -> build/lib/unitxt/catalog/templates/qa/with_context 2026-05-27T11:53:30,686 copying src/unitxt/catalog/templates/qa/with_context/all.json -> build/lib/unitxt/catalog/templates/qa/with_context 2026-05-27T11:53:30,688 creating build/lib/unitxt/catalog/templates/qa/multiple_choice 2026-05-27T11:53:30,689 copying src/unitxt/catalog/templates/qa/multiple_choice/helm.json -> build/lib/unitxt/catalog/templates/qa/multiple_choice 2026-05-27T11:53:30,691 copying src/unitxt/catalog/templates/qa/multiple_choice/title.json -> build/lib/unitxt/catalog/templates/qa/multiple_choice 2026-05-27T11:53:30,693 copying src/unitxt/catalog/templates/qa/multiple_choice/match.json -> build/lib/unitxt/catalog/templates/qa/multiple_choice 2026-05-27T11:53:30,696 copying src/unitxt/catalog/templates/qa/multiple_choice/lm_eval_harness.json -> build/lib/unitxt/catalog/templates/qa/multiple_choice 2026-05-27T11:53:30,698 creating build/lib/unitxt/catalog/templates/qa/multiple_choice/with_context 2026-05-27T11:53:30,699 copying src/unitxt/catalog/templates/qa/multiple_choice/with_context/ai2d.json -> build/lib/unitxt/catalog/templates/qa/multiple_choice/with_context 2026-05-27T11:53:30,701 copying src/unitxt/catalog/templates/qa/multiple_choice/with_context/title.json -> build/lib/unitxt/catalog/templates/qa/multiple_choice/with_context 2026-05-27T11:53:30,704 copying src/unitxt/catalog/templates/qa/multiple_choice/with_context/bluebench.json -> build/lib/unitxt/catalog/templates/qa/multiple_choice/with_context 2026-05-27T11:53:30,706 copying src/unitxt/catalog/templates/qa/multiple_choice/with_context/match.json -> build/lib/unitxt/catalog/templates/qa/multiple_choice/with_context 2026-05-27T11:53:30,708 copying src/unitxt/catalog/templates/qa/multiple_choice/with_context/lmms_eval.json -> build/lib/unitxt/catalog/templates/qa/multiple_choice/with_context 2026-05-27T11:53:30,710 copying src/unitxt/catalog/templates/qa/multiple_choice/with_context/exact_answer_instruct.json -> build/lib/unitxt/catalog/templates/qa/multiple_choice/with_context 2026-05-27T11:53:30,712 copying src/unitxt/catalog/templates/qa/multiple_choice/with_context/all.json -> build/lib/unitxt/catalog/templates/qa/multiple_choice/with_context 2026-05-27T11:53:30,715 copying src/unitxt/catalog/templates/qa/multiple_choice/with_context/lm_eval_harness.json -> build/lib/unitxt/catalog/templates/qa/multiple_choice/with_context 2026-05-27T11:53:30,717 creating build/lib/unitxt/catalog/templates/qa/multiple_choice/with_context/no_intro 2026-05-27T11:53:30,718 copying src/unitxt/catalog/templates/qa/multiple_choice/with_context/no_intro/mmlu.json -> build/lib/unitxt/catalog/templates/qa/multiple_choice/with_context/no_intro 2026-05-27T11:53:30,720 copying src/unitxt/catalog/templates/qa/multiple_choice/with_context/no_intro/helm.json -> build/lib/unitxt/catalog/templates/qa/multiple_choice/with_context/no_intro 2026-05-27T11:53:30,722 copying src/unitxt/catalog/templates/qa/multiple_choice/with_context/no_intro/all.json -> build/lib/unitxt/catalog/templates/qa/multiple_choice/with_context/no_intro 2026-05-27T11:53:30,724 copying src/unitxt/catalog/templates/qa/multiple_choice/with_context/no_intro/lm_eval_harness.json -> build/lib/unitxt/catalog/templates/qa/multiple_choice/with_context/no_intro 2026-05-27T11:53:30,727 creating build/lib/unitxt/catalog/templates/qa/multiple_choice/with_context/no_intro/ja 2026-05-27T11:53:30,728 copying src/unitxt/catalog/templates/qa/multiple_choice/with_context/no_intro/ja/mmlu.json -> build/lib/unitxt/catalog/templates/qa/multiple_choice/with_context/no_intro/ja 2026-05-27T11:53:30,730 copying src/unitxt/catalog/templates/qa/multiple_choice/with_context/no_intro/ja/helm.json -> build/lib/unitxt/catalog/templates/qa/multiple_choice/with_context/no_intro/ja 2026-05-27T11:53:30,732 copying src/unitxt/catalog/templates/qa/multiple_choice/with_context/no_intro/ja/all.json -> build/lib/unitxt/catalog/templates/qa/multiple_choice/with_context/no_intro/ja 2026-05-27T11:53:30,734 copying src/unitxt/catalog/templates/qa/multiple_choice/with_context/no_intro/ja/lm_eval_harness.json -> build/lib/unitxt/catalog/templates/qa/multiple_choice/with_context/no_intro/ja 2026-05-27T11:53:30,736 creating build/lib/unitxt/catalog/templates/qa/multiple_choice/with_context/no_intro/fr 2026-05-27T11:53:30,737 copying src/unitxt/catalog/templates/qa/multiple_choice/with_context/no_intro/fr/mmlu.json -> build/lib/unitxt/catalog/templates/qa/multiple_choice/with_context/no_intro/fr 2026-05-27T11:53:30,740 copying src/unitxt/catalog/templates/qa/multiple_choice/with_context/no_intro/fr/helm.json -> build/lib/unitxt/catalog/templates/qa/multiple_choice/with_context/no_intro/fr 2026-05-27T11:53:30,742 copying src/unitxt/catalog/templates/qa/multiple_choice/with_context/no_intro/fr/all.json -> build/lib/unitxt/catalog/templates/qa/multiple_choice/with_context/no_intro/fr 2026-05-27T11:53:30,744 copying src/unitxt/catalog/templates/qa/multiple_choice/with_context/no_intro/fr/lm_eval_harness.json -> build/lib/unitxt/catalog/templates/qa/multiple_choice/with_context/no_intro/fr 2026-05-27T11:53:30,746 creating build/lib/unitxt/catalog/templates/qa/multiple_choice/with_context/no_intro/de 2026-05-27T11:53:30,747 copying src/unitxt/catalog/templates/qa/multiple_choice/with_context/no_intro/de/mmlu.json -> build/lib/unitxt/catalog/templates/qa/multiple_choice/with_context/no_intro/de 2026-05-27T11:53:30,749 copying src/unitxt/catalog/templates/qa/multiple_choice/with_context/no_intro/de/helm.json -> build/lib/unitxt/catalog/templates/qa/multiple_choice/with_context/no_intro/de 2026-05-27T11:53:30,752 copying src/unitxt/catalog/templates/qa/multiple_choice/with_context/no_intro/de/all.json -> build/lib/unitxt/catalog/templates/qa/multiple_choice/with_context/no_intro/de 2026-05-27T11:53:30,754 copying src/unitxt/catalog/templates/qa/multiple_choice/with_context/no_intro/de/lm_eval_harness.json -> build/lib/unitxt/catalog/templates/qa/multiple_choice/with_context/no_intro/de 2026-05-27T11:53:30,756 creating build/lib/unitxt/catalog/templates/qa/multiple_choice/with_context/no_intro/es 2026-05-27T11:53:30,757 copying src/unitxt/catalog/templates/qa/multiple_choice/with_context/no_intro/es/mmlu.json -> build/lib/unitxt/catalog/templates/qa/multiple_choice/with_context/no_intro/es 2026-05-27T11:53:30,759 copying src/unitxt/catalog/templates/qa/multiple_choice/with_context/no_intro/es/helm.json -> build/lib/unitxt/catalog/templates/qa/multiple_choice/with_context/no_intro/es 2026-05-27T11:53:30,761 copying src/unitxt/catalog/templates/qa/multiple_choice/with_context/no_intro/es/all.json -> build/lib/unitxt/catalog/templates/qa/multiple_choice/with_context/no_intro/es 2026-05-27T11:53:30,763 copying src/unitxt/catalog/templates/qa/multiple_choice/with_context/no_intro/es/lm_eval_harness.json -> build/lib/unitxt/catalog/templates/qa/multiple_choice/with_context/no_intro/es 2026-05-27T11:53:30,765 creating build/lib/unitxt/catalog/templates/qa/multiple_choice/with_context/no_intro/pt 2026-05-27T11:53:30,766 copying src/unitxt/catalog/templates/qa/multiple_choice/with_context/no_intro/pt/mmlu.json -> build/lib/unitxt/catalog/templates/qa/multiple_choice/with_context/no_intro/pt 2026-05-27T11:53:30,768 copying src/unitxt/catalog/templates/qa/multiple_choice/with_context/no_intro/pt/helm.json -> build/lib/unitxt/catalog/templates/qa/multiple_choice/with_context/no_intro/pt 2026-05-27T11:53:30,770 copying src/unitxt/catalog/templates/qa/multiple_choice/with_context/no_intro/pt/all.json -> build/lib/unitxt/catalog/templates/qa/multiple_choice/with_context/no_intro/pt 2026-05-27T11:53:30,772 copying src/unitxt/catalog/templates/qa/multiple_choice/with_context/no_intro/pt/lm_eval_harness.json -> build/lib/unitxt/catalog/templates/qa/multiple_choice/with_context/no_intro/pt 2026-05-27T11:53:30,774 creating build/lib/unitxt/catalog/templates/qa/multiple_choice/with_context/with_topic 2026-05-27T11:53:30,775 copying src/unitxt/catalog/templates/qa/multiple_choice/with_context/with_topic/mmlu.json -> build/lib/unitxt/catalog/templates/qa/multiple_choice/with_context/with_topic 2026-05-27T11:53:30,778 copying src/unitxt/catalog/templates/qa/multiple_choice/with_context/with_topic/helm.json -> build/lib/unitxt/catalog/templates/qa/multiple_choice/with_context/with_topic 2026-05-27T11:53:30,780 copying src/unitxt/catalog/templates/qa/multiple_choice/with_context/with_topic/title.json -> build/lib/unitxt/catalog/templates/qa/multiple_choice/with_context/with_topic 2026-05-27T11:53:30,782 copying src/unitxt/catalog/templates/qa/multiple_choice/with_context/with_topic/match.json -> build/lib/unitxt/catalog/templates/qa/multiple_choice/with_context/with_topic 2026-05-27T11:53:30,784 copying src/unitxt/catalog/templates/qa/multiple_choice/with_context/with_topic/fm_eval.json -> build/lib/unitxt/catalog/templates/qa/multiple_choice/with_context/with_topic 2026-05-27T11:53:30,787 copying src/unitxt/catalog/templates/qa/multiple_choice/with_context/with_topic/all.json -> build/lib/unitxt/catalog/templates/qa/multiple_choice/with_context/with_topic 2026-05-27T11:53:30,789 copying src/unitxt/catalog/templates/qa/multiple_choice/with_context/with_topic/lm_eval_harness.json -> build/lib/unitxt/catalog/templates/qa/multiple_choice/with_context/with_topic 2026-05-27T11:53:30,791 creating build/lib/unitxt/catalog/templates/qa/multiple_choice/with_context/with_topic/ja 2026-05-27T11:53:30,792 copying src/unitxt/catalog/templates/qa/multiple_choice/with_context/with_topic/ja/mmlu.json -> build/lib/unitxt/catalog/templates/qa/multiple_choice/with_context/with_topic/ja 2026-05-27T11:53:30,794 copying src/unitxt/catalog/templates/qa/multiple_choice/with_context/with_topic/ja/helm.json -> build/lib/unitxt/catalog/templates/qa/multiple_choice/with_context/with_topic/ja 2026-05-27T11:53:30,797 copying src/unitxt/catalog/templates/qa/multiple_choice/with_context/with_topic/ja/all.json -> build/lib/unitxt/catalog/templates/qa/multiple_choice/with_context/with_topic/ja 2026-05-27T11:53:30,799 copying src/unitxt/catalog/templates/qa/multiple_choice/with_context/with_topic/ja/lm_eval_harness.json -> build/lib/unitxt/catalog/templates/qa/multiple_choice/with_context/with_topic/ja 2026-05-27T11:53:30,801 creating build/lib/unitxt/catalog/templates/qa/multiple_choice/with_context/with_topic/fr 2026-05-27T11:53:30,802 copying src/unitxt/catalog/templates/qa/multiple_choice/with_context/with_topic/fr/mmlu.json -> build/lib/unitxt/catalog/templates/qa/multiple_choice/with_context/with_topic/fr 2026-05-27T11:53:30,804 copying src/unitxt/catalog/templates/qa/multiple_choice/with_context/with_topic/fr/helm.json -> build/lib/unitxt/catalog/templates/qa/multiple_choice/with_context/with_topic/fr 2026-05-27T11:53:30,806 copying src/unitxt/catalog/templates/qa/multiple_choice/with_context/with_topic/fr/all.json -> build/lib/unitxt/catalog/templates/qa/multiple_choice/with_context/with_topic/fr 2026-05-27T11:53:30,809 copying src/unitxt/catalog/templates/qa/multiple_choice/with_context/with_topic/fr/lm_eval_harness.json -> build/lib/unitxt/catalog/templates/qa/multiple_choice/with_context/with_topic/fr 2026-05-27T11:53:30,811 creating build/lib/unitxt/catalog/templates/qa/multiple_choice/with_context/with_topic/de 2026-05-27T11:53:30,812 copying src/unitxt/catalog/templates/qa/multiple_choice/with_context/with_topic/de/mmlu.json -> build/lib/unitxt/catalog/templates/qa/multiple_choice/with_context/with_topic/de 2026-05-27T11:53:30,814 copying src/unitxt/catalog/templates/qa/multiple_choice/with_context/with_topic/de/helm.json -> build/lib/unitxt/catalog/templates/qa/multiple_choice/with_context/with_topic/de 2026-05-27T11:53:30,816 copying src/unitxt/catalog/templates/qa/multiple_choice/with_context/with_topic/de/all.json -> build/lib/unitxt/catalog/templates/qa/multiple_choice/with_context/with_topic/de 2026-05-27T11:53:30,819 copying src/unitxt/catalog/templates/qa/multiple_choice/with_context/with_topic/de/lm_eval_harness.json -> build/lib/unitxt/catalog/templates/qa/multiple_choice/with_context/with_topic/de 2026-05-27T11:53:30,821 creating build/lib/unitxt/catalog/templates/qa/multiple_choice/with_context/with_topic/es 2026-05-27T11:53:30,822 copying src/unitxt/catalog/templates/qa/multiple_choice/with_context/with_topic/es/mmlu.json -> build/lib/unitxt/catalog/templates/qa/multiple_choice/with_context/with_topic/es 2026-05-27T11:53:30,824 copying src/unitxt/catalog/templates/qa/multiple_choice/with_context/with_topic/es/helm.json -> build/lib/unitxt/catalog/templates/qa/multiple_choice/with_context/with_topic/es 2026-05-27T11:53:30,827 copying src/unitxt/catalog/templates/qa/multiple_choice/with_context/with_topic/es/all.json -> build/lib/unitxt/catalog/templates/qa/multiple_choice/with_context/with_topic/es 2026-05-27T11:53:30,829 copying src/unitxt/catalog/templates/qa/multiple_choice/with_context/with_topic/es/lm_eval_harness.json -> build/lib/unitxt/catalog/templates/qa/multiple_choice/with_context/with_topic/es 2026-05-27T11:53:30,831 creating build/lib/unitxt/catalog/templates/qa/multiple_choice/with_context/with_topic/pt 2026-05-27T11:53:30,832 copying src/unitxt/catalog/templates/qa/multiple_choice/with_context/with_topic/pt/mmlu.json -> build/lib/unitxt/catalog/templates/qa/multiple_choice/with_context/with_topic/pt 2026-05-27T11:53:30,835 copying src/unitxt/catalog/templates/qa/multiple_choice/with_context/with_topic/pt/helm.json -> build/lib/unitxt/catalog/templates/qa/multiple_choice/with_context/with_topic/pt 2026-05-27T11:53:30,838 copying src/unitxt/catalog/templates/qa/multiple_choice/with_context/with_topic/pt/all.json -> build/lib/unitxt/catalog/templates/qa/multiple_choice/with_context/with_topic/pt 2026-05-27T11:53:30,840 copying src/unitxt/catalog/templates/qa/multiple_choice/with_context/with_topic/pt/lm_eval_harness.json -> build/lib/unitxt/catalog/templates/qa/multiple_choice/with_context/with_topic/pt 2026-05-27T11:53:30,842 creating build/lib/unitxt/catalog/templates/qa/multiple_choice/open 2026-05-27T11:53:30,843 copying src/unitxt/catalog/templates/qa/multiple_choice/open/mmlu.json -> build/lib/unitxt/catalog/templates/qa/multiple_choice/open 2026-05-27T11:53:30,845 copying src/unitxt/catalog/templates/qa/multiple_choice/open/helm.json -> build/lib/unitxt/catalog/templates/qa/multiple_choice/open 2026-05-27T11:53:30,847 copying src/unitxt/catalog/templates/qa/multiple_choice/open/bluebench.json -> build/lib/unitxt/catalog/templates/qa/multiple_choice/open 2026-05-27T11:53:30,849 copying src/unitxt/catalog/templates/qa/multiple_choice/open/all.json -> build/lib/unitxt/catalog/templates/qa/multiple_choice/open 2026-05-27T11:53:30,851 copying src/unitxt/catalog/templates/qa/multiple_choice/open/lm_eval_harness.json -> build/lib/unitxt/catalog/templates/qa/multiple_choice/open 2026-05-27T11:53:30,853 creating build/lib/unitxt/catalog/templates/qa/multiple_choice/open/ja 2026-05-27T11:53:30,854 copying src/unitxt/catalog/templates/qa/multiple_choice/open/ja/mmlu.json -> build/lib/unitxt/catalog/templates/qa/multiple_choice/open/ja 2026-05-27T11:53:30,856 copying src/unitxt/catalog/templates/qa/multiple_choice/open/ja/helm.json -> build/lib/unitxt/catalog/templates/qa/multiple_choice/open/ja 2026-05-27T11:53:30,859 copying src/unitxt/catalog/templates/qa/multiple_choice/open/ja/all.json -> build/lib/unitxt/catalog/templates/qa/multiple_choice/open/ja 2026-05-27T11:53:30,861 copying src/unitxt/catalog/templates/qa/multiple_choice/open/ja/lm_eval_harness.json -> build/lib/unitxt/catalog/templates/qa/multiple_choice/open/ja 2026-05-27T11:53:30,863 creating build/lib/unitxt/catalog/templates/qa/multiple_choice/open/fr 2026-05-27T11:53:30,864 copying src/unitxt/catalog/templates/qa/multiple_choice/open/fr/mmlu.json -> build/lib/unitxt/catalog/templates/qa/multiple_choice/open/fr 2026-05-27T11:53:30,866 copying src/unitxt/catalog/templates/qa/multiple_choice/open/fr/helm.json -> build/lib/unitxt/catalog/templates/qa/multiple_choice/open/fr 2026-05-27T11:53:30,868 copying src/unitxt/catalog/templates/qa/multiple_choice/open/fr/all.json -> build/lib/unitxt/catalog/templates/qa/multiple_choice/open/fr 2026-05-27T11:53:30,870 copying src/unitxt/catalog/templates/qa/multiple_choice/open/fr/lm_eval_harness.json -> build/lib/unitxt/catalog/templates/qa/multiple_choice/open/fr 2026-05-27T11:53:30,872 creating build/lib/unitxt/catalog/templates/qa/multiple_choice/open/de 2026-05-27T11:53:30,873 copying src/unitxt/catalog/templates/qa/multiple_choice/open/de/mmlu.json -> build/lib/unitxt/catalog/templates/qa/multiple_choice/open/de 2026-05-27T11:53:30,876 copying src/unitxt/catalog/templates/qa/multiple_choice/open/de/helm.json -> build/lib/unitxt/catalog/templates/qa/multiple_choice/open/de 2026-05-27T11:53:30,878 copying src/unitxt/catalog/templates/qa/multiple_choice/open/de/all.json -> build/lib/unitxt/catalog/templates/qa/multiple_choice/open/de 2026-05-27T11:53:30,880 copying src/unitxt/catalog/templates/qa/multiple_choice/open/de/lm_eval_harness.json -> build/lib/unitxt/catalog/templates/qa/multiple_choice/open/de 2026-05-27T11:53:30,882 creating build/lib/unitxt/catalog/templates/qa/multiple_choice/open/es 2026-05-27T11:53:30,883 copying src/unitxt/catalog/templates/qa/multiple_choice/open/es/mmlu.json -> build/lib/unitxt/catalog/templates/qa/multiple_choice/open/es 2026-05-27T11:53:30,885 copying src/unitxt/catalog/templates/qa/multiple_choice/open/es/helm.json -> build/lib/unitxt/catalog/templates/qa/multiple_choice/open/es 2026-05-27T11:53:30,887 copying src/unitxt/catalog/templates/qa/multiple_choice/open/es/all.json -> build/lib/unitxt/catalog/templates/qa/multiple_choice/open/es 2026-05-27T11:53:30,889 copying src/unitxt/catalog/templates/qa/multiple_choice/open/es/lm_eval_harness.json -> build/lib/unitxt/catalog/templates/qa/multiple_choice/open/es 2026-05-27T11:53:30,891 creating build/lib/unitxt/catalog/templates/qa/multiple_choice/open/pt 2026-05-27T11:53:30,892 copying src/unitxt/catalog/templates/qa/multiple_choice/open/pt/mmlu.json -> build/lib/unitxt/catalog/templates/qa/multiple_choice/open/pt 2026-05-27T11:53:30,895 copying src/unitxt/catalog/templates/qa/multiple_choice/open/pt/helm.json -> build/lib/unitxt/catalog/templates/qa/multiple_choice/open/pt 2026-05-27T11:53:30,897 copying src/unitxt/catalog/templates/qa/multiple_choice/open/pt/all.json -> build/lib/unitxt/catalog/templates/qa/multiple_choice/open/pt 2026-05-27T11:53:30,899 copying src/unitxt/catalog/templates/qa/multiple_choice/open/pt/lm_eval_harness.json -> build/lib/unitxt/catalog/templates/qa/multiple_choice/open/pt 2026-05-27T11:53:30,901 creating build/lib/unitxt/catalog/templates/qa/multiple_choice/with_topic 2026-05-27T11:53:30,902 copying src/unitxt/catalog/templates/qa/multiple_choice/with_topic/mmlu.json -> build/lib/unitxt/catalog/templates/qa/multiple_choice/with_topic 2026-05-27T11:53:30,904 copying src/unitxt/catalog/templates/qa/multiple_choice/with_topic/helm.json -> build/lib/unitxt/catalog/templates/qa/multiple_choice/with_topic 2026-05-27T11:53:30,907 copying src/unitxt/catalog/templates/qa/multiple_choice/with_topic/title.json -> build/lib/unitxt/catalog/templates/qa/multiple_choice/with_topic 2026-05-27T11:53:30,909 copying src/unitxt/catalog/templates/qa/multiple_choice/with_topic/bluebench.json -> build/lib/unitxt/catalog/templates/qa/multiple_choice/with_topic 2026-05-27T11:53:30,911 copying src/unitxt/catalog/templates/qa/multiple_choice/with_topic/match.json -> build/lib/unitxt/catalog/templates/qa/multiple_choice/with_topic 2026-05-27T11:53:30,913 copying src/unitxt/catalog/templates/qa/multiple_choice/with_topic/fm_eval.json -> build/lib/unitxt/catalog/templates/qa/multiple_choice/with_topic 2026-05-27T11:53:30,915 copying src/unitxt/catalog/templates/qa/multiple_choice/with_topic/all.json -> build/lib/unitxt/catalog/templates/qa/multiple_choice/with_topic 2026-05-27T11:53:30,918 copying src/unitxt/catalog/templates/qa/multiple_choice/with_topic/lm_eval_harness.json -> build/lib/unitxt/catalog/templates/qa/multiple_choice/with_topic 2026-05-27T11:53:30,920 creating build/lib/unitxt/catalog/templates/qa/multiple_choice/with_topic/ja 2026-05-27T11:53:30,921 copying src/unitxt/catalog/templates/qa/multiple_choice/with_topic/ja/mmlu.json -> build/lib/unitxt/catalog/templates/qa/multiple_choice/with_topic/ja 2026-05-27T11:53:30,923 copying src/unitxt/catalog/templates/qa/multiple_choice/with_topic/ja/helm.json -> build/lib/unitxt/catalog/templates/qa/multiple_choice/with_topic/ja 2026-05-27T11:53:30,925 copying src/unitxt/catalog/templates/qa/multiple_choice/with_topic/ja/all.json -> build/lib/unitxt/catalog/templates/qa/multiple_choice/with_topic/ja 2026-05-27T11:53:30,928 copying src/unitxt/catalog/templates/qa/multiple_choice/with_topic/ja/lm_eval_harness.json -> build/lib/unitxt/catalog/templates/qa/multiple_choice/with_topic/ja 2026-05-27T11:53:30,930 creating build/lib/unitxt/catalog/templates/qa/multiple_choice/with_topic/fr 2026-05-27T11:53:30,931 copying src/unitxt/catalog/templates/qa/multiple_choice/with_topic/fr/mmlu.json -> build/lib/unitxt/catalog/templates/qa/multiple_choice/with_topic/fr 2026-05-27T11:53:30,933 copying src/unitxt/catalog/templates/qa/multiple_choice/with_topic/fr/helm.json -> build/lib/unitxt/catalog/templates/qa/multiple_choice/with_topic/fr 2026-05-27T11:53:30,935 copying src/unitxt/catalog/templates/qa/multiple_choice/with_topic/fr/all.json -> build/lib/unitxt/catalog/templates/qa/multiple_choice/with_topic/fr 2026-05-27T11:53:30,938 copying src/unitxt/catalog/templates/qa/multiple_choice/with_topic/fr/lm_eval_harness.json -> build/lib/unitxt/catalog/templates/qa/multiple_choice/with_topic/fr 2026-05-27T11:53:30,940 creating build/lib/unitxt/catalog/templates/qa/multiple_choice/with_topic/de 2026-05-27T11:53:30,941 copying src/unitxt/catalog/templates/qa/multiple_choice/with_topic/de/mmlu.json -> build/lib/unitxt/catalog/templates/qa/multiple_choice/with_topic/de 2026-05-27T11:53:30,943 copying src/unitxt/catalog/templates/qa/multiple_choice/with_topic/de/helm.json -> build/lib/unitxt/catalog/templates/qa/multiple_choice/with_topic/de 2026-05-27T11:53:30,945 copying src/unitxt/catalog/templates/qa/multiple_choice/with_topic/de/all.json -> build/lib/unitxt/catalog/templates/qa/multiple_choice/with_topic/de 2026-05-27T11:53:30,947 copying src/unitxt/catalog/templates/qa/multiple_choice/with_topic/de/lm_eval_harness.json -> build/lib/unitxt/catalog/templates/qa/multiple_choice/with_topic/de 2026-05-27T11:53:30,949 creating build/lib/unitxt/catalog/templates/qa/multiple_choice/with_topic/es 2026-05-27T11:53:30,950 copying src/unitxt/catalog/templates/qa/multiple_choice/with_topic/es/mmlu.json -> build/lib/unitxt/catalog/templates/qa/multiple_choice/with_topic/es 2026-05-27T11:53:30,952 copying src/unitxt/catalog/templates/qa/multiple_choice/with_topic/es/helm.json -> build/lib/unitxt/catalog/templates/qa/multiple_choice/with_topic/es 2026-05-27T11:53:30,954 copying src/unitxt/catalog/templates/qa/multiple_choice/with_topic/es/all.json -> build/lib/unitxt/catalog/templates/qa/multiple_choice/with_topic/es 2026-05-27T11:53:30,957 copying src/unitxt/catalog/templates/qa/multiple_choice/with_topic/es/lm_eval_harness.json -> build/lib/unitxt/catalog/templates/qa/multiple_choice/with_topic/es 2026-05-27T11:53:30,959 creating build/lib/unitxt/catalog/templates/qa/multiple_choice/with_topic/pt 2026-05-27T11:53:30,960 copying src/unitxt/catalog/templates/qa/multiple_choice/with_topic/pt/mmlu.json -> build/lib/unitxt/catalog/templates/qa/multiple_choice/with_topic/pt 2026-05-27T11:53:30,962 copying src/unitxt/catalog/templates/qa/multiple_choice/with_topic/pt/helm.json -> build/lib/unitxt/catalog/templates/qa/multiple_choice/with_topic/pt 2026-05-27T11:53:30,964 copying src/unitxt/catalog/templates/qa/multiple_choice/with_topic/pt/all.json -> build/lib/unitxt/catalog/templates/qa/multiple_choice/with_topic/pt 2026-05-27T11:53:30,966 copying src/unitxt/catalog/templates/qa/multiple_choice/with_topic/pt/lm_eval_harness.json -> build/lib/unitxt/catalog/templates/qa/multiple_choice/with_topic/pt 2026-05-27T11:53:30,968 creating build/lib/unitxt/catalog/templates/qa/open 2026-05-27T11:53:30,969 copying src/unitxt/catalog/templates/qa/open/title.json -> build/lib/unitxt/catalog/templates/qa/open 2026-05-27T11:53:30,971 copying src/unitxt/catalog/templates/qa/open/empty.json -> build/lib/unitxt/catalog/templates/qa/open 2026-05-27T11:53:30,973 copying src/unitxt/catalog/templates/qa/open/simple2.json -> build/lib/unitxt/catalog/templates/qa/open 2026-05-27T11:53:30,975 copying src/unitxt/catalog/templates/qa/open/simple.json -> build/lib/unitxt/catalog/templates/qa/open 2026-05-27T11:53:30,977 copying src/unitxt/catalog/templates/qa/open/all.json -> build/lib/unitxt/catalog/templates/qa/open 2026-05-27T11:53:30,979 creating build/lib/unitxt/catalog/templates/qa/llama_vision/with_context 2026-05-27T11:53:30,981 copying src/unitxt/catalog/templates/qa/llama_vision/with_context/info_vqa.json -> build/lib/unitxt/catalog/templates/qa/llama_vision/with_context 2026-05-27T11:53:30,983 copying src/unitxt/catalog/templates/qa/llama_vision/with_context/doc_vqa.json -> build/lib/unitxt/catalog/templates/qa/llama_vision/with_context 2026-05-27T11:53:30,985 copying src/unitxt/catalog/templates/qa/llama_vision/with_context/chart_qa.json -> build/lib/unitxt/catalog/templates/qa/llama_vision/with_context 2026-05-27T11:53:30,987 creating build/lib/unitxt/catalog/templates/qa/llama_vision/multiple_choice/with_context 2026-05-27T11:53:30,989 copying src/unitxt/catalog/templates/qa/llama_vision/multiple_choice/with_context/ai2d.json -> build/lib/unitxt/catalog/templates/qa/llama_vision/multiple_choice/with_context 2026-05-27T11:53:30,991 creating build/lib/unitxt/catalog/templates/qa/multi_turn/with_context 2026-05-27T11:53:30,993 copying src/unitxt/catalog/templates/qa/multi_turn/with_context/simple.json -> build/lib/unitxt/catalog/templates/qa/multi_turn/with_context 2026-05-27T11:53:30,995 creating build/lib/unitxt/catalog/templates/selection/by_attribute 2026-05-27T11:53:30,996 copying src/unitxt/catalog/templates/selection/by_attribute/default.json -> build/lib/unitxt/catalog/templates/selection/by_attribute 2026-05-27T11:53:30,999 copying src/unitxt/catalog/templates/selection/by_attribute/all.json -> build/lib/unitxt/catalog/templates/selection/by_attribute 2026-05-27T11:53:31,000 creating build/lib/unitxt/catalog/templates/grammatical_error_correction 2026-05-27T11:53:31,001 copying src/unitxt/catalog/templates/grammatical_error_correction/simple.json -> build/lib/unitxt/catalog/templates/grammatical_error_correction 2026-05-27T11:53:31,004 copying src/unitxt/catalog/templates/grammatical_error_correction/all.json -> build/lib/unitxt/catalog/templates/grammatical_error_correction 2026-05-27T11:53:31,006 creating build/lib/unitxt/catalog/templates/key_value_extraction 2026-05-27T11:53:31,007 copying src/unitxt/catalog/templates/key_value_extraction/extract_in_json_format.json -> build/lib/unitxt/catalog/templates/key_value_extraction 2026-05-27T11:53:31,009 creating build/lib/unitxt/catalog/templates/evaluation/preference 2026-05-27T11:53:31,010 copying src/unitxt/catalog/templates/evaluation/preference/default.json -> build/lib/unitxt/catalog/templates/evaluation/preference 2026-05-27T11:53:31,012 copying src/unitxt/catalog/templates/evaluation/preference/all.json -> build/lib/unitxt/catalog/templates/evaluation/preference 2026-05-27T11:53:31,015 creating build/lib/unitxt/catalog/templates/targeted_sentiment_extraction 2026-05-27T11:53:31,016 copying src/unitxt/catalog/templates/targeted_sentiment_extraction/carry_sentiment.json -> build/lib/unitxt/catalog/templates/targeted_sentiment_extraction 2026-05-27T11:53:31,018 copying src/unitxt/catalog/templates/targeted_sentiment_extraction/entities_sentiment.json -> build/lib/unitxt/catalog/templates/targeted_sentiment_extraction 2026-05-27T11:53:31,020 copying src/unitxt/catalog/templates/targeted_sentiment_extraction/empty.json -> build/lib/unitxt/catalog/templates/targeted_sentiment_extraction 2026-05-27T11:53:31,022 copying src/unitxt/catalog/templates/targeted_sentiment_extraction/extract_sentiment.json -> build/lib/unitxt/catalog/templates/targeted_sentiment_extraction 2026-05-27T11:53:31,024 copying src/unitxt/catalog/templates/targeted_sentiment_extraction/having_sentiment.json -> build/lib/unitxt/catalog/templates/targeted_sentiment_extraction 2026-05-27T11:53:31,027 copying src/unitxt/catalog/templates/targeted_sentiment_extraction/all.json -> build/lib/unitxt/catalog/templates/targeted_sentiment_extraction 2026-05-27T11:53:31,029 creating build/lib/unitxt/catalog/templates/targeted_sentiment_extraction/positive 2026-05-27T11:53:31,030 copying src/unitxt/catalog/templates/targeted_sentiment_extraction/positive/empty.json -> build/lib/unitxt/catalog/templates/targeted_sentiment_extraction/positive 2026-05-27T11:53:31,032 copying src/unitxt/catalog/templates/targeted_sentiment_extraction/positive/sentiment_extracted.json -> build/lib/unitxt/catalog/templates/targeted_sentiment_extraction/positive 2026-05-27T11:53:31,035 copying src/unitxt/catalog/templates/targeted_sentiment_extraction/positive/having_sentiment.json -> build/lib/unitxt/catalog/templates/targeted_sentiment_extraction/positive 2026-05-27T11:53:31,037 copying src/unitxt/catalog/templates/targeted_sentiment_extraction/positive/all.json -> build/lib/unitxt/catalog/templates/targeted_sentiment_extraction/positive 2026-05-27T11:53:31,040 creating build/lib/unitxt/catalog/templates/targeted_sentiment_extraction/as_json 2026-05-27T11:53:31,041 copying src/unitxt/catalog/templates/targeted_sentiment_extraction/as_json/convert_with_explicit_keys.json -> build/lib/unitxt/catalog/templates/targeted_sentiment_extraction/as_json 2026-05-27T11:53:31,043 copying src/unitxt/catalog/templates/targeted_sentiment_extraction/as_json/empty.json -> build/lib/unitxt/catalog/templates/targeted_sentiment_extraction/as_json 2026-05-27T11:53:31,045 copying src/unitxt/catalog/templates/targeted_sentiment_extraction/as_json/convert_with_implicit_keys.json -> build/lib/unitxt/catalog/templates/targeted_sentiment_extraction/as_json 2026-05-27T11:53:31,047 creating build/lib/unitxt/catalog/templates/targeted_sentiment_extraction/neutral 2026-05-27T11:53:31,048 copying src/unitxt/catalog/templates/targeted_sentiment_extraction/neutral/empty.json -> build/lib/unitxt/catalog/templates/targeted_sentiment_extraction/neutral 2026-05-27T11:53:31,050 copying src/unitxt/catalog/templates/targeted_sentiment_extraction/neutral/sentiment_extracted.json -> build/lib/unitxt/catalog/templates/targeted_sentiment_extraction/neutral 2026-05-27T11:53:31,052 copying src/unitxt/catalog/templates/targeted_sentiment_extraction/neutral/having_sentiment.json -> build/lib/unitxt/catalog/templates/targeted_sentiment_extraction/neutral 2026-05-27T11:53:31,054 copying src/unitxt/catalog/templates/targeted_sentiment_extraction/neutral/all.json -> build/lib/unitxt/catalog/templates/targeted_sentiment_extraction/neutral 2026-05-27T11:53:31,057 creating build/lib/unitxt/catalog/templates/targeted_sentiment_extraction/negative 2026-05-27T11:53:31,058 copying src/unitxt/catalog/templates/targeted_sentiment_extraction/negative/empty.json -> build/lib/unitxt/catalog/templates/targeted_sentiment_extraction/negative 2026-05-27T11:53:31,060 copying src/unitxt/catalog/templates/targeted_sentiment_extraction/negative/sentiment_extracted.json -> build/lib/unitxt/catalog/templates/targeted_sentiment_extraction/negative 2026-05-27T11:53:31,062 copying src/unitxt/catalog/templates/targeted_sentiment_extraction/negative/having_sentiment.json -> build/lib/unitxt/catalog/templates/targeted_sentiment_extraction/negative 2026-05-27T11:53:31,064 copying src/unitxt/catalog/templates/targeted_sentiment_extraction/negative/all.json -> build/lib/unitxt/catalog/templates/targeted_sentiment_extraction/negative 2026-05-27T11:53:31,066 creating build/lib/unitxt/catalog/templates/completion/multiple_choice 2026-05-27T11:53:31,068 copying src/unitxt/catalog/templates/completion/multiple_choice/enumerated.json -> build/lib/unitxt/catalog/templates/completion/multiple_choice 2026-05-27T11:53:31,070 copying src/unitxt/catalog/templates/completion/multiple_choice/title.json -> build/lib/unitxt/catalog/templates/completion/multiple_choice 2026-05-27T11:53:31,072 copying src/unitxt/catalog/templates/completion/multiple_choice/bluebench.json -> build/lib/unitxt/catalog/templates/completion/multiple_choice 2026-05-27T11:53:31,075 copying src/unitxt/catalog/templates/completion/multiple_choice/standard.json -> build/lib/unitxt/catalog/templates/completion/multiple_choice 2026-05-27T11:53:31,077 copying src/unitxt/catalog/templates/completion/multiple_choice/simple.json -> build/lib/unitxt/catalog/templates/completion/multiple_choice 2026-05-27T11:53:31,080 copying src/unitxt/catalog/templates/completion/multiple_choice/all.json -> build/lib/unitxt/catalog/templates/completion/multiple_choice 2026-05-27T11:53:31,082 creating build/lib/unitxt/catalog/templates/completion/abstractive 2026-05-27T11:53:31,083 copying src/unitxt/catalog/templates/completion/abstractive/empty.json -> build/lib/unitxt/catalog/templates/completion/abstractive 2026-05-27T11:53:31,086 copying src/unitxt/catalog/templates/completion/abstractive/standard.json -> build/lib/unitxt/catalog/templates/completion/abstractive 2026-05-27T11:53:31,089 copying src/unitxt/catalog/templates/completion/abstractive/all.json -> build/lib/unitxt/catalog/templates/completion/abstractive 2026-05-27T11:53:31,091 creating build/lib/unitxt/catalog/templates/span_labeling/extraction 2026-05-27T11:53:31,093 copying src/unitxt/catalog/templates/span_labeling/extraction/having.json -> build/lib/unitxt/catalog/templates/span_labeling/extraction 2026-05-27T11:53:31,096 copying src/unitxt/catalog/templates/span_labeling/extraction/identify.json -> build/lib/unitxt/catalog/templates/span_labeling/extraction 2026-05-27T11:53:31,098 copying src/unitxt/catalog/templates/span_labeling/extraction/carry.json -> build/lib/unitxt/catalog/templates/span_labeling/extraction 2026-05-27T11:53:31,102 copying src/unitxt/catalog/templates/span_labeling/extraction/title.json -> build/lib/unitxt/catalog/templates/span_labeling/extraction 2026-05-27T11:53:31,105 copying src/unitxt/catalog/templates/span_labeling/extraction/empty.json -> build/lib/unitxt/catalog/templates/span_labeling/extraction 2026-05-27T11:53:31,108 copying src/unitxt/catalog/templates/span_labeling/extraction/extract.json -> build/lib/unitxt/catalog/templates/span_labeling/extraction 2026-05-27T11:53:31,111 copying src/unitxt/catalog/templates/span_labeling/extraction/detailed.json -> build/lib/unitxt/catalog/templates/span_labeling/extraction 2026-05-27T11:53:31,115 copying src/unitxt/catalog/templates/span_labeling/extraction/all.json -> build/lib/unitxt/catalog/templates/span_labeling/extraction 2026-05-27T11:53:31,118 creating build/lib/unitxt/catalog/templates/regression/single_text 2026-05-27T11:53:31,120 copying src/unitxt/catalog/templates/regression/single_text/title.json -> build/lib/unitxt/catalog/templates/regression/single_text 2026-05-27T11:53:31,124 copying src/unitxt/catalog/templates/regression/single_text/simple.json -> build/lib/unitxt/catalog/templates/regression/single_text 2026-05-27T11:53:31,127 copying src/unitxt/catalog/templates/regression/single_text/all.json -> build/lib/unitxt/catalog/templates/regression/single_text 2026-05-27T11:53:31,131 creating build/lib/unitxt/catalog/templates/regression/two_texts 2026-05-27T11:53:31,132 copying src/unitxt/catalog/templates/regression/two_texts/title.json -> build/lib/unitxt/catalog/templates/regression/two_texts 2026-05-27T11:53:31,136 copying src/unitxt/catalog/templates/regression/two_texts/simple.json -> build/lib/unitxt/catalog/templates/regression/two_texts 2026-05-27T11:53:31,139 copying src/unitxt/catalog/templates/regression/two_texts/all.json -> build/lib/unitxt/catalog/templates/regression/two_texts 2026-05-27T11:53:31,142 creating build/lib/unitxt/catalog/templates/regression/two_texts/similarity 2026-05-27T11:53:31,144 copying src/unitxt/catalog/templates/regression/two_texts/similarity/flan.json -> build/lib/unitxt/catalog/templates/regression/two_texts/similarity 2026-05-27T11:53:31,148 creating build/lib/unitxt/catalog/operators 2026-05-27T11:53:31,149 copying src/unitxt/catalog/operators/extract_arena_hard_numerical_judgment.json -> build/lib/unitxt/catalog/operators 2026-05-27T11:53:31,153 copying src/unitxt/catalog/operators/convert_to_boolean.json -> build/lib/unitxt/catalog/operators 2026-05-27T11:53:31,156 copying src/unitxt/catalog/operators/capitalize.json -> build/lib/unitxt/catalog/operators 2026-05-27T11:53:31,159 copying src/unitxt/catalog/operators/toxic_or_not_toxic.json -> build/lib/unitxt/catalog/operators 2026-05-27T11:53:31,161 copying src/unitxt/catalog/operators/upper_case.json -> build/lib/unitxt/catalog/operators 2026-05-27T11:53:31,164 copying src/unitxt/catalog/operators/cast_to_float_return_zero_if_failed.json -> build/lib/unitxt/catalog/operators 2026-05-27T11:53:31,167 copying src/unitxt/catalog/operators/to_yes_or_none.json -> build/lib/unitxt/catalog/operators 2026-05-27T11:53:31,169 copying src/unitxt/catalog/operators/cast_to_float_return_0_5_if_failed.json -> build/lib/unitxt/catalog/operators 2026-05-27T11:53:31,172 copying src/unitxt/catalog/operators/hate_speech_or_not_hate_speech.json -> build/lib/unitxt/catalog/operators 2026-05-27T11:53:31,175 copying src/unitxt/catalog/operators/yes_no_to_int.json -> build/lib/unitxt/catalog/operators 2026-05-27T11:53:31,177 copying src/unitxt/catalog/operators/substring.json -> build/lib/unitxt/catalog/operators 2026-05-27T11:53:31,180 copying src/unitxt/catalog/operators/take_first_word.json -> build/lib/unitxt/catalog/operators 2026-05-27T11:53:31,182 copying src/unitxt/catalog/operators/remove_articles.json -> build/lib/unitxt/catalog/operators 2026-05-27T11:53:31,185 copying src/unitxt/catalog/operators/match_closest_option.json -> build/lib/unitxt/catalog/operators 2026-05-27T11:53:31,187 copying src/unitxt/catalog/operators/arena_hard_hf_space_processing_steps.json -> build/lib/unitxt/catalog/operators 2026-05-27T11:53:31,190 copying src/unitxt/catalog/operators/extract_mt_bench_rating_judgment.json -> build/lib/unitxt/catalog/operators 2026-05-27T11:53:31,193 copying src/unitxt/catalog/operators/predictions_yes_1_else_0.json -> build/lib/unitxt/catalog/operators 2026-05-27T11:53:31,195 copying src/unitxt/catalog/operators/fix_whitespace.json -> build/lib/unitxt/catalog/operators 2026-05-27T11:53:31,198 copying src/unitxt/catalog/operators/str_to_float_format.json -> build/lib/unitxt/catalog/operators 2026-05-27T11:53:31,200 copying src/unitxt/catalog/operators/take_first_non_empty_line.json -> build/lib/unitxt/catalog/operators 2026-05-27T11:53:31,202 copying src/unitxt/catalog/operators/extract_harm_rating_judgment.json -> build/lib/unitxt/catalog/operators 2026-05-27T11:53:31,204 copying src/unitxt/catalog/operators/cast_to_float_return_nan_if_failed.json -> build/lib/unitxt/catalog/operators 2026-05-27T11:53:31,206 copying src/unitxt/catalog/operators/take_last_non_empty_line.json -> build/lib/unitxt/catalog/operators 2026-05-27T11:53:31,209 copying src/unitxt/catalog/operators/extract_mt_bench_label_judgment.json -> build/lib/unitxt/catalog/operators 2026-05-27T11:53:31,211 copying src/unitxt/catalog/operators/scale_0_10_to_0_1.json -> build/lib/unitxt/catalog/operators 2026-05-27T11:53:31,213 copying src/unitxt/catalog/operators/fix_json_schema.json -> build/lib/unitxt/catalog/operators 2026-05-27T11:53:31,215 copying src/unitxt/catalog/operators/lower_case_till_punc.json -> build/lib/unitxt/catalog/operators 2026-05-27T11:53:31,217 copying src/unitxt/catalog/operators/literal_eval.json -> build/lib/unitxt/catalog/operators 2026-05-27T11:53:31,219 copying src/unitxt/catalog/operators/remove_none_from_list.json -> build/lib/unitxt/catalog/operators 2026-05-27T11:53:31,221 copying src/unitxt/catalog/operators/lower_case.json -> build/lib/unitxt/catalog/operators 2026-05-27T11:53:31,224 copying src/unitxt/catalog/operators/get_string_after_colon.json -> build/lib/unitxt/catalog/operators 2026-05-27T11:53:31,226 copying src/unitxt/catalog/operators/extract_verbal_judgement_bad_good.json -> build/lib/unitxt/catalog/operators 2026-05-27T11:53:31,228 copying src/unitxt/catalog/operators/remove_punctuations.json -> build/lib/unitxt/catalog/operators 2026-05-27T11:53:31,230 copying src/unitxt/catalog/operators/regex_parser.json -> build/lib/unitxt/catalog/operators 2026-05-27T11:53:31,232 copying src/unitxt/catalog/operators/extract_verbal_judgement.json -> build/lib/unitxt/catalog/operators 2026-05-27T11:53:31,235 copying src/unitxt/catalog/operators/stance_to_pro_con.json -> build/lib/unitxt/catalog/operators 2026-05-27T11:53:31,237 copying src/unitxt/catalog/operators/extract_from_double_brackets.json -> build/lib/unitxt/catalog/operators 2026-05-27T11:53:31,239 copying src/unitxt/catalog/operators/first_character.json -> build/lib/unitxt/catalog/operators 2026-05-27T11:53:31,241 creating build/lib/unitxt/catalog/operators/balancers/classification 2026-05-27T11:53:31,242 copying src/unitxt/catalog/operators/balancers/classification/minimum_one_example_per_class.json -> build/lib/unitxt/catalog/operators/balancers/classification 2026-05-27T11:53:31,245 copying src/unitxt/catalog/operators/balancers/classification/by_label.json -> build/lib/unitxt/catalog/operators/balancers/classification 2026-05-27T11:53:31,247 creating build/lib/unitxt/catalog/operators/balancers/ner 2026-05-27T11:53:31,248 copying src/unitxt/catalog/operators/balancers/ner/zero_vs_many_entities.json -> build/lib/unitxt/catalog/operators/balancers/ner 2026-05-27T11:53:31,250 creating build/lib/unitxt/catalog/operators/balancers/qa 2026-05-27T11:53:31,251 copying src/unitxt/catalog/operators/balancers/qa/by_answer.json -> build/lib/unitxt/catalog/operators/balancers/qa 2026-05-27T11:53:31,254 creating build/lib/unitxt/catalog/operators/balancers/multi_label 2026-05-27T11:53:31,255 copying src/unitxt/catalog/operators/balancers/multi_label/zero_vs_many_labels.json -> build/lib/unitxt/catalog/operators/balancers/multi_label 2026-05-27T11:53:31,258 creating build/lib/unitxt/catalog/operators/mt_bench 2026-05-27T11:53:31,259 copying src/unitxt/catalog/operators/mt_bench/pairwise_hf_space_processing_steps.json -> build/lib/unitxt/catalog/operators/mt_bench 2026-05-27T11:53:31,262 copying src/unitxt/catalog/operators/mt_bench/rating_hf_space_processing_steps.json -> build/lib/unitxt/catalog/operators/mt_bench 2026-05-27T11:53:31,264 creating build/lib/unitxt/catalog/system_prompts 2026-05-27T11:53:31,264 copying src/unitxt/catalog/system_prompts/empty.json -> build/lib/unitxt/catalog/system_prompts 2026-05-27T11:53:31,267 copying src/unitxt/catalog/system_prompts/boolqa.json -> build/lib/unitxt/catalog/system_prompts 2026-05-27T11:53:31,269 creating build/lib/unitxt/catalog/system_prompts/general 2026-05-27T11:53:31,270 copying src/unitxt/catalog/system_prompts/general/be_concise.json -> build/lib/unitxt/catalog/system_prompts/general 2026-05-27T11:53:31,272 creating build/lib/unitxt/catalog/system_prompts/model 2026-05-27T11:53:31,273 copying src/unitxt/catalog/system_prompts/model/granite.json -> build/lib/unitxt/catalog/system_prompts/model 2026-05-27T11:53:31,275 creating build/lib/unitxt/catalog/system_prompts/models 2026-05-27T11:53:31,276 copying src/unitxt/catalog/system_prompts/models/llava_next_llama3_8b.json -> build/lib/unitxt/catalog/system_prompts/models 2026-05-27T11:53:31,278 copying src/unitxt/catalog/system_prompts/models/llama.json -> build/lib/unitxt/catalog/system_prompts/models 2026-05-27T11:53:31,280 copying src/unitxt/catalog/system_prompts/models/labradorite.json -> build/lib/unitxt/catalog/system_prompts/models 2026-05-27T11:53:31,282 copying src/unitxt/catalog/system_prompts/models/japanese_llama.json -> build/lib/unitxt/catalog/system_prompts/models 2026-05-27T11:53:31,284 copying src/unitxt/catalog/system_prompts/models/deepseek_coder.json -> build/lib/unitxt/catalog/system_prompts/models 2026-05-27T11:53:31,287 copying src/unitxt/catalog/system_prompts/models/alpaca.json -> build/lib/unitxt/catalog/system_prompts/models 2026-05-27T11:53:31,289 copying src/unitxt/catalog/system_prompts/models/llama2.json -> build/lib/unitxt/catalog/system_prompts/models 2026-05-27T11:53:31,291 creating build/lib/unitxt/catalog/engines/openai 2026-05-27T11:53:31,292 copying src/unitxt/catalog/engines/openai/gpt_4o.json -> build/lib/unitxt/catalog/engines/openai 2026-05-27T11:53:31,295 creating build/lib/unitxt/catalog/engines/ollama 2026-05-27T11:53:31,296 copying src/unitxt/catalog/engines/ollama/llama2.json -> build/lib/unitxt/catalog/engines/ollama 2026-05-27T11:53:31,298 creating build/lib/unitxt/catalog/engines/cross_provider 2026-05-27T11:53:31,299 copying src/unitxt/catalog/engines/cross_provider/llama_3_8b_instruct.json -> build/lib/unitxt/catalog/engines/cross_provider 2026-05-27T11:53:31,301 copying src/unitxt/catalog/engines/cross_provider/llama_3_70b_instruct.json -> build/lib/unitxt/catalog/engines/cross_provider 2026-05-27T11:53:31,303 creating build/lib/unitxt/catalog/engines/model 2026-05-27T11:53:31,304 copying src/unitxt/catalog/engines/model/llama_3_8b_instruct.json -> build/lib/unitxt/catalog/engines/model 2026-05-27T11:53:31,306 creating build/lib/unitxt/catalog/engines/model/flan/t5_small 2026-05-27T11:53:31,308 copying src/unitxt/catalog/engines/model/flan/t5_small/hf.json -> build/lib/unitxt/catalog/engines/model/flan/t5_small 2026-05-27T11:53:31,310 creating build/lib/unitxt/catalog/engines/classification 2026-05-27T11:53:31,311 copying src/unitxt/catalog/engines/classification/llama_3_1_70b_instruct_wml.json -> build/lib/unitxt/catalog/engines/classification 2026-05-27T11:53:31,313 copying src/unitxt/catalog/engines/classification/gpt_4o_2024_08_06_azure_openai.json -> build/lib/unitxt/catalog/engines/classification 2026-05-27T11:53:31,315 copying src/unitxt/catalog/engines/classification/gpt_oss_120b_rits.json -> build/lib/unitxt/catalog/engines/classification 2026-05-27T11:53:31,317 copying src/unitxt/catalog/engines/classification/llama_4_maverick_17b_128e_instruct_fp8_watsonx.json -> build/lib/unitxt/catalog/engines/classification 2026-05-27T11:53:31,319 copying src/unitxt/catalog/engines/classification/llama_3_405b_instruct_wml.json -> build/lib/unitxt/catalog/engines/classification 2026-05-27T11:53:31,321 copying src/unitxt/catalog/engines/classification/llama_3_3_70b_instruct_wml.json -> build/lib/unitxt/catalog/engines/classification 2026-05-27T11:53:31,323 copying src/unitxt/catalog/engines/classification/mistral_large_watsonx.json -> build/lib/unitxt/catalog/engines/classification 2026-05-27T11:53:31,325 copying src/unitxt/catalog/engines/classification/llama3_3_ollama.json -> build/lib/unitxt/catalog/engines/classification 2026-05-27T11:53:31,327 copying src/unitxt/catalog/engines/classification/llama_4_maverick_17b_128e_instruct_fp8_rits.json -> build/lib/unitxt/catalog/engines/classification 2026-05-27T11:53:31,329 copying src/unitxt/catalog/engines/classification/mistral_small_3_1_24b_instruct_2503_wml.json -> build/lib/unitxt/catalog/engines/classification 2026-05-27T11:53:31,331 copying src/unitxt/catalog/engines/classification/llama_3_3_70b_instruct_watsonx.json -> build/lib/unitxt/catalog/engines/classification 2026-05-27T11:53:31,333 copying src/unitxt/catalog/engines/classification/mistral_large_instruct_2407_rits.json -> build/lib/unitxt/catalog/engines/classification 2026-05-27T11:53:31,335 copying src/unitxt/catalog/engines/classification/gpt_4_turbo_open_ai.json -> build/lib/unitxt/catalog/engines/classification 2026-05-27T11:53:31,337 copying src/unitxt/catalog/engines/classification/mixtral_8x7b_instruct_v01_wml.json -> build/lib/unitxt/catalog/engines/classification 2026-05-27T11:53:31,339 copying src/unitxt/catalog/engines/classification/gpt_4o_open_ai.json -> build/lib/unitxt/catalog/engines/classification 2026-05-27T11:53:31,341 copying src/unitxt/catalog/engines/classification/llama_3_1_405b_instruct_fp8_rits.json -> build/lib/unitxt/catalog/engines/classification 2026-05-27T11:53:31,343 copying src/unitxt/catalog/engines/classification/llama_3_1_70b_instruct_watsonx.json -> build/lib/unitxt/catalog/engines/classification 2026-05-27T11:53:31,345 copying src/unitxt/catalog/engines/classification/llama_3_1_70b_instruct_rits.json -> build/lib/unitxt/catalog/engines/classification 2026-05-27T11:53:31,348 copying src/unitxt/catalog/engines/classification/llama_3_3_70b_instruct_rits.json -> build/lib/unitxt/catalog/engines/classification 2026-05-27T11:53:31,350 copying src/unitxt/catalog/engines/classification/llama3_8b_ollama.json -> build/lib/unitxt/catalog/engines/classification 2026-05-27T11:53:31,352 copying src/unitxt/catalog/engines/classification/gpt_4_turbo_2024_04_09_azure_openai.json -> build/lib/unitxt/catalog/engines/classification 2026-05-27T11:53:31,354 copying src/unitxt/catalog/engines/classification/gpt_oss_120b_watsonx.json -> build/lib/unitxt/catalog/engines/classification 2026-05-27T11:53:31,356 creating build/lib/unitxt/catalog/engines/ibm_wml 2026-05-27T11:53:31,357 copying src/unitxt/catalog/engines/ibm_wml/llama_3_3_70b_instruct.json -> build/lib/unitxt/catalog/engines/ibm_wml 2026-05-27T11:53:31,360 creating build/lib/unitxt/catalog/engines/rits 2026-05-27T11:53:31,361 copying src/unitxt/catalog/engines/rits/llama_3_1_70b_instruct.json -> build/lib/unitxt/catalog/engines/rits 2026-05-27T11:53:31,363 copying src/unitxt/catalog/engines/rits/llama_3_1_405b_instruct_fp8.json -> build/lib/unitxt/catalog/engines/rits 2026-05-27T11:53:31,365 creating build/lib/unitxt/catalog/engines/rits/llama_3 2026-05-27T11:53:31,366 copying src/unitxt/catalog/engines/rits/llama_3/1_8b_instruct.json -> build/lib/unitxt/catalog/engines/rits/llama_3 2026-05-27T11:53:31,368 creating build/lib/unitxt/catalog/augmentors 2026-05-27T11:53:31,369 copying src/unitxt/catalog/augmentors/augment_whitespace_task_input.json -> build/lib/unitxt/catalog/augmentors 2026-05-27T11:53:31,371 copying src/unitxt/catalog/augmentors/no_augmentation.json -> build/lib/unitxt/catalog/augmentors 2026-05-27T11:53:31,373 copying src/unitxt/catalog/augmentors/augment_whitespace_prefix_and_suffix_task_input.json -> build/lib/unitxt/catalog/augmentors 2026-05-27T11:53:31,375 creating build/lib/unitxt/catalog/augmentors/text 2026-05-27T11:53:31,376 copying src/unitxt/catalog/augmentors/text/whitespace_prefix_suffix.json -> build/lib/unitxt/catalog/augmentors/text 2026-05-27T11:53:31,378 copying src/unitxt/catalog/augmentors/text/white_space.json -> build/lib/unitxt/catalog/augmentors/text 2026-05-27T11:53:31,380 creating build/lib/unitxt/catalog/augmentors/table 2026-05-27T11:53:31,381 copying src/unitxt/catalog/augmentors/table/insert_empty_rows.json -> build/lib/unitxt/catalog/augmentors/table 2026-05-27T11:53:31,383 copying src/unitxt/catalog/augmentors/table/shuffle_cols.json -> build/lib/unitxt/catalog/augmentors/table 2026-05-27T11:53:31,385 copying src/unitxt/catalog/augmentors/table/duplicate_rows.json -> build/lib/unitxt/catalog/augmentors/table 2026-05-27T11:53:31,388 copying src/unitxt/catalog/augmentors/table/mask_cols_names.json -> build/lib/unitxt/catalog/augmentors/table 2026-05-27T11:53:31,390 copying src/unitxt/catalog/augmentors/table/shuffle_rows.json -> build/lib/unitxt/catalog/augmentors/table 2026-05-27T11:53:31,392 copying src/unitxt/catalog/augmentors/table/duplicate_columns.json -> build/lib/unitxt/catalog/augmentors/table 2026-05-27T11:53:31,394 copying src/unitxt/catalog/augmentors/table/transpose.json -> build/lib/unitxt/catalog/augmentors/table 2026-05-27T11:53:31,396 copying src/unitxt/catalog/augmentors/table/truncate_rows.json -> build/lib/unitxt/catalog/augmentors/table 2026-05-27T11:53:31,399 copying src/unitxt/catalog/augmentors/table/shuffle_cols_names.json -> build/lib/unitxt/catalog/augmentors/table 2026-05-27T11:53:31,401 creating build/lib/unitxt/catalog/augmentors/image 2026-05-27T11:53:31,402 copying src/unitxt/catalog/augmentors/image/grey_scale.json -> build/lib/unitxt/catalog/augmentors/image 2026-05-27T11:53:31,404 copying src/unitxt/catalog/augmentors/image/oldify.json -> build/lib/unitxt/catalog/augmentors/image 2026-05-27T11:53:31,406 copying src/unitxt/catalog/augmentors/image/white_noise.json -> build/lib/unitxt/catalog/augmentors/image 2026-05-27T11:53:31,409 copying src/unitxt/catalog/augmentors/image/grid_lines.json -> build/lib/unitxt/catalog/augmentors/image 2026-05-27T11:53:31,411 creating build/lib/unitxt/catalog/formats 2026-05-27T11:53:31,412 copying src/unitxt/catalog/formats/llama3_instruct_all_demos_in_one_turn.json -> build/lib/unitxt/catalog/formats 2026-05-27T11:53:31,414 copying src/unitxt/catalog/formats/chat_api.json -> build/lib/unitxt/catalog/formats 2026-05-27T11:53:31,416 copying src/unitxt/catalog/formats/llama.json -> build/lib/unitxt/catalog/formats 2026-05-27T11:53:31,419 copying src/unitxt/catalog/formats/user_agent.json -> build/lib/unitxt/catalog/formats 2026-05-27T11:53:31,421 copying src/unitxt/catalog/formats/human_assistant.json -> build/lib/unitxt/catalog/formats 2026-05-27T11:53:31,423 copying src/unitxt/catalog/formats/deepseek_coder.json -> build/lib/unitxt/catalog/formats 2026-05-27T11:53:31,425 copying src/unitxt/catalog/formats/llama3_instruct.json -> build/lib/unitxt/catalog/formats 2026-05-27T11:53:31,427 copying src/unitxt/catalog/formats/empty.json -> build/lib/unitxt/catalog/formats 2026-05-27T11:53:31,430 copying src/unitxt/catalog/formats/textual_assistant.json -> build/lib/unitxt/catalog/formats 2026-05-27T11:53:31,432 copying src/unitxt/catalog/formats/llama2.json -> build/lib/unitxt/catalog/formats 2026-05-27T11:53:31,434 copying src/unitxt/catalog/formats/chat_api_with_tokenizer_chat_template.json -> build/lib/unitxt/catalog/formats 2026-05-27T11:53:31,436 copying src/unitxt/catalog/formats/llamaguard2.json -> build/lib/unitxt/catalog/formats 2026-05-27T11:53:31,438 copying src/unitxt/catalog/formats/empty_input_output_separator.json -> build/lib/unitxt/catalog/formats 2026-05-27T11:53:31,440 copying src/unitxt/catalog/formats/user_assistant.json -> build/lib/unitxt/catalog/formats 2026-05-27T11:53:31,442 creating build/lib/unitxt/catalog/formats/models 2026-05-27T11:53:31,443 copying src/unitxt/catalog/formats/models/starling.json -> build/lib/unitxt/catalog/formats/models 2026-05-27T11:53:31,445 copying src/unitxt/catalog/formats/models/llava.json -> build/lib/unitxt/catalog/formats/models 2026-05-27T11:53:31,447 copying src/unitxt/catalog/formats/models/alpaca_instruct.json -> build/lib/unitxt/catalog/formats/models 2026-05-27T11:53:31,449 copying src/unitxt/catalog/formats/models/llava_interleave.json -> build/lib/unitxt/catalog/formats/models 2026-05-27T11:53:31,451 copying src/unitxt/catalog/formats/models/phi_3.json -> build/lib/unitxt/catalog/formats/models 2026-05-27T11:53:31,454 copying src/unitxt/catalog/formats/models/granite_3_1_documents.json -> build/lib/unitxt/catalog/formats/models 2026-05-27T11:53:31,456 creating build/lib/unitxt/catalog/formats/models/labradorite 2026-05-27T11:53:31,457 copying src/unitxt/catalog/formats/models/labradorite/zero_shot.json -> build/lib/unitxt/catalog/formats/models/labradorite 2026-05-27T11:53:31,459 copying src/unitxt/catalog/formats/models/labradorite/few_shot.json -> build/lib/unitxt/catalog/formats/models/labradorite 2026-05-27T11:53:31,462 creating build/lib/unitxt/catalog/formats/models/mistral 2026-05-27T11:53:31,463 copying src/unitxt/catalog/formats/models/mistral/instruction.json -> build/lib/unitxt/catalog/formats/models/mistral 2026-05-27T11:53:31,466 creating build/lib/unitxt/catalog/formats/models/mistral/instruction 2026-05-27T11:53:31,467 copying src/unitxt/catalog/formats/models/mistral/instruction/with_system_prompt.json -> build/lib/unitxt/catalog/formats/models/mistral/instruction 2026-05-27T11:53:31,470 creating build/lib/unitxt/catalog/formats/models/flan 2026-05-27T11:53:31,471 copying src/unitxt/catalog/formats/models/flan/exq_exa.json -> build/lib/unitxt/catalog/formats/models/flan 2026-05-27T11:53:31,474 copying src/unitxt/catalog/formats/models/flan/few_shot.json -> build/lib/unitxt/catalog/formats/models/flan 2026-05-27T11:53:31,476 creating build/lib/unitxt/catalog/cards 2026-05-27T11:53:31,477 copying src/unitxt/catalog/cards/rte.json -> build/lib/unitxt/catalog/cards 2026-05-27T11:53:31,480 copying src/unitxt/catalog/cards/tldr_document_filtered_to_6000_chars.json -> build/lib/unitxt/catalog/cards 2026-05-27T11:53:31,483 copying src/unitxt/catalog/cards/ledgar.json -> build/lib/unitxt/catalog/cards 2026-05-27T11:53:31,486 copying src/unitxt/catalog/cards/copa.json -> build/lib/unitxt/catalog/cards 2026-05-27T11:53:31,489 copying src/unitxt/catalog/cards/qqp.json -> build/lib/unitxt/catalog/cards 2026-05-27T11:53:31,491 copying src/unitxt/catalog/cards/quality.json -> build/lib/unitxt/catalog/cards 2026-05-27T11:53:31,494 copying src/unitxt/catalog/cards/openbook_qa.json -> build/lib/unitxt/catalog/cards 2026-05-27T11:53:31,497 copying src/unitxt/catalog/cards/open_australian_legal_qa.json -> build/lib/unitxt/catalog/cards 2026-05-27T11:53:31,499 copying src/unitxt/catalog/cards/ethos_binary.json -> build/lib/unitxt/catalog/cards 2026-05-27T11:53:31,503 copying src/unitxt/catalog/cards/ai2d.json -> build/lib/unitxt/catalog/cards 2026-05-27T11:53:31,505 copying src/unitxt/catalog/cards/long_bench_v2.json -> build/lib/unitxt/catalog/cards 2026-05-27T11:53:31,508 copying src/unitxt/catalog/cards/news_category_classification_headline.json -> build/lib/unitxt/catalog/cards 2026-05-27T11:53:31,511 copying src/unitxt/catalog/cards/sst2.json -> build/lib/unitxt/catalog/cards 2026-05-27T11:53:31,514 copying src/unitxt/catalog/cards/tablerow_classify.json -> build/lib/unitxt/catalog/cards 2026-05-27T11:53:31,516 copying src/unitxt/catalog/cards/scigen.json -> build/lib/unitxt/catalog/cards 2026-05-27T11:53:31,519 copying src/unitxt/catalog/cards/20_newsgroups.json -> build/lib/unitxt/catalog/cards 2026-05-27T11:53:31,522 copying src/unitxt/catalog/cards/coedit_error_detection.json -> build/lib/unitxt/catalog/cards 2026-05-27T11:53:31,524 copying src/unitxt/catalog/cards/info_vqa.json -> build/lib/unitxt/catalog/cards 2026-05-27T11:53:31,527 copying src/unitxt/catalog/cards/language_identification.json -> build/lib/unitxt/catalog/cards 2026-05-27T11:53:31,530 copying src/unitxt/catalog/cards/pop_qa_robust.json -> build/lib/unitxt/catalog/cards 2026-05-27T11:53:31,533 copying src/unitxt/catalog/cards/sciq.json -> build/lib/unitxt/catalog/cards 2026-05-27T11:53:31,535 copying src/unitxt/catalog/cards/human_eval.json -> build/lib/unitxt/catalog/cards 2026-05-27T11:53:31,538 copying src/unitxt/catalog/cards/billsum_document_filtered_to_6000_chars.json -> build/lib/unitxt/catalog/cards 2026-05-27T11:53:31,541 copying src/unitxt/catalog/cards/tab_fact.json -> build/lib/unitxt/catalog/cards 2026-05-27T11:53:31,543 copying src/unitxt/catalog/cards/dart.json -> build/lib/unitxt/catalog/cards 2026-05-27T11:53:31,546 copying src/unitxt/catalog/cards/financial_tweets.json -> build/lib/unitxt/catalog/cards 2026-05-27T11:53:31,549 copying src/unitxt/catalog/cards/attaq.json -> build/lib/unitxt/catalog/cards 2026-05-27T11:53:31,551 copying src/unitxt/catalog/cards/chart_qa_lmms_eval.json -> build/lib/unitxt/catalog/cards 2026-05-27T11:53:31,554 copying src/unitxt/catalog/cards/qtsumm.json -> build/lib/unitxt/catalog/cards 2026-05-27T11:53:31,557 copying src/unitxt/catalog/cards/mrpc.json -> build/lib/unitxt/catalog/cards 2026-05-27T11:53:31,559 copying src/unitxt/catalog/cards/qnli.json -> build/lib/unitxt/catalog/cards 2026-05-27T11:53:31,562 copying src/unitxt/catalog/cards/simple_qa.json -> build/lib/unitxt/catalog/cards 2026-05-27T11:53:31,565 copying src/unitxt/catalog/cards/almost_evil.json -> build/lib/unitxt/catalog/cards 2026-05-27T11:53:31,567 copying src/unitxt/catalog/cards/race_all.json -> build/lib/unitxt/catalog/cards 2026-05-27T11:53:31,570 copying src/unitxt/catalog/cards/mnli.json -> build/lib/unitxt/catalog/cards 2026-05-27T11:53:31,572 copying src/unitxt/catalog/cards/tablebench_data_analysis.json -> build/lib/unitxt/catalog/cards 2026-05-27T11:53:31,575 copying src/unitxt/catalog/cards/attaq_500.json -> build/lib/unitxt/catalog/cards 2026-05-27T11:53:31,579 copying src/unitxt/catalog/cards/banking77.json -> build/lib/unitxt/catalog/cards 2026-05-27T11:53:31,582 copying src/unitxt/catalog/cards/medical_abstracts.json -> build/lib/unitxt/catalog/cards 2026-05-27T11:53:31,585 copying src/unitxt/catalog/cards/numeric_nlg.json -> build/lib/unitxt/catalog/cards 2026-05-27T11:53:31,588 copying src/unitxt/catalog/cards/atis.json -> build/lib/unitxt/catalog/cards 2026-05-27T11:53:31,591 copying src/unitxt/catalog/cards/info_vqa_lmms_eval.json -> build/lib/unitxt/catalog/cards 2026-05-27T11:53:31,594 copying src/unitxt/catalog/cards/cnn_dailymail.json -> build/lib/unitxt/catalog/cards 2026-05-27T11:53:31,596 copying src/unitxt/catalog/cards/billsum_document_filtered_to_10000_chars.json -> build/lib/unitxt/catalog/cards 2026-05-27T11:53:31,599 copying src/unitxt/catalog/cards/squad.json -> build/lib/unitxt/catalog/cards 2026-05-27T11:53:31,602 copying src/unitxt/catalog/cards/claim_stance_topic.json -> build/lib/unitxt/catalog/cards 2026-05-27T11:53:31,604 copying src/unitxt/catalog/cards/frames.json -> build/lib/unitxt/catalog/cards 2026-05-27T11:53:31,607 copying src/unitxt/catalog/cards/hh_rlhf.json -> build/lib/unitxt/catalog/cards 2026-05-27T11:53:31,610 copying src/unitxt/catalog/cards/yahoo_answers_topics.json -> build/lib/unitxt/catalog/cards 2026-05-27T11:53:31,613 copying src/unitxt/catalog/cards/xsum.json -> build/lib/unitxt/catalog/cards 2026-05-27T11:53:31,615 copying src/unitxt/catalog/cards/tablebench_fact_checking.json -> build/lib/unitxt/catalog/cards 2026-05-27T11:53:31,618 copying src/unitxt/catalog/cards/unfair_tos.json -> build/lib/unitxt/catalog/cards 2026-05-27T11:53:31,621 copying src/unitxt/catalog/cards/tldr_document_filtered_to_10000_chars.json -> build/lib/unitxt/catalog/cards 2026-05-27T11:53:31,623 copying src/unitxt/catalog/cards/piqa.json -> build/lib/unitxt/catalog/cards 2026-05-27T11:53:31,625 copying src/unitxt/catalog/cards/law_stack_exchange.json -> build/lib/unitxt/catalog/cards 2026-05-27T11:53:31,628 copying src/unitxt/catalog/cards/social_iqa.json -> build/lib/unitxt/catalog/cards 2026-05-27T11:53:31,631 copying src/unitxt/catalog/cards/chart_qa.json -> build/lib/unitxt/catalog/cards 2026-05-27T11:53:31,633 copying src/unitxt/catalog/cards/cola.json -> build/lib/unitxt/catalog/cards 2026-05-27T11:53:31,636 copying src/unitxt/catalog/cards/wikitq.json -> build/lib/unitxt/catalog/cards 2026-05-27T11:53:31,639 copying src/unitxt/catalog/cards/race_high.json -> build/lib/unitxt/catalog/cards 2026-05-27T11:53:31,641 copying src/unitxt/catalog/cards/seed_bench.json -> build/lib/unitxt/catalog/cards 2026-05-27T11:53:31,644 copying src/unitxt/catalog/cards/argument_topic.json -> build/lib/unitxt/catalog/cards 2026-05-27T11:53:31,647 copying src/unitxt/catalog/cards/websrc.json -> build/lib/unitxt/catalog/cards 2026-05-27T11:53:31,649 copying src/unitxt/catalog/cards/summarize_from_human_feedback.json -> build/lib/unitxt/catalog/cards 2026-05-27T11:53:31,652 copying src/unitxt/catalog/cards/hellaswag.json -> build/lib/unitxt/catalog/cards 2026-05-27T11:53:31,655 copying src/unitxt/catalog/cards/tldr.json -> build/lib/unitxt/catalog/cards 2026-05-27T11:53:31,657 copying src/unitxt/catalog/cards/pop_qa.json -> build/lib/unitxt/catalog/cards 2026-05-27T11:53:31,660 copying src/unitxt/catalog/cards/coedit_gec.json -> build/lib/unitxt/catalog/cards 2026-05-27T11:53:31,662 copying src/unitxt/catalog/cards/20_newsgroups_short.json -> build/lib/unitxt/catalog/cards 2026-05-27T11:53:31,665 copying src/unitxt/catalog/cards/turl_col_type.json -> build/lib/unitxt/catalog/cards 2026-05-27T11:53:31,668 copying src/unitxt/catalog/cards/fin_qa.json -> build/lib/unitxt/catalog/cards 2026-05-27T11:53:31,671 copying src/unitxt/catalog/cards/wsc.json -> build/lib/unitxt/catalog/cards 2026-05-27T11:53:31,674 copying src/unitxt/catalog/cards/dbpedia_14.json -> build/lib/unitxt/catalog/cards 2026-05-27T11:53:31,676 copying src/unitxt/catalog/cards/race_middle.json -> build/lib/unitxt/catalog/cards 2026-05-27T11:53:31,679 copying src/unitxt/catalog/cards/tablebench_numerical_reasoning.json -> build/lib/unitxt/catalog/cards 2026-05-27T11:53:31,682 copying src/unitxt/catalog/cards/ag_news.json -> build/lib/unitxt/catalog/cards 2026-05-27T11:53:31,685 copying src/unitxt/catalog/cards/wnli.json -> build/lib/unitxt/catalog/cards 2026-05-27T11:53:31,687 copying src/unitxt/catalog/cards/wiki_bio.json -> build/lib/unitxt/catalog/cards 2026-05-27T11:53:31,690 copying src/unitxt/catalog/cards/stsb.json -> build/lib/unitxt/catalog/cards 2026-05-27T11:53:31,693 copying src/unitxt/catalog/cards/bold.json -> build/lib/unitxt/catalog/cards 2026-05-27T11:53:31,696 copying src/unitxt/catalog/cards/toxigen.json -> build/lib/unitxt/catalog/cards 2026-05-27T11:53:31,699 copying src/unitxt/catalog/cards/atta_q.json -> build/lib/unitxt/catalog/cards 2026-05-27T11:53:31,701 copying src/unitxt/catalog/cards/billsum.json -> build/lib/unitxt/catalog/cards 2026-05-27T11:53:31,703 copying src/unitxt/catalog/cards/mbpp.json -> build/lib/unitxt/catalog/cards 2026-05-27T11:53:31,706 copying src/unitxt/catalog/cards/trec.json -> build/lib/unitxt/catalog/cards 2026-05-27T11:53:31,708 copying src/unitxt/catalog/cards/tablebench.json -> build/lib/unitxt/catalog/cards 2026-05-27T11:53:31,710 copying src/unitxt/catalog/cards/xlam_function_calling_60k.json -> build/lib/unitxt/catalog/cards 2026-05-27T11:53:31,713 creating build/lib/unitxt/catalog/cards/biggen_bench/results 2026-05-27T11:53:31,714 copying src/unitxt/catalog/cards/biggen_bench/results/human_eval.json -> build/lib/unitxt/catalog/cards/biggen_bench/results 2026-05-27T11:53:31,717 creating build/lib/unitxt/catalog/cards/ffqa_filtered 2026-05-27T11:53:31,718 copying src/unitxt/catalog/cards/ffqa_filtered/2k.json -> build/lib/unitxt/catalog/cards/ffqa_filtered 2026-05-27T11:53:31,720 copying src/unitxt/catalog/cards/ffqa_filtered/8k.json -> build/lib/unitxt/catalog/cards/ffqa_filtered 2026-05-27T11:53:31,722 copying src/unitxt/catalog/cards/ffqa_filtered/16k.json -> build/lib/unitxt/catalog/cards/ffqa_filtered 2026-05-27T11:53:31,724 copying src/unitxt/catalog/cards/ffqa_filtered/4k.json -> build/lib/unitxt/catalog/cards/ffqa_filtered 2026-05-27T11:53:31,727 creating build/lib/unitxt/catalog/cards/mmlu_pro 2026-05-27T11:53:31,728 copying src/unitxt/catalog/cards/mmlu_pro/economics.json -> build/lib/unitxt/catalog/cards/mmlu_pro 2026-05-27T11:53:31,730 copying src/unitxt/catalog/cards/mmlu_pro/law.json -> build/lib/unitxt/catalog/cards/mmlu_pro 2026-05-27T11:53:31,732 copying src/unitxt/catalog/cards/mmlu_pro/chemistry.json -> build/lib/unitxt/catalog/cards/mmlu_pro 2026-05-27T11:53:31,734 copying src/unitxt/catalog/cards/mmlu_pro/physics.json -> build/lib/unitxt/catalog/cards/mmlu_pro 2026-05-27T11:53:31,736 copying src/unitxt/catalog/cards/mmlu_pro/computer_science.json -> build/lib/unitxt/catalog/cards/mmlu_pro 2026-05-27T11:53:31,739 copying src/unitxt/catalog/cards/mmlu_pro/health.json -> build/lib/unitxt/catalog/cards/mmlu_pro 2026-05-27T11:53:31,741 copying src/unitxt/catalog/cards/mmlu_pro/business.json -> build/lib/unitxt/catalog/cards/mmlu_pro 2026-05-27T11:53:31,743 copying src/unitxt/catalog/cards/mmlu_pro/philosophy.json -> build/lib/unitxt/catalog/cards/mmlu_pro 2026-05-27T11:53:31,745 copying src/unitxt/catalog/cards/mmlu_pro/psychology.json -> build/lib/unitxt/catalog/cards/mmlu_pro 2026-05-27T11:53:31,747 copying src/unitxt/catalog/cards/mmlu_pro/math.json -> build/lib/unitxt/catalog/cards/mmlu_pro 2026-05-27T11:53:31,749 copying src/unitxt/catalog/cards/mmlu_pro/history.json -> build/lib/unitxt/catalog/cards/mmlu_pro 2026-05-27T11:53:31,752 copying src/unitxt/catalog/cards/mmlu_pro/biology.json -> build/lib/unitxt/catalog/cards/mmlu_pro 2026-05-27T11:53:31,754 copying src/unitxt/catalog/cards/mmlu_pro/engineering.json -> build/lib/unitxt/catalog/cards/mmlu_pro 2026-05-27T11:53:31,756 copying src/unitxt/catalog/cards/mmlu_pro/other.json -> build/lib/unitxt/catalog/cards/mmlu_pro 2026-05-27T11:53:31,758 creating build/lib/unitxt/catalog/cards/almost_evil 2026-05-27T11:53:31,759 copying src/unitxt/catalog/cards/almost_evil/de.json -> build/lib/unitxt/catalog/cards/almost_evil 2026-05-27T11:53:31,762 copying src/unitxt/catalog/cards/almost_evil/it.json -> build/lib/unitxt/catalog/cards/almost_evil 2026-05-27T11:53:31,764 copying src/unitxt/catalog/cards/almost_evil/ru.json -> build/lib/unitxt/catalog/cards/almost_evil 2026-05-27T11:53:31,766 copying src/unitxt/catalog/cards/almost_evil/fr.json -> build/lib/unitxt/catalog/cards/almost_evil 2026-05-27T11:53:31,769 copying src/unitxt/catalog/cards/almost_evil/es.json -> build/lib/unitxt/catalog/cards/almost_evil 2026-05-27T11:53:31,771 copying src/unitxt/catalog/cards/almost_evil/en.json -> build/lib/unitxt/catalog/cards/almost_evil 2026-05-27T11:53:31,773 copying src/unitxt/catalog/cards/almost_evil/pt.json -> build/lib/unitxt/catalog/cards/almost_evil 2026-05-27T11:53:31,776 copying src/unitxt/catalog/cards/almost_evil/nl.json -> build/lib/unitxt/catalog/cards/almost_evil 2026-05-27T11:53:31,778 creating build/lib/unitxt/catalog/cards/milu/Bengali 2026-05-27T11:53:31,780 copying src/unitxt/catalog/cards/milu/Bengali/Law_and_Governance.json -> build/lib/unitxt/catalog/cards/milu/Bengali 2026-05-27T11:53:31,782 copying src/unitxt/catalog/cards/milu/Bengali/Health_and_Medicine.json -> build/lib/unitxt/catalog/cards/milu/Bengali 2026-05-27T11:53:31,784 copying src/unitxt/catalog/cards/milu/Bengali/Social_Sciences.json -> build/lib/unitxt/catalog/cards/milu/Bengali 2026-05-27T11:53:31,787 copying src/unitxt/catalog/cards/milu/Bengali/Science.json -> build/lib/unitxt/catalog/cards/milu/Bengali 2026-05-27T11:53:31,789 copying src/unitxt/catalog/cards/milu/Bengali/Engineering_and_Tech.json -> build/lib/unitxt/catalog/cards/milu/Bengali 2026-05-27T11:53:31,791 copying src/unitxt/catalog/cards/milu/Bengali/Business_Studies.json -> build/lib/unitxt/catalog/cards/milu/Bengali 2026-05-27T11:53:31,793 copying src/unitxt/catalog/cards/milu/Bengali/Arts_and_Humanities.json -> build/lib/unitxt/catalog/cards/milu/Bengali 2026-05-27T11:53:31,795 copying src/unitxt/catalog/cards/milu/Bengali/Environmental_Sciences.json -> build/lib/unitxt/catalog/cards/milu/Bengali 2026-05-27T11:53:31,798 creating build/lib/unitxt/catalog/cards/milu/Marathi 2026-05-27T11:53:31,799 copying src/unitxt/catalog/cards/milu/Marathi/Law_and_Governance.json -> build/lib/unitxt/catalog/cards/milu/Marathi 2026-05-27T11:53:31,801 copying src/unitxt/catalog/cards/milu/Marathi/Health_and_Medicine.json -> build/lib/unitxt/catalog/cards/milu/Marathi 2026-05-27T11:53:31,803 copying src/unitxt/catalog/cards/milu/Marathi/Social_Sciences.json -> build/lib/unitxt/catalog/cards/milu/Marathi 2026-05-27T11:53:31,805 copying src/unitxt/catalog/cards/milu/Marathi/Science.json -> build/lib/unitxt/catalog/cards/milu/Marathi 2026-05-27T11:53:31,808 copying src/unitxt/catalog/cards/milu/Marathi/Engineering_and_Tech.json -> build/lib/unitxt/catalog/cards/milu/Marathi 2026-05-27T11:53:31,810 copying src/unitxt/catalog/cards/milu/Marathi/Business_Studies.json -> build/lib/unitxt/catalog/cards/milu/Marathi 2026-05-27T11:53:31,812 copying src/unitxt/catalog/cards/milu/Marathi/Arts_and_Humanities.json -> build/lib/unitxt/catalog/cards/milu/Marathi 2026-05-27T11:53:31,814 copying src/unitxt/catalog/cards/milu/Marathi/Environmental_Sciences.json -> build/lib/unitxt/catalog/cards/milu/Marathi 2026-05-27T11:53:31,817 creating build/lib/unitxt/catalog/cards/milu/Gujarati 2026-05-27T11:53:31,818 copying src/unitxt/catalog/cards/milu/Gujarati/Law_and_Governance.json -> build/lib/unitxt/catalog/cards/milu/Gujarati 2026-05-27T11:53:31,820 copying src/unitxt/catalog/cards/milu/Gujarati/Health_and_Medicine.json -> build/lib/unitxt/catalog/cards/milu/Gujarati 2026-05-27T11:53:31,822 copying src/unitxt/catalog/cards/milu/Gujarati/Social_Sciences.json -> build/lib/unitxt/catalog/cards/milu/Gujarati 2026-05-27T11:53:31,824 copying src/unitxt/catalog/cards/milu/Gujarati/Science.json -> build/lib/unitxt/catalog/cards/milu/Gujarati 2026-05-27T11:53:31,827 copying src/unitxt/catalog/cards/milu/Gujarati/Engineering_and_Tech.json -> build/lib/unitxt/catalog/cards/milu/Gujarati 2026-05-27T11:53:31,829 copying src/unitxt/catalog/cards/milu/Gujarati/Business_Studies.json -> build/lib/unitxt/catalog/cards/milu/Gujarati 2026-05-27T11:53:31,831 copying src/unitxt/catalog/cards/milu/Gujarati/Arts_and_Humanities.json -> build/lib/unitxt/catalog/cards/milu/Gujarati 2026-05-27T11:53:31,833 copying src/unitxt/catalog/cards/milu/Gujarati/Environmental_Sciences.json -> build/lib/unitxt/catalog/cards/milu/Gujarati 2026-05-27T11:53:31,836 creating build/lib/unitxt/catalog/cards/milu/Malayalam 2026-05-27T11:53:31,837 copying src/unitxt/catalog/cards/milu/Malayalam/Law_and_Governance.json -> build/lib/unitxt/catalog/cards/milu/Malayalam 2026-05-27T11:53:31,839 copying src/unitxt/catalog/cards/milu/Malayalam/Health_and_Medicine.json -> build/lib/unitxt/catalog/cards/milu/Malayalam 2026-05-27T11:53:31,841 copying src/unitxt/catalog/cards/milu/Malayalam/Social_Sciences.json -> build/lib/unitxt/catalog/cards/milu/Malayalam 2026-05-27T11:53:31,844 copying src/unitxt/catalog/cards/milu/Malayalam/Science.json -> build/lib/unitxt/catalog/cards/milu/Malayalam 2026-05-27T11:53:31,846 copying src/unitxt/catalog/cards/milu/Malayalam/Engineering_and_Tech.json -> build/lib/unitxt/catalog/cards/milu/Malayalam 2026-05-27T11:53:31,848 copying src/unitxt/catalog/cards/milu/Malayalam/Business_Studies.json -> build/lib/unitxt/catalog/cards/milu/Malayalam 2026-05-27T11:53:31,850 copying src/unitxt/catalog/cards/milu/Malayalam/Arts_and_Humanities.json -> build/lib/unitxt/catalog/cards/milu/Malayalam 2026-05-27T11:53:31,852 copying src/unitxt/catalog/cards/milu/Malayalam/Environmental_Sciences.json -> build/lib/unitxt/catalog/cards/milu/Malayalam 2026-05-27T11:53:31,855 creating build/lib/unitxt/catalog/cards/milu/Punjabi 2026-05-27T11:53:31,856 copying src/unitxt/catalog/cards/milu/Punjabi/Law_and_Governance.json -> build/lib/unitxt/catalog/cards/milu/Punjabi 2026-05-27T11:53:31,858 copying src/unitxt/catalog/cards/milu/Punjabi/Health_and_Medicine.json -> build/lib/unitxt/catalog/cards/milu/Punjabi 2026-05-27T11:53:31,860 copying src/unitxt/catalog/cards/milu/Punjabi/Social_Sciences.json -> build/lib/unitxt/catalog/cards/milu/Punjabi 2026-05-27T11:53:31,862 copying src/unitxt/catalog/cards/milu/Punjabi/Science.json -> build/lib/unitxt/catalog/cards/milu/Punjabi 2026-05-27T11:53:31,864 copying src/unitxt/catalog/cards/milu/Punjabi/Engineering_and_Tech.json -> build/lib/unitxt/catalog/cards/milu/Punjabi 2026-05-27T11:53:31,867 copying src/unitxt/catalog/cards/milu/Punjabi/Business_Studies.json -> build/lib/unitxt/catalog/cards/milu/Punjabi 2026-05-27T11:53:31,869 copying src/unitxt/catalog/cards/milu/Punjabi/Arts_and_Humanities.json -> build/lib/unitxt/catalog/cards/milu/Punjabi 2026-05-27T11:53:31,871 copying src/unitxt/catalog/cards/milu/Punjabi/Environmental_Sciences.json -> build/lib/unitxt/catalog/cards/milu/Punjabi 2026-05-27T11:53:31,873 creating build/lib/unitxt/catalog/cards/milu/Odia 2026-05-27T11:53:31,874 copying src/unitxt/catalog/cards/milu/Odia/Law_and_Governance.json -> build/lib/unitxt/catalog/cards/milu/Odia 2026-05-27T11:53:31,877 copying src/unitxt/catalog/cards/milu/Odia/Health_and_Medicine.json -> build/lib/unitxt/catalog/cards/milu/Odia 2026-05-27T11:53:31,879 copying src/unitxt/catalog/cards/milu/Odia/Social_Sciences.json -> build/lib/unitxt/catalog/cards/milu/Odia 2026-05-27T11:53:31,882 copying src/unitxt/catalog/cards/milu/Odia/Science.json -> build/lib/unitxt/catalog/cards/milu/Odia 2026-05-27T11:53:31,884 copying src/unitxt/catalog/cards/milu/Odia/Engineering_and_Tech.json -> build/lib/unitxt/catalog/cards/milu/Odia 2026-05-27T11:53:31,886 copying src/unitxt/catalog/cards/milu/Odia/Business_Studies.json -> build/lib/unitxt/catalog/cards/milu/Odia 2026-05-27T11:53:31,888 copying src/unitxt/catalog/cards/milu/Odia/Arts_and_Humanities.json -> build/lib/unitxt/catalog/cards/milu/Odia 2026-05-27T11:53:31,891 copying src/unitxt/catalog/cards/milu/Odia/Environmental_Sciences.json -> build/lib/unitxt/catalog/cards/milu/Odia 2026-05-27T11:53:31,893 creating build/lib/unitxt/catalog/cards/milu/Hindi 2026-05-27T11:53:31,894 copying src/unitxt/catalog/cards/milu/Hindi/Law_and_Governance.json -> build/lib/unitxt/catalog/cards/milu/Hindi 2026-05-27T11:53:31,896 copying src/unitxt/catalog/cards/milu/Hindi/Health_and_Medicine.json -> build/lib/unitxt/catalog/cards/milu/Hindi 2026-05-27T11:53:31,898 copying src/unitxt/catalog/cards/milu/Hindi/Social_Sciences.json -> build/lib/unitxt/catalog/cards/milu/Hindi 2026-05-27T11:53:31,901 copying src/unitxt/catalog/cards/milu/Hindi/Science.json -> build/lib/unitxt/catalog/cards/milu/Hindi 2026-05-27T11:53:31,903 copying src/unitxt/catalog/cards/milu/Hindi/Engineering_and_Tech.json -> build/lib/unitxt/catalog/cards/milu/Hindi 2026-05-27T11:53:31,906 copying src/unitxt/catalog/cards/milu/Hindi/Business_Studies.json -> build/lib/unitxt/catalog/cards/milu/Hindi 2026-05-27T11:53:31,909 copying src/unitxt/catalog/cards/milu/Hindi/Arts_and_Humanities.json -> build/lib/unitxt/catalog/cards/milu/Hindi 2026-05-27T11:53:31,912 copying src/unitxt/catalog/cards/milu/Hindi/Environmental_Sciences.json -> build/lib/unitxt/catalog/cards/milu/Hindi 2026-05-27T11:53:31,914 creating build/lib/unitxt/catalog/cards/milu/English 2026-05-27T11:53:31,916 copying src/unitxt/catalog/cards/milu/English/Law_and_Governance.json -> build/lib/unitxt/catalog/cards/milu/English 2026-05-27T11:53:31,919 copying src/unitxt/catalog/cards/milu/English/Health_and_Medicine.json -> build/lib/unitxt/catalog/cards/milu/English 2026-05-27T11:53:31,921 copying src/unitxt/catalog/cards/milu/English/Social_Sciences.json -> build/lib/unitxt/catalog/cards/milu/English 2026-05-27T11:53:31,924 copying src/unitxt/catalog/cards/milu/English/Science.json -> build/lib/unitxt/catalog/cards/milu/English 2026-05-27T11:53:31,927 copying src/unitxt/catalog/cards/milu/English/Engineering_and_Tech.json -> build/lib/unitxt/catalog/cards/milu/English 2026-05-27T11:53:31,929 copying src/unitxt/catalog/cards/milu/English/Business_Studies.json -> build/lib/unitxt/catalog/cards/milu/English 2026-05-27T11:53:31,932 copying src/unitxt/catalog/cards/milu/English/Arts_and_Humanities.json -> build/lib/unitxt/catalog/cards/milu/English 2026-05-27T11:53:31,934 copying src/unitxt/catalog/cards/milu/English/Environmental_Sciences.json -> build/lib/unitxt/catalog/cards/milu/English 2026-05-27T11:53:31,937 creating build/lib/unitxt/catalog/cards/milu/Tamil 2026-05-27T11:53:31,938 copying src/unitxt/catalog/cards/milu/Tamil/Law_and_Governance.json -> build/lib/unitxt/catalog/cards/milu/Tamil 2026-05-27T11:53:31,941 copying src/unitxt/catalog/cards/milu/Tamil/Health_and_Medicine.json -> build/lib/unitxt/catalog/cards/milu/Tamil 2026-05-27T11:53:31,943 copying src/unitxt/catalog/cards/milu/Tamil/Social_Sciences.json -> build/lib/unitxt/catalog/cards/milu/Tamil 2026-05-27T11:53:31,946 copying src/unitxt/catalog/cards/milu/Tamil/Science.json -> build/lib/unitxt/catalog/cards/milu/Tamil 2026-05-27T11:53:31,949 copying src/unitxt/catalog/cards/milu/Tamil/Engineering_and_Tech.json -> build/lib/unitxt/catalog/cards/milu/Tamil 2026-05-27T11:53:31,951 copying src/unitxt/catalog/cards/milu/Tamil/Business_Studies.json -> build/lib/unitxt/catalog/cards/milu/Tamil 2026-05-27T11:53:31,954 copying src/unitxt/catalog/cards/milu/Tamil/Arts_and_Humanities.json -> build/lib/unitxt/catalog/cards/milu/Tamil 2026-05-27T11:53:31,957 copying src/unitxt/catalog/cards/milu/Tamil/Environmental_Sciences.json -> build/lib/unitxt/catalog/cards/milu/Tamil 2026-05-27T11:53:31,960 creating build/lib/unitxt/catalog/cards/milu/Kannada 2026-05-27T11:53:31,961 copying src/unitxt/catalog/cards/milu/Kannada/Law_and_Governance.json -> build/lib/unitxt/catalog/cards/milu/Kannada 2026-05-27T11:53:31,964 copying src/unitxt/catalog/cards/milu/Kannada/Health_and_Medicine.json -> build/lib/unitxt/catalog/cards/milu/Kannada 2026-05-27T11:53:31,967 copying src/unitxt/catalog/cards/milu/Kannada/Social_Sciences.json -> build/lib/unitxt/catalog/cards/milu/Kannada 2026-05-27T11:53:31,970 copying src/unitxt/catalog/cards/milu/Kannada/Science.json -> build/lib/unitxt/catalog/cards/milu/Kannada 2026-05-27T11:53:31,972 copying src/unitxt/catalog/cards/milu/Kannada/Engineering_and_Tech.json -> build/lib/unitxt/catalog/cards/milu/Kannada 2026-05-27T11:53:31,975 copying src/unitxt/catalog/cards/milu/Kannada/Business_Studies.json -> build/lib/unitxt/catalog/cards/milu/Kannada 2026-05-27T11:53:31,978 copying src/unitxt/catalog/cards/milu/Kannada/Arts_and_Humanities.json -> build/lib/unitxt/catalog/cards/milu/Kannada 2026-05-27T11:53:31,981 copying src/unitxt/catalog/cards/milu/Kannada/Environmental_Sciences.json -> build/lib/unitxt/catalog/cards/milu/Kannada 2026-05-27T11:53:31,983 creating build/lib/unitxt/catalog/cards/milu/Telugu 2026-05-27T11:53:31,984 copying src/unitxt/catalog/cards/milu/Telugu/Law_and_Governance.json -> build/lib/unitxt/catalog/cards/milu/Telugu 2026-05-27T11:53:31,987 copying src/unitxt/catalog/cards/milu/Telugu/Health_and_Medicine.json -> build/lib/unitxt/catalog/cards/milu/Telugu 2026-05-27T11:53:31,990 copying src/unitxt/catalog/cards/milu/Telugu/Social_Sciences.json -> build/lib/unitxt/catalog/cards/milu/Telugu 2026-05-27T11:53:31,993 copying src/unitxt/catalog/cards/milu/Telugu/Science.json -> build/lib/unitxt/catalog/cards/milu/Telugu 2026-05-27T11:53:31,995 copying src/unitxt/catalog/cards/milu/Telugu/Engineering_and_Tech.json -> build/lib/unitxt/catalog/cards/milu/Telugu 2026-05-27T11:53:31,998 copying src/unitxt/catalog/cards/milu/Telugu/Business_Studies.json -> build/lib/unitxt/catalog/cards/milu/Telugu 2026-05-27T11:53:32,001 copying src/unitxt/catalog/cards/milu/Telugu/Arts_and_Humanities.json -> build/lib/unitxt/catalog/cards/milu/Telugu 2026-05-27T11:53:32,003 copying src/unitxt/catalog/cards/milu/Telugu/Environmental_Sciences.json -> build/lib/unitxt/catalog/cards/milu/Telugu 2026-05-27T11:53:32,005 creating build/lib/unitxt/catalog/cards/judge_bench/dices 2026-05-27T11:53:32,007 copying src/unitxt/catalog/cards/judge_bench/dices/safety.json -> build/lib/unitxt/catalog/cards/judge_bench/dices 2026-05-27T11:53:32,009 creating build/lib/unitxt/catalog/cards/judge_bench/roscoe/overall/esnli 2026-05-27T11:53:32,011 copying src/unitxt/catalog/cards/judge_bench/roscoe/overall/esnli/coherence.json -> build/lib/unitxt/catalog/cards/judge_bench/roscoe/overall/esnli 2026-05-27T11:53:32,013 copying src/unitxt/catalog/cards/judge_bench/roscoe/overall/esnli/overall_quality.json -> build/lib/unitxt/catalog/cards/judge_bench/roscoe/overall/esnli 2026-05-27T11:53:32,015 copying src/unitxt/catalog/cards/judge_bench/roscoe/overall/esnli/missing_steps.json -> build/lib/unitxt/catalog/cards/judge_bench/roscoe/overall/esnli 2026-05-27T11:53:32,018 copying src/unitxt/catalog/cards/judge_bench/roscoe/overall/esnli/contradiction.json -> build/lib/unitxt/catalog/cards/judge_bench/roscoe/overall/esnli 2026-05-27T11:53:32,020 creating build/lib/unitxt/catalog/cards/judge_bench/roscoe/overall/cosmos 2026-05-27T11:53:32,021 copying src/unitxt/catalog/cards/judge_bench/roscoe/overall/cosmos/coherence.json -> build/lib/unitxt/catalog/cards/judge_bench/roscoe/overall/cosmos 2026-05-27T11:53:32,023 copying src/unitxt/catalog/cards/judge_bench/roscoe/overall/cosmos/overall_quality.json -> build/lib/unitxt/catalog/cards/judge_bench/roscoe/overall/cosmos 2026-05-27T11:53:32,026 copying src/unitxt/catalog/cards/judge_bench/roscoe/overall/cosmos/missing_steps.json -> build/lib/unitxt/catalog/cards/judge_bench/roscoe/overall/cosmos 2026-05-27T11:53:32,028 copying src/unitxt/catalog/cards/judge_bench/roscoe/overall/cosmos/contradiction.json -> build/lib/unitxt/catalog/cards/judge_bench/roscoe/overall/cosmos 2026-05-27T11:53:32,030 creating build/lib/unitxt/catalog/cards/judge_bench/roscoe/overall/drop 2026-05-27T11:53:32,032 copying src/unitxt/catalog/cards/judge_bench/roscoe/overall/drop/coherence.json -> build/lib/unitxt/catalog/cards/judge_bench/roscoe/overall/drop 2026-05-27T11:53:32,035 copying src/unitxt/catalog/cards/judge_bench/roscoe/overall/drop/overall_quality.json -> build/lib/unitxt/catalog/cards/judge_bench/roscoe/overall/drop 2026-05-27T11:53:32,037 copying src/unitxt/catalog/cards/judge_bench/roscoe/overall/drop/missing_steps.json -> build/lib/unitxt/catalog/cards/judge_bench/roscoe/overall/drop 2026-05-27T11:53:32,040 copying src/unitxt/catalog/cards/judge_bench/roscoe/overall/drop/contradiction.json -> build/lib/unitxt/catalog/cards/judge_bench/roscoe/overall/drop 2026-05-27T11:53:32,042 creating build/lib/unitxt/catalog/cards/judge_bench/roscoe/stepwise/esnli 2026-05-27T11:53:32,044 copying src/unitxt/catalog/cards/judge_bench/roscoe/stepwise/esnli/hallucination.json -> build/lib/unitxt/catalog/cards/judge_bench/roscoe/stepwise/esnli 2026-05-27T11:53:32,046 copying src/unitxt/catalog/cards/judge_bench/roscoe/stepwise/esnli/final_answer.json -> build/lib/unitxt/catalog/cards/judge_bench/roscoe/stepwise/esnli 2026-05-27T11:53:32,049 copying src/unitxt/catalog/cards/judge_bench/roscoe/stepwise/esnli/redundancy.json -> build/lib/unitxt/catalog/cards/judge_bench/roscoe/stepwise/esnli 2026-05-27T11:53:32,052 copying src/unitxt/catalog/cards/judge_bench/roscoe/stepwise/esnli/arithmetic.json -> build/lib/unitxt/catalog/cards/judge_bench/roscoe/stepwise/esnli 2026-05-27T11:53:32,055 copying src/unitxt/catalog/cards/judge_bench/roscoe/stepwise/esnli/factuality.json -> build/lib/unitxt/catalog/cards/judge_bench/roscoe/stepwise/esnli 2026-05-27T11:53:32,057 copying src/unitxt/catalog/cards/judge_bench/roscoe/stepwise/esnli/repetition.json -> build/lib/unitxt/catalog/cards/judge_bench/roscoe/stepwise/esnli 2026-05-27T11:53:32,060 copying src/unitxt/catalog/cards/judge_bench/roscoe/stepwise/esnli/commonsense.json -> build/lib/unitxt/catalog/cards/judge_bench/roscoe/stepwise/esnli 2026-05-27T11:53:32,062 copying src/unitxt/catalog/cards/judge_bench/roscoe/stepwise/esnli/coherency_and_logic.json -> build/lib/unitxt/catalog/cards/judge_bench/roscoe/stepwise/esnli 2026-05-27T11:53:32,065 copying src/unitxt/catalog/cards/judge_bench/roscoe/stepwise/esnli/grammar.json -> build/lib/unitxt/catalog/cards/judge_bench/roscoe/stepwise/esnli 2026-05-27T11:53:32,067 creating build/lib/unitxt/catalog/cards/judge_bench/roscoe/stepwise/cosmos 2026-05-27T11:53:32,069 copying src/unitxt/catalog/cards/judge_bench/roscoe/stepwise/cosmos/hallucination.json -> build/lib/unitxt/catalog/cards/judge_bench/roscoe/stepwise/cosmos 2026-05-27T11:53:32,071 copying src/unitxt/catalog/cards/judge_bench/roscoe/stepwise/cosmos/final_answer.json -> build/lib/unitxt/catalog/cards/judge_bench/roscoe/stepwise/cosmos 2026-05-27T11:53:32,074 copying src/unitxt/catalog/cards/judge_bench/roscoe/stepwise/cosmos/redundancy.json -> build/lib/unitxt/catalog/cards/judge_bench/roscoe/stepwise/cosmos 2026-05-27T11:53:32,076 copying src/unitxt/catalog/cards/judge_bench/roscoe/stepwise/cosmos/arithmetic.json -> build/lib/unitxt/catalog/cards/judge_bench/roscoe/stepwise/cosmos 2026-05-27T11:53:32,079 copying src/unitxt/catalog/cards/judge_bench/roscoe/stepwise/cosmos/factuality.json -> build/lib/unitxt/catalog/cards/judge_bench/roscoe/stepwise/cosmos 2026-05-27T11:53:32,081 copying src/unitxt/catalog/cards/judge_bench/roscoe/stepwise/cosmos/repetition.json -> build/lib/unitxt/catalog/cards/judge_bench/roscoe/stepwise/cosmos 2026-05-27T11:53:32,084 copying src/unitxt/catalog/cards/judge_bench/roscoe/stepwise/cosmos/commonsense.json -> build/lib/unitxt/catalog/cards/judge_bench/roscoe/stepwise/cosmos 2026-05-27T11:53:32,086 copying src/unitxt/catalog/cards/judge_bench/roscoe/stepwise/cosmos/coherency_and_logic.json -> build/lib/unitxt/catalog/cards/judge_bench/roscoe/stepwise/cosmos 2026-05-27T11:53:32,089 copying src/unitxt/catalog/cards/judge_bench/roscoe/stepwise/cosmos/grammar.json -> build/lib/unitxt/catalog/cards/judge_bench/roscoe/stepwise/cosmos 2026-05-27T11:53:32,091 creating build/lib/unitxt/catalog/cards/judge_bench/roscoe/stepwise/drop 2026-05-27T11:53:32,093 copying src/unitxt/catalog/cards/judge_bench/roscoe/stepwise/drop/hallucination.json -> build/lib/unitxt/catalog/cards/judge_bench/roscoe/stepwise/drop 2026-05-27T11:53:32,095 copying src/unitxt/catalog/cards/judge_bench/roscoe/stepwise/drop/final_answer.json -> build/lib/unitxt/catalog/cards/judge_bench/roscoe/stepwise/drop 2026-05-27T11:53:32,098 copying src/unitxt/catalog/cards/judge_bench/roscoe/stepwise/drop/redundancy.json -> build/lib/unitxt/catalog/cards/judge_bench/roscoe/stepwise/drop 2026-05-27T11:53:32,100 copying src/unitxt/catalog/cards/judge_bench/roscoe/stepwise/drop/arithmetic.json -> build/lib/unitxt/catalog/cards/judge_bench/roscoe/stepwise/drop 2026-05-27T11:53:32,103 copying src/unitxt/catalog/cards/judge_bench/roscoe/stepwise/drop/factuality.json -> build/lib/unitxt/catalog/cards/judge_bench/roscoe/stepwise/drop 2026-05-27T11:53:32,105 copying src/unitxt/catalog/cards/judge_bench/roscoe/stepwise/drop/repetition.json -> build/lib/unitxt/catalog/cards/judge_bench/roscoe/stepwise/drop 2026-05-27T11:53:32,108 copying src/unitxt/catalog/cards/judge_bench/roscoe/stepwise/drop/commonsense.json -> build/lib/unitxt/catalog/cards/judge_bench/roscoe/stepwise/drop 2026-05-27T11:53:32,111 copying src/unitxt/catalog/cards/judge_bench/roscoe/stepwise/drop/coherency_and_logic.json -> build/lib/unitxt/catalog/cards/judge_bench/roscoe/stepwise/drop 2026-05-27T11:53:32,113 copying src/unitxt/catalog/cards/judge_bench/roscoe/stepwise/drop/grammar.json -> build/lib/unitxt/catalog/cards/judge_bench/roscoe/stepwise/drop 2026-05-27T11:53:32,116 creating build/lib/unitxt/catalog/cards/judge_bench/cola 2026-05-27T11:53:32,117 copying src/unitxt/catalog/cards/judge_bench/cola/grammaticality.json -> build/lib/unitxt/catalog/cards/judge_bench/cola 2026-05-27T11:53:32,119 creating build/lib/unitxt/catalog/cards/judge_bench/newswoom 2026-05-27T11:53:32,120 copying src/unitxt/catalog/cards/judge_bench/newswoom/fluency.json -> build/lib/unitxt/catalog/cards/judge_bench/newswoom 2026-05-27T11:53:32,122 copying src/unitxt/catalog/cards/judge_bench/newswoom/coherence.json -> build/lib/unitxt/catalog/cards/judge_bench/newswoom 2026-05-27T11:53:32,124 copying src/unitxt/catalog/cards/judge_bench/newswoom/relevance.json -> build/lib/unitxt/catalog/cards/judge_bench/newswoom 2026-05-27T11:53:32,126 copying src/unitxt/catalog/cards/judge_bench/newswoom/informativeness.json -> build/lib/unitxt/catalog/cards/judge_bench/newswoom 2026-05-27T11:53:32,129 creating build/lib/unitxt/catalog/cards/judge_bench/wmt_human/english_to_german 2026-05-27T11:53:32,130 copying src/unitxt/catalog/cards/judge_bench/wmt_human/english_to_german/quality.json -> build/lib/unitxt/catalog/cards/judge_bench/wmt_human/english_to_german 2026-05-27T11:53:32,132 creating build/lib/unitxt/catalog/cards/judge_bench/wmt_human/chinese_to_english 2026-05-27T11:53:32,133 copying src/unitxt/catalog/cards/judge_bench/wmt_human/chinese_to_english/quality.json -> build/lib/unitxt/catalog/cards/judge_bench/wmt_human/chinese_to_english 2026-05-27T11:53:32,136 creating build/lib/unitxt/catalog/cards/judge_bench/toxic_chat 2026-05-27T11:53:32,137 copying src/unitxt/catalog/cards/judge_bench/toxic_chat/jailbreaking.json -> build/lib/unitxt/catalog/cards/judge_bench/toxic_chat 2026-05-27T11:53:32,139 copying src/unitxt/catalog/cards/judge_bench/toxic_chat/toxicity.json -> build/lib/unitxt/catalog/cards/judge_bench/toxic_chat 2026-05-27T11:53:32,141 creating build/lib/unitxt/catalog/cards/judge_bench/inferential_strategies 2026-05-27T11:53:32,142 copying src/unitxt/catalog/cards/judge_bench/inferential_strategies/sound_reasoning.json -> build/lib/unitxt/catalog/cards/judge_bench/inferential_strategies 2026-05-27T11:53:32,144 creating build/lib/unitxt/catalog/cards/ragbench 2026-05-27T11:53:32,146 copying src/unitxt/catalog/cards/ragbench/expertqa.json -> build/lib/unitxt/catalog/cards/ragbench 2026-05-27T11:53:32,148 copying src/unitxt/catalog/cards/ragbench/cuad.json -> build/lib/unitxt/catalog/cards/ragbench 2026-05-27T11:53:32,150 copying src/unitxt/catalog/cards/ragbench/hotpotqa.json -> build/lib/unitxt/catalog/cards/ragbench 2026-05-27T11:53:32,152 copying src/unitxt/catalog/cards/ragbench/pubmedqa.json -> build/lib/unitxt/catalog/cards/ragbench 2026-05-27T11:53:32,155 copying src/unitxt/catalog/cards/ragbench/techqa.json -> build/lib/unitxt/catalog/cards/ragbench 2026-05-27T11:53:32,157 copying src/unitxt/catalog/cards/ragbench/hagrid.json -> build/lib/unitxt/catalog/cards/ragbench 2026-05-27T11:53:32,159 copying src/unitxt/catalog/cards/ragbench/msmarco.json -> build/lib/unitxt/catalog/cards/ragbench 2026-05-27T11:53:32,161 copying src/unitxt/catalog/cards/ragbench/delucionqa.json -> build/lib/unitxt/catalog/cards/ragbench 2026-05-27T11:53:32,163 copying src/unitxt/catalog/cards/ragbench/finqa.json -> build/lib/unitxt/catalog/cards/ragbench 2026-05-27T11:53:32,165 copying src/unitxt/catalog/cards/ragbench/covidqa.json -> build/lib/unitxt/catalog/cards/ragbench 2026-05-27T11:53:32,168 copying src/unitxt/catalog/cards/ragbench/tatqa.json -> build/lib/unitxt/catalog/cards/ragbench 2026-05-27T11:53:32,170 copying src/unitxt/catalog/cards/ragbench/emanual.json -> build/lib/unitxt/catalog/cards/ragbench 2026-05-27T11:53:32,172 creating build/lib/unitxt/catalog/cards/reuters21578 2026-05-27T11:53:32,173 copying src/unitxt/catalog/cards/reuters21578/ModHayes.json -> build/lib/unitxt/catalog/cards/reuters21578 2026-05-27T11:53:32,175 copying src/unitxt/catalog/cards/reuters21578/ModLewis.json -> build/lib/unitxt/catalog/cards/reuters21578 2026-05-27T11:53:32,178 copying src/unitxt/catalog/cards/reuters21578/ModApte.json -> build/lib/unitxt/catalog/cards/reuters21578 2026-05-27T11:53:32,180 creating build/lib/unitxt/catalog/cards/universal_ner/sv 2026-05-27T11:53:32,182 copying src/unitxt/catalog/cards/universal_ner/sv/pud.json -> build/lib/unitxt/catalog/cards/universal_ner/sv 2026-05-27T11:53:32,184 copying src/unitxt/catalog/cards/universal_ner/sv/talbanken.json -> build/lib/unitxt/catalog/cards/universal_ner/sv 2026-05-27T11:53:32,186 creating build/lib/unitxt/catalog/cards/universal_ner/da 2026-05-27T11:53:32,187 copying src/unitxt/catalog/cards/universal_ner/da/ddt.json -> build/lib/unitxt/catalog/cards/universal_ner/da 2026-05-27T11:53:32,189 creating build/lib/unitxt/catalog/cards/universal_ner/sk 2026-05-27T11:53:32,190 copying src/unitxt/catalog/cards/universal_ner/sk/snk.json -> build/lib/unitxt/catalog/cards/universal_ner/sk 2026-05-27T11:53:32,193 creating build/lib/unitxt/catalog/cards/universal_ner/tl 2026-05-27T11:53:32,194 copying src/unitxt/catalog/cards/universal_ner/tl/trg.json -> build/lib/unitxt/catalog/cards/universal_ner/tl 2026-05-27T11:53:32,196 copying src/unitxt/catalog/cards/universal_ner/tl/ugnayan.json -> build/lib/unitxt/catalog/cards/universal_ner/tl 2026-05-27T11:53:32,198 creating build/lib/unitxt/catalog/cards/universal_ner/sr 2026-05-27T11:53:32,199 copying src/unitxt/catalog/cards/universal_ner/sr/set.json -> build/lib/unitxt/catalog/cards/universal_ner/sr 2026-05-27T11:53:32,202 creating build/lib/unitxt/catalog/cards/universal_ner/en 2026-05-27T11:53:32,203 copying src/unitxt/catalog/cards/universal_ner/en/ewt.json -> build/lib/unitxt/catalog/cards/universal_ner/en 2026-05-27T11:53:32,205 copying src/unitxt/catalog/cards/universal_ner/en/pud.json -> build/lib/unitxt/catalog/cards/universal_ner/en 2026-05-27T11:53:32,207 creating build/lib/unitxt/catalog/cards/universal_ner/de 2026-05-27T11:53:32,208 copying src/unitxt/catalog/cards/universal_ner/de/pud.json -> build/lib/unitxt/catalog/cards/universal_ner/de 2026-05-27T11:53:32,211 creating build/lib/unitxt/catalog/cards/universal_ner/ceb 2026-05-27T11:53:32,212 copying src/unitxt/catalog/cards/universal_ner/ceb/gja.json -> build/lib/unitxt/catalog/cards/universal_ner/ceb 2026-05-27T11:53:32,214 creating build/lib/unitxt/catalog/cards/universal_ner/ru 2026-05-27T11:53:32,215 copying src/unitxt/catalog/cards/universal_ner/ru/pud.json -> build/lib/unitxt/catalog/cards/universal_ner/ru 2026-05-27T11:53:32,218 creating build/lib/unitxt/catalog/cards/universal_ner/pt 2026-05-27T11:53:32,219 copying src/unitxt/catalog/cards/universal_ner/pt/bosque.json -> build/lib/unitxt/catalog/cards/universal_ner/pt 2026-05-27T11:53:32,221 copying src/unitxt/catalog/cards/universal_ner/pt/pud.json -> build/lib/unitxt/catalog/cards/universal_ner/pt 2026-05-27T11:53:32,223 creating build/lib/unitxt/catalog/cards/universal_ner/hr 2026-05-27T11:53:32,224 copying src/unitxt/catalog/cards/universal_ner/hr/set.json -> build/lib/unitxt/catalog/cards/universal_ner/hr 2026-05-27T11:53:32,227 creating build/lib/unitxt/catalog/cards/universal_ner/zh 2026-05-27T11:53:32,228 copying src/unitxt/catalog/cards/universal_ner/zh/gsd.json -> build/lib/unitxt/catalog/cards/universal_ner/zh 2026-05-27T11:53:32,231 copying src/unitxt/catalog/cards/universal_ner/zh/gsdsimp.json -> build/lib/unitxt/catalog/cards/universal_ner/zh 2026-05-27T11:53:32,233 copying src/unitxt/catalog/cards/universal_ner/zh/pud.json -> build/lib/unitxt/catalog/cards/universal_ner/zh 2026-05-27T11:53:32,236 creating build/lib/unitxt/catalog/cards/mt/flores_101 2026-05-27T11:53:32,237 copying src/unitxt/catalog/cards/mt/flores_101/eng_jpn.json -> build/lib/unitxt/catalog/cards/mt/flores_101 2026-05-27T11:53:32,240 copying src/unitxt/catalog/cards/mt/flores_101/eng_spa.json -> build/lib/unitxt/catalog/cards/mt/flores_101 2026-05-27T11:53:32,242 copying src/unitxt/catalog/cards/mt/flores_101/eng_kor.json -> build/lib/unitxt/catalog/cards/mt/flores_101 2026-05-27T11:53:32,244 copying src/unitxt/catalog/cards/mt/flores_101/eng_fra.json -> build/lib/unitxt/catalog/cards/mt/flores_101 2026-05-27T11:53:32,246 copying src/unitxt/catalog/cards/mt/flores_101/ara_eng.json -> build/lib/unitxt/catalog/cards/mt/flores_101 2026-05-27T11:53:32,249 copying src/unitxt/catalog/cards/mt/flores_101/por_eng.json -> build/lib/unitxt/catalog/cards/mt/flores_101 2026-05-27T11:53:32,251 copying src/unitxt/catalog/cards/mt/flores_101/kor_eng.json -> build/lib/unitxt/catalog/cards/mt/flores_101 2026-05-27T11:53:32,253 copying src/unitxt/catalog/cards/mt/flores_101/jpn_eng.json -> build/lib/unitxt/catalog/cards/mt/flores_101 2026-05-27T11:53:32,255 copying src/unitxt/catalog/cards/mt/flores_101/eng_ara.json -> build/lib/unitxt/catalog/cards/mt/flores_101 2026-05-27T11:53:32,258 copying src/unitxt/catalog/cards/mt/flores_101/eng_por.json -> build/lib/unitxt/catalog/cards/mt/flores_101 2026-05-27T11:53:32,260 copying src/unitxt/catalog/cards/mt/flores_101/deu_eng.json -> build/lib/unitxt/catalog/cards/mt/flores_101 2026-05-27T11:53:32,262 copying src/unitxt/catalog/cards/mt/flores_101/fra_eng.json -> build/lib/unitxt/catalog/cards/mt/flores_101 2026-05-27T11:53:32,264 copying src/unitxt/catalog/cards/mt/flores_101/ron_eng.json -> build/lib/unitxt/catalog/cards/mt/flores_101 2026-05-27T11:53:32,267 copying src/unitxt/catalog/cards/mt/flores_101/eng_deu.json -> build/lib/unitxt/catalog/cards/mt/flores_101 2026-05-27T11:53:32,269 copying src/unitxt/catalog/cards/mt/flores_101/eng_ron.json -> build/lib/unitxt/catalog/cards/mt/flores_101 2026-05-27T11:53:32,271 copying src/unitxt/catalog/cards/mt/flores_101/spa_eng.json -> build/lib/unitxt/catalog/cards/mt/flores_101 2026-05-27T11:53:32,274 creating build/lib/unitxt/catalog/cards/mmmu 2026-05-27T11:53:32,275 copying src/unitxt/catalog/cards/mmmu/art.json -> build/lib/unitxt/catalog/cards/mmmu 2026-05-27T11:53:32,277 copying src/unitxt/catalog/cards/mmmu/pharmacy.json -> build/lib/unitxt/catalog/cards/mmmu 2026-05-27T11:53:32,280 copying src/unitxt/catalog/cards/mmmu/economics.json -> build/lib/unitxt/catalog/cards/mmmu 2026-05-27T11:53:32,282 copying src/unitxt/catalog/cards/mmmu/clinical_medicine.json -> build/lib/unitxt/catalog/cards/mmmu 2026-05-27T11:53:32,284 copying src/unitxt/catalog/cards/mmmu/chemistry.json -> build/lib/unitxt/catalog/cards/mmmu 2026-05-27T11:53:32,287 copying src/unitxt/catalog/cards/mmmu/literature.json -> build/lib/unitxt/catalog/cards/mmmu 2026-05-27T11:53:32,289 copying src/unitxt/catalog/cards/mmmu/physics.json -> build/lib/unitxt/catalog/cards/mmmu 2026-05-27T11:53:32,291 copying src/unitxt/catalog/cards/mmmu/sociology.json -> build/lib/unitxt/catalog/cards/mmmu 2026-05-27T11:53:32,294 copying src/unitxt/catalog/cards/mmmu/diagnostics_and_laboratory_medicine.json -> build/lib/unitxt/catalog/cards/mmmu 2026-05-27T11:53:32,296 copying src/unitxt/catalog/cards/mmmu/computer_science.json -> build/lib/unitxt/catalog/cards/mmmu 2026-05-27T11:53:32,298 copying src/unitxt/catalog/cards/mmmu/finance.json -> build/lib/unitxt/catalog/cards/mmmu 2026-05-27T11:53:32,301 copying src/unitxt/catalog/cards/mmmu/music.json -> build/lib/unitxt/catalog/cards/mmmu 2026-05-27T11:53:32,303 copying src/unitxt/catalog/cards/mmmu/mechanical_engineering.json -> build/lib/unitxt/catalog/cards/mmmu 2026-05-27T11:53:32,305 copying src/unitxt/catalog/cards/mmmu/public_health.json -> build/lib/unitxt/catalog/cards/mmmu 2026-05-27T11:53:32,308 copying src/unitxt/catalog/cards/mmmu/manage.json -> build/lib/unitxt/catalog/cards/mmmu 2026-05-27T11:53:32,310 copying src/unitxt/catalog/cards/mmmu/psychology.json -> build/lib/unitxt/catalog/cards/mmmu 2026-05-27T11:53:32,313 copying src/unitxt/catalog/cards/mmmu/math.json -> build/lib/unitxt/catalog/cards/mmmu 2026-05-27T11:53:32,315 copying src/unitxt/catalog/cards/mmmu/geography.json -> build/lib/unitxt/catalog/cards/mmmu 2026-05-27T11:53:32,318 copying src/unitxt/catalog/cards/mmmu/materials.json -> build/lib/unitxt/catalog/cards/mmmu 2026-05-27T11:53:32,321 copying src/unitxt/catalog/cards/mmmu/history.json -> build/lib/unitxt/catalog/cards/mmmu 2026-05-27T11:53:32,323 copying src/unitxt/catalog/cards/mmmu/art_theory.json -> build/lib/unitxt/catalog/cards/mmmu 2026-05-27T11:53:32,325 copying src/unitxt/catalog/cards/mmmu/design.json -> build/lib/unitxt/catalog/cards/mmmu 2026-05-27T11:53:32,327 copying src/unitxt/catalog/cards/mmmu/marketing.json -> build/lib/unitxt/catalog/cards/mmmu 2026-05-27T11:53:32,330 copying src/unitxt/catalog/cards/mmmu/biology.json -> build/lib/unitxt/catalog/cards/mmmu 2026-05-27T11:53:32,332 copying src/unitxt/catalog/cards/mmmu/basic_medical_science.json -> build/lib/unitxt/catalog/cards/mmmu 2026-05-27T11:53:32,334 copying src/unitxt/catalog/cards/mmmu/accounting.json -> build/lib/unitxt/catalog/cards/mmmu 2026-05-27T11:53:32,336 copying src/unitxt/catalog/cards/mmmu/architecture_and_engineering.json -> build/lib/unitxt/catalog/cards/mmmu 2026-05-27T11:53:32,339 copying src/unitxt/catalog/cards/mmmu/agriculture.json -> build/lib/unitxt/catalog/cards/mmmu 2026-05-27T11:53:32,341 copying src/unitxt/catalog/cards/mmmu/energy_and_power.json -> build/lib/unitxt/catalog/cards/mmmu 2026-05-27T11:53:32,343 copying src/unitxt/catalog/cards/mmmu/electronics.json -> build/lib/unitxt/catalog/cards/mmmu 2026-05-27T11:53:32,345 creating build/lib/unitxt/catalog/cards/winogrande 2026-05-27T11:53:32,346 copying src/unitxt/catalog/cards/winogrande/xl.json -> build/lib/unitxt/catalog/cards/winogrande 2026-05-27T11:53:32,349 copying src/unitxt/catalog/cards/winogrande/debiased.json -> build/lib/unitxt/catalog/cards/winogrande 2026-05-27T11:53:32,351 copying src/unitxt/catalog/cards/winogrande/s.json -> build/lib/unitxt/catalog/cards/winogrande 2026-05-27T11:53:32,353 copying src/unitxt/catalog/cards/winogrande/xs.json -> build/lib/unitxt/catalog/cards/winogrande 2026-05-27T11:53:32,356 copying src/unitxt/catalog/cards/winogrande/l.json -> build/lib/unitxt/catalog/cards/winogrande 2026-05-27T11:53:32,358 copying src/unitxt/catalog/cards/winogrande/m.json -> build/lib/unitxt/catalog/cards/winogrande 2026-05-27T11:53:32,360 creating build/lib/unitxt/catalog/cards/wmt 2026-05-27T11:53:32,361 copying src/unitxt/catalog/cards/wmt/en_fr.json -> build/lib/unitxt/catalog/cards/wmt 2026-05-27T11:53:32,364 copying src/unitxt/catalog/cards/wmt/en_ro.json -> build/lib/unitxt/catalog/cards/wmt 2026-05-27T11:53:32,366 copying src/unitxt/catalog/cards/wmt/en_de.json -> build/lib/unitxt/catalog/cards/wmt 2026-05-27T11:53:32,368 creating build/lib/unitxt/catalog/cards/tablebench_fact_checking 2026-05-27T11:53:32,369 copying src/unitxt/catalog/cards/tablebench_fact_checking/legacy.json -> build/lib/unitxt/catalog/cards/tablebench_fact_checking 2026-05-27T11:53:32,372 creating build/lib/unitxt/catalog/cards/tablebench_numerical_reasoning 2026-05-27T11:53:32,373 copying src/unitxt/catalog/cards/tablebench_numerical_reasoning/legacy.json -> build/lib/unitxt/catalog/cards/tablebench_numerical_reasoning 2026-05-27T11:53:32,375 creating build/lib/unitxt/catalog/cards/wnli 2026-05-27T11:53:32,376 copying src/unitxt/catalog/cards/wnli/truthfulness.json -> build/lib/unitxt/catalog/cards/wnli 2026-05-27T11:53:32,378 creating build/lib/unitxt/catalog/cards/rag 2026-05-27T11:53:32,380 copying src/unitxt/catalog/cards/rag/mtrag.json -> build/lib/unitxt/catalog/cards/rag 2026-05-27T11:53:32,382 creating build/lib/unitxt/catalog/cards/rag/documents/real_mm_rag_fin_report 2026-05-27T11:53:32,384 copying src/unitxt/catalog/cards/rag/documents/real_mm_rag_fin_report/en.json -> build/lib/unitxt/catalog/cards/rag/documents/real_mm_rag_fin_report 2026-05-27T11:53:32,386 creating build/lib/unitxt/catalog/cards/rag/documents/miniwiki 2026-05-27T11:53:32,387 copying src/unitxt/catalog/cards/rag/documents/miniwiki/en.json -> build/lib/unitxt/catalog/cards/rag/documents/miniwiki 2026-05-27T11:53:32,390 creating build/lib/unitxt/catalog/cards/rag/documents/real_mm_rag_fin_slides 2026-05-27T11:53:32,391 copying src/unitxt/catalog/cards/rag/documents/real_mm_rag_fin_slides/en.json -> build/lib/unitxt/catalog/cards/rag/documents/real_mm_rag_fin_slides 2026-05-27T11:53:32,393 creating build/lib/unitxt/catalog/cards/rag/documents/hotpotqa 2026-05-27T11:53:32,394 copying src/unitxt/catalog/cards/rag/documents/hotpotqa/en.json -> build/lib/unitxt/catalog/cards/rag/documents/hotpotqa 2026-05-27T11:53:32,396 creating build/lib/unitxt/catalog/cards/rag/documents/watsonxqa 2026-05-27T11:53:32,397 copying src/unitxt/catalog/cards/rag/documents/watsonxqa/en.json -> build/lib/unitxt/catalog/cards/rag/documents/watsonxqa 2026-05-27T11:53:32,400 creating build/lib/unitxt/catalog/cards/rag/documents/bioasq 2026-05-27T11:53:32,401 copying src/unitxt/catalog/cards/rag/documents/bioasq/en.json -> build/lib/unitxt/catalog/cards/rag/documents/bioasq 2026-05-27T11:53:32,403 creating build/lib/unitxt/catalog/cards/rag/documents/real_mm_rag_tech_slides 2026-05-27T11:53:32,404 copying src/unitxt/catalog/cards/rag/documents/real_mm_rag_tech_slides/en.json -> build/lib/unitxt/catalog/cards/rag/documents/real_mm_rag_tech_slides 2026-05-27T11:53:32,406 creating build/lib/unitxt/catalog/cards/rag/documents/real_mm_rag_tech_report 2026-05-27T11:53:32,407 copying src/unitxt/catalog/cards/rag/documents/real_mm_rag_tech_report/en.json -> build/lib/unitxt/catalog/cards/rag/documents/real_mm_rag_tech_report 2026-05-27T11:53:32,410 creating build/lib/unitxt/catalog/cards/rag/documents/clap_nq 2026-05-27T11:53:32,411 copying src/unitxt/catalog/cards/rag/documents/clap_nq/en.json -> build/lib/unitxt/catalog/cards/rag/documents/clap_nq 2026-05-27T11:53:32,413 creating build/lib/unitxt/catalog/cards/rag/benchmark/real_mm_rag_fin_report 2026-05-27T11:53:32,415 copying src/unitxt/catalog/cards/rag/benchmark/real_mm_rag_fin_report/en.json -> build/lib/unitxt/catalog/cards/rag/benchmark/real_mm_rag_fin_report 2026-05-27T11:53:32,417 creating build/lib/unitxt/catalog/cards/rag/benchmark/miniwiki 2026-05-27T11:53:32,418 copying src/unitxt/catalog/cards/rag/benchmark/miniwiki/en.json -> build/lib/unitxt/catalog/cards/rag/benchmark/miniwiki 2026-05-27T11:53:32,421 creating build/lib/unitxt/catalog/cards/rag/benchmark/real_mm_rag_fin_slides 2026-05-27T11:53:32,422 copying src/unitxt/catalog/cards/rag/benchmark/real_mm_rag_fin_slides/en.json -> build/lib/unitxt/catalog/cards/rag/benchmark/real_mm_rag_fin_slides 2026-05-27T11:53:32,424 creating build/lib/unitxt/catalog/cards/rag/benchmark/hotpotqa 2026-05-27T11:53:32,425 copying src/unitxt/catalog/cards/rag/benchmark/hotpotqa/en.json -> build/lib/unitxt/catalog/cards/rag/benchmark/hotpotqa 2026-05-27T11:53:32,428 creating build/lib/unitxt/catalog/cards/rag/benchmark/watsonxqa 2026-05-27T11:53:32,429 copying src/unitxt/catalog/cards/rag/benchmark/watsonxqa/en.json -> build/lib/unitxt/catalog/cards/rag/benchmark/watsonxqa 2026-05-27T11:53:32,431 creating build/lib/unitxt/catalog/cards/rag/benchmark/bioasq 2026-05-27T11:53:32,432 copying src/unitxt/catalog/cards/rag/benchmark/bioasq/en.json -> build/lib/unitxt/catalog/cards/rag/benchmark/bioasq 2026-05-27T11:53:32,434 creating build/lib/unitxt/catalog/cards/rag/benchmark/real_mm_rag_tech_slides 2026-05-27T11:53:32,435 copying src/unitxt/catalog/cards/rag/benchmark/real_mm_rag_tech_slides/en.json -> build/lib/unitxt/catalog/cards/rag/benchmark/real_mm_rag_tech_slides 2026-05-27T11:53:32,438 creating build/lib/unitxt/catalog/cards/rag/benchmark/real_mm_rag_tech_report 2026-05-27T11:53:32,439 copying src/unitxt/catalog/cards/rag/benchmark/real_mm_rag_tech_report/en.json -> build/lib/unitxt/catalog/cards/rag/benchmark/real_mm_rag_tech_report 2026-05-27T11:53:32,441 creating build/lib/unitxt/catalog/cards/rag/benchmark/clap_nq 2026-05-27T11:53:32,442 copying src/unitxt/catalog/cards/rag/benchmark/clap_nq/en.json -> build/lib/unitxt/catalog/cards/rag/benchmark/clap_nq 2026-05-27T11:53:32,445 creating build/lib/unitxt/catalog/cards/rag/response_generation 2026-05-27T11:53:32,446 copying src/unitxt/catalog/cards/rag/response_generation/clapnq.json -> build/lib/unitxt/catalog/cards/rag/response_generation 2026-05-27T11:53:32,448 creating build/lib/unitxt/catalog/cards/rag/response_generation/train 2026-05-27T11:53:32,449 copying src/unitxt/catalog/cards/rag/response_generation/train/open_australian_legal_qa.json -> build/lib/unitxt/catalog/cards/rag/response_generation/train 2026-05-27T11:53:32,452 copying src/unitxt/catalog/cards/rag/response_generation/train/clapnq.json -> build/lib/unitxt/catalog/cards/rag/response_generation/train 2026-05-27T11:53:32,454 creating build/lib/unitxt/catalog/cards/rag/response_generation/ragbench 2026-05-27T11:53:32,455 copying src/unitxt/catalog/cards/rag/response_generation/ragbench/expertqa.json -> build/lib/unitxt/catalog/cards/rag/response_generation/ragbench 2026-05-27T11:53:32,457 copying src/unitxt/catalog/cards/rag/response_generation/ragbench/cuad.json -> build/lib/unitxt/catalog/cards/rag/response_generation/ragbench 2026-05-27T11:53:32,460 copying src/unitxt/catalog/cards/rag/response_generation/ragbench/hotpotqa.json -> build/lib/unitxt/catalog/cards/rag/response_generation/ragbench 2026-05-27T11:53:32,462 copying src/unitxt/catalog/cards/rag/response_generation/ragbench/pubmedqa.json -> build/lib/unitxt/catalog/cards/rag/response_generation/ragbench 2026-05-27T11:53:32,464 copying src/unitxt/catalog/cards/rag/response_generation/ragbench/techqa.json -> build/lib/unitxt/catalog/cards/rag/response_generation/ragbench 2026-05-27T11:53:32,466 copying src/unitxt/catalog/cards/rag/response_generation/ragbench/hagrid.json -> build/lib/unitxt/catalog/cards/rag/response_generation/ragbench 2026-05-27T11:53:32,468 copying src/unitxt/catalog/cards/rag/response_generation/ragbench/msmarco.json -> build/lib/unitxt/catalog/cards/rag/response_generation/ragbench 2026-05-27T11:53:32,471 copying src/unitxt/catalog/cards/rag/response_generation/ragbench/delucionqa.json -> build/lib/unitxt/catalog/cards/rag/response_generation/ragbench 2026-05-27T11:53:32,473 copying src/unitxt/catalog/cards/rag/response_generation/ragbench/finqa.json -> build/lib/unitxt/catalog/cards/rag/response_generation/ragbench 2026-05-27T11:53:32,475 copying src/unitxt/catalog/cards/rag/response_generation/ragbench/covidqa.json -> build/lib/unitxt/catalog/cards/rag/response_generation/ragbench 2026-05-27T11:53:32,478 copying src/unitxt/catalog/cards/rag/response_generation/ragbench/tatqa.json -> build/lib/unitxt/catalog/cards/rag/response_generation/ragbench 2026-05-27T11:53:32,480 copying src/unitxt/catalog/cards/rag/response_generation/ragbench/emanual.json -> build/lib/unitxt/catalog/cards/rag/response_generation/ragbench 2026-05-27T11:53:32,482 creating build/lib/unitxt/catalog/cards/rag/response_generation/chat_rag_bench/train/user_assistant_format 2026-05-27T11:53:32,485 copying src/unitxt/catalog/cards/rag/response_generation/chat_rag_bench/train/user_assistant_format/doc2dial.json -> build/lib/unitxt/catalog/cards/rag/response_generation/chat_rag_bench/train/user_assistant_format 2026-05-27T11:53:32,487 copying src/unitxt/catalog/cards/rag/response_generation/chat_rag_bench/train/user_assistant_format/doqa_travel.json -> build/lib/unitxt/catalog/cards/rag/response_generation/chat_rag_bench/train/user_assistant_format 2026-05-27T11:53:32,489 copying src/unitxt/catalog/cards/rag/response_generation/chat_rag_bench/train/user_assistant_format/hybridial.json -> build/lib/unitxt/catalog/cards/rag/response_generation/chat_rag_bench/train/user_assistant_format 2026-05-27T11:53:32,492 copying src/unitxt/catalog/cards/rag/response_generation/chat_rag_bench/train/user_assistant_format/doqa_cooking.json -> build/lib/unitxt/catalog/cards/rag/response_generation/chat_rag_bench/train/user_assistant_format 2026-05-27T11:53:32,494 copying src/unitxt/catalog/cards/rag/response_generation/chat_rag_bench/train/user_assistant_format/doqa_movies.json -> build/lib/unitxt/catalog/cards/rag/response_generation/chat_rag_bench/train/user_assistant_format 2026-05-27T11:53:32,496 creating build/lib/unitxt/catalog/cards/rag/response_generation/chat_rag_bench/user_assistant_format 2026-05-27T11:53:32,497 copying src/unitxt/catalog/cards/rag/response_generation/chat_rag_bench/user_assistant_format/doc2dial.json -> build/lib/unitxt/catalog/cards/rag/response_generation/chat_rag_bench/user_assistant_format 2026-05-27T11:53:32,500 copying src/unitxt/catalog/cards/rag/response_generation/chat_rag_bench/user_assistant_format/doqa_travel.json -> build/lib/unitxt/catalog/cards/rag/response_generation/chat_rag_bench/user_assistant_format 2026-05-27T11:53:32,502 copying src/unitxt/catalog/cards/rag/response_generation/chat_rag_bench/user_assistant_format/hybridial.json -> build/lib/unitxt/catalog/cards/rag/response_generation/chat_rag_bench/user_assistant_format 2026-05-27T11:53:32,504 copying src/unitxt/catalog/cards/rag/response_generation/chat_rag_bench/user_assistant_format/doqa_cooking.json -> build/lib/unitxt/catalog/cards/rag/response_generation/chat_rag_bench/user_assistant_format 2026-05-27T11:53:32,506 copying src/unitxt/catalog/cards/rag/response_generation/chat_rag_bench/user_assistant_format/doqa_movies.json -> build/lib/unitxt/catalog/cards/rag/response_generation/chat_rag_bench/user_assistant_format 2026-05-27T11:53:32,509 creating build/lib/unitxt/catalog/cards/rag/mtrag/documents 2026-05-27T11:53:32,510 copying src/unitxt/catalog/cards/rag/mtrag/documents/fiqa.json -> build/lib/unitxt/catalog/cards/rag/mtrag/documents 2026-05-27T11:53:32,513 copying src/unitxt/catalog/cards/rag/mtrag/documents/clapnq.json -> build/lib/unitxt/catalog/cards/rag/mtrag/documents 2026-05-27T11:53:32,515 copying src/unitxt/catalog/cards/rag/mtrag/documents/cloud.json -> build/lib/unitxt/catalog/cards/rag/mtrag/documents 2026-05-27T11:53:32,517 copying src/unitxt/catalog/cards/rag/mtrag/documents/govt.json -> build/lib/unitxt/catalog/cards/rag/mtrag/documents 2026-05-27T11:53:32,519 creating build/lib/unitxt/catalog/cards/CFPB/product 2026-05-27T11:53:32,521 copying src/unitxt/catalog/cards/CFPB/product/watsonx.json -> build/lib/unitxt/catalog/cards/CFPB/product 2026-05-27T11:53:32,524 copying src/unitxt/catalog/cards/CFPB/product/2023.json -> build/lib/unitxt/catalog/cards/CFPB/product 2026-05-27T11:53:32,526 creating build/lib/unitxt/catalog/cards/mmlu 2026-05-27T11:53:32,527 copying src/unitxt/catalog/cards/mmlu/moral_disputes.json -> build/lib/unitxt/catalog/cards/mmlu 2026-05-27T11:53:32,529 copying src/unitxt/catalog/cards/mmlu/high_school_biology.json -> build/lib/unitxt/catalog/cards/mmlu 2026-05-27T11:53:32,532 copying src/unitxt/catalog/cards/mmlu/jurisprudence.json -> build/lib/unitxt/catalog/cards/mmlu 2026-05-27T11:53:32,534 copying src/unitxt/catalog/cards/mmlu/logical_fallacies.json -> build/lib/unitxt/catalog/cards/mmlu 2026-05-27T11:53:32,537 copying src/unitxt/catalog/cards/mmlu/college_chemistry.json -> build/lib/unitxt/catalog/cards/mmlu 2026-05-27T11:53:32,539 copying src/unitxt/catalog/cards/mmlu/high_school_government_and_politics.json -> build/lib/unitxt/catalog/cards/mmlu 2026-05-27T11:53:32,541 copying src/unitxt/catalog/cards/mmlu/college_mathematics.json -> build/lib/unitxt/catalog/cards/mmlu 2026-05-27T11:53:32,543 copying src/unitxt/catalog/cards/mmlu/econometrics.json -> build/lib/unitxt/catalog/cards/mmlu 2026-05-27T11:53:32,546 copying src/unitxt/catalog/cards/mmlu/high_school_macroeconomics.json -> build/lib/unitxt/catalog/cards/mmlu 2026-05-27T11:53:32,548 copying src/unitxt/catalog/cards/mmlu/high_school_psychology.json -> build/lib/unitxt/catalog/cards/mmlu 2026-05-27T11:53:32,550 copying src/unitxt/catalog/cards/mmlu/computer_security.json -> build/lib/unitxt/catalog/cards/mmlu 2026-05-27T11:53:32,553 copying src/unitxt/catalog/cards/mmlu/sociology.json -> build/lib/unitxt/catalog/cards/mmlu 2026-05-27T11:53:32,555 copying src/unitxt/catalog/cards/mmlu/nutrition.json -> build/lib/unitxt/catalog/cards/mmlu 2026-05-27T11:53:32,557 copying src/unitxt/catalog/cards/mmlu/professional_medicine.json -> build/lib/unitxt/catalog/cards/mmlu 2026-05-27T11:53:32,560 copying src/unitxt/catalog/cards/mmlu/college_biology.json -> build/lib/unitxt/catalog/cards/mmlu 2026-05-27T11:53:32,562 copying src/unitxt/catalog/cards/mmlu/anatomy.json -> build/lib/unitxt/catalog/cards/mmlu 2026-05-27T11:53:32,564 copying src/unitxt/catalog/cards/mmlu/professional_law.json -> build/lib/unitxt/catalog/cards/mmlu 2026-05-27T11:53:32,566 copying src/unitxt/catalog/cards/mmlu/machine_learning.json -> build/lib/unitxt/catalog/cards/mmlu 2026-05-27T11:53:32,569 copying src/unitxt/catalog/cards/mmlu/international_law.json -> build/lib/unitxt/catalog/cards/mmlu 2026-05-27T11:53:32,571 copying src/unitxt/catalog/cards/mmlu/medical_genetics.json -> build/lib/unitxt/catalog/cards/mmlu 2026-05-27T11:53:32,573 copying src/unitxt/catalog/cards/mmlu/high_school_computer_science.json -> build/lib/unitxt/catalog/cards/mmlu 2026-05-27T11:53:32,575 copying src/unitxt/catalog/cards/mmlu/clinical_knowledge.json -> build/lib/unitxt/catalog/cards/mmlu 2026-05-27T11:53:32,578 copying src/unitxt/catalog/cards/mmlu/college_physics.json -> build/lib/unitxt/catalog/cards/mmlu 2026-05-27T11:53:32,580 copying src/unitxt/catalog/cards/mmlu/global_facts.json -> build/lib/unitxt/catalog/cards/mmlu 2026-05-27T11:53:32,582 copying src/unitxt/catalog/cards/mmlu/college_computer_science.json -> build/lib/unitxt/catalog/cards/mmlu 2026-05-27T11:53:32,585 copying src/unitxt/catalog/cards/mmlu/us_foreign_policy.json -> build/lib/unitxt/catalog/cards/mmlu 2026-05-27T11:53:32,587 copying src/unitxt/catalog/cards/mmlu/professional_accounting.json -> build/lib/unitxt/catalog/cards/mmlu 2026-05-27T11:53:32,589 copying src/unitxt/catalog/cards/mmlu/professional_psychology.json -> build/lib/unitxt/catalog/cards/mmlu 2026-05-27T11:53:32,591 copying src/unitxt/catalog/cards/mmlu/philosophy.json -> build/lib/unitxt/catalog/cards/mmlu 2026-05-27T11:53:32,594 copying src/unitxt/catalog/cards/mmlu/elementary_mathematics.json -> build/lib/unitxt/catalog/cards/mmlu 2026-05-27T11:53:32,596 copying src/unitxt/catalog/cards/mmlu/conceptual_physics.json -> build/lib/unitxt/catalog/cards/mmlu 2026-05-27T11:53:32,599 copying src/unitxt/catalog/cards/mmlu/high_school_geography.json -> build/lib/unitxt/catalog/cards/mmlu 2026-05-27T11:53:32,602 copying src/unitxt/catalog/cards/mmlu/human_aging.json -> build/lib/unitxt/catalog/cards/mmlu 2026-05-27T11:53:32,605 copying src/unitxt/catalog/cards/mmlu/electrical_engineering.json -> build/lib/unitxt/catalog/cards/mmlu 2026-05-27T11:53:32,608 copying src/unitxt/catalog/cards/mmlu/management.json -> build/lib/unitxt/catalog/cards/mmlu 2026-05-27T11:53:32,610 copying src/unitxt/catalog/cards/mmlu/high_school_world_history.json -> build/lib/unitxt/catalog/cards/mmlu 2026-05-27T11:53:32,612 copying src/unitxt/catalog/cards/mmlu/marketing.json -> build/lib/unitxt/catalog/cards/mmlu 2026-05-27T11:53:32,615 copying src/unitxt/catalog/cards/mmlu/high_school_european_history.json -> build/lib/unitxt/catalog/cards/mmlu 2026-05-27T11:53:32,617 copying src/unitxt/catalog/cards/mmlu/astronomy.json -> build/lib/unitxt/catalog/cards/mmlu 2026-05-27T11:53:32,620 copying src/unitxt/catalog/cards/mmlu/high_school_physics.json -> build/lib/unitxt/catalog/cards/mmlu 2026-05-27T11:53:32,622 copying src/unitxt/catalog/cards/mmlu/public_relations.json -> build/lib/unitxt/catalog/cards/mmlu 2026-05-27T11:53:32,624 copying src/unitxt/catalog/cards/mmlu/high_school_microeconomics.json -> build/lib/unitxt/catalog/cards/mmlu 2026-05-27T11:53:32,627 copying src/unitxt/catalog/cards/mmlu/virology.json -> build/lib/unitxt/catalog/cards/mmlu 2026-05-27T11:53:32,629 copying src/unitxt/catalog/cards/mmlu/high_school_us_history.json -> build/lib/unitxt/catalog/cards/mmlu 2026-05-27T11:53:32,631 copying src/unitxt/catalog/cards/mmlu/high_school_statistics.json -> build/lib/unitxt/catalog/cards/mmlu 2026-05-27T11:53:32,634 copying src/unitxt/catalog/cards/mmlu/miscellaneous.json -> build/lib/unitxt/catalog/cards/mmlu 2026-05-27T11:53:32,636 copying src/unitxt/catalog/cards/mmlu/high_school_mathematics.json -> build/lib/unitxt/catalog/cards/mmlu 2026-05-27T11:53:32,638 copying src/unitxt/catalog/cards/mmlu/formal_logic.json -> build/lib/unitxt/catalog/cards/mmlu 2026-05-27T11:53:32,640 copying src/unitxt/catalog/cards/mmlu/high_school_chemistry.json -> build/lib/unitxt/catalog/cards/mmlu 2026-05-27T11:53:32,643 copying src/unitxt/catalog/cards/mmlu/abstract_algebra.json -> build/lib/unitxt/catalog/cards/mmlu 2026-05-27T11:53:32,645 copying src/unitxt/catalog/cards/mmlu/moral_scenarios.json -> build/lib/unitxt/catalog/cards/mmlu 2026-05-27T11:53:32,647 copying src/unitxt/catalog/cards/mmlu/world_religions.json -> build/lib/unitxt/catalog/cards/mmlu 2026-05-27T11:53:32,650 copying src/unitxt/catalog/cards/mmlu/business_ethics.json -> build/lib/unitxt/catalog/cards/mmlu 2026-05-27T11:53:32,652 copying src/unitxt/catalog/cards/mmlu/security_studies.json -> build/lib/unitxt/catalog/cards/mmlu 2026-05-27T11:53:32,654 copying src/unitxt/catalog/cards/mmlu/college_medicine.json -> build/lib/unitxt/catalog/cards/mmlu 2026-05-27T11:53:32,656 copying src/unitxt/catalog/cards/mmlu/human_sexuality.json -> build/lib/unitxt/catalog/cards/mmlu 2026-05-27T11:53:32,659 copying src/unitxt/catalog/cards/mmlu/prehistory.json -> build/lib/unitxt/catalog/cards/mmlu 2026-05-27T11:53:32,661 creating build/lib/unitxt/catalog/cards/coqa 2026-05-27T11:53:32,662 copying src/unitxt/catalog/cards/coqa/qa.json -> build/lib/unitxt/catalog/cards/coqa 2026-05-27T11:53:32,664 copying src/unitxt/catalog/cards/coqa/multi_turn.json -> build/lib/unitxt/catalog/cards/coqa 2026-05-27T11:53:32,667 copying src/unitxt/catalog/cards/coqa/completion.json -> build/lib/unitxt/catalog/cards/coqa 2026-05-27T11:53:32,669 creating build/lib/unitxt/catalog/cards/belebele 2026-05-27T11:53:32,670 copying src/unitxt/catalog/cards/belebele/sun_latn.json -> build/lib/unitxt/catalog/cards/belebele 2026-05-27T11:53:32,672 copying src/unitxt/catalog/cards/belebele/lit_latn.json -> build/lib/unitxt/catalog/cards/belebele 2026-05-27T11:53:32,675 copying src/unitxt/catalog/cards/belebele/ron_latn.json -> build/lib/unitxt/catalog/cards/belebele 2026-05-27T11:53:32,677 copying src/unitxt/catalog/cards/belebele/pes_arab.json -> build/lib/unitxt/catalog/cards/belebele 2026-05-27T11:53:32,680 copying src/unitxt/catalog/cards/belebele/kor_hang.json -> build/lib/unitxt/catalog/cards/belebele 2026-05-27T11:53:32,682 copying src/unitxt/catalog/cards/belebele/tso_latn.json -> build/lib/unitxt/catalog/cards/belebele 2026-05-27T11:53:32,684 copying src/unitxt/catalog/cards/belebele/asm_beng.json -> build/lib/unitxt/catalog/cards/belebele 2026-05-27T11:53:32,687 copying src/unitxt/catalog/cards/belebele/sin_latn.json -> build/lib/unitxt/catalog/cards/belebele 2026-05-27T11:53:32,689 copying src/unitxt/catalog/cards/belebele/bod_tibt.json -> build/lib/unitxt/catalog/cards/belebele 2026-05-27T11:53:32,691 copying src/unitxt/catalog/cards/belebele/hrv_latn.json -> build/lib/unitxt/catalog/cards/belebele 2026-05-27T11:53:32,694 copying src/unitxt/catalog/cards/belebele/kan_knda.json -> build/lib/unitxt/catalog/cards/belebele 2026-05-27T11:53:32,696 copying src/unitxt/catalog/cards/belebele/ita_latn.json -> build/lib/unitxt/catalog/cards/belebele 2026-05-27T11:53:32,699 copying src/unitxt/catalog/cards/belebele/arb_arab.json -> build/lib/unitxt/catalog/cards/belebele 2026-05-27T11:53:32,701 copying src/unitxt/catalog/cards/belebele/deu_latn.json -> build/lib/unitxt/catalog/cards/belebele 2026-05-27T11:53:32,703 copying src/unitxt/catalog/cards/belebele/apc_arab.json -> build/lib/unitxt/catalog/cards/belebele 2026-05-27T11:53:32,706 copying src/unitxt/catalog/cards/belebele/kac_latn.json -> build/lib/unitxt/catalog/cards/belebele 2026-05-27T11:53:32,708 copying src/unitxt/catalog/cards/belebele/sin_sinh.json -> build/lib/unitxt/catalog/cards/belebele 2026-05-27T11:53:32,710 copying src/unitxt/catalog/cards/belebele/pbt_arab.json -> build/lib/unitxt/catalog/cards/belebele 2026-05-27T11:53:32,713 copying src/unitxt/catalog/cards/belebele/lug_latn.json -> build/lib/unitxt/catalog/cards/belebele 2026-05-27T11:53:32,715 copying src/unitxt/catalog/cards/belebele/spa_latn.json -> build/lib/unitxt/catalog/cards/belebele 2026-05-27T11:53:32,717 copying src/unitxt/catalog/cards/belebele/slk_latn.json -> build/lib/unitxt/catalog/cards/belebele 2026-05-27T11:53:32,720 copying src/unitxt/catalog/cards/belebele/urd_latn.json -> build/lib/unitxt/catalog/cards/belebele 2026-05-27T11:53:32,722 copying src/unitxt/catalog/cards/belebele/nya_latn.json -> build/lib/unitxt/catalog/cards/belebele 2026-05-27T11:53:32,724 copying src/unitxt/catalog/cards/belebele/dan_latn.json -> build/lib/unitxt/catalog/cards/belebele 2026-05-27T11:53:32,727 copying src/unitxt/catalog/cards/belebele/hye_armn.json -> build/lib/unitxt/catalog/cards/belebele 2026-05-27T11:53:32,729 copying src/unitxt/catalog/cards/belebele/sna_latn.json -> build/lib/unitxt/catalog/cards/belebele 2026-05-27T11:53:32,731 copying src/unitxt/catalog/cards/belebele/mri_latn.json -> build/lib/unitxt/catalog/cards/belebele 2026-05-27T11:53:32,733 copying src/unitxt/catalog/cards/belebele/cat_latn.json -> build/lib/unitxt/catalog/cards/belebele 2026-05-27T11:53:32,736 copying src/unitxt/catalog/cards/belebele/urd_arab.json -> build/lib/unitxt/catalog/cards/belebele 2026-05-27T11:53:32,738 copying src/unitxt/catalog/cards/belebele/kir_cyrl.json -> build/lib/unitxt/catalog/cards/belebele 2026-05-27T11:53:32,740 copying src/unitxt/catalog/cards/belebele/tgk_cyrl.json -> build/lib/unitxt/catalog/cards/belebele 2026-05-27T11:53:32,742 copying src/unitxt/catalog/cards/belebele/khk_cyrl.json -> build/lib/unitxt/catalog/cards/belebele 2026-05-27T11:53:32,745 copying src/unitxt/catalog/cards/belebele/ben_latn.json -> build/lib/unitxt/catalog/cards/belebele 2026-05-27T11:53:32,747 copying src/unitxt/catalog/cards/belebele/tam_taml.json -> build/lib/unitxt/catalog/cards/belebele 2026-05-27T11:53:32,749 copying src/unitxt/catalog/cards/belebele/jav_latn.json -> build/lib/unitxt/catalog/cards/belebele 2026-05-27T11:53:32,751 copying src/unitxt/catalog/cards/belebele/fra_latn.json -> build/lib/unitxt/catalog/cards/belebele 2026-05-27T11:53:32,753 copying src/unitxt/catalog/cards/belebele/ary_arab.json -> build/lib/unitxt/catalog/cards/belebele 2026-05-27T11:53:32,756 copying src/unitxt/catalog/cards/belebele/afr_latn.json -> build/lib/unitxt/catalog/cards/belebele 2026-05-27T11:53:32,758 copying src/unitxt/catalog/cards/belebele/plt_latn.json -> build/lib/unitxt/catalog/cards/belebele 2026-05-27T11:53:32,760 copying src/unitxt/catalog/cards/belebele/hat_latn.json -> build/lib/unitxt/catalog/cards/belebele 2026-05-27T11:53:32,762 copying src/unitxt/catalog/cards/belebele/war_latn.json -> build/lib/unitxt/catalog/cards/belebele 2026-05-27T11:53:32,764 copying src/unitxt/catalog/cards/belebele/kaz_cyrl.json -> build/lib/unitxt/catalog/cards/belebele 2026-05-27T11:53:32,767 copying src/unitxt/catalog/cards/belebele/ceb_latn.json -> build/lib/unitxt/catalog/cards/belebele 2026-05-27T11:53:32,769 copying src/unitxt/catalog/cards/belebele/eus_latn.json -> build/lib/unitxt/catalog/cards/belebele 2026-05-27T11:53:32,771 copying src/unitxt/catalog/cards/belebele/tir_ethi.json -> build/lib/unitxt/catalog/cards/belebele 2026-05-27T11:53:32,773 copying src/unitxt/catalog/cards/belebele/kea_latn.json -> build/lib/unitxt/catalog/cards/belebele 2026-05-27T11:53:32,775 copying src/unitxt/catalog/cards/belebele/fuv_latn.json -> build/lib/unitxt/catalog/cards/belebele 2026-05-27T11:53:32,778 copying src/unitxt/catalog/cards/belebele/mkd_cyrl.json -> build/lib/unitxt/catalog/cards/belebele 2026-05-27T11:53:32,780 copying src/unitxt/catalog/cards/belebele/ilo_latn.json -> build/lib/unitxt/catalog/cards/belebele 2026-05-27T11:53:32,782 copying src/unitxt/catalog/cards/belebele/khm_khmr.json -> build/lib/unitxt/catalog/cards/belebele 2026-05-27T11:53:32,784 copying src/unitxt/catalog/cards/belebele/srp_cyrl.json -> build/lib/unitxt/catalog/cards/belebele 2026-05-27T11:53:32,786 copying src/unitxt/catalog/cards/belebele/zho_hant.json -> build/lib/unitxt/catalog/cards/belebele 2026-05-27T11:53:32,788 copying src/unitxt/catalog/cards/belebele/lvs_latn.json -> build/lib/unitxt/catalog/cards/belebele 2026-05-27T11:53:32,790 copying src/unitxt/catalog/cards/belebele/snd_arab.json -> build/lib/unitxt/catalog/cards/belebele 2026-05-27T11:53:32,793 copying src/unitxt/catalog/cards/belebele/lin_latn.json -> build/lib/unitxt/catalog/cards/belebele 2026-05-27T11:53:32,795 copying src/unitxt/catalog/cards/belebele/slv_latn.json -> build/lib/unitxt/catalog/cards/belebele 2026-05-27T11:53:32,797 copying src/unitxt/catalog/cards/belebele/nob_latn.json -> build/lib/unitxt/catalog/cards/belebele 2026-05-27T11:53:32,799 copying src/unitxt/catalog/cards/belebele/ukr_cyrl.json -> build/lib/unitxt/catalog/cards/belebele 2026-05-27T11:53:32,801 copying src/unitxt/catalog/cards/belebele/swe_latn.json -> build/lib/unitxt/catalog/cards/belebele 2026-05-27T11:53:32,803 copying src/unitxt/catalog/cards/belebele/ory_orya.json -> build/lib/unitxt/catalog/cards/belebele 2026-05-27T11:53:32,805 copying src/unitxt/catalog/cards/belebele/ssw_latn.json -> build/lib/unitxt/catalog/cards/belebele 2026-05-27T11:53:32,808 copying src/unitxt/catalog/cards/belebele/tsn_latn.json -> build/lib/unitxt/catalog/cards/belebele 2026-05-27T11:53:32,810 copying src/unitxt/catalog/cards/belebele/mya_mymr.json -> build/lib/unitxt/catalog/cards/belebele 2026-05-27T11:53:32,812 copying src/unitxt/catalog/cards/belebele/pol_latn.json -> build/lib/unitxt/catalog/cards/belebele 2026-05-27T11:53:32,814 copying src/unitxt/catalog/cards/belebele/tel_telu.json -> build/lib/unitxt/catalog/cards/belebele 2026-05-27T11:53:32,816 copying src/unitxt/catalog/cards/belebele/xho_latn.json -> build/lib/unitxt/catalog/cards/belebele 2026-05-27T11:53:32,819 copying src/unitxt/catalog/cards/belebele/shn_mymr.json -> build/lib/unitxt/catalog/cards/belebele 2026-05-27T11:53:32,821 copying src/unitxt/catalog/cards/belebele/ben_beng.json -> build/lib/unitxt/catalog/cards/belebele 2026-05-27T11:53:32,823 copying src/unitxt/catalog/cards/belebele/mar_deva.json -> build/lib/unitxt/catalog/cards/belebele 2026-05-27T11:53:32,825 copying src/unitxt/catalog/cards/belebele/hau_latn.json -> build/lib/unitxt/catalog/cards/belebele 2026-05-27T11:53:32,828 copying src/unitxt/catalog/cards/belebele/hin_latn.json -> build/lib/unitxt/catalog/cards/belebele 2026-05-27T11:53:32,830 copying src/unitxt/catalog/cards/belebele/npi_deva.json -> build/lib/unitxt/catalog/cards/belebele 2026-05-27T11:53:32,832 copying src/unitxt/catalog/cards/belebele/wol_latn.json -> build/lib/unitxt/catalog/cards/belebele 2026-05-27T11:53:32,834 copying src/unitxt/catalog/cards/belebele/pan_guru.json -> build/lib/unitxt/catalog/cards/belebele 2026-05-27T11:53:32,836 copying src/unitxt/catalog/cards/belebele/ell_grek.json -> build/lib/unitxt/catalog/cards/belebele 2026-05-27T11:53:32,839 copying src/unitxt/catalog/cards/belebele/kat_geor.json -> build/lib/unitxt/catalog/cards/belebele 2026-05-27T11:53:32,841 copying src/unitxt/catalog/cards/belebele/ckb_arab.json -> build/lib/unitxt/catalog/cards/belebele 2026-05-27T11:53:32,843 copying src/unitxt/catalog/cards/belebele/tgl_latn.json -> build/lib/unitxt/catalog/cards/belebele 2026-05-27T11:53:32,845 copying src/unitxt/catalog/cards/belebele/kin_latn.json -> build/lib/unitxt/catalog/cards/belebele 2026-05-27T11:53:32,847 copying src/unitxt/catalog/cards/belebele/hun_latn.json -> build/lib/unitxt/catalog/cards/belebele 2026-05-27T11:53:32,849 copying src/unitxt/catalog/cards/belebele/azj_latn.json -> build/lib/unitxt/catalog/cards/belebele 2026-05-27T11:53:32,852 copying src/unitxt/catalog/cards/belebele/rus_cyrl.json -> build/lib/unitxt/catalog/cards/belebele 2026-05-27T11:53:32,854 copying src/unitxt/catalog/cards/belebele/bul_cyrl.json -> build/lib/unitxt/catalog/cards/belebele 2026-05-27T11:53:32,856 copying src/unitxt/catalog/cards/belebele/vie_latn.json -> build/lib/unitxt/catalog/cards/belebele 2026-05-27T11:53:32,858 copying src/unitxt/catalog/cards/belebele/nso_latn.json -> build/lib/unitxt/catalog/cards/belebele 2026-05-27T11:53:32,860 copying src/unitxt/catalog/cards/belebele/nld_latn.json -> build/lib/unitxt/catalog/cards/belebele 2026-05-27T11:53:32,862 copying src/unitxt/catalog/cards/belebele/grn_latn.json -> build/lib/unitxt/catalog/cards/belebele 2026-05-27T11:53:32,864 copying src/unitxt/catalog/cards/belebele/yor_latn.json -> build/lib/unitxt/catalog/cards/belebele 2026-05-27T11:53:32,866 copying src/unitxt/catalog/cards/belebele/uzn_latn.json -> build/lib/unitxt/catalog/cards/belebele 2026-05-27T11:53:32,868 copying src/unitxt/catalog/cards/belebele/npi_latn.json -> build/lib/unitxt/catalog/cards/belebele 2026-05-27T11:53:32,870 copying src/unitxt/catalog/cards/belebele/amh_ethi.json -> build/lib/unitxt/catalog/cards/belebele 2026-05-27T11:53:32,873 copying src/unitxt/catalog/cards/belebele/ces_latn.json -> build/lib/unitxt/catalog/cards/belebele 2026-05-27T11:53:32,875 copying src/unitxt/catalog/cards/belebele/som_latn.json -> build/lib/unitxt/catalog/cards/belebele 2026-05-27T11:53:32,877 copying src/unitxt/catalog/cards/belebele/est_latn.json -> build/lib/unitxt/catalog/cards/belebele 2026-05-27T11:53:32,879 copying src/unitxt/catalog/cards/belebele/jpn_jpan.json -> build/lib/unitxt/catalog/cards/belebele 2026-05-27T11:53:32,881 copying src/unitxt/catalog/cards/belebele/arz_arab.json -> build/lib/unitxt/catalog/cards/belebele 2026-05-27T11:53:32,883 copying src/unitxt/catalog/cards/belebele/por_latn.json -> build/lib/unitxt/catalog/cards/belebele 2026-05-27T11:53:32,886 copying src/unitxt/catalog/cards/belebele/mlt_latn.json -> build/lib/unitxt/catalog/cards/belebele 2026-05-27T11:53:32,888 copying src/unitxt/catalog/cards/belebele/ind_latn.json -> build/lib/unitxt/catalog/cards/belebele 2026-05-27T11:53:32,890 copying src/unitxt/catalog/cards/belebele/als_latn.json -> build/lib/unitxt/catalog/cards/belebele 2026-05-27T11:53:32,892 copying src/unitxt/catalog/cards/belebele/luo_latn.json -> build/lib/unitxt/catalog/cards/belebele 2026-05-27T11:53:32,894 copying src/unitxt/catalog/cards/belebele/eng_latn.json -> build/lib/unitxt/catalog/cards/belebele 2026-05-27T11:53:32,897 copying src/unitxt/catalog/cards/belebele/bam_latn.json -> build/lib/unitxt/catalog/cards/belebele 2026-05-27T11:53:32,899 copying src/unitxt/catalog/cards/belebele/mal_mlym.json -> build/lib/unitxt/catalog/cards/belebele 2026-05-27T11:53:32,901 copying src/unitxt/catalog/cards/belebele/heb_hebr.json -> build/lib/unitxt/catalog/cards/belebele 2026-05-27T11:53:32,903 copying src/unitxt/catalog/cards/belebele/zul_latn.json -> build/lib/unitxt/catalog/cards/belebele 2026-05-27T11:53:32,906 copying src/unitxt/catalog/cards/belebele/ars_arab.json -> build/lib/unitxt/catalog/cards/belebele 2026-05-27T11:53:32,908 copying src/unitxt/catalog/cards/belebele/guj_gujr.json -> build/lib/unitxt/catalog/cards/belebele 2026-05-27T11:53:32,910 copying src/unitxt/catalog/cards/belebele/arb_latn.json -> build/lib/unitxt/catalog/cards/belebele 2026-05-27T11:53:32,912 copying src/unitxt/catalog/cards/belebele/isl_latn.json -> build/lib/unitxt/catalog/cards/belebele 2026-05-27T11:53:32,914 copying src/unitxt/catalog/cards/belebele/fin_latn.json -> build/lib/unitxt/catalog/cards/belebele 2026-05-27T11:53:32,917 copying src/unitxt/catalog/cards/belebele/zsm_latn.json -> build/lib/unitxt/catalog/cards/belebele 2026-05-27T11:53:32,919 copying src/unitxt/catalog/cards/belebele/ibo_latn.json -> build/lib/unitxt/catalog/cards/belebele 2026-05-27T11:53:32,921 copying src/unitxt/catalog/cards/belebele/tur_latn.json -> build/lib/unitxt/catalog/cards/belebele 2026-05-27T11:53:32,923 copying src/unitxt/catalog/cards/belebele/sot_latn.json -> build/lib/unitxt/catalog/cards/belebele 2026-05-27T11:53:32,925 copying src/unitxt/catalog/cards/belebele/tha_thai.json -> build/lib/unitxt/catalog/cards/belebele 2026-05-27T11:53:32,928 copying src/unitxt/catalog/cards/belebele/zho_hans.json -> build/lib/unitxt/catalog/cards/belebele 2026-05-27T11:53:32,930 copying src/unitxt/catalog/cards/belebele/acm_arab.json -> build/lib/unitxt/catalog/cards/belebele 2026-05-27T11:53:32,932 copying src/unitxt/catalog/cards/belebele/lao_laoo.json -> build/lib/unitxt/catalog/cards/belebele 2026-05-27T11:53:32,934 copying src/unitxt/catalog/cards/belebele/swh_latn.json -> build/lib/unitxt/catalog/cards/belebele 2026-05-27T11:53:32,936 copying src/unitxt/catalog/cards/belebele/hin_deva.json -> build/lib/unitxt/catalog/cards/belebele 2026-05-27T11:53:32,938 copying src/unitxt/catalog/cards/belebele/gaz_latn.json -> build/lib/unitxt/catalog/cards/belebele 2026-05-27T11:53:32,940 creating build/lib/unitxt/catalog/cards/dynamic_cards_for_llm_judges/pairwise_comparative_rating 2026-05-27T11:53:32,942 copying src/unitxt/catalog/cards/dynamic_cards_for_llm_judges/pairwise_comparative_rating/single_turn.json -> build/lib/unitxt/catalog/cards/dynamic_cards_for_llm_judges/pairwise_comparative_rating 2026-05-27T11:53:32,944 creating build/lib/unitxt/catalog/cards/dynamic_cards_for_llm_judges/rating 2026-05-27T11:53:32,945 copying src/unitxt/catalog/cards/dynamic_cards_for_llm_judges/rating/single_turn.json -> build/lib/unitxt/catalog/cards/dynamic_cards_for_llm_judges/rating 2026-05-27T11:53:32,947 copying src/unitxt/catalog/cards/dynamic_cards_for_llm_judges/rating/single_turn_with_reference.json -> build/lib/unitxt/catalog/cards/dynamic_cards_for_llm_judges/rating 2026-05-27T11:53:32,949 creating build/lib/unitxt/catalog/cards/safety 2026-05-27T11:53:32,950 copying src/unitxt/catalog/cards/safety/simple_safety_tests.json -> build/lib/unitxt/catalog/cards/safety 2026-05-27T11:53:32,953 copying src/unitxt/catalog/cards/safety/mlcommons_ailuminate.json -> build/lib/unitxt/catalog/cards/safety 2026-05-27T11:53:32,955 copying src/unitxt/catalog/cards/safety/airbench2024.json -> build/lib/unitxt/catalog/cards/safety 2026-05-27T11:53:32,957 copying src/unitxt/catalog/cards/safety/provoq.json -> build/lib/unitxt/catalog/cards/safety 2026-05-27T11:53:32,959 copying src/unitxt/catalog/cards/safety/truthful_qa.json -> build/lib/unitxt/catalog/cards/safety 2026-05-27T11:53:32,961 copying src/unitxt/catalog/cards/safety/xstest.json -> build/lib/unitxt/catalog/cards/safety 2026-05-27T11:53:32,963 creating build/lib/unitxt/catalog/cards/safety/discrim_eval 2026-05-27T11:53:32,964 copying src/unitxt/catalog/cards/safety/discrim_eval/implicit.json -> build/lib/unitxt/catalog/cards/safety/discrim_eval 2026-05-27T11:53:32,967 copying src/unitxt/catalog/cards/safety/discrim_eval/explicit.json -> build/lib/unitxt/catalog/cards/safety/discrim_eval 2026-05-27T11:53:32,969 creating build/lib/unitxt/catalog/cards/safety/bbq 2026-05-27T11:53:32,970 copying src/unitxt/catalog/cards/safety/bbq/Disability_status.json -> build/lib/unitxt/catalog/cards/safety/bbq 2026-05-27T11:53:32,972 copying src/unitxt/catalog/cards/safety/bbq/Race_x_gender.json -> build/lib/unitxt/catalog/cards/safety/bbq 2026-05-27T11:53:32,975 copying src/unitxt/catalog/cards/safety/bbq/Nationality.json -> build/lib/unitxt/catalog/cards/safety/bbq 2026-05-27T11:53:32,977 copying src/unitxt/catalog/cards/safety/bbq/Race_x_SES.json -> build/lib/unitxt/catalog/cards/safety/bbq 2026-05-27T11:53:32,979 copying src/unitxt/catalog/cards/safety/bbq/Physical_appearance.json -> build/lib/unitxt/catalog/cards/safety/bbq 2026-05-27T11:53:32,981 copying src/unitxt/catalog/cards/safety/bbq/Sexual_orientation.json -> build/lib/unitxt/catalog/cards/safety/bbq 2026-05-27T11:53:32,983 copying src/unitxt/catalog/cards/safety/bbq/SES.json -> build/lib/unitxt/catalog/cards/safety/bbq 2026-05-27T11:53:32,985 copying src/unitxt/catalog/cards/safety/bbq/Race_ethnicity.json -> build/lib/unitxt/catalog/cards/safety/bbq 2026-05-27T11:53:32,988 copying src/unitxt/catalog/cards/safety/bbq/Religion.json -> build/lib/unitxt/catalog/cards/safety/bbq 2026-05-27T11:53:32,990 copying src/unitxt/catalog/cards/safety/bbq/Age.json -> build/lib/unitxt/catalog/cards/safety/bbq 2026-05-27T11:53:32,992 copying src/unitxt/catalog/cards/safety/bbq/Gender_identity.json -> build/lib/unitxt/catalog/cards/safety/bbq 2026-05-27T11:53:32,994 creating build/lib/unitxt/catalog/cards/tablebench_data_analysis 2026-05-27T11:53:32,995 copying src/unitxt/catalog/cards/tablebench_data_analysis/legacy.json -> build/lib/unitxt/catalog/cards/tablebench_data_analysis 2026-05-27T11:53:32,998 creating build/lib/unitxt/catalog/cards/global_mmlu/sv 2026-05-27T11:53:32,999 copying src/unitxt/catalog/cards/global_mmlu/sv/moral_disputes.json -> build/lib/unitxt/catalog/cards/global_mmlu/sv 2026-05-27T11:53:33,001 copying src/unitxt/catalog/cards/global_mmlu/sv/high_school_biology.json -> build/lib/unitxt/catalog/cards/global_mmlu/sv 2026-05-27T11:53:33,004 copying src/unitxt/catalog/cards/global_mmlu/sv/jurisprudence.json -> build/lib/unitxt/catalog/cards/global_mmlu/sv 2026-05-27T11:53:33,006 copying src/unitxt/catalog/cards/global_mmlu/sv/logical_fallacies.json -> build/lib/unitxt/catalog/cards/global_mmlu/sv 2026-05-27T11:53:33,008 copying src/unitxt/catalog/cards/global_mmlu/sv/college_chemistry.json -> build/lib/unitxt/catalog/cards/global_mmlu/sv 2026-05-27T11:53:33,011 copying src/unitxt/catalog/cards/global_mmlu/sv/high_school_government_and_politics.json -> build/lib/unitxt/catalog/cards/global_mmlu/sv 2026-05-27T11:53:33,013 copying src/unitxt/catalog/cards/global_mmlu/sv/college_mathematics.json -> build/lib/unitxt/catalog/cards/global_mmlu/sv 2026-05-27T11:53:33,015 copying src/unitxt/catalog/cards/global_mmlu/sv/econometrics.json -> build/lib/unitxt/catalog/cards/global_mmlu/sv 2026-05-27T11:53:33,018 copying src/unitxt/catalog/cards/global_mmlu/sv/high_school_macroeconomics.json -> build/lib/unitxt/catalog/cards/global_mmlu/sv 2026-05-27T11:53:33,020 copying src/unitxt/catalog/cards/global_mmlu/sv/high_school_psychology.json -> build/lib/unitxt/catalog/cards/global_mmlu/sv 2026-05-27T11:53:33,022 copying src/unitxt/catalog/cards/global_mmlu/sv/computer_security.json -> build/lib/unitxt/catalog/cards/global_mmlu/sv 2026-05-27T11:53:33,024 copying src/unitxt/catalog/cards/global_mmlu/sv/sociology.json -> build/lib/unitxt/catalog/cards/global_mmlu/sv 2026-05-27T11:53:33,027 copying src/unitxt/catalog/cards/global_mmlu/sv/nutrition.json -> build/lib/unitxt/catalog/cards/global_mmlu/sv 2026-05-27T11:53:33,029 copying src/unitxt/catalog/cards/global_mmlu/sv/professional_medicine.json -> build/lib/unitxt/catalog/cards/global_mmlu/sv 2026-05-27T11:53:33,031 copying src/unitxt/catalog/cards/global_mmlu/sv/college_biology.json -> build/lib/unitxt/catalog/cards/global_mmlu/sv 2026-05-27T11:53:33,034 copying src/unitxt/catalog/cards/global_mmlu/sv/anatomy.json -> build/lib/unitxt/catalog/cards/global_mmlu/sv 2026-05-27T11:53:33,036 copying src/unitxt/catalog/cards/global_mmlu/sv/professional_law.json -> build/lib/unitxt/catalog/cards/global_mmlu/sv 2026-05-27T11:53:33,039 copying src/unitxt/catalog/cards/global_mmlu/sv/machine_learning.json -> build/lib/unitxt/catalog/cards/global_mmlu/sv 2026-05-27T11:53:33,041 copying src/unitxt/catalog/cards/global_mmlu/sv/international_law.json -> build/lib/unitxt/catalog/cards/global_mmlu/sv 2026-05-27T11:53:33,043 copying src/unitxt/catalog/cards/global_mmlu/sv/medical_genetics.json -> build/lib/unitxt/catalog/cards/global_mmlu/sv 2026-05-27T11:53:33,045 copying src/unitxt/catalog/cards/global_mmlu/sv/high_school_computer_science.json -> build/lib/unitxt/catalog/cards/global_mmlu/sv 2026-05-27T11:53:33,048 copying src/unitxt/catalog/cards/global_mmlu/sv/clinical_knowledge.json -> build/lib/unitxt/catalog/cards/global_mmlu/sv 2026-05-27T11:53:33,050 copying src/unitxt/catalog/cards/global_mmlu/sv/college_physics.json -> build/lib/unitxt/catalog/cards/global_mmlu/sv 2026-05-27T11:53:33,052 copying src/unitxt/catalog/cards/global_mmlu/sv/global_facts.json -> build/lib/unitxt/catalog/cards/global_mmlu/sv 2026-05-27T11:53:33,054 copying src/unitxt/catalog/cards/global_mmlu/sv/college_computer_science.json -> build/lib/unitxt/catalog/cards/global_mmlu/sv 2026-05-27T11:53:33,057 copying src/unitxt/catalog/cards/global_mmlu/sv/us_foreign_policy.json -> build/lib/unitxt/catalog/cards/global_mmlu/sv 2026-05-27T11:53:33,059 copying src/unitxt/catalog/cards/global_mmlu/sv/professional_accounting.json -> build/lib/unitxt/catalog/cards/global_mmlu/sv 2026-05-27T11:53:33,061 copying src/unitxt/catalog/cards/global_mmlu/sv/professional_psychology.json -> build/lib/unitxt/catalog/cards/global_mmlu/sv 2026-05-27T11:53:33,063 copying src/unitxt/catalog/cards/global_mmlu/sv/philosophy.json -> build/lib/unitxt/catalog/cards/global_mmlu/sv 2026-05-27T11:53:33,065 copying src/unitxt/catalog/cards/global_mmlu/sv/elementary_mathematics.json -> build/lib/unitxt/catalog/cards/global_mmlu/sv 2026-05-27T11:53:33,067 copying src/unitxt/catalog/cards/global_mmlu/sv/conceptual_physics.json -> build/lib/unitxt/catalog/cards/global_mmlu/sv 2026-05-27T11:53:33,070 copying src/unitxt/catalog/cards/global_mmlu/sv/high_school_geography.json -> build/lib/unitxt/catalog/cards/global_mmlu/sv 2026-05-27T11:53:33,072 copying src/unitxt/catalog/cards/global_mmlu/sv/human_aging.json -> build/lib/unitxt/catalog/cards/global_mmlu/sv 2026-05-27T11:53:33,074 copying src/unitxt/catalog/cards/global_mmlu/sv/electrical_engineering.json -> build/lib/unitxt/catalog/cards/global_mmlu/sv 2026-05-27T11:53:33,076 copying src/unitxt/catalog/cards/global_mmlu/sv/management.json -> build/lib/unitxt/catalog/cards/global_mmlu/sv 2026-05-27T11:53:33,079 copying src/unitxt/catalog/cards/global_mmlu/sv/high_school_world_history.json -> build/lib/unitxt/catalog/cards/global_mmlu/sv 2026-05-27T11:53:33,081 copying src/unitxt/catalog/cards/global_mmlu/sv/marketing.json -> build/lib/unitxt/catalog/cards/global_mmlu/sv 2026-05-27T11:53:33,083 copying src/unitxt/catalog/cards/global_mmlu/sv/high_school_european_history.json -> build/lib/unitxt/catalog/cards/global_mmlu/sv 2026-05-27T11:53:33,085 copying src/unitxt/catalog/cards/global_mmlu/sv/astronomy.json -> build/lib/unitxt/catalog/cards/global_mmlu/sv 2026-05-27T11:53:33,088 copying src/unitxt/catalog/cards/global_mmlu/sv/high_school_physics.json -> build/lib/unitxt/catalog/cards/global_mmlu/sv 2026-05-27T11:53:33,090 copying src/unitxt/catalog/cards/global_mmlu/sv/public_relations.json -> build/lib/unitxt/catalog/cards/global_mmlu/sv 2026-05-27T11:53:33,093 copying src/unitxt/catalog/cards/global_mmlu/sv/high_school_microeconomics.json -> build/lib/unitxt/catalog/cards/global_mmlu/sv 2026-05-27T11:53:33,095 copying src/unitxt/catalog/cards/global_mmlu/sv/virology.json -> build/lib/unitxt/catalog/cards/global_mmlu/sv 2026-05-27T11:53:33,097 copying src/unitxt/catalog/cards/global_mmlu/sv/high_school_us_history.json -> build/lib/unitxt/catalog/cards/global_mmlu/sv 2026-05-27T11:53:33,099 copying src/unitxt/catalog/cards/global_mmlu/sv/high_school_statistics.json -> build/lib/unitxt/catalog/cards/global_mmlu/sv 2026-05-27T11:53:33,102 copying src/unitxt/catalog/cards/global_mmlu/sv/miscellaneous.json -> build/lib/unitxt/catalog/cards/global_mmlu/sv 2026-05-27T11:53:33,104 copying src/unitxt/catalog/cards/global_mmlu/sv/high_school_mathematics.json -> build/lib/unitxt/catalog/cards/global_mmlu/sv 2026-05-27T11:53:33,106 copying src/unitxt/catalog/cards/global_mmlu/sv/formal_logic.json -> build/lib/unitxt/catalog/cards/global_mmlu/sv 2026-05-27T11:53:33,109 copying src/unitxt/catalog/cards/global_mmlu/sv/high_school_chemistry.json -> build/lib/unitxt/catalog/cards/global_mmlu/sv 2026-05-27T11:53:33,111 copying src/unitxt/catalog/cards/global_mmlu/sv/abstract_algebra.json -> build/lib/unitxt/catalog/cards/global_mmlu/sv 2026-05-27T11:53:33,114 copying src/unitxt/catalog/cards/global_mmlu/sv/moral_scenarios.json -> build/lib/unitxt/catalog/cards/global_mmlu/sv 2026-05-27T11:53:33,116 copying src/unitxt/catalog/cards/global_mmlu/sv/world_religions.json -> build/lib/unitxt/catalog/cards/global_mmlu/sv 2026-05-27T11:53:33,118 copying src/unitxt/catalog/cards/global_mmlu/sv/business_ethics.json -> build/lib/unitxt/catalog/cards/global_mmlu/sv 2026-05-27T11:53:33,121 copying src/unitxt/catalog/cards/global_mmlu/sv/security_studies.json -> build/lib/unitxt/catalog/cards/global_mmlu/sv 2026-05-27T11:53:33,123 copying src/unitxt/catalog/cards/global_mmlu/sv/college_medicine.json -> build/lib/unitxt/catalog/cards/global_mmlu/sv 2026-05-27T11:53:33,125 copying src/unitxt/catalog/cards/global_mmlu/sv/human_sexuality.json -> build/lib/unitxt/catalog/cards/global_mmlu/sv 2026-05-27T11:53:33,127 copying src/unitxt/catalog/cards/global_mmlu/sv/prehistory.json -> build/lib/unitxt/catalog/cards/global_mmlu/sv 2026-05-27T11:53:33,129 creating build/lib/unitxt/catalog/cards/global_mmlu/ny 2026-05-27T11:53:33,130 copying src/unitxt/catalog/cards/global_mmlu/ny/moral_disputes.json -> build/lib/unitxt/catalog/cards/global_mmlu/ny 2026-05-27T11:53:33,133 copying src/unitxt/catalog/cards/global_mmlu/ny/high_school_biology.json -> build/lib/unitxt/catalog/cards/global_mmlu/ny 2026-05-27T11:53:33,135 copying src/unitxt/catalog/cards/global_mmlu/ny/jurisprudence.json -> build/lib/unitxt/catalog/cards/global_mmlu/ny 2026-05-27T11:53:33,138 copying src/unitxt/catalog/cards/global_mmlu/ny/logical_fallacies.json -> build/lib/unitxt/catalog/cards/global_mmlu/ny 2026-05-27T11:53:33,140 copying src/unitxt/catalog/cards/global_mmlu/ny/college_chemistry.json -> build/lib/unitxt/catalog/cards/global_mmlu/ny 2026-05-27T11:53:33,142 copying src/unitxt/catalog/cards/global_mmlu/ny/high_school_government_and_politics.json -> build/lib/unitxt/catalog/cards/global_mmlu/ny 2026-05-27T11:53:33,145 copying src/unitxt/catalog/cards/global_mmlu/ny/college_mathematics.json -> build/lib/unitxt/catalog/cards/global_mmlu/ny 2026-05-27T11:53:33,147 copying src/unitxt/catalog/cards/global_mmlu/ny/econometrics.json -> build/lib/unitxt/catalog/cards/global_mmlu/ny 2026-05-27T11:53:33,149 copying src/unitxt/catalog/cards/global_mmlu/ny/high_school_macroeconomics.json -> build/lib/unitxt/catalog/cards/global_mmlu/ny 2026-05-27T11:53:33,151 copying src/unitxt/catalog/cards/global_mmlu/ny/high_school_psychology.json -> build/lib/unitxt/catalog/cards/global_mmlu/ny 2026-05-27T11:53:33,153 copying src/unitxt/catalog/cards/global_mmlu/ny/computer_security.json -> build/lib/unitxt/catalog/cards/global_mmlu/ny 2026-05-27T11:53:33,156 copying src/unitxt/catalog/cards/global_mmlu/ny/sociology.json -> build/lib/unitxt/catalog/cards/global_mmlu/ny 2026-05-27T11:53:33,158 copying src/unitxt/catalog/cards/global_mmlu/ny/nutrition.json -> build/lib/unitxt/catalog/cards/global_mmlu/ny 2026-05-27T11:53:33,160 copying src/unitxt/catalog/cards/global_mmlu/ny/professional_medicine.json -> build/lib/unitxt/catalog/cards/global_mmlu/ny 2026-05-27T11:53:33,162 copying src/unitxt/catalog/cards/global_mmlu/ny/college_biology.json -> build/lib/unitxt/catalog/cards/global_mmlu/ny 2026-05-27T11:53:33,164 copying src/unitxt/catalog/cards/global_mmlu/ny/anatomy.json -> build/lib/unitxt/catalog/cards/global_mmlu/ny 2026-05-27T11:53:33,167 copying src/unitxt/catalog/cards/global_mmlu/ny/professional_law.json -> build/lib/unitxt/catalog/cards/global_mmlu/ny 2026-05-27T11:53:33,169 copying src/unitxt/catalog/cards/global_mmlu/ny/machine_learning.json -> build/lib/unitxt/catalog/cards/global_mmlu/ny 2026-05-27T11:53:33,171 copying src/unitxt/catalog/cards/global_mmlu/ny/international_law.json -> build/lib/unitxt/catalog/cards/global_mmlu/ny 2026-05-27T11:53:33,174 copying src/unitxt/catalog/cards/global_mmlu/ny/medical_genetics.json -> build/lib/unitxt/catalog/cards/global_mmlu/ny 2026-05-27T11:53:33,176 copying src/unitxt/catalog/cards/global_mmlu/ny/high_school_computer_science.json -> build/lib/unitxt/catalog/cards/global_mmlu/ny 2026-05-27T11:53:33,179 copying src/unitxt/catalog/cards/global_mmlu/ny/clinical_knowledge.json -> build/lib/unitxt/catalog/cards/global_mmlu/ny 2026-05-27T11:53:33,181 copying src/unitxt/catalog/cards/global_mmlu/ny/college_physics.json -> build/lib/unitxt/catalog/cards/global_mmlu/ny 2026-05-27T11:53:33,183 copying src/unitxt/catalog/cards/global_mmlu/ny/global_facts.json -> build/lib/unitxt/catalog/cards/global_mmlu/ny 2026-05-27T11:53:33,185 copying src/unitxt/catalog/cards/global_mmlu/ny/college_computer_science.json -> build/lib/unitxt/catalog/cards/global_mmlu/ny 2026-05-27T11:53:33,188 copying src/unitxt/catalog/cards/global_mmlu/ny/us_foreign_policy.json -> build/lib/unitxt/catalog/cards/global_mmlu/ny 2026-05-27T11:53:33,190 copying src/unitxt/catalog/cards/global_mmlu/ny/professional_accounting.json -> build/lib/unitxt/catalog/cards/global_mmlu/ny 2026-05-27T11:53:33,192 copying src/unitxt/catalog/cards/global_mmlu/ny/professional_psychology.json -> build/lib/unitxt/catalog/cards/global_mmlu/ny 2026-05-27T11:53:33,194 copying src/unitxt/catalog/cards/global_mmlu/ny/philosophy.json -> build/lib/unitxt/catalog/cards/global_mmlu/ny 2026-05-27T11:53:33,197 copying src/unitxt/catalog/cards/global_mmlu/ny/elementary_mathematics.json -> build/lib/unitxt/catalog/cards/global_mmlu/ny 2026-05-27T11:53:33,199 copying src/unitxt/catalog/cards/global_mmlu/ny/conceptual_physics.json -> build/lib/unitxt/catalog/cards/global_mmlu/ny 2026-05-27T11:53:33,201 copying src/unitxt/catalog/cards/global_mmlu/ny/high_school_geography.json -> build/lib/unitxt/catalog/cards/global_mmlu/ny 2026-05-27T11:53:33,204 copying src/unitxt/catalog/cards/global_mmlu/ny/human_aging.json -> build/lib/unitxt/catalog/cards/global_mmlu/ny 2026-05-27T11:53:33,206 copying src/unitxt/catalog/cards/global_mmlu/ny/electrical_engineering.json -> build/lib/unitxt/catalog/cards/global_mmlu/ny 2026-05-27T11:53:33,208 copying src/unitxt/catalog/cards/global_mmlu/ny/management.json -> build/lib/unitxt/catalog/cards/global_mmlu/ny 2026-05-27T11:53:33,211 copying src/unitxt/catalog/cards/global_mmlu/ny/high_school_world_history.json -> build/lib/unitxt/catalog/cards/global_mmlu/ny 2026-05-27T11:53:33,213 copying src/unitxt/catalog/cards/global_mmlu/ny/marketing.json -> build/lib/unitxt/catalog/cards/global_mmlu/ny 2026-05-27T11:53:33,215 copying src/unitxt/catalog/cards/global_mmlu/ny/high_school_european_history.json -> build/lib/unitxt/catalog/cards/global_mmlu/ny 2026-05-27T11:53:33,218 copying src/unitxt/catalog/cards/global_mmlu/ny/astronomy.json -> build/lib/unitxt/catalog/cards/global_mmlu/ny 2026-05-27T11:53:33,220 copying src/unitxt/catalog/cards/global_mmlu/ny/high_school_physics.json -> build/lib/unitxt/catalog/cards/global_mmlu/ny 2026-05-27T11:53:33,222 copying src/unitxt/catalog/cards/global_mmlu/ny/public_relations.json -> build/lib/unitxt/catalog/cards/global_mmlu/ny 2026-05-27T11:53:33,225 copying src/unitxt/catalog/cards/global_mmlu/ny/high_school_microeconomics.json -> build/lib/unitxt/catalog/cards/global_mmlu/ny 2026-05-27T11:53:33,227 copying src/unitxt/catalog/cards/global_mmlu/ny/virology.json -> build/lib/unitxt/catalog/cards/global_mmlu/ny 2026-05-27T11:53:33,230 copying src/unitxt/catalog/cards/global_mmlu/ny/high_school_us_history.json -> build/lib/unitxt/catalog/cards/global_mmlu/ny 2026-05-27T11:53:33,232 copying src/unitxt/catalog/cards/global_mmlu/ny/high_school_statistics.json -> build/lib/unitxt/catalog/cards/global_mmlu/ny 2026-05-27T11:53:33,234 copying src/unitxt/catalog/cards/global_mmlu/ny/miscellaneous.json -> build/lib/unitxt/catalog/cards/global_mmlu/ny 2026-05-27T11:53:33,237 copying src/unitxt/catalog/cards/global_mmlu/ny/high_school_mathematics.json -> build/lib/unitxt/catalog/cards/global_mmlu/ny 2026-05-27T11:53:33,239 copying src/unitxt/catalog/cards/global_mmlu/ny/formal_logic.json -> build/lib/unitxt/catalog/cards/global_mmlu/ny 2026-05-27T11:53:33,242 copying src/unitxt/catalog/cards/global_mmlu/ny/high_school_chemistry.json -> build/lib/unitxt/catalog/cards/global_mmlu/ny 2026-05-27T11:53:33,244 copying src/unitxt/catalog/cards/global_mmlu/ny/abstract_algebra.json -> build/lib/unitxt/catalog/cards/global_mmlu/ny 2026-05-27T11:53:33,246 copying src/unitxt/catalog/cards/global_mmlu/ny/moral_scenarios.json -> build/lib/unitxt/catalog/cards/global_mmlu/ny 2026-05-27T11:53:33,248 copying src/unitxt/catalog/cards/global_mmlu/ny/world_religions.json -> build/lib/unitxt/catalog/cards/global_mmlu/ny 2026-05-27T11:53:33,251 copying src/unitxt/catalog/cards/global_mmlu/ny/business_ethics.json -> build/lib/unitxt/catalog/cards/global_mmlu/ny 2026-05-27T11:53:33,253 copying src/unitxt/catalog/cards/global_mmlu/ny/security_studies.json -> build/lib/unitxt/catalog/cards/global_mmlu/ny 2026-05-27T11:53:33,255 copying src/unitxt/catalog/cards/global_mmlu/ny/college_medicine.json -> build/lib/unitxt/catalog/cards/global_mmlu/ny 2026-05-27T11:53:33,257 copying src/unitxt/catalog/cards/global_mmlu/ny/human_sexuality.json -> build/lib/unitxt/catalog/cards/global_mmlu/ny 2026-05-27T11:53:33,260 copying src/unitxt/catalog/cards/global_mmlu/ny/prehistory.json -> build/lib/unitxt/catalog/cards/global_mmlu/ny 2026-05-27T11:53:33,262 creating build/lib/unitxt/catalog/cards/global_mmlu/si 2026-05-27T11:53:33,263 copying src/unitxt/catalog/cards/global_mmlu/si/moral_disputes.json -> build/lib/unitxt/catalog/cards/global_mmlu/si 2026-05-27T11:53:33,265 copying src/unitxt/catalog/cards/global_mmlu/si/high_school_biology.json -> build/lib/unitxt/catalog/cards/global_mmlu/si 2026-05-27T11:53:33,268 copying src/unitxt/catalog/cards/global_mmlu/si/jurisprudence.json -> build/lib/unitxt/catalog/cards/global_mmlu/si 2026-05-27T11:53:33,270 copying src/unitxt/catalog/cards/global_mmlu/si/logical_fallacies.json -> build/lib/unitxt/catalog/cards/global_mmlu/si 2026-05-27T11:53:33,272 copying src/unitxt/catalog/cards/global_mmlu/si/college_chemistry.json -> build/lib/unitxt/catalog/cards/global_mmlu/si 2026-05-27T11:53:33,275 copying src/unitxt/catalog/cards/global_mmlu/si/high_school_government_and_politics.json -> build/lib/unitxt/catalog/cards/global_mmlu/si 2026-05-27T11:53:33,277 copying src/unitxt/catalog/cards/global_mmlu/si/college_mathematics.json -> build/lib/unitxt/catalog/cards/global_mmlu/si 2026-05-27T11:53:33,279 copying src/unitxt/catalog/cards/global_mmlu/si/econometrics.json -> build/lib/unitxt/catalog/cards/global_mmlu/si 2026-05-27T11:53:33,282 copying src/unitxt/catalog/cards/global_mmlu/si/high_school_macroeconomics.json -> build/lib/unitxt/catalog/cards/global_mmlu/si 2026-05-27T11:53:33,284 copying src/unitxt/catalog/cards/global_mmlu/si/high_school_psychology.json -> build/lib/unitxt/catalog/cards/global_mmlu/si 2026-05-27T11:53:33,287 copying src/unitxt/catalog/cards/global_mmlu/si/computer_security.json -> build/lib/unitxt/catalog/cards/global_mmlu/si 2026-05-27T11:53:33,289 copying src/unitxt/catalog/cards/global_mmlu/si/sociology.json -> build/lib/unitxt/catalog/cards/global_mmlu/si 2026-05-27T11:53:33,292 copying src/unitxt/catalog/cards/global_mmlu/si/nutrition.json -> build/lib/unitxt/catalog/cards/global_mmlu/si 2026-05-27T11:53:33,294 copying src/unitxt/catalog/cards/global_mmlu/si/professional_medicine.json -> build/lib/unitxt/catalog/cards/global_mmlu/si 2026-05-27T11:53:33,297 copying src/unitxt/catalog/cards/global_mmlu/si/college_biology.json -> build/lib/unitxt/catalog/cards/global_mmlu/si 2026-05-27T11:53:33,299 copying src/unitxt/catalog/cards/global_mmlu/si/anatomy.json -> build/lib/unitxt/catalog/cards/global_mmlu/si 2026-05-27T11:53:33,302 copying src/unitxt/catalog/cards/global_mmlu/si/professional_law.json -> build/lib/unitxt/catalog/cards/global_mmlu/si 2026-05-27T11:53:33,304 copying src/unitxt/catalog/cards/global_mmlu/si/machine_learning.json -> build/lib/unitxt/catalog/cards/global_mmlu/si 2026-05-27T11:53:33,307 copying src/unitxt/catalog/cards/global_mmlu/si/international_law.json -> build/lib/unitxt/catalog/cards/global_mmlu/si 2026-05-27T11:53:33,309 copying src/unitxt/catalog/cards/global_mmlu/si/medical_genetics.json -> build/lib/unitxt/catalog/cards/global_mmlu/si 2026-05-27T11:53:33,311 copying src/unitxt/catalog/cards/global_mmlu/si/high_school_computer_science.json -> build/lib/unitxt/catalog/cards/global_mmlu/si 2026-05-27T11:53:33,314 copying src/unitxt/catalog/cards/global_mmlu/si/clinical_knowledge.json -> build/lib/unitxt/catalog/cards/global_mmlu/si 2026-05-27T11:53:33,316 copying src/unitxt/catalog/cards/global_mmlu/si/college_physics.json -> build/lib/unitxt/catalog/cards/global_mmlu/si 2026-05-27T11:53:33,319 copying src/unitxt/catalog/cards/global_mmlu/si/global_facts.json -> build/lib/unitxt/catalog/cards/global_mmlu/si 2026-05-27T11:53:33,321 copying src/unitxt/catalog/cards/global_mmlu/si/college_computer_science.json -> build/lib/unitxt/catalog/cards/global_mmlu/si 2026-05-27T11:53:33,324 copying src/unitxt/catalog/cards/global_mmlu/si/us_foreign_policy.json -> build/lib/unitxt/catalog/cards/global_mmlu/si 2026-05-27T11:53:33,326 copying src/unitxt/catalog/cards/global_mmlu/si/professional_accounting.json -> build/lib/unitxt/catalog/cards/global_mmlu/si 2026-05-27T11:53:33,328 copying src/unitxt/catalog/cards/global_mmlu/si/professional_psychology.json -> build/lib/unitxt/catalog/cards/global_mmlu/si 2026-05-27T11:53:33,331 copying src/unitxt/catalog/cards/global_mmlu/si/philosophy.json -> build/lib/unitxt/catalog/cards/global_mmlu/si 2026-05-27T11:53:33,333 copying src/unitxt/catalog/cards/global_mmlu/si/elementary_mathematics.json -> build/lib/unitxt/catalog/cards/global_mmlu/si 2026-05-27T11:53:33,335 copying src/unitxt/catalog/cards/global_mmlu/si/conceptual_physics.json -> build/lib/unitxt/catalog/cards/global_mmlu/si 2026-05-27T11:53:33,338 copying src/unitxt/catalog/cards/global_mmlu/si/high_school_geography.json -> build/lib/unitxt/catalog/cards/global_mmlu/si 2026-05-27T11:53:33,340 copying src/unitxt/catalog/cards/global_mmlu/si/human_aging.json -> build/lib/unitxt/catalog/cards/global_mmlu/si 2026-05-27T11:53:33,342 copying src/unitxt/catalog/cards/global_mmlu/si/electrical_engineering.json -> build/lib/unitxt/catalog/cards/global_mmlu/si 2026-05-27T11:53:33,345 copying src/unitxt/catalog/cards/global_mmlu/si/management.json -> build/lib/unitxt/catalog/cards/global_mmlu/si 2026-05-27T11:53:33,347 copying src/unitxt/catalog/cards/global_mmlu/si/high_school_world_history.json -> build/lib/unitxt/catalog/cards/global_mmlu/si 2026-05-27T11:53:33,349 copying src/unitxt/catalog/cards/global_mmlu/si/marketing.json -> build/lib/unitxt/catalog/cards/global_mmlu/si 2026-05-27T11:53:33,352 copying src/unitxt/catalog/cards/global_mmlu/si/high_school_european_history.json -> build/lib/unitxt/catalog/cards/global_mmlu/si 2026-05-27T11:53:33,354 copying src/unitxt/catalog/cards/global_mmlu/si/astronomy.json -> build/lib/unitxt/catalog/cards/global_mmlu/si 2026-05-27T11:53:33,356 copying src/unitxt/catalog/cards/global_mmlu/si/high_school_physics.json -> build/lib/unitxt/catalog/cards/global_mmlu/si 2026-05-27T11:53:33,359 copying src/unitxt/catalog/cards/global_mmlu/si/public_relations.json -> build/lib/unitxt/catalog/cards/global_mmlu/si 2026-05-27T11:53:33,361 copying src/unitxt/catalog/cards/global_mmlu/si/high_school_microeconomics.json -> build/lib/unitxt/catalog/cards/global_mmlu/si 2026-05-27T11:53:33,364 copying src/unitxt/catalog/cards/global_mmlu/si/virology.json -> build/lib/unitxt/catalog/cards/global_mmlu/si 2026-05-27T11:53:33,367 copying src/unitxt/catalog/cards/global_mmlu/si/high_school_us_history.json -> build/lib/unitxt/catalog/cards/global_mmlu/si 2026-05-27T11:53:33,369 copying src/unitxt/catalog/cards/global_mmlu/si/high_school_statistics.json -> build/lib/unitxt/catalog/cards/global_mmlu/si 2026-05-27T11:53:33,372 copying src/unitxt/catalog/cards/global_mmlu/si/miscellaneous.json -> build/lib/unitxt/catalog/cards/global_mmlu/si 2026-05-27T11:53:33,374 copying src/unitxt/catalog/cards/global_mmlu/si/high_school_mathematics.json -> build/lib/unitxt/catalog/cards/global_mmlu/si 2026-05-27T11:53:33,376 copying src/unitxt/catalog/cards/global_mmlu/si/formal_logic.json -> build/lib/unitxt/catalog/cards/global_mmlu/si 2026-05-27T11:53:33,379 copying src/unitxt/catalog/cards/global_mmlu/si/high_school_chemistry.json -> build/lib/unitxt/catalog/cards/global_mmlu/si 2026-05-27T11:53:33,381 copying src/unitxt/catalog/cards/global_mmlu/si/abstract_algebra.json -> build/lib/unitxt/catalog/cards/global_mmlu/si 2026-05-27T11:53:33,383 copying src/unitxt/catalog/cards/global_mmlu/si/moral_scenarios.json -> build/lib/unitxt/catalog/cards/global_mmlu/si 2026-05-27T11:53:33,385 copying src/unitxt/catalog/cards/global_mmlu/si/world_religions.json -> build/lib/unitxt/catalog/cards/global_mmlu/si 2026-05-27T11:53:33,388 copying src/unitxt/catalog/cards/global_mmlu/si/business_ethics.json -> build/lib/unitxt/catalog/cards/global_mmlu/si 2026-05-27T11:53:33,390 copying src/unitxt/catalog/cards/global_mmlu/si/security_studies.json -> build/lib/unitxt/catalog/cards/global_mmlu/si 2026-05-27T11:53:33,393 copying src/unitxt/catalog/cards/global_mmlu/si/college_medicine.json -> build/lib/unitxt/catalog/cards/global_mmlu/si 2026-05-27T11:53:33,395 copying src/unitxt/catalog/cards/global_mmlu/si/human_sexuality.json -> build/lib/unitxt/catalog/cards/global_mmlu/si 2026-05-27T11:53:33,397 copying src/unitxt/catalog/cards/global_mmlu/si/prehistory.json -> build/lib/unitxt/catalog/cards/global_mmlu/si 2026-05-27T11:53:33,400 creating build/lib/unitxt/catalog/cards/global_mmlu/mg 2026-05-27T11:53:33,401 copying src/unitxt/catalog/cards/global_mmlu/mg/moral_disputes.json -> build/lib/unitxt/catalog/cards/global_mmlu/mg 2026-05-27T11:53:33,404 copying src/unitxt/catalog/cards/global_mmlu/mg/high_school_biology.json -> build/lib/unitxt/catalog/cards/global_mmlu/mg 2026-05-27T11:53:33,406 copying src/unitxt/catalog/cards/global_mmlu/mg/jurisprudence.json -> build/lib/unitxt/catalog/cards/global_mmlu/mg 2026-05-27T11:53:33,408 copying src/unitxt/catalog/cards/global_mmlu/mg/logical_fallacies.json -> build/lib/unitxt/catalog/cards/global_mmlu/mg 2026-05-27T11:53:33,411 copying src/unitxt/catalog/cards/global_mmlu/mg/college_chemistry.json -> build/lib/unitxt/catalog/cards/global_mmlu/mg 2026-05-27T11:53:33,413 copying src/unitxt/catalog/cards/global_mmlu/mg/high_school_government_and_politics.json -> build/lib/unitxt/catalog/cards/global_mmlu/mg 2026-05-27T11:53:33,415 copying src/unitxt/catalog/cards/global_mmlu/mg/college_mathematics.json -> build/lib/unitxt/catalog/cards/global_mmlu/mg 2026-05-27T11:53:33,418 copying src/unitxt/catalog/cards/global_mmlu/mg/econometrics.json -> build/lib/unitxt/catalog/cards/global_mmlu/mg 2026-05-27T11:53:33,420 copying src/unitxt/catalog/cards/global_mmlu/mg/high_school_macroeconomics.json -> build/lib/unitxt/catalog/cards/global_mmlu/mg 2026-05-27T11:53:33,423 copying src/unitxt/catalog/cards/global_mmlu/mg/high_school_psychology.json -> build/lib/unitxt/catalog/cards/global_mmlu/mg 2026-05-27T11:53:33,425 copying src/unitxt/catalog/cards/global_mmlu/mg/computer_security.json -> build/lib/unitxt/catalog/cards/global_mmlu/mg 2026-05-27T11:53:33,427 copying src/unitxt/catalog/cards/global_mmlu/mg/sociology.json -> build/lib/unitxt/catalog/cards/global_mmlu/mg 2026-05-27T11:53:33,430 copying src/unitxt/catalog/cards/global_mmlu/mg/nutrition.json -> build/lib/unitxt/catalog/cards/global_mmlu/mg 2026-05-27T11:53:33,432 copying src/unitxt/catalog/cards/global_mmlu/mg/professional_medicine.json -> build/lib/unitxt/catalog/cards/global_mmlu/mg 2026-05-27T11:53:33,434 copying src/unitxt/catalog/cards/global_mmlu/mg/college_biology.json -> build/lib/unitxt/catalog/cards/global_mmlu/mg 2026-05-27T11:53:33,437 copying src/unitxt/catalog/cards/global_mmlu/mg/anatomy.json -> build/lib/unitxt/catalog/cards/global_mmlu/mg 2026-05-27T11:53:33,439 copying src/unitxt/catalog/cards/global_mmlu/mg/professional_law.json -> build/lib/unitxt/catalog/cards/global_mmlu/mg 2026-05-27T11:53:33,442 copying src/unitxt/catalog/cards/global_mmlu/mg/machine_learning.json -> build/lib/unitxt/catalog/cards/global_mmlu/mg 2026-05-27T11:53:33,444 copying src/unitxt/catalog/cards/global_mmlu/mg/international_law.json -> build/lib/unitxt/catalog/cards/global_mmlu/mg 2026-05-27T11:53:33,446 copying src/unitxt/catalog/cards/global_mmlu/mg/medical_genetics.json -> build/lib/unitxt/catalog/cards/global_mmlu/mg 2026-05-27T11:53:33,448 copying src/unitxt/catalog/cards/global_mmlu/mg/high_school_computer_science.json -> build/lib/unitxt/catalog/cards/global_mmlu/mg 2026-05-27T11:53:33,450 copying src/unitxt/catalog/cards/global_mmlu/mg/clinical_knowledge.json -> build/lib/unitxt/catalog/cards/global_mmlu/mg 2026-05-27T11:53:33,453 copying src/unitxt/catalog/cards/global_mmlu/mg/college_physics.json -> build/lib/unitxt/catalog/cards/global_mmlu/mg 2026-05-27T11:53:33,455 copying src/unitxt/catalog/cards/global_mmlu/mg/global_facts.json -> build/lib/unitxt/catalog/cards/global_mmlu/mg 2026-05-27T11:53:33,457 copying src/unitxt/catalog/cards/global_mmlu/mg/college_computer_science.json -> build/lib/unitxt/catalog/cards/global_mmlu/mg 2026-05-27T11:53:33,459 copying src/unitxt/catalog/cards/global_mmlu/mg/us_foreign_policy.json -> build/lib/unitxt/catalog/cards/global_mmlu/mg 2026-05-27T11:53:33,462 copying src/unitxt/catalog/cards/global_mmlu/mg/professional_accounting.json -> build/lib/unitxt/catalog/cards/global_mmlu/mg 2026-05-27T11:53:33,464 copying src/unitxt/catalog/cards/global_mmlu/mg/professional_psychology.json -> build/lib/unitxt/catalog/cards/global_mmlu/mg 2026-05-27T11:53:33,466 copying src/unitxt/catalog/cards/global_mmlu/mg/philosophy.json -> build/lib/unitxt/catalog/cards/global_mmlu/mg 2026-05-27T11:53:33,469 copying src/unitxt/catalog/cards/global_mmlu/mg/elementary_mathematics.json -> build/lib/unitxt/catalog/cards/global_mmlu/mg 2026-05-27T11:53:33,471 copying src/unitxt/catalog/cards/global_mmlu/mg/conceptual_physics.json -> build/lib/unitxt/catalog/cards/global_mmlu/mg 2026-05-27T11:53:33,473 copying src/unitxt/catalog/cards/global_mmlu/mg/high_school_geography.json -> build/lib/unitxt/catalog/cards/global_mmlu/mg 2026-05-27T11:53:33,476 copying src/unitxt/catalog/cards/global_mmlu/mg/human_aging.json -> build/lib/unitxt/catalog/cards/global_mmlu/mg 2026-05-27T11:53:33,479 copying src/unitxt/catalog/cards/global_mmlu/mg/electrical_engineering.json -> build/lib/unitxt/catalog/cards/global_mmlu/mg 2026-05-27T11:53:33,481 copying src/unitxt/catalog/cards/global_mmlu/mg/management.json -> build/lib/unitxt/catalog/cards/global_mmlu/mg 2026-05-27T11:53:33,483 copying src/unitxt/catalog/cards/global_mmlu/mg/high_school_world_history.json -> build/lib/unitxt/catalog/cards/global_mmlu/mg 2026-05-27T11:53:33,485 copying src/unitxt/catalog/cards/global_mmlu/mg/marketing.json -> build/lib/unitxt/catalog/cards/global_mmlu/mg 2026-05-27T11:53:33,488 copying src/unitxt/catalog/cards/global_mmlu/mg/high_school_european_history.json -> build/lib/unitxt/catalog/cards/global_mmlu/mg 2026-05-27T11:53:33,490 copying src/unitxt/catalog/cards/global_mmlu/mg/astronomy.json -> build/lib/unitxt/catalog/cards/global_mmlu/mg 2026-05-27T11:53:33,492 copying src/unitxt/catalog/cards/global_mmlu/mg/high_school_physics.json -> build/lib/unitxt/catalog/cards/global_mmlu/mg 2026-05-27T11:53:33,495 copying src/unitxt/catalog/cards/global_mmlu/mg/public_relations.json -> build/lib/unitxt/catalog/cards/global_mmlu/mg 2026-05-27T11:53:33,497 copying src/unitxt/catalog/cards/global_mmlu/mg/high_school_microeconomics.json -> build/lib/unitxt/catalog/cards/global_mmlu/mg 2026-05-27T11:53:33,499 copying src/unitxt/catalog/cards/global_mmlu/mg/virology.json -> build/lib/unitxt/catalog/cards/global_mmlu/mg 2026-05-27T11:53:33,502 copying src/unitxt/catalog/cards/global_mmlu/mg/high_school_us_history.json -> build/lib/unitxt/catalog/cards/global_mmlu/mg 2026-05-27T11:53:33,504 copying src/unitxt/catalog/cards/global_mmlu/mg/high_school_statistics.json -> build/lib/unitxt/catalog/cards/global_mmlu/mg 2026-05-27T11:53:33,506 copying src/unitxt/catalog/cards/global_mmlu/mg/miscellaneous.json -> build/lib/unitxt/catalog/cards/global_mmlu/mg 2026-05-27T11:53:33,508 copying src/unitxt/catalog/cards/global_mmlu/mg/high_school_mathematics.json -> build/lib/unitxt/catalog/cards/global_mmlu/mg 2026-05-27T11:53:33,511 copying src/unitxt/catalog/cards/global_mmlu/mg/formal_logic.json -> build/lib/unitxt/catalog/cards/global_mmlu/mg 2026-05-27T11:53:33,513 copying src/unitxt/catalog/cards/global_mmlu/mg/high_school_chemistry.json -> build/lib/unitxt/catalog/cards/global_mmlu/mg 2026-05-27T11:53:33,516 copying src/unitxt/catalog/cards/global_mmlu/mg/abstract_algebra.json -> build/lib/unitxt/catalog/cards/global_mmlu/mg 2026-05-27T11:53:33,518 copying src/unitxt/catalog/cards/global_mmlu/mg/moral_scenarios.json -> build/lib/unitxt/catalog/cards/global_mmlu/mg 2026-05-27T11:53:33,521 copying src/unitxt/catalog/cards/global_mmlu/mg/world_religions.json -> build/lib/unitxt/catalog/cards/global_mmlu/mg 2026-05-27T11:53:33,524 copying src/unitxt/catalog/cards/global_mmlu/mg/business_ethics.json -> build/lib/unitxt/catalog/cards/global_mmlu/mg 2026-05-27T11:53:33,526 copying src/unitxt/catalog/cards/global_mmlu/mg/security_studies.json -> build/lib/unitxt/catalog/cards/global_mmlu/mg 2026-05-27T11:53:33,529 copying src/unitxt/catalog/cards/global_mmlu/mg/college_medicine.json -> build/lib/unitxt/catalog/cards/global_mmlu/mg 2026-05-27T11:53:33,531 copying src/unitxt/catalog/cards/global_mmlu/mg/human_sexuality.json -> build/lib/unitxt/catalog/cards/global_mmlu/mg 2026-05-27T11:53:33,533 copying src/unitxt/catalog/cards/global_mmlu/mg/prehistory.json -> build/lib/unitxt/catalog/cards/global_mmlu/mg 2026-05-27T11:53:33,536 creating build/lib/unitxt/catalog/cards/global_mmlu/ms 2026-05-27T11:53:33,537 copying src/unitxt/catalog/cards/global_mmlu/ms/moral_disputes.json -> build/lib/unitxt/catalog/cards/global_mmlu/ms 2026-05-27T11:53:33,540 copying src/unitxt/catalog/cards/global_mmlu/ms/high_school_biology.json -> build/lib/unitxt/catalog/cards/global_mmlu/ms 2026-05-27T11:53:33,542 copying src/unitxt/catalog/cards/global_mmlu/ms/jurisprudence.json -> build/lib/unitxt/catalog/cards/global_mmlu/ms 2026-05-27T11:53:33,545 copying src/unitxt/catalog/cards/global_mmlu/ms/logical_fallacies.json -> build/lib/unitxt/catalog/cards/global_mmlu/ms 2026-05-27T11:53:33,547 copying src/unitxt/catalog/cards/global_mmlu/ms/college_chemistry.json -> build/lib/unitxt/catalog/cards/global_mmlu/ms 2026-05-27T11:53:33,550 copying src/unitxt/catalog/cards/global_mmlu/ms/high_school_government_and_politics.json -> build/lib/unitxt/catalog/cards/global_mmlu/ms 2026-05-27T11:53:33,553 copying src/unitxt/catalog/cards/global_mmlu/ms/college_mathematics.json -> build/lib/unitxt/catalog/cards/global_mmlu/ms 2026-05-27T11:53:33,555 copying src/unitxt/catalog/cards/global_mmlu/ms/econometrics.json -> build/lib/unitxt/catalog/cards/global_mmlu/ms 2026-05-27T11:53:33,558 copying src/unitxt/catalog/cards/global_mmlu/ms/high_school_macroeconomics.json -> build/lib/unitxt/catalog/cards/global_mmlu/ms 2026-05-27T11:53:33,561 copying src/unitxt/catalog/cards/global_mmlu/ms/high_school_psychology.json -> build/lib/unitxt/catalog/cards/global_mmlu/ms 2026-05-27T11:53:33,563 copying src/unitxt/catalog/cards/global_mmlu/ms/computer_security.json -> build/lib/unitxt/catalog/cards/global_mmlu/ms 2026-05-27T11:53:33,566 copying src/unitxt/catalog/cards/global_mmlu/ms/sociology.json -> build/lib/unitxt/catalog/cards/global_mmlu/ms 2026-05-27T11:53:33,568 copying src/unitxt/catalog/cards/global_mmlu/ms/nutrition.json -> build/lib/unitxt/catalog/cards/global_mmlu/ms 2026-05-27T11:53:33,571 copying src/unitxt/catalog/cards/global_mmlu/ms/professional_medicine.json -> build/lib/unitxt/catalog/cards/global_mmlu/ms 2026-05-27T11:53:33,573 copying src/unitxt/catalog/cards/global_mmlu/ms/college_biology.json -> build/lib/unitxt/catalog/cards/global_mmlu/ms 2026-05-27T11:53:33,575 copying src/unitxt/catalog/cards/global_mmlu/ms/anatomy.json -> build/lib/unitxt/catalog/cards/global_mmlu/ms 2026-05-27T11:53:33,578 copying src/unitxt/catalog/cards/global_mmlu/ms/professional_law.json -> build/lib/unitxt/catalog/cards/global_mmlu/ms 2026-05-27T11:53:33,581 copying src/unitxt/catalog/cards/global_mmlu/ms/machine_learning.json -> build/lib/unitxt/catalog/cards/global_mmlu/ms 2026-05-27T11:53:33,583 copying src/unitxt/catalog/cards/global_mmlu/ms/international_law.json -> build/lib/unitxt/catalog/cards/global_mmlu/ms 2026-05-27T11:53:33,585 copying src/unitxt/catalog/cards/global_mmlu/ms/medical_genetics.json -> build/lib/unitxt/catalog/cards/global_mmlu/ms 2026-05-27T11:53:33,588 copying src/unitxt/catalog/cards/global_mmlu/ms/high_school_computer_science.json -> build/lib/unitxt/catalog/cards/global_mmlu/ms 2026-05-27T11:53:33,591 copying src/unitxt/catalog/cards/global_mmlu/ms/clinical_knowledge.json -> build/lib/unitxt/catalog/cards/global_mmlu/ms 2026-05-27T11:53:33,593 copying src/unitxt/catalog/cards/global_mmlu/ms/college_physics.json -> build/lib/unitxt/catalog/cards/global_mmlu/ms 2026-05-27T11:53:33,595 copying src/unitxt/catalog/cards/global_mmlu/ms/global_facts.json -> build/lib/unitxt/catalog/cards/global_mmlu/ms 2026-05-27T11:53:33,598 copying src/unitxt/catalog/cards/global_mmlu/ms/college_computer_science.json -> build/lib/unitxt/catalog/cards/global_mmlu/ms 2026-05-27T11:53:33,600 copying src/unitxt/catalog/cards/global_mmlu/ms/us_foreign_policy.json -> build/lib/unitxt/catalog/cards/global_mmlu/ms 2026-05-27T11:53:33,603 copying src/unitxt/catalog/cards/global_mmlu/ms/professional_accounting.json -> build/lib/unitxt/catalog/cards/global_mmlu/ms 2026-05-27T11:53:33,605 copying src/unitxt/catalog/cards/global_mmlu/ms/professional_psychology.json -> build/lib/unitxt/catalog/cards/global_mmlu/ms 2026-05-27T11:53:33,608 copying src/unitxt/catalog/cards/global_mmlu/ms/philosophy.json -> build/lib/unitxt/catalog/cards/global_mmlu/ms 2026-05-27T11:53:33,610 copying src/unitxt/catalog/cards/global_mmlu/ms/elementary_mathematics.json -> build/lib/unitxt/catalog/cards/global_mmlu/ms 2026-05-27T11:53:33,613 copying src/unitxt/catalog/cards/global_mmlu/ms/conceptual_physics.json -> build/lib/unitxt/catalog/cards/global_mmlu/ms 2026-05-27T11:53:33,615 copying src/unitxt/catalog/cards/global_mmlu/ms/high_school_geography.json -> build/lib/unitxt/catalog/cards/global_mmlu/ms 2026-05-27T11:53:33,618 copying src/unitxt/catalog/cards/global_mmlu/ms/human_aging.json -> build/lib/unitxt/catalog/cards/global_mmlu/ms 2026-05-27T11:53:33,620 copying src/unitxt/catalog/cards/global_mmlu/ms/electrical_engineering.json -> build/lib/unitxt/catalog/cards/global_mmlu/ms 2026-05-27T11:53:33,623 copying src/unitxt/catalog/cards/global_mmlu/ms/management.json -> build/lib/unitxt/catalog/cards/global_mmlu/ms 2026-05-27T11:53:33,625 copying src/unitxt/catalog/cards/global_mmlu/ms/high_school_world_history.json -> build/lib/unitxt/catalog/cards/global_mmlu/ms 2026-05-27T11:53:33,628 copying src/unitxt/catalog/cards/global_mmlu/ms/marketing.json -> build/lib/unitxt/catalog/cards/global_mmlu/ms 2026-05-27T11:53:33,631 copying src/unitxt/catalog/cards/global_mmlu/ms/high_school_european_history.json -> build/lib/unitxt/catalog/cards/global_mmlu/ms 2026-05-27T11:53:33,634 copying src/unitxt/catalog/cards/global_mmlu/ms/astronomy.json -> build/lib/unitxt/catalog/cards/global_mmlu/ms 2026-05-27T11:53:33,638 copying src/unitxt/catalog/cards/global_mmlu/ms/high_school_physics.json -> build/lib/unitxt/catalog/cards/global_mmlu/ms 2026-05-27T11:53:33,640 copying src/unitxt/catalog/cards/global_mmlu/ms/public_relations.json -> build/lib/unitxt/catalog/cards/global_mmlu/ms 2026-05-27T11:53:33,643 copying src/unitxt/catalog/cards/global_mmlu/ms/high_school_microeconomics.json -> build/lib/unitxt/catalog/cards/global_mmlu/ms 2026-05-27T11:53:33,645 copying src/unitxt/catalog/cards/global_mmlu/ms/virology.json -> build/lib/unitxt/catalog/cards/global_mmlu/ms 2026-05-27T11:53:33,648 copying src/unitxt/catalog/cards/global_mmlu/ms/high_school_us_history.json -> build/lib/unitxt/catalog/cards/global_mmlu/ms 2026-05-27T11:53:33,651 copying src/unitxt/catalog/cards/global_mmlu/ms/high_school_statistics.json -> build/lib/unitxt/catalog/cards/global_mmlu/ms 2026-05-27T11:53:33,654 copying src/unitxt/catalog/cards/global_mmlu/ms/miscellaneous.json -> build/lib/unitxt/catalog/cards/global_mmlu/ms 2026-05-27T11:53:33,656 copying src/unitxt/catalog/cards/global_mmlu/ms/high_school_mathematics.json -> build/lib/unitxt/catalog/cards/global_mmlu/ms 2026-05-27T11:53:33,659 copying src/unitxt/catalog/cards/global_mmlu/ms/formal_logic.json -> build/lib/unitxt/catalog/cards/global_mmlu/ms 2026-05-27T11:53:33,661 copying src/unitxt/catalog/cards/global_mmlu/ms/high_school_chemistry.json -> build/lib/unitxt/catalog/cards/global_mmlu/ms 2026-05-27T11:53:33,664 copying src/unitxt/catalog/cards/global_mmlu/ms/abstract_algebra.json -> build/lib/unitxt/catalog/cards/global_mmlu/ms 2026-05-27T11:53:33,667 copying src/unitxt/catalog/cards/global_mmlu/ms/moral_scenarios.json -> build/lib/unitxt/catalog/cards/global_mmlu/ms 2026-05-27T11:53:33,670 copying src/unitxt/catalog/cards/global_mmlu/ms/world_religions.json -> build/lib/unitxt/catalog/cards/global_mmlu/ms 2026-05-27T11:53:33,672 copying src/unitxt/catalog/cards/global_mmlu/ms/business_ethics.json -> build/lib/unitxt/catalog/cards/global_mmlu/ms 2026-05-27T11:53:33,675 copying src/unitxt/catalog/cards/global_mmlu/ms/security_studies.json -> build/lib/unitxt/catalog/cards/global_mmlu/ms 2026-05-27T11:53:33,678 copying src/unitxt/catalog/cards/global_mmlu/ms/college_medicine.json -> build/lib/unitxt/catalog/cards/global_mmlu/ms 2026-05-27T11:53:33,680 copying src/unitxt/catalog/cards/global_mmlu/ms/human_sexuality.json -> build/lib/unitxt/catalog/cards/global_mmlu/ms 2026-05-27T11:53:33,683 copying src/unitxt/catalog/cards/global_mmlu/ms/prehistory.json -> build/lib/unitxt/catalog/cards/global_mmlu/ms 2026-05-27T11:53:33,685 creating build/lib/unitxt/catalog/cards/global_mmlu/hi 2026-05-27T11:53:33,687 copying src/unitxt/catalog/cards/global_mmlu/hi/moral_disputes.json -> build/lib/unitxt/catalog/cards/global_mmlu/hi 2026-05-27T11:53:33,690 copying src/unitxt/catalog/cards/global_mmlu/hi/high_school_biology.json -> build/lib/unitxt/catalog/cards/global_mmlu/hi 2026-05-27T11:53:33,692 copying src/unitxt/catalog/cards/global_mmlu/hi/jurisprudence.json -> build/lib/unitxt/catalog/cards/global_mmlu/hi 2026-05-27T11:53:33,695 copying src/unitxt/catalog/cards/global_mmlu/hi/logical_fallacies.json -> build/lib/unitxt/catalog/cards/global_mmlu/hi 2026-05-27T11:53:33,697 copying src/unitxt/catalog/cards/global_mmlu/hi/college_chemistry.json -> build/lib/unitxt/catalog/cards/global_mmlu/hi 2026-05-27T11:53:33,700 copying src/unitxt/catalog/cards/global_mmlu/hi/high_school_government_and_politics.json -> build/lib/unitxt/catalog/cards/global_mmlu/hi 2026-05-27T11:53:33,703 copying src/unitxt/catalog/cards/global_mmlu/hi/college_mathematics.json -> build/lib/unitxt/catalog/cards/global_mmlu/hi 2026-05-27T11:53:33,706 copying src/unitxt/catalog/cards/global_mmlu/hi/econometrics.json -> build/lib/unitxt/catalog/cards/global_mmlu/hi 2026-05-27T11:53:33,708 copying src/unitxt/catalog/cards/global_mmlu/hi/high_school_macroeconomics.json -> build/lib/unitxt/catalog/cards/global_mmlu/hi 2026-05-27T11:53:33,711 copying src/unitxt/catalog/cards/global_mmlu/hi/high_school_psychology.json -> build/lib/unitxt/catalog/cards/global_mmlu/hi 2026-05-27T11:53:33,714 copying src/unitxt/catalog/cards/global_mmlu/hi/computer_security.json -> build/lib/unitxt/catalog/cards/global_mmlu/hi 2026-05-27T11:53:33,717 copying src/unitxt/catalog/cards/global_mmlu/hi/sociology.json -> build/lib/unitxt/catalog/cards/global_mmlu/hi 2026-05-27T11:53:33,719 copying src/unitxt/catalog/cards/global_mmlu/hi/nutrition.json -> build/lib/unitxt/catalog/cards/global_mmlu/hi 2026-05-27T11:53:33,722 copying src/unitxt/catalog/cards/global_mmlu/hi/professional_medicine.json -> build/lib/unitxt/catalog/cards/global_mmlu/hi 2026-05-27T11:53:33,724 copying src/unitxt/catalog/cards/global_mmlu/hi/college_biology.json -> build/lib/unitxt/catalog/cards/global_mmlu/hi 2026-05-27T11:53:33,727 copying src/unitxt/catalog/cards/global_mmlu/hi/anatomy.json -> build/lib/unitxt/catalog/cards/global_mmlu/hi 2026-05-27T11:53:33,730 copying src/unitxt/catalog/cards/global_mmlu/hi/professional_law.json -> build/lib/unitxt/catalog/cards/global_mmlu/hi 2026-05-27T11:53:33,732 copying src/unitxt/catalog/cards/global_mmlu/hi/machine_learning.json -> build/lib/unitxt/catalog/cards/global_mmlu/hi 2026-05-27T11:53:33,735 copying src/unitxt/catalog/cards/global_mmlu/hi/international_law.json -> build/lib/unitxt/catalog/cards/global_mmlu/hi 2026-05-27T11:53:33,738 copying src/unitxt/catalog/cards/global_mmlu/hi/medical_genetics.json -> build/lib/unitxt/catalog/cards/global_mmlu/hi 2026-05-27T11:53:33,740 copying src/unitxt/catalog/cards/global_mmlu/hi/high_school_computer_science.json -> build/lib/unitxt/catalog/cards/global_mmlu/hi 2026-05-27T11:53:33,743 copying src/unitxt/catalog/cards/global_mmlu/hi/clinical_knowledge.json -> build/lib/unitxt/catalog/cards/global_mmlu/hi 2026-05-27T11:53:33,745 copying src/unitxt/catalog/cards/global_mmlu/hi/college_physics.json -> build/lib/unitxt/catalog/cards/global_mmlu/hi 2026-05-27T11:53:33,748 copying src/unitxt/catalog/cards/global_mmlu/hi/global_facts.json -> build/lib/unitxt/catalog/cards/global_mmlu/hi 2026-05-27T11:53:33,751 copying src/unitxt/catalog/cards/global_mmlu/hi/college_computer_science.json -> build/lib/unitxt/catalog/cards/global_mmlu/hi 2026-05-27T11:53:33,754 copying src/unitxt/catalog/cards/global_mmlu/hi/us_foreign_policy.json -> build/lib/unitxt/catalog/cards/global_mmlu/hi 2026-05-27T11:53:33,756 copying src/unitxt/catalog/cards/global_mmlu/hi/professional_accounting.json -> build/lib/unitxt/catalog/cards/global_mmlu/hi 2026-05-27T11:53:33,759 copying src/unitxt/catalog/cards/global_mmlu/hi/professional_psychology.json -> build/lib/unitxt/catalog/cards/global_mmlu/hi 2026-05-27T11:53:33,762 copying src/unitxt/catalog/cards/global_mmlu/hi/philosophy.json -> build/lib/unitxt/catalog/cards/global_mmlu/hi 2026-05-27T11:53:33,764 copying src/unitxt/catalog/cards/global_mmlu/hi/elementary_mathematics.json -> build/lib/unitxt/catalog/cards/global_mmlu/hi 2026-05-27T11:53:33,767 copying src/unitxt/catalog/cards/global_mmlu/hi/conceptual_physics.json -> build/lib/unitxt/catalog/cards/global_mmlu/hi 2026-05-27T11:53:33,770 copying src/unitxt/catalog/cards/global_mmlu/hi/high_school_geography.json -> build/lib/unitxt/catalog/cards/global_mmlu/hi 2026-05-27T11:53:33,772 copying src/unitxt/catalog/cards/global_mmlu/hi/human_aging.json -> build/lib/unitxt/catalog/cards/global_mmlu/hi 2026-05-27T11:53:33,775 copying src/unitxt/catalog/cards/global_mmlu/hi/electrical_engineering.json -> build/lib/unitxt/catalog/cards/global_mmlu/hi 2026-05-27T11:53:33,777 copying src/unitxt/catalog/cards/global_mmlu/hi/management.json -> build/lib/unitxt/catalog/cards/global_mmlu/hi 2026-05-27T11:53:33,780 copying src/unitxt/catalog/cards/global_mmlu/hi/high_school_world_history.json -> build/lib/unitxt/catalog/cards/global_mmlu/hi 2026-05-27T11:53:33,783 copying src/unitxt/catalog/cards/global_mmlu/hi/marketing.json -> build/lib/unitxt/catalog/cards/global_mmlu/hi 2026-05-27T11:53:33,785 copying src/unitxt/catalog/cards/global_mmlu/hi/high_school_european_history.json -> build/lib/unitxt/catalog/cards/global_mmlu/hi 2026-05-27T11:53:33,788 copying src/unitxt/catalog/cards/global_mmlu/hi/astronomy.json -> build/lib/unitxt/catalog/cards/global_mmlu/hi 2026-05-27T11:53:33,791 copying src/unitxt/catalog/cards/global_mmlu/hi/high_school_physics.json -> build/lib/unitxt/catalog/cards/global_mmlu/hi 2026-05-27T11:53:33,793 copying src/unitxt/catalog/cards/global_mmlu/hi/public_relations.json -> build/lib/unitxt/catalog/cards/global_mmlu/hi 2026-05-27T11:53:33,796 copying src/unitxt/catalog/cards/global_mmlu/hi/high_school_microeconomics.json -> build/lib/unitxt/catalog/cards/global_mmlu/hi 2026-05-27T11:53:33,798 copying src/unitxt/catalog/cards/global_mmlu/hi/virology.json -> build/lib/unitxt/catalog/cards/global_mmlu/hi 2026-05-27T11:53:33,800 copying src/unitxt/catalog/cards/global_mmlu/hi/high_school_us_history.json -> build/lib/unitxt/catalog/cards/global_mmlu/hi 2026-05-27T11:53:33,803 copying src/unitxt/catalog/cards/global_mmlu/hi/high_school_statistics.json -> build/lib/unitxt/catalog/cards/global_mmlu/hi 2026-05-27T11:53:33,805 copying src/unitxt/catalog/cards/global_mmlu/hi/miscellaneous.json -> build/lib/unitxt/catalog/cards/global_mmlu/hi 2026-05-27T11:53:33,807 copying src/unitxt/catalog/cards/global_mmlu/hi/high_school_mathematics.json -> build/lib/unitxt/catalog/cards/global_mmlu/hi 2026-05-27T11:53:33,809 copying src/unitxt/catalog/cards/global_mmlu/hi/formal_logic.json -> build/lib/unitxt/catalog/cards/global_mmlu/hi 2026-05-27T11:53:33,811 copying src/unitxt/catalog/cards/global_mmlu/hi/high_school_chemistry.json -> build/lib/unitxt/catalog/cards/global_mmlu/hi 2026-05-27T11:53:33,813 copying src/unitxt/catalog/cards/global_mmlu/hi/abstract_algebra.json -> build/lib/unitxt/catalog/cards/global_mmlu/hi 2026-05-27T11:53:33,816 copying src/unitxt/catalog/cards/global_mmlu/hi/moral_scenarios.json -> build/lib/unitxt/catalog/cards/global_mmlu/hi 2026-05-27T11:53:33,818 copying src/unitxt/catalog/cards/global_mmlu/hi/world_religions.json -> build/lib/unitxt/catalog/cards/global_mmlu/hi 2026-05-27T11:53:33,820 copying src/unitxt/catalog/cards/global_mmlu/hi/business_ethics.json -> build/lib/unitxt/catalog/cards/global_mmlu/hi 2026-05-27T11:53:33,822 copying src/unitxt/catalog/cards/global_mmlu/hi/security_studies.json -> build/lib/unitxt/catalog/cards/global_mmlu/hi 2026-05-27T11:53:33,824 copying src/unitxt/catalog/cards/global_mmlu/hi/college_medicine.json -> build/lib/unitxt/catalog/cards/global_mmlu/hi 2026-05-27T11:53:33,827 copying src/unitxt/catalog/cards/global_mmlu/hi/human_sexuality.json -> build/lib/unitxt/catalog/cards/global_mmlu/hi 2026-05-27T11:53:33,829 copying src/unitxt/catalog/cards/global_mmlu/hi/prehistory.json -> build/lib/unitxt/catalog/cards/global_mmlu/hi 2026-05-27T11:53:33,831 creating build/lib/unitxt/catalog/cards/global_mmlu/lt 2026-05-27T11:53:33,832 copying src/unitxt/catalog/cards/global_mmlu/lt/moral_disputes.json -> build/lib/unitxt/catalog/cards/global_mmlu/lt 2026-05-27T11:53:33,834 copying src/unitxt/catalog/cards/global_mmlu/lt/high_school_biology.json -> build/lib/unitxt/catalog/cards/global_mmlu/lt 2026-05-27T11:53:33,836 copying src/unitxt/catalog/cards/global_mmlu/lt/jurisprudence.json -> build/lib/unitxt/catalog/cards/global_mmlu/lt 2026-05-27T11:53:33,839 copying src/unitxt/catalog/cards/global_mmlu/lt/logical_fallacies.json -> build/lib/unitxt/catalog/cards/global_mmlu/lt 2026-05-27T11:53:33,841 copying src/unitxt/catalog/cards/global_mmlu/lt/college_chemistry.json -> build/lib/unitxt/catalog/cards/global_mmlu/lt 2026-05-27T11:53:33,843 copying src/unitxt/catalog/cards/global_mmlu/lt/high_school_government_and_politics.json -> build/lib/unitxt/catalog/cards/global_mmlu/lt 2026-05-27T11:53:33,845 copying src/unitxt/catalog/cards/global_mmlu/lt/college_mathematics.json -> build/lib/unitxt/catalog/cards/global_mmlu/lt 2026-05-27T11:53:33,847 copying src/unitxt/catalog/cards/global_mmlu/lt/econometrics.json -> build/lib/unitxt/catalog/cards/global_mmlu/lt 2026-05-27T11:53:33,849 copying src/unitxt/catalog/cards/global_mmlu/lt/high_school_macroeconomics.json -> build/lib/unitxt/catalog/cards/global_mmlu/lt 2026-05-27T11:53:33,851 copying src/unitxt/catalog/cards/global_mmlu/lt/high_school_psychology.json -> build/lib/unitxt/catalog/cards/global_mmlu/lt 2026-05-27T11:53:33,854 copying src/unitxt/catalog/cards/global_mmlu/lt/computer_security.json -> build/lib/unitxt/catalog/cards/global_mmlu/lt 2026-05-27T11:53:33,856 copying src/unitxt/catalog/cards/global_mmlu/lt/sociology.json -> build/lib/unitxt/catalog/cards/global_mmlu/lt 2026-05-27T11:53:33,858 copying src/unitxt/catalog/cards/global_mmlu/lt/nutrition.json -> build/lib/unitxt/catalog/cards/global_mmlu/lt 2026-05-27T11:53:33,860 copying src/unitxt/catalog/cards/global_mmlu/lt/professional_medicine.json -> build/lib/unitxt/catalog/cards/global_mmlu/lt 2026-05-27T11:53:33,862 copying src/unitxt/catalog/cards/global_mmlu/lt/college_biology.json -> build/lib/unitxt/catalog/cards/global_mmlu/lt 2026-05-27T11:53:33,864 copying src/unitxt/catalog/cards/global_mmlu/lt/anatomy.json -> build/lib/unitxt/catalog/cards/global_mmlu/lt 2026-05-27T11:53:33,867 copying src/unitxt/catalog/cards/global_mmlu/lt/professional_law.json -> build/lib/unitxt/catalog/cards/global_mmlu/lt 2026-05-27T11:53:33,869 copying src/unitxt/catalog/cards/global_mmlu/lt/machine_learning.json -> build/lib/unitxt/catalog/cards/global_mmlu/lt 2026-05-27T11:53:33,871 copying src/unitxt/catalog/cards/global_mmlu/lt/international_law.json -> build/lib/unitxt/catalog/cards/global_mmlu/lt 2026-05-27T11:53:33,873 copying src/unitxt/catalog/cards/global_mmlu/lt/medical_genetics.json -> build/lib/unitxt/catalog/cards/global_mmlu/lt 2026-05-27T11:53:33,875 copying src/unitxt/catalog/cards/global_mmlu/lt/high_school_computer_science.json -> build/lib/unitxt/catalog/cards/global_mmlu/lt 2026-05-27T11:53:33,877 copying src/unitxt/catalog/cards/global_mmlu/lt/clinical_knowledge.json -> build/lib/unitxt/catalog/cards/global_mmlu/lt 2026-05-27T11:53:33,879 copying src/unitxt/catalog/cards/global_mmlu/lt/college_physics.json -> build/lib/unitxt/catalog/cards/global_mmlu/lt 2026-05-27T11:53:33,881 copying src/unitxt/catalog/cards/global_mmlu/lt/global_facts.json -> build/lib/unitxt/catalog/cards/global_mmlu/lt 2026-05-27T11:53:33,883 copying src/unitxt/catalog/cards/global_mmlu/lt/college_computer_science.json -> build/lib/unitxt/catalog/cards/global_mmlu/lt 2026-05-27T11:53:33,886 copying src/unitxt/catalog/cards/global_mmlu/lt/us_foreign_policy.json -> build/lib/unitxt/catalog/cards/global_mmlu/lt 2026-05-27T11:53:33,888 copying src/unitxt/catalog/cards/global_mmlu/lt/professional_accounting.json -> build/lib/unitxt/catalog/cards/global_mmlu/lt 2026-05-27T11:53:33,890 copying src/unitxt/catalog/cards/global_mmlu/lt/professional_psychology.json -> build/lib/unitxt/catalog/cards/global_mmlu/lt 2026-05-27T11:53:33,892 copying src/unitxt/catalog/cards/global_mmlu/lt/philosophy.json -> build/lib/unitxt/catalog/cards/global_mmlu/lt 2026-05-27T11:53:33,894 copying src/unitxt/catalog/cards/global_mmlu/lt/elementary_mathematics.json -> build/lib/unitxt/catalog/cards/global_mmlu/lt 2026-05-27T11:53:33,897 copying src/unitxt/catalog/cards/global_mmlu/lt/conceptual_physics.json -> build/lib/unitxt/catalog/cards/global_mmlu/lt 2026-05-27T11:53:33,899 copying src/unitxt/catalog/cards/global_mmlu/lt/high_school_geography.json -> build/lib/unitxt/catalog/cards/global_mmlu/lt 2026-05-27T11:53:33,901 copying src/unitxt/catalog/cards/global_mmlu/lt/human_aging.json -> build/lib/unitxt/catalog/cards/global_mmlu/lt 2026-05-27T11:53:33,903 copying src/unitxt/catalog/cards/global_mmlu/lt/electrical_engineering.json -> build/lib/unitxt/catalog/cards/global_mmlu/lt 2026-05-27T11:53:33,906 copying src/unitxt/catalog/cards/global_mmlu/lt/management.json -> build/lib/unitxt/catalog/cards/global_mmlu/lt 2026-05-27T11:53:33,908 copying src/unitxt/catalog/cards/global_mmlu/lt/high_school_world_history.json -> build/lib/unitxt/catalog/cards/global_mmlu/lt 2026-05-27T11:53:33,910 copying src/unitxt/catalog/cards/global_mmlu/lt/marketing.json -> build/lib/unitxt/catalog/cards/global_mmlu/lt 2026-05-27T11:53:33,912 copying src/unitxt/catalog/cards/global_mmlu/lt/high_school_european_history.json -> build/lib/unitxt/catalog/cards/global_mmlu/lt 2026-05-27T11:53:33,914 copying src/unitxt/catalog/cards/global_mmlu/lt/astronomy.json -> build/lib/unitxt/catalog/cards/global_mmlu/lt 2026-05-27T11:53:33,917 copying src/unitxt/catalog/cards/global_mmlu/lt/high_school_physics.json -> build/lib/unitxt/catalog/cards/global_mmlu/lt 2026-05-27T11:53:33,919 copying src/unitxt/catalog/cards/global_mmlu/lt/public_relations.json -> build/lib/unitxt/catalog/cards/global_mmlu/lt 2026-05-27T11:53:33,921 copying src/unitxt/catalog/cards/global_mmlu/lt/high_school_microeconomics.json -> build/lib/unitxt/catalog/cards/global_mmlu/lt 2026-05-27T11:53:33,923 copying src/unitxt/catalog/cards/global_mmlu/lt/virology.json -> build/lib/unitxt/catalog/cards/global_mmlu/lt 2026-05-27T11:53:33,926 copying src/unitxt/catalog/cards/global_mmlu/lt/high_school_us_history.json -> build/lib/unitxt/catalog/cards/global_mmlu/lt 2026-05-27T11:53:33,928 copying src/unitxt/catalog/cards/global_mmlu/lt/high_school_statistics.json -> build/lib/unitxt/catalog/cards/global_mmlu/lt 2026-05-27T11:53:33,930 copying src/unitxt/catalog/cards/global_mmlu/lt/miscellaneous.json -> build/lib/unitxt/catalog/cards/global_mmlu/lt 2026-05-27T11:53:33,932 copying src/unitxt/catalog/cards/global_mmlu/lt/high_school_mathematics.json -> build/lib/unitxt/catalog/cards/global_mmlu/lt 2026-05-27T11:53:33,934 copying src/unitxt/catalog/cards/global_mmlu/lt/formal_logic.json -> build/lib/unitxt/catalog/cards/global_mmlu/lt 2026-05-27T11:53:33,937 copying src/unitxt/catalog/cards/global_mmlu/lt/high_school_chemistry.json -> build/lib/unitxt/catalog/cards/global_mmlu/lt 2026-05-27T11:53:33,939 copying src/unitxt/catalog/cards/global_mmlu/lt/abstract_algebra.json -> build/lib/unitxt/catalog/cards/global_mmlu/lt 2026-05-27T11:53:33,941 copying src/unitxt/catalog/cards/global_mmlu/lt/moral_scenarios.json -> build/lib/unitxt/catalog/cards/global_mmlu/lt 2026-05-27T11:53:33,943 copying src/unitxt/catalog/cards/global_mmlu/lt/world_religions.json -> build/lib/unitxt/catalog/cards/global_mmlu/lt 2026-05-27T11:53:33,945 copying src/unitxt/catalog/cards/global_mmlu/lt/business_ethics.json -> build/lib/unitxt/catalog/cards/global_mmlu/lt 2026-05-27T11:53:33,948 copying src/unitxt/catalog/cards/global_mmlu/lt/security_studies.json -> build/lib/unitxt/catalog/cards/global_mmlu/lt 2026-05-27T11:53:33,950 copying src/unitxt/catalog/cards/global_mmlu/lt/college_medicine.json -> build/lib/unitxt/catalog/cards/global_mmlu/lt 2026-05-27T11:53:33,952 copying src/unitxt/catalog/cards/global_mmlu/lt/human_sexuality.json -> build/lib/unitxt/catalog/cards/global_mmlu/lt 2026-05-27T11:53:33,954 copying src/unitxt/catalog/cards/global_mmlu/lt/prehistory.json -> build/lib/unitxt/catalog/cards/global_mmlu/lt 2026-05-27T11:53:33,957 creating build/lib/unitxt/catalog/cards/global_mmlu/ky 2026-05-27T11:53:33,958 copying src/unitxt/catalog/cards/global_mmlu/ky/moral_disputes.json -> build/lib/unitxt/catalog/cards/global_mmlu/ky 2026-05-27T11:53:33,960 copying src/unitxt/catalog/cards/global_mmlu/ky/high_school_biology.json -> build/lib/unitxt/catalog/cards/global_mmlu/ky 2026-05-27T11:53:33,962 copying src/unitxt/catalog/cards/global_mmlu/ky/jurisprudence.json -> build/lib/unitxt/catalog/cards/global_mmlu/ky 2026-05-27T11:53:33,964 copying src/unitxt/catalog/cards/global_mmlu/ky/logical_fallacies.json -> build/lib/unitxt/catalog/cards/global_mmlu/ky 2026-05-27T11:53:33,967 copying src/unitxt/catalog/cards/global_mmlu/ky/college_chemistry.json -> build/lib/unitxt/catalog/cards/global_mmlu/ky 2026-05-27T11:53:33,969 copying src/unitxt/catalog/cards/global_mmlu/ky/high_school_government_and_politics.json -> build/lib/unitxt/catalog/cards/global_mmlu/ky 2026-05-27T11:53:33,971 copying src/unitxt/catalog/cards/global_mmlu/ky/college_mathematics.json -> build/lib/unitxt/catalog/cards/global_mmlu/ky 2026-05-27T11:53:33,973 copying src/unitxt/catalog/cards/global_mmlu/ky/econometrics.json -> build/lib/unitxt/catalog/cards/global_mmlu/ky 2026-05-27T11:53:33,975 copying src/unitxt/catalog/cards/global_mmlu/ky/high_school_macroeconomics.json -> build/lib/unitxt/catalog/cards/global_mmlu/ky 2026-05-27T11:53:33,978 copying src/unitxt/catalog/cards/global_mmlu/ky/high_school_psychology.json -> build/lib/unitxt/catalog/cards/global_mmlu/ky 2026-05-27T11:53:33,980 copying src/unitxt/catalog/cards/global_mmlu/ky/computer_security.json -> build/lib/unitxt/catalog/cards/global_mmlu/ky 2026-05-27T11:53:33,982 copying src/unitxt/catalog/cards/global_mmlu/ky/sociology.json -> build/lib/unitxt/catalog/cards/global_mmlu/ky 2026-05-27T11:53:33,985 copying src/unitxt/catalog/cards/global_mmlu/ky/nutrition.json -> build/lib/unitxt/catalog/cards/global_mmlu/ky 2026-05-27T11:53:33,987 copying src/unitxt/catalog/cards/global_mmlu/ky/professional_medicine.json -> build/lib/unitxt/catalog/cards/global_mmlu/ky 2026-05-27T11:53:33,989 copying src/unitxt/catalog/cards/global_mmlu/ky/college_biology.json -> build/lib/unitxt/catalog/cards/global_mmlu/ky 2026-05-27T11:53:33,991 copying src/unitxt/catalog/cards/global_mmlu/ky/anatomy.json -> build/lib/unitxt/catalog/cards/global_mmlu/ky 2026-05-27T11:53:33,993 copying src/unitxt/catalog/cards/global_mmlu/ky/professional_law.json -> build/lib/unitxt/catalog/cards/global_mmlu/ky 2026-05-27T11:53:33,995 copying src/unitxt/catalog/cards/global_mmlu/ky/machine_learning.json -> build/lib/unitxt/catalog/cards/global_mmlu/ky 2026-05-27T11:53:33,997 copying src/unitxt/catalog/cards/global_mmlu/ky/international_law.json -> build/lib/unitxt/catalog/cards/global_mmlu/ky 2026-05-27T11:53:33,999 copying src/unitxt/catalog/cards/global_mmlu/ky/medical_genetics.json -> build/lib/unitxt/catalog/cards/global_mmlu/ky 2026-05-27T11:53:34,002 copying src/unitxt/catalog/cards/global_mmlu/ky/high_school_computer_science.json -> build/lib/unitxt/catalog/cards/global_mmlu/ky 2026-05-27T11:53:34,004 copying src/unitxt/catalog/cards/global_mmlu/ky/clinical_knowledge.json -> build/lib/unitxt/catalog/cards/global_mmlu/ky 2026-05-27T11:53:34,006 copying src/unitxt/catalog/cards/global_mmlu/ky/college_physics.json -> build/lib/unitxt/catalog/cards/global_mmlu/ky 2026-05-27T11:53:34,008 copying src/unitxt/catalog/cards/global_mmlu/ky/global_facts.json -> build/lib/unitxt/catalog/cards/global_mmlu/ky 2026-05-27T11:53:34,010 copying src/unitxt/catalog/cards/global_mmlu/ky/college_computer_science.json -> build/lib/unitxt/catalog/cards/global_mmlu/ky 2026-05-27T11:53:34,013 copying src/unitxt/catalog/cards/global_mmlu/ky/us_foreign_policy.json -> build/lib/unitxt/catalog/cards/global_mmlu/ky 2026-05-27T11:53:34,015 copying src/unitxt/catalog/cards/global_mmlu/ky/professional_accounting.json -> build/lib/unitxt/catalog/cards/global_mmlu/ky 2026-05-27T11:53:34,017 copying src/unitxt/catalog/cards/global_mmlu/ky/professional_psychology.json -> build/lib/unitxt/catalog/cards/global_mmlu/ky 2026-05-27T11:53:34,020 copying src/unitxt/catalog/cards/global_mmlu/ky/philosophy.json -> build/lib/unitxt/catalog/cards/global_mmlu/ky 2026-05-27T11:53:34,022 copying src/unitxt/catalog/cards/global_mmlu/ky/elementary_mathematics.json -> build/lib/unitxt/catalog/cards/global_mmlu/ky 2026-05-27T11:53:34,024 copying src/unitxt/catalog/cards/global_mmlu/ky/conceptual_physics.json -> build/lib/unitxt/catalog/cards/global_mmlu/ky 2026-05-27T11:53:34,027 copying src/unitxt/catalog/cards/global_mmlu/ky/high_school_geography.json -> build/lib/unitxt/catalog/cards/global_mmlu/ky 2026-05-27T11:53:34,029 copying src/unitxt/catalog/cards/global_mmlu/ky/human_aging.json -> build/lib/unitxt/catalog/cards/global_mmlu/ky 2026-05-27T11:53:34,031 copying src/unitxt/catalog/cards/global_mmlu/ky/electrical_engineering.json -> build/lib/unitxt/catalog/cards/global_mmlu/ky 2026-05-27T11:53:34,034 copying src/unitxt/catalog/cards/global_mmlu/ky/management.json -> build/lib/unitxt/catalog/cards/global_mmlu/ky 2026-05-27T11:53:34,036 copying src/unitxt/catalog/cards/global_mmlu/ky/high_school_world_history.json -> build/lib/unitxt/catalog/cards/global_mmlu/ky 2026-05-27T11:53:34,038 copying src/unitxt/catalog/cards/global_mmlu/ky/marketing.json -> build/lib/unitxt/catalog/cards/global_mmlu/ky 2026-05-27T11:53:34,040 copying src/unitxt/catalog/cards/global_mmlu/ky/high_school_european_history.json -> build/lib/unitxt/catalog/cards/global_mmlu/ky 2026-05-27T11:53:34,043 copying src/unitxt/catalog/cards/global_mmlu/ky/astronomy.json -> build/lib/unitxt/catalog/cards/global_mmlu/ky 2026-05-27T11:53:34,045 copying src/unitxt/catalog/cards/global_mmlu/ky/high_school_physics.json -> build/lib/unitxt/catalog/cards/global_mmlu/ky 2026-05-27T11:53:34,048 copying src/unitxt/catalog/cards/global_mmlu/ky/public_relations.json -> build/lib/unitxt/catalog/cards/global_mmlu/ky 2026-05-27T11:53:34,050 copying src/unitxt/catalog/cards/global_mmlu/ky/high_school_microeconomics.json -> build/lib/unitxt/catalog/cards/global_mmlu/ky 2026-05-27T11:53:34,052 copying src/unitxt/catalog/cards/global_mmlu/ky/virology.json -> build/lib/unitxt/catalog/cards/global_mmlu/ky 2026-05-27T11:53:34,054 copying src/unitxt/catalog/cards/global_mmlu/ky/high_school_us_history.json -> build/lib/unitxt/catalog/cards/global_mmlu/ky 2026-05-27T11:53:34,057 copying src/unitxt/catalog/cards/global_mmlu/ky/high_school_statistics.json -> build/lib/unitxt/catalog/cards/global_mmlu/ky 2026-05-27T11:53:34,059 copying src/unitxt/catalog/cards/global_mmlu/ky/miscellaneous.json -> build/lib/unitxt/catalog/cards/global_mmlu/ky 2026-05-27T11:53:34,061 copying src/unitxt/catalog/cards/global_mmlu/ky/high_school_mathematics.json -> build/lib/unitxt/catalog/cards/global_mmlu/ky 2026-05-27T11:53:34,063 copying src/unitxt/catalog/cards/global_mmlu/ky/formal_logic.json -> build/lib/unitxt/catalog/cards/global_mmlu/ky 2026-05-27T11:53:34,066 copying src/unitxt/catalog/cards/global_mmlu/ky/high_school_chemistry.json -> build/lib/unitxt/catalog/cards/global_mmlu/ky 2026-05-27T11:53:34,068 copying src/unitxt/catalog/cards/global_mmlu/ky/abstract_algebra.json -> build/lib/unitxt/catalog/cards/global_mmlu/ky 2026-05-27T11:53:34,070 copying src/unitxt/catalog/cards/global_mmlu/ky/moral_scenarios.json -> build/lib/unitxt/catalog/cards/global_mmlu/ky 2026-05-27T11:53:34,072 copying src/unitxt/catalog/cards/global_mmlu/ky/world_religions.json -> build/lib/unitxt/catalog/cards/global_mmlu/ky 2026-05-27T11:53:34,074 copying src/unitxt/catalog/cards/global_mmlu/ky/business_ethics.json -> build/lib/unitxt/catalog/cards/global_mmlu/ky 2026-05-27T11:53:34,077 copying src/unitxt/catalog/cards/global_mmlu/ky/security_studies.json -> build/lib/unitxt/catalog/cards/global_mmlu/ky 2026-05-27T11:53:34,079 copying src/unitxt/catalog/cards/global_mmlu/ky/college_medicine.json -> build/lib/unitxt/catalog/cards/global_mmlu/ky 2026-05-27T11:53:34,081 copying src/unitxt/catalog/cards/global_mmlu/ky/human_sexuality.json -> build/lib/unitxt/catalog/cards/global_mmlu/ky 2026-05-27T11:53:34,083 copying src/unitxt/catalog/cards/global_mmlu/ky/prehistory.json -> build/lib/unitxt/catalog/cards/global_mmlu/ky 2026-05-27T11:53:34,085 creating build/lib/unitxt/catalog/cards/global_mmlu/id 2026-05-27T11:53:34,086 copying src/unitxt/catalog/cards/global_mmlu/id/moral_disputes.json -> build/lib/unitxt/catalog/cards/global_mmlu/id 2026-05-27T11:53:34,089 copying src/unitxt/catalog/cards/global_mmlu/id/high_school_biology.json -> build/lib/unitxt/catalog/cards/global_mmlu/id 2026-05-27T11:53:34,091 copying src/unitxt/catalog/cards/global_mmlu/id/jurisprudence.json -> build/lib/unitxt/catalog/cards/global_mmlu/id 2026-05-27T11:53:34,093 copying src/unitxt/catalog/cards/global_mmlu/id/logical_fallacies.json -> build/lib/unitxt/catalog/cards/global_mmlu/id 2026-05-27T11:53:34,095 copying src/unitxt/catalog/cards/global_mmlu/id/college_chemistry.json -> build/lib/unitxt/catalog/cards/global_mmlu/id 2026-05-27T11:53:34,097 copying src/unitxt/catalog/cards/global_mmlu/id/high_school_government_and_politics.json -> build/lib/unitxt/catalog/cards/global_mmlu/id 2026-05-27T11:53:34,099 copying src/unitxt/catalog/cards/global_mmlu/id/college_mathematics.json -> build/lib/unitxt/catalog/cards/global_mmlu/id 2026-05-27T11:53:34,102 copying src/unitxt/catalog/cards/global_mmlu/id/econometrics.json -> build/lib/unitxt/catalog/cards/global_mmlu/id 2026-05-27T11:53:34,104 copying src/unitxt/catalog/cards/global_mmlu/id/high_school_macroeconomics.json -> build/lib/unitxt/catalog/cards/global_mmlu/id 2026-05-27T11:53:34,106 copying src/unitxt/catalog/cards/global_mmlu/id/high_school_psychology.json -> build/lib/unitxt/catalog/cards/global_mmlu/id 2026-05-27T11:53:34,108 copying src/unitxt/catalog/cards/global_mmlu/id/computer_security.json -> build/lib/unitxt/catalog/cards/global_mmlu/id 2026-05-27T11:53:34,110 copying src/unitxt/catalog/cards/global_mmlu/id/sociology.json -> build/lib/unitxt/catalog/cards/global_mmlu/id 2026-05-27T11:53:34,112 copying src/unitxt/catalog/cards/global_mmlu/id/nutrition.json -> build/lib/unitxt/catalog/cards/global_mmlu/id 2026-05-27T11:53:34,114 copying src/unitxt/catalog/cards/global_mmlu/id/professional_medicine.json -> build/lib/unitxt/catalog/cards/global_mmlu/id 2026-05-27T11:53:34,117 copying src/unitxt/catalog/cards/global_mmlu/id/college_biology.json -> build/lib/unitxt/catalog/cards/global_mmlu/id 2026-05-27T11:53:34,119 copying src/unitxt/catalog/cards/global_mmlu/id/anatomy.json -> build/lib/unitxt/catalog/cards/global_mmlu/id 2026-05-27T11:53:34,121 copying src/unitxt/catalog/cards/global_mmlu/id/professional_law.json -> build/lib/unitxt/catalog/cards/global_mmlu/id 2026-05-27T11:53:34,123 copying src/unitxt/catalog/cards/global_mmlu/id/machine_learning.json -> build/lib/unitxt/catalog/cards/global_mmlu/id 2026-05-27T11:53:34,125 copying src/unitxt/catalog/cards/global_mmlu/id/international_law.json -> build/lib/unitxt/catalog/cards/global_mmlu/id 2026-05-27T11:53:34,127 copying src/unitxt/catalog/cards/global_mmlu/id/medical_genetics.json -> build/lib/unitxt/catalog/cards/global_mmlu/id 2026-05-27T11:53:34,129 copying src/unitxt/catalog/cards/global_mmlu/id/high_school_computer_science.json -> build/lib/unitxt/catalog/cards/global_mmlu/id 2026-05-27T11:53:34,131 copying src/unitxt/catalog/cards/global_mmlu/id/clinical_knowledge.json -> build/lib/unitxt/catalog/cards/global_mmlu/id 2026-05-27T11:53:34,133 copying src/unitxt/catalog/cards/global_mmlu/id/college_physics.json -> build/lib/unitxt/catalog/cards/global_mmlu/id 2026-05-27T11:53:34,135 copying src/unitxt/catalog/cards/global_mmlu/id/global_facts.json -> build/lib/unitxt/catalog/cards/global_mmlu/id 2026-05-27T11:53:34,138 copying src/unitxt/catalog/cards/global_mmlu/id/college_computer_science.json -> build/lib/unitxt/catalog/cards/global_mmlu/id 2026-05-27T11:53:34,140 copying src/unitxt/catalog/cards/global_mmlu/id/us_foreign_policy.json -> build/lib/unitxt/catalog/cards/global_mmlu/id 2026-05-27T11:53:34,142 copying src/unitxt/catalog/cards/global_mmlu/id/professional_accounting.json -> build/lib/unitxt/catalog/cards/global_mmlu/id 2026-05-27T11:53:34,144 copying src/unitxt/catalog/cards/global_mmlu/id/professional_psychology.json -> build/lib/unitxt/catalog/cards/global_mmlu/id 2026-05-27T11:53:34,146 copying src/unitxt/catalog/cards/global_mmlu/id/philosophy.json -> build/lib/unitxt/catalog/cards/global_mmlu/id 2026-05-27T11:53:34,148 copying src/unitxt/catalog/cards/global_mmlu/id/elementary_mathematics.json -> build/lib/unitxt/catalog/cards/global_mmlu/id 2026-05-27T11:53:34,150 copying src/unitxt/catalog/cards/global_mmlu/id/conceptual_physics.json -> build/lib/unitxt/catalog/cards/global_mmlu/id 2026-05-27T11:53:34,153 copying src/unitxt/catalog/cards/global_mmlu/id/high_school_geography.json -> build/lib/unitxt/catalog/cards/global_mmlu/id 2026-05-27T11:53:34,155 copying src/unitxt/catalog/cards/global_mmlu/id/human_aging.json -> build/lib/unitxt/catalog/cards/global_mmlu/id 2026-05-27T11:53:34,157 copying src/unitxt/catalog/cards/global_mmlu/id/electrical_engineering.json -> build/lib/unitxt/catalog/cards/global_mmlu/id 2026-05-27T11:53:34,159 copying src/unitxt/catalog/cards/global_mmlu/id/management.json -> build/lib/unitxt/catalog/cards/global_mmlu/id 2026-05-27T11:53:34,161 copying src/unitxt/catalog/cards/global_mmlu/id/high_school_world_history.json -> build/lib/unitxt/catalog/cards/global_mmlu/id 2026-05-27T11:53:34,164 copying src/unitxt/catalog/cards/global_mmlu/id/marketing.json -> build/lib/unitxt/catalog/cards/global_mmlu/id 2026-05-27T11:53:34,166 copying src/unitxt/catalog/cards/global_mmlu/id/high_school_european_history.json -> build/lib/unitxt/catalog/cards/global_mmlu/id 2026-05-27T11:53:34,168 copying src/unitxt/catalog/cards/global_mmlu/id/astronomy.json -> build/lib/unitxt/catalog/cards/global_mmlu/id 2026-05-27T11:53:34,170 copying src/unitxt/catalog/cards/global_mmlu/id/high_school_physics.json -> build/lib/unitxt/catalog/cards/global_mmlu/id 2026-05-27T11:53:34,173 copying src/unitxt/catalog/cards/global_mmlu/id/public_relations.json -> build/lib/unitxt/catalog/cards/global_mmlu/id 2026-05-27T11:53:34,175 copying src/unitxt/catalog/cards/global_mmlu/id/high_school_microeconomics.json -> build/lib/unitxt/catalog/cards/global_mmlu/id 2026-05-27T11:53:34,177 copying src/unitxt/catalog/cards/global_mmlu/id/virology.json -> build/lib/unitxt/catalog/cards/global_mmlu/id 2026-05-27T11:53:34,179 copying src/unitxt/catalog/cards/global_mmlu/id/high_school_us_history.json -> build/lib/unitxt/catalog/cards/global_mmlu/id 2026-05-27T11:53:34,181 copying src/unitxt/catalog/cards/global_mmlu/id/high_school_statistics.json -> build/lib/unitxt/catalog/cards/global_mmlu/id 2026-05-27T11:53:34,183 copying src/unitxt/catalog/cards/global_mmlu/id/miscellaneous.json -> build/lib/unitxt/catalog/cards/global_mmlu/id 2026-05-27T11:53:34,185 copying src/unitxt/catalog/cards/global_mmlu/id/high_school_mathematics.json -> build/lib/unitxt/catalog/cards/global_mmlu/id 2026-05-27T11:53:34,187 copying src/unitxt/catalog/cards/global_mmlu/id/formal_logic.json -> build/lib/unitxt/catalog/cards/global_mmlu/id 2026-05-27T11:53:34,190 copying src/unitxt/catalog/cards/global_mmlu/id/high_school_chemistry.json -> build/lib/unitxt/catalog/cards/global_mmlu/id 2026-05-27T11:53:34,192 copying src/unitxt/catalog/cards/global_mmlu/id/abstract_algebra.json -> build/lib/unitxt/catalog/cards/global_mmlu/id 2026-05-27T11:53:34,194 copying src/unitxt/catalog/cards/global_mmlu/id/moral_scenarios.json -> build/lib/unitxt/catalog/cards/global_mmlu/id 2026-05-27T11:53:34,196 copying src/unitxt/catalog/cards/global_mmlu/id/world_religions.json -> build/lib/unitxt/catalog/cards/global_mmlu/id 2026-05-27T11:53:34,198 copying src/unitxt/catalog/cards/global_mmlu/id/business_ethics.json -> build/lib/unitxt/catalog/cards/global_mmlu/id 2026-05-27T11:53:34,201 copying src/unitxt/catalog/cards/global_mmlu/id/security_studies.json -> build/lib/unitxt/catalog/cards/global_mmlu/id 2026-05-27T11:53:34,203 copying src/unitxt/catalog/cards/global_mmlu/id/college_medicine.json -> build/lib/unitxt/catalog/cards/global_mmlu/id 2026-05-27T11:53:34,205 copying src/unitxt/catalog/cards/global_mmlu/id/human_sexuality.json -> build/lib/unitxt/catalog/cards/global_mmlu/id 2026-05-27T11:53:34,207 copying src/unitxt/catalog/cards/global_mmlu/id/prehistory.json -> build/lib/unitxt/catalog/cards/global_mmlu/id 2026-05-27T11:53:34,209 creating build/lib/unitxt/catalog/cards/global_mmlu/he 2026-05-27T11:53:34,210 copying src/unitxt/catalog/cards/global_mmlu/he/moral_disputes.json -> build/lib/unitxt/catalog/cards/global_mmlu/he 2026-05-27T11:53:34,213 copying src/unitxt/catalog/cards/global_mmlu/he/high_school_biology.json -> build/lib/unitxt/catalog/cards/global_mmlu/he 2026-05-27T11:53:34,215 copying src/unitxt/catalog/cards/global_mmlu/he/jurisprudence.json -> build/lib/unitxt/catalog/cards/global_mmlu/he 2026-05-27T11:53:34,217 copying src/unitxt/catalog/cards/global_mmlu/he/logical_fallacies.json -> build/lib/unitxt/catalog/cards/global_mmlu/he 2026-05-27T11:53:34,220 copying src/unitxt/catalog/cards/global_mmlu/he/college_chemistry.json -> build/lib/unitxt/catalog/cards/global_mmlu/he 2026-05-27T11:53:34,222 copying src/unitxt/catalog/cards/global_mmlu/he/high_school_government_and_politics.json -> build/lib/unitxt/catalog/cards/global_mmlu/he 2026-05-27T11:53:34,224 copying src/unitxt/catalog/cards/global_mmlu/he/college_mathematics.json -> build/lib/unitxt/catalog/cards/global_mmlu/he 2026-05-27T11:53:34,227 copying src/unitxt/catalog/cards/global_mmlu/he/econometrics.json -> build/lib/unitxt/catalog/cards/global_mmlu/he 2026-05-27T11:53:34,229 copying src/unitxt/catalog/cards/global_mmlu/he/high_school_macroeconomics.json -> build/lib/unitxt/catalog/cards/global_mmlu/he 2026-05-27T11:53:34,231 copying src/unitxt/catalog/cards/global_mmlu/he/high_school_psychology.json -> build/lib/unitxt/catalog/cards/global_mmlu/he 2026-05-27T11:53:34,233 copying src/unitxt/catalog/cards/global_mmlu/he/computer_security.json -> build/lib/unitxt/catalog/cards/global_mmlu/he 2026-05-27T11:53:34,236 copying src/unitxt/catalog/cards/global_mmlu/he/sociology.json -> build/lib/unitxt/catalog/cards/global_mmlu/he 2026-05-27T11:53:34,238 copying src/unitxt/catalog/cards/global_mmlu/he/nutrition.json -> build/lib/unitxt/catalog/cards/global_mmlu/he 2026-05-27T11:53:34,240 copying src/unitxt/catalog/cards/global_mmlu/he/professional_medicine.json -> build/lib/unitxt/catalog/cards/global_mmlu/he 2026-05-27T11:53:34,242 copying src/unitxt/catalog/cards/global_mmlu/he/college_biology.json -> build/lib/unitxt/catalog/cards/global_mmlu/he 2026-05-27T11:53:34,244 copying src/unitxt/catalog/cards/global_mmlu/he/anatomy.json -> build/lib/unitxt/catalog/cards/global_mmlu/he 2026-05-27T11:53:34,246 copying src/unitxt/catalog/cards/global_mmlu/he/professional_law.json -> build/lib/unitxt/catalog/cards/global_mmlu/he 2026-05-27T11:53:34,249 copying src/unitxt/catalog/cards/global_mmlu/he/machine_learning.json -> build/lib/unitxt/catalog/cards/global_mmlu/he 2026-05-27T11:53:34,251 copying src/unitxt/catalog/cards/global_mmlu/he/international_law.json -> build/lib/unitxt/catalog/cards/global_mmlu/he 2026-05-27T11:53:34,253 copying src/unitxt/catalog/cards/global_mmlu/he/medical_genetics.json -> build/lib/unitxt/catalog/cards/global_mmlu/he 2026-05-27T11:53:34,255 copying src/unitxt/catalog/cards/global_mmlu/he/high_school_computer_science.json -> build/lib/unitxt/catalog/cards/global_mmlu/he 2026-05-27T11:53:34,257 copying src/unitxt/catalog/cards/global_mmlu/he/clinical_knowledge.json -> build/lib/unitxt/catalog/cards/global_mmlu/he 2026-05-27T11:53:34,259 copying src/unitxt/catalog/cards/global_mmlu/he/college_physics.json -> build/lib/unitxt/catalog/cards/global_mmlu/he 2026-05-27T11:53:34,261 copying src/unitxt/catalog/cards/global_mmlu/he/global_facts.json -> build/lib/unitxt/catalog/cards/global_mmlu/he 2026-05-27T11:53:34,264 copying src/unitxt/catalog/cards/global_mmlu/he/college_computer_science.json -> build/lib/unitxt/catalog/cards/global_mmlu/he 2026-05-27T11:53:34,266 copying src/unitxt/catalog/cards/global_mmlu/he/us_foreign_policy.json -> build/lib/unitxt/catalog/cards/global_mmlu/he 2026-05-27T11:53:34,268 copying src/unitxt/catalog/cards/global_mmlu/he/professional_accounting.json -> build/lib/unitxt/catalog/cards/global_mmlu/he 2026-05-27T11:53:34,270 copying src/unitxt/catalog/cards/global_mmlu/he/professional_psychology.json -> build/lib/unitxt/catalog/cards/global_mmlu/he 2026-05-27T11:53:34,272 copying src/unitxt/catalog/cards/global_mmlu/he/philosophy.json -> build/lib/unitxt/catalog/cards/global_mmlu/he 2026-05-27T11:53:34,275 copying src/unitxt/catalog/cards/global_mmlu/he/elementary_mathematics.json -> build/lib/unitxt/catalog/cards/global_mmlu/he 2026-05-27T11:53:34,277 copying src/unitxt/catalog/cards/global_mmlu/he/conceptual_physics.json -> build/lib/unitxt/catalog/cards/global_mmlu/he 2026-05-27T11:53:34,279 copying src/unitxt/catalog/cards/global_mmlu/he/high_school_geography.json -> build/lib/unitxt/catalog/cards/global_mmlu/he 2026-05-27T11:53:34,282 copying src/unitxt/catalog/cards/global_mmlu/he/human_aging.json -> build/lib/unitxt/catalog/cards/global_mmlu/he 2026-05-27T11:53:34,284 copying src/unitxt/catalog/cards/global_mmlu/he/electrical_engineering.json -> build/lib/unitxt/catalog/cards/global_mmlu/he 2026-05-27T11:53:34,286 copying src/unitxt/catalog/cards/global_mmlu/he/management.json -> build/lib/unitxt/catalog/cards/global_mmlu/he 2026-05-27T11:53:34,288 copying src/unitxt/catalog/cards/global_mmlu/he/high_school_world_history.json -> build/lib/unitxt/catalog/cards/global_mmlu/he 2026-05-27T11:53:34,291 copying src/unitxt/catalog/cards/global_mmlu/he/marketing.json -> build/lib/unitxt/catalog/cards/global_mmlu/he 2026-05-27T11:53:34,293 copying src/unitxt/catalog/cards/global_mmlu/he/high_school_european_history.json -> build/lib/unitxt/catalog/cards/global_mmlu/he 2026-05-27T11:53:34,295 copying src/unitxt/catalog/cards/global_mmlu/he/astronomy.json -> build/lib/unitxt/catalog/cards/global_mmlu/he 2026-05-27T11:53:34,298 copying src/unitxt/catalog/cards/global_mmlu/he/high_school_physics.json -> build/lib/unitxt/catalog/cards/global_mmlu/he 2026-05-27T11:53:34,300 copying src/unitxt/catalog/cards/global_mmlu/he/public_relations.json -> build/lib/unitxt/catalog/cards/global_mmlu/he 2026-05-27T11:53:34,302 copying src/unitxt/catalog/cards/global_mmlu/he/high_school_microeconomics.json -> build/lib/unitxt/catalog/cards/global_mmlu/he 2026-05-27T11:53:34,304 copying src/unitxt/catalog/cards/global_mmlu/he/virology.json -> build/lib/unitxt/catalog/cards/global_mmlu/he 2026-05-27T11:53:34,306 copying src/unitxt/catalog/cards/global_mmlu/he/high_school_us_history.json -> build/lib/unitxt/catalog/cards/global_mmlu/he 2026-05-27T11:53:34,309 copying src/unitxt/catalog/cards/global_mmlu/he/high_school_statistics.json -> build/lib/unitxt/catalog/cards/global_mmlu/he 2026-05-27T11:53:34,311 copying src/unitxt/catalog/cards/global_mmlu/he/miscellaneous.json -> build/lib/unitxt/catalog/cards/global_mmlu/he 2026-05-27T11:53:34,313 copying src/unitxt/catalog/cards/global_mmlu/he/high_school_mathematics.json -> build/lib/unitxt/catalog/cards/global_mmlu/he 2026-05-27T11:53:34,315 copying src/unitxt/catalog/cards/global_mmlu/he/formal_logic.json -> build/lib/unitxt/catalog/cards/global_mmlu/he 2026-05-27T11:53:34,317 copying src/unitxt/catalog/cards/global_mmlu/he/high_school_chemistry.json -> build/lib/unitxt/catalog/cards/global_mmlu/he 2026-05-27T11:53:34,319 copying src/unitxt/catalog/cards/global_mmlu/he/abstract_algebra.json -> build/lib/unitxt/catalog/cards/global_mmlu/he 2026-05-27T11:53:34,322 copying src/unitxt/catalog/cards/global_mmlu/he/moral_scenarios.json -> build/lib/unitxt/catalog/cards/global_mmlu/he 2026-05-27T11:53:34,324 copying src/unitxt/catalog/cards/global_mmlu/he/world_religions.json -> build/lib/unitxt/catalog/cards/global_mmlu/he 2026-05-27T11:53:34,326 copying src/unitxt/catalog/cards/global_mmlu/he/business_ethics.json -> build/lib/unitxt/catalog/cards/global_mmlu/he 2026-05-27T11:53:34,328 copying src/unitxt/catalog/cards/global_mmlu/he/security_studies.json -> build/lib/unitxt/catalog/cards/global_mmlu/he 2026-05-27T11:53:34,330 copying src/unitxt/catalog/cards/global_mmlu/he/college_medicine.json -> build/lib/unitxt/catalog/cards/global_mmlu/he 2026-05-27T11:53:34,332 copying src/unitxt/catalog/cards/global_mmlu/he/human_sexuality.json -> build/lib/unitxt/catalog/cards/global_mmlu/he 2026-05-27T11:53:34,335 copying src/unitxt/catalog/cards/global_mmlu/he/prehistory.json -> build/lib/unitxt/catalog/cards/global_mmlu/he 2026-05-27T11:53:34,337 creating build/lib/unitxt/catalog/cards/global_mmlu/ja 2026-05-27T11:53:34,338 copying src/unitxt/catalog/cards/global_mmlu/ja/moral_disputes.json -> build/lib/unitxt/catalog/cards/global_mmlu/ja 2026-05-27T11:53:34,340 copying src/unitxt/catalog/cards/global_mmlu/ja/high_school_biology.json -> build/lib/unitxt/catalog/cards/global_mmlu/ja 2026-05-27T11:53:34,342 copying src/unitxt/catalog/cards/global_mmlu/ja/jurisprudence.json -> build/lib/unitxt/catalog/cards/global_mmlu/ja 2026-05-27T11:53:34,344 copying src/unitxt/catalog/cards/global_mmlu/ja/logical_fallacies.json -> build/lib/unitxt/catalog/cards/global_mmlu/ja 2026-05-27T11:53:34,347 copying src/unitxt/catalog/cards/global_mmlu/ja/college_chemistry.json -> build/lib/unitxt/catalog/cards/global_mmlu/ja 2026-05-27T11:53:34,349 copying src/unitxt/catalog/cards/global_mmlu/ja/high_school_government_and_politics.json -> build/lib/unitxt/catalog/cards/global_mmlu/ja 2026-05-27T11:53:34,351 copying src/unitxt/catalog/cards/global_mmlu/ja/college_mathematics.json -> build/lib/unitxt/catalog/cards/global_mmlu/ja 2026-05-27T11:53:34,353 copying src/unitxt/catalog/cards/global_mmlu/ja/econometrics.json -> build/lib/unitxt/catalog/cards/global_mmlu/ja 2026-05-27T11:53:34,356 copying src/unitxt/catalog/cards/global_mmlu/ja/high_school_macroeconomics.json -> build/lib/unitxt/catalog/cards/global_mmlu/ja 2026-05-27T11:53:34,358 copying src/unitxt/catalog/cards/global_mmlu/ja/high_school_psychology.json -> build/lib/unitxt/catalog/cards/global_mmlu/ja 2026-05-27T11:53:34,360 copying src/unitxt/catalog/cards/global_mmlu/ja/computer_security.json -> build/lib/unitxt/catalog/cards/global_mmlu/ja 2026-05-27T11:53:34,362 copying src/unitxt/catalog/cards/global_mmlu/ja/sociology.json -> build/lib/unitxt/catalog/cards/global_mmlu/ja 2026-05-27T11:53:34,364 copying src/unitxt/catalog/cards/global_mmlu/ja/nutrition.json -> build/lib/unitxt/catalog/cards/global_mmlu/ja 2026-05-27T11:53:34,366 copying src/unitxt/catalog/cards/global_mmlu/ja/professional_medicine.json -> build/lib/unitxt/catalog/cards/global_mmlu/ja 2026-05-27T11:53:34,368 copying src/unitxt/catalog/cards/global_mmlu/ja/college_biology.json -> build/lib/unitxt/catalog/cards/global_mmlu/ja 2026-05-27T11:53:34,371 copying src/unitxt/catalog/cards/global_mmlu/ja/anatomy.json -> build/lib/unitxt/catalog/cards/global_mmlu/ja 2026-05-27T11:53:34,373 copying src/unitxt/catalog/cards/global_mmlu/ja/professional_law.json -> build/lib/unitxt/catalog/cards/global_mmlu/ja 2026-05-27T11:53:34,375 copying src/unitxt/catalog/cards/global_mmlu/ja/machine_learning.json -> build/lib/unitxt/catalog/cards/global_mmlu/ja 2026-05-27T11:53:34,377 copying src/unitxt/catalog/cards/global_mmlu/ja/international_law.json -> build/lib/unitxt/catalog/cards/global_mmlu/ja 2026-05-27T11:53:34,380 copying src/unitxt/catalog/cards/global_mmlu/ja/medical_genetics.json -> build/lib/unitxt/catalog/cards/global_mmlu/ja 2026-05-27T11:53:34,382 copying src/unitxt/catalog/cards/global_mmlu/ja/high_school_computer_science.json -> build/lib/unitxt/catalog/cards/global_mmlu/ja 2026-05-27T11:53:34,384 copying src/unitxt/catalog/cards/global_mmlu/ja/clinical_knowledge.json -> build/lib/unitxt/catalog/cards/global_mmlu/ja 2026-05-27T11:53:34,386 copying src/unitxt/catalog/cards/global_mmlu/ja/college_physics.json -> build/lib/unitxt/catalog/cards/global_mmlu/ja 2026-05-27T11:53:34,389 copying src/unitxt/catalog/cards/global_mmlu/ja/global_facts.json -> build/lib/unitxt/catalog/cards/global_mmlu/ja 2026-05-27T11:53:34,391 copying src/unitxt/catalog/cards/global_mmlu/ja/college_computer_science.json -> build/lib/unitxt/catalog/cards/global_mmlu/ja 2026-05-27T11:53:34,393 copying src/unitxt/catalog/cards/global_mmlu/ja/us_foreign_policy.json -> build/lib/unitxt/catalog/cards/global_mmlu/ja 2026-05-27T11:53:34,396 copying src/unitxt/catalog/cards/global_mmlu/ja/professional_accounting.json -> build/lib/unitxt/catalog/cards/global_mmlu/ja 2026-05-27T11:53:34,398 copying src/unitxt/catalog/cards/global_mmlu/ja/professional_psychology.json -> build/lib/unitxt/catalog/cards/global_mmlu/ja 2026-05-27T11:53:34,400 copying src/unitxt/catalog/cards/global_mmlu/ja/philosophy.json -> build/lib/unitxt/catalog/cards/global_mmlu/ja 2026-05-27T11:53:34,402 copying src/unitxt/catalog/cards/global_mmlu/ja/elementary_mathematics.json -> build/lib/unitxt/catalog/cards/global_mmlu/ja 2026-05-27T11:53:34,405 copying src/unitxt/catalog/cards/global_mmlu/ja/conceptual_physics.json -> build/lib/unitxt/catalog/cards/global_mmlu/ja 2026-05-27T11:53:34,407 copying src/unitxt/catalog/cards/global_mmlu/ja/high_school_geography.json -> build/lib/unitxt/catalog/cards/global_mmlu/ja 2026-05-27T11:53:34,409 copying src/unitxt/catalog/cards/global_mmlu/ja/human_aging.json -> build/lib/unitxt/catalog/cards/global_mmlu/ja 2026-05-27T11:53:34,412 copying src/unitxt/catalog/cards/global_mmlu/ja/electrical_engineering.json -> build/lib/unitxt/catalog/cards/global_mmlu/ja 2026-05-27T11:53:34,414 copying src/unitxt/catalog/cards/global_mmlu/ja/management.json -> build/lib/unitxt/catalog/cards/global_mmlu/ja 2026-05-27T11:53:34,416 copying src/unitxt/catalog/cards/global_mmlu/ja/high_school_world_history.json -> build/lib/unitxt/catalog/cards/global_mmlu/ja 2026-05-27T11:53:34,419 copying src/unitxt/catalog/cards/global_mmlu/ja/marketing.json -> build/lib/unitxt/catalog/cards/global_mmlu/ja 2026-05-27T11:53:34,421 copying src/unitxt/catalog/cards/global_mmlu/ja/high_school_european_history.json -> build/lib/unitxt/catalog/cards/global_mmlu/ja 2026-05-27T11:53:34,423 copying src/unitxt/catalog/cards/global_mmlu/ja/astronomy.json -> build/lib/unitxt/catalog/cards/global_mmlu/ja 2026-05-27T11:53:34,425 copying src/unitxt/catalog/cards/global_mmlu/ja/high_school_physics.json -> build/lib/unitxt/catalog/cards/global_mmlu/ja 2026-05-27T11:53:34,428 copying src/unitxt/catalog/cards/global_mmlu/ja/public_relations.json -> build/lib/unitxt/catalog/cards/global_mmlu/ja 2026-05-27T11:53:34,430 copying src/unitxt/catalog/cards/global_mmlu/ja/high_school_microeconomics.json -> build/lib/unitxt/catalog/cards/global_mmlu/ja 2026-05-27T11:53:34,432 copying src/unitxt/catalog/cards/global_mmlu/ja/virology.json -> build/lib/unitxt/catalog/cards/global_mmlu/ja 2026-05-27T11:53:34,434 copying src/unitxt/catalog/cards/global_mmlu/ja/high_school_us_history.json -> build/lib/unitxt/catalog/cards/global_mmlu/ja 2026-05-27T11:53:34,436 copying src/unitxt/catalog/cards/global_mmlu/ja/high_school_statistics.json -> build/lib/unitxt/catalog/cards/global_mmlu/ja 2026-05-27T11:53:34,439 copying src/unitxt/catalog/cards/global_mmlu/ja/miscellaneous.json -> build/lib/unitxt/catalog/cards/global_mmlu/ja 2026-05-27T11:53:34,441 copying src/unitxt/catalog/cards/global_mmlu/ja/high_school_mathematics.json -> build/lib/unitxt/catalog/cards/global_mmlu/ja 2026-05-27T11:53:34,443 copying src/unitxt/catalog/cards/global_mmlu/ja/formal_logic.json -> build/lib/unitxt/catalog/cards/global_mmlu/ja 2026-05-27T11:53:34,445 copying src/unitxt/catalog/cards/global_mmlu/ja/high_school_chemistry.json -> build/lib/unitxt/catalog/cards/global_mmlu/ja 2026-05-27T11:53:34,448 copying src/unitxt/catalog/cards/global_mmlu/ja/abstract_algebra.json -> build/lib/unitxt/catalog/cards/global_mmlu/ja 2026-05-27T11:53:34,450 copying src/unitxt/catalog/cards/global_mmlu/ja/moral_scenarios.json -> build/lib/unitxt/catalog/cards/global_mmlu/ja 2026-05-27T11:53:34,452 copying src/unitxt/catalog/cards/global_mmlu/ja/world_religions.json -> build/lib/unitxt/catalog/cards/global_mmlu/ja 2026-05-27T11:53:34,455 copying src/unitxt/catalog/cards/global_mmlu/ja/business_ethics.json -> build/lib/unitxt/catalog/cards/global_mmlu/ja 2026-05-27T11:53:34,457 copying src/unitxt/catalog/cards/global_mmlu/ja/security_studies.json -> build/lib/unitxt/catalog/cards/global_mmlu/ja 2026-05-27T11:53:34,459 copying src/unitxt/catalog/cards/global_mmlu/ja/college_medicine.json -> build/lib/unitxt/catalog/cards/global_mmlu/ja 2026-05-27T11:53:34,461 copying src/unitxt/catalog/cards/global_mmlu/ja/human_sexuality.json -> build/lib/unitxt/catalog/cards/global_mmlu/ja 2026-05-27T11:53:34,464 copying src/unitxt/catalog/cards/global_mmlu/ja/prehistory.json -> build/lib/unitxt/catalog/cards/global_mmlu/ja 2026-05-27T11:53:34,466 creating build/lib/unitxt/catalog/cards/global_mmlu/bn 2026-05-27T11:53:34,467 copying src/unitxt/catalog/cards/global_mmlu/bn/moral_disputes.json -> build/lib/unitxt/catalog/cards/global_mmlu/bn 2026-05-27T11:53:34,469 copying src/unitxt/catalog/cards/global_mmlu/bn/high_school_biology.json -> build/lib/unitxt/catalog/cards/global_mmlu/bn 2026-05-27T11:53:34,472 copying src/unitxt/catalog/cards/global_mmlu/bn/jurisprudence.json -> build/lib/unitxt/catalog/cards/global_mmlu/bn 2026-05-27T11:53:34,474 copying src/unitxt/catalog/cards/global_mmlu/bn/logical_fallacies.json -> build/lib/unitxt/catalog/cards/global_mmlu/bn 2026-05-27T11:53:34,476 copying src/unitxt/catalog/cards/global_mmlu/bn/college_chemistry.json -> build/lib/unitxt/catalog/cards/global_mmlu/bn 2026-05-27T11:53:34,479 copying src/unitxt/catalog/cards/global_mmlu/bn/high_school_government_and_politics.json -> build/lib/unitxt/catalog/cards/global_mmlu/bn 2026-05-27T11:53:34,481 copying src/unitxt/catalog/cards/global_mmlu/bn/college_mathematics.json -> build/lib/unitxt/catalog/cards/global_mmlu/bn 2026-05-27T11:53:34,483 copying src/unitxt/catalog/cards/global_mmlu/bn/econometrics.json -> build/lib/unitxt/catalog/cards/global_mmlu/bn 2026-05-27T11:53:34,485 copying src/unitxt/catalog/cards/global_mmlu/bn/high_school_macroeconomics.json -> build/lib/unitxt/catalog/cards/global_mmlu/bn 2026-05-27T11:53:34,487 copying src/unitxt/catalog/cards/global_mmlu/bn/high_school_psychology.json -> build/lib/unitxt/catalog/cards/global_mmlu/bn 2026-05-27T11:53:34,490 copying src/unitxt/catalog/cards/global_mmlu/bn/computer_security.json -> build/lib/unitxt/catalog/cards/global_mmlu/bn 2026-05-27T11:53:34,492 copying src/unitxt/catalog/cards/global_mmlu/bn/sociology.json -> build/lib/unitxt/catalog/cards/global_mmlu/bn 2026-05-27T11:53:34,494 copying src/unitxt/catalog/cards/global_mmlu/bn/nutrition.json -> build/lib/unitxt/catalog/cards/global_mmlu/bn 2026-05-27T11:53:34,496 copying src/unitxt/catalog/cards/global_mmlu/bn/professional_medicine.json -> build/lib/unitxt/catalog/cards/global_mmlu/bn 2026-05-27T11:53:34,498 copying src/unitxt/catalog/cards/global_mmlu/bn/college_biology.json -> build/lib/unitxt/catalog/cards/global_mmlu/bn 2026-05-27T11:53:34,501 copying src/unitxt/catalog/cards/global_mmlu/bn/anatomy.json -> build/lib/unitxt/catalog/cards/global_mmlu/bn 2026-05-27T11:53:34,503 copying src/unitxt/catalog/cards/global_mmlu/bn/professional_law.json -> build/lib/unitxt/catalog/cards/global_mmlu/bn 2026-05-27T11:53:34,505 copying src/unitxt/catalog/cards/global_mmlu/bn/machine_learning.json -> build/lib/unitxt/catalog/cards/global_mmlu/bn 2026-05-27T11:53:34,507 copying src/unitxt/catalog/cards/global_mmlu/bn/international_law.json -> build/lib/unitxt/catalog/cards/global_mmlu/bn 2026-05-27T11:53:34,510 copying src/unitxt/catalog/cards/global_mmlu/bn/medical_genetics.json -> build/lib/unitxt/catalog/cards/global_mmlu/bn 2026-05-27T11:53:34,512 copying src/unitxt/catalog/cards/global_mmlu/bn/high_school_computer_science.json -> build/lib/unitxt/catalog/cards/global_mmlu/bn 2026-05-27T11:53:34,514 copying src/unitxt/catalog/cards/global_mmlu/bn/clinical_knowledge.json -> build/lib/unitxt/catalog/cards/global_mmlu/bn 2026-05-27T11:53:34,516 copying src/unitxt/catalog/cards/global_mmlu/bn/college_physics.json -> build/lib/unitxt/catalog/cards/global_mmlu/bn 2026-05-27T11:53:34,519 copying src/unitxt/catalog/cards/global_mmlu/bn/global_facts.json -> build/lib/unitxt/catalog/cards/global_mmlu/bn 2026-05-27T11:53:34,521 copying src/unitxt/catalog/cards/global_mmlu/bn/college_computer_science.json -> build/lib/unitxt/catalog/cards/global_mmlu/bn 2026-05-27T11:53:34,523 copying src/unitxt/catalog/cards/global_mmlu/bn/us_foreign_policy.json -> build/lib/unitxt/catalog/cards/global_mmlu/bn 2026-05-27T11:53:34,525 copying src/unitxt/catalog/cards/global_mmlu/bn/professional_accounting.json -> build/lib/unitxt/catalog/cards/global_mmlu/bn 2026-05-27T11:53:34,528 copying src/unitxt/catalog/cards/global_mmlu/bn/professional_psychology.json -> build/lib/unitxt/catalog/cards/global_mmlu/bn 2026-05-27T11:53:34,530 copying src/unitxt/catalog/cards/global_mmlu/bn/philosophy.json -> build/lib/unitxt/catalog/cards/global_mmlu/bn 2026-05-27T11:53:34,533 copying src/unitxt/catalog/cards/global_mmlu/bn/elementary_mathematics.json -> build/lib/unitxt/catalog/cards/global_mmlu/bn 2026-05-27T11:53:34,535 copying src/unitxt/catalog/cards/global_mmlu/bn/conceptual_physics.json -> build/lib/unitxt/catalog/cards/global_mmlu/bn 2026-05-27T11:53:34,538 copying src/unitxt/catalog/cards/global_mmlu/bn/high_school_geography.json -> build/lib/unitxt/catalog/cards/global_mmlu/bn 2026-05-27T11:53:34,540 copying src/unitxt/catalog/cards/global_mmlu/bn/human_aging.json -> build/lib/unitxt/catalog/cards/global_mmlu/bn 2026-05-27T11:53:34,542 copying src/unitxt/catalog/cards/global_mmlu/bn/electrical_engineering.json -> build/lib/unitxt/catalog/cards/global_mmlu/bn 2026-05-27T11:53:34,544 copying src/unitxt/catalog/cards/global_mmlu/bn/management.json -> build/lib/unitxt/catalog/cards/global_mmlu/bn 2026-05-27T11:53:34,547 copying src/unitxt/catalog/cards/global_mmlu/bn/high_school_world_history.json -> build/lib/unitxt/catalog/cards/global_mmlu/bn 2026-05-27T11:53:34,549 copying src/unitxt/catalog/cards/global_mmlu/bn/marketing.json -> build/lib/unitxt/catalog/cards/global_mmlu/bn 2026-05-27T11:53:34,551 copying src/unitxt/catalog/cards/global_mmlu/bn/high_school_european_history.json -> build/lib/unitxt/catalog/cards/global_mmlu/bn 2026-05-27T11:53:34,553 copying src/unitxt/catalog/cards/global_mmlu/bn/astronomy.json -> build/lib/unitxt/catalog/cards/global_mmlu/bn 2026-05-27T11:53:34,555 copying src/unitxt/catalog/cards/global_mmlu/bn/high_school_physics.json -> build/lib/unitxt/catalog/cards/global_mmlu/bn 2026-05-27T11:53:34,558 copying src/unitxt/catalog/cards/global_mmlu/bn/public_relations.json -> build/lib/unitxt/catalog/cards/global_mmlu/bn 2026-05-27T11:53:34,560 copying src/unitxt/catalog/cards/global_mmlu/bn/high_school_microeconomics.json -> build/lib/unitxt/catalog/cards/global_mmlu/bn 2026-05-27T11:53:34,562 copying src/unitxt/catalog/cards/global_mmlu/bn/virology.json -> build/lib/unitxt/catalog/cards/global_mmlu/bn 2026-05-27T11:53:34,564 copying src/unitxt/catalog/cards/global_mmlu/bn/high_school_us_history.json -> build/lib/unitxt/catalog/cards/global_mmlu/bn 2026-05-27T11:53:34,567 copying src/unitxt/catalog/cards/global_mmlu/bn/high_school_statistics.json -> build/lib/unitxt/catalog/cards/global_mmlu/bn 2026-05-27T11:53:34,569 copying src/unitxt/catalog/cards/global_mmlu/bn/miscellaneous.json -> build/lib/unitxt/catalog/cards/global_mmlu/bn 2026-05-27T11:53:34,571 copying src/unitxt/catalog/cards/global_mmlu/bn/high_school_mathematics.json -> build/lib/unitxt/catalog/cards/global_mmlu/bn 2026-05-27T11:53:34,573 copying src/unitxt/catalog/cards/global_mmlu/bn/formal_logic.json -> build/lib/unitxt/catalog/cards/global_mmlu/bn 2026-05-27T11:53:34,575 copying src/unitxt/catalog/cards/global_mmlu/bn/high_school_chemistry.json -> build/lib/unitxt/catalog/cards/global_mmlu/bn 2026-05-27T11:53:34,578 copying src/unitxt/catalog/cards/global_mmlu/bn/abstract_algebra.json -> build/lib/unitxt/catalog/cards/global_mmlu/bn 2026-05-27T11:53:34,580 copying src/unitxt/catalog/cards/global_mmlu/bn/moral_scenarios.json -> build/lib/unitxt/catalog/cards/global_mmlu/bn 2026-05-27T11:53:34,582 copying src/unitxt/catalog/cards/global_mmlu/bn/world_religions.json -> build/lib/unitxt/catalog/cards/global_mmlu/bn 2026-05-27T11:53:34,585 copying src/unitxt/catalog/cards/global_mmlu/bn/business_ethics.json -> build/lib/unitxt/catalog/cards/global_mmlu/bn 2026-05-27T11:53:34,587 copying src/unitxt/catalog/cards/global_mmlu/bn/security_studies.json -> build/lib/unitxt/catalog/cards/global_mmlu/bn 2026-05-27T11:53:34,589 copying src/unitxt/catalog/cards/global_mmlu/bn/college_medicine.json -> build/lib/unitxt/catalog/cards/global_mmlu/bn 2026-05-27T11:53:34,591 copying src/unitxt/catalog/cards/global_mmlu/bn/human_sexuality.json -> build/lib/unitxt/catalog/cards/global_mmlu/bn 2026-05-27T11:53:34,594 copying src/unitxt/catalog/cards/global_mmlu/bn/prehistory.json -> build/lib/unitxt/catalog/cards/global_mmlu/bn 2026-05-27T11:53:34,596 creating build/lib/unitxt/catalog/cards/global_mmlu/el 2026-05-27T11:53:34,597 copying src/unitxt/catalog/cards/global_mmlu/el/moral_disputes.json -> build/lib/unitxt/catalog/cards/global_mmlu/el 2026-05-27T11:53:34,599 copying src/unitxt/catalog/cards/global_mmlu/el/high_school_biology.json -> build/lib/unitxt/catalog/cards/global_mmlu/el 2026-05-27T11:53:34,602 copying src/unitxt/catalog/cards/global_mmlu/el/jurisprudence.json -> build/lib/unitxt/catalog/cards/global_mmlu/el 2026-05-27T11:53:34,604 copying src/unitxt/catalog/cards/global_mmlu/el/logical_fallacies.json -> build/lib/unitxt/catalog/cards/global_mmlu/el 2026-05-27T11:53:34,607 copying src/unitxt/catalog/cards/global_mmlu/el/college_chemistry.json -> build/lib/unitxt/catalog/cards/global_mmlu/el 2026-05-27T11:53:34,609 copying src/unitxt/catalog/cards/global_mmlu/el/high_school_government_and_politics.json -> build/lib/unitxt/catalog/cards/global_mmlu/el 2026-05-27T11:53:34,611 copying src/unitxt/catalog/cards/global_mmlu/el/college_mathematics.json -> build/lib/unitxt/catalog/cards/global_mmlu/el 2026-05-27T11:53:34,613 copying src/unitxt/catalog/cards/global_mmlu/el/econometrics.json -> build/lib/unitxt/catalog/cards/global_mmlu/el 2026-05-27T11:53:34,616 copying src/unitxt/catalog/cards/global_mmlu/el/high_school_macroeconomics.json -> build/lib/unitxt/catalog/cards/global_mmlu/el 2026-05-27T11:53:34,618 copying src/unitxt/catalog/cards/global_mmlu/el/high_school_psychology.json -> build/lib/unitxt/catalog/cards/global_mmlu/el 2026-05-27T11:53:34,620 copying src/unitxt/catalog/cards/global_mmlu/el/computer_security.json -> build/lib/unitxt/catalog/cards/global_mmlu/el 2026-05-27T11:53:34,622 copying src/unitxt/catalog/cards/global_mmlu/el/sociology.json -> build/lib/unitxt/catalog/cards/global_mmlu/el 2026-05-27T11:53:34,624 copying src/unitxt/catalog/cards/global_mmlu/el/nutrition.json -> build/lib/unitxt/catalog/cards/global_mmlu/el 2026-05-27T11:53:34,627 copying src/unitxt/catalog/cards/global_mmlu/el/professional_medicine.json -> build/lib/unitxt/catalog/cards/global_mmlu/el 2026-05-27T11:53:34,629 copying src/unitxt/catalog/cards/global_mmlu/el/college_biology.json -> build/lib/unitxt/catalog/cards/global_mmlu/el 2026-05-27T11:53:34,631 copying src/unitxt/catalog/cards/global_mmlu/el/anatomy.json -> build/lib/unitxt/catalog/cards/global_mmlu/el 2026-05-27T11:53:34,633 copying src/unitxt/catalog/cards/global_mmlu/el/professional_law.json -> build/lib/unitxt/catalog/cards/global_mmlu/el 2026-05-27T11:53:34,635 copying src/unitxt/catalog/cards/global_mmlu/el/machine_learning.json -> build/lib/unitxt/catalog/cards/global_mmlu/el 2026-05-27T11:53:34,638 copying src/unitxt/catalog/cards/global_mmlu/el/international_law.json -> build/lib/unitxt/catalog/cards/global_mmlu/el 2026-05-27T11:53:34,640 copying src/unitxt/catalog/cards/global_mmlu/el/medical_genetics.json -> build/lib/unitxt/catalog/cards/global_mmlu/el 2026-05-27T11:53:34,642 copying src/unitxt/catalog/cards/global_mmlu/el/high_school_computer_science.json -> build/lib/unitxt/catalog/cards/global_mmlu/el 2026-05-27T11:53:34,645 copying src/unitxt/catalog/cards/global_mmlu/el/clinical_knowledge.json -> build/lib/unitxt/catalog/cards/global_mmlu/el 2026-05-27T11:53:34,647 copying src/unitxt/catalog/cards/global_mmlu/el/college_physics.json -> build/lib/unitxt/catalog/cards/global_mmlu/el 2026-05-27T11:53:34,650 copying src/unitxt/catalog/cards/global_mmlu/el/global_facts.json -> build/lib/unitxt/catalog/cards/global_mmlu/el 2026-05-27T11:53:34,652 copying src/unitxt/catalog/cards/global_mmlu/el/college_computer_science.json -> build/lib/unitxt/catalog/cards/global_mmlu/el 2026-05-27T11:53:34,654 copying src/unitxt/catalog/cards/global_mmlu/el/us_foreign_policy.json -> build/lib/unitxt/catalog/cards/global_mmlu/el 2026-05-27T11:53:34,657 copying src/unitxt/catalog/cards/global_mmlu/el/professional_accounting.json -> build/lib/unitxt/catalog/cards/global_mmlu/el 2026-05-27T11:53:34,659 copying src/unitxt/catalog/cards/global_mmlu/el/professional_psychology.json -> build/lib/unitxt/catalog/cards/global_mmlu/el 2026-05-27T11:53:34,661 copying src/unitxt/catalog/cards/global_mmlu/el/philosophy.json -> build/lib/unitxt/catalog/cards/global_mmlu/el 2026-05-27T11:53:34,664 copying src/unitxt/catalog/cards/global_mmlu/el/elementary_mathematics.json -> build/lib/unitxt/catalog/cards/global_mmlu/el 2026-05-27T11:53:34,666 copying src/unitxt/catalog/cards/global_mmlu/el/conceptual_physics.json -> build/lib/unitxt/catalog/cards/global_mmlu/el 2026-05-27T11:53:34,669 copying src/unitxt/catalog/cards/global_mmlu/el/high_school_geography.json -> build/lib/unitxt/catalog/cards/global_mmlu/el 2026-05-27T11:53:34,671 copying src/unitxt/catalog/cards/global_mmlu/el/human_aging.json -> build/lib/unitxt/catalog/cards/global_mmlu/el 2026-05-27T11:53:34,673 copying src/unitxt/catalog/cards/global_mmlu/el/electrical_engineering.json -> build/lib/unitxt/catalog/cards/global_mmlu/el 2026-05-27T11:53:34,675 copying src/unitxt/catalog/cards/global_mmlu/el/management.json -> build/lib/unitxt/catalog/cards/global_mmlu/el 2026-05-27T11:53:34,678 copying src/unitxt/catalog/cards/global_mmlu/el/high_school_world_history.json -> build/lib/unitxt/catalog/cards/global_mmlu/el 2026-05-27T11:53:34,680 copying src/unitxt/catalog/cards/global_mmlu/el/marketing.json -> build/lib/unitxt/catalog/cards/global_mmlu/el 2026-05-27T11:53:34,683 copying src/unitxt/catalog/cards/global_mmlu/el/high_school_european_history.json -> build/lib/unitxt/catalog/cards/global_mmlu/el 2026-05-27T11:53:34,685 copying src/unitxt/catalog/cards/global_mmlu/el/astronomy.json -> build/lib/unitxt/catalog/cards/global_mmlu/el 2026-05-27T11:53:34,688 copying src/unitxt/catalog/cards/global_mmlu/el/high_school_physics.json -> build/lib/unitxt/catalog/cards/global_mmlu/el 2026-05-27T11:53:34,690 copying src/unitxt/catalog/cards/global_mmlu/el/public_relations.json -> build/lib/unitxt/catalog/cards/global_mmlu/el 2026-05-27T11:53:34,693 copying src/unitxt/catalog/cards/global_mmlu/el/high_school_microeconomics.json -> build/lib/unitxt/catalog/cards/global_mmlu/el 2026-05-27T11:53:34,695 copying src/unitxt/catalog/cards/global_mmlu/el/virology.json -> build/lib/unitxt/catalog/cards/global_mmlu/el 2026-05-27T11:53:34,697 copying src/unitxt/catalog/cards/global_mmlu/el/high_school_us_history.json -> build/lib/unitxt/catalog/cards/global_mmlu/el 2026-05-27T11:53:34,699 copying src/unitxt/catalog/cards/global_mmlu/el/high_school_statistics.json -> build/lib/unitxt/catalog/cards/global_mmlu/el 2026-05-27T11:53:34,702 copying src/unitxt/catalog/cards/global_mmlu/el/miscellaneous.json -> build/lib/unitxt/catalog/cards/global_mmlu/el 2026-05-27T11:53:34,704 copying src/unitxt/catalog/cards/global_mmlu/el/high_school_mathematics.json -> build/lib/unitxt/catalog/cards/global_mmlu/el 2026-05-27T11:53:34,706 copying src/unitxt/catalog/cards/global_mmlu/el/formal_logic.json -> build/lib/unitxt/catalog/cards/global_mmlu/el 2026-05-27T11:53:34,708 copying src/unitxt/catalog/cards/global_mmlu/el/high_school_chemistry.json -> build/lib/unitxt/catalog/cards/global_mmlu/el 2026-05-27T11:53:34,711 copying src/unitxt/catalog/cards/global_mmlu/el/abstract_algebra.json -> build/lib/unitxt/catalog/cards/global_mmlu/el 2026-05-27T11:53:34,713 copying src/unitxt/catalog/cards/global_mmlu/el/moral_scenarios.json -> build/lib/unitxt/catalog/cards/global_mmlu/el 2026-05-27T11:53:34,715 copying src/unitxt/catalog/cards/global_mmlu/el/world_religions.json -> build/lib/unitxt/catalog/cards/global_mmlu/el 2026-05-27T11:53:34,718 copying src/unitxt/catalog/cards/global_mmlu/el/business_ethics.json -> build/lib/unitxt/catalog/cards/global_mmlu/el 2026-05-27T11:53:34,720 copying src/unitxt/catalog/cards/global_mmlu/el/security_studies.json -> build/lib/unitxt/catalog/cards/global_mmlu/el 2026-05-27T11:53:34,722 copying src/unitxt/catalog/cards/global_mmlu/el/college_medicine.json -> build/lib/unitxt/catalog/cards/global_mmlu/el 2026-05-27T11:53:34,725 copying src/unitxt/catalog/cards/global_mmlu/el/human_sexuality.json -> build/lib/unitxt/catalog/cards/global_mmlu/el 2026-05-27T11:53:34,727 copying src/unitxt/catalog/cards/global_mmlu/el/prehistory.json -> build/lib/unitxt/catalog/cards/global_mmlu/el 2026-05-27T11:53:34,730 creating build/lib/unitxt/catalog/cards/global_mmlu/ig 2026-05-27T11:53:34,731 copying src/unitxt/catalog/cards/global_mmlu/ig/moral_disputes.json -> build/lib/unitxt/catalog/cards/global_mmlu/ig 2026-05-27T11:53:34,733 copying src/unitxt/catalog/cards/global_mmlu/ig/high_school_biology.json -> build/lib/unitxt/catalog/cards/global_mmlu/ig 2026-05-27T11:53:34,735 copying src/unitxt/catalog/cards/global_mmlu/ig/jurisprudence.json -> build/lib/unitxt/catalog/cards/global_mmlu/ig 2026-05-27T11:53:34,738 copying src/unitxt/catalog/cards/global_mmlu/ig/logical_fallacies.json -> build/lib/unitxt/catalog/cards/global_mmlu/ig 2026-05-27T11:53:34,740 copying src/unitxt/catalog/cards/global_mmlu/ig/college_chemistry.json -> build/lib/unitxt/catalog/cards/global_mmlu/ig 2026-05-27T11:53:34,742 copying src/unitxt/catalog/cards/global_mmlu/ig/high_school_government_and_politics.json -> build/lib/unitxt/catalog/cards/global_mmlu/ig 2026-05-27T11:53:34,744 copying src/unitxt/catalog/cards/global_mmlu/ig/college_mathematics.json -> build/lib/unitxt/catalog/cards/global_mmlu/ig 2026-05-27T11:53:34,746 copying src/unitxt/catalog/cards/global_mmlu/ig/econometrics.json -> build/lib/unitxt/catalog/cards/global_mmlu/ig 2026-05-27T11:53:34,748 copying src/unitxt/catalog/cards/global_mmlu/ig/high_school_macroeconomics.json -> build/lib/unitxt/catalog/cards/global_mmlu/ig 2026-05-27T11:53:34,751 copying src/unitxt/catalog/cards/global_mmlu/ig/high_school_psychology.json -> build/lib/unitxt/catalog/cards/global_mmlu/ig 2026-05-27T11:53:34,753 copying src/unitxt/catalog/cards/global_mmlu/ig/computer_security.json -> build/lib/unitxt/catalog/cards/global_mmlu/ig 2026-05-27T11:53:34,755 copying src/unitxt/catalog/cards/global_mmlu/ig/sociology.json -> build/lib/unitxt/catalog/cards/global_mmlu/ig 2026-05-27T11:53:34,758 copying src/unitxt/catalog/cards/global_mmlu/ig/nutrition.json -> build/lib/unitxt/catalog/cards/global_mmlu/ig 2026-05-27T11:53:34,760 copying src/unitxt/catalog/cards/global_mmlu/ig/professional_medicine.json -> build/lib/unitxt/catalog/cards/global_mmlu/ig 2026-05-27T11:53:34,763 copying src/unitxt/catalog/cards/global_mmlu/ig/college_biology.json -> build/lib/unitxt/catalog/cards/global_mmlu/ig 2026-05-27T11:53:34,765 copying src/unitxt/catalog/cards/global_mmlu/ig/anatomy.json -> build/lib/unitxt/catalog/cards/global_mmlu/ig 2026-05-27T11:53:34,768 copying src/unitxt/catalog/cards/global_mmlu/ig/professional_law.json -> build/lib/unitxt/catalog/cards/global_mmlu/ig 2026-05-27T11:53:34,770 copying src/unitxt/catalog/cards/global_mmlu/ig/machine_learning.json -> build/lib/unitxt/catalog/cards/global_mmlu/ig 2026-05-27T11:53:34,772 copying src/unitxt/catalog/cards/global_mmlu/ig/international_law.json -> build/lib/unitxt/catalog/cards/global_mmlu/ig 2026-05-27T11:53:34,775 copying src/unitxt/catalog/cards/global_mmlu/ig/medical_genetics.json -> build/lib/unitxt/catalog/cards/global_mmlu/ig 2026-05-27T11:53:34,777 copying src/unitxt/catalog/cards/global_mmlu/ig/high_school_computer_science.json -> build/lib/unitxt/catalog/cards/global_mmlu/ig 2026-05-27T11:53:34,779 copying src/unitxt/catalog/cards/global_mmlu/ig/clinical_knowledge.json -> build/lib/unitxt/catalog/cards/global_mmlu/ig 2026-05-27T11:53:34,782 copying src/unitxt/catalog/cards/global_mmlu/ig/college_physics.json -> build/lib/unitxt/catalog/cards/global_mmlu/ig 2026-05-27T11:53:34,784 copying src/unitxt/catalog/cards/global_mmlu/ig/global_facts.json -> build/lib/unitxt/catalog/cards/global_mmlu/ig 2026-05-27T11:53:34,786 copying src/unitxt/catalog/cards/global_mmlu/ig/college_computer_science.json -> build/lib/unitxt/catalog/cards/global_mmlu/ig 2026-05-27T11:53:34,789 copying src/unitxt/catalog/cards/global_mmlu/ig/us_foreign_policy.json -> build/lib/unitxt/catalog/cards/global_mmlu/ig 2026-05-27T11:53:34,791 copying src/unitxt/catalog/cards/global_mmlu/ig/professional_accounting.json -> build/lib/unitxt/catalog/cards/global_mmlu/ig 2026-05-27T11:53:34,794 copying src/unitxt/catalog/cards/global_mmlu/ig/professional_psychology.json -> build/lib/unitxt/catalog/cards/global_mmlu/ig 2026-05-27T11:53:34,796 copying src/unitxt/catalog/cards/global_mmlu/ig/philosophy.json -> build/lib/unitxt/catalog/cards/global_mmlu/ig 2026-05-27T11:53:34,799 copying src/unitxt/catalog/cards/global_mmlu/ig/elementary_mathematics.json -> build/lib/unitxt/catalog/cards/global_mmlu/ig 2026-05-27T11:53:34,801 copying src/unitxt/catalog/cards/global_mmlu/ig/conceptual_physics.json -> build/lib/unitxt/catalog/cards/global_mmlu/ig 2026-05-27T11:53:34,803 copying src/unitxt/catalog/cards/global_mmlu/ig/high_school_geography.json -> build/lib/unitxt/catalog/cards/global_mmlu/ig 2026-05-27T11:53:34,806 copying src/unitxt/catalog/cards/global_mmlu/ig/human_aging.json -> build/lib/unitxt/catalog/cards/global_mmlu/ig 2026-05-27T11:53:34,808 copying src/unitxt/catalog/cards/global_mmlu/ig/electrical_engineering.json -> build/lib/unitxt/catalog/cards/global_mmlu/ig 2026-05-27T11:53:34,810 copying src/unitxt/catalog/cards/global_mmlu/ig/management.json -> build/lib/unitxt/catalog/cards/global_mmlu/ig 2026-05-27T11:53:34,812 copying src/unitxt/catalog/cards/global_mmlu/ig/high_school_world_history.json -> build/lib/unitxt/catalog/cards/global_mmlu/ig 2026-05-27T11:53:34,815 copying src/unitxt/catalog/cards/global_mmlu/ig/marketing.json -> build/lib/unitxt/catalog/cards/global_mmlu/ig 2026-05-27T11:53:34,817 copying src/unitxt/catalog/cards/global_mmlu/ig/high_school_european_history.json -> build/lib/unitxt/catalog/cards/global_mmlu/ig 2026-05-27T11:53:34,819 copying src/unitxt/catalog/cards/global_mmlu/ig/astronomy.json -> build/lib/unitxt/catalog/cards/global_mmlu/ig 2026-05-27T11:53:34,821 copying src/unitxt/catalog/cards/global_mmlu/ig/high_school_physics.json -> build/lib/unitxt/catalog/cards/global_mmlu/ig 2026-05-27T11:53:34,824 copying src/unitxt/catalog/cards/global_mmlu/ig/public_relations.json -> build/lib/unitxt/catalog/cards/global_mmlu/ig 2026-05-27T11:53:34,826 copying src/unitxt/catalog/cards/global_mmlu/ig/high_school_microeconomics.json -> build/lib/unitxt/catalog/cards/global_mmlu/ig 2026-05-27T11:53:34,828 copying src/unitxt/catalog/cards/global_mmlu/ig/virology.json -> build/lib/unitxt/catalog/cards/global_mmlu/ig 2026-05-27T11:53:34,831 copying src/unitxt/catalog/cards/global_mmlu/ig/high_school_us_history.json -> build/lib/unitxt/catalog/cards/global_mmlu/ig 2026-05-27T11:53:34,833 copying src/unitxt/catalog/cards/global_mmlu/ig/high_school_statistics.json -> build/lib/unitxt/catalog/cards/global_mmlu/ig 2026-05-27T11:53:34,835 copying src/unitxt/catalog/cards/global_mmlu/ig/miscellaneous.json -> build/lib/unitxt/catalog/cards/global_mmlu/ig 2026-05-27T11:53:34,838 copying src/unitxt/catalog/cards/global_mmlu/ig/high_school_mathematics.json -> build/lib/unitxt/catalog/cards/global_mmlu/ig 2026-05-27T11:53:34,840 copying src/unitxt/catalog/cards/global_mmlu/ig/formal_logic.json -> build/lib/unitxt/catalog/cards/global_mmlu/ig 2026-05-27T11:53:34,843 copying src/unitxt/catalog/cards/global_mmlu/ig/high_school_chemistry.json -> build/lib/unitxt/catalog/cards/global_mmlu/ig 2026-05-27T11:53:34,845 copying src/unitxt/catalog/cards/global_mmlu/ig/abstract_algebra.json -> build/lib/unitxt/catalog/cards/global_mmlu/ig 2026-05-27T11:53:34,848 copying src/unitxt/catalog/cards/global_mmlu/ig/moral_scenarios.json -> build/lib/unitxt/catalog/cards/global_mmlu/ig 2026-05-27T11:53:34,850 copying src/unitxt/catalog/cards/global_mmlu/ig/world_religions.json -> build/lib/unitxt/catalog/cards/global_mmlu/ig 2026-05-27T11:53:34,852 copying src/unitxt/catalog/cards/global_mmlu/ig/business_ethics.json -> build/lib/unitxt/catalog/cards/global_mmlu/ig 2026-05-27T11:53:34,854 copying src/unitxt/catalog/cards/global_mmlu/ig/security_studies.json -> build/lib/unitxt/catalog/cards/global_mmlu/ig 2026-05-27T11:53:34,857 copying src/unitxt/catalog/cards/global_mmlu/ig/college_medicine.json -> build/lib/unitxt/catalog/cards/global_mmlu/ig 2026-05-27T11:53:34,859 copying src/unitxt/catalog/cards/global_mmlu/ig/human_sexuality.json -> build/lib/unitxt/catalog/cards/global_mmlu/ig 2026-05-27T11:53:34,861 copying src/unitxt/catalog/cards/global_mmlu/ig/prehistory.json -> build/lib/unitxt/catalog/cards/global_mmlu/ig 2026-05-27T11:53:34,863 creating build/lib/unitxt/catalog/cards/global_mmlu/te 2026-05-27T11:53:34,865 copying src/unitxt/catalog/cards/global_mmlu/te/moral_disputes.json -> build/lib/unitxt/catalog/cards/global_mmlu/te 2026-05-27T11:53:34,867 copying src/unitxt/catalog/cards/global_mmlu/te/high_school_biology.json -> build/lib/unitxt/catalog/cards/global_mmlu/te 2026-05-27T11:53:34,869 copying src/unitxt/catalog/cards/global_mmlu/te/jurisprudence.json -> build/lib/unitxt/catalog/cards/global_mmlu/te 2026-05-27T11:53:34,871 copying src/unitxt/catalog/cards/global_mmlu/te/logical_fallacies.json -> build/lib/unitxt/catalog/cards/global_mmlu/te 2026-05-27T11:53:34,873 copying src/unitxt/catalog/cards/global_mmlu/te/college_chemistry.json -> build/lib/unitxt/catalog/cards/global_mmlu/te 2026-05-27T11:53:34,875 copying src/unitxt/catalog/cards/global_mmlu/te/high_school_government_and_politics.json -> build/lib/unitxt/catalog/cards/global_mmlu/te 2026-05-27T11:53:34,878 copying src/unitxt/catalog/cards/global_mmlu/te/college_mathematics.json -> build/lib/unitxt/catalog/cards/global_mmlu/te 2026-05-27T11:53:34,880 copying src/unitxt/catalog/cards/global_mmlu/te/econometrics.json -> build/lib/unitxt/catalog/cards/global_mmlu/te 2026-05-27T11:53:34,882 copying src/unitxt/catalog/cards/global_mmlu/te/high_school_macroeconomics.json -> build/lib/unitxt/catalog/cards/global_mmlu/te 2026-05-27T11:53:34,884 copying src/unitxt/catalog/cards/global_mmlu/te/high_school_psychology.json -> build/lib/unitxt/catalog/cards/global_mmlu/te 2026-05-27T11:53:34,886 copying src/unitxt/catalog/cards/global_mmlu/te/computer_security.json -> build/lib/unitxt/catalog/cards/global_mmlu/te 2026-05-27T11:53:34,888 copying src/unitxt/catalog/cards/global_mmlu/te/sociology.json -> build/lib/unitxt/catalog/cards/global_mmlu/te 2026-05-27T11:53:34,891 copying src/unitxt/catalog/cards/global_mmlu/te/nutrition.json -> build/lib/unitxt/catalog/cards/global_mmlu/te 2026-05-27T11:53:34,893 copying src/unitxt/catalog/cards/global_mmlu/te/professional_medicine.json -> build/lib/unitxt/catalog/cards/global_mmlu/te 2026-05-27T11:53:34,895 copying src/unitxt/catalog/cards/global_mmlu/te/college_biology.json -> build/lib/unitxt/catalog/cards/global_mmlu/te 2026-05-27T11:53:34,897 copying src/unitxt/catalog/cards/global_mmlu/te/anatomy.json -> build/lib/unitxt/catalog/cards/global_mmlu/te 2026-05-27T11:53:34,899 copying src/unitxt/catalog/cards/global_mmlu/te/professional_law.json -> build/lib/unitxt/catalog/cards/global_mmlu/te 2026-05-27T11:53:34,902 copying src/unitxt/catalog/cards/global_mmlu/te/machine_learning.json -> build/lib/unitxt/catalog/cards/global_mmlu/te 2026-05-27T11:53:34,904 copying src/unitxt/catalog/cards/global_mmlu/te/international_law.json -> build/lib/unitxt/catalog/cards/global_mmlu/te 2026-05-27T11:53:34,906 copying src/unitxt/catalog/cards/global_mmlu/te/medical_genetics.json -> build/lib/unitxt/catalog/cards/global_mmlu/te 2026-05-27T11:53:34,908 copying src/unitxt/catalog/cards/global_mmlu/te/high_school_computer_science.json -> build/lib/unitxt/catalog/cards/global_mmlu/te 2026-05-27T11:53:34,910 copying src/unitxt/catalog/cards/global_mmlu/te/clinical_knowledge.json -> build/lib/unitxt/catalog/cards/global_mmlu/te 2026-05-27T11:53:34,913 copying src/unitxt/catalog/cards/global_mmlu/te/college_physics.json -> build/lib/unitxt/catalog/cards/global_mmlu/te 2026-05-27T11:53:34,915 copying src/unitxt/catalog/cards/global_mmlu/te/global_facts.json -> build/lib/unitxt/catalog/cards/global_mmlu/te 2026-05-27T11:53:34,917 copying src/unitxt/catalog/cards/global_mmlu/te/college_computer_science.json -> build/lib/unitxt/catalog/cards/global_mmlu/te 2026-05-27T11:53:34,919 copying src/unitxt/catalog/cards/global_mmlu/te/us_foreign_policy.json -> build/lib/unitxt/catalog/cards/global_mmlu/te 2026-05-27T11:53:34,922 copying src/unitxt/catalog/cards/global_mmlu/te/professional_accounting.json -> build/lib/unitxt/catalog/cards/global_mmlu/te 2026-05-27T11:53:34,924 copying src/unitxt/catalog/cards/global_mmlu/te/professional_psychology.json -> build/lib/unitxt/catalog/cards/global_mmlu/te 2026-05-27T11:53:34,926 copying src/unitxt/catalog/cards/global_mmlu/te/philosophy.json -> build/lib/unitxt/catalog/cards/global_mmlu/te 2026-05-27T11:53:34,928 copying src/unitxt/catalog/cards/global_mmlu/te/elementary_mathematics.json -> build/lib/unitxt/catalog/cards/global_mmlu/te 2026-05-27T11:53:34,930 copying src/unitxt/catalog/cards/global_mmlu/te/conceptual_physics.json -> build/lib/unitxt/catalog/cards/global_mmlu/te 2026-05-27T11:53:34,933 copying src/unitxt/catalog/cards/global_mmlu/te/high_school_geography.json -> build/lib/unitxt/catalog/cards/global_mmlu/te 2026-05-27T11:53:34,935 copying src/unitxt/catalog/cards/global_mmlu/te/human_aging.json -> build/lib/unitxt/catalog/cards/global_mmlu/te 2026-05-27T11:53:34,937 copying src/unitxt/catalog/cards/global_mmlu/te/electrical_engineering.json -> build/lib/unitxt/catalog/cards/global_mmlu/te 2026-05-27T11:53:34,939 copying src/unitxt/catalog/cards/global_mmlu/te/management.json -> build/lib/unitxt/catalog/cards/global_mmlu/te 2026-05-27T11:53:34,941 copying src/unitxt/catalog/cards/global_mmlu/te/high_school_world_history.json -> build/lib/unitxt/catalog/cards/global_mmlu/te 2026-05-27T11:53:34,943 copying src/unitxt/catalog/cards/global_mmlu/te/marketing.json -> build/lib/unitxt/catalog/cards/global_mmlu/te 2026-05-27T11:53:34,945 copying src/unitxt/catalog/cards/global_mmlu/te/high_school_european_history.json -> build/lib/unitxt/catalog/cards/global_mmlu/te 2026-05-27T11:53:34,947 copying src/unitxt/catalog/cards/global_mmlu/te/astronomy.json -> build/lib/unitxt/catalog/cards/global_mmlu/te 2026-05-27T11:53:34,950 copying src/unitxt/catalog/cards/global_mmlu/te/high_school_physics.json -> build/lib/unitxt/catalog/cards/global_mmlu/te 2026-05-27T11:53:34,952 copying src/unitxt/catalog/cards/global_mmlu/te/public_relations.json -> build/lib/unitxt/catalog/cards/global_mmlu/te 2026-05-27T11:53:34,954 copying src/unitxt/catalog/cards/global_mmlu/te/high_school_microeconomics.json -> build/lib/unitxt/catalog/cards/global_mmlu/te 2026-05-27T11:53:34,956 copying src/unitxt/catalog/cards/global_mmlu/te/virology.json -> build/lib/unitxt/catalog/cards/global_mmlu/te 2026-05-27T11:53:34,959 copying src/unitxt/catalog/cards/global_mmlu/te/high_school_us_history.json -> build/lib/unitxt/catalog/cards/global_mmlu/te 2026-05-27T11:53:34,961 copying src/unitxt/catalog/cards/global_mmlu/te/high_school_statistics.json -> build/lib/unitxt/catalog/cards/global_mmlu/te 2026-05-27T11:53:34,963 copying src/unitxt/catalog/cards/global_mmlu/te/miscellaneous.json -> build/lib/unitxt/catalog/cards/global_mmlu/te 2026-05-27T11:53:34,965 copying src/unitxt/catalog/cards/global_mmlu/te/high_school_mathematics.json -> build/lib/unitxt/catalog/cards/global_mmlu/te 2026-05-27T11:53:34,967 copying src/unitxt/catalog/cards/global_mmlu/te/formal_logic.json -> build/lib/unitxt/catalog/cards/global_mmlu/te 2026-05-27T11:53:34,970 copying src/unitxt/catalog/cards/global_mmlu/te/high_school_chemistry.json -> build/lib/unitxt/catalog/cards/global_mmlu/te 2026-05-27T11:53:34,972 copying src/unitxt/catalog/cards/global_mmlu/te/abstract_algebra.json -> build/lib/unitxt/catalog/cards/global_mmlu/te 2026-05-27T11:53:34,974 copying src/unitxt/catalog/cards/global_mmlu/te/moral_scenarios.json -> build/lib/unitxt/catalog/cards/global_mmlu/te 2026-05-27T11:53:34,977 copying src/unitxt/catalog/cards/global_mmlu/te/world_religions.json -> build/lib/unitxt/catalog/cards/global_mmlu/te 2026-05-27T11:53:34,979 copying src/unitxt/catalog/cards/global_mmlu/te/business_ethics.json -> build/lib/unitxt/catalog/cards/global_mmlu/te 2026-05-27T11:53:34,982 copying src/unitxt/catalog/cards/global_mmlu/te/security_studies.json -> build/lib/unitxt/catalog/cards/global_mmlu/te 2026-05-27T11:53:34,984 copying src/unitxt/catalog/cards/global_mmlu/te/college_medicine.json -> build/lib/unitxt/catalog/cards/global_mmlu/te 2026-05-27T11:53:34,986 copying src/unitxt/catalog/cards/global_mmlu/te/human_sexuality.json -> build/lib/unitxt/catalog/cards/global_mmlu/te 2026-05-27T11:53:34,989 copying src/unitxt/catalog/cards/global_mmlu/te/prehistory.json -> build/lib/unitxt/catalog/cards/global_mmlu/te 2026-05-27T11:53:34,991 creating build/lib/unitxt/catalog/cards/global_mmlu/fil 2026-05-27T11:53:34,992 copying src/unitxt/catalog/cards/global_mmlu/fil/moral_disputes.json -> build/lib/unitxt/catalog/cards/global_mmlu/fil 2026-05-27T11:53:34,995 copying src/unitxt/catalog/cards/global_mmlu/fil/high_school_biology.json -> build/lib/unitxt/catalog/cards/global_mmlu/fil 2026-05-27T11:53:34,997 copying src/unitxt/catalog/cards/global_mmlu/fil/jurisprudence.json -> build/lib/unitxt/catalog/cards/global_mmlu/fil 2026-05-27T11:53:34,999 copying src/unitxt/catalog/cards/global_mmlu/fil/logical_fallacies.json -> build/lib/unitxt/catalog/cards/global_mmlu/fil 2026-05-27T11:53:35,001 copying src/unitxt/catalog/cards/global_mmlu/fil/college_chemistry.json -> build/lib/unitxt/catalog/cards/global_mmlu/fil 2026-05-27T11:53:35,004 copying src/unitxt/catalog/cards/global_mmlu/fil/high_school_government_and_politics.json -> build/lib/unitxt/catalog/cards/global_mmlu/fil 2026-05-27T11:53:35,006 copying src/unitxt/catalog/cards/global_mmlu/fil/college_mathematics.json -> build/lib/unitxt/catalog/cards/global_mmlu/fil 2026-05-27T11:53:35,008 copying src/unitxt/catalog/cards/global_mmlu/fil/econometrics.json -> build/lib/unitxt/catalog/cards/global_mmlu/fil 2026-05-27T11:53:35,011 copying src/unitxt/catalog/cards/global_mmlu/fil/high_school_macroeconomics.json -> build/lib/unitxt/catalog/cards/global_mmlu/fil 2026-05-27T11:53:35,013 copying src/unitxt/catalog/cards/global_mmlu/fil/high_school_psychology.json -> build/lib/unitxt/catalog/cards/global_mmlu/fil 2026-05-27T11:53:35,015 copying src/unitxt/catalog/cards/global_mmlu/fil/computer_security.json -> build/lib/unitxt/catalog/cards/global_mmlu/fil 2026-05-27T11:53:35,018 copying src/unitxt/catalog/cards/global_mmlu/fil/sociology.json -> build/lib/unitxt/catalog/cards/global_mmlu/fil 2026-05-27T11:53:35,020 copying src/unitxt/catalog/cards/global_mmlu/fil/nutrition.json -> build/lib/unitxt/catalog/cards/global_mmlu/fil 2026-05-27T11:53:35,023 copying src/unitxt/catalog/cards/global_mmlu/fil/professional_medicine.json -> build/lib/unitxt/catalog/cards/global_mmlu/fil 2026-05-27T11:53:35,025 copying src/unitxt/catalog/cards/global_mmlu/fil/college_biology.json -> build/lib/unitxt/catalog/cards/global_mmlu/fil 2026-05-27T11:53:35,027 copying src/unitxt/catalog/cards/global_mmlu/fil/anatomy.json -> build/lib/unitxt/catalog/cards/global_mmlu/fil 2026-05-27T11:53:35,030 copying src/unitxt/catalog/cards/global_mmlu/fil/professional_law.json -> build/lib/unitxt/catalog/cards/global_mmlu/fil 2026-05-27T11:53:35,032 copying src/unitxt/catalog/cards/global_mmlu/fil/machine_learning.json -> build/lib/unitxt/catalog/cards/global_mmlu/fil 2026-05-27T11:53:35,035 copying src/unitxt/catalog/cards/global_mmlu/fil/international_law.json -> build/lib/unitxt/catalog/cards/global_mmlu/fil 2026-05-27T11:53:35,037 copying src/unitxt/catalog/cards/global_mmlu/fil/medical_genetics.json -> build/lib/unitxt/catalog/cards/global_mmlu/fil 2026-05-27T11:53:35,039 copying src/unitxt/catalog/cards/global_mmlu/fil/high_school_computer_science.json -> build/lib/unitxt/catalog/cards/global_mmlu/fil 2026-05-27T11:53:35,042 copying src/unitxt/catalog/cards/global_mmlu/fil/clinical_knowledge.json -> build/lib/unitxt/catalog/cards/global_mmlu/fil 2026-05-27T11:53:35,044 copying src/unitxt/catalog/cards/global_mmlu/fil/college_physics.json -> build/lib/unitxt/catalog/cards/global_mmlu/fil 2026-05-27T11:53:35,047 copying src/unitxt/catalog/cards/global_mmlu/fil/global_facts.json -> build/lib/unitxt/catalog/cards/global_mmlu/fil 2026-05-27T11:53:35,049 copying src/unitxt/catalog/cards/global_mmlu/fil/college_computer_science.json -> build/lib/unitxt/catalog/cards/global_mmlu/fil 2026-05-27T11:53:35,052 copying src/unitxt/catalog/cards/global_mmlu/fil/us_foreign_policy.json -> build/lib/unitxt/catalog/cards/global_mmlu/fil 2026-05-27T11:53:35,054 copying src/unitxt/catalog/cards/global_mmlu/fil/professional_accounting.json -> build/lib/unitxt/catalog/cards/global_mmlu/fil 2026-05-27T11:53:35,057 copying src/unitxt/catalog/cards/global_mmlu/fil/professional_psychology.json -> build/lib/unitxt/catalog/cards/global_mmlu/fil 2026-05-27T11:53:35,059 copying src/unitxt/catalog/cards/global_mmlu/fil/philosophy.json -> build/lib/unitxt/catalog/cards/global_mmlu/fil 2026-05-27T11:53:35,061 copying src/unitxt/catalog/cards/global_mmlu/fil/elementary_mathematics.json -> build/lib/unitxt/catalog/cards/global_mmlu/fil 2026-05-27T11:53:35,064 copying src/unitxt/catalog/cards/global_mmlu/fil/conceptual_physics.json -> build/lib/unitxt/catalog/cards/global_mmlu/fil 2026-05-27T11:53:35,066 copying src/unitxt/catalog/cards/global_mmlu/fil/high_school_geography.json -> build/lib/unitxt/catalog/cards/global_mmlu/fil 2026-05-27T11:53:35,068 copying src/unitxt/catalog/cards/global_mmlu/fil/human_aging.json -> build/lib/unitxt/catalog/cards/global_mmlu/fil 2026-05-27T11:53:35,071 copying src/unitxt/catalog/cards/global_mmlu/fil/electrical_engineering.json -> build/lib/unitxt/catalog/cards/global_mmlu/fil 2026-05-27T11:53:35,073 copying src/unitxt/catalog/cards/global_mmlu/fil/management.json -> build/lib/unitxt/catalog/cards/global_mmlu/fil 2026-05-27T11:53:35,075 copying src/unitxt/catalog/cards/global_mmlu/fil/high_school_world_history.json -> build/lib/unitxt/catalog/cards/global_mmlu/fil 2026-05-27T11:53:35,078 copying src/unitxt/catalog/cards/global_mmlu/fil/marketing.json -> build/lib/unitxt/catalog/cards/global_mmlu/fil 2026-05-27T11:53:35,080 copying src/unitxt/catalog/cards/global_mmlu/fil/high_school_european_history.json -> build/lib/unitxt/catalog/cards/global_mmlu/fil 2026-05-27T11:53:35,083 copying src/unitxt/catalog/cards/global_mmlu/fil/astronomy.json -> build/lib/unitxt/catalog/cards/global_mmlu/fil 2026-05-27T11:53:35,085 copying src/unitxt/catalog/cards/global_mmlu/fil/high_school_physics.json -> build/lib/unitxt/catalog/cards/global_mmlu/fil 2026-05-27T11:53:35,087 copying src/unitxt/catalog/cards/global_mmlu/fil/public_relations.json -> build/lib/unitxt/catalog/cards/global_mmlu/fil 2026-05-27T11:53:35,090 copying src/unitxt/catalog/cards/global_mmlu/fil/high_school_microeconomics.json -> build/lib/unitxt/catalog/cards/global_mmlu/fil 2026-05-27T11:53:35,092 copying src/unitxt/catalog/cards/global_mmlu/fil/virology.json -> build/lib/unitxt/catalog/cards/global_mmlu/fil 2026-05-27T11:53:35,094 copying src/unitxt/catalog/cards/global_mmlu/fil/high_school_us_history.json -> build/lib/unitxt/catalog/cards/global_mmlu/fil 2026-05-27T11:53:35,097 copying src/unitxt/catalog/cards/global_mmlu/fil/high_school_statistics.json -> build/lib/unitxt/catalog/cards/global_mmlu/fil 2026-05-27T11:53:35,099 copying src/unitxt/catalog/cards/global_mmlu/fil/miscellaneous.json -> build/lib/unitxt/catalog/cards/global_mmlu/fil 2026-05-27T11:53:35,101 copying src/unitxt/catalog/cards/global_mmlu/fil/high_school_mathematics.json -> build/lib/unitxt/catalog/cards/global_mmlu/fil 2026-05-27T11:53:35,104 copying src/unitxt/catalog/cards/global_mmlu/fil/formal_logic.json -> build/lib/unitxt/catalog/cards/global_mmlu/fil 2026-05-27T11:53:35,106 copying src/unitxt/catalog/cards/global_mmlu/fil/high_school_chemistry.json -> build/lib/unitxt/catalog/cards/global_mmlu/fil 2026-05-27T11:53:35,109 copying src/unitxt/catalog/cards/global_mmlu/fil/abstract_algebra.json -> build/lib/unitxt/catalog/cards/global_mmlu/fil 2026-05-27T11:53:35,111 copying src/unitxt/catalog/cards/global_mmlu/fil/moral_scenarios.json -> build/lib/unitxt/catalog/cards/global_mmlu/fil 2026-05-27T11:53:35,113 copying src/unitxt/catalog/cards/global_mmlu/fil/world_religions.json -> build/lib/unitxt/catalog/cards/global_mmlu/fil 2026-05-27T11:53:35,115 copying src/unitxt/catalog/cards/global_mmlu/fil/business_ethics.json -> build/lib/unitxt/catalog/cards/global_mmlu/fil 2026-05-27T11:53:35,118 copying src/unitxt/catalog/cards/global_mmlu/fil/security_studies.json -> build/lib/unitxt/catalog/cards/global_mmlu/fil 2026-05-27T11:53:35,120 copying src/unitxt/catalog/cards/global_mmlu/fil/college_medicine.json -> build/lib/unitxt/catalog/cards/global_mmlu/fil 2026-05-27T11:53:35,122 copying src/unitxt/catalog/cards/global_mmlu/fil/human_sexuality.json -> build/lib/unitxt/catalog/cards/global_mmlu/fil 2026-05-27T11:53:35,125 copying src/unitxt/catalog/cards/global_mmlu/fil/prehistory.json -> build/lib/unitxt/catalog/cards/global_mmlu/fil 2026-05-27T11:53:35,127 creating build/lib/unitxt/catalog/cards/global_mmlu/ro 2026-05-27T11:53:35,128 copying src/unitxt/catalog/cards/global_mmlu/ro/moral_disputes.json -> build/lib/unitxt/catalog/cards/global_mmlu/ro 2026-05-27T11:53:35,130 copying src/unitxt/catalog/cards/global_mmlu/ro/high_school_biology.json -> build/lib/unitxt/catalog/cards/global_mmlu/ro 2026-05-27T11:53:35,132 copying src/unitxt/catalog/cards/global_mmlu/ro/jurisprudence.json -> build/lib/unitxt/catalog/cards/global_mmlu/ro 2026-05-27T11:53:35,134 copying src/unitxt/catalog/cards/global_mmlu/ro/logical_fallacies.json -> build/lib/unitxt/catalog/cards/global_mmlu/ro 2026-05-27T11:53:35,136 copying src/unitxt/catalog/cards/global_mmlu/ro/college_chemistry.json -> build/lib/unitxt/catalog/cards/global_mmlu/ro 2026-05-27T11:53:35,139 copying src/unitxt/catalog/cards/global_mmlu/ro/high_school_government_and_politics.json -> build/lib/unitxt/catalog/cards/global_mmlu/ro 2026-05-27T11:53:35,141 copying src/unitxt/catalog/cards/global_mmlu/ro/college_mathematics.json -> build/lib/unitxt/catalog/cards/global_mmlu/ro 2026-05-27T11:53:35,143 copying src/unitxt/catalog/cards/global_mmlu/ro/econometrics.json -> build/lib/unitxt/catalog/cards/global_mmlu/ro 2026-05-27T11:53:35,145 copying src/unitxt/catalog/cards/global_mmlu/ro/high_school_macroeconomics.json -> build/lib/unitxt/catalog/cards/global_mmlu/ro 2026-05-27T11:53:35,147 copying src/unitxt/catalog/cards/global_mmlu/ro/high_school_psychology.json -> build/lib/unitxt/catalog/cards/global_mmlu/ro 2026-05-27T11:53:35,150 copying src/unitxt/catalog/cards/global_mmlu/ro/computer_security.json -> build/lib/unitxt/catalog/cards/global_mmlu/ro 2026-05-27T11:53:35,152 copying src/unitxt/catalog/cards/global_mmlu/ro/sociology.json -> build/lib/unitxt/catalog/cards/global_mmlu/ro 2026-05-27T11:53:35,154 copying src/unitxt/catalog/cards/global_mmlu/ro/nutrition.json -> build/lib/unitxt/catalog/cards/global_mmlu/ro 2026-05-27T11:53:35,156 copying src/unitxt/catalog/cards/global_mmlu/ro/professional_medicine.json -> build/lib/unitxt/catalog/cards/global_mmlu/ro 2026-05-27T11:53:35,158 copying src/unitxt/catalog/cards/global_mmlu/ro/college_biology.json -> build/lib/unitxt/catalog/cards/global_mmlu/ro 2026-05-27T11:53:35,161 copying src/unitxt/catalog/cards/global_mmlu/ro/anatomy.json -> build/lib/unitxt/catalog/cards/global_mmlu/ro 2026-05-27T11:53:35,163 copying src/unitxt/catalog/cards/global_mmlu/ro/professional_law.json -> build/lib/unitxt/catalog/cards/global_mmlu/ro 2026-05-27T11:53:35,165 copying src/unitxt/catalog/cards/global_mmlu/ro/machine_learning.json -> build/lib/unitxt/catalog/cards/global_mmlu/ro 2026-05-27T11:53:35,167 copying src/unitxt/catalog/cards/global_mmlu/ro/international_law.json -> build/lib/unitxt/catalog/cards/global_mmlu/ro 2026-05-27T11:53:35,169 copying src/unitxt/catalog/cards/global_mmlu/ro/medical_genetics.json -> build/lib/unitxt/catalog/cards/global_mmlu/ro 2026-05-27T11:53:35,172 copying src/unitxt/catalog/cards/global_mmlu/ro/high_school_computer_science.json -> build/lib/unitxt/catalog/cards/global_mmlu/ro 2026-05-27T11:53:35,174 copying src/unitxt/catalog/cards/global_mmlu/ro/clinical_knowledge.json -> build/lib/unitxt/catalog/cards/global_mmlu/ro 2026-05-27T11:53:35,176 copying src/unitxt/catalog/cards/global_mmlu/ro/college_physics.json -> build/lib/unitxt/catalog/cards/global_mmlu/ro 2026-05-27T11:53:35,178 copying src/unitxt/catalog/cards/global_mmlu/ro/global_facts.json -> build/lib/unitxt/catalog/cards/global_mmlu/ro 2026-05-27T11:53:35,181 copying src/unitxt/catalog/cards/global_mmlu/ro/college_computer_science.json -> build/lib/unitxt/catalog/cards/global_mmlu/ro 2026-05-27T11:53:35,183 copying src/unitxt/catalog/cards/global_mmlu/ro/us_foreign_policy.json -> build/lib/unitxt/catalog/cards/global_mmlu/ro 2026-05-27T11:53:35,185 copying src/unitxt/catalog/cards/global_mmlu/ro/professional_accounting.json -> build/lib/unitxt/catalog/cards/global_mmlu/ro 2026-05-27T11:53:35,187 copying src/unitxt/catalog/cards/global_mmlu/ro/professional_psychology.json -> build/lib/unitxt/catalog/cards/global_mmlu/ro 2026-05-27T11:53:35,190 copying src/unitxt/catalog/cards/global_mmlu/ro/philosophy.json -> build/lib/unitxt/catalog/cards/global_mmlu/ro 2026-05-27T11:53:35,192 copying src/unitxt/catalog/cards/global_mmlu/ro/elementary_mathematics.json -> build/lib/unitxt/catalog/cards/global_mmlu/ro 2026-05-27T11:53:35,194 copying src/unitxt/catalog/cards/global_mmlu/ro/conceptual_physics.json -> build/lib/unitxt/catalog/cards/global_mmlu/ro 2026-05-27T11:53:35,196 copying src/unitxt/catalog/cards/global_mmlu/ro/high_school_geography.json -> build/lib/unitxt/catalog/cards/global_mmlu/ro 2026-05-27T11:53:35,198 copying src/unitxt/catalog/cards/global_mmlu/ro/human_aging.json -> build/lib/unitxt/catalog/cards/global_mmlu/ro 2026-05-27T11:53:35,201 copying src/unitxt/catalog/cards/global_mmlu/ro/electrical_engineering.json -> build/lib/unitxt/catalog/cards/global_mmlu/ro 2026-05-27T11:53:35,203 copying src/unitxt/catalog/cards/global_mmlu/ro/management.json -> build/lib/unitxt/catalog/cards/global_mmlu/ro 2026-05-27T11:53:35,205 copying src/unitxt/catalog/cards/global_mmlu/ro/high_school_world_history.json -> build/lib/unitxt/catalog/cards/global_mmlu/ro 2026-05-27T11:53:35,207 copying src/unitxt/catalog/cards/global_mmlu/ro/marketing.json -> build/lib/unitxt/catalog/cards/global_mmlu/ro 2026-05-27T11:53:35,210 copying src/unitxt/catalog/cards/global_mmlu/ro/high_school_european_history.json -> build/lib/unitxt/catalog/cards/global_mmlu/ro 2026-05-27T11:53:35,212 copying src/unitxt/catalog/cards/global_mmlu/ro/astronomy.json -> build/lib/unitxt/catalog/cards/global_mmlu/ro 2026-05-27T11:53:35,214 copying src/unitxt/catalog/cards/global_mmlu/ro/high_school_physics.json -> build/lib/unitxt/catalog/cards/global_mmlu/ro 2026-05-27T11:53:35,216 copying src/unitxt/catalog/cards/global_mmlu/ro/public_relations.json -> build/lib/unitxt/catalog/cards/global_mmlu/ro 2026-05-27T11:53:35,219 copying src/unitxt/catalog/cards/global_mmlu/ro/high_school_microeconomics.json -> build/lib/unitxt/catalog/cards/global_mmlu/ro 2026-05-27T11:53:35,221 copying src/unitxt/catalog/cards/global_mmlu/ro/virology.json -> build/lib/unitxt/catalog/cards/global_mmlu/ro 2026-05-27T11:53:35,223 copying src/unitxt/catalog/cards/global_mmlu/ro/high_school_us_history.json -> build/lib/unitxt/catalog/cards/global_mmlu/ro 2026-05-27T11:53:35,225 copying src/unitxt/catalog/cards/global_mmlu/ro/high_school_statistics.json -> build/lib/unitxt/catalog/cards/global_mmlu/ro 2026-05-27T11:53:35,228 copying src/unitxt/catalog/cards/global_mmlu/ro/miscellaneous.json -> build/lib/unitxt/catalog/cards/global_mmlu/ro 2026-05-27T11:53:35,230 copying src/unitxt/catalog/cards/global_mmlu/ro/high_school_mathematics.json -> build/lib/unitxt/catalog/cards/global_mmlu/ro 2026-05-27T11:53:35,232 copying src/unitxt/catalog/cards/global_mmlu/ro/formal_logic.json -> build/lib/unitxt/catalog/cards/global_mmlu/ro 2026-05-27T11:53:35,234 copying src/unitxt/catalog/cards/global_mmlu/ro/high_school_chemistry.json -> build/lib/unitxt/catalog/cards/global_mmlu/ro 2026-05-27T11:53:35,237 copying src/unitxt/catalog/cards/global_mmlu/ro/abstract_algebra.json -> build/lib/unitxt/catalog/cards/global_mmlu/ro 2026-05-27T11:53:35,239 copying src/unitxt/catalog/cards/global_mmlu/ro/moral_scenarios.json -> build/lib/unitxt/catalog/cards/global_mmlu/ro 2026-05-27T11:53:35,241 copying src/unitxt/catalog/cards/global_mmlu/ro/world_religions.json -> build/lib/unitxt/catalog/cards/global_mmlu/ro 2026-05-27T11:53:35,244 copying src/unitxt/catalog/cards/global_mmlu/ro/business_ethics.json -> build/lib/unitxt/catalog/cards/global_mmlu/ro 2026-05-27T11:53:35,246 copying src/unitxt/catalog/cards/global_mmlu/ro/security_studies.json -> build/lib/unitxt/catalog/cards/global_mmlu/ro 2026-05-27T11:53:35,248 copying src/unitxt/catalog/cards/global_mmlu/ro/college_medicine.json -> build/lib/unitxt/catalog/cards/global_mmlu/ro 2026-05-27T11:53:35,250 copying src/unitxt/catalog/cards/global_mmlu/ro/human_sexuality.json -> build/lib/unitxt/catalog/cards/global_mmlu/ro 2026-05-27T11:53:35,253 copying src/unitxt/catalog/cards/global_mmlu/ro/prehistory.json -> build/lib/unitxt/catalog/cards/global_mmlu/ro 2026-05-27T11:53:35,255 creating build/lib/unitxt/catalog/cards/global_mmlu/fr 2026-05-27T11:53:35,255 copying src/unitxt/catalog/cards/global_mmlu/fr/moral_disputes.json -> build/lib/unitxt/catalog/cards/global_mmlu/fr 2026-05-27T11:53:35,258 copying src/unitxt/catalog/cards/global_mmlu/fr/high_school_biology.json -> build/lib/unitxt/catalog/cards/global_mmlu/fr 2026-05-27T11:53:35,260 copying src/unitxt/catalog/cards/global_mmlu/fr/jurisprudence.json -> build/lib/unitxt/catalog/cards/global_mmlu/fr 2026-05-27T11:53:35,262 copying src/unitxt/catalog/cards/global_mmlu/fr/logical_fallacies.json -> build/lib/unitxt/catalog/cards/global_mmlu/fr 2026-05-27T11:53:35,264 copying src/unitxt/catalog/cards/global_mmlu/fr/college_chemistry.json -> build/lib/unitxt/catalog/cards/global_mmlu/fr 2026-05-27T11:53:35,267 copying src/unitxt/catalog/cards/global_mmlu/fr/high_school_government_and_politics.json -> build/lib/unitxt/catalog/cards/global_mmlu/fr 2026-05-27T11:53:35,269 copying src/unitxt/catalog/cards/global_mmlu/fr/college_mathematics.json -> build/lib/unitxt/catalog/cards/global_mmlu/fr 2026-05-27T11:53:35,271 copying src/unitxt/catalog/cards/global_mmlu/fr/econometrics.json -> build/lib/unitxt/catalog/cards/global_mmlu/fr 2026-05-27T11:53:35,273 copying src/unitxt/catalog/cards/global_mmlu/fr/high_school_macroeconomics.json -> build/lib/unitxt/catalog/cards/global_mmlu/fr 2026-05-27T11:53:35,275 copying src/unitxt/catalog/cards/global_mmlu/fr/high_school_psychology.json -> build/lib/unitxt/catalog/cards/global_mmlu/fr 2026-05-27T11:53:35,277 copying src/unitxt/catalog/cards/global_mmlu/fr/computer_security.json -> build/lib/unitxt/catalog/cards/global_mmlu/fr 2026-05-27T11:53:35,280 copying src/unitxt/catalog/cards/global_mmlu/fr/sociology.json -> build/lib/unitxt/catalog/cards/global_mmlu/fr 2026-05-27T11:53:35,282 copying src/unitxt/catalog/cards/global_mmlu/fr/nutrition.json -> build/lib/unitxt/catalog/cards/global_mmlu/fr 2026-05-27T11:53:35,284 copying src/unitxt/catalog/cards/global_mmlu/fr/professional_medicine.json -> build/lib/unitxt/catalog/cards/global_mmlu/fr 2026-05-27T11:53:35,286 copying src/unitxt/catalog/cards/global_mmlu/fr/college_biology.json -> build/lib/unitxt/catalog/cards/global_mmlu/fr 2026-05-27T11:53:35,289 copying src/unitxt/catalog/cards/global_mmlu/fr/anatomy.json -> build/lib/unitxt/catalog/cards/global_mmlu/fr 2026-05-27T11:53:35,291 copying src/unitxt/catalog/cards/global_mmlu/fr/professional_law.json -> build/lib/unitxt/catalog/cards/global_mmlu/fr 2026-05-27T11:53:35,293 copying src/unitxt/catalog/cards/global_mmlu/fr/machine_learning.json -> build/lib/unitxt/catalog/cards/global_mmlu/fr 2026-05-27T11:53:35,295 copying src/unitxt/catalog/cards/global_mmlu/fr/international_law.json -> build/lib/unitxt/catalog/cards/global_mmlu/fr 2026-05-27T11:53:35,297 copying src/unitxt/catalog/cards/global_mmlu/fr/medical_genetics.json -> build/lib/unitxt/catalog/cards/global_mmlu/fr 2026-05-27T11:53:35,299 copying src/unitxt/catalog/cards/global_mmlu/fr/high_school_computer_science.json -> build/lib/unitxt/catalog/cards/global_mmlu/fr 2026-05-27T11:53:35,302 copying src/unitxt/catalog/cards/global_mmlu/fr/clinical_knowledge.json -> build/lib/unitxt/catalog/cards/global_mmlu/fr 2026-05-27T11:53:35,304 copying src/unitxt/catalog/cards/global_mmlu/fr/college_physics.json -> build/lib/unitxt/catalog/cards/global_mmlu/fr 2026-05-27T11:53:35,307 copying src/unitxt/catalog/cards/global_mmlu/fr/global_facts.json -> build/lib/unitxt/catalog/cards/global_mmlu/fr 2026-05-27T11:53:35,309 copying src/unitxt/catalog/cards/global_mmlu/fr/college_computer_science.json -> build/lib/unitxt/catalog/cards/global_mmlu/fr 2026-05-27T11:53:35,311 copying src/unitxt/catalog/cards/global_mmlu/fr/us_foreign_policy.json -> build/lib/unitxt/catalog/cards/global_mmlu/fr 2026-05-27T11:53:35,314 copying src/unitxt/catalog/cards/global_mmlu/fr/professional_accounting.json -> build/lib/unitxt/catalog/cards/global_mmlu/fr 2026-05-27T11:53:35,316 copying src/unitxt/catalog/cards/global_mmlu/fr/professional_psychology.json -> build/lib/unitxt/catalog/cards/global_mmlu/fr 2026-05-27T11:53:35,318 copying src/unitxt/catalog/cards/global_mmlu/fr/philosophy.json -> build/lib/unitxt/catalog/cards/global_mmlu/fr 2026-05-27T11:53:35,321 copying src/unitxt/catalog/cards/global_mmlu/fr/elementary_mathematics.json -> build/lib/unitxt/catalog/cards/global_mmlu/fr 2026-05-27T11:53:35,323 copying src/unitxt/catalog/cards/global_mmlu/fr/conceptual_physics.json -> build/lib/unitxt/catalog/cards/global_mmlu/fr 2026-05-27T11:53:35,325 copying src/unitxt/catalog/cards/global_mmlu/fr/high_school_geography.json -> build/lib/unitxt/catalog/cards/global_mmlu/fr 2026-05-27T11:53:35,328 copying src/unitxt/catalog/cards/global_mmlu/fr/human_aging.json -> build/lib/unitxt/catalog/cards/global_mmlu/fr 2026-05-27T11:53:35,330 copying src/unitxt/catalog/cards/global_mmlu/fr/electrical_engineering.json -> build/lib/unitxt/catalog/cards/global_mmlu/fr 2026-05-27T11:53:35,332 copying src/unitxt/catalog/cards/global_mmlu/fr/management.json -> build/lib/unitxt/catalog/cards/global_mmlu/fr 2026-05-27T11:53:35,335 copying src/unitxt/catalog/cards/global_mmlu/fr/high_school_world_history.json -> build/lib/unitxt/catalog/cards/global_mmlu/fr 2026-05-27T11:53:35,337 copying src/unitxt/catalog/cards/global_mmlu/fr/marketing.json -> build/lib/unitxt/catalog/cards/global_mmlu/fr 2026-05-27T11:53:35,339 copying src/unitxt/catalog/cards/global_mmlu/fr/high_school_european_history.json -> build/lib/unitxt/catalog/cards/global_mmlu/fr 2026-05-27T11:53:35,341 copying src/unitxt/catalog/cards/global_mmlu/fr/astronomy.json -> build/lib/unitxt/catalog/cards/global_mmlu/fr 2026-05-27T11:53:35,344 copying src/unitxt/catalog/cards/global_mmlu/fr/high_school_physics.json -> build/lib/unitxt/catalog/cards/global_mmlu/fr 2026-05-27T11:53:35,346 copying src/unitxt/catalog/cards/global_mmlu/fr/public_relations.json -> build/lib/unitxt/catalog/cards/global_mmlu/fr 2026-05-27T11:53:35,349 copying src/unitxt/catalog/cards/global_mmlu/fr/high_school_microeconomics.json -> build/lib/unitxt/catalog/cards/global_mmlu/fr 2026-05-27T11:53:35,351 copying src/unitxt/catalog/cards/global_mmlu/fr/virology.json -> build/lib/unitxt/catalog/cards/global_mmlu/fr 2026-05-27T11:53:35,353 copying src/unitxt/catalog/cards/global_mmlu/fr/high_school_us_history.json -> build/lib/unitxt/catalog/cards/global_mmlu/fr 2026-05-27T11:53:35,356 copying src/unitxt/catalog/cards/global_mmlu/fr/high_school_statistics.json -> build/lib/unitxt/catalog/cards/global_mmlu/fr 2026-05-27T11:53:35,358 copying src/unitxt/catalog/cards/global_mmlu/fr/miscellaneous.json -> build/lib/unitxt/catalog/cards/global_mmlu/fr 2026-05-27T11:53:35,361 copying src/unitxt/catalog/cards/global_mmlu/fr/high_school_mathematics.json -> build/lib/unitxt/catalog/cards/global_mmlu/fr 2026-05-27T11:53:35,363 copying src/unitxt/catalog/cards/global_mmlu/fr/formal_logic.json -> build/lib/unitxt/catalog/cards/global_mmlu/fr 2026-05-27T11:53:35,365 copying src/unitxt/catalog/cards/global_mmlu/fr/high_school_chemistry.json -> build/lib/unitxt/catalog/cards/global_mmlu/fr 2026-05-27T11:53:35,368 copying src/unitxt/catalog/cards/global_mmlu/fr/abstract_algebra.json -> build/lib/unitxt/catalog/cards/global_mmlu/fr 2026-05-27T11:53:35,370 copying src/unitxt/catalog/cards/global_mmlu/fr/moral_scenarios.json -> build/lib/unitxt/catalog/cards/global_mmlu/fr 2026-05-27T11:53:35,373 copying src/unitxt/catalog/cards/global_mmlu/fr/world_religions.json -> build/lib/unitxt/catalog/cards/global_mmlu/fr 2026-05-27T11:53:35,375 copying src/unitxt/catalog/cards/global_mmlu/fr/business_ethics.json -> build/lib/unitxt/catalog/cards/global_mmlu/fr 2026-05-27T11:53:35,377 copying src/unitxt/catalog/cards/global_mmlu/fr/security_studies.json -> build/lib/unitxt/catalog/cards/global_mmlu/fr 2026-05-27T11:53:35,380 copying src/unitxt/catalog/cards/global_mmlu/fr/college_medicine.json -> build/lib/unitxt/catalog/cards/global_mmlu/fr 2026-05-27T11:53:35,382 copying src/unitxt/catalog/cards/global_mmlu/fr/human_sexuality.json -> build/lib/unitxt/catalog/cards/global_mmlu/fr 2026-05-27T11:53:35,384 copying src/unitxt/catalog/cards/global_mmlu/fr/prehistory.json -> build/lib/unitxt/catalog/cards/global_mmlu/fr 2026-05-27T11:53:35,386 creating build/lib/unitxt/catalog/cards/global_mmlu/vi 2026-05-27T11:53:35,387 copying src/unitxt/catalog/cards/global_mmlu/vi/moral_disputes.json -> build/lib/unitxt/catalog/cards/global_mmlu/vi 2026-05-27T11:53:35,390 copying src/unitxt/catalog/cards/global_mmlu/vi/high_school_biology.json -> build/lib/unitxt/catalog/cards/global_mmlu/vi 2026-05-27T11:53:35,392 copying src/unitxt/catalog/cards/global_mmlu/vi/jurisprudence.json -> build/lib/unitxt/catalog/cards/global_mmlu/vi 2026-05-27T11:53:35,394 copying src/unitxt/catalog/cards/global_mmlu/vi/logical_fallacies.json -> build/lib/unitxt/catalog/cards/global_mmlu/vi 2026-05-27T11:53:35,397 copying src/unitxt/catalog/cards/global_mmlu/vi/college_chemistry.json -> build/lib/unitxt/catalog/cards/global_mmlu/vi 2026-05-27T11:53:35,400 copying src/unitxt/catalog/cards/global_mmlu/vi/high_school_government_and_politics.json -> build/lib/unitxt/catalog/cards/global_mmlu/vi 2026-05-27T11:53:35,402 copying src/unitxt/catalog/cards/global_mmlu/vi/college_mathematics.json -> build/lib/unitxt/catalog/cards/global_mmlu/vi 2026-05-27T11:53:35,404 copying src/unitxt/catalog/cards/global_mmlu/vi/econometrics.json -> build/lib/unitxt/catalog/cards/global_mmlu/vi 2026-05-27T11:53:35,407 copying src/unitxt/catalog/cards/global_mmlu/vi/high_school_macroeconomics.json -> build/lib/unitxt/catalog/cards/global_mmlu/vi 2026-05-27T11:53:35,409 copying src/unitxt/catalog/cards/global_mmlu/vi/high_school_psychology.json -> build/lib/unitxt/catalog/cards/global_mmlu/vi 2026-05-27T11:53:35,411 copying src/unitxt/catalog/cards/global_mmlu/vi/computer_security.json -> build/lib/unitxt/catalog/cards/global_mmlu/vi 2026-05-27T11:53:35,414 copying src/unitxt/catalog/cards/global_mmlu/vi/sociology.json -> build/lib/unitxt/catalog/cards/global_mmlu/vi 2026-05-27T11:53:35,416 copying src/unitxt/catalog/cards/global_mmlu/vi/nutrition.json -> build/lib/unitxt/catalog/cards/global_mmlu/vi 2026-05-27T11:53:35,418 copying src/unitxt/catalog/cards/global_mmlu/vi/professional_medicine.json -> build/lib/unitxt/catalog/cards/global_mmlu/vi 2026-05-27T11:53:35,421 copying src/unitxt/catalog/cards/global_mmlu/vi/college_biology.json -> build/lib/unitxt/catalog/cards/global_mmlu/vi 2026-05-27T11:53:35,423 copying src/unitxt/catalog/cards/global_mmlu/vi/anatomy.json -> build/lib/unitxt/catalog/cards/global_mmlu/vi 2026-05-27T11:53:35,426 copying src/unitxt/catalog/cards/global_mmlu/vi/professional_law.json -> build/lib/unitxt/catalog/cards/global_mmlu/vi 2026-05-27T11:53:35,428 copying src/unitxt/catalog/cards/global_mmlu/vi/machine_learning.json -> build/lib/unitxt/catalog/cards/global_mmlu/vi 2026-05-27T11:53:35,430 copying src/unitxt/catalog/cards/global_mmlu/vi/international_law.json -> build/lib/unitxt/catalog/cards/global_mmlu/vi 2026-05-27T11:53:35,433 copying src/unitxt/catalog/cards/global_mmlu/vi/medical_genetics.json -> build/lib/unitxt/catalog/cards/global_mmlu/vi 2026-05-27T11:53:35,435 copying src/unitxt/catalog/cards/global_mmlu/vi/high_school_computer_science.json -> build/lib/unitxt/catalog/cards/global_mmlu/vi 2026-05-27T11:53:35,438 copying src/unitxt/catalog/cards/global_mmlu/vi/clinical_knowledge.json -> build/lib/unitxt/catalog/cards/global_mmlu/vi 2026-05-27T11:53:35,440 copying src/unitxt/catalog/cards/global_mmlu/vi/college_physics.json -> build/lib/unitxt/catalog/cards/global_mmlu/vi 2026-05-27T11:53:35,443 copying src/unitxt/catalog/cards/global_mmlu/vi/global_facts.json -> build/lib/unitxt/catalog/cards/global_mmlu/vi 2026-05-27T11:53:35,445 copying src/unitxt/catalog/cards/global_mmlu/vi/college_computer_science.json -> build/lib/unitxt/catalog/cards/global_mmlu/vi 2026-05-27T11:53:35,447 copying src/unitxt/catalog/cards/global_mmlu/vi/us_foreign_policy.json -> build/lib/unitxt/catalog/cards/global_mmlu/vi 2026-05-27T11:53:35,450 copying src/unitxt/catalog/cards/global_mmlu/vi/professional_accounting.json -> build/lib/unitxt/catalog/cards/global_mmlu/vi 2026-05-27T11:53:35,452 copying src/unitxt/catalog/cards/global_mmlu/vi/professional_psychology.json -> build/lib/unitxt/catalog/cards/global_mmlu/vi 2026-05-27T11:53:35,454 copying src/unitxt/catalog/cards/global_mmlu/vi/philosophy.json -> build/lib/unitxt/catalog/cards/global_mmlu/vi 2026-05-27T11:53:35,457 copying src/unitxt/catalog/cards/global_mmlu/vi/elementary_mathematics.json -> build/lib/unitxt/catalog/cards/global_mmlu/vi 2026-05-27T11:53:35,459 copying src/unitxt/catalog/cards/global_mmlu/vi/conceptual_physics.json -> build/lib/unitxt/catalog/cards/global_mmlu/vi 2026-05-27T11:53:35,461 copying src/unitxt/catalog/cards/global_mmlu/vi/high_school_geography.json -> build/lib/unitxt/catalog/cards/global_mmlu/vi 2026-05-27T11:53:35,464 copying src/unitxt/catalog/cards/global_mmlu/vi/human_aging.json -> build/lib/unitxt/catalog/cards/global_mmlu/vi 2026-05-27T11:53:35,466 copying src/unitxt/catalog/cards/global_mmlu/vi/electrical_engineering.json -> build/lib/unitxt/catalog/cards/global_mmlu/vi 2026-05-27T11:53:35,468 copying src/unitxt/catalog/cards/global_mmlu/vi/management.json -> build/lib/unitxt/catalog/cards/global_mmlu/vi 2026-05-27T11:53:35,470 copying src/unitxt/catalog/cards/global_mmlu/vi/high_school_world_history.json -> build/lib/unitxt/catalog/cards/global_mmlu/vi 2026-05-27T11:53:35,473 copying src/unitxt/catalog/cards/global_mmlu/vi/marketing.json -> build/lib/unitxt/catalog/cards/global_mmlu/vi 2026-05-27T11:53:35,475 copying src/unitxt/catalog/cards/global_mmlu/vi/high_school_european_history.json -> build/lib/unitxt/catalog/cards/global_mmlu/vi 2026-05-27T11:53:35,477 copying src/unitxt/catalog/cards/global_mmlu/vi/astronomy.json -> build/lib/unitxt/catalog/cards/global_mmlu/vi 2026-05-27T11:53:35,480 copying src/unitxt/catalog/cards/global_mmlu/vi/high_school_physics.json -> build/lib/unitxt/catalog/cards/global_mmlu/vi 2026-05-27T11:53:35,482 copying src/unitxt/catalog/cards/global_mmlu/vi/public_relations.json -> build/lib/unitxt/catalog/cards/global_mmlu/vi 2026-05-27T11:53:35,484 copying src/unitxt/catalog/cards/global_mmlu/vi/high_school_microeconomics.json -> build/lib/unitxt/catalog/cards/global_mmlu/vi 2026-05-27T11:53:35,487 copying src/unitxt/catalog/cards/global_mmlu/vi/virology.json -> build/lib/unitxt/catalog/cards/global_mmlu/vi 2026-05-27T11:53:35,489 copying src/unitxt/catalog/cards/global_mmlu/vi/high_school_us_history.json -> build/lib/unitxt/catalog/cards/global_mmlu/vi 2026-05-27T11:53:35,492 copying src/unitxt/catalog/cards/global_mmlu/vi/high_school_statistics.json -> build/lib/unitxt/catalog/cards/global_mmlu/vi 2026-05-27T11:53:35,494 copying src/unitxt/catalog/cards/global_mmlu/vi/miscellaneous.json -> build/lib/unitxt/catalog/cards/global_mmlu/vi 2026-05-27T11:53:35,497 copying src/unitxt/catalog/cards/global_mmlu/vi/high_school_mathematics.json -> build/lib/unitxt/catalog/cards/global_mmlu/vi 2026-05-27T11:53:35,499 copying src/unitxt/catalog/cards/global_mmlu/vi/formal_logic.json -> build/lib/unitxt/catalog/cards/global_mmlu/vi 2026-05-27T11:53:35,501 copying src/unitxt/catalog/cards/global_mmlu/vi/high_school_chemistry.json -> build/lib/unitxt/catalog/cards/global_mmlu/vi 2026-05-27T11:53:35,504 copying src/unitxt/catalog/cards/global_mmlu/vi/abstract_algebra.json -> build/lib/unitxt/catalog/cards/global_mmlu/vi 2026-05-27T11:53:35,506 copying src/unitxt/catalog/cards/global_mmlu/vi/moral_scenarios.json -> build/lib/unitxt/catalog/cards/global_mmlu/vi 2026-05-27T11:53:35,509 copying src/unitxt/catalog/cards/global_mmlu/vi/world_religions.json -> build/lib/unitxt/catalog/cards/global_mmlu/vi 2026-05-27T11:53:35,511 copying src/unitxt/catalog/cards/global_mmlu/vi/business_ethics.json -> build/lib/unitxt/catalog/cards/global_mmlu/vi 2026-05-27T11:53:35,513 copying src/unitxt/catalog/cards/global_mmlu/vi/security_studies.json -> build/lib/unitxt/catalog/cards/global_mmlu/vi 2026-05-27T11:53:35,515 copying src/unitxt/catalog/cards/global_mmlu/vi/college_medicine.json -> build/lib/unitxt/catalog/cards/global_mmlu/vi 2026-05-27T11:53:35,518 copying src/unitxt/catalog/cards/global_mmlu/vi/human_sexuality.json -> build/lib/unitxt/catalog/cards/global_mmlu/vi 2026-05-27T11:53:35,520 copying src/unitxt/catalog/cards/global_mmlu/vi/prehistory.json -> build/lib/unitxt/catalog/cards/global_mmlu/vi 2026-05-27T11:53:35,522 creating build/lib/unitxt/catalog/cards/global_mmlu/ne 2026-05-27T11:53:35,523 copying src/unitxt/catalog/cards/global_mmlu/ne/moral_disputes.json -> build/lib/unitxt/catalog/cards/global_mmlu/ne 2026-05-27T11:53:35,526 copying src/unitxt/catalog/cards/global_mmlu/ne/high_school_biology.json -> build/lib/unitxt/catalog/cards/global_mmlu/ne 2026-05-27T11:53:35,528 copying src/unitxt/catalog/cards/global_mmlu/ne/jurisprudence.json -> build/lib/unitxt/catalog/cards/global_mmlu/ne 2026-05-27T11:53:35,531 copying src/unitxt/catalog/cards/global_mmlu/ne/logical_fallacies.json -> build/lib/unitxt/catalog/cards/global_mmlu/ne 2026-05-27T11:53:35,533 copying src/unitxt/catalog/cards/global_mmlu/ne/college_chemistry.json -> build/lib/unitxt/catalog/cards/global_mmlu/ne 2026-05-27T11:53:35,535 copying src/unitxt/catalog/cards/global_mmlu/ne/high_school_government_and_politics.json -> build/lib/unitxt/catalog/cards/global_mmlu/ne 2026-05-27T11:53:35,537 copying src/unitxt/catalog/cards/global_mmlu/ne/college_mathematics.json -> build/lib/unitxt/catalog/cards/global_mmlu/ne 2026-05-27T11:53:35,540 copying src/unitxt/catalog/cards/global_mmlu/ne/econometrics.json -> build/lib/unitxt/catalog/cards/global_mmlu/ne 2026-05-27T11:53:35,542 copying src/unitxt/catalog/cards/global_mmlu/ne/high_school_macroeconomics.json -> build/lib/unitxt/catalog/cards/global_mmlu/ne 2026-05-27T11:53:35,544 copying src/unitxt/catalog/cards/global_mmlu/ne/high_school_psychology.json -> build/lib/unitxt/catalog/cards/global_mmlu/ne 2026-05-27T11:53:35,547 copying src/unitxt/catalog/cards/global_mmlu/ne/computer_security.json -> build/lib/unitxt/catalog/cards/global_mmlu/ne 2026-05-27T11:53:35,549 copying src/unitxt/catalog/cards/global_mmlu/ne/sociology.json -> build/lib/unitxt/catalog/cards/global_mmlu/ne 2026-05-27T11:53:35,551 copying src/unitxt/catalog/cards/global_mmlu/ne/nutrition.json -> build/lib/unitxt/catalog/cards/global_mmlu/ne 2026-05-27T11:53:35,554 copying src/unitxt/catalog/cards/global_mmlu/ne/professional_medicine.json -> build/lib/unitxt/catalog/cards/global_mmlu/ne 2026-05-27T11:53:35,556 copying src/unitxt/catalog/cards/global_mmlu/ne/college_biology.json -> build/lib/unitxt/catalog/cards/global_mmlu/ne 2026-05-27T11:53:35,558 copying src/unitxt/catalog/cards/global_mmlu/ne/anatomy.json -> build/lib/unitxt/catalog/cards/global_mmlu/ne 2026-05-27T11:53:35,561 copying src/unitxt/catalog/cards/global_mmlu/ne/professional_law.json -> build/lib/unitxt/catalog/cards/global_mmlu/ne 2026-05-27T11:53:35,563 copying src/unitxt/catalog/cards/global_mmlu/ne/machine_learning.json -> build/lib/unitxt/catalog/cards/global_mmlu/ne 2026-05-27T11:53:35,565 copying src/unitxt/catalog/cards/global_mmlu/ne/international_law.json -> build/lib/unitxt/catalog/cards/global_mmlu/ne 2026-05-27T11:53:35,567 copying src/unitxt/catalog/cards/global_mmlu/ne/medical_genetics.json -> build/lib/unitxt/catalog/cards/global_mmlu/ne 2026-05-27T11:53:35,570 copying src/unitxt/catalog/cards/global_mmlu/ne/high_school_computer_science.json -> build/lib/unitxt/catalog/cards/global_mmlu/ne 2026-05-27T11:53:35,572 copying src/unitxt/catalog/cards/global_mmlu/ne/clinical_knowledge.json -> build/lib/unitxt/catalog/cards/global_mmlu/ne 2026-05-27T11:53:35,575 copying src/unitxt/catalog/cards/global_mmlu/ne/college_physics.json -> build/lib/unitxt/catalog/cards/global_mmlu/ne 2026-05-27T11:53:35,577 copying src/unitxt/catalog/cards/global_mmlu/ne/global_facts.json -> build/lib/unitxt/catalog/cards/global_mmlu/ne 2026-05-27T11:53:35,579 copying src/unitxt/catalog/cards/global_mmlu/ne/college_computer_science.json -> build/lib/unitxt/catalog/cards/global_mmlu/ne 2026-05-27T11:53:35,582 copying src/unitxt/catalog/cards/global_mmlu/ne/us_foreign_policy.json -> build/lib/unitxt/catalog/cards/global_mmlu/ne 2026-05-27T11:53:35,584 copying src/unitxt/catalog/cards/global_mmlu/ne/professional_accounting.json -> build/lib/unitxt/catalog/cards/global_mmlu/ne 2026-05-27T11:53:35,586 copying src/unitxt/catalog/cards/global_mmlu/ne/professional_psychology.json -> build/lib/unitxt/catalog/cards/global_mmlu/ne 2026-05-27T11:53:35,589 copying src/unitxt/catalog/cards/global_mmlu/ne/philosophy.json -> build/lib/unitxt/catalog/cards/global_mmlu/ne 2026-05-27T11:53:35,591 copying src/unitxt/catalog/cards/global_mmlu/ne/elementary_mathematics.json -> build/lib/unitxt/catalog/cards/global_mmlu/ne 2026-05-27T11:53:35,593 copying src/unitxt/catalog/cards/global_mmlu/ne/conceptual_physics.json -> build/lib/unitxt/catalog/cards/global_mmlu/ne 2026-05-27T11:53:35,596 copying src/unitxt/catalog/cards/global_mmlu/ne/high_school_geography.json -> build/lib/unitxt/catalog/cards/global_mmlu/ne 2026-05-27T11:53:35,598 copying src/unitxt/catalog/cards/global_mmlu/ne/human_aging.json -> build/lib/unitxt/catalog/cards/global_mmlu/ne 2026-05-27T11:53:35,601 copying src/unitxt/catalog/cards/global_mmlu/ne/electrical_engineering.json -> build/lib/unitxt/catalog/cards/global_mmlu/ne 2026-05-27T11:53:35,603 copying src/unitxt/catalog/cards/global_mmlu/ne/management.json -> build/lib/unitxt/catalog/cards/global_mmlu/ne 2026-05-27T11:53:35,605 copying src/unitxt/catalog/cards/global_mmlu/ne/high_school_world_history.json -> build/lib/unitxt/catalog/cards/global_mmlu/ne 2026-05-27T11:53:35,608 copying src/unitxt/catalog/cards/global_mmlu/ne/marketing.json -> build/lib/unitxt/catalog/cards/global_mmlu/ne 2026-05-27T11:53:35,610 copying src/unitxt/catalog/cards/global_mmlu/ne/high_school_european_history.json -> build/lib/unitxt/catalog/cards/global_mmlu/ne 2026-05-27T11:53:35,613 copying src/unitxt/catalog/cards/global_mmlu/ne/astronomy.json -> build/lib/unitxt/catalog/cards/global_mmlu/ne 2026-05-27T11:53:35,615 copying src/unitxt/catalog/cards/global_mmlu/ne/high_school_physics.json -> build/lib/unitxt/catalog/cards/global_mmlu/ne 2026-05-27T11:53:35,617 copying src/unitxt/catalog/cards/global_mmlu/ne/public_relations.json -> build/lib/unitxt/catalog/cards/global_mmlu/ne 2026-05-27T11:53:35,620 copying src/unitxt/catalog/cards/global_mmlu/ne/high_school_microeconomics.json -> build/lib/unitxt/catalog/cards/global_mmlu/ne 2026-05-27T11:53:35,622 copying src/unitxt/catalog/cards/global_mmlu/ne/virology.json -> build/lib/unitxt/catalog/cards/global_mmlu/ne 2026-05-27T11:53:35,625 copying src/unitxt/catalog/cards/global_mmlu/ne/high_school_us_history.json -> build/lib/unitxt/catalog/cards/global_mmlu/ne 2026-05-27T11:53:35,627 copying src/unitxt/catalog/cards/global_mmlu/ne/high_school_statistics.json -> build/lib/unitxt/catalog/cards/global_mmlu/ne 2026-05-27T11:53:35,630 copying src/unitxt/catalog/cards/global_mmlu/ne/miscellaneous.json -> build/lib/unitxt/catalog/cards/global_mmlu/ne 2026-05-27T11:53:35,632 copying src/unitxt/catalog/cards/global_mmlu/ne/high_school_mathematics.json -> build/lib/unitxt/catalog/cards/global_mmlu/ne 2026-05-27T11:53:35,634 copying src/unitxt/catalog/cards/global_mmlu/ne/formal_logic.json -> build/lib/unitxt/catalog/cards/global_mmlu/ne 2026-05-27T11:53:35,637 copying src/unitxt/catalog/cards/global_mmlu/ne/high_school_chemistry.json -> build/lib/unitxt/catalog/cards/global_mmlu/ne 2026-05-27T11:53:35,639 copying src/unitxt/catalog/cards/global_mmlu/ne/abstract_algebra.json -> build/lib/unitxt/catalog/cards/global_mmlu/ne 2026-05-27T11:53:35,641 copying src/unitxt/catalog/cards/global_mmlu/ne/moral_scenarios.json -> build/lib/unitxt/catalog/cards/global_mmlu/ne 2026-05-27T11:53:35,643 copying src/unitxt/catalog/cards/global_mmlu/ne/world_religions.json -> build/lib/unitxt/catalog/cards/global_mmlu/ne 2026-05-27T11:53:35,646 copying src/unitxt/catalog/cards/global_mmlu/ne/business_ethics.json -> build/lib/unitxt/catalog/cards/global_mmlu/ne 2026-05-27T11:53:35,648 copying src/unitxt/catalog/cards/global_mmlu/ne/security_studies.json -> build/lib/unitxt/catalog/cards/global_mmlu/ne 2026-05-27T11:53:35,650 copying src/unitxt/catalog/cards/global_mmlu/ne/college_medicine.json -> build/lib/unitxt/catalog/cards/global_mmlu/ne 2026-05-27T11:53:35,652 copying src/unitxt/catalog/cards/global_mmlu/ne/human_sexuality.json -> build/lib/unitxt/catalog/cards/global_mmlu/ne 2026-05-27T11:53:35,655 copying src/unitxt/catalog/cards/global_mmlu/ne/prehistory.json -> build/lib/unitxt/catalog/cards/global_mmlu/ne 2026-05-27T11:53:35,657 creating build/lib/unitxt/catalog/cards/global_mmlu/nl 2026-05-27T11:53:35,658 copying src/unitxt/catalog/cards/global_mmlu/nl/moral_disputes.json -> build/lib/unitxt/catalog/cards/global_mmlu/nl 2026-05-27T11:53:35,660 copying src/unitxt/catalog/cards/global_mmlu/nl/high_school_biology.json -> build/lib/unitxt/catalog/cards/global_mmlu/nl 2026-05-27T11:53:35,663 copying src/unitxt/catalog/cards/global_mmlu/nl/jurisprudence.json -> build/lib/unitxt/catalog/cards/global_mmlu/nl 2026-05-27T11:53:35,665 copying src/unitxt/catalog/cards/global_mmlu/nl/logical_fallacies.json -> build/lib/unitxt/catalog/cards/global_mmlu/nl 2026-05-27T11:53:35,667 copying src/unitxt/catalog/cards/global_mmlu/nl/college_chemistry.json -> build/lib/unitxt/catalog/cards/global_mmlu/nl 2026-05-27T11:53:35,670 copying src/unitxt/catalog/cards/global_mmlu/nl/high_school_government_and_politics.json -> build/lib/unitxt/catalog/cards/global_mmlu/nl 2026-05-27T11:53:35,672 copying src/unitxt/catalog/cards/global_mmlu/nl/college_mathematics.json -> build/lib/unitxt/catalog/cards/global_mmlu/nl 2026-05-27T11:53:35,674 copying src/unitxt/catalog/cards/global_mmlu/nl/econometrics.json -> build/lib/unitxt/catalog/cards/global_mmlu/nl 2026-05-27T11:53:35,677 copying src/unitxt/catalog/cards/global_mmlu/nl/high_school_macroeconomics.json -> build/lib/unitxt/catalog/cards/global_mmlu/nl 2026-05-27T11:53:35,679 copying src/unitxt/catalog/cards/global_mmlu/nl/high_school_psychology.json -> build/lib/unitxt/catalog/cards/global_mmlu/nl 2026-05-27T11:53:35,682 copying src/unitxt/catalog/cards/global_mmlu/nl/computer_security.json -> build/lib/unitxt/catalog/cards/global_mmlu/nl 2026-05-27T11:53:35,684 copying src/unitxt/catalog/cards/global_mmlu/nl/sociology.json -> build/lib/unitxt/catalog/cards/global_mmlu/nl 2026-05-27T11:53:35,687 copying src/unitxt/catalog/cards/global_mmlu/nl/nutrition.json -> build/lib/unitxt/catalog/cards/global_mmlu/nl 2026-05-27T11:53:35,689 copying src/unitxt/catalog/cards/global_mmlu/nl/professional_medicine.json -> build/lib/unitxt/catalog/cards/global_mmlu/nl 2026-05-27T11:53:35,691 copying src/unitxt/catalog/cards/global_mmlu/nl/college_biology.json -> build/lib/unitxt/catalog/cards/global_mmlu/nl 2026-05-27T11:53:35,693 copying src/unitxt/catalog/cards/global_mmlu/nl/anatomy.json -> build/lib/unitxt/catalog/cards/global_mmlu/nl 2026-05-27T11:53:35,696 copying src/unitxt/catalog/cards/global_mmlu/nl/professional_law.json -> build/lib/unitxt/catalog/cards/global_mmlu/nl 2026-05-27T11:53:35,698 copying src/unitxt/catalog/cards/global_mmlu/nl/machine_learning.json -> build/lib/unitxt/catalog/cards/global_mmlu/nl 2026-05-27T11:53:35,701 copying src/unitxt/catalog/cards/global_mmlu/nl/international_law.json -> build/lib/unitxt/catalog/cards/global_mmlu/nl 2026-05-27T11:53:35,703 copying src/unitxt/catalog/cards/global_mmlu/nl/medical_genetics.json -> build/lib/unitxt/catalog/cards/global_mmlu/nl 2026-05-27T11:53:35,705 copying src/unitxt/catalog/cards/global_mmlu/nl/high_school_computer_science.json -> build/lib/unitxt/catalog/cards/global_mmlu/nl 2026-05-27T11:53:35,708 copying src/unitxt/catalog/cards/global_mmlu/nl/clinical_knowledge.json -> build/lib/unitxt/catalog/cards/global_mmlu/nl 2026-05-27T11:53:35,710 copying src/unitxt/catalog/cards/global_mmlu/nl/college_physics.json -> build/lib/unitxt/catalog/cards/global_mmlu/nl 2026-05-27T11:53:35,712 copying src/unitxt/catalog/cards/global_mmlu/nl/global_facts.json -> build/lib/unitxt/catalog/cards/global_mmlu/nl 2026-05-27T11:53:35,714 copying src/unitxt/catalog/cards/global_mmlu/nl/college_computer_science.json -> build/lib/unitxt/catalog/cards/global_mmlu/nl 2026-05-27T11:53:35,716 copying src/unitxt/catalog/cards/global_mmlu/nl/us_foreign_policy.json -> build/lib/unitxt/catalog/cards/global_mmlu/nl 2026-05-27T11:53:35,719 copying src/unitxt/catalog/cards/global_mmlu/nl/professional_accounting.json -> build/lib/unitxt/catalog/cards/global_mmlu/nl 2026-05-27T11:53:35,721 copying src/unitxt/catalog/cards/global_mmlu/nl/professional_psychology.json -> build/lib/unitxt/catalog/cards/global_mmlu/nl 2026-05-27T11:53:35,723 copying src/unitxt/catalog/cards/global_mmlu/nl/philosophy.json -> build/lib/unitxt/catalog/cards/global_mmlu/nl 2026-05-27T11:53:35,725 copying src/unitxt/catalog/cards/global_mmlu/nl/elementary_mathematics.json -> build/lib/unitxt/catalog/cards/global_mmlu/nl 2026-05-27T11:53:35,728 copying src/unitxt/catalog/cards/global_mmlu/nl/conceptual_physics.json -> build/lib/unitxt/catalog/cards/global_mmlu/nl 2026-05-27T11:53:35,730 copying src/unitxt/catalog/cards/global_mmlu/nl/high_school_geography.json -> build/lib/unitxt/catalog/cards/global_mmlu/nl 2026-05-27T11:53:35,732 copying src/unitxt/catalog/cards/global_mmlu/nl/human_aging.json -> build/lib/unitxt/catalog/cards/global_mmlu/nl 2026-05-27T11:53:35,734 copying src/unitxt/catalog/cards/global_mmlu/nl/electrical_engineering.json -> build/lib/unitxt/catalog/cards/global_mmlu/nl 2026-05-27T11:53:35,737 copying src/unitxt/catalog/cards/global_mmlu/nl/management.json -> build/lib/unitxt/catalog/cards/global_mmlu/nl 2026-05-27T11:53:35,739 copying src/unitxt/catalog/cards/global_mmlu/nl/high_school_world_history.json -> build/lib/unitxt/catalog/cards/global_mmlu/nl 2026-05-27T11:53:35,742 copying src/unitxt/catalog/cards/global_mmlu/nl/marketing.json -> build/lib/unitxt/catalog/cards/global_mmlu/nl 2026-05-27T11:53:35,744 copying src/unitxt/catalog/cards/global_mmlu/nl/high_school_european_history.json -> build/lib/unitxt/catalog/cards/global_mmlu/nl 2026-05-27T11:53:35,746 copying src/unitxt/catalog/cards/global_mmlu/nl/astronomy.json -> build/lib/unitxt/catalog/cards/global_mmlu/nl 2026-05-27T11:53:35,749 copying src/unitxt/catalog/cards/global_mmlu/nl/high_school_physics.json -> build/lib/unitxt/catalog/cards/global_mmlu/nl 2026-05-27T11:53:35,751 copying src/unitxt/catalog/cards/global_mmlu/nl/public_relations.json -> build/lib/unitxt/catalog/cards/global_mmlu/nl 2026-05-27T11:53:35,754 copying src/unitxt/catalog/cards/global_mmlu/nl/high_school_microeconomics.json -> build/lib/unitxt/catalog/cards/global_mmlu/nl 2026-05-27T11:53:35,756 copying src/unitxt/catalog/cards/global_mmlu/nl/virology.json -> build/lib/unitxt/catalog/cards/global_mmlu/nl 2026-05-27T11:53:35,758 copying src/unitxt/catalog/cards/global_mmlu/nl/high_school_us_history.json -> build/lib/unitxt/catalog/cards/global_mmlu/nl 2026-05-27T11:53:35,761 copying src/unitxt/catalog/cards/global_mmlu/nl/high_school_statistics.json -> build/lib/unitxt/catalog/cards/global_mmlu/nl 2026-05-27T11:53:35,763 copying src/unitxt/catalog/cards/global_mmlu/nl/miscellaneous.json -> build/lib/unitxt/catalog/cards/global_mmlu/nl 2026-05-27T11:53:35,766 copying src/unitxt/catalog/cards/global_mmlu/nl/high_school_mathematics.json -> build/lib/unitxt/catalog/cards/global_mmlu/nl 2026-05-27T11:53:35,768 copying src/unitxt/catalog/cards/global_mmlu/nl/formal_logic.json -> build/lib/unitxt/catalog/cards/global_mmlu/nl 2026-05-27T11:53:35,771 copying src/unitxt/catalog/cards/global_mmlu/nl/high_school_chemistry.json -> build/lib/unitxt/catalog/cards/global_mmlu/nl 2026-05-27T11:53:35,773 copying src/unitxt/catalog/cards/global_mmlu/nl/abstract_algebra.json -> build/lib/unitxt/catalog/cards/global_mmlu/nl 2026-05-27T11:53:35,775 copying src/unitxt/catalog/cards/global_mmlu/nl/moral_scenarios.json -> build/lib/unitxt/catalog/cards/global_mmlu/nl 2026-05-27T11:53:35,778 copying src/unitxt/catalog/cards/global_mmlu/nl/world_religions.json -> build/lib/unitxt/catalog/cards/global_mmlu/nl 2026-05-27T11:53:35,780 copying src/unitxt/catalog/cards/global_mmlu/nl/business_ethics.json -> build/lib/unitxt/catalog/cards/global_mmlu/nl 2026-05-27T11:53:35,782 copying src/unitxt/catalog/cards/global_mmlu/nl/security_studies.json -> build/lib/unitxt/catalog/cards/global_mmlu/nl 2026-05-27T11:53:35,785 copying src/unitxt/catalog/cards/global_mmlu/nl/college_medicine.json -> build/lib/unitxt/catalog/cards/global_mmlu/nl 2026-05-27T11:53:35,787 copying src/unitxt/catalog/cards/global_mmlu/nl/human_sexuality.json -> build/lib/unitxt/catalog/cards/global_mmlu/nl 2026-05-27T11:53:35,789 copying src/unitxt/catalog/cards/global_mmlu/nl/prehistory.json -> build/lib/unitxt/catalog/cards/global_mmlu/nl 2026-05-27T11:53:35,792 creating build/lib/unitxt/catalog/cards/global_mmlu/sr 2026-05-27T11:53:35,793 copying src/unitxt/catalog/cards/global_mmlu/sr/moral_disputes.json -> build/lib/unitxt/catalog/cards/global_mmlu/sr 2026-05-27T11:53:35,795 copying src/unitxt/catalog/cards/global_mmlu/sr/high_school_biology.json -> build/lib/unitxt/catalog/cards/global_mmlu/sr 2026-05-27T11:53:35,797 copying src/unitxt/catalog/cards/global_mmlu/sr/jurisprudence.json -> build/lib/unitxt/catalog/cards/global_mmlu/sr 2026-05-27T11:53:35,800 copying src/unitxt/catalog/cards/global_mmlu/sr/logical_fallacies.json -> build/lib/unitxt/catalog/cards/global_mmlu/sr 2026-05-27T11:53:35,802 copying src/unitxt/catalog/cards/global_mmlu/sr/college_chemistry.json -> build/lib/unitxt/catalog/cards/global_mmlu/sr 2026-05-27T11:53:35,805 copying src/unitxt/catalog/cards/global_mmlu/sr/high_school_government_and_politics.json -> build/lib/unitxt/catalog/cards/global_mmlu/sr 2026-05-27T11:53:35,807 copying src/unitxt/catalog/cards/global_mmlu/sr/college_mathematics.json -> build/lib/unitxt/catalog/cards/global_mmlu/sr 2026-05-27T11:53:35,810 copying src/unitxt/catalog/cards/global_mmlu/sr/econometrics.json -> build/lib/unitxt/catalog/cards/global_mmlu/sr 2026-05-27T11:53:35,812 copying src/unitxt/catalog/cards/global_mmlu/sr/high_school_macroeconomics.json -> build/lib/unitxt/catalog/cards/global_mmlu/sr 2026-05-27T11:53:35,814 copying src/unitxt/catalog/cards/global_mmlu/sr/high_school_psychology.json -> build/lib/unitxt/catalog/cards/global_mmlu/sr 2026-05-27T11:53:35,817 copying src/unitxt/catalog/cards/global_mmlu/sr/computer_security.json -> build/lib/unitxt/catalog/cards/global_mmlu/sr 2026-05-27T11:53:35,819 copying src/unitxt/catalog/cards/global_mmlu/sr/sociology.json -> build/lib/unitxt/catalog/cards/global_mmlu/sr 2026-05-27T11:53:35,821 copying src/unitxt/catalog/cards/global_mmlu/sr/nutrition.json -> build/lib/unitxt/catalog/cards/global_mmlu/sr 2026-05-27T11:53:35,824 copying src/unitxt/catalog/cards/global_mmlu/sr/professional_medicine.json -> build/lib/unitxt/catalog/cards/global_mmlu/sr 2026-05-27T11:53:35,826 copying src/unitxt/catalog/cards/global_mmlu/sr/college_biology.json -> build/lib/unitxt/catalog/cards/global_mmlu/sr 2026-05-27T11:53:35,829 copying src/unitxt/catalog/cards/global_mmlu/sr/anatomy.json -> build/lib/unitxt/catalog/cards/global_mmlu/sr 2026-05-27T11:53:35,831 copying src/unitxt/catalog/cards/global_mmlu/sr/professional_law.json -> build/lib/unitxt/catalog/cards/global_mmlu/sr 2026-05-27T11:53:35,834 copying src/unitxt/catalog/cards/global_mmlu/sr/machine_learning.json -> build/lib/unitxt/catalog/cards/global_mmlu/sr 2026-05-27T11:53:35,836 copying src/unitxt/catalog/cards/global_mmlu/sr/international_law.json -> build/lib/unitxt/catalog/cards/global_mmlu/sr 2026-05-27T11:53:35,839 copying src/unitxt/catalog/cards/global_mmlu/sr/medical_genetics.json -> build/lib/unitxt/catalog/cards/global_mmlu/sr 2026-05-27T11:53:35,841 copying src/unitxt/catalog/cards/global_mmlu/sr/high_school_computer_science.json -> build/lib/unitxt/catalog/cards/global_mmlu/sr 2026-05-27T11:53:35,843 copying src/unitxt/catalog/cards/global_mmlu/sr/clinical_knowledge.json -> build/lib/unitxt/catalog/cards/global_mmlu/sr 2026-05-27T11:53:35,845 copying src/unitxt/catalog/cards/global_mmlu/sr/college_physics.json -> build/lib/unitxt/catalog/cards/global_mmlu/sr 2026-05-27T11:53:35,847 copying src/unitxt/catalog/cards/global_mmlu/sr/global_facts.json -> build/lib/unitxt/catalog/cards/global_mmlu/sr 2026-05-27T11:53:35,850 copying src/unitxt/catalog/cards/global_mmlu/sr/college_computer_science.json -> build/lib/unitxt/catalog/cards/global_mmlu/sr 2026-05-27T11:53:35,852 copying src/unitxt/catalog/cards/global_mmlu/sr/us_foreign_policy.json -> build/lib/unitxt/catalog/cards/global_mmlu/sr 2026-05-27T11:53:35,854 copying src/unitxt/catalog/cards/global_mmlu/sr/professional_accounting.json -> build/lib/unitxt/catalog/cards/global_mmlu/sr 2026-05-27T11:53:35,856 copying src/unitxt/catalog/cards/global_mmlu/sr/professional_psychology.json -> build/lib/unitxt/catalog/cards/global_mmlu/sr 2026-05-27T11:53:35,859 copying src/unitxt/catalog/cards/global_mmlu/sr/philosophy.json -> build/lib/unitxt/catalog/cards/global_mmlu/sr 2026-05-27T11:53:35,862 copying src/unitxt/catalog/cards/global_mmlu/sr/elementary_mathematics.json -> build/lib/unitxt/catalog/cards/global_mmlu/sr 2026-05-27T11:53:35,865 copying src/unitxt/catalog/cards/global_mmlu/sr/conceptual_physics.json -> build/lib/unitxt/catalog/cards/global_mmlu/sr 2026-05-27T11:53:35,868 copying src/unitxt/catalog/cards/global_mmlu/sr/high_school_geography.json -> build/lib/unitxt/catalog/cards/global_mmlu/sr 2026-05-27T11:53:35,870 copying src/unitxt/catalog/cards/global_mmlu/sr/human_aging.json -> build/lib/unitxt/catalog/cards/global_mmlu/sr 2026-05-27T11:53:35,873 copying src/unitxt/catalog/cards/global_mmlu/sr/electrical_engineering.json -> build/lib/unitxt/catalog/cards/global_mmlu/sr 2026-05-27T11:53:35,876 copying src/unitxt/catalog/cards/global_mmlu/sr/management.json -> build/lib/unitxt/catalog/cards/global_mmlu/sr 2026-05-27T11:53:35,879 copying src/unitxt/catalog/cards/global_mmlu/sr/high_school_world_history.json -> build/lib/unitxt/catalog/cards/global_mmlu/sr 2026-05-27T11:53:35,882 copying src/unitxt/catalog/cards/global_mmlu/sr/marketing.json -> build/lib/unitxt/catalog/cards/global_mmlu/sr 2026-05-27T11:53:35,884 copying src/unitxt/catalog/cards/global_mmlu/sr/high_school_european_history.json -> build/lib/unitxt/catalog/cards/global_mmlu/sr 2026-05-27T11:53:35,886 copying src/unitxt/catalog/cards/global_mmlu/sr/astronomy.json -> build/lib/unitxt/catalog/cards/global_mmlu/sr 2026-05-27T11:53:35,889 copying src/unitxt/catalog/cards/global_mmlu/sr/high_school_physics.json -> build/lib/unitxt/catalog/cards/global_mmlu/sr 2026-05-27T11:53:35,891 copying src/unitxt/catalog/cards/global_mmlu/sr/public_relations.json -> build/lib/unitxt/catalog/cards/global_mmlu/sr 2026-05-27T11:53:35,894 copying src/unitxt/catalog/cards/global_mmlu/sr/high_school_microeconomics.json -> build/lib/unitxt/catalog/cards/global_mmlu/sr 2026-05-27T11:53:35,896 copying src/unitxt/catalog/cards/global_mmlu/sr/virology.json -> build/lib/unitxt/catalog/cards/global_mmlu/sr 2026-05-27T11:53:35,898 copying src/unitxt/catalog/cards/global_mmlu/sr/high_school_us_history.json -> build/lib/unitxt/catalog/cards/global_mmlu/sr 2026-05-27T11:53:35,901 copying src/unitxt/catalog/cards/global_mmlu/sr/high_school_statistics.json -> build/lib/unitxt/catalog/cards/global_mmlu/sr 2026-05-27T11:53:35,903 copying src/unitxt/catalog/cards/global_mmlu/sr/miscellaneous.json -> build/lib/unitxt/catalog/cards/global_mmlu/sr 2026-05-27T11:53:35,905 copying src/unitxt/catalog/cards/global_mmlu/sr/high_school_mathematics.json -> build/lib/unitxt/catalog/cards/global_mmlu/sr 2026-05-27T11:53:35,908 copying src/unitxt/catalog/cards/global_mmlu/sr/formal_logic.json -> build/lib/unitxt/catalog/cards/global_mmlu/sr 2026-05-27T11:53:35,910 copying src/unitxt/catalog/cards/global_mmlu/sr/high_school_chemistry.json -> build/lib/unitxt/catalog/cards/global_mmlu/sr 2026-05-27T11:53:35,913 copying src/unitxt/catalog/cards/global_mmlu/sr/abstract_algebra.json -> build/lib/unitxt/catalog/cards/global_mmlu/sr 2026-05-27T11:53:35,915 copying src/unitxt/catalog/cards/global_mmlu/sr/moral_scenarios.json -> build/lib/unitxt/catalog/cards/global_mmlu/sr 2026-05-27T11:53:35,917 copying src/unitxt/catalog/cards/global_mmlu/sr/world_religions.json -> build/lib/unitxt/catalog/cards/global_mmlu/sr 2026-05-27T11:53:35,920 copying src/unitxt/catalog/cards/global_mmlu/sr/business_ethics.json -> build/lib/unitxt/catalog/cards/global_mmlu/sr 2026-05-27T11:53:35,922 copying src/unitxt/catalog/cards/global_mmlu/sr/security_studies.json -> build/lib/unitxt/catalog/cards/global_mmlu/sr 2026-05-27T11:53:35,925 copying src/unitxt/catalog/cards/global_mmlu/sr/college_medicine.json -> build/lib/unitxt/catalog/cards/global_mmlu/sr 2026-05-27T11:53:35,927 copying src/unitxt/catalog/cards/global_mmlu/sr/human_sexuality.json -> build/lib/unitxt/catalog/cards/global_mmlu/sr 2026-05-27T11:53:35,929 copying src/unitxt/catalog/cards/global_mmlu/sr/prehistory.json -> build/lib/unitxt/catalog/cards/global_mmlu/sr 2026-05-27T11:53:35,931 creating build/lib/unitxt/catalog/cards/global_mmlu/cs 2026-05-27T11:53:35,932 copying src/unitxt/catalog/cards/global_mmlu/cs/moral_disputes.json -> build/lib/unitxt/catalog/cards/global_mmlu/cs 2026-05-27T11:53:35,935 copying src/unitxt/catalog/cards/global_mmlu/cs/high_school_biology.json -> build/lib/unitxt/catalog/cards/global_mmlu/cs 2026-05-27T11:53:35,937 copying src/unitxt/catalog/cards/global_mmlu/cs/jurisprudence.json -> build/lib/unitxt/catalog/cards/global_mmlu/cs 2026-05-27T11:53:35,939 copying src/unitxt/catalog/cards/global_mmlu/cs/logical_fallacies.json -> build/lib/unitxt/catalog/cards/global_mmlu/cs 2026-05-27T11:53:35,942 copying src/unitxt/catalog/cards/global_mmlu/cs/college_chemistry.json -> build/lib/unitxt/catalog/cards/global_mmlu/cs 2026-05-27T11:53:35,944 copying src/unitxt/catalog/cards/global_mmlu/cs/high_school_government_and_politics.json -> build/lib/unitxt/catalog/cards/global_mmlu/cs 2026-05-27T11:53:35,946 copying src/unitxt/catalog/cards/global_mmlu/cs/college_mathematics.json -> build/lib/unitxt/catalog/cards/global_mmlu/cs 2026-05-27T11:53:35,949 copying src/unitxt/catalog/cards/global_mmlu/cs/econometrics.json -> build/lib/unitxt/catalog/cards/global_mmlu/cs 2026-05-27T11:53:35,951 copying src/unitxt/catalog/cards/global_mmlu/cs/high_school_macroeconomics.json -> build/lib/unitxt/catalog/cards/global_mmlu/cs 2026-05-27T11:53:35,953 copying src/unitxt/catalog/cards/global_mmlu/cs/high_school_psychology.json -> build/lib/unitxt/catalog/cards/global_mmlu/cs 2026-05-27T11:53:35,955 copying src/unitxt/catalog/cards/global_mmlu/cs/computer_security.json -> build/lib/unitxt/catalog/cards/global_mmlu/cs 2026-05-27T11:53:35,958 copying src/unitxt/catalog/cards/global_mmlu/cs/sociology.json -> build/lib/unitxt/catalog/cards/global_mmlu/cs 2026-05-27T11:53:35,960 copying src/unitxt/catalog/cards/global_mmlu/cs/nutrition.json -> build/lib/unitxt/catalog/cards/global_mmlu/cs 2026-05-27T11:53:35,962 copying src/unitxt/catalog/cards/global_mmlu/cs/professional_medicine.json -> build/lib/unitxt/catalog/cards/global_mmlu/cs 2026-05-27T11:53:35,965 copying src/unitxt/catalog/cards/global_mmlu/cs/college_biology.json -> build/lib/unitxt/catalog/cards/global_mmlu/cs 2026-05-27T11:53:35,967 copying src/unitxt/catalog/cards/global_mmlu/cs/anatomy.json -> build/lib/unitxt/catalog/cards/global_mmlu/cs 2026-05-27T11:53:35,970 copying src/unitxt/catalog/cards/global_mmlu/cs/professional_law.json -> build/lib/unitxt/catalog/cards/global_mmlu/cs 2026-05-27T11:53:35,972 copying src/unitxt/catalog/cards/global_mmlu/cs/machine_learning.json -> build/lib/unitxt/catalog/cards/global_mmlu/cs 2026-05-27T11:53:35,974 copying src/unitxt/catalog/cards/global_mmlu/cs/international_law.json -> build/lib/unitxt/catalog/cards/global_mmlu/cs 2026-05-27T11:53:35,976 copying src/unitxt/catalog/cards/global_mmlu/cs/medical_genetics.json -> build/lib/unitxt/catalog/cards/global_mmlu/cs 2026-05-27T11:53:35,978 copying src/unitxt/catalog/cards/global_mmlu/cs/high_school_computer_science.json -> build/lib/unitxt/catalog/cards/global_mmlu/cs 2026-05-27T11:53:35,981 copying src/unitxt/catalog/cards/global_mmlu/cs/clinical_knowledge.json -> build/lib/unitxt/catalog/cards/global_mmlu/cs 2026-05-27T11:53:35,983 copying src/unitxt/catalog/cards/global_mmlu/cs/college_physics.json -> build/lib/unitxt/catalog/cards/global_mmlu/cs 2026-05-27T11:53:35,985 copying src/unitxt/catalog/cards/global_mmlu/cs/global_facts.json -> build/lib/unitxt/catalog/cards/global_mmlu/cs 2026-05-27T11:53:35,987 copying src/unitxt/catalog/cards/global_mmlu/cs/college_computer_science.json -> build/lib/unitxt/catalog/cards/global_mmlu/cs 2026-05-27T11:53:35,990 copying src/unitxt/catalog/cards/global_mmlu/cs/us_foreign_policy.json -> build/lib/unitxt/catalog/cards/global_mmlu/cs 2026-05-27T11:53:35,992 copying src/unitxt/catalog/cards/global_mmlu/cs/professional_accounting.json -> build/lib/unitxt/catalog/cards/global_mmlu/cs 2026-05-27T11:53:35,994 copying src/unitxt/catalog/cards/global_mmlu/cs/professional_psychology.json -> build/lib/unitxt/catalog/cards/global_mmlu/cs 2026-05-27T11:53:35,997 copying src/unitxt/catalog/cards/global_mmlu/cs/philosophy.json -> build/lib/unitxt/catalog/cards/global_mmlu/cs 2026-05-27T11:53:35,999 copying src/unitxt/catalog/cards/global_mmlu/cs/elementary_mathematics.json -> build/lib/unitxt/catalog/cards/global_mmlu/cs 2026-05-27T11:53:36,001 copying src/unitxt/catalog/cards/global_mmlu/cs/conceptual_physics.json -> build/lib/unitxt/catalog/cards/global_mmlu/cs 2026-05-27T11:53:36,003 copying src/unitxt/catalog/cards/global_mmlu/cs/high_school_geography.json -> build/lib/unitxt/catalog/cards/global_mmlu/cs 2026-05-27T11:53:36,005 copying src/unitxt/catalog/cards/global_mmlu/cs/human_aging.json -> build/lib/unitxt/catalog/cards/global_mmlu/cs 2026-05-27T11:53:36,008 copying src/unitxt/catalog/cards/global_mmlu/cs/electrical_engineering.json -> build/lib/unitxt/catalog/cards/global_mmlu/cs 2026-05-27T11:53:36,010 copying src/unitxt/catalog/cards/global_mmlu/cs/management.json -> build/lib/unitxt/catalog/cards/global_mmlu/cs 2026-05-27T11:53:36,012 copying src/unitxt/catalog/cards/global_mmlu/cs/high_school_world_history.json -> build/lib/unitxt/catalog/cards/global_mmlu/cs 2026-05-27T11:53:36,015 copying src/unitxt/catalog/cards/global_mmlu/cs/marketing.json -> build/lib/unitxt/catalog/cards/global_mmlu/cs 2026-05-27T11:53:36,017 copying src/unitxt/catalog/cards/global_mmlu/cs/high_school_european_history.json -> build/lib/unitxt/catalog/cards/global_mmlu/cs 2026-05-27T11:53:36,019 copying src/unitxt/catalog/cards/global_mmlu/cs/astronomy.json -> build/lib/unitxt/catalog/cards/global_mmlu/cs 2026-05-27T11:53:36,022 copying src/unitxt/catalog/cards/global_mmlu/cs/high_school_physics.json -> build/lib/unitxt/catalog/cards/global_mmlu/cs 2026-05-27T11:53:36,024 copying src/unitxt/catalog/cards/global_mmlu/cs/public_relations.json -> build/lib/unitxt/catalog/cards/global_mmlu/cs 2026-05-27T11:53:36,026 copying src/unitxt/catalog/cards/global_mmlu/cs/high_school_microeconomics.json -> build/lib/unitxt/catalog/cards/global_mmlu/cs 2026-05-27T11:53:36,029 copying src/unitxt/catalog/cards/global_mmlu/cs/virology.json -> build/lib/unitxt/catalog/cards/global_mmlu/cs 2026-05-27T11:53:36,031 copying src/unitxt/catalog/cards/global_mmlu/cs/high_school_us_history.json -> build/lib/unitxt/catalog/cards/global_mmlu/cs 2026-05-27T11:53:36,033 copying src/unitxt/catalog/cards/global_mmlu/cs/high_school_statistics.json -> build/lib/unitxt/catalog/cards/global_mmlu/cs 2026-05-27T11:53:36,036 copying src/unitxt/catalog/cards/global_mmlu/cs/miscellaneous.json -> build/lib/unitxt/catalog/cards/global_mmlu/cs 2026-05-27T11:53:36,038 copying src/unitxt/catalog/cards/global_mmlu/cs/high_school_mathematics.json -> build/lib/unitxt/catalog/cards/global_mmlu/cs 2026-05-27T11:53:36,040 copying src/unitxt/catalog/cards/global_mmlu/cs/formal_logic.json -> build/lib/unitxt/catalog/cards/global_mmlu/cs 2026-05-27T11:53:36,042 copying src/unitxt/catalog/cards/global_mmlu/cs/high_school_chemistry.json -> build/lib/unitxt/catalog/cards/global_mmlu/cs 2026-05-27T11:53:36,045 copying src/unitxt/catalog/cards/global_mmlu/cs/abstract_algebra.json -> build/lib/unitxt/catalog/cards/global_mmlu/cs 2026-05-27T11:53:36,047 copying src/unitxt/catalog/cards/global_mmlu/cs/moral_scenarios.json -> build/lib/unitxt/catalog/cards/global_mmlu/cs 2026-05-27T11:53:36,049 copying src/unitxt/catalog/cards/global_mmlu/cs/world_religions.json -> build/lib/unitxt/catalog/cards/global_mmlu/cs 2026-05-27T11:53:36,052 copying src/unitxt/catalog/cards/global_mmlu/cs/business_ethics.json -> build/lib/unitxt/catalog/cards/global_mmlu/cs 2026-05-27T11:53:36,054 copying src/unitxt/catalog/cards/global_mmlu/cs/security_studies.json -> build/lib/unitxt/catalog/cards/global_mmlu/cs 2026-05-27T11:53:36,056 copying src/unitxt/catalog/cards/global_mmlu/cs/college_medicine.json -> build/lib/unitxt/catalog/cards/global_mmlu/cs 2026-05-27T11:53:36,058 copying src/unitxt/catalog/cards/global_mmlu/cs/human_sexuality.json -> build/lib/unitxt/catalog/cards/global_mmlu/cs 2026-05-27T11:53:36,061 copying src/unitxt/catalog/cards/global_mmlu/cs/prehistory.json -> build/lib/unitxt/catalog/cards/global_mmlu/cs 2026-05-27T11:53:36,063 creating build/lib/unitxt/catalog/cards/global_mmlu/tr 2026-05-27T11:53:36,064 copying src/unitxt/catalog/cards/global_mmlu/tr/moral_disputes.json -> build/lib/unitxt/catalog/cards/global_mmlu/tr 2026-05-27T11:53:36,067 copying src/unitxt/catalog/cards/global_mmlu/tr/high_school_biology.json -> build/lib/unitxt/catalog/cards/global_mmlu/tr 2026-05-27T11:53:36,069 copying src/unitxt/catalog/cards/global_mmlu/tr/jurisprudence.json -> build/lib/unitxt/catalog/cards/global_mmlu/tr 2026-05-27T11:53:36,071 copying src/unitxt/catalog/cards/global_mmlu/tr/logical_fallacies.json -> build/lib/unitxt/catalog/cards/global_mmlu/tr 2026-05-27T11:53:36,074 copying src/unitxt/catalog/cards/global_mmlu/tr/college_chemistry.json -> build/lib/unitxt/catalog/cards/global_mmlu/tr 2026-05-27T11:53:36,076 copying src/unitxt/catalog/cards/global_mmlu/tr/high_school_government_and_politics.json -> build/lib/unitxt/catalog/cards/global_mmlu/tr 2026-05-27T11:53:36,078 copying src/unitxt/catalog/cards/global_mmlu/tr/college_mathematics.json -> build/lib/unitxt/catalog/cards/global_mmlu/tr 2026-05-27T11:53:36,081 copying src/unitxt/catalog/cards/global_mmlu/tr/econometrics.json -> build/lib/unitxt/catalog/cards/global_mmlu/tr 2026-05-27T11:53:36,083 copying src/unitxt/catalog/cards/global_mmlu/tr/high_school_macroeconomics.json -> build/lib/unitxt/catalog/cards/global_mmlu/tr 2026-05-27T11:53:36,086 copying src/unitxt/catalog/cards/global_mmlu/tr/high_school_psychology.json -> build/lib/unitxt/catalog/cards/global_mmlu/tr 2026-05-27T11:53:36,088 copying src/unitxt/catalog/cards/global_mmlu/tr/computer_security.json -> build/lib/unitxt/catalog/cards/global_mmlu/tr 2026-05-27T11:53:36,091 copying src/unitxt/catalog/cards/global_mmlu/tr/sociology.json -> build/lib/unitxt/catalog/cards/global_mmlu/tr 2026-05-27T11:53:36,093 copying src/unitxt/catalog/cards/global_mmlu/tr/nutrition.json -> build/lib/unitxt/catalog/cards/global_mmlu/tr 2026-05-27T11:53:36,096 copying src/unitxt/catalog/cards/global_mmlu/tr/professional_medicine.json -> build/lib/unitxt/catalog/cards/global_mmlu/tr 2026-05-27T11:53:36,098 copying src/unitxt/catalog/cards/global_mmlu/tr/college_biology.json -> build/lib/unitxt/catalog/cards/global_mmlu/tr 2026-05-27T11:53:36,101 copying src/unitxt/catalog/cards/global_mmlu/tr/anatomy.json -> build/lib/unitxt/catalog/cards/global_mmlu/tr 2026-05-27T11:53:36,103 copying src/unitxt/catalog/cards/global_mmlu/tr/professional_law.json -> build/lib/unitxt/catalog/cards/global_mmlu/tr 2026-05-27T11:53:36,105 copying src/unitxt/catalog/cards/global_mmlu/tr/machine_learning.json -> build/lib/unitxt/catalog/cards/global_mmlu/tr 2026-05-27T11:53:36,108 copying src/unitxt/catalog/cards/global_mmlu/tr/international_law.json -> build/lib/unitxt/catalog/cards/global_mmlu/tr 2026-05-27T11:53:36,110 copying src/unitxt/catalog/cards/global_mmlu/tr/medical_genetics.json -> build/lib/unitxt/catalog/cards/global_mmlu/tr 2026-05-27T11:53:36,112 copying src/unitxt/catalog/cards/global_mmlu/tr/high_school_computer_science.json -> build/lib/unitxt/catalog/cards/global_mmlu/tr 2026-05-27T11:53:36,114 copying src/unitxt/catalog/cards/global_mmlu/tr/clinical_knowledge.json -> build/lib/unitxt/catalog/cards/global_mmlu/tr 2026-05-27T11:53:36,117 copying src/unitxt/catalog/cards/global_mmlu/tr/college_physics.json -> build/lib/unitxt/catalog/cards/global_mmlu/tr 2026-05-27T11:53:36,119 copying src/unitxt/catalog/cards/global_mmlu/tr/global_facts.json -> build/lib/unitxt/catalog/cards/global_mmlu/tr 2026-05-27T11:53:36,121 copying src/unitxt/catalog/cards/global_mmlu/tr/college_computer_science.json -> build/lib/unitxt/catalog/cards/global_mmlu/tr 2026-05-27T11:53:36,123 copying src/unitxt/catalog/cards/global_mmlu/tr/us_foreign_policy.json -> build/lib/unitxt/catalog/cards/global_mmlu/tr 2026-05-27T11:53:36,125 copying src/unitxt/catalog/cards/global_mmlu/tr/professional_accounting.json -> build/lib/unitxt/catalog/cards/global_mmlu/tr 2026-05-27T11:53:36,128 copying src/unitxt/catalog/cards/global_mmlu/tr/professional_psychology.json -> build/lib/unitxt/catalog/cards/global_mmlu/tr 2026-05-27T11:53:36,130 copying src/unitxt/catalog/cards/global_mmlu/tr/philosophy.json -> build/lib/unitxt/catalog/cards/global_mmlu/tr 2026-05-27T11:53:36,132 copying src/unitxt/catalog/cards/global_mmlu/tr/elementary_mathematics.json -> build/lib/unitxt/catalog/cards/global_mmlu/tr 2026-05-27T11:53:36,135 copying src/unitxt/catalog/cards/global_mmlu/tr/conceptual_physics.json -> build/lib/unitxt/catalog/cards/global_mmlu/tr 2026-05-27T11:53:36,137 copying src/unitxt/catalog/cards/global_mmlu/tr/high_school_geography.json -> build/lib/unitxt/catalog/cards/global_mmlu/tr 2026-05-27T11:53:36,139 copying src/unitxt/catalog/cards/global_mmlu/tr/human_aging.json -> build/lib/unitxt/catalog/cards/global_mmlu/tr 2026-05-27T11:53:36,142 copying src/unitxt/catalog/cards/global_mmlu/tr/electrical_engineering.json -> build/lib/unitxt/catalog/cards/global_mmlu/tr 2026-05-27T11:53:36,144 copying src/unitxt/catalog/cards/global_mmlu/tr/management.json -> build/lib/unitxt/catalog/cards/global_mmlu/tr 2026-05-27T11:53:36,146 copying src/unitxt/catalog/cards/global_mmlu/tr/high_school_world_history.json -> build/lib/unitxt/catalog/cards/global_mmlu/tr 2026-05-27T11:53:36,149 copying src/unitxt/catalog/cards/global_mmlu/tr/marketing.json -> build/lib/unitxt/catalog/cards/global_mmlu/tr 2026-05-27T11:53:36,151 copying src/unitxt/catalog/cards/global_mmlu/tr/high_school_european_history.json -> build/lib/unitxt/catalog/cards/global_mmlu/tr 2026-05-27T11:53:36,153 copying src/unitxt/catalog/cards/global_mmlu/tr/astronomy.json -> build/lib/unitxt/catalog/cards/global_mmlu/tr 2026-05-27T11:53:36,156 copying src/unitxt/catalog/cards/global_mmlu/tr/high_school_physics.json -> build/lib/unitxt/catalog/cards/global_mmlu/tr 2026-05-27T11:53:36,158 copying src/unitxt/catalog/cards/global_mmlu/tr/public_relations.json -> build/lib/unitxt/catalog/cards/global_mmlu/tr 2026-05-27T11:53:36,160 copying src/unitxt/catalog/cards/global_mmlu/tr/high_school_microeconomics.json -> build/lib/unitxt/catalog/cards/global_mmlu/tr 2026-05-27T11:53:36,163 copying src/unitxt/catalog/cards/global_mmlu/tr/virology.json -> build/lib/unitxt/catalog/cards/global_mmlu/tr 2026-05-27T11:53:36,165 copying src/unitxt/catalog/cards/global_mmlu/tr/high_school_us_history.json -> build/lib/unitxt/catalog/cards/global_mmlu/tr 2026-05-27T11:53:36,167 copying src/unitxt/catalog/cards/global_mmlu/tr/high_school_statistics.json -> build/lib/unitxt/catalog/cards/global_mmlu/tr 2026-05-27T11:53:36,170 copying src/unitxt/catalog/cards/global_mmlu/tr/miscellaneous.json -> build/lib/unitxt/catalog/cards/global_mmlu/tr 2026-05-27T11:53:36,172 copying src/unitxt/catalog/cards/global_mmlu/tr/high_school_mathematics.json -> build/lib/unitxt/catalog/cards/global_mmlu/tr 2026-05-27T11:53:36,174 copying src/unitxt/catalog/cards/global_mmlu/tr/formal_logic.json -> build/lib/unitxt/catalog/cards/global_mmlu/tr 2026-05-27T11:53:36,177 copying src/unitxt/catalog/cards/global_mmlu/tr/high_school_chemistry.json -> build/lib/unitxt/catalog/cards/global_mmlu/tr 2026-05-27T11:53:36,179 copying src/unitxt/catalog/cards/global_mmlu/tr/abstract_algebra.json -> build/lib/unitxt/catalog/cards/global_mmlu/tr 2026-05-27T11:53:36,181 copying src/unitxt/catalog/cards/global_mmlu/tr/moral_scenarios.json -> build/lib/unitxt/catalog/cards/global_mmlu/tr 2026-05-27T11:53:36,183 copying src/unitxt/catalog/cards/global_mmlu/tr/world_religions.json -> build/lib/unitxt/catalog/cards/global_mmlu/tr 2026-05-27T11:53:36,185 copying src/unitxt/catalog/cards/global_mmlu/tr/business_ethics.json -> build/lib/unitxt/catalog/cards/global_mmlu/tr 2026-05-27T11:53:36,187 copying src/unitxt/catalog/cards/global_mmlu/tr/security_studies.json -> build/lib/unitxt/catalog/cards/global_mmlu/tr 2026-05-27T11:53:36,190 copying src/unitxt/catalog/cards/global_mmlu/tr/college_medicine.json -> build/lib/unitxt/catalog/cards/global_mmlu/tr 2026-05-27T11:53:36,192 copying src/unitxt/catalog/cards/global_mmlu/tr/human_sexuality.json -> build/lib/unitxt/catalog/cards/global_mmlu/tr 2026-05-27T11:53:36,194 copying src/unitxt/catalog/cards/global_mmlu/tr/prehistory.json -> build/lib/unitxt/catalog/cards/global_mmlu/tr 2026-05-27T11:53:36,196 creating build/lib/unitxt/catalog/cards/global_mmlu/so 2026-05-27T11:53:36,197 copying src/unitxt/catalog/cards/global_mmlu/so/moral_disputes.json -> build/lib/unitxt/catalog/cards/global_mmlu/so 2026-05-27T11:53:36,200 copying src/unitxt/catalog/cards/global_mmlu/so/high_school_biology.json -> build/lib/unitxt/catalog/cards/global_mmlu/so 2026-05-27T11:53:36,202 copying src/unitxt/catalog/cards/global_mmlu/so/jurisprudence.json -> build/lib/unitxt/catalog/cards/global_mmlu/so 2026-05-27T11:53:36,204 copying src/unitxt/catalog/cards/global_mmlu/so/logical_fallacies.json -> build/lib/unitxt/catalog/cards/global_mmlu/so 2026-05-27T11:53:36,207 copying src/unitxt/catalog/cards/global_mmlu/so/college_chemistry.json -> build/lib/unitxt/catalog/cards/global_mmlu/so 2026-05-27T11:53:36,209 copying src/unitxt/catalog/cards/global_mmlu/so/high_school_government_and_politics.json -> build/lib/unitxt/catalog/cards/global_mmlu/so 2026-05-27T11:53:36,211 copying src/unitxt/catalog/cards/global_mmlu/so/college_mathematics.json -> build/lib/unitxt/catalog/cards/global_mmlu/so 2026-05-27T11:53:36,213 copying src/unitxt/catalog/cards/global_mmlu/so/econometrics.json -> build/lib/unitxt/catalog/cards/global_mmlu/so 2026-05-27T11:53:36,216 copying src/unitxt/catalog/cards/global_mmlu/so/high_school_macroeconomics.json -> build/lib/unitxt/catalog/cards/global_mmlu/so 2026-05-27T11:53:36,218 copying src/unitxt/catalog/cards/global_mmlu/so/high_school_psychology.json -> build/lib/unitxt/catalog/cards/global_mmlu/so 2026-05-27T11:53:36,221 copying src/unitxt/catalog/cards/global_mmlu/so/computer_security.json -> build/lib/unitxt/catalog/cards/global_mmlu/so 2026-05-27T11:53:36,223 copying src/unitxt/catalog/cards/global_mmlu/so/sociology.json -> build/lib/unitxt/catalog/cards/global_mmlu/so 2026-05-27T11:53:36,225 copying src/unitxt/catalog/cards/global_mmlu/so/nutrition.json -> build/lib/unitxt/catalog/cards/global_mmlu/so 2026-05-27T11:53:36,227 copying src/unitxt/catalog/cards/global_mmlu/so/professional_medicine.json -> build/lib/unitxt/catalog/cards/global_mmlu/so 2026-05-27T11:53:36,230 copying src/unitxt/catalog/cards/global_mmlu/so/college_biology.json -> build/lib/unitxt/catalog/cards/global_mmlu/so 2026-05-27T11:53:36,232 copying src/unitxt/catalog/cards/global_mmlu/so/anatomy.json -> build/lib/unitxt/catalog/cards/global_mmlu/so 2026-05-27T11:53:36,234 copying src/unitxt/catalog/cards/global_mmlu/so/professional_law.json -> build/lib/unitxt/catalog/cards/global_mmlu/so 2026-05-27T11:53:36,236 copying src/unitxt/catalog/cards/global_mmlu/so/machine_learning.json -> build/lib/unitxt/catalog/cards/global_mmlu/so 2026-05-27T11:53:36,238 copying src/unitxt/catalog/cards/global_mmlu/so/international_law.json -> build/lib/unitxt/catalog/cards/global_mmlu/so 2026-05-27T11:53:36,241 copying src/unitxt/catalog/cards/global_mmlu/so/medical_genetics.json -> build/lib/unitxt/catalog/cards/global_mmlu/so 2026-05-27T11:53:36,243 copying src/unitxt/catalog/cards/global_mmlu/so/high_school_computer_science.json -> build/lib/unitxt/catalog/cards/global_mmlu/so 2026-05-27T11:53:36,245 copying src/unitxt/catalog/cards/global_mmlu/so/clinical_knowledge.json -> build/lib/unitxt/catalog/cards/global_mmlu/so 2026-05-27T11:53:36,247 copying src/unitxt/catalog/cards/global_mmlu/so/college_physics.json -> build/lib/unitxt/catalog/cards/global_mmlu/so 2026-05-27T11:53:36,250 copying src/unitxt/catalog/cards/global_mmlu/so/global_facts.json -> build/lib/unitxt/catalog/cards/global_mmlu/so 2026-05-27T11:53:36,253 copying src/unitxt/catalog/cards/global_mmlu/so/college_computer_science.json -> build/lib/unitxt/catalog/cards/global_mmlu/so 2026-05-27T11:53:36,255 copying src/unitxt/catalog/cards/global_mmlu/so/us_foreign_policy.json -> build/lib/unitxt/catalog/cards/global_mmlu/so 2026-05-27T11:53:36,257 copying src/unitxt/catalog/cards/global_mmlu/so/professional_accounting.json -> build/lib/unitxt/catalog/cards/global_mmlu/so 2026-05-27T11:53:36,259 copying src/unitxt/catalog/cards/global_mmlu/so/professional_psychology.json -> build/lib/unitxt/catalog/cards/global_mmlu/so 2026-05-27T11:53:36,262 copying src/unitxt/catalog/cards/global_mmlu/so/philosophy.json -> build/lib/unitxt/catalog/cards/global_mmlu/so 2026-05-27T11:53:36,264 copying src/unitxt/catalog/cards/global_mmlu/so/elementary_mathematics.json -> build/lib/unitxt/catalog/cards/global_mmlu/so 2026-05-27T11:53:36,267 copying src/unitxt/catalog/cards/global_mmlu/so/conceptual_physics.json -> build/lib/unitxt/catalog/cards/global_mmlu/so 2026-05-27T11:53:36,269 copying src/unitxt/catalog/cards/global_mmlu/so/high_school_geography.json -> build/lib/unitxt/catalog/cards/global_mmlu/so 2026-05-27T11:53:36,271 copying src/unitxt/catalog/cards/global_mmlu/so/human_aging.json -> build/lib/unitxt/catalog/cards/global_mmlu/so 2026-05-27T11:53:36,273 copying src/unitxt/catalog/cards/global_mmlu/so/electrical_engineering.json -> build/lib/unitxt/catalog/cards/global_mmlu/so 2026-05-27T11:53:36,276 copying src/unitxt/catalog/cards/global_mmlu/so/management.json -> build/lib/unitxt/catalog/cards/global_mmlu/so 2026-05-27T11:53:36,278 copying src/unitxt/catalog/cards/global_mmlu/so/high_school_world_history.json -> build/lib/unitxt/catalog/cards/global_mmlu/so 2026-05-27T11:53:36,280 copying src/unitxt/catalog/cards/global_mmlu/so/marketing.json -> build/lib/unitxt/catalog/cards/global_mmlu/so 2026-05-27T11:53:36,283 copying src/unitxt/catalog/cards/global_mmlu/so/high_school_european_history.json -> build/lib/unitxt/catalog/cards/global_mmlu/so 2026-05-27T11:53:36,285 copying src/unitxt/catalog/cards/global_mmlu/so/astronomy.json -> build/lib/unitxt/catalog/cards/global_mmlu/so 2026-05-27T11:53:36,287 copying src/unitxt/catalog/cards/global_mmlu/so/high_school_physics.json -> build/lib/unitxt/catalog/cards/global_mmlu/so 2026-05-27T11:53:36,290 copying src/unitxt/catalog/cards/global_mmlu/so/public_relations.json -> build/lib/unitxt/catalog/cards/global_mmlu/so 2026-05-27T11:53:36,292 copying src/unitxt/catalog/cards/global_mmlu/so/high_school_microeconomics.json -> build/lib/unitxt/catalog/cards/global_mmlu/so 2026-05-27T11:53:36,294 copying src/unitxt/catalog/cards/global_mmlu/so/virology.json -> build/lib/unitxt/catalog/cards/global_mmlu/so 2026-05-27T11:53:36,296 copying src/unitxt/catalog/cards/global_mmlu/so/high_school_us_history.json -> build/lib/unitxt/catalog/cards/global_mmlu/so 2026-05-27T11:53:36,299 copying src/unitxt/catalog/cards/global_mmlu/so/high_school_statistics.json -> build/lib/unitxt/catalog/cards/global_mmlu/so 2026-05-27T11:53:36,301 copying src/unitxt/catalog/cards/global_mmlu/so/miscellaneous.json -> build/lib/unitxt/catalog/cards/global_mmlu/so 2026-05-27T11:53:36,303 copying src/unitxt/catalog/cards/global_mmlu/so/high_school_mathematics.json -> build/lib/unitxt/catalog/cards/global_mmlu/so 2026-05-27T11:53:36,305 copying src/unitxt/catalog/cards/global_mmlu/so/formal_logic.json -> build/lib/unitxt/catalog/cards/global_mmlu/so 2026-05-27T11:53:36,308 copying src/unitxt/catalog/cards/global_mmlu/so/high_school_chemistry.json -> build/lib/unitxt/catalog/cards/global_mmlu/so 2026-05-27T11:53:36,310 copying src/unitxt/catalog/cards/global_mmlu/so/abstract_algebra.json -> build/lib/unitxt/catalog/cards/global_mmlu/so 2026-05-27T11:53:36,312 copying src/unitxt/catalog/cards/global_mmlu/so/moral_scenarios.json -> build/lib/unitxt/catalog/cards/global_mmlu/so 2026-05-27T11:53:36,314 copying src/unitxt/catalog/cards/global_mmlu/so/world_religions.json -> build/lib/unitxt/catalog/cards/global_mmlu/so 2026-05-27T11:53:36,317 copying src/unitxt/catalog/cards/global_mmlu/so/business_ethics.json -> build/lib/unitxt/catalog/cards/global_mmlu/so 2026-05-27T11:53:36,319 copying src/unitxt/catalog/cards/global_mmlu/so/security_studies.json -> build/lib/unitxt/catalog/cards/global_mmlu/so 2026-05-27T11:53:36,321 copying src/unitxt/catalog/cards/global_mmlu/so/college_medicine.json -> build/lib/unitxt/catalog/cards/global_mmlu/so 2026-05-27T11:53:36,324 copying src/unitxt/catalog/cards/global_mmlu/so/human_sexuality.json -> build/lib/unitxt/catalog/cards/global_mmlu/so 2026-05-27T11:53:36,326 copying src/unitxt/catalog/cards/global_mmlu/so/prehistory.json -> build/lib/unitxt/catalog/cards/global_mmlu/so 2026-05-27T11:53:36,328 creating build/lib/unitxt/catalog/cards/global_mmlu/ko 2026-05-27T11:53:36,329 copying src/unitxt/catalog/cards/global_mmlu/ko/moral_disputes.json -> build/lib/unitxt/catalog/cards/global_mmlu/ko 2026-05-27T11:53:36,332 copying src/unitxt/catalog/cards/global_mmlu/ko/high_school_biology.json -> build/lib/unitxt/catalog/cards/global_mmlu/ko 2026-05-27T11:53:36,334 copying src/unitxt/catalog/cards/global_mmlu/ko/jurisprudence.json -> build/lib/unitxt/catalog/cards/global_mmlu/ko 2026-05-27T11:53:36,336 copying src/unitxt/catalog/cards/global_mmlu/ko/logical_fallacies.json -> build/lib/unitxt/catalog/cards/global_mmlu/ko 2026-05-27T11:53:36,339 copying src/unitxt/catalog/cards/global_mmlu/ko/college_chemistry.json -> build/lib/unitxt/catalog/cards/global_mmlu/ko 2026-05-27T11:53:36,341 copying src/unitxt/catalog/cards/global_mmlu/ko/high_school_government_and_politics.json -> build/lib/unitxt/catalog/cards/global_mmlu/ko 2026-05-27T11:53:36,344 copying src/unitxt/catalog/cards/global_mmlu/ko/college_mathematics.json -> build/lib/unitxt/catalog/cards/global_mmlu/ko 2026-05-27T11:53:36,346 copying src/unitxt/catalog/cards/global_mmlu/ko/econometrics.json -> build/lib/unitxt/catalog/cards/global_mmlu/ko 2026-05-27T11:53:36,348 copying src/unitxt/catalog/cards/global_mmlu/ko/high_school_macroeconomics.json -> build/lib/unitxt/catalog/cards/global_mmlu/ko 2026-05-27T11:53:36,351 copying src/unitxt/catalog/cards/global_mmlu/ko/high_school_psychology.json -> build/lib/unitxt/catalog/cards/global_mmlu/ko 2026-05-27T11:53:36,353 copying src/unitxt/catalog/cards/global_mmlu/ko/computer_security.json -> build/lib/unitxt/catalog/cards/global_mmlu/ko 2026-05-27T11:53:36,355 copying src/unitxt/catalog/cards/global_mmlu/ko/sociology.json -> build/lib/unitxt/catalog/cards/global_mmlu/ko 2026-05-27T11:53:36,358 copying src/unitxt/catalog/cards/global_mmlu/ko/nutrition.json -> build/lib/unitxt/catalog/cards/global_mmlu/ko 2026-05-27T11:53:36,360 copying src/unitxt/catalog/cards/global_mmlu/ko/professional_medicine.json -> build/lib/unitxt/catalog/cards/global_mmlu/ko 2026-05-27T11:53:36,362 copying src/unitxt/catalog/cards/global_mmlu/ko/college_biology.json -> build/lib/unitxt/catalog/cards/global_mmlu/ko 2026-05-27T11:53:36,365 copying src/unitxt/catalog/cards/global_mmlu/ko/anatomy.json -> build/lib/unitxt/catalog/cards/global_mmlu/ko 2026-05-27T11:53:36,367 copying src/unitxt/catalog/cards/global_mmlu/ko/professional_law.json -> build/lib/unitxt/catalog/cards/global_mmlu/ko 2026-05-27T11:53:36,369 copying src/unitxt/catalog/cards/global_mmlu/ko/machine_learning.json -> build/lib/unitxt/catalog/cards/global_mmlu/ko 2026-05-27T11:53:36,371 copying src/unitxt/catalog/cards/global_mmlu/ko/international_law.json -> build/lib/unitxt/catalog/cards/global_mmlu/ko 2026-05-27T11:53:36,374 copying src/unitxt/catalog/cards/global_mmlu/ko/medical_genetics.json -> build/lib/unitxt/catalog/cards/global_mmlu/ko 2026-05-27T11:53:36,376 copying src/unitxt/catalog/cards/global_mmlu/ko/high_school_computer_science.json -> build/lib/unitxt/catalog/cards/global_mmlu/ko 2026-05-27T11:53:36,378 copying src/unitxt/catalog/cards/global_mmlu/ko/clinical_knowledge.json -> build/lib/unitxt/catalog/cards/global_mmlu/ko 2026-05-27T11:53:36,380 copying src/unitxt/catalog/cards/global_mmlu/ko/college_physics.json -> build/lib/unitxt/catalog/cards/global_mmlu/ko 2026-05-27T11:53:36,383 copying src/unitxt/catalog/cards/global_mmlu/ko/global_facts.json -> build/lib/unitxt/catalog/cards/global_mmlu/ko 2026-05-27T11:53:36,385 copying src/unitxt/catalog/cards/global_mmlu/ko/college_computer_science.json -> build/lib/unitxt/catalog/cards/global_mmlu/ko 2026-05-27T11:53:36,387 copying src/unitxt/catalog/cards/global_mmlu/ko/us_foreign_policy.json -> build/lib/unitxt/catalog/cards/global_mmlu/ko 2026-05-27T11:53:36,390 copying src/unitxt/catalog/cards/global_mmlu/ko/professional_accounting.json -> build/lib/unitxt/catalog/cards/global_mmlu/ko 2026-05-27T11:53:36,392 copying src/unitxt/catalog/cards/global_mmlu/ko/professional_psychology.json -> build/lib/unitxt/catalog/cards/global_mmlu/ko 2026-05-27T11:53:36,394 copying src/unitxt/catalog/cards/global_mmlu/ko/philosophy.json -> build/lib/unitxt/catalog/cards/global_mmlu/ko 2026-05-27T11:53:36,397 copying src/unitxt/catalog/cards/global_mmlu/ko/elementary_mathematics.json -> build/lib/unitxt/catalog/cards/global_mmlu/ko 2026-05-27T11:53:36,399 copying src/unitxt/catalog/cards/global_mmlu/ko/conceptual_physics.json -> build/lib/unitxt/catalog/cards/global_mmlu/ko 2026-05-27T11:53:36,401 copying src/unitxt/catalog/cards/global_mmlu/ko/high_school_geography.json -> build/lib/unitxt/catalog/cards/global_mmlu/ko 2026-05-27T11:53:36,404 copying src/unitxt/catalog/cards/global_mmlu/ko/human_aging.json -> build/lib/unitxt/catalog/cards/global_mmlu/ko 2026-05-27T11:53:36,406 copying src/unitxt/catalog/cards/global_mmlu/ko/electrical_engineering.json -> build/lib/unitxt/catalog/cards/global_mmlu/ko 2026-05-27T11:53:36,408 copying src/unitxt/catalog/cards/global_mmlu/ko/management.json -> build/lib/unitxt/catalog/cards/global_mmlu/ko 2026-05-27T11:53:36,411 copying src/unitxt/catalog/cards/global_mmlu/ko/high_school_world_history.json -> build/lib/unitxt/catalog/cards/global_mmlu/ko 2026-05-27T11:53:36,413 copying src/unitxt/catalog/cards/global_mmlu/ko/marketing.json -> build/lib/unitxt/catalog/cards/global_mmlu/ko 2026-05-27T11:53:36,416 copying src/unitxt/catalog/cards/global_mmlu/ko/high_school_european_history.json -> build/lib/unitxt/catalog/cards/global_mmlu/ko 2026-05-27T11:53:36,418 copying src/unitxt/catalog/cards/global_mmlu/ko/astronomy.json -> build/lib/unitxt/catalog/cards/global_mmlu/ko 2026-05-27T11:53:36,420 copying src/unitxt/catalog/cards/global_mmlu/ko/high_school_physics.json -> build/lib/unitxt/catalog/cards/global_mmlu/ko 2026-05-27T11:53:36,423 copying src/unitxt/catalog/cards/global_mmlu/ko/public_relations.json -> build/lib/unitxt/catalog/cards/global_mmlu/ko 2026-05-27T11:53:36,425 copying src/unitxt/catalog/cards/global_mmlu/ko/high_school_microeconomics.json -> build/lib/unitxt/catalog/cards/global_mmlu/ko 2026-05-27T11:53:36,428 copying src/unitxt/catalog/cards/global_mmlu/ko/virology.json -> build/lib/unitxt/catalog/cards/global_mmlu/ko 2026-05-27T11:53:36,430 copying src/unitxt/catalog/cards/global_mmlu/ko/high_school_us_history.json -> build/lib/unitxt/catalog/cards/global_mmlu/ko 2026-05-27T11:53:36,432 copying src/unitxt/catalog/cards/global_mmlu/ko/high_school_statistics.json -> build/lib/unitxt/catalog/cards/global_mmlu/ko 2026-05-27T11:53:36,434 copying src/unitxt/catalog/cards/global_mmlu/ko/miscellaneous.json -> build/lib/unitxt/catalog/cards/global_mmlu/ko 2026-05-27T11:53:36,436 copying src/unitxt/catalog/cards/global_mmlu/ko/high_school_mathematics.json -> build/lib/unitxt/catalog/cards/global_mmlu/ko 2026-05-27T11:53:36,439 copying src/unitxt/catalog/cards/global_mmlu/ko/formal_logic.json -> build/lib/unitxt/catalog/cards/global_mmlu/ko 2026-05-27T11:53:36,441 copying src/unitxt/catalog/cards/global_mmlu/ko/high_school_chemistry.json -> build/lib/unitxt/catalog/cards/global_mmlu/ko 2026-05-27T11:53:36,443 copying src/unitxt/catalog/cards/global_mmlu/ko/abstract_algebra.json -> build/lib/unitxt/catalog/cards/global_mmlu/ko 2026-05-27T11:53:36,445 copying src/unitxt/catalog/cards/global_mmlu/ko/moral_scenarios.json -> build/lib/unitxt/catalog/cards/global_mmlu/ko 2026-05-27T11:53:36,448 copying src/unitxt/catalog/cards/global_mmlu/ko/world_religions.json -> build/lib/unitxt/catalog/cards/global_mmlu/ko 2026-05-27T11:53:36,450 copying src/unitxt/catalog/cards/global_mmlu/ko/business_ethics.json -> build/lib/unitxt/catalog/cards/global_mmlu/ko 2026-05-27T11:53:36,452 copying src/unitxt/catalog/cards/global_mmlu/ko/security_studies.json -> build/lib/unitxt/catalog/cards/global_mmlu/ko 2026-05-27T11:53:36,455 copying src/unitxt/catalog/cards/global_mmlu/ko/college_medicine.json -> build/lib/unitxt/catalog/cards/global_mmlu/ko 2026-05-27T11:53:36,457 copying src/unitxt/catalog/cards/global_mmlu/ko/human_sexuality.json -> build/lib/unitxt/catalog/cards/global_mmlu/ko 2026-05-27T11:53:36,459 copying src/unitxt/catalog/cards/global_mmlu/ko/prehistory.json -> build/lib/unitxt/catalog/cards/global_mmlu/ko 2026-05-27T11:53:36,462 creating build/lib/unitxt/catalog/cards/global_mmlu/en 2026-05-27T11:53:36,463 copying src/unitxt/catalog/cards/global_mmlu/en/moral_disputes.json -> build/lib/unitxt/catalog/cards/global_mmlu/en 2026-05-27T11:53:36,465 copying src/unitxt/catalog/cards/global_mmlu/en/high_school_biology.json -> build/lib/unitxt/catalog/cards/global_mmlu/en 2026-05-27T11:53:36,467 copying src/unitxt/catalog/cards/global_mmlu/en/jurisprudence.json -> build/lib/unitxt/catalog/cards/global_mmlu/en 2026-05-27T11:53:36,470 copying src/unitxt/catalog/cards/global_mmlu/en/logical_fallacies.json -> build/lib/unitxt/catalog/cards/global_mmlu/en 2026-05-27T11:53:36,472 copying src/unitxt/catalog/cards/global_mmlu/en/college_chemistry.json -> build/lib/unitxt/catalog/cards/global_mmlu/en 2026-05-27T11:53:36,475 copying src/unitxt/catalog/cards/global_mmlu/en/high_school_government_and_politics.json -> build/lib/unitxt/catalog/cards/global_mmlu/en 2026-05-27T11:53:36,477 copying src/unitxt/catalog/cards/global_mmlu/en/college_mathematics.json -> build/lib/unitxt/catalog/cards/global_mmlu/en 2026-05-27T11:53:36,479 copying src/unitxt/catalog/cards/global_mmlu/en/econometrics.json -> build/lib/unitxt/catalog/cards/global_mmlu/en 2026-05-27T11:53:36,482 copying src/unitxt/catalog/cards/global_mmlu/en/high_school_macroeconomics.json -> build/lib/unitxt/catalog/cards/global_mmlu/en 2026-05-27T11:53:36,484 copying src/unitxt/catalog/cards/global_mmlu/en/high_school_psychology.json -> build/lib/unitxt/catalog/cards/global_mmlu/en 2026-05-27T11:53:36,487 copying src/unitxt/catalog/cards/global_mmlu/en/computer_security.json -> build/lib/unitxt/catalog/cards/global_mmlu/en 2026-05-27T11:53:36,489 copying src/unitxt/catalog/cards/global_mmlu/en/sociology.json -> build/lib/unitxt/catalog/cards/global_mmlu/en 2026-05-27T11:53:36,491 copying src/unitxt/catalog/cards/global_mmlu/en/nutrition.json -> build/lib/unitxt/catalog/cards/global_mmlu/en 2026-05-27T11:53:36,494 copying src/unitxt/catalog/cards/global_mmlu/en/professional_medicine.json -> build/lib/unitxt/catalog/cards/global_mmlu/en 2026-05-27T11:53:36,496 copying src/unitxt/catalog/cards/global_mmlu/en/college_biology.json -> build/lib/unitxt/catalog/cards/global_mmlu/en 2026-05-27T11:53:36,498 copying src/unitxt/catalog/cards/global_mmlu/en/anatomy.json -> build/lib/unitxt/catalog/cards/global_mmlu/en 2026-05-27T11:53:36,500 copying src/unitxt/catalog/cards/global_mmlu/en/professional_law.json -> build/lib/unitxt/catalog/cards/global_mmlu/en 2026-05-27T11:53:36,502 copying src/unitxt/catalog/cards/global_mmlu/en/machine_learning.json -> build/lib/unitxt/catalog/cards/global_mmlu/en 2026-05-27T11:53:36,505 copying src/unitxt/catalog/cards/global_mmlu/en/international_law.json -> build/lib/unitxt/catalog/cards/global_mmlu/en 2026-05-27T11:53:36,507 copying src/unitxt/catalog/cards/global_mmlu/en/medical_genetics.json -> build/lib/unitxt/catalog/cards/global_mmlu/en 2026-05-27T11:53:36,509 copying src/unitxt/catalog/cards/global_mmlu/en/high_school_computer_science.json -> build/lib/unitxt/catalog/cards/global_mmlu/en 2026-05-27T11:53:36,512 copying src/unitxt/catalog/cards/global_mmlu/en/clinical_knowledge.json -> build/lib/unitxt/catalog/cards/global_mmlu/en 2026-05-27T11:53:36,514 copying src/unitxt/catalog/cards/global_mmlu/en/college_physics.json -> build/lib/unitxt/catalog/cards/global_mmlu/en 2026-05-27T11:53:36,516 copying src/unitxt/catalog/cards/global_mmlu/en/global_facts.json -> build/lib/unitxt/catalog/cards/global_mmlu/en 2026-05-27T11:53:36,519 copying src/unitxt/catalog/cards/global_mmlu/en/college_computer_science.json -> build/lib/unitxt/catalog/cards/global_mmlu/en 2026-05-27T11:53:36,521 copying src/unitxt/catalog/cards/global_mmlu/en/us_foreign_policy.json -> build/lib/unitxt/catalog/cards/global_mmlu/en 2026-05-27T11:53:36,523 copying src/unitxt/catalog/cards/global_mmlu/en/professional_accounting.json -> build/lib/unitxt/catalog/cards/global_mmlu/en 2026-05-27T11:53:36,526 copying src/unitxt/catalog/cards/global_mmlu/en/professional_psychology.json -> build/lib/unitxt/catalog/cards/global_mmlu/en 2026-05-27T11:53:36,528 copying src/unitxt/catalog/cards/global_mmlu/en/philosophy.json -> build/lib/unitxt/catalog/cards/global_mmlu/en 2026-05-27T11:53:36,531 copying src/unitxt/catalog/cards/global_mmlu/en/elementary_mathematics.json -> build/lib/unitxt/catalog/cards/global_mmlu/en 2026-05-27T11:53:36,533 copying src/unitxt/catalog/cards/global_mmlu/en/conceptual_physics.json -> build/lib/unitxt/catalog/cards/global_mmlu/en 2026-05-27T11:53:36,535 copying src/unitxt/catalog/cards/global_mmlu/en/high_school_geography.json -> build/lib/unitxt/catalog/cards/global_mmlu/en 2026-05-27T11:53:36,538 copying src/unitxt/catalog/cards/global_mmlu/en/human_aging.json -> build/lib/unitxt/catalog/cards/global_mmlu/en 2026-05-27T11:53:36,540 copying src/unitxt/catalog/cards/global_mmlu/en/electrical_engineering.json -> build/lib/unitxt/catalog/cards/global_mmlu/en 2026-05-27T11:53:36,543 copying src/unitxt/catalog/cards/global_mmlu/en/management.json -> build/lib/unitxt/catalog/cards/global_mmlu/en 2026-05-27T11:53:36,545 copying src/unitxt/catalog/cards/global_mmlu/en/high_school_world_history.json -> build/lib/unitxt/catalog/cards/global_mmlu/en 2026-05-27T11:53:36,548 copying src/unitxt/catalog/cards/global_mmlu/en/marketing.json -> build/lib/unitxt/catalog/cards/global_mmlu/en 2026-05-27T11:53:36,550 copying src/unitxt/catalog/cards/global_mmlu/en/high_school_european_history.json -> build/lib/unitxt/catalog/cards/global_mmlu/en 2026-05-27T11:53:36,552 copying src/unitxt/catalog/cards/global_mmlu/en/astronomy.json -> build/lib/unitxt/catalog/cards/global_mmlu/en 2026-05-27T11:53:36,555 copying src/unitxt/catalog/cards/global_mmlu/en/high_school_physics.json -> build/lib/unitxt/catalog/cards/global_mmlu/en 2026-05-27T11:53:36,557 copying src/unitxt/catalog/cards/global_mmlu/en/public_relations.json -> build/lib/unitxt/catalog/cards/global_mmlu/en 2026-05-27T11:53:36,559 copying src/unitxt/catalog/cards/global_mmlu/en/high_school_microeconomics.json -> build/lib/unitxt/catalog/cards/global_mmlu/en 2026-05-27T11:53:36,561 copying src/unitxt/catalog/cards/global_mmlu/en/virology.json -> build/lib/unitxt/catalog/cards/global_mmlu/en 2026-05-27T11:53:36,563 copying src/unitxt/catalog/cards/global_mmlu/en/high_school_us_history.json -> build/lib/unitxt/catalog/cards/global_mmlu/en 2026-05-27T11:53:36,566 copying src/unitxt/catalog/cards/global_mmlu/en/high_school_statistics.json -> build/lib/unitxt/catalog/cards/global_mmlu/en 2026-05-27T11:53:36,568 copying src/unitxt/catalog/cards/global_mmlu/en/miscellaneous.json -> build/lib/unitxt/catalog/cards/global_mmlu/en 2026-05-27T11:53:36,570 copying src/unitxt/catalog/cards/global_mmlu/en/high_school_mathematics.json -> build/lib/unitxt/catalog/cards/global_mmlu/en 2026-05-27T11:53:36,572 copying src/unitxt/catalog/cards/global_mmlu/en/formal_logic.json -> build/lib/unitxt/catalog/cards/global_mmlu/en 2026-05-27T11:53:36,575 copying src/unitxt/catalog/cards/global_mmlu/en/high_school_chemistry.json -> build/lib/unitxt/catalog/cards/global_mmlu/en 2026-05-27T11:53:36,577 copying src/unitxt/catalog/cards/global_mmlu/en/abstract_algebra.json -> build/lib/unitxt/catalog/cards/global_mmlu/en 2026-05-27T11:53:36,579 copying src/unitxt/catalog/cards/global_mmlu/en/moral_scenarios.json -> build/lib/unitxt/catalog/cards/global_mmlu/en 2026-05-27T11:53:36,581 copying src/unitxt/catalog/cards/global_mmlu/en/world_religions.json -> build/lib/unitxt/catalog/cards/global_mmlu/en 2026-05-27T11:53:36,584 copying src/unitxt/catalog/cards/global_mmlu/en/business_ethics.json -> build/lib/unitxt/catalog/cards/global_mmlu/en 2026-05-27T11:53:36,586 copying src/unitxt/catalog/cards/global_mmlu/en/security_studies.json -> build/lib/unitxt/catalog/cards/global_mmlu/en 2026-05-27T11:53:36,588 copying src/unitxt/catalog/cards/global_mmlu/en/college_medicine.json -> build/lib/unitxt/catalog/cards/global_mmlu/en 2026-05-27T11:53:36,591 copying src/unitxt/catalog/cards/global_mmlu/en/human_sexuality.json -> build/lib/unitxt/catalog/cards/global_mmlu/en 2026-05-27T11:53:36,593 copying src/unitxt/catalog/cards/global_mmlu/en/prehistory.json -> build/lib/unitxt/catalog/cards/global_mmlu/en 2026-05-27T11:53:36,595 creating build/lib/unitxt/catalog/cards/global_mmlu/it 2026-05-27T11:53:36,596 copying src/unitxt/catalog/cards/global_mmlu/it/moral_disputes.json -> build/lib/unitxt/catalog/cards/global_mmlu/it 2026-05-27T11:53:36,599 copying src/unitxt/catalog/cards/global_mmlu/it/high_school_biology.json -> build/lib/unitxt/catalog/cards/global_mmlu/it 2026-05-27T11:53:36,601 copying src/unitxt/catalog/cards/global_mmlu/it/jurisprudence.json -> build/lib/unitxt/catalog/cards/global_mmlu/it 2026-05-27T11:53:36,603 copying src/unitxt/catalog/cards/global_mmlu/it/logical_fallacies.json -> build/lib/unitxt/catalog/cards/global_mmlu/it 2026-05-27T11:53:36,606 copying src/unitxt/catalog/cards/global_mmlu/it/college_chemistry.json -> build/lib/unitxt/catalog/cards/global_mmlu/it 2026-05-27T11:53:36,608 copying src/unitxt/catalog/cards/global_mmlu/it/high_school_government_and_politics.json -> build/lib/unitxt/catalog/cards/global_mmlu/it 2026-05-27T11:53:36,611 copying src/unitxt/catalog/cards/global_mmlu/it/college_mathematics.json -> build/lib/unitxt/catalog/cards/global_mmlu/it 2026-05-27T11:53:36,613 copying src/unitxt/catalog/cards/global_mmlu/it/econometrics.json -> build/lib/unitxt/catalog/cards/global_mmlu/it 2026-05-27T11:53:36,615 copying src/unitxt/catalog/cards/global_mmlu/it/high_school_macroeconomics.json -> build/lib/unitxt/catalog/cards/global_mmlu/it 2026-05-27T11:53:36,618 copying src/unitxt/catalog/cards/global_mmlu/it/high_school_psychology.json -> build/lib/unitxt/catalog/cards/global_mmlu/it 2026-05-27T11:53:36,620 copying src/unitxt/catalog/cards/global_mmlu/it/computer_security.json -> build/lib/unitxt/catalog/cards/global_mmlu/it 2026-05-27T11:53:36,622 copying src/unitxt/catalog/cards/global_mmlu/it/sociology.json -> build/lib/unitxt/catalog/cards/global_mmlu/it 2026-05-27T11:53:36,625 copying src/unitxt/catalog/cards/global_mmlu/it/nutrition.json -> build/lib/unitxt/catalog/cards/global_mmlu/it 2026-05-27T11:53:36,627 copying src/unitxt/catalog/cards/global_mmlu/it/professional_medicine.json -> build/lib/unitxt/catalog/cards/global_mmlu/it 2026-05-27T11:53:36,630 copying src/unitxt/catalog/cards/global_mmlu/it/college_biology.json -> build/lib/unitxt/catalog/cards/global_mmlu/it 2026-05-27T11:53:36,632 copying src/unitxt/catalog/cards/global_mmlu/it/anatomy.json -> build/lib/unitxt/catalog/cards/global_mmlu/it 2026-05-27T11:53:36,634 copying src/unitxt/catalog/cards/global_mmlu/it/professional_law.json -> build/lib/unitxt/catalog/cards/global_mmlu/it 2026-05-27T11:53:36,637 copying src/unitxt/catalog/cards/global_mmlu/it/machine_learning.json -> build/lib/unitxt/catalog/cards/global_mmlu/it 2026-05-27T11:53:36,639 copying src/unitxt/catalog/cards/global_mmlu/it/international_law.json -> build/lib/unitxt/catalog/cards/global_mmlu/it 2026-05-27T11:53:36,641 copying src/unitxt/catalog/cards/global_mmlu/it/medical_genetics.json -> build/lib/unitxt/catalog/cards/global_mmlu/it 2026-05-27T11:53:36,643 copying src/unitxt/catalog/cards/global_mmlu/it/high_school_computer_science.json -> build/lib/unitxt/catalog/cards/global_mmlu/it 2026-05-27T11:53:36,646 copying src/unitxt/catalog/cards/global_mmlu/it/clinical_knowledge.json -> build/lib/unitxt/catalog/cards/global_mmlu/it 2026-05-27T11:53:36,648 copying src/unitxt/catalog/cards/global_mmlu/it/college_physics.json -> build/lib/unitxt/catalog/cards/global_mmlu/it 2026-05-27T11:53:36,651 copying src/unitxt/catalog/cards/global_mmlu/it/global_facts.json -> build/lib/unitxt/catalog/cards/global_mmlu/it 2026-05-27T11:53:36,653 copying src/unitxt/catalog/cards/global_mmlu/it/college_computer_science.json -> build/lib/unitxt/catalog/cards/global_mmlu/it 2026-05-27T11:53:36,655 copying src/unitxt/catalog/cards/global_mmlu/it/us_foreign_policy.json -> build/lib/unitxt/catalog/cards/global_mmlu/it 2026-05-27T11:53:36,658 copying src/unitxt/catalog/cards/global_mmlu/it/professional_accounting.json -> build/lib/unitxt/catalog/cards/global_mmlu/it 2026-05-27T11:53:36,660 copying src/unitxt/catalog/cards/global_mmlu/it/professional_psychology.json -> build/lib/unitxt/catalog/cards/global_mmlu/it 2026-05-27T11:53:36,663 copying src/unitxt/catalog/cards/global_mmlu/it/philosophy.json -> build/lib/unitxt/catalog/cards/global_mmlu/it 2026-05-27T11:53:36,665 copying src/unitxt/catalog/cards/global_mmlu/it/elementary_mathematics.json -> build/lib/unitxt/catalog/cards/global_mmlu/it 2026-05-27T11:53:36,668 copying src/unitxt/catalog/cards/global_mmlu/it/conceptual_physics.json -> build/lib/unitxt/catalog/cards/global_mmlu/it 2026-05-27T11:53:36,670 copying src/unitxt/catalog/cards/global_mmlu/it/high_school_geography.json -> build/lib/unitxt/catalog/cards/global_mmlu/it 2026-05-27T11:53:36,672 copying src/unitxt/catalog/cards/global_mmlu/it/human_aging.json -> build/lib/unitxt/catalog/cards/global_mmlu/it 2026-05-27T11:53:36,675 copying src/unitxt/catalog/cards/global_mmlu/it/electrical_engineering.json -> build/lib/unitxt/catalog/cards/global_mmlu/it 2026-05-27T11:53:36,677 copying src/unitxt/catalog/cards/global_mmlu/it/management.json -> build/lib/unitxt/catalog/cards/global_mmlu/it 2026-05-27T11:53:36,680 copying src/unitxt/catalog/cards/global_mmlu/it/high_school_world_history.json -> build/lib/unitxt/catalog/cards/global_mmlu/it 2026-05-27T11:53:36,682 copying src/unitxt/catalog/cards/global_mmlu/it/marketing.json -> build/lib/unitxt/catalog/cards/global_mmlu/it 2026-05-27T11:53:36,685 copying src/unitxt/catalog/cards/global_mmlu/it/high_school_european_history.json -> build/lib/unitxt/catalog/cards/global_mmlu/it 2026-05-27T11:53:36,687 copying src/unitxt/catalog/cards/global_mmlu/it/astronomy.json -> build/lib/unitxt/catalog/cards/global_mmlu/it 2026-05-27T11:53:36,689 copying src/unitxt/catalog/cards/global_mmlu/it/high_school_physics.json -> build/lib/unitxt/catalog/cards/global_mmlu/it 2026-05-27T11:53:36,692 copying src/unitxt/catalog/cards/global_mmlu/it/public_relations.json -> build/lib/unitxt/catalog/cards/global_mmlu/it 2026-05-27T11:53:36,694 copying src/unitxt/catalog/cards/global_mmlu/it/high_school_microeconomics.json -> build/lib/unitxt/catalog/cards/global_mmlu/it 2026-05-27T11:53:36,697 copying src/unitxt/catalog/cards/global_mmlu/it/virology.json -> build/lib/unitxt/catalog/cards/global_mmlu/it 2026-05-27T11:53:36,699 copying src/unitxt/catalog/cards/global_mmlu/it/high_school_us_history.json -> build/lib/unitxt/catalog/cards/global_mmlu/it 2026-05-27T11:53:36,701 copying src/unitxt/catalog/cards/global_mmlu/it/high_school_statistics.json -> build/lib/unitxt/catalog/cards/global_mmlu/it 2026-05-27T11:53:36,703 copying src/unitxt/catalog/cards/global_mmlu/it/miscellaneous.json -> build/lib/unitxt/catalog/cards/global_mmlu/it 2026-05-27T11:53:36,706 copying src/unitxt/catalog/cards/global_mmlu/it/high_school_mathematics.json -> build/lib/unitxt/catalog/cards/global_mmlu/it 2026-05-27T11:53:36,708 copying src/unitxt/catalog/cards/global_mmlu/it/formal_logic.json -> build/lib/unitxt/catalog/cards/global_mmlu/it 2026-05-27T11:53:36,711 copying src/unitxt/catalog/cards/global_mmlu/it/high_school_chemistry.json -> build/lib/unitxt/catalog/cards/global_mmlu/it 2026-05-27T11:53:36,713 copying src/unitxt/catalog/cards/global_mmlu/it/abstract_algebra.json -> build/lib/unitxt/catalog/cards/global_mmlu/it 2026-05-27T11:53:36,715 copying src/unitxt/catalog/cards/global_mmlu/it/moral_scenarios.json -> build/lib/unitxt/catalog/cards/global_mmlu/it 2026-05-27T11:53:36,718 copying src/unitxt/catalog/cards/global_mmlu/it/world_religions.json -> build/lib/unitxt/catalog/cards/global_mmlu/it 2026-05-27T11:53:36,720 copying src/unitxt/catalog/cards/global_mmlu/it/business_ethics.json -> build/lib/unitxt/catalog/cards/global_mmlu/it 2026-05-27T11:53:36,723 copying src/unitxt/catalog/cards/global_mmlu/it/security_studies.json -> build/lib/unitxt/catalog/cards/global_mmlu/it 2026-05-27T11:53:36,725 copying src/unitxt/catalog/cards/global_mmlu/it/college_medicine.json -> build/lib/unitxt/catalog/cards/global_mmlu/it 2026-05-27T11:53:36,727 copying src/unitxt/catalog/cards/global_mmlu/it/human_sexuality.json -> build/lib/unitxt/catalog/cards/global_mmlu/it 2026-05-27T11:53:36,730 copying src/unitxt/catalog/cards/global_mmlu/it/prehistory.json -> build/lib/unitxt/catalog/cards/global_mmlu/it 2026-05-27T11:53:36,732 creating build/lib/unitxt/catalog/cards/global_mmlu/de 2026-05-27T11:53:36,733 copying src/unitxt/catalog/cards/global_mmlu/de/moral_disputes.json -> build/lib/unitxt/catalog/cards/global_mmlu/de 2026-05-27T11:53:36,736 copying src/unitxt/catalog/cards/global_mmlu/de/high_school_biology.json -> build/lib/unitxt/catalog/cards/global_mmlu/de 2026-05-27T11:53:36,739 copying src/unitxt/catalog/cards/global_mmlu/de/jurisprudence.json -> build/lib/unitxt/catalog/cards/global_mmlu/de 2026-05-27T11:53:36,742 copying src/unitxt/catalog/cards/global_mmlu/de/logical_fallacies.json -> build/lib/unitxt/catalog/cards/global_mmlu/de 2026-05-27T11:53:36,746 copying src/unitxt/catalog/cards/global_mmlu/de/college_chemistry.json -> build/lib/unitxt/catalog/cards/global_mmlu/de 2026-05-27T11:53:36,750 copying src/unitxt/catalog/cards/global_mmlu/de/high_school_government_and_politics.json -> build/lib/unitxt/catalog/cards/global_mmlu/de 2026-05-27T11:53:36,753 copying src/unitxt/catalog/cards/global_mmlu/de/college_mathematics.json -> build/lib/unitxt/catalog/cards/global_mmlu/de 2026-05-27T11:53:36,755 copying src/unitxt/catalog/cards/global_mmlu/de/econometrics.json -> build/lib/unitxt/catalog/cards/global_mmlu/de 2026-05-27T11:53:36,758 copying src/unitxt/catalog/cards/global_mmlu/de/high_school_macroeconomics.json -> build/lib/unitxt/catalog/cards/global_mmlu/de 2026-05-27T11:53:36,761 copying src/unitxt/catalog/cards/global_mmlu/de/high_school_psychology.json -> build/lib/unitxt/catalog/cards/global_mmlu/de 2026-05-27T11:53:36,763 copying src/unitxt/catalog/cards/global_mmlu/de/computer_security.json -> build/lib/unitxt/catalog/cards/global_mmlu/de 2026-05-27T11:53:36,766 copying src/unitxt/catalog/cards/global_mmlu/de/sociology.json -> build/lib/unitxt/catalog/cards/global_mmlu/de 2026-05-27T11:53:36,768 copying src/unitxt/catalog/cards/global_mmlu/de/nutrition.json -> build/lib/unitxt/catalog/cards/global_mmlu/de 2026-05-27T11:53:36,771 copying src/unitxt/catalog/cards/global_mmlu/de/professional_medicine.json -> build/lib/unitxt/catalog/cards/global_mmlu/de 2026-05-27T11:53:36,773 copying src/unitxt/catalog/cards/global_mmlu/de/college_biology.json -> build/lib/unitxt/catalog/cards/global_mmlu/de 2026-05-27T11:53:36,776 copying src/unitxt/catalog/cards/global_mmlu/de/anatomy.json -> build/lib/unitxt/catalog/cards/global_mmlu/de 2026-05-27T11:53:36,778 copying src/unitxt/catalog/cards/global_mmlu/de/professional_law.json -> build/lib/unitxt/catalog/cards/global_mmlu/de 2026-05-27T11:53:36,781 copying src/unitxt/catalog/cards/global_mmlu/de/machine_learning.json -> build/lib/unitxt/catalog/cards/global_mmlu/de 2026-05-27T11:53:36,783 copying src/unitxt/catalog/cards/global_mmlu/de/international_law.json -> build/lib/unitxt/catalog/cards/global_mmlu/de 2026-05-27T11:53:36,786 copying src/unitxt/catalog/cards/global_mmlu/de/medical_genetics.json -> build/lib/unitxt/catalog/cards/global_mmlu/de 2026-05-27T11:53:36,789 copying src/unitxt/catalog/cards/global_mmlu/de/high_school_computer_science.json -> build/lib/unitxt/catalog/cards/global_mmlu/de 2026-05-27T11:53:36,791 copying src/unitxt/catalog/cards/global_mmlu/de/clinical_knowledge.json -> build/lib/unitxt/catalog/cards/global_mmlu/de 2026-05-27T11:53:36,794 copying src/unitxt/catalog/cards/global_mmlu/de/college_physics.json -> build/lib/unitxt/catalog/cards/global_mmlu/de 2026-05-27T11:53:36,796 copying src/unitxt/catalog/cards/global_mmlu/de/global_facts.json -> build/lib/unitxt/catalog/cards/global_mmlu/de 2026-05-27T11:53:36,799 copying src/unitxt/catalog/cards/global_mmlu/de/college_computer_science.json -> build/lib/unitxt/catalog/cards/global_mmlu/de 2026-05-27T11:53:36,801 copying src/unitxt/catalog/cards/global_mmlu/de/us_foreign_policy.json -> build/lib/unitxt/catalog/cards/global_mmlu/de 2026-05-27T11:53:36,804 copying src/unitxt/catalog/cards/global_mmlu/de/professional_accounting.json -> build/lib/unitxt/catalog/cards/global_mmlu/de 2026-05-27T11:53:36,806 copying src/unitxt/catalog/cards/global_mmlu/de/professional_psychology.json -> build/lib/unitxt/catalog/cards/global_mmlu/de 2026-05-27T11:53:36,809 copying src/unitxt/catalog/cards/global_mmlu/de/philosophy.json -> build/lib/unitxt/catalog/cards/global_mmlu/de 2026-05-27T11:53:36,812 copying src/unitxt/catalog/cards/global_mmlu/de/elementary_mathematics.json -> build/lib/unitxt/catalog/cards/global_mmlu/de 2026-05-27T11:53:36,814 copying src/unitxt/catalog/cards/global_mmlu/de/conceptual_physics.json -> build/lib/unitxt/catalog/cards/global_mmlu/de 2026-05-27T11:53:36,816 copying src/unitxt/catalog/cards/global_mmlu/de/high_school_geography.json -> build/lib/unitxt/catalog/cards/global_mmlu/de 2026-05-27T11:53:36,819 copying src/unitxt/catalog/cards/global_mmlu/de/human_aging.json -> build/lib/unitxt/catalog/cards/global_mmlu/de 2026-05-27T11:53:36,822 copying src/unitxt/catalog/cards/global_mmlu/de/electrical_engineering.json -> build/lib/unitxt/catalog/cards/global_mmlu/de 2026-05-27T11:53:36,824 copying src/unitxt/catalog/cards/global_mmlu/de/management.json -> build/lib/unitxt/catalog/cards/global_mmlu/de 2026-05-27T11:53:36,827 copying src/unitxt/catalog/cards/global_mmlu/de/high_school_world_history.json -> build/lib/unitxt/catalog/cards/global_mmlu/de 2026-05-27T11:53:36,829 copying src/unitxt/catalog/cards/global_mmlu/de/marketing.json -> build/lib/unitxt/catalog/cards/global_mmlu/de 2026-05-27T11:53:36,832 copying src/unitxt/catalog/cards/global_mmlu/de/high_school_european_history.json -> build/lib/unitxt/catalog/cards/global_mmlu/de 2026-05-27T11:53:36,834 copying src/unitxt/catalog/cards/global_mmlu/de/astronomy.json -> build/lib/unitxt/catalog/cards/global_mmlu/de 2026-05-27T11:53:36,837 copying src/unitxt/catalog/cards/global_mmlu/de/high_school_physics.json -> build/lib/unitxt/catalog/cards/global_mmlu/de 2026-05-27T11:53:36,840 copying src/unitxt/catalog/cards/global_mmlu/de/public_relations.json -> build/lib/unitxt/catalog/cards/global_mmlu/de 2026-05-27T11:53:36,842 copying src/unitxt/catalog/cards/global_mmlu/de/high_school_microeconomics.json -> build/lib/unitxt/catalog/cards/global_mmlu/de 2026-05-27T11:53:36,845 copying src/unitxt/catalog/cards/global_mmlu/de/virology.json -> build/lib/unitxt/catalog/cards/global_mmlu/de 2026-05-27T11:53:36,847 copying src/unitxt/catalog/cards/global_mmlu/de/high_school_us_history.json -> build/lib/unitxt/catalog/cards/global_mmlu/de 2026-05-27T11:53:36,849 copying src/unitxt/catalog/cards/global_mmlu/de/high_school_statistics.json -> build/lib/unitxt/catalog/cards/global_mmlu/de 2026-05-27T11:53:36,852 copying src/unitxt/catalog/cards/global_mmlu/de/miscellaneous.json -> build/lib/unitxt/catalog/cards/global_mmlu/de 2026-05-27T11:53:36,854 copying src/unitxt/catalog/cards/global_mmlu/de/high_school_mathematics.json -> build/lib/unitxt/catalog/cards/global_mmlu/de 2026-05-27T11:53:36,857 copying src/unitxt/catalog/cards/global_mmlu/de/formal_logic.json -> build/lib/unitxt/catalog/cards/global_mmlu/de 2026-05-27T11:53:36,859 copying src/unitxt/catalog/cards/global_mmlu/de/high_school_chemistry.json -> build/lib/unitxt/catalog/cards/global_mmlu/de 2026-05-27T11:53:36,862 copying src/unitxt/catalog/cards/global_mmlu/de/abstract_algebra.json -> build/lib/unitxt/catalog/cards/global_mmlu/de 2026-05-27T11:53:36,864 copying src/unitxt/catalog/cards/global_mmlu/de/moral_scenarios.json -> build/lib/unitxt/catalog/cards/global_mmlu/de 2026-05-27T11:53:36,867 copying src/unitxt/catalog/cards/global_mmlu/de/world_religions.json -> build/lib/unitxt/catalog/cards/global_mmlu/de 2026-05-27T11:53:36,869 copying src/unitxt/catalog/cards/global_mmlu/de/business_ethics.json -> build/lib/unitxt/catalog/cards/global_mmlu/de 2026-05-27T11:53:36,872 copying src/unitxt/catalog/cards/global_mmlu/de/security_studies.json -> build/lib/unitxt/catalog/cards/global_mmlu/de 2026-05-27T11:53:36,874 copying src/unitxt/catalog/cards/global_mmlu/de/college_medicine.json -> build/lib/unitxt/catalog/cards/global_mmlu/de 2026-05-27T11:53:36,877 copying src/unitxt/catalog/cards/global_mmlu/de/human_sexuality.json -> build/lib/unitxt/catalog/cards/global_mmlu/de 2026-05-27T11:53:36,879 copying src/unitxt/catalog/cards/global_mmlu/de/prehistory.json -> build/lib/unitxt/catalog/cards/global_mmlu/de 2026-05-27T11:53:36,882 creating build/lib/unitxt/catalog/cards/global_mmlu/yo 2026-05-27T11:53:36,883 copying src/unitxt/catalog/cards/global_mmlu/yo/moral_disputes.json -> build/lib/unitxt/catalog/cards/global_mmlu/yo 2026-05-27T11:53:36,886 copying src/unitxt/catalog/cards/global_mmlu/yo/high_school_biology.json -> build/lib/unitxt/catalog/cards/global_mmlu/yo 2026-05-27T11:53:36,888 copying src/unitxt/catalog/cards/global_mmlu/yo/jurisprudence.json -> build/lib/unitxt/catalog/cards/global_mmlu/yo 2026-05-27T11:53:36,891 copying src/unitxt/catalog/cards/global_mmlu/yo/logical_fallacies.json -> build/lib/unitxt/catalog/cards/global_mmlu/yo 2026-05-27T11:53:36,893 copying src/unitxt/catalog/cards/global_mmlu/yo/college_chemistry.json -> build/lib/unitxt/catalog/cards/global_mmlu/yo 2026-05-27T11:53:36,896 copying src/unitxt/catalog/cards/global_mmlu/yo/high_school_government_and_politics.json -> build/lib/unitxt/catalog/cards/global_mmlu/yo 2026-05-27T11:53:36,898 copying src/unitxt/catalog/cards/global_mmlu/yo/college_mathematics.json -> build/lib/unitxt/catalog/cards/global_mmlu/yo 2026-05-27T11:53:36,901 copying src/unitxt/catalog/cards/global_mmlu/yo/econometrics.json -> build/lib/unitxt/catalog/cards/global_mmlu/yo 2026-05-27T11:53:36,903 copying src/unitxt/catalog/cards/global_mmlu/yo/high_school_macroeconomics.json -> build/lib/unitxt/catalog/cards/global_mmlu/yo 2026-05-27T11:53:36,906 copying src/unitxt/catalog/cards/global_mmlu/yo/high_school_psychology.json -> build/lib/unitxt/catalog/cards/global_mmlu/yo 2026-05-27T11:53:36,908 copying src/unitxt/catalog/cards/global_mmlu/yo/computer_security.json -> build/lib/unitxt/catalog/cards/global_mmlu/yo 2026-05-27T11:53:36,911 copying src/unitxt/catalog/cards/global_mmlu/yo/sociology.json -> build/lib/unitxt/catalog/cards/global_mmlu/yo 2026-05-27T11:53:36,913 copying src/unitxt/catalog/cards/global_mmlu/yo/nutrition.json -> build/lib/unitxt/catalog/cards/global_mmlu/yo 2026-05-27T11:53:36,915 copying src/unitxt/catalog/cards/global_mmlu/yo/professional_medicine.json -> build/lib/unitxt/catalog/cards/global_mmlu/yo 2026-05-27T11:53:36,918 copying src/unitxt/catalog/cards/global_mmlu/yo/college_biology.json -> build/lib/unitxt/catalog/cards/global_mmlu/yo 2026-05-27T11:53:36,920 copying src/unitxt/catalog/cards/global_mmlu/yo/anatomy.json -> build/lib/unitxt/catalog/cards/global_mmlu/yo 2026-05-27T11:53:36,923 copying src/unitxt/catalog/cards/global_mmlu/yo/professional_law.json -> build/lib/unitxt/catalog/cards/global_mmlu/yo 2026-05-27T11:53:36,925 copying src/unitxt/catalog/cards/global_mmlu/yo/machine_learning.json -> build/lib/unitxt/catalog/cards/global_mmlu/yo 2026-05-27T11:53:36,928 copying src/unitxt/catalog/cards/global_mmlu/yo/international_law.json -> build/lib/unitxt/catalog/cards/global_mmlu/yo 2026-05-27T11:53:36,930 copying src/unitxt/catalog/cards/global_mmlu/yo/medical_genetics.json -> build/lib/unitxt/catalog/cards/global_mmlu/yo 2026-05-27T11:53:36,932 copying src/unitxt/catalog/cards/global_mmlu/yo/high_school_computer_science.json -> build/lib/unitxt/catalog/cards/global_mmlu/yo 2026-05-27T11:53:36,935 copying src/unitxt/catalog/cards/global_mmlu/yo/clinical_knowledge.json -> build/lib/unitxt/catalog/cards/global_mmlu/yo 2026-05-27T11:53:36,937 copying src/unitxt/catalog/cards/global_mmlu/yo/college_physics.json -> build/lib/unitxt/catalog/cards/global_mmlu/yo 2026-05-27T11:53:36,940 copying src/unitxt/catalog/cards/global_mmlu/yo/global_facts.json -> build/lib/unitxt/catalog/cards/global_mmlu/yo 2026-05-27T11:53:36,942 copying src/unitxt/catalog/cards/global_mmlu/yo/college_computer_science.json -> build/lib/unitxt/catalog/cards/global_mmlu/yo 2026-05-27T11:53:36,944 copying src/unitxt/catalog/cards/global_mmlu/yo/us_foreign_policy.json -> build/lib/unitxt/catalog/cards/global_mmlu/yo 2026-05-27T11:53:36,947 copying src/unitxt/catalog/cards/global_mmlu/yo/professional_accounting.json -> build/lib/unitxt/catalog/cards/global_mmlu/yo 2026-05-27T11:53:36,949 copying src/unitxt/catalog/cards/global_mmlu/yo/professional_psychology.json -> build/lib/unitxt/catalog/cards/global_mmlu/yo 2026-05-27T11:53:36,952 copying src/unitxt/catalog/cards/global_mmlu/yo/philosophy.json -> build/lib/unitxt/catalog/cards/global_mmlu/yo 2026-05-27T11:53:36,954 copying src/unitxt/catalog/cards/global_mmlu/yo/elementary_mathematics.json -> build/lib/unitxt/catalog/cards/global_mmlu/yo 2026-05-27T11:53:36,956 copying src/unitxt/catalog/cards/global_mmlu/yo/conceptual_physics.json -> build/lib/unitxt/catalog/cards/global_mmlu/yo 2026-05-27T11:53:36,959 copying src/unitxt/catalog/cards/global_mmlu/yo/high_school_geography.json -> build/lib/unitxt/catalog/cards/global_mmlu/yo 2026-05-27T11:53:36,961 copying src/unitxt/catalog/cards/global_mmlu/yo/human_aging.json -> build/lib/unitxt/catalog/cards/global_mmlu/yo 2026-05-27T11:53:36,963 copying src/unitxt/catalog/cards/global_mmlu/yo/electrical_engineering.json -> build/lib/unitxt/catalog/cards/global_mmlu/yo 2026-05-27T11:53:36,966 copying src/unitxt/catalog/cards/global_mmlu/yo/management.json -> build/lib/unitxt/catalog/cards/global_mmlu/yo 2026-05-27T11:53:36,968 copying src/unitxt/catalog/cards/global_mmlu/yo/high_school_world_history.json -> build/lib/unitxt/catalog/cards/global_mmlu/yo 2026-05-27T11:53:36,970 copying src/unitxt/catalog/cards/global_mmlu/yo/marketing.json -> build/lib/unitxt/catalog/cards/global_mmlu/yo 2026-05-27T11:53:36,973 copying src/unitxt/catalog/cards/global_mmlu/yo/high_school_european_history.json -> build/lib/unitxt/catalog/cards/global_mmlu/yo 2026-05-27T11:53:36,975 copying src/unitxt/catalog/cards/global_mmlu/yo/astronomy.json -> build/lib/unitxt/catalog/cards/global_mmlu/yo 2026-05-27T11:53:36,977 copying src/unitxt/catalog/cards/global_mmlu/yo/high_school_physics.json -> build/lib/unitxt/catalog/cards/global_mmlu/yo 2026-05-27T11:53:36,980 copying src/unitxt/catalog/cards/global_mmlu/yo/public_relations.json -> build/lib/unitxt/catalog/cards/global_mmlu/yo 2026-05-27T11:53:36,982 copying src/unitxt/catalog/cards/global_mmlu/yo/high_school_microeconomics.json -> build/lib/unitxt/catalog/cards/global_mmlu/yo 2026-05-27T11:53:36,985 copying src/unitxt/catalog/cards/global_mmlu/yo/virology.json -> build/lib/unitxt/catalog/cards/global_mmlu/yo 2026-05-27T11:53:36,987 copying src/unitxt/catalog/cards/global_mmlu/yo/high_school_us_history.json -> build/lib/unitxt/catalog/cards/global_mmlu/yo 2026-05-27T11:53:36,990 copying src/unitxt/catalog/cards/global_mmlu/yo/high_school_statistics.json -> build/lib/unitxt/catalog/cards/global_mmlu/yo 2026-05-27T11:53:36,992 copying src/unitxt/catalog/cards/global_mmlu/yo/miscellaneous.json -> build/lib/unitxt/catalog/cards/global_mmlu/yo 2026-05-27T11:53:36,994 copying src/unitxt/catalog/cards/global_mmlu/yo/high_school_mathematics.json -> build/lib/unitxt/catalog/cards/global_mmlu/yo 2026-05-27T11:53:36,997 copying src/unitxt/catalog/cards/global_mmlu/yo/formal_logic.json -> build/lib/unitxt/catalog/cards/global_mmlu/yo 2026-05-27T11:53:36,999 copying src/unitxt/catalog/cards/global_mmlu/yo/high_school_chemistry.json -> build/lib/unitxt/catalog/cards/global_mmlu/yo 2026-05-27T11:53:37,002 copying src/unitxt/catalog/cards/global_mmlu/yo/abstract_algebra.json -> build/lib/unitxt/catalog/cards/global_mmlu/yo 2026-05-27T11:53:37,004 copying src/unitxt/catalog/cards/global_mmlu/yo/moral_scenarios.json -> build/lib/unitxt/catalog/cards/global_mmlu/yo 2026-05-27T11:53:37,007 copying src/unitxt/catalog/cards/global_mmlu/yo/world_religions.json -> build/lib/unitxt/catalog/cards/global_mmlu/yo 2026-05-27T11:53:37,009 copying src/unitxt/catalog/cards/global_mmlu/yo/business_ethics.json -> build/lib/unitxt/catalog/cards/global_mmlu/yo 2026-05-27T11:53:37,012 copying src/unitxt/catalog/cards/global_mmlu/yo/security_studies.json -> build/lib/unitxt/catalog/cards/global_mmlu/yo 2026-05-27T11:53:37,014 copying src/unitxt/catalog/cards/global_mmlu/yo/college_medicine.json -> build/lib/unitxt/catalog/cards/global_mmlu/yo 2026-05-27T11:53:37,017 copying src/unitxt/catalog/cards/global_mmlu/yo/human_sexuality.json -> build/lib/unitxt/catalog/cards/global_mmlu/yo 2026-05-27T11:53:37,019 copying src/unitxt/catalog/cards/global_mmlu/yo/prehistory.json -> build/lib/unitxt/catalog/cards/global_mmlu/yo 2026-05-27T11:53:37,021 creating build/lib/unitxt/catalog/cards/global_mmlu/ar 2026-05-27T11:53:37,023 copying src/unitxt/catalog/cards/global_mmlu/ar/moral_disputes.json -> build/lib/unitxt/catalog/cards/global_mmlu/ar 2026-05-27T11:53:37,025 copying src/unitxt/catalog/cards/global_mmlu/ar/high_school_biology.json -> build/lib/unitxt/catalog/cards/global_mmlu/ar 2026-05-27T11:53:37,028 copying src/unitxt/catalog/cards/global_mmlu/ar/jurisprudence.json -> build/lib/unitxt/catalog/cards/global_mmlu/ar 2026-05-27T11:53:37,030 copying src/unitxt/catalog/cards/global_mmlu/ar/logical_fallacies.json -> build/lib/unitxt/catalog/cards/global_mmlu/ar 2026-05-27T11:53:37,033 copying src/unitxt/catalog/cards/global_mmlu/ar/college_chemistry.json -> build/lib/unitxt/catalog/cards/global_mmlu/ar 2026-05-27T11:53:37,035 copying src/unitxt/catalog/cards/global_mmlu/ar/high_school_government_and_politics.json -> build/lib/unitxt/catalog/cards/global_mmlu/ar 2026-05-27T11:53:37,038 copying src/unitxt/catalog/cards/global_mmlu/ar/college_mathematics.json -> build/lib/unitxt/catalog/cards/global_mmlu/ar 2026-05-27T11:53:37,040 copying src/unitxt/catalog/cards/global_mmlu/ar/econometrics.json -> build/lib/unitxt/catalog/cards/global_mmlu/ar 2026-05-27T11:53:37,042 copying src/unitxt/catalog/cards/global_mmlu/ar/high_school_macroeconomics.json -> build/lib/unitxt/catalog/cards/global_mmlu/ar 2026-05-27T11:53:37,045 copying src/unitxt/catalog/cards/global_mmlu/ar/high_school_psychology.json -> build/lib/unitxt/catalog/cards/global_mmlu/ar 2026-05-27T11:53:37,047 copying src/unitxt/catalog/cards/global_mmlu/ar/computer_security.json -> build/lib/unitxt/catalog/cards/global_mmlu/ar 2026-05-27T11:53:37,049 copying src/unitxt/catalog/cards/global_mmlu/ar/sociology.json -> build/lib/unitxt/catalog/cards/global_mmlu/ar 2026-05-27T11:53:37,051 copying src/unitxt/catalog/cards/global_mmlu/ar/nutrition.json -> build/lib/unitxt/catalog/cards/global_mmlu/ar 2026-05-27T11:53:37,054 copying src/unitxt/catalog/cards/global_mmlu/ar/professional_medicine.json -> build/lib/unitxt/catalog/cards/global_mmlu/ar 2026-05-27T11:53:37,056 copying src/unitxt/catalog/cards/global_mmlu/ar/college_biology.json -> build/lib/unitxt/catalog/cards/global_mmlu/ar 2026-05-27T11:53:37,058 copying src/unitxt/catalog/cards/global_mmlu/ar/anatomy.json -> build/lib/unitxt/catalog/cards/global_mmlu/ar 2026-05-27T11:53:37,060 copying src/unitxt/catalog/cards/global_mmlu/ar/professional_law.json -> build/lib/unitxt/catalog/cards/global_mmlu/ar 2026-05-27T11:53:37,063 copying src/unitxt/catalog/cards/global_mmlu/ar/machine_learning.json -> build/lib/unitxt/catalog/cards/global_mmlu/ar 2026-05-27T11:53:37,065 copying src/unitxt/catalog/cards/global_mmlu/ar/international_law.json -> build/lib/unitxt/catalog/cards/global_mmlu/ar 2026-05-27T11:53:37,068 copying src/unitxt/catalog/cards/global_mmlu/ar/medical_genetics.json -> build/lib/unitxt/catalog/cards/global_mmlu/ar 2026-05-27T11:53:37,070 copying src/unitxt/catalog/cards/global_mmlu/ar/high_school_computer_science.json -> build/lib/unitxt/catalog/cards/global_mmlu/ar 2026-05-27T11:53:37,073 copying src/unitxt/catalog/cards/global_mmlu/ar/clinical_knowledge.json -> build/lib/unitxt/catalog/cards/global_mmlu/ar 2026-05-27T11:53:37,075 copying src/unitxt/catalog/cards/global_mmlu/ar/college_physics.json -> build/lib/unitxt/catalog/cards/global_mmlu/ar 2026-05-27T11:53:37,078 copying src/unitxt/catalog/cards/global_mmlu/ar/global_facts.json -> build/lib/unitxt/catalog/cards/global_mmlu/ar 2026-05-27T11:53:37,080 copying src/unitxt/catalog/cards/global_mmlu/ar/college_computer_science.json -> build/lib/unitxt/catalog/cards/global_mmlu/ar 2026-05-27T11:53:37,083 copying src/unitxt/catalog/cards/global_mmlu/ar/us_foreign_policy.json -> build/lib/unitxt/catalog/cards/global_mmlu/ar 2026-05-27T11:53:37,085 copying src/unitxt/catalog/cards/global_mmlu/ar/professional_accounting.json -> build/lib/unitxt/catalog/cards/global_mmlu/ar 2026-05-27T11:53:37,088 copying src/unitxt/catalog/cards/global_mmlu/ar/professional_psychology.json -> build/lib/unitxt/catalog/cards/global_mmlu/ar 2026-05-27T11:53:37,090 copying src/unitxt/catalog/cards/global_mmlu/ar/philosophy.json -> build/lib/unitxt/catalog/cards/global_mmlu/ar 2026-05-27T11:53:37,093 copying src/unitxt/catalog/cards/global_mmlu/ar/elementary_mathematics.json -> build/lib/unitxt/catalog/cards/global_mmlu/ar 2026-05-27T11:53:37,095 copying src/unitxt/catalog/cards/global_mmlu/ar/conceptual_physics.json -> build/lib/unitxt/catalog/cards/global_mmlu/ar 2026-05-27T11:53:37,098 copying src/unitxt/catalog/cards/global_mmlu/ar/high_school_geography.json -> build/lib/unitxt/catalog/cards/global_mmlu/ar 2026-05-27T11:53:37,101 copying src/unitxt/catalog/cards/global_mmlu/ar/human_aging.json -> build/lib/unitxt/catalog/cards/global_mmlu/ar 2026-05-27T11:53:37,103 copying src/unitxt/catalog/cards/global_mmlu/ar/electrical_engineering.json -> build/lib/unitxt/catalog/cards/global_mmlu/ar 2026-05-27T11:53:37,105 copying src/unitxt/catalog/cards/global_mmlu/ar/management.json -> build/lib/unitxt/catalog/cards/global_mmlu/ar 2026-05-27T11:53:37,108 copying src/unitxt/catalog/cards/global_mmlu/ar/high_school_world_history.json -> build/lib/unitxt/catalog/cards/global_mmlu/ar 2026-05-27T11:53:37,110 copying src/unitxt/catalog/cards/global_mmlu/ar/marketing.json -> build/lib/unitxt/catalog/cards/global_mmlu/ar 2026-05-27T11:53:37,113 copying src/unitxt/catalog/cards/global_mmlu/ar/high_school_european_history.json -> build/lib/unitxt/catalog/cards/global_mmlu/ar 2026-05-27T11:53:37,116 copying src/unitxt/catalog/cards/global_mmlu/ar/astronomy.json -> build/lib/unitxt/catalog/cards/global_mmlu/ar 2026-05-27T11:53:37,118 copying src/unitxt/catalog/cards/global_mmlu/ar/high_school_physics.json -> build/lib/unitxt/catalog/cards/global_mmlu/ar 2026-05-27T11:53:37,120 copying src/unitxt/catalog/cards/global_mmlu/ar/public_relations.json -> build/lib/unitxt/catalog/cards/global_mmlu/ar 2026-05-27T11:53:37,123 copying src/unitxt/catalog/cards/global_mmlu/ar/high_school_microeconomics.json -> build/lib/unitxt/catalog/cards/global_mmlu/ar 2026-05-27T11:53:37,125 copying src/unitxt/catalog/cards/global_mmlu/ar/virology.json -> build/lib/unitxt/catalog/cards/global_mmlu/ar 2026-05-27T11:53:37,128 copying src/unitxt/catalog/cards/global_mmlu/ar/high_school_us_history.json -> build/lib/unitxt/catalog/cards/global_mmlu/ar 2026-05-27T11:53:37,130 copying src/unitxt/catalog/cards/global_mmlu/ar/high_school_statistics.json -> build/lib/unitxt/catalog/cards/global_mmlu/ar 2026-05-27T11:53:37,133 copying src/unitxt/catalog/cards/global_mmlu/ar/miscellaneous.json -> build/lib/unitxt/catalog/cards/global_mmlu/ar 2026-05-27T11:53:37,135 copying src/unitxt/catalog/cards/global_mmlu/ar/high_school_mathematics.json -> build/lib/unitxt/catalog/cards/global_mmlu/ar 2026-05-27T11:53:37,137 copying src/unitxt/catalog/cards/global_mmlu/ar/formal_logic.json -> build/lib/unitxt/catalog/cards/global_mmlu/ar 2026-05-27T11:53:37,140 copying src/unitxt/catalog/cards/global_mmlu/ar/high_school_chemistry.json -> build/lib/unitxt/catalog/cards/global_mmlu/ar 2026-05-27T11:53:37,142 copying src/unitxt/catalog/cards/global_mmlu/ar/abstract_algebra.json -> build/lib/unitxt/catalog/cards/global_mmlu/ar 2026-05-27T11:53:37,145 copying src/unitxt/catalog/cards/global_mmlu/ar/moral_scenarios.json -> build/lib/unitxt/catalog/cards/global_mmlu/ar 2026-05-27T11:53:37,147 copying src/unitxt/catalog/cards/global_mmlu/ar/world_religions.json -> build/lib/unitxt/catalog/cards/global_mmlu/ar 2026-05-27T11:53:37,149 copying src/unitxt/catalog/cards/global_mmlu/ar/business_ethics.json -> build/lib/unitxt/catalog/cards/global_mmlu/ar 2026-05-27T11:53:37,152 copying src/unitxt/catalog/cards/global_mmlu/ar/security_studies.json -> build/lib/unitxt/catalog/cards/global_mmlu/ar 2026-05-27T11:53:37,154 copying src/unitxt/catalog/cards/global_mmlu/ar/college_medicine.json -> build/lib/unitxt/catalog/cards/global_mmlu/ar 2026-05-27T11:53:37,156 copying src/unitxt/catalog/cards/global_mmlu/ar/human_sexuality.json -> build/lib/unitxt/catalog/cards/global_mmlu/ar 2026-05-27T11:53:37,159 copying src/unitxt/catalog/cards/global_mmlu/ar/prehistory.json -> build/lib/unitxt/catalog/cards/global_mmlu/ar 2026-05-27T11:53:37,161 creating build/lib/unitxt/catalog/cards/global_mmlu/ha 2026-05-27T11:53:37,162 copying src/unitxt/catalog/cards/global_mmlu/ha/moral_disputes.json -> build/lib/unitxt/catalog/cards/global_mmlu/ha 2026-05-27T11:53:37,165 copying src/unitxt/catalog/cards/global_mmlu/ha/high_school_biology.json -> build/lib/unitxt/catalog/cards/global_mmlu/ha 2026-05-27T11:53:37,168 copying src/unitxt/catalog/cards/global_mmlu/ha/jurisprudence.json -> build/lib/unitxt/catalog/cards/global_mmlu/ha 2026-05-27T11:53:37,170 copying src/unitxt/catalog/cards/global_mmlu/ha/logical_fallacies.json -> build/lib/unitxt/catalog/cards/global_mmlu/ha 2026-05-27T11:53:37,172 copying src/unitxt/catalog/cards/global_mmlu/ha/college_chemistry.json -> build/lib/unitxt/catalog/cards/global_mmlu/ha 2026-05-27T11:53:37,174 copying src/unitxt/catalog/cards/global_mmlu/ha/high_school_government_and_politics.json -> build/lib/unitxt/catalog/cards/global_mmlu/ha 2026-05-27T11:53:37,177 copying src/unitxt/catalog/cards/global_mmlu/ha/college_mathematics.json -> build/lib/unitxt/catalog/cards/global_mmlu/ha 2026-05-27T11:53:37,179 copying src/unitxt/catalog/cards/global_mmlu/ha/econometrics.json -> build/lib/unitxt/catalog/cards/global_mmlu/ha 2026-05-27T11:53:37,181 copying src/unitxt/catalog/cards/global_mmlu/ha/high_school_macroeconomics.json -> build/lib/unitxt/catalog/cards/global_mmlu/ha 2026-05-27T11:53:37,183 copying src/unitxt/catalog/cards/global_mmlu/ha/high_school_psychology.json -> build/lib/unitxt/catalog/cards/global_mmlu/ha 2026-05-27T11:53:37,186 copying src/unitxt/catalog/cards/global_mmlu/ha/computer_security.json -> build/lib/unitxt/catalog/cards/global_mmlu/ha 2026-05-27T11:53:37,188 copying src/unitxt/catalog/cards/global_mmlu/ha/sociology.json -> build/lib/unitxt/catalog/cards/global_mmlu/ha 2026-05-27T11:53:37,190 copying src/unitxt/catalog/cards/global_mmlu/ha/nutrition.json -> build/lib/unitxt/catalog/cards/global_mmlu/ha 2026-05-27T11:53:37,193 copying src/unitxt/catalog/cards/global_mmlu/ha/professional_medicine.json -> build/lib/unitxt/catalog/cards/global_mmlu/ha 2026-05-27T11:53:37,195 copying src/unitxt/catalog/cards/global_mmlu/ha/college_biology.json -> build/lib/unitxt/catalog/cards/global_mmlu/ha 2026-05-27T11:53:37,197 copying src/unitxt/catalog/cards/global_mmlu/ha/anatomy.json -> build/lib/unitxt/catalog/cards/global_mmlu/ha 2026-05-27T11:53:37,200 copying src/unitxt/catalog/cards/global_mmlu/ha/professional_law.json -> build/lib/unitxt/catalog/cards/global_mmlu/ha 2026-05-27T11:53:37,202 copying src/unitxt/catalog/cards/global_mmlu/ha/machine_learning.json -> build/lib/unitxt/catalog/cards/global_mmlu/ha 2026-05-27T11:53:37,204 copying src/unitxt/catalog/cards/global_mmlu/ha/international_law.json -> build/lib/unitxt/catalog/cards/global_mmlu/ha 2026-05-27T11:53:37,207 copying src/unitxt/catalog/cards/global_mmlu/ha/medical_genetics.json -> build/lib/unitxt/catalog/cards/global_mmlu/ha 2026-05-27T11:53:37,209 copying src/unitxt/catalog/cards/global_mmlu/ha/high_school_computer_science.json -> build/lib/unitxt/catalog/cards/global_mmlu/ha 2026-05-27T11:53:37,211 copying src/unitxt/catalog/cards/global_mmlu/ha/clinical_knowledge.json -> build/lib/unitxt/catalog/cards/global_mmlu/ha 2026-05-27T11:53:37,214 copying src/unitxt/catalog/cards/global_mmlu/ha/college_physics.json -> build/lib/unitxt/catalog/cards/global_mmlu/ha 2026-05-27T11:53:37,216 copying src/unitxt/catalog/cards/global_mmlu/ha/global_facts.json -> build/lib/unitxt/catalog/cards/global_mmlu/ha 2026-05-27T11:53:37,219 copying src/unitxt/catalog/cards/global_mmlu/ha/college_computer_science.json -> build/lib/unitxt/catalog/cards/global_mmlu/ha 2026-05-27T11:53:37,221 copying src/unitxt/catalog/cards/global_mmlu/ha/us_foreign_policy.json -> build/lib/unitxt/catalog/cards/global_mmlu/ha 2026-05-27T11:53:37,223 copying src/unitxt/catalog/cards/global_mmlu/ha/professional_accounting.json -> build/lib/unitxt/catalog/cards/global_mmlu/ha 2026-05-27T11:53:37,226 copying src/unitxt/catalog/cards/global_mmlu/ha/professional_psychology.json -> build/lib/unitxt/catalog/cards/global_mmlu/ha 2026-05-27T11:53:37,228 copying src/unitxt/catalog/cards/global_mmlu/ha/philosophy.json -> build/lib/unitxt/catalog/cards/global_mmlu/ha 2026-05-27T11:53:37,231 copying src/unitxt/catalog/cards/global_mmlu/ha/elementary_mathematics.json -> build/lib/unitxt/catalog/cards/global_mmlu/ha 2026-05-27T11:53:37,233 copying src/unitxt/catalog/cards/global_mmlu/ha/conceptual_physics.json -> build/lib/unitxt/catalog/cards/global_mmlu/ha 2026-05-27T11:53:37,236 copying src/unitxt/catalog/cards/global_mmlu/ha/high_school_geography.json -> build/lib/unitxt/catalog/cards/global_mmlu/ha 2026-05-27T11:53:37,238 copying src/unitxt/catalog/cards/global_mmlu/ha/human_aging.json -> build/lib/unitxt/catalog/cards/global_mmlu/ha 2026-05-27T11:53:37,240 copying src/unitxt/catalog/cards/global_mmlu/ha/electrical_engineering.json -> build/lib/unitxt/catalog/cards/global_mmlu/ha 2026-05-27T11:53:37,243 copying src/unitxt/catalog/cards/global_mmlu/ha/management.json -> build/lib/unitxt/catalog/cards/global_mmlu/ha 2026-05-27T11:53:37,245 copying src/unitxt/catalog/cards/global_mmlu/ha/high_school_world_history.json -> build/lib/unitxt/catalog/cards/global_mmlu/ha 2026-05-27T11:53:37,247 copying src/unitxt/catalog/cards/global_mmlu/ha/marketing.json -> build/lib/unitxt/catalog/cards/global_mmlu/ha 2026-05-27T11:53:37,249 copying src/unitxt/catalog/cards/global_mmlu/ha/high_school_european_history.json -> build/lib/unitxt/catalog/cards/global_mmlu/ha 2026-05-27T11:53:37,252 copying src/unitxt/catalog/cards/global_mmlu/ha/astronomy.json -> build/lib/unitxt/catalog/cards/global_mmlu/ha 2026-05-27T11:53:37,254 copying src/unitxt/catalog/cards/global_mmlu/ha/high_school_physics.json -> build/lib/unitxt/catalog/cards/global_mmlu/ha 2026-05-27T11:53:37,256 copying src/unitxt/catalog/cards/global_mmlu/ha/public_relations.json -> build/lib/unitxt/catalog/cards/global_mmlu/ha 2026-05-27T11:53:37,259 copying src/unitxt/catalog/cards/global_mmlu/ha/high_school_microeconomics.json -> build/lib/unitxt/catalog/cards/global_mmlu/ha 2026-05-27T11:53:37,261 copying src/unitxt/catalog/cards/global_mmlu/ha/virology.json -> build/lib/unitxt/catalog/cards/global_mmlu/ha 2026-05-27T11:53:37,263 copying src/unitxt/catalog/cards/global_mmlu/ha/high_school_us_history.json -> build/lib/unitxt/catalog/cards/global_mmlu/ha 2026-05-27T11:53:37,266 copying src/unitxt/catalog/cards/global_mmlu/ha/high_school_statistics.json -> build/lib/unitxt/catalog/cards/global_mmlu/ha 2026-05-27T11:53:37,268 copying src/unitxt/catalog/cards/global_mmlu/ha/miscellaneous.json -> build/lib/unitxt/catalog/cards/global_mmlu/ha 2026-05-27T11:53:37,270 copying src/unitxt/catalog/cards/global_mmlu/ha/high_school_mathematics.json -> build/lib/unitxt/catalog/cards/global_mmlu/ha 2026-05-27T11:53:37,273 copying src/unitxt/catalog/cards/global_mmlu/ha/formal_logic.json -> build/lib/unitxt/catalog/cards/global_mmlu/ha 2026-05-27T11:53:37,275 copying src/unitxt/catalog/cards/global_mmlu/ha/high_school_chemistry.json -> build/lib/unitxt/catalog/cards/global_mmlu/ha 2026-05-27T11:53:37,277 copying src/unitxt/catalog/cards/global_mmlu/ha/abstract_algebra.json -> build/lib/unitxt/catalog/cards/global_mmlu/ha 2026-05-27T11:53:37,280 copying src/unitxt/catalog/cards/global_mmlu/ha/moral_scenarios.json -> build/lib/unitxt/catalog/cards/global_mmlu/ha 2026-05-27T11:53:37,282 copying src/unitxt/catalog/cards/global_mmlu/ha/world_religions.json -> build/lib/unitxt/catalog/cards/global_mmlu/ha 2026-05-27T11:53:37,285 copying src/unitxt/catalog/cards/global_mmlu/ha/business_ethics.json -> build/lib/unitxt/catalog/cards/global_mmlu/ha 2026-05-27T11:53:37,287 copying src/unitxt/catalog/cards/global_mmlu/ha/security_studies.json -> build/lib/unitxt/catalog/cards/global_mmlu/ha 2026-05-27T11:53:37,289 copying src/unitxt/catalog/cards/global_mmlu/ha/college_medicine.json -> build/lib/unitxt/catalog/cards/global_mmlu/ha 2026-05-27T11:53:37,292 copying src/unitxt/catalog/cards/global_mmlu/ha/human_sexuality.json -> build/lib/unitxt/catalog/cards/global_mmlu/ha 2026-05-27T11:53:37,294 copying src/unitxt/catalog/cards/global_mmlu/ha/prehistory.json -> build/lib/unitxt/catalog/cards/global_mmlu/ha 2026-05-27T11:53:37,297 creating build/lib/unitxt/catalog/cards/global_mmlu/es 2026-05-27T11:53:37,298 copying src/unitxt/catalog/cards/global_mmlu/es/moral_disputes.json -> build/lib/unitxt/catalog/cards/global_mmlu/es 2026-05-27T11:53:37,301 copying src/unitxt/catalog/cards/global_mmlu/es/high_school_biology.json -> build/lib/unitxt/catalog/cards/global_mmlu/es 2026-05-27T11:53:37,303 copying src/unitxt/catalog/cards/global_mmlu/es/jurisprudence.json -> build/lib/unitxt/catalog/cards/global_mmlu/es 2026-05-27T11:53:37,305 copying src/unitxt/catalog/cards/global_mmlu/es/logical_fallacies.json -> build/lib/unitxt/catalog/cards/global_mmlu/es 2026-05-27T11:53:37,307 copying src/unitxt/catalog/cards/global_mmlu/es/college_chemistry.json -> build/lib/unitxt/catalog/cards/global_mmlu/es 2026-05-27T11:53:37,310 copying src/unitxt/catalog/cards/global_mmlu/es/high_school_government_and_politics.json -> build/lib/unitxt/catalog/cards/global_mmlu/es 2026-05-27T11:53:37,312 copying src/unitxt/catalog/cards/global_mmlu/es/college_mathematics.json -> build/lib/unitxt/catalog/cards/global_mmlu/es 2026-05-27T11:53:37,314 copying src/unitxt/catalog/cards/global_mmlu/es/econometrics.json -> build/lib/unitxt/catalog/cards/global_mmlu/es 2026-05-27T11:53:37,317 copying src/unitxt/catalog/cards/global_mmlu/es/high_school_macroeconomics.json -> build/lib/unitxt/catalog/cards/global_mmlu/es 2026-05-27T11:53:37,319 copying src/unitxt/catalog/cards/global_mmlu/es/high_school_psychology.json -> build/lib/unitxt/catalog/cards/global_mmlu/es 2026-05-27T11:53:37,321 copying src/unitxt/catalog/cards/global_mmlu/es/computer_security.json -> build/lib/unitxt/catalog/cards/global_mmlu/es 2026-05-27T11:53:37,323 copying src/unitxt/catalog/cards/global_mmlu/es/sociology.json -> build/lib/unitxt/catalog/cards/global_mmlu/es 2026-05-27T11:53:37,326 copying src/unitxt/catalog/cards/global_mmlu/es/nutrition.json -> build/lib/unitxt/catalog/cards/global_mmlu/es 2026-05-27T11:53:37,328 copying src/unitxt/catalog/cards/global_mmlu/es/professional_medicine.json -> build/lib/unitxt/catalog/cards/global_mmlu/es 2026-05-27T11:53:37,330 copying src/unitxt/catalog/cards/global_mmlu/es/college_biology.json -> build/lib/unitxt/catalog/cards/global_mmlu/es 2026-05-27T11:53:37,333 copying src/unitxt/catalog/cards/global_mmlu/es/anatomy.json -> build/lib/unitxt/catalog/cards/global_mmlu/es 2026-05-27T11:53:37,335 copying src/unitxt/catalog/cards/global_mmlu/es/professional_law.json -> build/lib/unitxt/catalog/cards/global_mmlu/es 2026-05-27T11:53:37,338 copying src/unitxt/catalog/cards/global_mmlu/es/machine_learning.json -> build/lib/unitxt/catalog/cards/global_mmlu/es 2026-05-27T11:53:37,340 copying src/unitxt/catalog/cards/global_mmlu/es/international_law.json -> build/lib/unitxt/catalog/cards/global_mmlu/es 2026-05-27T11:53:37,342 copying src/unitxt/catalog/cards/global_mmlu/es/medical_genetics.json -> build/lib/unitxt/catalog/cards/global_mmlu/es 2026-05-27T11:53:37,344 copying src/unitxt/catalog/cards/global_mmlu/es/high_school_computer_science.json -> build/lib/unitxt/catalog/cards/global_mmlu/es 2026-05-27T11:53:37,347 copying src/unitxt/catalog/cards/global_mmlu/es/clinical_knowledge.json -> build/lib/unitxt/catalog/cards/global_mmlu/es 2026-05-27T11:53:37,349 copying src/unitxt/catalog/cards/global_mmlu/es/college_physics.json -> build/lib/unitxt/catalog/cards/global_mmlu/es 2026-05-27T11:53:37,351 copying src/unitxt/catalog/cards/global_mmlu/es/global_facts.json -> build/lib/unitxt/catalog/cards/global_mmlu/es 2026-05-27T11:53:37,354 copying src/unitxt/catalog/cards/global_mmlu/es/college_computer_science.json -> build/lib/unitxt/catalog/cards/global_mmlu/es 2026-05-27T11:53:37,356 copying src/unitxt/catalog/cards/global_mmlu/es/us_foreign_policy.json -> build/lib/unitxt/catalog/cards/global_mmlu/es 2026-05-27T11:53:37,359 copying src/unitxt/catalog/cards/global_mmlu/es/professional_accounting.json -> build/lib/unitxt/catalog/cards/global_mmlu/es 2026-05-27T11:53:37,361 copying src/unitxt/catalog/cards/global_mmlu/es/professional_psychology.json -> build/lib/unitxt/catalog/cards/global_mmlu/es 2026-05-27T11:53:37,363 copying src/unitxt/catalog/cards/global_mmlu/es/philosophy.json -> build/lib/unitxt/catalog/cards/global_mmlu/es 2026-05-27T11:53:37,366 copying src/unitxt/catalog/cards/global_mmlu/es/elementary_mathematics.json -> build/lib/unitxt/catalog/cards/global_mmlu/es 2026-05-27T11:53:37,368 copying src/unitxt/catalog/cards/global_mmlu/es/conceptual_physics.json -> build/lib/unitxt/catalog/cards/global_mmlu/es 2026-05-27T11:53:37,370 copying src/unitxt/catalog/cards/global_mmlu/es/high_school_geography.json -> build/lib/unitxt/catalog/cards/global_mmlu/es 2026-05-27T11:53:37,373 copying src/unitxt/catalog/cards/global_mmlu/es/human_aging.json -> build/lib/unitxt/catalog/cards/global_mmlu/es 2026-05-27T11:53:37,375 copying src/unitxt/catalog/cards/global_mmlu/es/electrical_engineering.json -> build/lib/unitxt/catalog/cards/global_mmlu/es 2026-05-27T11:53:37,377 copying src/unitxt/catalog/cards/global_mmlu/es/management.json -> build/lib/unitxt/catalog/cards/global_mmlu/es 2026-05-27T11:53:37,379 copying src/unitxt/catalog/cards/global_mmlu/es/high_school_world_history.json -> build/lib/unitxt/catalog/cards/global_mmlu/es 2026-05-27T11:53:37,382 copying src/unitxt/catalog/cards/global_mmlu/es/marketing.json -> build/lib/unitxt/catalog/cards/global_mmlu/es 2026-05-27T11:53:37,384 copying src/unitxt/catalog/cards/global_mmlu/es/high_school_european_history.json -> build/lib/unitxt/catalog/cards/global_mmlu/es 2026-05-27T11:53:37,387 copying src/unitxt/catalog/cards/global_mmlu/es/astronomy.json -> build/lib/unitxt/catalog/cards/global_mmlu/es 2026-05-27T11:53:37,389 copying src/unitxt/catalog/cards/global_mmlu/es/high_school_physics.json -> build/lib/unitxt/catalog/cards/global_mmlu/es 2026-05-27T11:53:37,391 copying src/unitxt/catalog/cards/global_mmlu/es/public_relations.json -> build/lib/unitxt/catalog/cards/global_mmlu/es 2026-05-27T11:53:37,394 copying src/unitxt/catalog/cards/global_mmlu/es/high_school_microeconomics.json -> build/lib/unitxt/catalog/cards/global_mmlu/es 2026-05-27T11:53:37,396 copying src/unitxt/catalog/cards/global_mmlu/es/virology.json -> build/lib/unitxt/catalog/cards/global_mmlu/es 2026-05-27T11:53:37,398 copying src/unitxt/catalog/cards/global_mmlu/es/high_school_us_history.json -> build/lib/unitxt/catalog/cards/global_mmlu/es 2026-05-27T11:53:37,401 copying src/unitxt/catalog/cards/global_mmlu/es/high_school_statistics.json -> build/lib/unitxt/catalog/cards/global_mmlu/es 2026-05-27T11:53:37,403 copying src/unitxt/catalog/cards/global_mmlu/es/miscellaneous.json -> build/lib/unitxt/catalog/cards/global_mmlu/es 2026-05-27T11:53:37,406 copying src/unitxt/catalog/cards/global_mmlu/es/high_school_mathematics.json -> build/lib/unitxt/catalog/cards/global_mmlu/es 2026-05-27T11:53:37,408 copying src/unitxt/catalog/cards/global_mmlu/es/formal_logic.json -> build/lib/unitxt/catalog/cards/global_mmlu/es 2026-05-27T11:53:37,410 copying src/unitxt/catalog/cards/global_mmlu/es/high_school_chemistry.json -> build/lib/unitxt/catalog/cards/global_mmlu/es 2026-05-27T11:53:37,413 copying src/unitxt/catalog/cards/global_mmlu/es/abstract_algebra.json -> build/lib/unitxt/catalog/cards/global_mmlu/es 2026-05-27T11:53:37,415 copying src/unitxt/catalog/cards/global_mmlu/es/moral_scenarios.json -> build/lib/unitxt/catalog/cards/global_mmlu/es 2026-05-27T11:53:37,418 copying src/unitxt/catalog/cards/global_mmlu/es/world_religions.json -> build/lib/unitxt/catalog/cards/global_mmlu/es 2026-05-27T11:53:37,420 copying src/unitxt/catalog/cards/global_mmlu/es/business_ethics.json -> build/lib/unitxt/catalog/cards/global_mmlu/es 2026-05-27T11:53:37,423 copying src/unitxt/catalog/cards/global_mmlu/es/security_studies.json -> build/lib/unitxt/catalog/cards/global_mmlu/es 2026-05-27T11:53:37,425 copying src/unitxt/catalog/cards/global_mmlu/es/college_medicine.json -> build/lib/unitxt/catalog/cards/global_mmlu/es 2026-05-27T11:53:37,428 copying src/unitxt/catalog/cards/global_mmlu/es/human_sexuality.json -> build/lib/unitxt/catalog/cards/global_mmlu/es 2026-05-27T11:53:37,430 copying src/unitxt/catalog/cards/global_mmlu/es/prehistory.json -> build/lib/unitxt/catalog/cards/global_mmlu/es 2026-05-27T11:53:37,432 creating build/lib/unitxt/catalog/cards/global_mmlu/fa 2026-05-27T11:53:37,433 copying src/unitxt/catalog/cards/global_mmlu/fa/moral_disputes.json -> build/lib/unitxt/catalog/cards/global_mmlu/fa 2026-05-27T11:53:37,436 copying src/unitxt/catalog/cards/global_mmlu/fa/high_school_biology.json -> build/lib/unitxt/catalog/cards/global_mmlu/fa 2026-05-27T11:53:37,439 copying src/unitxt/catalog/cards/global_mmlu/fa/jurisprudence.json -> build/lib/unitxt/catalog/cards/global_mmlu/fa 2026-05-27T11:53:37,441 copying src/unitxt/catalog/cards/global_mmlu/fa/logical_fallacies.json -> build/lib/unitxt/catalog/cards/global_mmlu/fa 2026-05-27T11:53:37,443 copying src/unitxt/catalog/cards/global_mmlu/fa/college_chemistry.json -> build/lib/unitxt/catalog/cards/global_mmlu/fa 2026-05-27T11:53:37,446 copying src/unitxt/catalog/cards/global_mmlu/fa/high_school_government_and_politics.json -> build/lib/unitxt/catalog/cards/global_mmlu/fa 2026-05-27T11:53:37,448 copying src/unitxt/catalog/cards/global_mmlu/fa/college_mathematics.json -> build/lib/unitxt/catalog/cards/global_mmlu/fa 2026-05-27T11:53:37,450 copying src/unitxt/catalog/cards/global_mmlu/fa/econometrics.json -> build/lib/unitxt/catalog/cards/global_mmlu/fa 2026-05-27T11:53:37,453 copying src/unitxt/catalog/cards/global_mmlu/fa/high_school_macroeconomics.json -> build/lib/unitxt/catalog/cards/global_mmlu/fa 2026-05-27T11:53:37,455 copying src/unitxt/catalog/cards/global_mmlu/fa/high_school_psychology.json -> build/lib/unitxt/catalog/cards/global_mmlu/fa 2026-05-27T11:53:37,457 copying src/unitxt/catalog/cards/global_mmlu/fa/computer_security.json -> build/lib/unitxt/catalog/cards/global_mmlu/fa 2026-05-27T11:53:37,460 copying src/unitxt/catalog/cards/global_mmlu/fa/sociology.json -> build/lib/unitxt/catalog/cards/global_mmlu/fa 2026-05-27T11:53:37,462 copying src/unitxt/catalog/cards/global_mmlu/fa/nutrition.json -> build/lib/unitxt/catalog/cards/global_mmlu/fa 2026-05-27T11:53:37,465 copying src/unitxt/catalog/cards/global_mmlu/fa/professional_medicine.json -> build/lib/unitxt/catalog/cards/global_mmlu/fa 2026-05-27T11:53:37,467 copying src/unitxt/catalog/cards/global_mmlu/fa/college_biology.json -> build/lib/unitxt/catalog/cards/global_mmlu/fa 2026-05-27T11:53:37,470 copying src/unitxt/catalog/cards/global_mmlu/fa/anatomy.json -> build/lib/unitxt/catalog/cards/global_mmlu/fa 2026-05-27T11:53:37,472 copying src/unitxt/catalog/cards/global_mmlu/fa/professional_law.json -> build/lib/unitxt/catalog/cards/global_mmlu/fa 2026-05-27T11:53:37,474 copying src/unitxt/catalog/cards/global_mmlu/fa/machine_learning.json -> build/lib/unitxt/catalog/cards/global_mmlu/fa 2026-05-27T11:53:37,477 copying src/unitxt/catalog/cards/global_mmlu/fa/international_law.json -> build/lib/unitxt/catalog/cards/global_mmlu/fa 2026-05-27T11:53:37,479 copying src/unitxt/catalog/cards/global_mmlu/fa/medical_genetics.json -> build/lib/unitxt/catalog/cards/global_mmlu/fa 2026-05-27T11:53:37,482 copying src/unitxt/catalog/cards/global_mmlu/fa/high_school_computer_science.json -> build/lib/unitxt/catalog/cards/global_mmlu/fa 2026-05-27T11:53:37,484 copying src/unitxt/catalog/cards/global_mmlu/fa/clinical_knowledge.json -> build/lib/unitxt/catalog/cards/global_mmlu/fa 2026-05-27T11:53:37,486 copying src/unitxt/catalog/cards/global_mmlu/fa/college_physics.json -> build/lib/unitxt/catalog/cards/global_mmlu/fa 2026-05-27T11:53:37,489 copying src/unitxt/catalog/cards/global_mmlu/fa/global_facts.json -> build/lib/unitxt/catalog/cards/global_mmlu/fa 2026-05-27T11:53:37,491 copying src/unitxt/catalog/cards/global_mmlu/fa/college_computer_science.json -> build/lib/unitxt/catalog/cards/global_mmlu/fa 2026-05-27T11:53:37,494 copying src/unitxt/catalog/cards/global_mmlu/fa/us_foreign_policy.json -> build/lib/unitxt/catalog/cards/global_mmlu/fa 2026-05-27T11:53:37,496 copying src/unitxt/catalog/cards/global_mmlu/fa/professional_accounting.json -> build/lib/unitxt/catalog/cards/global_mmlu/fa 2026-05-27T11:53:37,499 copying src/unitxt/catalog/cards/global_mmlu/fa/professional_psychology.json -> build/lib/unitxt/catalog/cards/global_mmlu/fa 2026-05-27T11:53:37,501 copying src/unitxt/catalog/cards/global_mmlu/fa/philosophy.json -> build/lib/unitxt/catalog/cards/global_mmlu/fa 2026-05-27T11:53:37,504 copying src/unitxt/catalog/cards/global_mmlu/fa/elementary_mathematics.json -> build/lib/unitxt/catalog/cards/global_mmlu/fa 2026-05-27T11:53:37,506 copying src/unitxt/catalog/cards/global_mmlu/fa/conceptual_physics.json -> build/lib/unitxt/catalog/cards/global_mmlu/fa 2026-05-27T11:53:37,508 copying src/unitxt/catalog/cards/global_mmlu/fa/high_school_geography.json -> build/lib/unitxt/catalog/cards/global_mmlu/fa 2026-05-27T11:53:37,511 copying src/unitxt/catalog/cards/global_mmlu/fa/human_aging.json -> build/lib/unitxt/catalog/cards/global_mmlu/fa 2026-05-27T11:53:37,513 copying src/unitxt/catalog/cards/global_mmlu/fa/electrical_engineering.json -> build/lib/unitxt/catalog/cards/global_mmlu/fa 2026-05-27T11:53:37,515 copying src/unitxt/catalog/cards/global_mmlu/fa/management.json -> build/lib/unitxt/catalog/cards/global_mmlu/fa 2026-05-27T11:53:37,518 copying src/unitxt/catalog/cards/global_mmlu/fa/high_school_world_history.json -> build/lib/unitxt/catalog/cards/global_mmlu/fa 2026-05-27T11:53:37,520 copying src/unitxt/catalog/cards/global_mmlu/fa/marketing.json -> build/lib/unitxt/catalog/cards/global_mmlu/fa 2026-05-27T11:53:37,523 copying src/unitxt/catalog/cards/global_mmlu/fa/high_school_european_history.json -> build/lib/unitxt/catalog/cards/global_mmlu/fa 2026-05-27T11:53:37,525 copying src/unitxt/catalog/cards/global_mmlu/fa/astronomy.json -> build/lib/unitxt/catalog/cards/global_mmlu/fa 2026-05-27T11:53:37,527 copying src/unitxt/catalog/cards/global_mmlu/fa/high_school_physics.json -> build/lib/unitxt/catalog/cards/global_mmlu/fa 2026-05-27T11:53:37,530 copying src/unitxt/catalog/cards/global_mmlu/fa/public_relations.json -> build/lib/unitxt/catalog/cards/global_mmlu/fa 2026-05-27T11:53:37,532 copying src/unitxt/catalog/cards/global_mmlu/fa/high_school_microeconomics.json -> build/lib/unitxt/catalog/cards/global_mmlu/fa 2026-05-27T11:53:37,535 copying src/unitxt/catalog/cards/global_mmlu/fa/virology.json -> build/lib/unitxt/catalog/cards/global_mmlu/fa 2026-05-27T11:53:37,537 copying src/unitxt/catalog/cards/global_mmlu/fa/high_school_us_history.json -> build/lib/unitxt/catalog/cards/global_mmlu/fa 2026-05-27T11:53:37,540 copying src/unitxt/catalog/cards/global_mmlu/fa/high_school_statistics.json -> build/lib/unitxt/catalog/cards/global_mmlu/fa 2026-05-27T11:53:37,542 copying src/unitxt/catalog/cards/global_mmlu/fa/miscellaneous.json -> build/lib/unitxt/catalog/cards/global_mmlu/fa 2026-05-27T11:53:37,544 copying src/unitxt/catalog/cards/global_mmlu/fa/high_school_mathematics.json -> build/lib/unitxt/catalog/cards/global_mmlu/fa 2026-05-27T11:53:37,547 copying src/unitxt/catalog/cards/global_mmlu/fa/formal_logic.json -> build/lib/unitxt/catalog/cards/global_mmlu/fa 2026-05-27T11:53:37,549 copying src/unitxt/catalog/cards/global_mmlu/fa/high_school_chemistry.json -> build/lib/unitxt/catalog/cards/global_mmlu/fa 2026-05-27T11:53:37,552 copying src/unitxt/catalog/cards/global_mmlu/fa/abstract_algebra.json -> build/lib/unitxt/catalog/cards/global_mmlu/fa 2026-05-27T11:53:37,554 copying src/unitxt/catalog/cards/global_mmlu/fa/moral_scenarios.json -> build/lib/unitxt/catalog/cards/global_mmlu/fa 2026-05-27T11:53:37,556 copying src/unitxt/catalog/cards/global_mmlu/fa/world_religions.json -> build/lib/unitxt/catalog/cards/global_mmlu/fa 2026-05-27T11:53:37,559 copying src/unitxt/catalog/cards/global_mmlu/fa/business_ethics.json -> build/lib/unitxt/catalog/cards/global_mmlu/fa 2026-05-27T11:53:37,562 copying src/unitxt/catalog/cards/global_mmlu/fa/security_studies.json -> build/lib/unitxt/catalog/cards/global_mmlu/fa 2026-05-27T11:53:37,564 copying src/unitxt/catalog/cards/global_mmlu/fa/college_medicine.json -> build/lib/unitxt/catalog/cards/global_mmlu/fa 2026-05-27T11:53:37,566 copying src/unitxt/catalog/cards/global_mmlu/fa/human_sexuality.json -> build/lib/unitxt/catalog/cards/global_mmlu/fa 2026-05-27T11:53:37,569 copying src/unitxt/catalog/cards/global_mmlu/fa/prehistory.json -> build/lib/unitxt/catalog/cards/global_mmlu/fa 2026-05-27T11:53:37,571 creating build/lib/unitxt/catalog/cards/global_mmlu/ru 2026-05-27T11:53:37,572 copying src/unitxt/catalog/cards/global_mmlu/ru/moral_disputes.json -> build/lib/unitxt/catalog/cards/global_mmlu/ru 2026-05-27T11:53:37,574 copying src/unitxt/catalog/cards/global_mmlu/ru/high_school_biology.json -> build/lib/unitxt/catalog/cards/global_mmlu/ru 2026-05-27T11:53:37,577 copying src/unitxt/catalog/cards/global_mmlu/ru/jurisprudence.json -> build/lib/unitxt/catalog/cards/global_mmlu/ru 2026-05-27T11:53:37,579 copying src/unitxt/catalog/cards/global_mmlu/ru/logical_fallacies.json -> build/lib/unitxt/catalog/cards/global_mmlu/ru 2026-05-27T11:53:37,581 copying src/unitxt/catalog/cards/global_mmlu/ru/college_chemistry.json -> build/lib/unitxt/catalog/cards/global_mmlu/ru 2026-05-27T11:53:37,584 copying src/unitxt/catalog/cards/global_mmlu/ru/high_school_government_and_politics.json -> build/lib/unitxt/catalog/cards/global_mmlu/ru 2026-05-27T11:53:37,586 copying src/unitxt/catalog/cards/global_mmlu/ru/college_mathematics.json -> build/lib/unitxt/catalog/cards/global_mmlu/ru 2026-05-27T11:53:37,588 copying src/unitxt/catalog/cards/global_mmlu/ru/econometrics.json -> build/lib/unitxt/catalog/cards/global_mmlu/ru 2026-05-27T11:53:37,591 copying src/unitxt/catalog/cards/global_mmlu/ru/high_school_macroeconomics.json -> build/lib/unitxt/catalog/cards/global_mmlu/ru 2026-05-27T11:53:37,593 copying src/unitxt/catalog/cards/global_mmlu/ru/high_school_psychology.json -> build/lib/unitxt/catalog/cards/global_mmlu/ru 2026-05-27T11:53:37,595 copying src/unitxt/catalog/cards/global_mmlu/ru/computer_security.json -> build/lib/unitxt/catalog/cards/global_mmlu/ru 2026-05-27T11:53:37,597 copying src/unitxt/catalog/cards/global_mmlu/ru/sociology.json -> build/lib/unitxt/catalog/cards/global_mmlu/ru 2026-05-27T11:53:37,600 copying src/unitxt/catalog/cards/global_mmlu/ru/nutrition.json -> build/lib/unitxt/catalog/cards/global_mmlu/ru 2026-05-27T11:53:37,602 copying src/unitxt/catalog/cards/global_mmlu/ru/professional_medicine.json -> build/lib/unitxt/catalog/cards/global_mmlu/ru 2026-05-27T11:53:37,605 copying src/unitxt/catalog/cards/global_mmlu/ru/college_biology.json -> build/lib/unitxt/catalog/cards/global_mmlu/ru 2026-05-27T11:53:37,607 copying src/unitxt/catalog/cards/global_mmlu/ru/anatomy.json -> build/lib/unitxt/catalog/cards/global_mmlu/ru 2026-05-27T11:53:37,609 copying src/unitxt/catalog/cards/global_mmlu/ru/professional_law.json -> build/lib/unitxt/catalog/cards/global_mmlu/ru 2026-05-27T11:53:37,612 copying src/unitxt/catalog/cards/global_mmlu/ru/machine_learning.json -> build/lib/unitxt/catalog/cards/global_mmlu/ru 2026-05-27T11:53:37,614 copying src/unitxt/catalog/cards/global_mmlu/ru/international_law.json -> build/lib/unitxt/catalog/cards/global_mmlu/ru 2026-05-27T11:53:37,616 copying src/unitxt/catalog/cards/global_mmlu/ru/medical_genetics.json -> build/lib/unitxt/catalog/cards/global_mmlu/ru 2026-05-27T11:53:37,619 copying src/unitxt/catalog/cards/global_mmlu/ru/high_school_computer_science.json -> build/lib/unitxt/catalog/cards/global_mmlu/ru 2026-05-27T11:53:37,621 copying src/unitxt/catalog/cards/global_mmlu/ru/clinical_knowledge.json -> build/lib/unitxt/catalog/cards/global_mmlu/ru 2026-05-27T11:53:37,623 copying src/unitxt/catalog/cards/global_mmlu/ru/college_physics.json -> build/lib/unitxt/catalog/cards/global_mmlu/ru 2026-05-27T11:53:37,626 copying src/unitxt/catalog/cards/global_mmlu/ru/global_facts.json -> build/lib/unitxt/catalog/cards/global_mmlu/ru 2026-05-27T11:53:37,628 copying src/unitxt/catalog/cards/global_mmlu/ru/college_computer_science.json -> build/lib/unitxt/catalog/cards/global_mmlu/ru 2026-05-27T11:53:37,630 copying src/unitxt/catalog/cards/global_mmlu/ru/us_foreign_policy.json -> build/lib/unitxt/catalog/cards/global_mmlu/ru 2026-05-27T11:53:37,633 copying src/unitxt/catalog/cards/global_mmlu/ru/professional_accounting.json -> build/lib/unitxt/catalog/cards/global_mmlu/ru 2026-05-27T11:53:37,635 copying src/unitxt/catalog/cards/global_mmlu/ru/professional_psychology.json -> build/lib/unitxt/catalog/cards/global_mmlu/ru 2026-05-27T11:53:37,637 copying src/unitxt/catalog/cards/global_mmlu/ru/philosophy.json -> build/lib/unitxt/catalog/cards/global_mmlu/ru 2026-05-27T11:53:37,639 copying src/unitxt/catalog/cards/global_mmlu/ru/elementary_mathematics.json -> build/lib/unitxt/catalog/cards/global_mmlu/ru 2026-05-27T11:53:37,642 copying src/unitxt/catalog/cards/global_mmlu/ru/conceptual_physics.json -> build/lib/unitxt/catalog/cards/global_mmlu/ru 2026-05-27T11:53:37,644 copying src/unitxt/catalog/cards/global_mmlu/ru/high_school_geography.json -> build/lib/unitxt/catalog/cards/global_mmlu/ru 2026-05-27T11:53:37,646 copying src/unitxt/catalog/cards/global_mmlu/ru/human_aging.json -> build/lib/unitxt/catalog/cards/global_mmlu/ru 2026-05-27T11:53:37,649 copying src/unitxt/catalog/cards/global_mmlu/ru/electrical_engineering.json -> build/lib/unitxt/catalog/cards/global_mmlu/ru 2026-05-27T11:53:37,651 copying src/unitxt/catalog/cards/global_mmlu/ru/management.json -> build/lib/unitxt/catalog/cards/global_mmlu/ru 2026-05-27T11:53:37,653 copying src/unitxt/catalog/cards/global_mmlu/ru/high_school_world_history.json -> build/lib/unitxt/catalog/cards/global_mmlu/ru 2026-05-27T11:53:37,655 copying src/unitxt/catalog/cards/global_mmlu/ru/marketing.json -> build/lib/unitxt/catalog/cards/global_mmlu/ru 2026-05-27T11:53:37,657 copying src/unitxt/catalog/cards/global_mmlu/ru/high_school_european_history.json -> build/lib/unitxt/catalog/cards/global_mmlu/ru 2026-05-27T11:53:37,660 copying src/unitxt/catalog/cards/global_mmlu/ru/astronomy.json -> build/lib/unitxt/catalog/cards/global_mmlu/ru 2026-05-27T11:53:37,662 copying src/unitxt/catalog/cards/global_mmlu/ru/high_school_physics.json -> build/lib/unitxt/catalog/cards/global_mmlu/ru 2026-05-27T11:53:37,664 copying src/unitxt/catalog/cards/global_mmlu/ru/public_relations.json -> build/lib/unitxt/catalog/cards/global_mmlu/ru 2026-05-27T11:53:37,667 copying src/unitxt/catalog/cards/global_mmlu/ru/high_school_microeconomics.json -> build/lib/unitxt/catalog/cards/global_mmlu/ru 2026-05-27T11:53:37,669 copying src/unitxt/catalog/cards/global_mmlu/ru/virology.json -> build/lib/unitxt/catalog/cards/global_mmlu/ru 2026-05-27T11:53:37,671 copying src/unitxt/catalog/cards/global_mmlu/ru/high_school_us_history.json -> build/lib/unitxt/catalog/cards/global_mmlu/ru 2026-05-27T11:53:37,674 copying src/unitxt/catalog/cards/global_mmlu/ru/high_school_statistics.json -> build/lib/unitxt/catalog/cards/global_mmlu/ru 2026-05-27T11:53:37,676 copying src/unitxt/catalog/cards/global_mmlu/ru/miscellaneous.json -> build/lib/unitxt/catalog/cards/global_mmlu/ru 2026-05-27T11:53:37,678 copying src/unitxt/catalog/cards/global_mmlu/ru/high_school_mathematics.json -> build/lib/unitxt/catalog/cards/global_mmlu/ru 2026-05-27T11:53:37,681 copying src/unitxt/catalog/cards/global_mmlu/ru/formal_logic.json -> build/lib/unitxt/catalog/cards/global_mmlu/ru 2026-05-27T11:53:37,683 copying src/unitxt/catalog/cards/global_mmlu/ru/high_school_chemistry.json -> build/lib/unitxt/catalog/cards/global_mmlu/ru 2026-05-27T11:53:37,686 copying src/unitxt/catalog/cards/global_mmlu/ru/abstract_algebra.json -> build/lib/unitxt/catalog/cards/global_mmlu/ru 2026-05-27T11:53:37,688 copying src/unitxt/catalog/cards/global_mmlu/ru/moral_scenarios.json -> build/lib/unitxt/catalog/cards/global_mmlu/ru 2026-05-27T11:53:37,691 copying src/unitxt/catalog/cards/global_mmlu/ru/world_religions.json -> build/lib/unitxt/catalog/cards/global_mmlu/ru 2026-05-27T11:53:37,693 copying src/unitxt/catalog/cards/global_mmlu/ru/business_ethics.json -> build/lib/unitxt/catalog/cards/global_mmlu/ru 2026-05-27T11:53:37,695 copying src/unitxt/catalog/cards/global_mmlu/ru/security_studies.json -> build/lib/unitxt/catalog/cards/global_mmlu/ru 2026-05-27T11:53:37,698 copying src/unitxt/catalog/cards/global_mmlu/ru/college_medicine.json -> build/lib/unitxt/catalog/cards/global_mmlu/ru 2026-05-27T11:53:37,700 copying src/unitxt/catalog/cards/global_mmlu/ru/human_sexuality.json -> build/lib/unitxt/catalog/cards/global_mmlu/ru 2026-05-27T11:53:37,703 copying src/unitxt/catalog/cards/global_mmlu/ru/prehistory.json -> build/lib/unitxt/catalog/cards/global_mmlu/ru 2026-05-27T11:53:37,705 creating build/lib/unitxt/catalog/cards/global_mmlu/pl 2026-05-27T11:53:37,706 copying src/unitxt/catalog/cards/global_mmlu/pl/moral_disputes.json -> build/lib/unitxt/catalog/cards/global_mmlu/pl 2026-05-27T11:53:37,708 copying src/unitxt/catalog/cards/global_mmlu/pl/high_school_biology.json -> build/lib/unitxt/catalog/cards/global_mmlu/pl 2026-05-27T11:53:37,711 copying src/unitxt/catalog/cards/global_mmlu/pl/jurisprudence.json -> build/lib/unitxt/catalog/cards/global_mmlu/pl 2026-05-27T11:53:37,713 copying src/unitxt/catalog/cards/global_mmlu/pl/logical_fallacies.json -> build/lib/unitxt/catalog/cards/global_mmlu/pl 2026-05-27T11:53:37,715 copying src/unitxt/catalog/cards/global_mmlu/pl/college_chemistry.json -> build/lib/unitxt/catalog/cards/global_mmlu/pl 2026-05-27T11:53:37,718 copying src/unitxt/catalog/cards/global_mmlu/pl/high_school_government_and_politics.json -> build/lib/unitxt/catalog/cards/global_mmlu/pl 2026-05-27T11:53:37,720 copying src/unitxt/catalog/cards/global_mmlu/pl/college_mathematics.json -> build/lib/unitxt/catalog/cards/global_mmlu/pl 2026-05-27T11:53:37,722 copying src/unitxt/catalog/cards/global_mmlu/pl/econometrics.json -> build/lib/unitxt/catalog/cards/global_mmlu/pl 2026-05-27T11:53:37,724 copying src/unitxt/catalog/cards/global_mmlu/pl/high_school_macroeconomics.json -> build/lib/unitxt/catalog/cards/global_mmlu/pl 2026-05-27T11:53:37,727 copying src/unitxt/catalog/cards/global_mmlu/pl/high_school_psychology.json -> build/lib/unitxt/catalog/cards/global_mmlu/pl 2026-05-27T11:53:37,729 copying src/unitxt/catalog/cards/global_mmlu/pl/computer_security.json -> build/lib/unitxt/catalog/cards/global_mmlu/pl 2026-05-27T11:53:37,732 copying src/unitxt/catalog/cards/global_mmlu/pl/sociology.json -> build/lib/unitxt/catalog/cards/global_mmlu/pl 2026-05-27T11:53:37,734 copying src/unitxt/catalog/cards/global_mmlu/pl/nutrition.json -> build/lib/unitxt/catalog/cards/global_mmlu/pl 2026-05-27T11:53:37,736 copying src/unitxt/catalog/cards/global_mmlu/pl/professional_medicine.json -> build/lib/unitxt/catalog/cards/global_mmlu/pl 2026-05-27T11:53:37,739 copying src/unitxt/catalog/cards/global_mmlu/pl/college_biology.json -> build/lib/unitxt/catalog/cards/global_mmlu/pl 2026-05-27T11:53:37,741 copying src/unitxt/catalog/cards/global_mmlu/pl/anatomy.json -> build/lib/unitxt/catalog/cards/global_mmlu/pl 2026-05-27T11:53:37,743 copying src/unitxt/catalog/cards/global_mmlu/pl/professional_law.json -> build/lib/unitxt/catalog/cards/global_mmlu/pl 2026-05-27T11:53:37,746 copying src/unitxt/catalog/cards/global_mmlu/pl/machine_learning.json -> build/lib/unitxt/catalog/cards/global_mmlu/pl 2026-05-27T11:53:37,748 copying src/unitxt/catalog/cards/global_mmlu/pl/international_law.json -> build/lib/unitxt/catalog/cards/global_mmlu/pl 2026-05-27T11:53:37,750 copying src/unitxt/catalog/cards/global_mmlu/pl/medical_genetics.json -> build/lib/unitxt/catalog/cards/global_mmlu/pl 2026-05-27T11:53:37,752 copying src/unitxt/catalog/cards/global_mmlu/pl/high_school_computer_science.json -> build/lib/unitxt/catalog/cards/global_mmlu/pl 2026-05-27T11:53:37,754 copying src/unitxt/catalog/cards/global_mmlu/pl/clinical_knowledge.json -> build/lib/unitxt/catalog/cards/global_mmlu/pl 2026-05-27T11:53:37,757 copying src/unitxt/catalog/cards/global_mmlu/pl/college_physics.json -> build/lib/unitxt/catalog/cards/global_mmlu/pl 2026-05-27T11:53:37,759 copying src/unitxt/catalog/cards/global_mmlu/pl/global_facts.json -> build/lib/unitxt/catalog/cards/global_mmlu/pl 2026-05-27T11:53:37,761 copying src/unitxt/catalog/cards/global_mmlu/pl/college_computer_science.json -> build/lib/unitxt/catalog/cards/global_mmlu/pl 2026-05-27T11:53:37,764 copying src/unitxt/catalog/cards/global_mmlu/pl/us_foreign_policy.json -> build/lib/unitxt/catalog/cards/global_mmlu/pl 2026-05-27T11:53:37,766 copying src/unitxt/catalog/cards/global_mmlu/pl/professional_accounting.json -> build/lib/unitxt/catalog/cards/global_mmlu/pl 2026-05-27T11:53:37,768 copying src/unitxt/catalog/cards/global_mmlu/pl/professional_psychology.json -> build/lib/unitxt/catalog/cards/global_mmlu/pl 2026-05-27T11:53:37,770 copying src/unitxt/catalog/cards/global_mmlu/pl/philosophy.json -> build/lib/unitxt/catalog/cards/global_mmlu/pl 2026-05-27T11:53:37,772 copying src/unitxt/catalog/cards/global_mmlu/pl/elementary_mathematics.json -> build/lib/unitxt/catalog/cards/global_mmlu/pl 2026-05-27T11:53:37,775 copying src/unitxt/catalog/cards/global_mmlu/pl/conceptual_physics.json -> build/lib/unitxt/catalog/cards/global_mmlu/pl 2026-05-27T11:53:37,777 copying src/unitxt/catalog/cards/global_mmlu/pl/high_school_geography.json -> build/lib/unitxt/catalog/cards/global_mmlu/pl 2026-05-27T11:53:37,779 copying src/unitxt/catalog/cards/global_mmlu/pl/human_aging.json -> build/lib/unitxt/catalog/cards/global_mmlu/pl 2026-05-27T11:53:37,781 copying src/unitxt/catalog/cards/global_mmlu/pl/electrical_engineering.json -> build/lib/unitxt/catalog/cards/global_mmlu/pl 2026-05-27T11:53:37,784 copying src/unitxt/catalog/cards/global_mmlu/pl/management.json -> build/lib/unitxt/catalog/cards/global_mmlu/pl 2026-05-27T11:53:37,786 copying src/unitxt/catalog/cards/global_mmlu/pl/high_school_world_history.json -> build/lib/unitxt/catalog/cards/global_mmlu/pl 2026-05-27T11:53:37,788 copying src/unitxt/catalog/cards/global_mmlu/pl/marketing.json -> build/lib/unitxt/catalog/cards/global_mmlu/pl 2026-05-27T11:53:37,791 copying src/unitxt/catalog/cards/global_mmlu/pl/high_school_european_history.json -> build/lib/unitxt/catalog/cards/global_mmlu/pl 2026-05-27T11:53:37,793 copying src/unitxt/catalog/cards/global_mmlu/pl/astronomy.json -> build/lib/unitxt/catalog/cards/global_mmlu/pl 2026-05-27T11:53:37,795 copying src/unitxt/catalog/cards/global_mmlu/pl/high_school_physics.json -> build/lib/unitxt/catalog/cards/global_mmlu/pl 2026-05-27T11:53:37,798 copying src/unitxt/catalog/cards/global_mmlu/pl/public_relations.json -> build/lib/unitxt/catalog/cards/global_mmlu/pl 2026-05-27T11:53:37,800 copying src/unitxt/catalog/cards/global_mmlu/pl/high_school_microeconomics.json -> build/lib/unitxt/catalog/cards/global_mmlu/pl 2026-05-27T11:53:37,803 copying src/unitxt/catalog/cards/global_mmlu/pl/virology.json -> build/lib/unitxt/catalog/cards/global_mmlu/pl 2026-05-27T11:53:37,805 copying src/unitxt/catalog/cards/global_mmlu/pl/high_school_us_history.json -> build/lib/unitxt/catalog/cards/global_mmlu/pl 2026-05-27T11:53:37,808 copying src/unitxt/catalog/cards/global_mmlu/pl/high_school_statistics.json -> build/lib/unitxt/catalog/cards/global_mmlu/pl 2026-05-27T11:53:37,810 copying src/unitxt/catalog/cards/global_mmlu/pl/miscellaneous.json -> build/lib/unitxt/catalog/cards/global_mmlu/pl 2026-05-27T11:53:37,812 copying src/unitxt/catalog/cards/global_mmlu/pl/high_school_mathematics.json -> build/lib/unitxt/catalog/cards/global_mmlu/pl 2026-05-27T11:53:37,815 copying src/unitxt/catalog/cards/global_mmlu/pl/formal_logic.json -> build/lib/unitxt/catalog/cards/global_mmlu/pl 2026-05-27T11:53:37,817 copying src/unitxt/catalog/cards/global_mmlu/pl/high_school_chemistry.json -> build/lib/unitxt/catalog/cards/global_mmlu/pl 2026-05-27T11:53:37,819 copying src/unitxt/catalog/cards/global_mmlu/pl/abstract_algebra.json -> build/lib/unitxt/catalog/cards/global_mmlu/pl 2026-05-27T11:53:37,822 copying src/unitxt/catalog/cards/global_mmlu/pl/moral_scenarios.json -> build/lib/unitxt/catalog/cards/global_mmlu/pl 2026-05-27T11:53:37,824 copying src/unitxt/catalog/cards/global_mmlu/pl/world_religions.json -> build/lib/unitxt/catalog/cards/global_mmlu/pl 2026-05-27T11:53:37,826 copying src/unitxt/catalog/cards/global_mmlu/pl/business_ethics.json -> build/lib/unitxt/catalog/cards/global_mmlu/pl 2026-05-27T11:53:37,829 copying src/unitxt/catalog/cards/global_mmlu/pl/security_studies.json -> build/lib/unitxt/catalog/cards/global_mmlu/pl 2026-05-27T11:53:37,831 copying src/unitxt/catalog/cards/global_mmlu/pl/college_medicine.json -> build/lib/unitxt/catalog/cards/global_mmlu/pl 2026-05-27T11:53:37,833 copying src/unitxt/catalog/cards/global_mmlu/pl/human_sexuality.json -> build/lib/unitxt/catalog/cards/global_mmlu/pl 2026-05-27T11:53:37,836 copying src/unitxt/catalog/cards/global_mmlu/pl/prehistory.json -> build/lib/unitxt/catalog/cards/global_mmlu/pl 2026-05-27T11:53:37,838 creating build/lib/unitxt/catalog/cards/global_mmlu/am 2026-05-27T11:53:37,839 copying src/unitxt/catalog/cards/global_mmlu/am/moral_disputes.json -> build/lib/unitxt/catalog/cards/global_mmlu/am 2026-05-27T11:53:37,841 copying src/unitxt/catalog/cards/global_mmlu/am/high_school_biology.json -> build/lib/unitxt/catalog/cards/global_mmlu/am 2026-05-27T11:53:37,844 copying src/unitxt/catalog/cards/global_mmlu/am/jurisprudence.json -> build/lib/unitxt/catalog/cards/global_mmlu/am 2026-05-27T11:53:37,846 copying src/unitxt/catalog/cards/global_mmlu/am/logical_fallacies.json -> build/lib/unitxt/catalog/cards/global_mmlu/am 2026-05-27T11:53:37,848 copying src/unitxt/catalog/cards/global_mmlu/am/college_chemistry.json -> build/lib/unitxt/catalog/cards/global_mmlu/am 2026-05-27T11:53:37,851 copying src/unitxt/catalog/cards/global_mmlu/am/high_school_government_and_politics.json -> build/lib/unitxt/catalog/cards/global_mmlu/am 2026-05-27T11:53:37,853 copying src/unitxt/catalog/cards/global_mmlu/am/college_mathematics.json -> build/lib/unitxt/catalog/cards/global_mmlu/am 2026-05-27T11:53:37,855 copying src/unitxt/catalog/cards/global_mmlu/am/econometrics.json -> build/lib/unitxt/catalog/cards/global_mmlu/am 2026-05-27T11:53:37,858 copying src/unitxt/catalog/cards/global_mmlu/am/high_school_macroeconomics.json -> build/lib/unitxt/catalog/cards/global_mmlu/am 2026-05-27T11:53:37,860 copying src/unitxt/catalog/cards/global_mmlu/am/high_school_psychology.json -> build/lib/unitxt/catalog/cards/global_mmlu/am 2026-05-27T11:53:37,863 copying src/unitxt/catalog/cards/global_mmlu/am/computer_security.json -> build/lib/unitxt/catalog/cards/global_mmlu/am 2026-05-27T11:53:37,865 copying src/unitxt/catalog/cards/global_mmlu/am/sociology.json -> build/lib/unitxt/catalog/cards/global_mmlu/am 2026-05-27T11:53:37,867 copying src/unitxt/catalog/cards/global_mmlu/am/nutrition.json -> build/lib/unitxt/catalog/cards/global_mmlu/am 2026-05-27T11:53:37,870 copying src/unitxt/catalog/cards/global_mmlu/am/professional_medicine.json -> build/lib/unitxt/catalog/cards/global_mmlu/am 2026-05-27T11:53:37,872 copying src/unitxt/catalog/cards/global_mmlu/am/college_biology.json -> build/lib/unitxt/catalog/cards/global_mmlu/am 2026-05-27T11:53:37,875 copying src/unitxt/catalog/cards/global_mmlu/am/anatomy.json -> build/lib/unitxt/catalog/cards/global_mmlu/am 2026-05-27T11:53:37,877 copying src/unitxt/catalog/cards/global_mmlu/am/professional_law.json -> build/lib/unitxt/catalog/cards/global_mmlu/am 2026-05-27T11:53:37,879 copying src/unitxt/catalog/cards/global_mmlu/am/machine_learning.json -> build/lib/unitxt/catalog/cards/global_mmlu/am 2026-05-27T11:53:37,882 copying src/unitxt/catalog/cards/global_mmlu/am/international_law.json -> build/lib/unitxt/catalog/cards/global_mmlu/am 2026-05-27T11:53:37,884 copying src/unitxt/catalog/cards/global_mmlu/am/medical_genetics.json -> build/lib/unitxt/catalog/cards/global_mmlu/am 2026-05-27T11:53:37,887 copying src/unitxt/catalog/cards/global_mmlu/am/high_school_computer_science.json -> build/lib/unitxt/catalog/cards/global_mmlu/am 2026-05-27T11:53:37,889 copying src/unitxt/catalog/cards/global_mmlu/am/clinical_knowledge.json -> build/lib/unitxt/catalog/cards/global_mmlu/am 2026-05-27T11:53:37,891 copying src/unitxt/catalog/cards/global_mmlu/am/college_physics.json -> build/lib/unitxt/catalog/cards/global_mmlu/am 2026-05-27T11:53:37,894 copying src/unitxt/catalog/cards/global_mmlu/am/global_facts.json -> build/lib/unitxt/catalog/cards/global_mmlu/am 2026-05-27T11:53:37,896 copying src/unitxt/catalog/cards/global_mmlu/am/college_computer_science.json -> build/lib/unitxt/catalog/cards/global_mmlu/am 2026-05-27T11:53:37,898 copying src/unitxt/catalog/cards/global_mmlu/am/us_foreign_policy.json -> build/lib/unitxt/catalog/cards/global_mmlu/am 2026-05-27T11:53:37,900 copying src/unitxt/catalog/cards/global_mmlu/am/professional_accounting.json -> build/lib/unitxt/catalog/cards/global_mmlu/am 2026-05-27T11:53:37,902 copying src/unitxt/catalog/cards/global_mmlu/am/professional_psychology.json -> build/lib/unitxt/catalog/cards/global_mmlu/am 2026-05-27T11:53:37,905 copying src/unitxt/catalog/cards/global_mmlu/am/philosophy.json -> build/lib/unitxt/catalog/cards/global_mmlu/am 2026-05-27T11:53:37,907 copying src/unitxt/catalog/cards/global_mmlu/am/elementary_mathematics.json -> build/lib/unitxt/catalog/cards/global_mmlu/am 2026-05-27T11:53:37,909 copying src/unitxt/catalog/cards/global_mmlu/am/conceptual_physics.json -> build/lib/unitxt/catalog/cards/global_mmlu/am 2026-05-27T11:53:37,911 copying src/unitxt/catalog/cards/global_mmlu/am/high_school_geography.json -> build/lib/unitxt/catalog/cards/global_mmlu/am 2026-05-27T11:53:37,913 copying src/unitxt/catalog/cards/global_mmlu/am/human_aging.json -> build/lib/unitxt/catalog/cards/global_mmlu/am 2026-05-27T11:53:37,916 copying src/unitxt/catalog/cards/global_mmlu/am/electrical_engineering.json -> build/lib/unitxt/catalog/cards/global_mmlu/am 2026-05-27T11:53:37,918 copying src/unitxt/catalog/cards/global_mmlu/am/management.json -> build/lib/unitxt/catalog/cards/global_mmlu/am 2026-05-27T11:53:37,920 copying src/unitxt/catalog/cards/global_mmlu/am/high_school_world_history.json -> build/lib/unitxt/catalog/cards/global_mmlu/am 2026-05-27T11:53:37,923 copying src/unitxt/catalog/cards/global_mmlu/am/marketing.json -> build/lib/unitxt/catalog/cards/global_mmlu/am 2026-05-27T11:53:37,925 copying src/unitxt/catalog/cards/global_mmlu/am/high_school_european_history.json -> build/lib/unitxt/catalog/cards/global_mmlu/am 2026-05-27T11:53:37,927 copying src/unitxt/catalog/cards/global_mmlu/am/astronomy.json -> build/lib/unitxt/catalog/cards/global_mmlu/am 2026-05-27T11:53:37,929 copying src/unitxt/catalog/cards/global_mmlu/am/high_school_physics.json -> build/lib/unitxt/catalog/cards/global_mmlu/am 2026-05-27T11:53:37,932 copying src/unitxt/catalog/cards/global_mmlu/am/public_relations.json -> build/lib/unitxt/catalog/cards/global_mmlu/am 2026-05-27T11:53:37,934 copying src/unitxt/catalog/cards/global_mmlu/am/high_school_microeconomics.json -> build/lib/unitxt/catalog/cards/global_mmlu/am 2026-05-27T11:53:37,937 copying src/unitxt/catalog/cards/global_mmlu/am/virology.json -> build/lib/unitxt/catalog/cards/global_mmlu/am 2026-05-27T11:53:37,939 copying src/unitxt/catalog/cards/global_mmlu/am/high_school_us_history.json -> build/lib/unitxt/catalog/cards/global_mmlu/am 2026-05-27T11:53:37,941 copying src/unitxt/catalog/cards/global_mmlu/am/high_school_statistics.json -> build/lib/unitxt/catalog/cards/global_mmlu/am 2026-05-27T11:53:37,944 copying src/unitxt/catalog/cards/global_mmlu/am/miscellaneous.json -> build/lib/unitxt/catalog/cards/global_mmlu/am 2026-05-27T11:53:37,946 copying src/unitxt/catalog/cards/global_mmlu/am/high_school_mathematics.json -> build/lib/unitxt/catalog/cards/global_mmlu/am 2026-05-27T11:53:37,948 copying src/unitxt/catalog/cards/global_mmlu/am/formal_logic.json -> build/lib/unitxt/catalog/cards/global_mmlu/am 2026-05-27T11:53:37,950 copying src/unitxt/catalog/cards/global_mmlu/am/high_school_chemistry.json -> build/lib/unitxt/catalog/cards/global_mmlu/am 2026-05-27T11:53:37,953 copying src/unitxt/catalog/cards/global_mmlu/am/abstract_algebra.json -> build/lib/unitxt/catalog/cards/global_mmlu/am 2026-05-27T11:53:37,955 copying src/unitxt/catalog/cards/global_mmlu/am/moral_scenarios.json -> build/lib/unitxt/catalog/cards/global_mmlu/am 2026-05-27T11:53:37,958 copying src/unitxt/catalog/cards/global_mmlu/am/world_religions.json -> build/lib/unitxt/catalog/cards/global_mmlu/am 2026-05-27T11:53:37,960 copying src/unitxt/catalog/cards/global_mmlu/am/business_ethics.json -> build/lib/unitxt/catalog/cards/global_mmlu/am 2026-05-27T11:53:37,962 copying src/unitxt/catalog/cards/global_mmlu/am/security_studies.json -> build/lib/unitxt/catalog/cards/global_mmlu/am 2026-05-27T11:53:37,964 copying src/unitxt/catalog/cards/global_mmlu/am/college_medicine.json -> build/lib/unitxt/catalog/cards/global_mmlu/am 2026-05-27T11:53:37,967 copying src/unitxt/catalog/cards/global_mmlu/am/human_sexuality.json -> build/lib/unitxt/catalog/cards/global_mmlu/am 2026-05-27T11:53:37,969 copying src/unitxt/catalog/cards/global_mmlu/am/prehistory.json -> build/lib/unitxt/catalog/cards/global_mmlu/am 2026-05-27T11:53:37,971 creating build/lib/unitxt/catalog/cards/global_mmlu/uk 2026-05-27T11:53:37,972 copying src/unitxt/catalog/cards/global_mmlu/uk/moral_disputes.json -> build/lib/unitxt/catalog/cards/global_mmlu/uk 2026-05-27T11:53:37,975 copying src/unitxt/catalog/cards/global_mmlu/uk/high_school_biology.json -> build/lib/unitxt/catalog/cards/global_mmlu/uk 2026-05-27T11:53:37,977 copying src/unitxt/catalog/cards/global_mmlu/uk/jurisprudence.json -> build/lib/unitxt/catalog/cards/global_mmlu/uk 2026-05-27T11:53:37,979 copying src/unitxt/catalog/cards/global_mmlu/uk/logical_fallacies.json -> build/lib/unitxt/catalog/cards/global_mmlu/uk 2026-05-27T11:53:37,982 copying src/unitxt/catalog/cards/global_mmlu/uk/college_chemistry.json -> build/lib/unitxt/catalog/cards/global_mmlu/uk 2026-05-27T11:53:37,984 copying src/unitxt/catalog/cards/global_mmlu/uk/high_school_government_and_politics.json -> build/lib/unitxt/catalog/cards/global_mmlu/uk 2026-05-27T11:53:37,987 copying src/unitxt/catalog/cards/global_mmlu/uk/college_mathematics.json -> build/lib/unitxt/catalog/cards/global_mmlu/uk 2026-05-27T11:53:37,989 copying src/unitxt/catalog/cards/global_mmlu/uk/econometrics.json -> build/lib/unitxt/catalog/cards/global_mmlu/uk 2026-05-27T11:53:37,991 copying src/unitxt/catalog/cards/global_mmlu/uk/high_school_macroeconomics.json -> build/lib/unitxt/catalog/cards/global_mmlu/uk 2026-05-27T11:53:37,993 copying src/unitxt/catalog/cards/global_mmlu/uk/high_school_psychology.json -> build/lib/unitxt/catalog/cards/global_mmlu/uk 2026-05-27T11:53:37,996 copying src/unitxt/catalog/cards/global_mmlu/uk/computer_security.json -> build/lib/unitxt/catalog/cards/global_mmlu/uk 2026-05-27T11:53:37,998 copying src/unitxt/catalog/cards/global_mmlu/uk/sociology.json -> build/lib/unitxt/catalog/cards/global_mmlu/uk 2026-05-27T11:53:38,001 copying src/unitxt/catalog/cards/global_mmlu/uk/nutrition.json -> build/lib/unitxt/catalog/cards/global_mmlu/uk 2026-05-27T11:53:38,003 copying src/unitxt/catalog/cards/global_mmlu/uk/professional_medicine.json -> build/lib/unitxt/catalog/cards/global_mmlu/uk 2026-05-27T11:53:38,005 copying src/unitxt/catalog/cards/global_mmlu/uk/college_biology.json -> build/lib/unitxt/catalog/cards/global_mmlu/uk 2026-05-27T11:53:38,008 copying src/unitxt/catalog/cards/global_mmlu/uk/anatomy.json -> build/lib/unitxt/catalog/cards/global_mmlu/uk 2026-05-27T11:53:38,010 copying src/unitxt/catalog/cards/global_mmlu/uk/professional_law.json -> build/lib/unitxt/catalog/cards/global_mmlu/uk 2026-05-27T11:53:38,012 copying src/unitxt/catalog/cards/global_mmlu/uk/machine_learning.json -> build/lib/unitxt/catalog/cards/global_mmlu/uk 2026-05-27T11:53:38,015 copying src/unitxt/catalog/cards/global_mmlu/uk/international_law.json -> build/lib/unitxt/catalog/cards/global_mmlu/uk 2026-05-27T11:53:38,017 copying src/unitxt/catalog/cards/global_mmlu/uk/medical_genetics.json -> build/lib/unitxt/catalog/cards/global_mmlu/uk 2026-05-27T11:53:38,020 copying src/unitxt/catalog/cards/global_mmlu/uk/high_school_computer_science.json -> build/lib/unitxt/catalog/cards/global_mmlu/uk 2026-05-27T11:53:38,022 copying src/unitxt/catalog/cards/global_mmlu/uk/clinical_knowledge.json -> build/lib/unitxt/catalog/cards/global_mmlu/uk 2026-05-27T11:53:38,024 copying src/unitxt/catalog/cards/global_mmlu/uk/college_physics.json -> build/lib/unitxt/catalog/cards/global_mmlu/uk 2026-05-27T11:53:38,027 copying src/unitxt/catalog/cards/global_mmlu/uk/global_facts.json -> build/lib/unitxt/catalog/cards/global_mmlu/uk 2026-05-27T11:53:38,029 copying src/unitxt/catalog/cards/global_mmlu/uk/college_computer_science.json -> build/lib/unitxt/catalog/cards/global_mmlu/uk 2026-05-27T11:53:38,031 copying src/unitxt/catalog/cards/global_mmlu/uk/us_foreign_policy.json -> build/lib/unitxt/catalog/cards/global_mmlu/uk 2026-05-27T11:53:38,033 copying src/unitxt/catalog/cards/global_mmlu/uk/professional_accounting.json -> build/lib/unitxt/catalog/cards/global_mmlu/uk 2026-05-27T11:53:38,035 copying src/unitxt/catalog/cards/global_mmlu/uk/professional_psychology.json -> build/lib/unitxt/catalog/cards/global_mmlu/uk 2026-05-27T11:53:38,038 copying src/unitxt/catalog/cards/global_mmlu/uk/philosophy.json -> build/lib/unitxt/catalog/cards/global_mmlu/uk 2026-05-27T11:53:38,040 copying src/unitxt/catalog/cards/global_mmlu/uk/elementary_mathematics.json -> build/lib/unitxt/catalog/cards/global_mmlu/uk 2026-05-27T11:53:38,042 copying src/unitxt/catalog/cards/global_mmlu/uk/conceptual_physics.json -> build/lib/unitxt/catalog/cards/global_mmlu/uk 2026-05-27T11:53:38,044 copying src/unitxt/catalog/cards/global_mmlu/uk/high_school_geography.json -> build/lib/unitxt/catalog/cards/global_mmlu/uk 2026-05-27T11:53:38,047 copying src/unitxt/catalog/cards/global_mmlu/uk/human_aging.json -> build/lib/unitxt/catalog/cards/global_mmlu/uk 2026-05-27T11:53:38,049 copying src/unitxt/catalog/cards/global_mmlu/uk/electrical_engineering.json -> build/lib/unitxt/catalog/cards/global_mmlu/uk 2026-05-27T11:53:38,051 copying src/unitxt/catalog/cards/global_mmlu/uk/management.json -> build/lib/unitxt/catalog/cards/global_mmlu/uk 2026-05-27T11:53:38,054 copying src/unitxt/catalog/cards/global_mmlu/uk/high_school_world_history.json -> build/lib/unitxt/catalog/cards/global_mmlu/uk 2026-05-27T11:53:38,056 copying src/unitxt/catalog/cards/global_mmlu/uk/marketing.json -> build/lib/unitxt/catalog/cards/global_mmlu/uk 2026-05-27T11:53:38,058 copying src/unitxt/catalog/cards/global_mmlu/uk/high_school_european_history.json -> build/lib/unitxt/catalog/cards/global_mmlu/uk 2026-05-27T11:53:38,061 copying src/unitxt/catalog/cards/global_mmlu/uk/astronomy.json -> build/lib/unitxt/catalog/cards/global_mmlu/uk 2026-05-27T11:53:38,063 copying src/unitxt/catalog/cards/global_mmlu/uk/high_school_physics.json -> build/lib/unitxt/catalog/cards/global_mmlu/uk 2026-05-27T11:53:38,065 copying src/unitxt/catalog/cards/global_mmlu/uk/public_relations.json -> build/lib/unitxt/catalog/cards/global_mmlu/uk 2026-05-27T11:53:38,068 copying src/unitxt/catalog/cards/global_mmlu/uk/high_school_microeconomics.json -> build/lib/unitxt/catalog/cards/global_mmlu/uk 2026-05-27T11:53:38,070 copying src/unitxt/catalog/cards/global_mmlu/uk/virology.json -> build/lib/unitxt/catalog/cards/global_mmlu/uk 2026-05-27T11:53:38,072 copying src/unitxt/catalog/cards/global_mmlu/uk/high_school_us_history.json -> build/lib/unitxt/catalog/cards/global_mmlu/uk 2026-05-27T11:53:38,075 copying src/unitxt/catalog/cards/global_mmlu/uk/high_school_statistics.json -> build/lib/unitxt/catalog/cards/global_mmlu/uk 2026-05-27T11:53:38,077 copying src/unitxt/catalog/cards/global_mmlu/uk/miscellaneous.json -> build/lib/unitxt/catalog/cards/global_mmlu/uk 2026-05-27T11:53:38,080 copying src/unitxt/catalog/cards/global_mmlu/uk/high_school_mathematics.json -> build/lib/unitxt/catalog/cards/global_mmlu/uk 2026-05-27T11:53:38,082 copying src/unitxt/catalog/cards/global_mmlu/uk/formal_logic.json -> build/lib/unitxt/catalog/cards/global_mmlu/uk 2026-05-27T11:53:38,084 copying src/unitxt/catalog/cards/global_mmlu/uk/high_school_chemistry.json -> build/lib/unitxt/catalog/cards/global_mmlu/uk 2026-05-27T11:53:38,087 copying src/unitxt/catalog/cards/global_mmlu/uk/abstract_algebra.json -> build/lib/unitxt/catalog/cards/global_mmlu/uk 2026-05-27T11:53:38,089 copying src/unitxt/catalog/cards/global_mmlu/uk/moral_scenarios.json -> build/lib/unitxt/catalog/cards/global_mmlu/uk 2026-05-27T11:53:38,091 copying src/unitxt/catalog/cards/global_mmlu/uk/world_religions.json -> build/lib/unitxt/catalog/cards/global_mmlu/uk 2026-05-27T11:53:38,094 copying src/unitxt/catalog/cards/global_mmlu/uk/business_ethics.json -> build/lib/unitxt/catalog/cards/global_mmlu/uk 2026-05-27T11:53:38,096 copying src/unitxt/catalog/cards/global_mmlu/uk/security_studies.json -> build/lib/unitxt/catalog/cards/global_mmlu/uk 2026-05-27T11:53:38,098 copying src/unitxt/catalog/cards/global_mmlu/uk/college_medicine.json -> build/lib/unitxt/catalog/cards/global_mmlu/uk 2026-05-27T11:53:38,100 copying src/unitxt/catalog/cards/global_mmlu/uk/human_sexuality.json -> build/lib/unitxt/catalog/cards/global_mmlu/uk 2026-05-27T11:53:38,102 copying src/unitxt/catalog/cards/global_mmlu/uk/prehistory.json -> build/lib/unitxt/catalog/cards/global_mmlu/uk 2026-05-27T11:53:38,105 creating build/lib/unitxt/catalog/cards/global_mmlu/sw 2026-05-27T11:53:38,106 copying src/unitxt/catalog/cards/global_mmlu/sw/moral_disputes.json -> build/lib/unitxt/catalog/cards/global_mmlu/sw 2026-05-27T11:53:38,108 copying src/unitxt/catalog/cards/global_mmlu/sw/high_school_biology.json -> build/lib/unitxt/catalog/cards/global_mmlu/sw 2026-05-27T11:53:38,110 copying src/unitxt/catalog/cards/global_mmlu/sw/jurisprudence.json -> build/lib/unitxt/catalog/cards/global_mmlu/sw 2026-05-27T11:53:38,112 copying src/unitxt/catalog/cards/global_mmlu/sw/logical_fallacies.json -> build/lib/unitxt/catalog/cards/global_mmlu/sw 2026-05-27T11:53:38,115 copying src/unitxt/catalog/cards/global_mmlu/sw/college_chemistry.json -> build/lib/unitxt/catalog/cards/global_mmlu/sw 2026-05-27T11:53:38,117 copying src/unitxt/catalog/cards/global_mmlu/sw/high_school_government_and_politics.json -> build/lib/unitxt/catalog/cards/global_mmlu/sw 2026-05-27T11:53:38,119 copying src/unitxt/catalog/cards/global_mmlu/sw/college_mathematics.json -> build/lib/unitxt/catalog/cards/global_mmlu/sw 2026-05-27T11:53:38,122 copying src/unitxt/catalog/cards/global_mmlu/sw/econometrics.json -> build/lib/unitxt/catalog/cards/global_mmlu/sw 2026-05-27T11:53:38,124 copying src/unitxt/catalog/cards/global_mmlu/sw/high_school_macroeconomics.json -> build/lib/unitxt/catalog/cards/global_mmlu/sw 2026-05-27T11:53:38,126 copying src/unitxt/catalog/cards/global_mmlu/sw/high_school_psychology.json -> build/lib/unitxt/catalog/cards/global_mmlu/sw 2026-05-27T11:53:38,129 copying src/unitxt/catalog/cards/global_mmlu/sw/computer_security.json -> build/lib/unitxt/catalog/cards/global_mmlu/sw 2026-05-27T11:53:38,131 copying src/unitxt/catalog/cards/global_mmlu/sw/sociology.json -> build/lib/unitxt/catalog/cards/global_mmlu/sw 2026-05-27T11:53:38,133 copying src/unitxt/catalog/cards/global_mmlu/sw/nutrition.json -> build/lib/unitxt/catalog/cards/global_mmlu/sw 2026-05-27T11:53:38,136 copying src/unitxt/catalog/cards/global_mmlu/sw/professional_medicine.json -> build/lib/unitxt/catalog/cards/global_mmlu/sw 2026-05-27T11:53:38,138 copying src/unitxt/catalog/cards/global_mmlu/sw/college_biology.json -> build/lib/unitxt/catalog/cards/global_mmlu/sw 2026-05-27T11:53:38,140 copying src/unitxt/catalog/cards/global_mmlu/sw/anatomy.json -> build/lib/unitxt/catalog/cards/global_mmlu/sw 2026-05-27T11:53:38,142 copying src/unitxt/catalog/cards/global_mmlu/sw/professional_law.json -> build/lib/unitxt/catalog/cards/global_mmlu/sw 2026-05-27T11:53:38,145 copying src/unitxt/catalog/cards/global_mmlu/sw/machine_learning.json -> build/lib/unitxt/catalog/cards/global_mmlu/sw 2026-05-27T11:53:38,147 copying src/unitxt/catalog/cards/global_mmlu/sw/international_law.json -> build/lib/unitxt/catalog/cards/global_mmlu/sw 2026-05-27T11:53:38,149 copying src/unitxt/catalog/cards/global_mmlu/sw/medical_genetics.json -> build/lib/unitxt/catalog/cards/global_mmlu/sw 2026-05-27T11:53:38,151 copying src/unitxt/catalog/cards/global_mmlu/sw/high_school_computer_science.json -> build/lib/unitxt/catalog/cards/global_mmlu/sw 2026-05-27T11:53:38,153 copying src/unitxt/catalog/cards/global_mmlu/sw/clinical_knowledge.json -> build/lib/unitxt/catalog/cards/global_mmlu/sw 2026-05-27T11:53:38,156 copying src/unitxt/catalog/cards/global_mmlu/sw/college_physics.json -> build/lib/unitxt/catalog/cards/global_mmlu/sw 2026-05-27T11:53:38,158 copying src/unitxt/catalog/cards/global_mmlu/sw/global_facts.json -> build/lib/unitxt/catalog/cards/global_mmlu/sw 2026-05-27T11:53:38,160 copying src/unitxt/catalog/cards/global_mmlu/sw/college_computer_science.json -> build/lib/unitxt/catalog/cards/global_mmlu/sw 2026-05-27T11:53:38,163 copying src/unitxt/catalog/cards/global_mmlu/sw/us_foreign_policy.json -> build/lib/unitxt/catalog/cards/global_mmlu/sw 2026-05-27T11:53:38,165 copying src/unitxt/catalog/cards/global_mmlu/sw/professional_accounting.json -> build/lib/unitxt/catalog/cards/global_mmlu/sw 2026-05-27T11:53:38,167 copying src/unitxt/catalog/cards/global_mmlu/sw/professional_psychology.json -> build/lib/unitxt/catalog/cards/global_mmlu/sw 2026-05-27T11:53:38,169 copying src/unitxt/catalog/cards/global_mmlu/sw/philosophy.json -> build/lib/unitxt/catalog/cards/global_mmlu/sw 2026-05-27T11:53:38,172 copying src/unitxt/catalog/cards/global_mmlu/sw/elementary_mathematics.json -> build/lib/unitxt/catalog/cards/global_mmlu/sw 2026-05-27T11:53:38,174 copying src/unitxt/catalog/cards/global_mmlu/sw/conceptual_physics.json -> build/lib/unitxt/catalog/cards/global_mmlu/sw 2026-05-27T11:53:38,176 copying src/unitxt/catalog/cards/global_mmlu/sw/high_school_geography.json -> build/lib/unitxt/catalog/cards/global_mmlu/sw 2026-05-27T11:53:38,178 copying src/unitxt/catalog/cards/global_mmlu/sw/human_aging.json -> build/lib/unitxt/catalog/cards/global_mmlu/sw 2026-05-27T11:53:38,181 copying src/unitxt/catalog/cards/global_mmlu/sw/electrical_engineering.json -> build/lib/unitxt/catalog/cards/global_mmlu/sw 2026-05-27T11:53:38,183 copying src/unitxt/catalog/cards/global_mmlu/sw/management.json -> build/lib/unitxt/catalog/cards/global_mmlu/sw 2026-05-27T11:53:38,185 copying src/unitxt/catalog/cards/global_mmlu/sw/high_school_world_history.json -> build/lib/unitxt/catalog/cards/global_mmlu/sw 2026-05-27T11:53:38,188 copying src/unitxt/catalog/cards/global_mmlu/sw/marketing.json -> build/lib/unitxt/catalog/cards/global_mmlu/sw 2026-05-27T11:53:38,190 copying src/unitxt/catalog/cards/global_mmlu/sw/high_school_european_history.json -> build/lib/unitxt/catalog/cards/global_mmlu/sw 2026-05-27T11:53:38,192 copying src/unitxt/catalog/cards/global_mmlu/sw/astronomy.json -> build/lib/unitxt/catalog/cards/global_mmlu/sw 2026-05-27T11:53:38,195 copying src/unitxt/catalog/cards/global_mmlu/sw/high_school_physics.json -> build/lib/unitxt/catalog/cards/global_mmlu/sw 2026-05-27T11:53:38,197 copying src/unitxt/catalog/cards/global_mmlu/sw/public_relations.json -> build/lib/unitxt/catalog/cards/global_mmlu/sw 2026-05-27T11:53:38,199 copying src/unitxt/catalog/cards/global_mmlu/sw/high_school_microeconomics.json -> build/lib/unitxt/catalog/cards/global_mmlu/sw 2026-05-27T11:53:38,202 copying src/unitxt/catalog/cards/global_mmlu/sw/virology.json -> build/lib/unitxt/catalog/cards/global_mmlu/sw 2026-05-27T11:53:38,204 copying src/unitxt/catalog/cards/global_mmlu/sw/high_school_us_history.json -> build/lib/unitxt/catalog/cards/global_mmlu/sw 2026-05-27T11:53:38,206 copying src/unitxt/catalog/cards/global_mmlu/sw/high_school_statistics.json -> build/lib/unitxt/catalog/cards/global_mmlu/sw 2026-05-27T11:53:38,209 copying src/unitxt/catalog/cards/global_mmlu/sw/miscellaneous.json -> build/lib/unitxt/catalog/cards/global_mmlu/sw 2026-05-27T11:53:38,211 copying src/unitxt/catalog/cards/global_mmlu/sw/high_school_mathematics.json -> build/lib/unitxt/catalog/cards/global_mmlu/sw 2026-05-27T11:53:38,214 copying src/unitxt/catalog/cards/global_mmlu/sw/formal_logic.json -> build/lib/unitxt/catalog/cards/global_mmlu/sw 2026-05-27T11:53:38,216 copying src/unitxt/catalog/cards/global_mmlu/sw/high_school_chemistry.json -> build/lib/unitxt/catalog/cards/global_mmlu/sw 2026-05-27T11:53:38,218 copying src/unitxt/catalog/cards/global_mmlu/sw/abstract_algebra.json -> build/lib/unitxt/catalog/cards/global_mmlu/sw 2026-05-27T11:53:38,221 copying src/unitxt/catalog/cards/global_mmlu/sw/moral_scenarios.json -> build/lib/unitxt/catalog/cards/global_mmlu/sw 2026-05-27T11:53:38,223 copying src/unitxt/catalog/cards/global_mmlu/sw/world_religions.json -> build/lib/unitxt/catalog/cards/global_mmlu/sw 2026-05-27T11:53:38,225 copying src/unitxt/catalog/cards/global_mmlu/sw/business_ethics.json -> build/lib/unitxt/catalog/cards/global_mmlu/sw 2026-05-27T11:53:38,228 copying src/unitxt/catalog/cards/global_mmlu/sw/security_studies.json -> build/lib/unitxt/catalog/cards/global_mmlu/sw 2026-05-27T11:53:38,230 copying src/unitxt/catalog/cards/global_mmlu/sw/college_medicine.json -> build/lib/unitxt/catalog/cards/global_mmlu/sw 2026-05-27T11:53:38,232 copying src/unitxt/catalog/cards/global_mmlu/sw/human_sexuality.json -> build/lib/unitxt/catalog/cards/global_mmlu/sw 2026-05-27T11:53:38,235 copying src/unitxt/catalog/cards/global_mmlu/sw/prehistory.json -> build/lib/unitxt/catalog/cards/global_mmlu/sw 2026-05-27T11:53:38,237 creating build/lib/unitxt/catalog/cards/global_mmlu/pt 2026-05-27T11:53:38,238 copying src/unitxt/catalog/cards/global_mmlu/pt/moral_disputes.json -> build/lib/unitxt/catalog/cards/global_mmlu/pt 2026-05-27T11:53:38,241 copying src/unitxt/catalog/cards/global_mmlu/pt/high_school_biology.json -> build/lib/unitxt/catalog/cards/global_mmlu/pt 2026-05-27T11:53:38,243 copying src/unitxt/catalog/cards/global_mmlu/pt/jurisprudence.json -> build/lib/unitxt/catalog/cards/global_mmlu/pt 2026-05-27T11:53:38,245 copying src/unitxt/catalog/cards/global_mmlu/pt/logical_fallacies.json -> build/lib/unitxt/catalog/cards/global_mmlu/pt 2026-05-27T11:53:38,248 copying src/unitxt/catalog/cards/global_mmlu/pt/college_chemistry.json -> build/lib/unitxt/catalog/cards/global_mmlu/pt 2026-05-27T11:53:38,250 copying src/unitxt/catalog/cards/global_mmlu/pt/high_school_government_and_politics.json -> build/lib/unitxt/catalog/cards/global_mmlu/pt 2026-05-27T11:53:38,252 copying src/unitxt/catalog/cards/global_mmlu/pt/college_mathematics.json -> build/lib/unitxt/catalog/cards/global_mmlu/pt 2026-05-27T11:53:38,254 copying src/unitxt/catalog/cards/global_mmlu/pt/econometrics.json -> build/lib/unitxt/catalog/cards/global_mmlu/pt 2026-05-27T11:53:38,257 copying src/unitxt/catalog/cards/global_mmlu/pt/high_school_macroeconomics.json -> build/lib/unitxt/catalog/cards/global_mmlu/pt 2026-05-27T11:53:38,259 copying src/unitxt/catalog/cards/global_mmlu/pt/high_school_psychology.json -> build/lib/unitxt/catalog/cards/global_mmlu/pt 2026-05-27T11:53:38,261 copying src/unitxt/catalog/cards/global_mmlu/pt/computer_security.json -> build/lib/unitxt/catalog/cards/global_mmlu/pt 2026-05-27T11:53:38,264 copying src/unitxt/catalog/cards/global_mmlu/pt/sociology.json -> build/lib/unitxt/catalog/cards/global_mmlu/pt 2026-05-27T11:53:38,266 copying src/unitxt/catalog/cards/global_mmlu/pt/nutrition.json -> build/lib/unitxt/catalog/cards/global_mmlu/pt 2026-05-27T11:53:38,268 copying src/unitxt/catalog/cards/global_mmlu/pt/professional_medicine.json -> build/lib/unitxt/catalog/cards/global_mmlu/pt 2026-05-27T11:53:38,271 copying src/unitxt/catalog/cards/global_mmlu/pt/college_biology.json -> build/lib/unitxt/catalog/cards/global_mmlu/pt 2026-05-27T11:53:38,273 copying src/unitxt/catalog/cards/global_mmlu/pt/anatomy.json -> build/lib/unitxt/catalog/cards/global_mmlu/pt 2026-05-27T11:53:38,276 copying src/unitxt/catalog/cards/global_mmlu/pt/professional_law.json -> build/lib/unitxt/catalog/cards/global_mmlu/pt 2026-05-27T11:53:38,278 copying src/unitxt/catalog/cards/global_mmlu/pt/machine_learning.json -> build/lib/unitxt/catalog/cards/global_mmlu/pt 2026-05-27T11:53:38,280 copying src/unitxt/catalog/cards/global_mmlu/pt/international_law.json -> build/lib/unitxt/catalog/cards/global_mmlu/pt 2026-05-27T11:53:38,283 copying src/unitxt/catalog/cards/global_mmlu/pt/medical_genetics.json -> build/lib/unitxt/catalog/cards/global_mmlu/pt 2026-05-27T11:53:38,285 copying src/unitxt/catalog/cards/global_mmlu/pt/high_school_computer_science.json -> build/lib/unitxt/catalog/cards/global_mmlu/pt 2026-05-27T11:53:38,287 copying src/unitxt/catalog/cards/global_mmlu/pt/clinical_knowledge.json -> build/lib/unitxt/catalog/cards/global_mmlu/pt 2026-05-27T11:53:38,289 copying src/unitxt/catalog/cards/global_mmlu/pt/college_physics.json -> build/lib/unitxt/catalog/cards/global_mmlu/pt 2026-05-27T11:53:38,291 copying src/unitxt/catalog/cards/global_mmlu/pt/global_facts.json -> build/lib/unitxt/catalog/cards/global_mmlu/pt 2026-05-27T11:53:38,294 copying src/unitxt/catalog/cards/global_mmlu/pt/college_computer_science.json -> build/lib/unitxt/catalog/cards/global_mmlu/pt 2026-05-27T11:53:38,296 copying src/unitxt/catalog/cards/global_mmlu/pt/us_foreign_policy.json -> build/lib/unitxt/catalog/cards/global_mmlu/pt 2026-05-27T11:53:38,298 copying src/unitxt/catalog/cards/global_mmlu/pt/professional_accounting.json -> build/lib/unitxt/catalog/cards/global_mmlu/pt 2026-05-27T11:53:38,300 copying src/unitxt/catalog/cards/global_mmlu/pt/professional_psychology.json -> build/lib/unitxt/catalog/cards/global_mmlu/pt 2026-05-27T11:53:38,302 copying src/unitxt/catalog/cards/global_mmlu/pt/philosophy.json -> build/lib/unitxt/catalog/cards/global_mmlu/pt 2026-05-27T11:53:38,305 copying src/unitxt/catalog/cards/global_mmlu/pt/elementary_mathematics.json -> build/lib/unitxt/catalog/cards/global_mmlu/pt 2026-05-27T11:53:38,307 copying src/unitxt/catalog/cards/global_mmlu/pt/conceptual_physics.json -> build/lib/unitxt/catalog/cards/global_mmlu/pt 2026-05-27T11:53:38,309 copying src/unitxt/catalog/cards/global_mmlu/pt/high_school_geography.json -> build/lib/unitxt/catalog/cards/global_mmlu/pt 2026-05-27T11:53:38,312 copying src/unitxt/catalog/cards/global_mmlu/pt/human_aging.json -> build/lib/unitxt/catalog/cards/global_mmlu/pt 2026-05-27T11:53:38,314 copying src/unitxt/catalog/cards/global_mmlu/pt/electrical_engineering.json -> build/lib/unitxt/catalog/cards/global_mmlu/pt 2026-05-27T11:53:38,316 copying src/unitxt/catalog/cards/global_mmlu/pt/management.json -> build/lib/unitxt/catalog/cards/global_mmlu/pt 2026-05-27T11:53:38,319 copying src/unitxt/catalog/cards/global_mmlu/pt/high_school_world_history.json -> build/lib/unitxt/catalog/cards/global_mmlu/pt 2026-05-27T11:53:38,321 copying src/unitxt/catalog/cards/global_mmlu/pt/marketing.json -> build/lib/unitxt/catalog/cards/global_mmlu/pt 2026-05-27T11:53:38,323 copying src/unitxt/catalog/cards/global_mmlu/pt/high_school_european_history.json -> build/lib/unitxt/catalog/cards/global_mmlu/pt 2026-05-27T11:53:38,326 copying src/unitxt/catalog/cards/global_mmlu/pt/astronomy.json -> build/lib/unitxt/catalog/cards/global_mmlu/pt 2026-05-27T11:53:38,328 copying src/unitxt/catalog/cards/global_mmlu/pt/high_school_physics.json -> build/lib/unitxt/catalog/cards/global_mmlu/pt 2026-05-27T11:53:38,330 copying src/unitxt/catalog/cards/global_mmlu/pt/public_relations.json -> build/lib/unitxt/catalog/cards/global_mmlu/pt 2026-05-27T11:53:38,332 copying src/unitxt/catalog/cards/global_mmlu/pt/high_school_microeconomics.json -> build/lib/unitxt/catalog/cards/global_mmlu/pt 2026-05-27T11:53:38,335 copying src/unitxt/catalog/cards/global_mmlu/pt/virology.json -> build/lib/unitxt/catalog/cards/global_mmlu/pt 2026-05-27T11:53:38,337 copying src/unitxt/catalog/cards/global_mmlu/pt/high_school_us_history.json -> build/lib/unitxt/catalog/cards/global_mmlu/pt 2026-05-27T11:53:38,339 copying src/unitxt/catalog/cards/global_mmlu/pt/high_school_statistics.json -> build/lib/unitxt/catalog/cards/global_mmlu/pt 2026-05-27T11:53:38,342 copying src/unitxt/catalog/cards/global_mmlu/pt/miscellaneous.json -> build/lib/unitxt/catalog/cards/global_mmlu/pt 2026-05-27T11:53:38,344 copying src/unitxt/catalog/cards/global_mmlu/pt/high_school_mathematics.json -> build/lib/unitxt/catalog/cards/global_mmlu/pt 2026-05-27T11:53:38,346 copying src/unitxt/catalog/cards/global_mmlu/pt/formal_logic.json -> build/lib/unitxt/catalog/cards/global_mmlu/pt 2026-05-27T11:53:38,348 copying src/unitxt/catalog/cards/global_mmlu/pt/high_school_chemistry.json -> build/lib/unitxt/catalog/cards/global_mmlu/pt 2026-05-27T11:53:38,350 copying src/unitxt/catalog/cards/global_mmlu/pt/abstract_algebra.json -> build/lib/unitxt/catalog/cards/global_mmlu/pt 2026-05-27T11:53:38,353 copying src/unitxt/catalog/cards/global_mmlu/pt/moral_scenarios.json -> build/lib/unitxt/catalog/cards/global_mmlu/pt 2026-05-27T11:53:38,355 copying src/unitxt/catalog/cards/global_mmlu/pt/world_religions.json -> build/lib/unitxt/catalog/cards/global_mmlu/pt 2026-05-27T11:53:38,357 copying src/unitxt/catalog/cards/global_mmlu/pt/business_ethics.json -> build/lib/unitxt/catalog/cards/global_mmlu/pt 2026-05-27T11:53:38,359 copying src/unitxt/catalog/cards/global_mmlu/pt/security_studies.json -> build/lib/unitxt/catalog/cards/global_mmlu/pt 2026-05-27T11:53:38,361 copying src/unitxt/catalog/cards/global_mmlu/pt/college_medicine.json -> build/lib/unitxt/catalog/cards/global_mmlu/pt 2026-05-27T11:53:38,364 copying src/unitxt/catalog/cards/global_mmlu/pt/human_sexuality.json -> build/lib/unitxt/catalog/cards/global_mmlu/pt 2026-05-27T11:53:38,366 copying src/unitxt/catalog/cards/global_mmlu/pt/prehistory.json -> build/lib/unitxt/catalog/cards/global_mmlu/pt 2026-05-27T11:53:38,368 creating build/lib/unitxt/catalog/cards/global_mmlu/sn 2026-05-27T11:53:38,369 copying src/unitxt/catalog/cards/global_mmlu/sn/moral_disputes.json -> build/lib/unitxt/catalog/cards/global_mmlu/sn 2026-05-27T11:53:38,371 copying src/unitxt/catalog/cards/global_mmlu/sn/high_school_biology.json -> build/lib/unitxt/catalog/cards/global_mmlu/sn 2026-05-27T11:53:38,374 copying src/unitxt/catalog/cards/global_mmlu/sn/jurisprudence.json -> build/lib/unitxt/catalog/cards/global_mmlu/sn 2026-05-27T11:53:38,376 copying src/unitxt/catalog/cards/global_mmlu/sn/logical_fallacies.json -> build/lib/unitxt/catalog/cards/global_mmlu/sn 2026-05-27T11:53:38,378 copying src/unitxt/catalog/cards/global_mmlu/sn/college_chemistry.json -> build/lib/unitxt/catalog/cards/global_mmlu/sn 2026-05-27T11:53:38,381 copying src/unitxt/catalog/cards/global_mmlu/sn/high_school_government_and_politics.json -> build/lib/unitxt/catalog/cards/global_mmlu/sn 2026-05-27T11:53:38,383 copying src/unitxt/catalog/cards/global_mmlu/sn/college_mathematics.json -> build/lib/unitxt/catalog/cards/global_mmlu/sn 2026-05-27T11:53:38,385 copying src/unitxt/catalog/cards/global_mmlu/sn/econometrics.json -> build/lib/unitxt/catalog/cards/global_mmlu/sn 2026-05-27T11:53:38,388 copying src/unitxt/catalog/cards/global_mmlu/sn/high_school_macroeconomics.json -> build/lib/unitxt/catalog/cards/global_mmlu/sn 2026-05-27T11:53:38,390 copying src/unitxt/catalog/cards/global_mmlu/sn/high_school_psychology.json -> build/lib/unitxt/catalog/cards/global_mmlu/sn 2026-05-27T11:53:38,392 copying src/unitxt/catalog/cards/global_mmlu/sn/computer_security.json -> build/lib/unitxt/catalog/cards/global_mmlu/sn 2026-05-27T11:53:38,394 copying src/unitxt/catalog/cards/global_mmlu/sn/sociology.json -> build/lib/unitxt/catalog/cards/global_mmlu/sn 2026-05-27T11:53:38,397 copying src/unitxt/catalog/cards/global_mmlu/sn/nutrition.json -> build/lib/unitxt/catalog/cards/global_mmlu/sn 2026-05-27T11:53:38,399 copying src/unitxt/catalog/cards/global_mmlu/sn/professional_medicine.json -> build/lib/unitxt/catalog/cards/global_mmlu/sn 2026-05-27T11:53:38,401 copying src/unitxt/catalog/cards/global_mmlu/sn/college_biology.json -> build/lib/unitxt/catalog/cards/global_mmlu/sn 2026-05-27T11:53:38,404 copying src/unitxt/catalog/cards/global_mmlu/sn/anatomy.json -> build/lib/unitxt/catalog/cards/global_mmlu/sn 2026-05-27T11:53:38,406 copying src/unitxt/catalog/cards/global_mmlu/sn/professional_law.json -> build/lib/unitxt/catalog/cards/global_mmlu/sn 2026-05-27T11:53:38,408 copying src/unitxt/catalog/cards/global_mmlu/sn/machine_learning.json -> build/lib/unitxt/catalog/cards/global_mmlu/sn 2026-05-27T11:53:38,411 copying src/unitxt/catalog/cards/global_mmlu/sn/international_law.json -> build/lib/unitxt/catalog/cards/global_mmlu/sn 2026-05-27T11:53:38,413 copying src/unitxt/catalog/cards/global_mmlu/sn/medical_genetics.json -> build/lib/unitxt/catalog/cards/global_mmlu/sn 2026-05-27T11:53:38,415 copying src/unitxt/catalog/cards/global_mmlu/sn/high_school_computer_science.json -> build/lib/unitxt/catalog/cards/global_mmlu/sn 2026-05-27T11:53:38,417 copying src/unitxt/catalog/cards/global_mmlu/sn/clinical_knowledge.json -> build/lib/unitxt/catalog/cards/global_mmlu/sn 2026-05-27T11:53:38,419 copying src/unitxt/catalog/cards/global_mmlu/sn/college_physics.json -> build/lib/unitxt/catalog/cards/global_mmlu/sn 2026-05-27T11:53:38,421 copying src/unitxt/catalog/cards/global_mmlu/sn/global_facts.json -> build/lib/unitxt/catalog/cards/global_mmlu/sn 2026-05-27T11:53:38,424 copying src/unitxt/catalog/cards/global_mmlu/sn/college_computer_science.json -> build/lib/unitxt/catalog/cards/global_mmlu/sn 2026-05-27T11:53:38,426 copying src/unitxt/catalog/cards/global_mmlu/sn/us_foreign_policy.json -> build/lib/unitxt/catalog/cards/global_mmlu/sn 2026-05-27T11:53:38,428 copying src/unitxt/catalog/cards/global_mmlu/sn/professional_accounting.json -> build/lib/unitxt/catalog/cards/global_mmlu/sn 2026-05-27T11:53:38,430 copying src/unitxt/catalog/cards/global_mmlu/sn/professional_psychology.json -> build/lib/unitxt/catalog/cards/global_mmlu/sn 2026-05-27T11:53:38,432 copying src/unitxt/catalog/cards/global_mmlu/sn/philosophy.json -> build/lib/unitxt/catalog/cards/global_mmlu/sn 2026-05-27T11:53:38,435 copying src/unitxt/catalog/cards/global_mmlu/sn/elementary_mathematics.json -> build/lib/unitxt/catalog/cards/global_mmlu/sn 2026-05-27T11:53:38,437 copying src/unitxt/catalog/cards/global_mmlu/sn/conceptual_physics.json -> build/lib/unitxt/catalog/cards/global_mmlu/sn 2026-05-27T11:53:38,439 copying src/unitxt/catalog/cards/global_mmlu/sn/high_school_geography.json -> build/lib/unitxt/catalog/cards/global_mmlu/sn 2026-05-27T11:53:38,442 copying src/unitxt/catalog/cards/global_mmlu/sn/human_aging.json -> build/lib/unitxt/catalog/cards/global_mmlu/sn 2026-05-27T11:53:38,444 copying src/unitxt/catalog/cards/global_mmlu/sn/electrical_engineering.json -> build/lib/unitxt/catalog/cards/global_mmlu/sn 2026-05-27T11:53:38,446 copying src/unitxt/catalog/cards/global_mmlu/sn/management.json -> build/lib/unitxt/catalog/cards/global_mmlu/sn 2026-05-27T11:53:38,449 copying src/unitxt/catalog/cards/global_mmlu/sn/high_school_world_history.json -> build/lib/unitxt/catalog/cards/global_mmlu/sn 2026-05-27T11:53:38,451 copying src/unitxt/catalog/cards/global_mmlu/sn/marketing.json -> build/lib/unitxt/catalog/cards/global_mmlu/sn 2026-05-27T11:53:38,453 copying src/unitxt/catalog/cards/global_mmlu/sn/high_school_european_history.json -> build/lib/unitxt/catalog/cards/global_mmlu/sn 2026-05-27T11:53:38,455 copying src/unitxt/catalog/cards/global_mmlu/sn/astronomy.json -> build/lib/unitxt/catalog/cards/global_mmlu/sn 2026-05-27T11:53:38,458 copying src/unitxt/catalog/cards/global_mmlu/sn/high_school_physics.json -> build/lib/unitxt/catalog/cards/global_mmlu/sn 2026-05-27T11:53:38,460 copying src/unitxt/catalog/cards/global_mmlu/sn/public_relations.json -> build/lib/unitxt/catalog/cards/global_mmlu/sn 2026-05-27T11:53:38,462 copying src/unitxt/catalog/cards/global_mmlu/sn/high_school_microeconomics.json -> build/lib/unitxt/catalog/cards/global_mmlu/sn 2026-05-27T11:53:38,465 copying src/unitxt/catalog/cards/global_mmlu/sn/virology.json -> build/lib/unitxt/catalog/cards/global_mmlu/sn 2026-05-27T11:53:38,467 copying src/unitxt/catalog/cards/global_mmlu/sn/high_school_us_history.json -> build/lib/unitxt/catalog/cards/global_mmlu/sn 2026-05-27T11:53:38,470 copying src/unitxt/catalog/cards/global_mmlu/sn/high_school_statistics.json -> build/lib/unitxt/catalog/cards/global_mmlu/sn 2026-05-27T11:53:38,472 copying src/unitxt/catalog/cards/global_mmlu/sn/miscellaneous.json -> build/lib/unitxt/catalog/cards/global_mmlu/sn 2026-05-27T11:53:38,474 copying src/unitxt/catalog/cards/global_mmlu/sn/high_school_mathematics.json -> build/lib/unitxt/catalog/cards/global_mmlu/sn 2026-05-27T11:53:38,477 copying src/unitxt/catalog/cards/global_mmlu/sn/formal_logic.json -> build/lib/unitxt/catalog/cards/global_mmlu/sn 2026-05-27T11:53:38,479 copying src/unitxt/catalog/cards/global_mmlu/sn/high_school_chemistry.json -> build/lib/unitxt/catalog/cards/global_mmlu/sn 2026-05-27T11:53:38,481 copying src/unitxt/catalog/cards/global_mmlu/sn/abstract_algebra.json -> build/lib/unitxt/catalog/cards/global_mmlu/sn 2026-05-27T11:53:38,484 copying src/unitxt/catalog/cards/global_mmlu/sn/moral_scenarios.json -> build/lib/unitxt/catalog/cards/global_mmlu/sn 2026-05-27T11:53:38,486 copying src/unitxt/catalog/cards/global_mmlu/sn/world_religions.json -> build/lib/unitxt/catalog/cards/global_mmlu/sn 2026-05-27T11:53:38,488 copying src/unitxt/catalog/cards/global_mmlu/sn/business_ethics.json -> build/lib/unitxt/catalog/cards/global_mmlu/sn 2026-05-27T11:53:38,491 copying src/unitxt/catalog/cards/global_mmlu/sn/security_studies.json -> build/lib/unitxt/catalog/cards/global_mmlu/sn 2026-05-27T11:53:38,493 copying src/unitxt/catalog/cards/global_mmlu/sn/college_medicine.json -> build/lib/unitxt/catalog/cards/global_mmlu/sn 2026-05-27T11:53:38,495 copying src/unitxt/catalog/cards/global_mmlu/sn/human_sexuality.json -> build/lib/unitxt/catalog/cards/global_mmlu/sn 2026-05-27T11:53:38,497 copying src/unitxt/catalog/cards/global_mmlu/sn/prehistory.json -> build/lib/unitxt/catalog/cards/global_mmlu/sn 2026-05-27T11:53:38,500 creating build/lib/unitxt/catalog/cards/global_mmlu/zh 2026-05-27T11:53:38,501 copying src/unitxt/catalog/cards/global_mmlu/zh/moral_disputes.json -> build/lib/unitxt/catalog/cards/global_mmlu/zh 2026-05-27T11:53:38,503 copying src/unitxt/catalog/cards/global_mmlu/zh/high_school_biology.json -> build/lib/unitxt/catalog/cards/global_mmlu/zh 2026-05-27T11:53:38,506 copying src/unitxt/catalog/cards/global_mmlu/zh/jurisprudence.json -> build/lib/unitxt/catalog/cards/global_mmlu/zh 2026-05-27T11:53:38,508 copying src/unitxt/catalog/cards/global_mmlu/zh/logical_fallacies.json -> build/lib/unitxt/catalog/cards/global_mmlu/zh 2026-05-27T11:53:38,510 copying src/unitxt/catalog/cards/global_mmlu/zh/college_chemistry.json -> build/lib/unitxt/catalog/cards/global_mmlu/zh 2026-05-27T11:53:38,513 copying src/unitxt/catalog/cards/global_mmlu/zh/high_school_government_and_politics.json -> build/lib/unitxt/catalog/cards/global_mmlu/zh 2026-05-27T11:53:38,515 copying src/unitxt/catalog/cards/global_mmlu/zh/college_mathematics.json -> build/lib/unitxt/catalog/cards/global_mmlu/zh 2026-05-27T11:53:38,517 copying src/unitxt/catalog/cards/global_mmlu/zh/econometrics.json -> build/lib/unitxt/catalog/cards/global_mmlu/zh 2026-05-27T11:53:38,520 copying src/unitxt/catalog/cards/global_mmlu/zh/high_school_macroeconomics.json -> build/lib/unitxt/catalog/cards/global_mmlu/zh 2026-05-27T11:53:38,522 copying src/unitxt/catalog/cards/global_mmlu/zh/high_school_psychology.json -> build/lib/unitxt/catalog/cards/global_mmlu/zh 2026-05-27T11:53:38,525 copying src/unitxt/catalog/cards/global_mmlu/zh/computer_security.json -> build/lib/unitxt/catalog/cards/global_mmlu/zh 2026-05-27T11:53:38,527 copying src/unitxt/catalog/cards/global_mmlu/zh/sociology.json -> build/lib/unitxt/catalog/cards/global_mmlu/zh 2026-05-27T11:53:38,530 copying src/unitxt/catalog/cards/global_mmlu/zh/nutrition.json -> build/lib/unitxt/catalog/cards/global_mmlu/zh 2026-05-27T11:53:38,532 copying src/unitxt/catalog/cards/global_mmlu/zh/professional_medicine.json -> build/lib/unitxt/catalog/cards/global_mmlu/zh 2026-05-27T11:53:38,535 copying src/unitxt/catalog/cards/global_mmlu/zh/college_biology.json -> build/lib/unitxt/catalog/cards/global_mmlu/zh 2026-05-27T11:53:38,537 copying src/unitxt/catalog/cards/global_mmlu/zh/anatomy.json -> build/lib/unitxt/catalog/cards/global_mmlu/zh 2026-05-27T11:53:38,539 copying src/unitxt/catalog/cards/global_mmlu/zh/professional_law.json -> build/lib/unitxt/catalog/cards/global_mmlu/zh 2026-05-27T11:53:38,542 copying src/unitxt/catalog/cards/global_mmlu/zh/machine_learning.json -> build/lib/unitxt/catalog/cards/global_mmlu/zh 2026-05-27T11:53:38,544 copying src/unitxt/catalog/cards/global_mmlu/zh/international_law.json -> build/lib/unitxt/catalog/cards/global_mmlu/zh 2026-05-27T11:53:38,546 copying src/unitxt/catalog/cards/global_mmlu/zh/medical_genetics.json -> build/lib/unitxt/catalog/cards/global_mmlu/zh 2026-05-27T11:53:38,549 copying src/unitxt/catalog/cards/global_mmlu/zh/high_school_computer_science.json -> build/lib/unitxt/catalog/cards/global_mmlu/zh 2026-05-27T11:53:38,551 copying src/unitxt/catalog/cards/global_mmlu/zh/clinical_knowledge.json -> build/lib/unitxt/catalog/cards/global_mmlu/zh 2026-05-27T11:53:38,553 copying src/unitxt/catalog/cards/global_mmlu/zh/college_physics.json -> build/lib/unitxt/catalog/cards/global_mmlu/zh 2026-05-27T11:53:38,555 copying src/unitxt/catalog/cards/global_mmlu/zh/global_facts.json -> build/lib/unitxt/catalog/cards/global_mmlu/zh 2026-05-27T11:53:38,558 copying src/unitxt/catalog/cards/global_mmlu/zh/college_computer_science.json -> build/lib/unitxt/catalog/cards/global_mmlu/zh 2026-05-27T11:53:38,560 copying src/unitxt/catalog/cards/global_mmlu/zh/us_foreign_policy.json -> build/lib/unitxt/catalog/cards/global_mmlu/zh 2026-05-27T11:53:38,563 copying src/unitxt/catalog/cards/global_mmlu/zh/professional_accounting.json -> build/lib/unitxt/catalog/cards/global_mmlu/zh 2026-05-27T11:53:38,565 copying src/unitxt/catalog/cards/global_mmlu/zh/professional_psychology.json -> build/lib/unitxt/catalog/cards/global_mmlu/zh 2026-05-27T11:53:38,567 copying src/unitxt/catalog/cards/global_mmlu/zh/philosophy.json -> build/lib/unitxt/catalog/cards/global_mmlu/zh 2026-05-27T11:53:38,569 copying src/unitxt/catalog/cards/global_mmlu/zh/elementary_mathematics.json -> build/lib/unitxt/catalog/cards/global_mmlu/zh 2026-05-27T11:53:38,572 copying src/unitxt/catalog/cards/global_mmlu/zh/conceptual_physics.json -> build/lib/unitxt/catalog/cards/global_mmlu/zh 2026-05-27T11:53:38,574 copying src/unitxt/catalog/cards/global_mmlu/zh/high_school_geography.json -> build/lib/unitxt/catalog/cards/global_mmlu/zh 2026-05-27T11:53:38,576 copying src/unitxt/catalog/cards/global_mmlu/zh/human_aging.json -> build/lib/unitxt/catalog/cards/global_mmlu/zh 2026-05-27T11:53:38,578 copying src/unitxt/catalog/cards/global_mmlu/zh/electrical_engineering.json -> build/lib/unitxt/catalog/cards/global_mmlu/zh 2026-05-27T11:53:38,581 copying src/unitxt/catalog/cards/global_mmlu/zh/management.json -> build/lib/unitxt/catalog/cards/global_mmlu/zh 2026-05-27T11:53:38,583 copying src/unitxt/catalog/cards/global_mmlu/zh/high_school_world_history.json -> build/lib/unitxt/catalog/cards/global_mmlu/zh 2026-05-27T11:53:38,585 copying src/unitxt/catalog/cards/global_mmlu/zh/marketing.json -> build/lib/unitxt/catalog/cards/global_mmlu/zh 2026-05-27T11:53:38,588 copying src/unitxt/catalog/cards/global_mmlu/zh/high_school_european_history.json -> build/lib/unitxt/catalog/cards/global_mmlu/zh 2026-05-27T11:53:38,590 copying src/unitxt/catalog/cards/global_mmlu/zh/astronomy.json -> build/lib/unitxt/catalog/cards/global_mmlu/zh 2026-05-27T11:53:38,592 copying src/unitxt/catalog/cards/global_mmlu/zh/high_school_physics.json -> build/lib/unitxt/catalog/cards/global_mmlu/zh 2026-05-27T11:53:38,595 copying src/unitxt/catalog/cards/global_mmlu/zh/public_relations.json -> build/lib/unitxt/catalog/cards/global_mmlu/zh 2026-05-27T11:53:38,597 copying src/unitxt/catalog/cards/global_mmlu/zh/high_school_microeconomics.json -> build/lib/unitxt/catalog/cards/global_mmlu/zh 2026-05-27T11:53:38,599 copying src/unitxt/catalog/cards/global_mmlu/zh/virology.json -> build/lib/unitxt/catalog/cards/global_mmlu/zh 2026-05-27T11:53:38,602 copying src/unitxt/catalog/cards/global_mmlu/zh/high_school_us_history.json -> build/lib/unitxt/catalog/cards/global_mmlu/zh 2026-05-27T11:53:38,604 copying src/unitxt/catalog/cards/global_mmlu/zh/high_school_statistics.json -> build/lib/unitxt/catalog/cards/global_mmlu/zh 2026-05-27T11:53:38,606 copying src/unitxt/catalog/cards/global_mmlu/zh/miscellaneous.json -> build/lib/unitxt/catalog/cards/global_mmlu/zh 2026-05-27T11:53:38,608 copying src/unitxt/catalog/cards/global_mmlu/zh/high_school_mathematics.json -> build/lib/unitxt/catalog/cards/global_mmlu/zh 2026-05-27T11:53:38,611 copying src/unitxt/catalog/cards/global_mmlu/zh/formal_logic.json -> build/lib/unitxt/catalog/cards/global_mmlu/zh 2026-05-27T11:53:38,613 copying src/unitxt/catalog/cards/global_mmlu/zh/high_school_chemistry.json -> build/lib/unitxt/catalog/cards/global_mmlu/zh 2026-05-27T11:53:38,616 copying src/unitxt/catalog/cards/global_mmlu/zh/abstract_algebra.json -> build/lib/unitxt/catalog/cards/global_mmlu/zh 2026-05-27T11:53:38,618 copying src/unitxt/catalog/cards/global_mmlu/zh/moral_scenarios.json -> build/lib/unitxt/catalog/cards/global_mmlu/zh 2026-05-27T11:53:38,620 copying src/unitxt/catalog/cards/global_mmlu/zh/world_religions.json -> build/lib/unitxt/catalog/cards/global_mmlu/zh 2026-05-27T11:53:38,622 copying src/unitxt/catalog/cards/global_mmlu/zh/business_ethics.json -> build/lib/unitxt/catalog/cards/global_mmlu/zh 2026-05-27T11:53:38,625 copying src/unitxt/catalog/cards/global_mmlu/zh/security_studies.json -> build/lib/unitxt/catalog/cards/global_mmlu/zh 2026-05-27T11:53:38,627 copying src/unitxt/catalog/cards/global_mmlu/zh/college_medicine.json -> build/lib/unitxt/catalog/cards/global_mmlu/zh 2026-05-27T11:53:38,629 copying src/unitxt/catalog/cards/global_mmlu/zh/human_sexuality.json -> build/lib/unitxt/catalog/cards/global_mmlu/zh 2026-05-27T11:53:38,631 copying src/unitxt/catalog/cards/global_mmlu/zh/prehistory.json -> build/lib/unitxt/catalog/cards/global_mmlu/zh 2026-05-27T11:53:38,634 creating build/lib/unitxt/catalog/cards/xlsum 2026-05-27T11:53:38,635 copying src/unitxt/catalog/cards/xlsum/tamil.json -> build/lib/unitxt/catalog/cards/xlsum 2026-05-27T11:53:38,637 copying src/unitxt/catalog/cards/xlsum/kyrgyz.json -> build/lib/unitxt/catalog/cards/xlsum 2026-05-27T11:53:38,639 copying src/unitxt/catalog/cards/xlsum/portuguese.json -> build/lib/unitxt/catalog/cards/xlsum 2026-05-27T11:53:38,642 copying src/unitxt/catalog/cards/xlsum/chinese_simplified.json -> build/lib/unitxt/catalog/cards/xlsum 2026-05-27T11:53:38,644 copying src/unitxt/catalog/cards/xlsum/burmese.json -> build/lib/unitxt/catalog/cards/xlsum 2026-05-27T11:53:38,646 copying src/unitxt/catalog/cards/xlsum/russian.json -> build/lib/unitxt/catalog/cards/xlsum 2026-05-27T11:53:38,648 copying src/unitxt/catalog/cards/xlsum/punjabi.json -> build/lib/unitxt/catalog/cards/xlsum 2026-05-27T11:53:38,651 copying src/unitxt/catalog/cards/xlsum/tigrinya.json -> build/lib/unitxt/catalog/cards/xlsum 2026-05-27T11:53:38,653 copying src/unitxt/catalog/cards/xlsum/telugu.json -> build/lib/unitxt/catalog/cards/xlsum 2026-05-27T11:53:38,655 copying src/unitxt/catalog/cards/xlsum/swahili.json -> build/lib/unitxt/catalog/cards/xlsum 2026-05-27T11:53:38,658 copying src/unitxt/catalog/cards/xlsum/sinhala.json -> build/lib/unitxt/catalog/cards/xlsum 2026-05-27T11:53:38,660 copying src/unitxt/catalog/cards/xlsum/french.json -> build/lib/unitxt/catalog/cards/xlsum 2026-05-27T11:53:38,662 copying src/unitxt/catalog/cards/xlsum/spanish.json -> build/lib/unitxt/catalog/cards/xlsum 2026-05-27T11:53:38,664 copying src/unitxt/catalog/cards/xlsum/azerbaijani.json -> build/lib/unitxt/catalog/cards/xlsum 2026-05-27T11:53:38,667 copying src/unitxt/catalog/cards/xlsum/persian.json -> build/lib/unitxt/catalog/cards/xlsum 2026-05-27T11:53:38,669 copying src/unitxt/catalog/cards/xlsum/serbian_cyrillic.json -> build/lib/unitxt/catalog/cards/xlsum 2026-05-27T11:53:38,672 copying src/unitxt/catalog/cards/xlsum/english.json -> build/lib/unitxt/catalog/cards/xlsum 2026-05-27T11:53:38,674 copying src/unitxt/catalog/cards/xlsum/hausa.json -> build/lib/unitxt/catalog/cards/xlsum 2026-05-27T11:53:38,676 copying src/unitxt/catalog/cards/xlsum/welsh.json -> build/lib/unitxt/catalog/cards/xlsum 2026-05-27T11:53:38,679 copying src/unitxt/catalog/cards/xlsum/vietnamese.json -> build/lib/unitxt/catalog/cards/xlsum 2026-05-27T11:53:38,681 copying src/unitxt/catalog/cards/xlsum/indonesian.json -> build/lib/unitxt/catalog/cards/xlsum 2026-05-27T11:53:38,683 copying src/unitxt/catalog/cards/xlsum/somali.json -> build/lib/unitxt/catalog/cards/xlsum 2026-05-27T11:53:38,686 copying src/unitxt/catalog/cards/xlsum/hindi.json -> build/lib/unitxt/catalog/cards/xlsum 2026-05-27T11:53:38,688 copying src/unitxt/catalog/cards/xlsum/bengali.json -> build/lib/unitxt/catalog/cards/xlsum 2026-05-27T11:53:38,690 copying src/unitxt/catalog/cards/xlsum/nepali.json -> build/lib/unitxt/catalog/cards/xlsum 2026-05-27T11:53:38,692 copying src/unitxt/catalog/cards/xlsum/urdu.json -> build/lib/unitxt/catalog/cards/xlsum 2026-05-27T11:53:38,694 copying src/unitxt/catalog/cards/xlsum/serbian_latin.json -> build/lib/unitxt/catalog/cards/xlsum 2026-05-27T11:53:38,697 copying src/unitxt/catalog/cards/xlsum/scottish_gaelic.json -> build/lib/unitxt/catalog/cards/xlsum 2026-05-27T11:53:38,699 copying src/unitxt/catalog/cards/xlsum/kirundi.json -> build/lib/unitxt/catalog/cards/xlsum 2026-05-27T11:53:38,702 copying src/unitxt/catalog/cards/xlsum/arabic.json -> build/lib/unitxt/catalog/cards/xlsum 2026-05-27T11:53:38,704 copying src/unitxt/catalog/cards/xlsum/marathi.json -> build/lib/unitxt/catalog/cards/xlsum 2026-05-27T11:53:38,707 copying src/unitxt/catalog/cards/xlsum/korean.json -> build/lib/unitxt/catalog/cards/xlsum 2026-05-27T11:53:38,709 copying src/unitxt/catalog/cards/xlsum/amharic.json -> build/lib/unitxt/catalog/cards/xlsum 2026-05-27T11:53:38,712 copying src/unitxt/catalog/cards/xlsum/pidgin.json -> build/lib/unitxt/catalog/cards/xlsum 2026-05-27T11:53:38,714 copying src/unitxt/catalog/cards/xlsum/turkish.json -> build/lib/unitxt/catalog/cards/xlsum 2026-05-27T11:53:38,717 copying src/unitxt/catalog/cards/xlsum/japanese.json -> build/lib/unitxt/catalog/cards/xlsum 2026-05-27T11:53:38,719 copying src/unitxt/catalog/cards/xlsum/gujarati.json -> build/lib/unitxt/catalog/cards/xlsum 2026-05-27T11:53:38,721 copying src/unitxt/catalog/cards/xlsum/oromo.json -> build/lib/unitxt/catalog/cards/xlsum 2026-05-27T11:53:38,723 copying src/unitxt/catalog/cards/xlsum/uzbek.json -> build/lib/unitxt/catalog/cards/xlsum 2026-05-27T11:53:38,726 copying src/unitxt/catalog/cards/xlsum/ukrainian.json -> build/lib/unitxt/catalog/cards/xlsum 2026-05-27T11:53:38,728 copying src/unitxt/catalog/cards/xlsum/igbo.json -> build/lib/unitxt/catalog/cards/xlsum 2026-05-27T11:53:38,730 copying src/unitxt/catalog/cards/xlsum/chinese_traditional.json -> build/lib/unitxt/catalog/cards/xlsum 2026-05-27T11:53:38,733 copying src/unitxt/catalog/cards/xlsum/thai.json -> build/lib/unitxt/catalog/cards/xlsum 2026-05-27T11:53:38,735 copying src/unitxt/catalog/cards/xlsum/yoruba.json -> build/lib/unitxt/catalog/cards/xlsum 2026-05-27T11:53:38,737 copying src/unitxt/catalog/cards/xlsum/pashto.json -> build/lib/unitxt/catalog/cards/xlsum 2026-05-27T11:53:38,740 creating build/lib/unitxt/catalog/cards/rag_eval/faithfulness/ragbench 2026-05-27T11:53:38,742 copying src/unitxt/catalog/cards/rag_eval/faithfulness/ragbench/expertqa.json -> build/lib/unitxt/catalog/cards/rag_eval/faithfulness/ragbench 2026-05-27T11:53:38,744 copying src/unitxt/catalog/cards/rag_eval/faithfulness/ragbench/cuad.json -> build/lib/unitxt/catalog/cards/rag_eval/faithfulness/ragbench 2026-05-27T11:53:38,747 copying src/unitxt/catalog/cards/rag_eval/faithfulness/ragbench/hotpotqa.json -> build/lib/unitxt/catalog/cards/rag_eval/faithfulness/ragbench 2026-05-27T11:53:38,749 copying src/unitxt/catalog/cards/rag_eval/faithfulness/ragbench/pubmedqa.json -> build/lib/unitxt/catalog/cards/rag_eval/faithfulness/ragbench 2026-05-27T11:53:38,751 copying src/unitxt/catalog/cards/rag_eval/faithfulness/ragbench/techqa.json -> build/lib/unitxt/catalog/cards/rag_eval/faithfulness/ragbench 2026-05-27T11:53:38,753 copying src/unitxt/catalog/cards/rag_eval/faithfulness/ragbench/hagrid.json -> build/lib/unitxt/catalog/cards/rag_eval/faithfulness/ragbench 2026-05-27T11:53:38,756 copying src/unitxt/catalog/cards/rag_eval/faithfulness/ragbench/msmarco.json -> build/lib/unitxt/catalog/cards/rag_eval/faithfulness/ragbench 2026-05-27T11:53:38,758 copying src/unitxt/catalog/cards/rag_eval/faithfulness/ragbench/delucionqa.json -> build/lib/unitxt/catalog/cards/rag_eval/faithfulness/ragbench 2026-05-27T11:53:38,760 copying src/unitxt/catalog/cards/rag_eval/faithfulness/ragbench/finqa.json -> build/lib/unitxt/catalog/cards/rag_eval/faithfulness/ragbench 2026-05-27T11:53:38,762 copying src/unitxt/catalog/cards/rag_eval/faithfulness/ragbench/covidqa.json -> build/lib/unitxt/catalog/cards/rag_eval/faithfulness/ragbench 2026-05-27T11:53:38,764 copying src/unitxt/catalog/cards/rag_eval/faithfulness/ragbench/tatqa.json -> build/lib/unitxt/catalog/cards/rag_eval/faithfulness/ragbench 2026-05-27T11:53:38,767 copying src/unitxt/catalog/cards/rag_eval/faithfulness/ragbench/emanual.json -> build/lib/unitxt/catalog/cards/rag_eval/faithfulness/ragbench 2026-05-27T11:53:38,769 creating build/lib/unitxt/catalog/cards/head_qa 2026-05-27T11:53:38,770 copying src/unitxt/catalog/cards/head_qa/gl.json -> build/lib/unitxt/catalog/cards/head_qa 2026-05-27T11:53:38,772 copying src/unitxt/catalog/cards/head_qa/it.json -> build/lib/unitxt/catalog/cards/head_qa 2026-05-27T11:53:38,774 copying src/unitxt/catalog/cards/head_qa/ru.json -> build/lib/unitxt/catalog/cards/head_qa 2026-05-27T11:53:38,777 copying src/unitxt/catalog/cards/head_qa/es.json -> build/lib/unitxt/catalog/cards/head_qa 2026-05-27T11:53:38,779 copying src/unitxt/catalog/cards/head_qa/en.json -> build/lib/unitxt/catalog/cards/head_qa 2026-05-27T11:53:38,782 creating build/lib/unitxt/catalog/cards/bfcl 2026-05-27T11:53:38,783 copying src/unitxt/catalog/cards/bfcl/simple_v3.json -> build/lib/unitxt/catalog/cards/bfcl 2026-05-27T11:53:38,785 creating build/lib/unitxt/catalog/cards/bfcl/multi_turn 2026-05-27T11:53:38,786 copying src/unitxt/catalog/cards/bfcl/multi_turn/parallel_multiple_v3.json -> build/lib/unitxt/catalog/cards/bfcl/multi_turn 2026-05-27T11:53:38,789 copying src/unitxt/catalog/cards/bfcl/multi_turn/live_parallel_v3.json -> build/lib/unitxt/catalog/cards/bfcl/multi_turn 2026-05-27T11:53:38,791 copying src/unitxt/catalog/cards/bfcl/multi_turn/parallel_v3.json -> build/lib/unitxt/catalog/cards/bfcl/multi_turn 2026-05-27T11:53:38,793 copying src/unitxt/catalog/cards/bfcl/multi_turn/javascript_v3.json -> build/lib/unitxt/catalog/cards/bfcl/multi_turn 2026-05-27T11:53:38,796 copying src/unitxt/catalog/cards/bfcl/multi_turn/live_relevance_v3.json -> build/lib/unitxt/catalog/cards/bfcl/multi_turn 2026-05-27T11:53:38,798 copying src/unitxt/catalog/cards/bfcl/multi_turn/live_irrelevance_v3.json -> build/lib/unitxt/catalog/cards/bfcl/multi_turn 2026-05-27T11:53:38,800 copying src/unitxt/catalog/cards/bfcl/multi_turn/live_simple_v3.json -> build/lib/unitxt/catalog/cards/bfcl/multi_turn 2026-05-27T11:53:38,803 copying src/unitxt/catalog/cards/bfcl/multi_turn/live_multiple_v3.json -> build/lib/unitxt/catalog/cards/bfcl/multi_turn 2026-05-27T11:53:38,805 copying src/unitxt/catalog/cards/bfcl/multi_turn/live_parallel_multiple_v3.json -> build/lib/unitxt/catalog/cards/bfcl/multi_turn 2026-05-27T11:53:38,808 copying src/unitxt/catalog/cards/bfcl/multi_turn/simple_v3.json -> build/lib/unitxt/catalog/cards/bfcl/multi_turn 2026-05-27T11:53:38,810 copying src/unitxt/catalog/cards/bfcl/multi_turn/java_v3.json -> build/lib/unitxt/catalog/cards/bfcl/multi_turn 2026-05-27T11:53:38,812 copying src/unitxt/catalog/cards/bfcl/multi_turn/multiple_v3.json -> build/lib/unitxt/catalog/cards/bfcl/multi_turn 2026-05-27T11:53:38,814 creating build/lib/unitxt/catalog/cards/reward_bench 2026-05-27T11:53:38,816 copying src/unitxt/catalog/cards/reward_bench/reasoning.json -> build/lib/unitxt/catalog/cards/reward_bench 2026-05-27T11:53:38,818 copying src/unitxt/catalog/cards/reward_bench/chat_hard.json -> build/lib/unitxt/catalog/cards/reward_bench 2026-05-27T11:53:38,820 copying src/unitxt/catalog/cards/reward_bench/chat.json -> build/lib/unitxt/catalog/cards/reward_bench 2026-05-27T11:53:38,822 copying src/unitxt/catalog/cards/reward_bench/safety.json -> build/lib/unitxt/catalog/cards/reward_bench 2026-05-27T11:53:38,825 creating build/lib/unitxt/catalog/cards/go_emotions 2026-05-27T11:53:38,826 copying src/unitxt/catalog/cards/go_emotions/simplified.json -> build/lib/unitxt/catalog/cards/go_emotions 2026-05-27T11:53:38,828 creating build/lib/unitxt/catalog/cards/ai2_arc 2026-05-27T11:53:38,829 copying src/unitxt/catalog/cards/ai2_arc/arc_challenge.json -> build/lib/unitxt/catalog/cards/ai2_arc 2026-05-27T11:53:38,831 copying src/unitxt/catalog/cards/ai2_arc/arc_easy.json -> build/lib/unitxt/catalog/cards/ai2_arc 2026-05-27T11:53:38,834 creating build/lib/unitxt/catalog/cards/coedit 2026-05-27T11:53:38,835 copying src/unitxt/catalog/cards/coedit/paraphrase.json -> build/lib/unitxt/catalog/cards/coedit 2026-05-27T11:53:38,837 copying src/unitxt/catalog/cards/coedit/selection.json -> build/lib/unitxt/catalog/cards/coedit 2026-05-27T11:53:38,839 copying src/unitxt/catalog/cards/coedit/rewriting.json -> build/lib/unitxt/catalog/cards/coedit 2026-05-27T11:53:38,842 copying src/unitxt/catalog/cards/coedit/preference.json -> build/lib/unitxt/catalog/cards/coedit 2026-05-27T11:53:38,844 creating build/lib/unitxt/catalog/cards/xwinogrande 2026-05-27T11:53:38,845 copying src/unitxt/catalog/cards/xwinogrande/zh.json -> build/lib/unitxt/catalog/cards/xwinogrande 2026-05-27T11:53:38,847 copying src/unitxt/catalog/cards/xwinogrande/ru.json -> build/lib/unitxt/catalog/cards/xwinogrande 2026-05-27T11:53:38,849 copying src/unitxt/catalog/cards/xwinogrande/en.json -> build/lib/unitxt/catalog/cards/xwinogrande 2026-05-27T11:53:38,852 copying src/unitxt/catalog/cards/xwinogrande/jp.json -> build/lib/unitxt/catalog/cards/xwinogrande 2026-05-27T11:53:38,854 copying src/unitxt/catalog/cards/xwinogrande/pt.json -> build/lib/unitxt/catalog/cards/xwinogrande 2026-05-27T11:53:38,856 creating build/lib/unitxt/catalog/cards/text2sql 2026-05-27T11:53:38,857 copying src/unitxt/catalog/cards/text2sql/bird.json -> build/lib/unitxt/catalog/cards/text2sql 2026-05-27T11:53:38,859 creating build/lib/unitxt/catalog/cards/mt_bench/generation 2026-05-27T11:53:38,861 copying src/unitxt/catalog/cards/mt_bench/generation/english_single_turn.json -> build/lib/unitxt/catalog/cards/mt_bench/generation 2026-05-27T11:53:38,864 copying src/unitxt/catalog/cards/mt_bench/generation/japanese_single_turn.json -> build/lib/unitxt/catalog/cards/mt_bench/generation 2026-05-27T11:53:38,866 creating build/lib/unitxt/catalog/cards/mt_bench/response_assessment/pairwise_comparison 2026-05-27T11:53:38,868 copying src/unitxt/catalog/cards/mt_bench/response_assessment/pairwise_comparison/multi_turn_with_reference_gpt4_judgement.json -> build/lib/unitxt/catalog/cards/mt_bench/response_assessment/pairwise_comparison 2026-05-27T11:53:38,870 copying src/unitxt/catalog/cards/mt_bench/response_assessment/pairwise_comparison/single_turn_gpt4_judgement.json -> build/lib/unitxt/catalog/cards/mt_bench/response_assessment/pairwise_comparison 2026-05-27T11:53:38,873 copying src/unitxt/catalog/cards/mt_bench/response_assessment/pairwise_comparison/multi_turn_gpt4_judgement.json -> build/lib/unitxt/catalog/cards/mt_bench/response_assessment/pairwise_comparison 2026-05-27T11:53:38,875 copying src/unitxt/catalog/cards/mt_bench/response_assessment/pairwise_comparison/single_turn_with_reference_gpt4_judgement.json -> build/lib/unitxt/catalog/cards/mt_bench/response_assessment/pairwise_comparison 2026-05-27T11:53:38,878 creating build/lib/unitxt/catalog/cards/mt_bench/response_assessment/rating 2026-05-27T11:53:38,879 copying src/unitxt/catalog/cards/mt_bench/response_assessment/rating/multi_turn_with_reference_gpt4_judgement.json -> build/lib/unitxt/catalog/cards/mt_bench/response_assessment/rating 2026-05-27T11:53:38,881 copying src/unitxt/catalog/cards/mt_bench/response_assessment/rating/single_turn_gpt4_judgement.json -> build/lib/unitxt/catalog/cards/mt_bench/response_assessment/rating 2026-05-27T11:53:38,883 copying src/unitxt/catalog/cards/mt_bench/response_assessment/rating/multi_turn_gpt4_judgement.json -> build/lib/unitxt/catalog/cards/mt_bench/response_assessment/rating 2026-05-27T11:53:38,885 copying src/unitxt/catalog/cards/mt_bench/response_assessment/rating/single_turn_with_reference_gpt4_judgement.json -> build/lib/unitxt/catalog/cards/mt_bench/response_assessment/rating 2026-05-27T11:53:38,888 creating build/lib/unitxt/catalog/cards/boolq 2026-05-27T11:53:38,889 copying src/unitxt/catalog/cards/boolq/classification.json -> build/lib/unitxt/catalog/cards/boolq 2026-05-27T11:53:38,891 copying src/unitxt/catalog/cards/boolq/multiple_choice.json -> build/lib/unitxt/catalog/cards/boolq 2026-05-27T11:53:38,893 creating build/lib/unitxt/catalog/cards/arena_hard/generation 2026-05-27T11:53:38,895 copying src/unitxt/catalog/cards/arena_hard/generation/english_gpt_4_0314_reference.json -> build/lib/unitxt/catalog/cards/arena_hard/generation 2026-05-27T11:53:38,897 creating build/lib/unitxt/catalog/cards/arena_hard/response_assessment/pairwise_comparative_rating 2026-05-27T11:53:38,899 copying src/unitxt/catalog/cards/arena_hard/response_assessment/pairwise_comparative_rating/both_games_mean_judgment_gpt4_judge.json -> build/lib/unitxt/catalog/cards/arena_hard/response_assessment/pairwise_comparative_rating 2026-05-27T11:53:38,901 copying src/unitxt/catalog/cards/arena_hard/response_assessment/pairwise_comparative_rating/first_game_only_gpt_4_judge.json -> build/lib/unitxt/catalog/cards/arena_hard/response_assessment/pairwise_comparative_rating 2026-05-27T11:53:38,903 copying src/unitxt/catalog/cards/arena_hard/response_assessment/pairwise_comparative_rating/both_games_gpt_4_judge.json -> build/lib/unitxt/catalog/cards/arena_hard/response_assessment/pairwise_comparative_rating 2026-05-27T11:53:38,906 creating build/lib/unitxt/catalog/cards/cohere_for_ai/dolly_machine_translated 2026-05-27T11:53:38,907 copying src/unitxt/catalog/cards/cohere_for_ai/dolly_machine_translated/deu.json -> build/lib/unitxt/catalog/cards/cohere_for_ai/dolly_machine_translated 2026-05-27T11:53:38,910 copying src/unitxt/catalog/cards/cohere_for_ai/dolly_machine_translated/por.json -> build/lib/unitxt/catalog/cards/cohere_for_ai/dolly_machine_translated 2026-05-27T11:53:38,912 copying src/unitxt/catalog/cards/cohere_for_ai/dolly_machine_translated/fra.json -> build/lib/unitxt/catalog/cards/cohere_for_ai/dolly_machine_translated 2026-05-27T11:53:38,915 copying src/unitxt/catalog/cards/cohere_for_ai/dolly_machine_translated/spa.json -> build/lib/unitxt/catalog/cards/cohere_for_ai/dolly_machine_translated 2026-05-27T11:53:38,917 copying src/unitxt/catalog/cards/cohere_for_ai/dolly_machine_translated/eng.json -> build/lib/unitxt/catalog/cards/cohere_for_ai/dolly_machine_translated 2026-05-27T11:53:38,920 copying src/unitxt/catalog/cards/cohere_for_ai/dolly_machine_translated/jpn.json -> build/lib/unitxt/catalog/cards/cohere_for_ai/dolly_machine_translated 2026-05-27T11:53:38,922 creating build/lib/unitxt/catalog/cards/cohere_for_ai/dolly_human_edited 2026-05-27T11:53:38,923 copying src/unitxt/catalog/cards/cohere_for_ai/dolly_human_edited/fra.json -> build/lib/unitxt/catalog/cards/cohere_for_ai/dolly_human_edited 2026-05-27T11:53:38,925 copying src/unitxt/catalog/cards/cohere_for_ai/dolly_human_edited/spa.json -> build/lib/unitxt/catalog/cards/cohere_for_ai/dolly_human_edited 2026-05-27T11:53:38,928 creating build/lib/unitxt/catalog/cards/cohere_for_ai/aya_human_annotated 2026-05-27T11:53:38,929 copying src/unitxt/catalog/cards/cohere_for_ai/aya_human_annotated/tel.json -> build/lib/unitxt/catalog/cards/cohere_for_ai/aya_human_annotated 2026-05-27T11:53:38,931 copying src/unitxt/catalog/cards/cohere_for_ai/aya_human_annotated/arb.json -> build/lib/unitxt/catalog/cards/cohere_for_ai/aya_human_annotated 2026-05-27T11:53:38,934 copying src/unitxt/catalog/cards/cohere_for_ai/aya_human_annotated/yor.json -> build/lib/unitxt/catalog/cards/cohere_for_ai/aya_human_annotated 2026-05-27T11:53:38,936 copying src/unitxt/catalog/cards/cohere_for_ai/aya_human_annotated/por.json -> build/lib/unitxt/catalog/cards/cohere_for_ai/aya_human_annotated 2026-05-27T11:53:38,938 copying src/unitxt/catalog/cards/cohere_for_ai/aya_human_annotated/tur.json -> build/lib/unitxt/catalog/cards/cohere_for_ai/aya_human_annotated 2026-05-27T11:53:38,941 copying src/unitxt/catalog/cards/cohere_for_ai/aya_human_annotated/eng.json -> build/lib/unitxt/catalog/cards/cohere_for_ai/aya_human_annotated 2026-05-27T11:53:38,943 copying src/unitxt/catalog/cards/cohere_for_ai/aya_human_annotated/zho.json -> build/lib/unitxt/catalog/cards/cohere_for_ai/aya_human_annotated 2026-05-27T11:53:38,945 creating build/lib/unitxt/catalog/cards/global_mmlu_lite_cs 2026-05-27T11:53:38,946 copying src/unitxt/catalog/cards/global_mmlu_lite_cs/ja.json -> build/lib/unitxt/catalog/cards/global_mmlu_lite_cs 2026-05-27T11:53:38,949 copying src/unitxt/catalog/cards/global_mmlu_lite_cs/zh.json -> build/lib/unitxt/catalog/cards/global_mmlu_lite_cs 2026-05-27T11:53:38,951 copying src/unitxt/catalog/cards/global_mmlu_lite_cs/bn.json -> build/lib/unitxt/catalog/cards/global_mmlu_lite_cs 2026-05-27T11:53:38,954 copying src/unitxt/catalog/cards/global_mmlu_lite_cs/ko.json -> build/lib/unitxt/catalog/cards/global_mmlu_lite_cs 2026-05-27T11:53:38,957 copying src/unitxt/catalog/cards/global_mmlu_lite_cs/de.json -> build/lib/unitxt/catalog/cards/global_mmlu_lite_cs 2026-05-27T11:53:38,959 copying src/unitxt/catalog/cards/global_mmlu_lite_cs/it.json -> build/lib/unitxt/catalog/cards/global_mmlu_lite_cs 2026-05-27T11:53:38,962 copying src/unitxt/catalog/cards/global_mmlu_lite_cs/fr.json -> build/lib/unitxt/catalog/cards/global_mmlu_lite_cs 2026-05-27T11:53:38,964 copying src/unitxt/catalog/cards/global_mmlu_lite_cs/ar.json -> build/lib/unitxt/catalog/cards/global_mmlu_lite_cs 2026-05-27T11:53:38,967 copying src/unitxt/catalog/cards/global_mmlu_lite_cs/es.json -> build/lib/unitxt/catalog/cards/global_mmlu_lite_cs 2026-05-27T11:53:38,970 copying src/unitxt/catalog/cards/global_mmlu_lite_cs/yo.json -> build/lib/unitxt/catalog/cards/global_mmlu_lite_cs 2026-05-27T11:53:38,973 copying src/unitxt/catalog/cards/global_mmlu_lite_cs/pt.json -> build/lib/unitxt/catalog/cards/global_mmlu_lite_cs 2026-05-27T11:53:38,975 copying src/unitxt/catalog/cards/global_mmlu_lite_cs/sw.json -> build/lib/unitxt/catalog/cards/global_mmlu_lite_cs 2026-05-27T11:53:38,978 copying src/unitxt/catalog/cards/global_mmlu_lite_cs/hi.json -> build/lib/unitxt/catalog/cards/global_mmlu_lite_cs 2026-05-27T11:53:38,980 copying src/unitxt/catalog/cards/global_mmlu_lite_cs/id.json -> build/lib/unitxt/catalog/cards/global_mmlu_lite_cs 2026-05-27T11:53:38,983 creating build/lib/unitxt/catalog/cards/global_mmlu_lite_ca 2026-05-27T11:53:38,984 copying src/unitxt/catalog/cards/global_mmlu_lite_ca/ja.json -> build/lib/unitxt/catalog/cards/global_mmlu_lite_ca 2026-05-27T11:53:38,987 copying src/unitxt/catalog/cards/global_mmlu_lite_ca/zh.json -> build/lib/unitxt/catalog/cards/global_mmlu_lite_ca 2026-05-27T11:53:38,990 copying src/unitxt/catalog/cards/global_mmlu_lite_ca/bn.json -> build/lib/unitxt/catalog/cards/global_mmlu_lite_ca 2026-05-27T11:53:38,993 copying src/unitxt/catalog/cards/global_mmlu_lite_ca/ko.json -> build/lib/unitxt/catalog/cards/global_mmlu_lite_ca 2026-05-27T11:53:38,995 copying src/unitxt/catalog/cards/global_mmlu_lite_ca/de.json -> build/lib/unitxt/catalog/cards/global_mmlu_lite_ca 2026-05-27T11:53:38,998 copying src/unitxt/catalog/cards/global_mmlu_lite_ca/it.json -> build/lib/unitxt/catalog/cards/global_mmlu_lite_ca 2026-05-27T11:53:39,001 copying src/unitxt/catalog/cards/global_mmlu_lite_ca/fr.json -> build/lib/unitxt/catalog/cards/global_mmlu_lite_ca 2026-05-27T11:53:39,004 copying src/unitxt/catalog/cards/global_mmlu_lite_ca/ar.json -> build/lib/unitxt/catalog/cards/global_mmlu_lite_ca 2026-05-27T11:53:39,006 copying src/unitxt/catalog/cards/global_mmlu_lite_ca/es.json -> build/lib/unitxt/catalog/cards/global_mmlu_lite_ca 2026-05-27T11:53:39,009 copying src/unitxt/catalog/cards/global_mmlu_lite_ca/yo.json -> build/lib/unitxt/catalog/cards/global_mmlu_lite_ca 2026-05-27T11:53:39,011 copying src/unitxt/catalog/cards/global_mmlu_lite_ca/pt.json -> build/lib/unitxt/catalog/cards/global_mmlu_lite_ca 2026-05-27T11:53:39,014 copying src/unitxt/catalog/cards/global_mmlu_lite_ca/sw.json -> build/lib/unitxt/catalog/cards/global_mmlu_lite_ca 2026-05-27T11:53:39,017 copying src/unitxt/catalog/cards/global_mmlu_lite_ca/hi.json -> build/lib/unitxt/catalog/cards/global_mmlu_lite_ca 2026-05-27T11:53:39,019 copying src/unitxt/catalog/cards/global_mmlu_lite_ca/id.json -> build/lib/unitxt/catalog/cards/global_mmlu_lite_ca 2026-05-27T11:53:39,022 creating build/lib/unitxt/catalog/cards/tot 2026-05-27T11:53:39,023 copying src/unitxt/catalog/cards/tot/arithmetic.json -> build/lib/unitxt/catalog/cards/tot 2026-05-27T11:53:39,025 copying src/unitxt/catalog/cards/tot/semantic.json -> build/lib/unitxt/catalog/cards/tot 2026-05-27T11:53:39,027 creating build/lib/unitxt/catalog/cards/amazon_mass 2026-05-27T11:53:39,028 copying src/unitxt/catalog/cards/amazon_mass/th_TH.json -> build/lib/unitxt/catalog/cards/amazon_mass 2026-05-27T11:53:39,031 copying src/unitxt/catalog/cards/amazon_mass/ro_RO.json -> build/lib/unitxt/catalog/cards/amazon_mass 2026-05-27T11:53:39,034 copying src/unitxt/catalog/cards/amazon_mass/da_DK.json -> build/lib/unitxt/catalog/cards/amazon_mass 2026-05-27T11:53:39,037 copying src/unitxt/catalog/cards/amazon_mass/nb_NO.json -> build/lib/unitxt/catalog/cards/amazon_mass 2026-05-27T11:53:39,040 copying src/unitxt/catalog/cards/amazon_mass/zh_TW.json -> build/lib/unitxt/catalog/cards/amazon_mass 2026-05-27T11:53:39,042 copying src/unitxt/catalog/cards/amazon_mass/nl_NL.json -> build/lib/unitxt/catalog/cards/amazon_mass 2026-05-27T11:53:39,045 copying src/unitxt/catalog/cards/amazon_mass/is_IS.json -> build/lib/unitxt/catalog/cards/amazon_mass 2026-05-27T11:53:39,048 copying src/unitxt/catalog/cards/amazon_mass/de_DE.json -> build/lib/unitxt/catalog/cards/amazon_mass 2026-05-27T11:53:39,051 copying src/unitxt/catalog/cards/amazon_mass/hi_IN.json -> build/lib/unitxt/catalog/cards/amazon_mass 2026-05-27T11:53:39,053 copying src/unitxt/catalog/cards/amazon_mass/es_ES.json -> build/lib/unitxt/catalog/cards/amazon_mass 2026-05-27T11:53:39,056 copying src/unitxt/catalog/cards/amazon_mass/fa_IR.json -> build/lib/unitxt/catalog/cards/amazon_mass 2026-05-27T11:53:39,059 copying src/unitxt/catalog/cards/amazon_mass/my_MM.json -> build/lib/unitxt/catalog/cards/amazon_mass 2026-05-27T11:53:39,061 copying src/unitxt/catalog/cards/amazon_mass/ja_JP.json -> build/lib/unitxt/catalog/cards/amazon_mass 2026-05-27T11:53:39,064 copying src/unitxt/catalog/cards/amazon_mass/he_IL.json -> build/lib/unitxt/catalog/cards/amazon_mass 2026-05-27T11:53:39,067 copying src/unitxt/catalog/cards/amazon_mass/mn_MN.json -> build/lib/unitxt/catalog/cards/amazon_mass 2026-05-27T11:53:39,070 copying src/unitxt/catalog/cards/amazon_mass/az_AZ.json -> build/lib/unitxt/catalog/cards/amazon_mass 2026-05-27T11:53:39,073 copying src/unitxt/catalog/cards/amazon_mass/am_ET.json -> build/lib/unitxt/catalog/cards/amazon_mass 2026-05-27T11:53:39,076 copying src/unitxt/catalog/cards/amazon_mass/bn_BD.json -> build/lib/unitxt/catalog/cards/amazon_mass 2026-05-27T11:53:39,079 copying src/unitxt/catalog/cards/amazon_mass/kn_IN.json -> build/lib/unitxt/catalog/cards/amazon_mass 2026-05-27T11:53:39,082 copying src/unitxt/catalog/cards/amazon_mass/tr_TR.json -> build/lib/unitxt/catalog/cards/amazon_mass 2026-05-27T11:53:39,085 copying src/unitxt/catalog/cards/amazon_mass/ru_RU.json -> build/lib/unitxt/catalog/cards/amazon_mass 2026-05-27T11:53:39,088 copying src/unitxt/catalog/cards/amazon_mass/sw_KE.json -> build/lib/unitxt/catalog/cards/amazon_mass 2026-05-27T11:53:39,091 copying src/unitxt/catalog/cards/amazon_mass/hy_AM.json -> build/lib/unitxt/catalog/cards/amazon_mass 2026-05-27T11:53:39,094 copying src/unitxt/catalog/cards/amazon_mass/fi_FI.json -> build/lib/unitxt/catalog/cards/amazon_mass 2026-05-27T11:53:39,097 copying src/unitxt/catalog/cards/amazon_mass/hu_HU.json -> build/lib/unitxt/catalog/cards/amazon_mass 2026-05-27T11:53:39,100 copying src/unitxt/catalog/cards/amazon_mass/vi_VN.json -> build/lib/unitxt/catalog/cards/amazon_mass 2026-05-27T11:53:39,103 copying src/unitxt/catalog/cards/amazon_mass/en_US.json -> build/lib/unitxt/catalog/cards/amazon_mass 2026-05-27T11:53:39,106 copying src/unitxt/catalog/cards/amazon_mass/cy_GB.json -> build/lib/unitxt/catalog/cards/amazon_mass 2026-05-27T11:53:39,109 copying src/unitxt/catalog/cards/amazon_mass/lv_LV.json -> build/lib/unitxt/catalog/cards/amazon_mass 2026-05-27T11:53:39,112 copying src/unitxt/catalog/cards/amazon_mass/el_GR.json -> build/lib/unitxt/catalog/cards/amazon_mass 2026-05-27T11:53:39,115 copying src/unitxt/catalog/cards/amazon_mass/pl_PL.json -> build/lib/unitxt/catalog/cards/amazon_mass 2026-05-27T11:53:39,118 copying src/unitxt/catalog/cards/amazon_mass/te_IN.json -> build/lib/unitxt/catalog/cards/amazon_mass 2026-05-27T11:53:39,121 copying src/unitxt/catalog/cards/amazon_mass/ca_ES.json -> build/lib/unitxt/catalog/cards/amazon_mass 2026-05-27T11:53:39,124 copying src/unitxt/catalog/cards/amazon_mass/ar_SA.json -> build/lib/unitxt/catalog/cards/amazon_mass 2026-05-27T11:53:39,127 copying src/unitxt/catalog/cards/amazon_mass/sq_AL.json -> build/lib/unitxt/catalog/cards/amazon_mass 2026-05-27T11:53:39,130 copying src/unitxt/catalog/cards/amazon_mass/jv_ID.json -> build/lib/unitxt/catalog/cards/amazon_mass 2026-05-27T11:53:39,132 copying src/unitxt/catalog/cards/amazon_mass/km_KH.json -> build/lib/unitxt/catalog/cards/amazon_mass 2026-05-27T11:53:39,135 copying src/unitxt/catalog/cards/amazon_mass/pt_PT.json -> build/lib/unitxt/catalog/cards/amazon_mass 2026-05-27T11:53:39,138 copying src/unitxt/catalog/cards/amazon_mass/zh_CN.json -> build/lib/unitxt/catalog/cards/amazon_mass 2026-05-27T11:53:39,141 copying src/unitxt/catalog/cards/amazon_mass/af_ZA.json -> build/lib/unitxt/catalog/cards/amazon_mass 2026-05-27T11:53:39,144 copying src/unitxt/catalog/cards/amazon_mass/ml_IN.json -> build/lib/unitxt/catalog/cards/amazon_mass 2026-05-27T11:53:39,147 copying src/unitxt/catalog/cards/amazon_mass/it_IT.json -> build/lib/unitxt/catalog/cards/amazon_mass 2026-05-27T11:53:39,151 copying src/unitxt/catalog/cards/amazon_mass/ms_MY.json -> build/lib/unitxt/catalog/cards/amazon_mass 2026-05-27T11:53:39,154 copying src/unitxt/catalog/cards/amazon_mass/all.json -> build/lib/unitxt/catalog/cards/amazon_mass 2026-05-27T11:53:39,157 copying src/unitxt/catalog/cards/amazon_mass/sl_SL.json -> build/lib/unitxt/catalog/cards/amazon_mass 2026-05-27T11:53:39,160 copying src/unitxt/catalog/cards/amazon_mass/id_ID.json -> build/lib/unitxt/catalog/cards/amazon_mass 2026-05-27T11:53:39,163 copying src/unitxt/catalog/cards/amazon_mass/tl_PH.json -> build/lib/unitxt/catalog/cards/amazon_mass 2026-05-27T11:53:39,165 copying src/unitxt/catalog/cards/amazon_mass/ta_IN.json -> build/lib/unitxt/catalog/cards/amazon_mass 2026-05-27T11:53:39,168 copying src/unitxt/catalog/cards/amazon_mass/ka_GE.json -> build/lib/unitxt/catalog/cards/amazon_mass 2026-05-27T11:53:39,171 copying src/unitxt/catalog/cards/amazon_mass/fr_FR.json -> build/lib/unitxt/catalog/cards/amazon_mass 2026-05-27T11:53:39,174 copying src/unitxt/catalog/cards/amazon_mass/sv_SE.json -> build/lib/unitxt/catalog/cards/amazon_mass 2026-05-27T11:53:39,177 copying src/unitxt/catalog/cards/amazon_mass/ur_PK.json -> build/lib/unitxt/catalog/cards/amazon_mass 2026-05-27T11:53:39,180 copying src/unitxt/catalog/cards/amazon_mass/ko_KR.json -> build/lib/unitxt/catalog/cards/amazon_mass 2026-05-27T11:53:39,183 creating build/lib/unitxt/catalog/cards/amazon_mass/all_1 2026-05-27T11:53:39,184 copying src/unitxt/catalog/cards/amazon_mass/all_1/1.json -> build/lib/unitxt/catalog/cards/amazon_mass/all_1 2026-05-27T11:53:39,187 creating build/lib/unitxt/catalog/cards/gpqa 2026-05-27T11:53:39,188 copying src/unitxt/catalog/cards/gpqa/extended.json -> build/lib/unitxt/catalog/cards/gpqa 2026-05-27T11:53:39,191 copying src/unitxt/catalog/cards/gpqa/diamond.json -> build/lib/unitxt/catalog/cards/gpqa 2026-05-27T11:53:39,193 copying src/unitxt/catalog/cards/gpqa/main.json -> build/lib/unitxt/catalog/cards/gpqa 2026-05-27T11:53:39,196 creating build/lib/unitxt/catalog/cards/clinc_oos 2026-05-27T11:53:39,197 copying src/unitxt/catalog/cards/clinc_oos/small.json -> build/lib/unitxt/catalog/cards/clinc_oos 2026-05-27T11:53:39,201 copying src/unitxt/catalog/cards/clinc_oos/imbalanced.json -> build/lib/unitxt/catalog/cards/clinc_oos 2026-05-27T11:53:39,204 copying src/unitxt/catalog/cards/clinc_oos/plus.json -> build/lib/unitxt/catalog/cards/clinc_oos 2026-05-27T11:53:39,207 creating build/lib/unitxt/catalog/cards/20_newsgroups 2026-05-27T11:53:39,208 copying src/unitxt/catalog/cards/20_newsgroups/sklearn.json -> build/lib/unitxt/catalog/cards/20_newsgroups 2026-05-27T11:53:39,211 creating build/lib/unitxt/catalog/cards/doc_vqa 2026-05-27T11:53:39,212 copying src/unitxt/catalog/cards/doc_vqa/fr.json -> build/lib/unitxt/catalog/cards/doc_vqa 2026-05-27T11:53:39,215 copying src/unitxt/catalog/cards/doc_vqa/en.json -> build/lib/unitxt/catalog/cards/doc_vqa 2026-05-27T11:53:39,218 copying src/unitxt/catalog/cards/doc_vqa/lmms_eval.json -> build/lib/unitxt/catalog/cards/doc_vqa 2026-05-27T11:53:39,220 creating build/lib/unitxt/catalog/cards/legalbench 2026-05-27T11:53:39,222 copying src/unitxt/catalog/cards/legalbench/proa.json -> build/lib/unitxt/catalog/cards/legalbench 2026-05-27T11:53:39,224 copying src/unitxt/catalog/cards/legalbench/international_citizenship_questions.json -> build/lib/unitxt/catalog/cards/legalbench 2026-05-27T11:53:39,227 copying src/unitxt/catalog/cards/legalbench/corporate_lobbying.json -> build/lib/unitxt/catalog/cards/legalbench 2026-05-27T11:53:39,230 copying src/unitxt/catalog/cards/legalbench/function_of_decision_section.json -> build/lib/unitxt/catalog/cards/legalbench 2026-05-27T11:53:39,232 copying src/unitxt/catalog/cards/legalbench/abercrombie.json -> build/lib/unitxt/catalog/cards/legalbench 2026-05-27T11:53:39,235 creating build/lib/unitxt/catalog/cards/mlsum 2026-05-27T11:53:39,236 copying src/unitxt/catalog/cards/mlsum/de.json -> build/lib/unitxt/catalog/cards/mlsum 2026-05-27T11:53:39,239 copying src/unitxt/catalog/cards/mlsum/ru.json -> build/lib/unitxt/catalog/cards/mlsum 2026-05-27T11:53:39,242 copying src/unitxt/catalog/cards/mlsum/fr.json -> build/lib/unitxt/catalog/cards/mlsum 2026-05-27T11:53:39,244 copying src/unitxt/catalog/cards/mlsum/es.json -> build/lib/unitxt/catalog/cards/mlsum 2026-05-27T11:53:39,247 copying src/unitxt/catalog/cards/mlsum/tu.json -> build/lib/unitxt/catalog/cards/mlsum 2026-05-27T11:53:39,249 creating build/lib/unitxt/catalog/cards/multidoc2dial 2026-05-27T11:53:39,251 copying src/unitxt/catalog/cards/multidoc2dial/abstractive.json -> build/lib/unitxt/catalog/cards/multidoc2dial 2026-05-27T11:53:39,253 copying src/unitxt/catalog/cards/multidoc2dial/extractive.json -> build/lib/unitxt/catalog/cards/multidoc2dial 2026-05-27T11:53:39,256 creating build/lib/unitxt/catalog/cards/babi 2026-05-27T11:53:39,258 copying src/unitxt/catalog/cards/babi/qa.json -> build/lib/unitxt/catalog/cards/babi 2026-05-27T11:53:39,260 creating build/lib/unitxt/catalog/cards/boolq_indic/hi 2026-05-27T11:53:39,262 copying src/unitxt/catalog/cards/boolq_indic/hi/classification.json -> build/lib/unitxt/catalog/cards/boolq_indic/hi 2026-05-27T11:53:39,265 copying src/unitxt/catalog/cards/boolq_indic/hi/multiple_choice.json -> build/lib/unitxt/catalog/cards/boolq_indic/hi 2026-05-27T11:53:39,268 creating build/lib/unitxt/catalog/cards/boolq_indic/bn 2026-05-27T11:53:39,269 copying src/unitxt/catalog/cards/boolq_indic/bn/classification.json -> build/lib/unitxt/catalog/cards/boolq_indic/bn 2026-05-27T11:53:39,272 copying src/unitxt/catalog/cards/boolq_indic/bn/multiple_choice.json -> build/lib/unitxt/catalog/cards/boolq_indic/bn 2026-05-27T11:53:39,274 creating build/lib/unitxt/catalog/cards/boolq_indic/ta 2026-05-27T11:53:39,275 copying src/unitxt/catalog/cards/boolq_indic/ta/classification.json -> build/lib/unitxt/catalog/cards/boolq_indic/ta 2026-05-27T11:53:39,278 copying src/unitxt/catalog/cards/boolq_indic/ta/multiple_choice.json -> build/lib/unitxt/catalog/cards/boolq_indic/ta 2026-05-27T11:53:39,280 creating build/lib/unitxt/catalog/cards/boolq_indic/mr 2026-05-27T11:53:39,282 copying src/unitxt/catalog/cards/boolq_indic/mr/classification.json -> build/lib/unitxt/catalog/cards/boolq_indic/mr 2026-05-27T11:53:39,284 copying src/unitxt/catalog/cards/boolq_indic/mr/multiple_choice.json -> build/lib/unitxt/catalog/cards/boolq_indic/mr 2026-05-27T11:53:39,287 creating build/lib/unitxt/catalog/cards/boolq_indic/te 2026-05-27T11:53:39,288 copying src/unitxt/catalog/cards/boolq_indic/te/classification.json -> build/lib/unitxt/catalog/cards/boolq_indic/te 2026-05-27T11:53:39,291 copying src/unitxt/catalog/cards/boolq_indic/te/multiple_choice.json -> build/lib/unitxt/catalog/cards/boolq_indic/te 2026-05-27T11:53:39,293 creating build/lib/unitxt/catalog/cards/boolq_indic/ml 2026-05-27T11:53:39,294 copying src/unitxt/catalog/cards/boolq_indic/ml/classification.json -> build/lib/unitxt/catalog/cards/boolq_indic/ml 2026-05-27T11:53:39,297 copying src/unitxt/catalog/cards/boolq_indic/ml/multiple_choice.json -> build/lib/unitxt/catalog/cards/boolq_indic/ml 2026-05-27T11:53:39,299 creating build/lib/unitxt/catalog/cards/boolq_indic/or 2026-05-27T11:53:39,301 copying src/unitxt/catalog/cards/boolq_indic/or/classification.json -> build/lib/unitxt/catalog/cards/boolq_indic/or 2026-05-27T11:53:39,303 copying src/unitxt/catalog/cards/boolq_indic/or/multiple_choice.json -> build/lib/unitxt/catalog/cards/boolq_indic/or 2026-05-27T11:53:39,306 creating build/lib/unitxt/catalog/cards/boolq_indic/kn 2026-05-27T11:53:39,307 copying src/unitxt/catalog/cards/boolq_indic/kn/classification.json -> build/lib/unitxt/catalog/cards/boolq_indic/kn 2026-05-27T11:53:39,310 copying src/unitxt/catalog/cards/boolq_indic/kn/multiple_choice.json -> build/lib/unitxt/catalog/cards/boolq_indic/kn 2026-05-27T11:53:39,313 creating build/lib/unitxt/catalog/cards/boolq_indic/gu 2026-05-27T11:53:39,314 copying src/unitxt/catalog/cards/boolq_indic/gu/classification.json -> build/lib/unitxt/catalog/cards/boolq_indic/gu 2026-05-27T11:53:39,317 copying src/unitxt/catalog/cards/boolq_indic/gu/multiple_choice.json -> build/lib/unitxt/catalog/cards/boolq_indic/gu 2026-05-27T11:53:39,319 creating build/lib/unitxt/catalog/cards/boolq_indic/pa 2026-05-27T11:53:39,321 copying src/unitxt/catalog/cards/boolq_indic/pa/classification.json -> build/lib/unitxt/catalog/cards/boolq_indic/pa 2026-05-27T11:53:39,323 copying src/unitxt/catalog/cards/boolq_indic/pa/multiple_choice.json -> build/lib/unitxt/catalog/cards/boolq_indic/pa 2026-05-27T11:53:39,326 creating build/lib/unitxt/catalog/cards/xnli 2026-05-27T11:53:39,327 copying src/unitxt/catalog/cards/xnli/zh.json -> build/lib/unitxt/catalog/cards/xnli 2026-05-27T11:53:39,330 copying src/unitxt/catalog/cards/xnli/bg.json -> build/lib/unitxt/catalog/cards/xnli 2026-05-27T11:53:39,332 copying src/unitxt/catalog/cards/xnli/de.json -> build/lib/unitxt/catalog/cards/xnli 2026-05-27T11:53:39,335 copying src/unitxt/catalog/cards/xnli/th.json -> build/lib/unitxt/catalog/cards/xnli 2026-05-27T11:53:39,337 copying src/unitxt/catalog/cards/xnli/ru.json -> build/lib/unitxt/catalog/cards/xnli 2026-05-27T11:53:39,340 copying src/unitxt/catalog/cards/xnli/fr.json -> build/lib/unitxt/catalog/cards/xnli 2026-05-27T11:53:39,343 copying src/unitxt/catalog/cards/xnli/ar.json -> build/lib/unitxt/catalog/cards/xnli 2026-05-27T11:53:39,345 copying src/unitxt/catalog/cards/xnli/es.json -> build/lib/unitxt/catalog/cards/xnli 2026-05-27T11:53:39,348 copying src/unitxt/catalog/cards/xnli/en.json -> build/lib/unitxt/catalog/cards/xnli 2026-05-27T11:53:39,350 copying src/unitxt/catalog/cards/xnli/ur.json -> build/lib/unitxt/catalog/cards/xnli 2026-05-27T11:53:39,352 copying src/unitxt/catalog/cards/xnli/sw.json -> build/lib/unitxt/catalog/cards/xnli 2026-05-27T11:53:39,354 copying src/unitxt/catalog/cards/xnli/hi.json -> build/lib/unitxt/catalog/cards/xnli 2026-05-27T11:53:39,357 copying src/unitxt/catalog/cards/xnli/tr.json -> build/lib/unitxt/catalog/cards/xnli 2026-05-27T11:53:39,359 copying src/unitxt/catalog/cards/xnli/vi.json -> build/lib/unitxt/catalog/cards/xnli 2026-05-27T11:53:39,361 copying src/unitxt/catalog/cards/xnli/el.json -> build/lib/unitxt/catalog/cards/xnli 2026-05-27T11:53:39,363 creating build/lib/unitxt/catalog/recipes/bluebench/summarization 2026-05-27T11:53:39,365 copying src/unitxt/catalog/recipes/bluebench/summarization/tldr_document_filtered_to_6000_chars.json -> build/lib/unitxt/catalog/recipes/bluebench/summarization 2026-05-27T11:53:39,368 copying src/unitxt/catalog/recipes/bluebench/summarization/billsum_document_filtered_to_6000_chars.json -> build/lib/unitxt/catalog/recipes/bluebench/summarization 2026-05-27T11:53:39,370 creating build/lib/unitxt/catalog/recipes/bluebench/translation 2026-05-27T11:53:39,371 copying src/unitxt/catalog/recipes/bluebench/translation/mt_flores_101_eng_ara.json -> build/lib/unitxt/catalog/recipes/bluebench/translation 2026-05-27T11:53:39,373 copying src/unitxt/catalog/recipes/bluebench/translation/mt_flores_101_ara_eng.json -> build/lib/unitxt/catalog/recipes/bluebench/translation 2026-05-27T11:53:39,375 copying src/unitxt/catalog/recipes/bluebench/translation/mt_flores_101_deu_eng.json -> build/lib/unitxt/catalog/recipes/bluebench/translation 2026-05-27T11:53:39,378 copying src/unitxt/catalog/recipes/bluebench/translation/mt_flores_101_eng_deu.json -> build/lib/unitxt/catalog/recipes/bluebench/translation 2026-05-27T11:53:39,380 copying src/unitxt/catalog/recipes/bluebench/translation/mt_flores_101_kor_eng.json -> build/lib/unitxt/catalog/recipes/bluebench/translation 2026-05-27T11:53:39,382 copying src/unitxt/catalog/recipes/bluebench/translation/mt_flores_101_spa_eng.json -> build/lib/unitxt/catalog/recipes/bluebench/translation 2026-05-27T11:53:39,384 copying src/unitxt/catalog/recipes/bluebench/translation/mt_flores_101_fra_eng.json -> build/lib/unitxt/catalog/recipes/bluebench/translation 2026-05-27T11:53:39,386 copying src/unitxt/catalog/recipes/bluebench/translation/mt_flores_101_jpn_eng.json -> build/lib/unitxt/catalog/recipes/bluebench/translation 2026-05-27T11:53:39,389 copying src/unitxt/catalog/recipes/bluebench/translation/mt_flores_101_eng_por.json -> build/lib/unitxt/catalog/recipes/bluebench/translation 2026-05-27T11:53:39,391 copying src/unitxt/catalog/recipes/bluebench/translation/mt_flores_101_eng_fra.json -> build/lib/unitxt/catalog/recipes/bluebench/translation 2026-05-27T11:53:39,393 copying src/unitxt/catalog/recipes/bluebench/translation/mt_flores_101_eng_ron.json -> build/lib/unitxt/catalog/recipes/bluebench/translation 2026-05-27T11:53:39,395 copying src/unitxt/catalog/recipes/bluebench/translation/mt_flores_101_ron_eng.json -> build/lib/unitxt/catalog/recipes/bluebench/translation 2026-05-27T11:53:39,398 copying src/unitxt/catalog/recipes/bluebench/translation/mt_flores_101_por_eng.json -> build/lib/unitxt/catalog/recipes/bluebench/translation 2026-05-27T11:53:39,400 copying src/unitxt/catalog/recipes/bluebench/translation/mt_flores_101_eng_kor.json -> build/lib/unitxt/catalog/recipes/bluebench/translation 2026-05-27T11:53:39,402 copying src/unitxt/catalog/recipes/bluebench/translation/mt_flores_101_eng_spa.json -> build/lib/unitxt/catalog/recipes/bluebench/translation 2026-05-27T11:53:39,404 creating build/lib/unitxt/catalog/recipes/bluebench/rag_general 2026-05-27T11:53:39,405 copying src/unitxt/catalog/recipes/bluebench/rag_general/rag_response_generation_clapnq.json -> build/lib/unitxt/catalog/recipes/bluebench/rag_general 2026-05-27T11:53:39,408 creating build/lib/unitxt/catalog/recipes/bluebench/reasoning 2026-05-27T11:53:39,409 copying src/unitxt/catalog/recipes/bluebench/reasoning/openbook_qa.json -> build/lib/unitxt/catalog/recipes/bluebench/reasoning 2026-05-27T11:53:39,411 copying src/unitxt/catalog/recipes/bluebench/reasoning/hellaswag.json -> build/lib/unitxt/catalog/recipes/bluebench/reasoning 2026-05-27T11:53:39,413 creating build/lib/unitxt/catalog/recipes/bluebench/safety 2026-05-27T11:53:39,414 copying src/unitxt/catalog/recipes/bluebench/safety/attaq_500.json -> build/lib/unitxt/catalog/recipes/bluebench/safety 2026-05-27T11:53:39,416 creating build/lib/unitxt/catalog/recipes/bluebench/news_classification 2026-05-27T11:53:39,417 copying src/unitxt/catalog/recipes/bluebench/news_classification/20_newsgroups_short.json -> build/lib/unitxt/catalog/recipes/bluebench/news_classification 2026-05-27T11:53:39,419 creating build/lib/unitxt/catalog/recipes/bluebench/entity_extraction 2026-05-27T11:53:39,420 copying src/unitxt/catalog/recipes/bluebench/entity_extraction/universal_ner_en_ewt.json -> build/lib/unitxt/catalog/recipes/bluebench/entity_extraction 2026-05-27T11:53:39,423 creating build/lib/unitxt/catalog/recipes/bluebench/legal 2026-05-27T11:53:39,424 copying src/unitxt/catalog/recipes/bluebench/legal/legalbench_corporate_lobbying.json -> build/lib/unitxt/catalog/recipes/bluebench/legal 2026-05-27T11:53:39,426 copying src/unitxt/catalog/recipes/bluebench/legal/legalbench_function_of_decision_section.json -> build/lib/unitxt/catalog/recipes/bluebench/legal 2026-05-27T11:53:39,428 copying src/unitxt/catalog/recipes/bluebench/legal/legalbench_international_citizenship_questions.json -> build/lib/unitxt/catalog/recipes/bluebench/legal 2026-05-27T11:53:39,431 copying src/unitxt/catalog/recipes/bluebench/legal/legalbench_proa.json -> build/lib/unitxt/catalog/recipes/bluebench/legal 2026-05-27T11:53:39,433 copying src/unitxt/catalog/recipes/bluebench/legal/legalbench_abercrombie.json -> build/lib/unitxt/catalog/recipes/bluebench/legal 2026-05-27T11:53:39,436 creating build/lib/unitxt/catalog/recipes/bluebench/chatbot_abilities 2026-05-27T11:53:39,437 copying src/unitxt/catalog/recipes/bluebench/chatbot_abilities/arena_hard_generation_english_gpt_4_0314_reference.json -> build/lib/unitxt/catalog/recipes/bluebench/chatbot_abilities 2026-05-27T11:53:39,439 creating build/lib/unitxt/catalog/recipes/bluebench/bias 2026-05-27T11:53:39,440 copying src/unitxt/catalog/recipes/bluebench/bias/safety_bbq_race_x_ses.json -> build/lib/unitxt/catalog/recipes/bluebench/bias 2026-05-27T11:53:39,443 copying src/unitxt/catalog/recipes/bluebench/bias/safety_bbq_gender_identity.json -> build/lib/unitxt/catalog/recipes/bluebench/bias 2026-05-27T11:53:39,445 copying src/unitxt/catalog/recipes/bluebench/bias/safety_bbq_race_x_gender.json -> build/lib/unitxt/catalog/recipes/bluebench/bias 2026-05-27T11:53:39,447 copying src/unitxt/catalog/recipes/bluebench/bias/safety_bbq_sexual_orientation.json -> build/lib/unitxt/catalog/recipes/bluebench/bias 2026-05-27T11:53:39,449 copying src/unitxt/catalog/recipes/bluebench/bias/safety_bbq_age.json -> build/lib/unitxt/catalog/recipes/bluebench/bias 2026-05-27T11:53:39,452 copying src/unitxt/catalog/recipes/bluebench/bias/safety_bbq_ses.json -> build/lib/unitxt/catalog/recipes/bluebench/bias 2026-05-27T11:53:39,455 copying src/unitxt/catalog/recipes/bluebench/bias/safety_bbq_nationality.json -> build/lib/unitxt/catalog/recipes/bluebench/bias 2026-05-27T11:53:39,457 copying src/unitxt/catalog/recipes/bluebench/bias/safety_bbq_disability_status.json -> build/lib/unitxt/catalog/recipes/bluebench/bias 2026-05-27T11:53:39,459 copying src/unitxt/catalog/recipes/bluebench/bias/safety_bbq_physical_appearance.json -> build/lib/unitxt/catalog/recipes/bluebench/bias 2026-05-27T11:53:39,462 copying src/unitxt/catalog/recipes/bluebench/bias/safety_bbq_race_ethnicity.json -> build/lib/unitxt/catalog/recipes/bluebench/bias 2026-05-27T11:53:39,464 copying src/unitxt/catalog/recipes/bluebench/bias/safety_bbq_religion.json -> build/lib/unitxt/catalog/recipes/bluebench/bias 2026-05-27T11:53:39,466 creating build/lib/unitxt/catalog/recipes/bluebench/product_help 2026-05-27T11:53:39,467 copying src/unitxt/catalog/recipes/bluebench/product_help/cfpb_product_watsonx.json -> build/lib/unitxt/catalog/recipes/bluebench/product_help 2026-05-27T11:53:39,469 copying src/unitxt/catalog/recipes/bluebench/product_help/cfpb_product_2023.json -> build/lib/unitxt/catalog/recipes/bluebench/product_help 2026-05-27T11:53:39,471 creating build/lib/unitxt/catalog/recipes/bluebench/qa_finance 2026-05-27T11:53:39,472 copying src/unitxt/catalog/recipes/bluebench/qa_finance/fin_qa.json -> build/lib/unitxt/catalog/recipes/bluebench/qa_finance 2026-05-27T11:53:39,475 creating build/lib/unitxt/catalog/recipes/bluebench/knowledge 2026-05-27T11:53:39,476 copying src/unitxt/catalog/recipes/bluebench/knowledge/mmlu_pro_law.json -> build/lib/unitxt/catalog/recipes/bluebench/knowledge 2026-05-27T11:53:39,478 copying src/unitxt/catalog/recipes/bluebench/knowledge/mmlu_pro_engineering.json -> build/lib/unitxt/catalog/recipes/bluebench/knowledge 2026-05-27T11:53:39,481 copying src/unitxt/catalog/recipes/bluebench/knowledge/mmlu_pro_economics.json -> build/lib/unitxt/catalog/recipes/bluebench/knowledge 2026-05-27T11:53:39,483 copying src/unitxt/catalog/recipes/bluebench/knowledge/mmlu_pro_computer_science.json -> build/lib/unitxt/catalog/recipes/bluebench/knowledge 2026-05-27T11:53:39,485 copying src/unitxt/catalog/recipes/bluebench/knowledge/mmlu_pro_math.json -> build/lib/unitxt/catalog/recipes/bluebench/knowledge 2026-05-27T11:53:39,487 copying src/unitxt/catalog/recipes/bluebench/knowledge/mmlu_pro_chemistry.json -> build/lib/unitxt/catalog/recipes/bluebench/knowledge 2026-05-27T11:53:39,489 copying src/unitxt/catalog/recipes/bluebench/knowledge/mmlu_pro_biology.json -> build/lib/unitxt/catalog/recipes/bluebench/knowledge 2026-05-27T11:53:39,491 copying src/unitxt/catalog/recipes/bluebench/knowledge/mmlu_pro_other.json -> build/lib/unitxt/catalog/recipes/bluebench/knowledge 2026-05-27T11:53:39,493 copying src/unitxt/catalog/recipes/bluebench/knowledge/mmlu_pro_philosophy.json -> build/lib/unitxt/catalog/recipes/bluebench/knowledge 2026-05-27T11:53:39,495 copying src/unitxt/catalog/recipes/bluebench/knowledge/mmlu_pro_business.json -> build/lib/unitxt/catalog/recipes/bluebench/knowledge 2026-05-27T11:53:39,497 copying src/unitxt/catalog/recipes/bluebench/knowledge/mmlu_pro_physics.json -> build/lib/unitxt/catalog/recipes/bluebench/knowledge 2026-05-27T11:53:39,499 copying src/unitxt/catalog/recipes/bluebench/knowledge/mmlu_pro_history.json -> build/lib/unitxt/catalog/recipes/bluebench/knowledge 2026-05-27T11:53:39,502 copying src/unitxt/catalog/recipes/bluebench/knowledge/mmlu_pro_health.json -> build/lib/unitxt/catalog/recipes/bluebench/knowledge 2026-05-27T11:53:39,504 copying src/unitxt/catalog/recipes/bluebench/knowledge/mmlu_pro_psychology.json -> build/lib/unitxt/catalog/recipes/bluebench/knowledge 2026-05-27T11:53:39,506 creating build/lib/unitxt/catalog/recipes/torr/tab_fact/json 2026-05-27T11:53:39,508 copying src/unitxt/catalog/recipes/torr/tab_fact/json/shuffle_cols_augmentation_5_demos.json -> build/lib/unitxt/catalog/recipes/torr/tab_fact/json 2026-05-27T11:53:39,511 copying src/unitxt/catalog/recipes/torr/tab_fact/json/insert_empty_rows_augmentation_5_demos.json -> build/lib/unitxt/catalog/recipes/torr/tab_fact/json 2026-05-27T11:53:39,513 copying src/unitxt/catalog/recipes/torr/tab_fact/json/no_augmentation_5_demos.json -> build/lib/unitxt/catalog/recipes/torr/tab_fact/json 2026-05-27T11:53:39,515 copying src/unitxt/catalog/recipes/torr/tab_fact/json/transpose_augmentation_5_demos.json -> build/lib/unitxt/catalog/recipes/torr/tab_fact/json 2026-05-27T11:53:39,518 copying src/unitxt/catalog/recipes/torr/tab_fact/json/shuffle_rows_augmentation_5_demos.json -> build/lib/unitxt/catalog/recipes/torr/tab_fact/json 2026-05-27T11:53:39,520 creating build/lib/unitxt/catalog/recipes/torr/tab_fact/df 2026-05-27T11:53:39,521 copying src/unitxt/catalog/recipes/torr/tab_fact/df/shuffle_cols_augmentation_5_demos.json -> build/lib/unitxt/catalog/recipes/torr/tab_fact/df 2026-05-27T11:53:39,524 copying src/unitxt/catalog/recipes/torr/tab_fact/df/insert_empty_rows_augmentation_5_demos.json -> build/lib/unitxt/catalog/recipes/torr/tab_fact/df 2026-05-27T11:53:39,526 copying src/unitxt/catalog/recipes/torr/tab_fact/df/no_augmentation_5_demos.json -> build/lib/unitxt/catalog/recipes/torr/tab_fact/df 2026-05-27T11:53:39,528 copying src/unitxt/catalog/recipes/torr/tab_fact/df/transpose_augmentation_5_demos.json -> build/lib/unitxt/catalog/recipes/torr/tab_fact/df 2026-05-27T11:53:39,530 copying src/unitxt/catalog/recipes/torr/tab_fact/df/shuffle_rows_augmentation_5_demos.json -> build/lib/unitxt/catalog/recipes/torr/tab_fact/df 2026-05-27T11:53:39,532 creating build/lib/unitxt/catalog/recipes/torr/tab_fact/markdown 2026-05-27T11:53:39,533 copying src/unitxt/catalog/recipes/torr/tab_fact/markdown/shuffle_cols_augmentation_5_demos.json -> build/lib/unitxt/catalog/recipes/torr/tab_fact/markdown 2026-05-27T11:53:39,536 copying src/unitxt/catalog/recipes/torr/tab_fact/markdown/insert_empty_rows_augmentation_5_demos.json -> build/lib/unitxt/catalog/recipes/torr/tab_fact/markdown 2026-05-27T11:53:39,538 copying src/unitxt/catalog/recipes/torr/tab_fact/markdown/no_augmentation_5_demos.json -> build/lib/unitxt/catalog/recipes/torr/tab_fact/markdown 2026-05-27T11:53:39,540 copying src/unitxt/catalog/recipes/torr/tab_fact/markdown/transpose_augmentation_5_demos.json -> build/lib/unitxt/catalog/recipes/torr/tab_fact/markdown 2026-05-27T11:53:39,542 copying src/unitxt/catalog/recipes/torr/tab_fact/markdown/shuffle_rows_augmentation_5_demos.json -> build/lib/unitxt/catalog/recipes/torr/tab_fact/markdown 2026-05-27T11:53:39,544 creating build/lib/unitxt/catalog/recipes/torr/tab_fact/concat 2026-05-27T11:53:39,545 copying src/unitxt/catalog/recipes/torr/tab_fact/concat/shuffle_cols_augmentation_5_demos.json -> build/lib/unitxt/catalog/recipes/torr/tab_fact/concat 2026-05-27T11:53:39,548 copying src/unitxt/catalog/recipes/torr/tab_fact/concat/insert_empty_rows_augmentation_5_demos.json -> build/lib/unitxt/catalog/recipes/torr/tab_fact/concat 2026-05-27T11:53:39,550 copying src/unitxt/catalog/recipes/torr/tab_fact/concat/no_augmentation_5_demos.json -> build/lib/unitxt/catalog/recipes/torr/tab_fact/concat 2026-05-27T11:53:39,552 copying src/unitxt/catalog/recipes/torr/tab_fact/concat/transpose_augmentation_5_demos.json -> build/lib/unitxt/catalog/recipes/torr/tab_fact/concat 2026-05-27T11:53:39,554 copying src/unitxt/catalog/recipes/torr/tab_fact/concat/shuffle_rows_augmentation_5_demos.json -> build/lib/unitxt/catalog/recipes/torr/tab_fact/concat 2026-05-27T11:53:39,557 creating build/lib/unitxt/catalog/recipes/torr/tab_fact/csv 2026-05-27T11:53:39,558 copying src/unitxt/catalog/recipes/torr/tab_fact/csv/shuffle_cols_augmentation_5_demos.json -> build/lib/unitxt/catalog/recipes/torr/tab_fact/csv 2026-05-27T11:53:39,560 copying src/unitxt/catalog/recipes/torr/tab_fact/csv/insert_empty_rows_augmentation_5_demos.json -> build/lib/unitxt/catalog/recipes/torr/tab_fact/csv 2026-05-27T11:53:39,562 copying src/unitxt/catalog/recipes/torr/tab_fact/csv/no_augmentation_5_demos.json -> build/lib/unitxt/catalog/recipes/torr/tab_fact/csv 2026-05-27T11:53:39,564 copying src/unitxt/catalog/recipes/torr/tab_fact/csv/transpose_augmentation_5_demos.json -> build/lib/unitxt/catalog/recipes/torr/tab_fact/csv 2026-05-27T11:53:39,567 copying src/unitxt/catalog/recipes/torr/tab_fact/csv/shuffle_rows_augmentation_5_demos.json -> build/lib/unitxt/catalog/recipes/torr/tab_fact/csv 2026-05-27T11:53:39,569 creating build/lib/unitxt/catalog/recipes/torr/tab_fact/indexed_row_major 2026-05-27T11:53:39,570 copying src/unitxt/catalog/recipes/torr/tab_fact/indexed_row_major/shuffle_cols_augmentation_5_demos.json -> build/lib/unitxt/catalog/recipes/torr/tab_fact/indexed_row_major 2026-05-27T11:53:39,572 copying src/unitxt/catalog/recipes/torr/tab_fact/indexed_row_major/insert_empty_rows_augmentation_5_demos.json -> build/lib/unitxt/catalog/recipes/torr/tab_fact/indexed_row_major 2026-05-27T11:53:39,575 copying src/unitxt/catalog/recipes/torr/tab_fact/indexed_row_major/no_augmentation_5_demos.json -> build/lib/unitxt/catalog/recipes/torr/tab_fact/indexed_row_major 2026-05-27T11:53:39,577 copying src/unitxt/catalog/recipes/torr/tab_fact/indexed_row_major/transpose_augmentation_5_demos.json -> build/lib/unitxt/catalog/recipes/torr/tab_fact/indexed_row_major 2026-05-27T11:53:39,579 copying src/unitxt/catalog/recipes/torr/tab_fact/indexed_row_major/shuffle_rows_augmentation_5_demos.json -> build/lib/unitxt/catalog/recipes/torr/tab_fact/indexed_row_major 2026-05-27T11:53:39,581 creating build/lib/unitxt/catalog/recipes/torr/tab_fact/html 2026-05-27T11:53:39,582 copying src/unitxt/catalog/recipes/torr/tab_fact/html/shuffle_cols_augmentation_5_demos.json -> build/lib/unitxt/catalog/recipes/torr/tab_fact/html 2026-05-27T11:53:39,584 copying src/unitxt/catalog/recipes/torr/tab_fact/html/insert_empty_rows_augmentation_5_demos.json -> build/lib/unitxt/catalog/recipes/torr/tab_fact/html 2026-05-27T11:53:39,586 copying src/unitxt/catalog/recipes/torr/tab_fact/html/no_augmentation_5_demos.json -> build/lib/unitxt/catalog/recipes/torr/tab_fact/html 2026-05-27T11:53:39,589 copying src/unitxt/catalog/recipes/torr/tab_fact/html/transpose_augmentation_5_demos.json -> build/lib/unitxt/catalog/recipes/torr/tab_fact/html 2026-05-27T11:53:39,591 copying src/unitxt/catalog/recipes/torr/tab_fact/html/shuffle_rows_augmentation_5_demos.json -> build/lib/unitxt/catalog/recipes/torr/tab_fact/html 2026-05-27T11:53:39,593 creating build/lib/unitxt/catalog/recipes/torr/tablebench_fact_checking/json 2026-05-27T11:53:39,595 copying src/unitxt/catalog/recipes/torr/tablebench_fact_checking/json/shuffle_cols_augmentation_5_demos.json -> build/lib/unitxt/catalog/recipes/torr/tablebench_fact_checking/json 2026-05-27T11:53:39,597 copying src/unitxt/catalog/recipes/torr/tablebench_fact_checking/json/insert_empty_rows_augmentation_5_demos.json -> build/lib/unitxt/catalog/recipes/torr/tablebench_fact_checking/json 2026-05-27T11:53:39,599 copying src/unitxt/catalog/recipes/torr/tablebench_fact_checking/json/no_augmentation_5_demos.json -> build/lib/unitxt/catalog/recipes/torr/tablebench_fact_checking/json 2026-05-27T11:53:39,601 copying src/unitxt/catalog/recipes/torr/tablebench_fact_checking/json/transpose_augmentation_5_demos.json -> build/lib/unitxt/catalog/recipes/torr/tablebench_fact_checking/json 2026-05-27T11:53:39,604 copying src/unitxt/catalog/recipes/torr/tablebench_fact_checking/json/shuffle_rows_augmentation_5_demos.json -> build/lib/unitxt/catalog/recipes/torr/tablebench_fact_checking/json 2026-05-27T11:53:39,606 creating build/lib/unitxt/catalog/recipes/torr/tablebench_fact_checking/df 2026-05-27T11:53:39,607 copying src/unitxt/catalog/recipes/torr/tablebench_fact_checking/df/shuffle_cols_augmentation_5_demos.json -> build/lib/unitxt/catalog/recipes/torr/tablebench_fact_checking/df 2026-05-27T11:53:39,609 copying src/unitxt/catalog/recipes/torr/tablebench_fact_checking/df/insert_empty_rows_augmentation_5_demos.json -> build/lib/unitxt/catalog/recipes/torr/tablebench_fact_checking/df 2026-05-27T11:53:39,612 copying src/unitxt/catalog/recipes/torr/tablebench_fact_checking/df/no_augmentation_5_demos.json -> build/lib/unitxt/catalog/recipes/torr/tablebench_fact_checking/df 2026-05-27T11:53:39,614 copying src/unitxt/catalog/recipes/torr/tablebench_fact_checking/df/transpose_augmentation_5_demos.json -> build/lib/unitxt/catalog/recipes/torr/tablebench_fact_checking/df 2026-05-27T11:53:39,616 copying src/unitxt/catalog/recipes/torr/tablebench_fact_checking/df/shuffle_rows_augmentation_5_demos.json -> build/lib/unitxt/catalog/recipes/torr/tablebench_fact_checking/df 2026-05-27T11:53:39,619 creating build/lib/unitxt/catalog/recipes/torr/tablebench_fact_checking/markdown 2026-05-27T11:53:39,620 copying src/unitxt/catalog/recipes/torr/tablebench_fact_checking/markdown/shuffle_cols_augmentation_5_demos.json -> build/lib/unitxt/catalog/recipes/torr/tablebench_fact_checking/markdown 2026-05-27T11:53:39,622 copying src/unitxt/catalog/recipes/torr/tablebench_fact_checking/markdown/insert_empty_rows_augmentation_5_demos.json -> build/lib/unitxt/catalog/recipes/torr/tablebench_fact_checking/markdown 2026-05-27T11:53:39,624 copying src/unitxt/catalog/recipes/torr/tablebench_fact_checking/markdown/no_augmentation_5_demos.json -> build/lib/unitxt/catalog/recipes/torr/tablebench_fact_checking/markdown 2026-05-27T11:53:39,626 copying src/unitxt/catalog/recipes/torr/tablebench_fact_checking/markdown/transpose_augmentation_5_demos.json -> build/lib/unitxt/catalog/recipes/torr/tablebench_fact_checking/markdown 2026-05-27T11:53:39,628 copying src/unitxt/catalog/recipes/torr/tablebench_fact_checking/markdown/shuffle_rows_augmentation_5_demos.json -> build/lib/unitxt/catalog/recipes/torr/tablebench_fact_checking/markdown 2026-05-27T11:53:39,630 creating build/lib/unitxt/catalog/recipes/torr/tablebench_fact_checking/concat 2026-05-27T11:53:39,631 copying src/unitxt/catalog/recipes/torr/tablebench_fact_checking/concat/shuffle_cols_augmentation_5_demos.json -> build/lib/unitxt/catalog/recipes/torr/tablebench_fact_checking/concat 2026-05-27T11:53:39,634 copying src/unitxt/catalog/recipes/torr/tablebench_fact_checking/concat/insert_empty_rows_augmentation_5_demos.json -> build/lib/unitxt/catalog/recipes/torr/tablebench_fact_checking/concat 2026-05-27T11:53:39,636 copying src/unitxt/catalog/recipes/torr/tablebench_fact_checking/concat/no_augmentation_5_demos.json -> build/lib/unitxt/catalog/recipes/torr/tablebench_fact_checking/concat 2026-05-27T11:53:39,638 copying src/unitxt/catalog/recipes/torr/tablebench_fact_checking/concat/transpose_augmentation_5_demos.json -> build/lib/unitxt/catalog/recipes/torr/tablebench_fact_checking/concat 2026-05-27T11:53:39,641 copying src/unitxt/catalog/recipes/torr/tablebench_fact_checking/concat/shuffle_rows_augmentation_5_demos.json -> build/lib/unitxt/catalog/recipes/torr/tablebench_fact_checking/concat 2026-05-27T11:53:39,643 creating build/lib/unitxt/catalog/recipes/torr/tablebench_fact_checking/csv 2026-05-27T11:53:39,644 copying src/unitxt/catalog/recipes/torr/tablebench_fact_checking/csv/shuffle_cols_augmentation_5_demos.json -> build/lib/unitxt/catalog/recipes/torr/tablebench_fact_checking/csv 2026-05-27T11:53:39,646 copying src/unitxt/catalog/recipes/torr/tablebench_fact_checking/csv/insert_empty_rows_augmentation_5_demos.json -> build/lib/unitxt/catalog/recipes/torr/tablebench_fact_checking/csv 2026-05-27T11:53:39,648 copying src/unitxt/catalog/recipes/torr/tablebench_fact_checking/csv/no_augmentation_5_demos.json -> build/lib/unitxt/catalog/recipes/torr/tablebench_fact_checking/csv 2026-05-27T11:53:39,651 copying src/unitxt/catalog/recipes/torr/tablebench_fact_checking/csv/transpose_augmentation_5_demos.json -> build/lib/unitxt/catalog/recipes/torr/tablebench_fact_checking/csv 2026-05-27T11:53:39,653 copying src/unitxt/catalog/recipes/torr/tablebench_fact_checking/csv/shuffle_rows_augmentation_5_demos.json -> build/lib/unitxt/catalog/recipes/torr/tablebench_fact_checking/csv 2026-05-27T11:53:39,655 creating build/lib/unitxt/catalog/recipes/torr/tablebench_fact_checking/indexed_row_major 2026-05-27T11:53:39,656 copying src/unitxt/catalog/recipes/torr/tablebench_fact_checking/indexed_row_major/shuffle_cols_augmentation_5_demos.json -> build/lib/unitxt/catalog/recipes/torr/tablebench_fact_checking/indexed_row_major 2026-05-27T11:53:39,659 copying src/unitxt/catalog/recipes/torr/tablebench_fact_checking/indexed_row_major/insert_empty_rows_augmentation_5_demos.json -> build/lib/unitxt/catalog/recipes/torr/tablebench_fact_checking/indexed_row_major 2026-05-27T11:53:39,661 copying src/unitxt/catalog/recipes/torr/tablebench_fact_checking/indexed_row_major/no_augmentation_5_demos.json -> build/lib/unitxt/catalog/recipes/torr/tablebench_fact_checking/indexed_row_major 2026-05-27T11:53:39,663 copying src/unitxt/catalog/recipes/torr/tablebench_fact_checking/indexed_row_major/transpose_augmentation_5_demos.json -> build/lib/unitxt/catalog/recipes/torr/tablebench_fact_checking/indexed_row_major 2026-05-27T11:53:39,665 copying src/unitxt/catalog/recipes/torr/tablebench_fact_checking/indexed_row_major/shuffle_rows_augmentation_5_demos.json -> build/lib/unitxt/catalog/recipes/torr/tablebench_fact_checking/indexed_row_major 2026-05-27T11:53:39,667 creating build/lib/unitxt/catalog/recipes/torr/tablebench_fact_checking/html 2026-05-27T11:53:39,668 copying src/unitxt/catalog/recipes/torr/tablebench_fact_checking/html/shuffle_cols_augmentation_5_demos.json -> build/lib/unitxt/catalog/recipes/torr/tablebench_fact_checking/html 2026-05-27T11:53:39,671 copying src/unitxt/catalog/recipes/torr/tablebench_fact_checking/html/insert_empty_rows_augmentation_5_demos.json -> build/lib/unitxt/catalog/recipes/torr/tablebench_fact_checking/html 2026-05-27T11:53:39,673 copying src/unitxt/catalog/recipes/torr/tablebench_fact_checking/html/no_augmentation_5_demos.json -> build/lib/unitxt/catalog/recipes/torr/tablebench_fact_checking/html 2026-05-27T11:53:39,675 copying src/unitxt/catalog/recipes/torr/tablebench_fact_checking/html/transpose_augmentation_5_demos.json -> build/lib/unitxt/catalog/recipes/torr/tablebench_fact_checking/html 2026-05-27T11:53:39,677 copying src/unitxt/catalog/recipes/torr/tablebench_fact_checking/html/shuffle_rows_augmentation_5_demos.json -> build/lib/unitxt/catalog/recipes/torr/tablebench_fact_checking/html 2026-05-27T11:53:39,679 creating build/lib/unitxt/catalog/recipes/torr/tablebench_numerical_reasoning/json 2026-05-27T11:53:39,681 copying src/unitxt/catalog/recipes/torr/tablebench_numerical_reasoning/json/shuffle_cols_augmentation_5_demos.json -> build/lib/unitxt/catalog/recipes/torr/tablebench_numerical_reasoning/json 2026-05-27T11:53:39,683 copying src/unitxt/catalog/recipes/torr/tablebench_numerical_reasoning/json/insert_empty_rows_augmentation_5_demos.json -> build/lib/unitxt/catalog/recipes/torr/tablebench_numerical_reasoning/json 2026-05-27T11:53:39,686 copying src/unitxt/catalog/recipes/torr/tablebench_numerical_reasoning/json/no_augmentation_5_demos.json -> build/lib/unitxt/catalog/recipes/torr/tablebench_numerical_reasoning/json 2026-05-27T11:53:39,688 copying src/unitxt/catalog/recipes/torr/tablebench_numerical_reasoning/json/transpose_augmentation_5_demos.json -> build/lib/unitxt/catalog/recipes/torr/tablebench_numerical_reasoning/json 2026-05-27T11:53:39,690 copying src/unitxt/catalog/recipes/torr/tablebench_numerical_reasoning/json/shuffle_rows_augmentation_5_demos.json -> build/lib/unitxt/catalog/recipes/torr/tablebench_numerical_reasoning/json 2026-05-27T11:53:39,692 creating build/lib/unitxt/catalog/recipes/torr/tablebench_numerical_reasoning/df 2026-05-27T11:53:39,693 copying src/unitxt/catalog/recipes/torr/tablebench_numerical_reasoning/df/shuffle_cols_augmentation_5_demos.json -> build/lib/unitxt/catalog/recipes/torr/tablebench_numerical_reasoning/df 2026-05-27T11:53:39,696 copying src/unitxt/catalog/recipes/torr/tablebench_numerical_reasoning/df/insert_empty_rows_augmentation_5_demos.json -> build/lib/unitxt/catalog/recipes/torr/tablebench_numerical_reasoning/df 2026-05-27T11:53:39,698 copying src/unitxt/catalog/recipes/torr/tablebench_numerical_reasoning/df/no_augmentation_5_demos.json -> build/lib/unitxt/catalog/recipes/torr/tablebench_numerical_reasoning/df 2026-05-27T11:53:39,700 copying src/unitxt/catalog/recipes/torr/tablebench_numerical_reasoning/df/transpose_augmentation_5_demos.json -> build/lib/unitxt/catalog/recipes/torr/tablebench_numerical_reasoning/df 2026-05-27T11:53:39,703 copying src/unitxt/catalog/recipes/torr/tablebench_numerical_reasoning/df/shuffle_rows_augmentation_5_demos.json -> build/lib/unitxt/catalog/recipes/torr/tablebench_numerical_reasoning/df 2026-05-27T11:53:39,705 creating build/lib/unitxt/catalog/recipes/torr/tablebench_numerical_reasoning/markdown 2026-05-27T11:53:39,706 copying src/unitxt/catalog/recipes/torr/tablebench_numerical_reasoning/markdown/shuffle_cols_augmentation_5_demos.json -> build/lib/unitxt/catalog/recipes/torr/tablebench_numerical_reasoning/markdown 2026-05-27T11:53:39,708 copying src/unitxt/catalog/recipes/torr/tablebench_numerical_reasoning/markdown/insert_empty_rows_augmentation_5_demos.json -> build/lib/unitxt/catalog/recipes/torr/tablebench_numerical_reasoning/markdown 2026-05-27T11:53:39,710 copying src/unitxt/catalog/recipes/torr/tablebench_numerical_reasoning/markdown/no_augmentation_5_demos.json -> build/lib/unitxt/catalog/recipes/torr/tablebench_numerical_reasoning/markdown 2026-05-27T11:53:39,712 copying src/unitxt/catalog/recipes/torr/tablebench_numerical_reasoning/markdown/transpose_augmentation_5_demos.json -> build/lib/unitxt/catalog/recipes/torr/tablebench_numerical_reasoning/markdown 2026-05-27T11:53:39,714 copying src/unitxt/catalog/recipes/torr/tablebench_numerical_reasoning/markdown/shuffle_rows_augmentation_5_demos.json -> build/lib/unitxt/catalog/recipes/torr/tablebench_numerical_reasoning/markdown 2026-05-27T11:53:39,716 creating build/lib/unitxt/catalog/recipes/torr/tablebench_numerical_reasoning/concat 2026-05-27T11:53:39,717 copying src/unitxt/catalog/recipes/torr/tablebench_numerical_reasoning/concat/shuffle_cols_augmentation_5_demos.json -> build/lib/unitxt/catalog/recipes/torr/tablebench_numerical_reasoning/concat 2026-05-27T11:53:39,720 copying src/unitxt/catalog/recipes/torr/tablebench_numerical_reasoning/concat/insert_empty_rows_augmentation_5_demos.json -> build/lib/unitxt/catalog/recipes/torr/tablebench_numerical_reasoning/concat 2026-05-27T11:53:39,722 copying src/unitxt/catalog/recipes/torr/tablebench_numerical_reasoning/concat/no_augmentation_5_demos.json -> build/lib/unitxt/catalog/recipes/torr/tablebench_numerical_reasoning/concat 2026-05-27T11:53:39,725 copying src/unitxt/catalog/recipes/torr/tablebench_numerical_reasoning/concat/transpose_augmentation_5_demos.json -> build/lib/unitxt/catalog/recipes/torr/tablebench_numerical_reasoning/concat 2026-05-27T11:53:39,727 copying src/unitxt/catalog/recipes/torr/tablebench_numerical_reasoning/concat/shuffle_rows_augmentation_5_demos.json -> build/lib/unitxt/catalog/recipes/torr/tablebench_numerical_reasoning/concat 2026-05-27T11:53:39,729 creating build/lib/unitxt/catalog/recipes/torr/tablebench_numerical_reasoning/csv 2026-05-27T11:53:39,730 copying src/unitxt/catalog/recipes/torr/tablebench_numerical_reasoning/csv/shuffle_cols_augmentation_5_demos.json -> build/lib/unitxt/catalog/recipes/torr/tablebench_numerical_reasoning/csv 2026-05-27T11:53:39,733 copying src/unitxt/catalog/recipes/torr/tablebench_numerical_reasoning/csv/insert_empty_rows_augmentation_5_demos.json -> build/lib/unitxt/catalog/recipes/torr/tablebench_numerical_reasoning/csv 2026-05-27T11:53:39,735 copying src/unitxt/catalog/recipes/torr/tablebench_numerical_reasoning/csv/no_augmentation_5_demos.json -> build/lib/unitxt/catalog/recipes/torr/tablebench_numerical_reasoning/csv 2026-05-27T11:53:39,737 copying src/unitxt/catalog/recipes/torr/tablebench_numerical_reasoning/csv/transpose_augmentation_5_demos.json -> build/lib/unitxt/catalog/recipes/torr/tablebench_numerical_reasoning/csv 2026-05-27T11:53:39,740 copying src/unitxt/catalog/recipes/torr/tablebench_numerical_reasoning/csv/shuffle_rows_augmentation_5_demos.json -> build/lib/unitxt/catalog/recipes/torr/tablebench_numerical_reasoning/csv 2026-05-27T11:53:39,742 creating build/lib/unitxt/catalog/recipes/torr/tablebench_numerical_reasoning/indexed_row_major 2026-05-27T11:53:39,743 copying src/unitxt/catalog/recipes/torr/tablebench_numerical_reasoning/indexed_row_major/shuffle_cols_augmentation_5_demos.json -> build/lib/unitxt/catalog/recipes/torr/tablebench_numerical_reasoning/indexed_row_major 2026-05-27T11:53:39,745 copying src/unitxt/catalog/recipes/torr/tablebench_numerical_reasoning/indexed_row_major/insert_empty_rows_augmentation_5_demos.json -> build/lib/unitxt/catalog/recipes/torr/tablebench_numerical_reasoning/indexed_row_major 2026-05-27T11:53:39,748 copying src/unitxt/catalog/recipes/torr/tablebench_numerical_reasoning/indexed_row_major/no_augmentation_5_demos.json -> build/lib/unitxt/catalog/recipes/torr/tablebench_numerical_reasoning/indexed_row_major 2026-05-27T11:53:39,750 copying src/unitxt/catalog/recipes/torr/tablebench_numerical_reasoning/indexed_row_major/transpose_augmentation_5_demos.json -> build/lib/unitxt/catalog/recipes/torr/tablebench_numerical_reasoning/indexed_row_major 2026-05-27T11:53:39,752 copying src/unitxt/catalog/recipes/torr/tablebench_numerical_reasoning/indexed_row_major/shuffle_rows_augmentation_5_demos.json -> build/lib/unitxt/catalog/recipes/torr/tablebench_numerical_reasoning/indexed_row_major 2026-05-27T11:53:39,754 creating build/lib/unitxt/catalog/recipes/torr/tablebench_numerical_reasoning/html 2026-05-27T11:53:39,755 copying src/unitxt/catalog/recipes/torr/tablebench_numerical_reasoning/html/shuffle_cols_augmentation_5_demos.json -> build/lib/unitxt/catalog/recipes/torr/tablebench_numerical_reasoning/html 2026-05-27T11:53:39,757 copying src/unitxt/catalog/recipes/torr/tablebench_numerical_reasoning/html/insert_empty_rows_augmentation_5_demos.json -> build/lib/unitxt/catalog/recipes/torr/tablebench_numerical_reasoning/html 2026-05-27T11:53:39,759 copying src/unitxt/catalog/recipes/torr/tablebench_numerical_reasoning/html/no_augmentation_5_demos.json -> build/lib/unitxt/catalog/recipes/torr/tablebench_numerical_reasoning/html 2026-05-27T11:53:39,761 copying src/unitxt/catalog/recipes/torr/tablebench_numerical_reasoning/html/transpose_augmentation_5_demos.json -> build/lib/unitxt/catalog/recipes/torr/tablebench_numerical_reasoning/html 2026-05-27T11:53:39,764 copying src/unitxt/catalog/recipes/torr/tablebench_numerical_reasoning/html/shuffle_rows_augmentation_5_demos.json -> build/lib/unitxt/catalog/recipes/torr/tablebench_numerical_reasoning/html 2026-05-27T11:53:39,767 creating build/lib/unitxt/catalog/recipes/torr/qtsumm/json 2026-05-27T11:53:39,769 copying src/unitxt/catalog/recipes/torr/qtsumm/json/shuffle_cols_augmentation_5_demos.json -> build/lib/unitxt/catalog/recipes/torr/qtsumm/json 2026-05-27T11:53:39,772 copying src/unitxt/catalog/recipes/torr/qtsumm/json/insert_empty_rows_augmentation_5_demos.json -> build/lib/unitxt/catalog/recipes/torr/qtsumm/json 2026-05-27T11:53:39,774 copying src/unitxt/catalog/recipes/torr/qtsumm/json/no_augmentation_5_demos.json -> build/lib/unitxt/catalog/recipes/torr/qtsumm/json 2026-05-27T11:53:39,777 copying src/unitxt/catalog/recipes/torr/qtsumm/json/transpose_augmentation_5_demos.json -> build/lib/unitxt/catalog/recipes/torr/qtsumm/json 2026-05-27T11:53:39,780 copying src/unitxt/catalog/recipes/torr/qtsumm/json/shuffle_rows_augmentation_5_demos.json -> build/lib/unitxt/catalog/recipes/torr/qtsumm/json 2026-05-27T11:53:39,783 creating build/lib/unitxt/catalog/recipes/torr/qtsumm/df 2026-05-27T11:53:39,784 copying src/unitxt/catalog/recipes/torr/qtsumm/df/shuffle_cols_augmentation_5_demos.json -> build/lib/unitxt/catalog/recipes/torr/qtsumm/df 2026-05-27T11:53:39,787 copying src/unitxt/catalog/recipes/torr/qtsumm/df/insert_empty_rows_augmentation_5_demos.json -> build/lib/unitxt/catalog/recipes/torr/qtsumm/df 2026-05-27T11:53:39,790 copying src/unitxt/catalog/recipes/torr/qtsumm/df/no_augmentation_5_demos.json -> build/lib/unitxt/catalog/recipes/torr/qtsumm/df 2026-05-27T11:53:39,793 copying src/unitxt/catalog/recipes/torr/qtsumm/df/transpose_augmentation_5_demos.json -> build/lib/unitxt/catalog/recipes/torr/qtsumm/df 2026-05-27T11:53:39,796 copying src/unitxt/catalog/recipes/torr/qtsumm/df/shuffle_rows_augmentation_5_demos.json -> build/lib/unitxt/catalog/recipes/torr/qtsumm/df 2026-05-27T11:53:39,799 creating build/lib/unitxt/catalog/recipes/torr/qtsumm/markdown 2026-05-27T11:53:39,800 copying src/unitxt/catalog/recipes/torr/qtsumm/markdown/shuffle_cols_augmentation_5_demos.json -> build/lib/unitxt/catalog/recipes/torr/qtsumm/markdown 2026-05-27T11:53:39,803 copying src/unitxt/catalog/recipes/torr/qtsumm/markdown/insert_empty_rows_augmentation_5_demos.json -> build/lib/unitxt/catalog/recipes/torr/qtsumm/markdown 2026-05-27T11:53:39,806 copying src/unitxt/catalog/recipes/torr/qtsumm/markdown/no_augmentation_5_demos.json -> build/lib/unitxt/catalog/recipes/torr/qtsumm/markdown 2026-05-27T11:53:39,808 copying src/unitxt/catalog/recipes/torr/qtsumm/markdown/transpose_augmentation_5_demos.json -> build/lib/unitxt/catalog/recipes/torr/qtsumm/markdown 2026-05-27T11:53:39,811 copying src/unitxt/catalog/recipes/torr/qtsumm/markdown/shuffle_rows_augmentation_5_demos.json -> build/lib/unitxt/catalog/recipes/torr/qtsumm/markdown 2026-05-27T11:53:39,814 creating build/lib/unitxt/catalog/recipes/torr/qtsumm/concat 2026-05-27T11:53:39,815 copying src/unitxt/catalog/recipes/torr/qtsumm/concat/shuffle_cols_augmentation_5_demos.json -> build/lib/unitxt/catalog/recipes/torr/qtsumm/concat 2026-05-27T11:53:39,818 copying src/unitxt/catalog/recipes/torr/qtsumm/concat/insert_empty_rows_augmentation_5_demos.json -> build/lib/unitxt/catalog/recipes/torr/qtsumm/concat 2026-05-27T11:53:39,821 copying src/unitxt/catalog/recipes/torr/qtsumm/concat/no_augmentation_5_demos.json -> build/lib/unitxt/catalog/recipes/torr/qtsumm/concat 2026-05-27T11:53:39,824 copying src/unitxt/catalog/recipes/torr/qtsumm/concat/transpose_augmentation_5_demos.json -> build/lib/unitxt/catalog/recipes/torr/qtsumm/concat 2026-05-27T11:53:39,827 copying src/unitxt/catalog/recipes/torr/qtsumm/concat/shuffle_rows_augmentation_5_demos.json -> build/lib/unitxt/catalog/recipes/torr/qtsumm/concat 2026-05-27T11:53:39,829 creating build/lib/unitxt/catalog/recipes/torr/qtsumm/csv 2026-05-27T11:53:39,831 copying src/unitxt/catalog/recipes/torr/qtsumm/csv/shuffle_cols_augmentation_5_demos.json -> build/lib/unitxt/catalog/recipes/torr/qtsumm/csv 2026-05-27T11:53:39,834 copying src/unitxt/catalog/recipes/torr/qtsumm/csv/insert_empty_rows_augmentation_5_demos.json -> build/lib/unitxt/catalog/recipes/torr/qtsumm/csv 2026-05-27T11:53:39,837 copying src/unitxt/catalog/recipes/torr/qtsumm/csv/no_augmentation_5_demos.json -> build/lib/unitxt/catalog/recipes/torr/qtsumm/csv 2026-05-27T11:53:39,840 copying src/unitxt/catalog/recipes/torr/qtsumm/csv/transpose_augmentation_5_demos.json -> build/lib/unitxt/catalog/recipes/torr/qtsumm/csv 2026-05-27T11:53:39,843 copying src/unitxt/catalog/recipes/torr/qtsumm/csv/shuffle_rows_augmentation_5_demos.json -> build/lib/unitxt/catalog/recipes/torr/qtsumm/csv 2026-05-27T11:53:39,845 creating build/lib/unitxt/catalog/recipes/torr/qtsumm/indexed_row_major 2026-05-27T11:53:39,847 copying src/unitxt/catalog/recipes/torr/qtsumm/indexed_row_major/shuffle_cols_augmentation_5_demos.json -> build/lib/unitxt/catalog/recipes/torr/qtsumm/indexed_row_major 2026-05-27T11:53:39,850 copying src/unitxt/catalog/recipes/torr/qtsumm/indexed_row_major/insert_empty_rows_augmentation_5_demos.json -> build/lib/unitxt/catalog/recipes/torr/qtsumm/indexed_row_major 2026-05-27T11:53:39,853 copying src/unitxt/catalog/recipes/torr/qtsumm/indexed_row_major/no_augmentation_5_demos.json -> build/lib/unitxt/catalog/recipes/torr/qtsumm/indexed_row_major 2026-05-27T11:53:39,856 copying src/unitxt/catalog/recipes/torr/qtsumm/indexed_row_major/transpose_augmentation_5_demos.json -> build/lib/unitxt/catalog/recipes/torr/qtsumm/indexed_row_major 2026-05-27T11:53:39,859 copying src/unitxt/catalog/recipes/torr/qtsumm/indexed_row_major/shuffle_rows_augmentation_5_demos.json -> build/lib/unitxt/catalog/recipes/torr/qtsumm/indexed_row_major 2026-05-27T11:53:39,862 creating build/lib/unitxt/catalog/recipes/torr/qtsumm/html 2026-05-27T11:53:39,863 copying src/unitxt/catalog/recipes/torr/qtsumm/html/shuffle_cols_augmentation_5_demos.json -> build/lib/unitxt/catalog/recipes/torr/qtsumm/html 2026-05-27T11:53:39,866 copying src/unitxt/catalog/recipes/torr/qtsumm/html/insert_empty_rows_augmentation_5_demos.json -> build/lib/unitxt/catalog/recipes/torr/qtsumm/html 2026-05-27T11:53:39,868 copying src/unitxt/catalog/recipes/torr/qtsumm/html/no_augmentation_5_demos.json -> build/lib/unitxt/catalog/recipes/torr/qtsumm/html 2026-05-27T11:53:39,871 copying src/unitxt/catalog/recipes/torr/qtsumm/html/transpose_augmentation_5_demos.json -> build/lib/unitxt/catalog/recipes/torr/qtsumm/html 2026-05-27T11:53:39,873 copying src/unitxt/catalog/recipes/torr/qtsumm/html/shuffle_rows_augmentation_5_demos.json -> build/lib/unitxt/catalog/recipes/torr/qtsumm/html 2026-05-27T11:53:39,875 creating build/lib/unitxt/catalog/recipes/torr/tablebench_data_analysis/json 2026-05-27T11:53:39,877 copying src/unitxt/catalog/recipes/torr/tablebench_data_analysis/json/shuffle_cols_augmentation_5_demos.json -> build/lib/unitxt/catalog/recipes/torr/tablebench_data_analysis/json 2026-05-27T11:53:39,880 copying src/unitxt/catalog/recipes/torr/tablebench_data_analysis/json/insert_empty_rows_augmentation_5_demos.json -> build/lib/unitxt/catalog/recipes/torr/tablebench_data_analysis/json 2026-05-27T11:53:39,882 copying src/unitxt/catalog/recipes/torr/tablebench_data_analysis/json/no_augmentation_5_demos.json -> build/lib/unitxt/catalog/recipes/torr/tablebench_data_analysis/json 2026-05-27T11:53:39,884 copying src/unitxt/catalog/recipes/torr/tablebench_data_analysis/json/transpose_augmentation_5_demos.json -> build/lib/unitxt/catalog/recipes/torr/tablebench_data_analysis/json 2026-05-27T11:53:39,887 copying src/unitxt/catalog/recipes/torr/tablebench_data_analysis/json/shuffle_rows_augmentation_5_demos.json -> build/lib/unitxt/catalog/recipes/torr/tablebench_data_analysis/json 2026-05-27T11:53:39,889 creating build/lib/unitxt/catalog/recipes/torr/tablebench_data_analysis/df 2026-05-27T11:53:39,890 copying src/unitxt/catalog/recipes/torr/tablebench_data_analysis/df/shuffle_cols_augmentation_5_demos.json -> build/lib/unitxt/catalog/recipes/torr/tablebench_data_analysis/df 2026-05-27T11:53:39,893 copying src/unitxt/catalog/recipes/torr/tablebench_data_analysis/df/insert_empty_rows_augmentation_5_demos.json -> build/lib/unitxt/catalog/recipes/torr/tablebench_data_analysis/df 2026-05-27T11:53:39,895 copying src/unitxt/catalog/recipes/torr/tablebench_data_analysis/df/no_augmentation_5_demos.json -> build/lib/unitxt/catalog/recipes/torr/tablebench_data_analysis/df 2026-05-27T11:53:39,898 copying src/unitxt/catalog/recipes/torr/tablebench_data_analysis/df/transpose_augmentation_5_demos.json -> build/lib/unitxt/catalog/recipes/torr/tablebench_data_analysis/df 2026-05-27T11:53:39,900 copying src/unitxt/catalog/recipes/torr/tablebench_data_analysis/df/shuffle_rows_augmentation_5_demos.json -> build/lib/unitxt/catalog/recipes/torr/tablebench_data_analysis/df 2026-05-27T11:53:39,902 creating build/lib/unitxt/catalog/recipes/torr/tablebench_data_analysis/markdown 2026-05-27T11:53:39,903 copying src/unitxt/catalog/recipes/torr/tablebench_data_analysis/markdown/shuffle_cols_augmentation_5_demos.json -> build/lib/unitxt/catalog/recipes/torr/tablebench_data_analysis/markdown 2026-05-27T11:53:39,906 copying src/unitxt/catalog/recipes/torr/tablebench_data_analysis/markdown/insert_empty_rows_augmentation_5_demos.json -> build/lib/unitxt/catalog/recipes/torr/tablebench_data_analysis/markdown 2026-05-27T11:53:39,908 copying src/unitxt/catalog/recipes/torr/tablebench_data_analysis/markdown/no_augmentation_5_demos.json -> build/lib/unitxt/catalog/recipes/torr/tablebench_data_analysis/markdown 2026-05-27T11:53:39,911 copying src/unitxt/catalog/recipes/torr/tablebench_data_analysis/markdown/transpose_augmentation_5_demos.json -> build/lib/unitxt/catalog/recipes/torr/tablebench_data_analysis/markdown 2026-05-27T11:53:39,913 copying src/unitxt/catalog/recipes/torr/tablebench_data_analysis/markdown/shuffle_rows_augmentation_5_demos.json -> build/lib/unitxt/catalog/recipes/torr/tablebench_data_analysis/markdown 2026-05-27T11:53:39,915 creating build/lib/unitxt/catalog/recipes/torr/tablebench_data_analysis/concat 2026-05-27T11:53:39,916 copying src/unitxt/catalog/recipes/torr/tablebench_data_analysis/concat/shuffle_cols_augmentation_5_demos.json -> build/lib/unitxt/catalog/recipes/torr/tablebench_data_analysis/concat 2026-05-27T11:53:39,919 copying src/unitxt/catalog/recipes/torr/tablebench_data_analysis/concat/insert_empty_rows_augmentation_5_demos.json -> build/lib/unitxt/catalog/recipes/torr/tablebench_data_analysis/concat 2026-05-27T11:53:39,921 copying src/unitxt/catalog/recipes/torr/tablebench_data_analysis/concat/no_augmentation_5_demos.json -> build/lib/unitxt/catalog/recipes/torr/tablebench_data_analysis/concat 2026-05-27T11:53:39,924 copying src/unitxt/catalog/recipes/torr/tablebench_data_analysis/concat/transpose_augmentation_5_demos.json -> build/lib/unitxt/catalog/recipes/torr/tablebench_data_analysis/concat 2026-05-27T11:53:39,926 copying src/unitxt/catalog/recipes/torr/tablebench_data_analysis/concat/shuffle_rows_augmentation_5_demos.json -> build/lib/unitxt/catalog/recipes/torr/tablebench_data_analysis/concat 2026-05-27T11:53:39,928 creating build/lib/unitxt/catalog/recipes/torr/tablebench_data_analysis/csv 2026-05-27T11:53:39,929 copying src/unitxt/catalog/recipes/torr/tablebench_data_analysis/csv/shuffle_cols_augmentation_5_demos.json -> build/lib/unitxt/catalog/recipes/torr/tablebench_data_analysis/csv 2026-05-27T11:53:39,931 copying src/unitxt/catalog/recipes/torr/tablebench_data_analysis/csv/insert_empty_rows_augmentation_5_demos.json -> build/lib/unitxt/catalog/recipes/torr/tablebench_data_analysis/csv 2026-05-27T11:53:39,934 copying src/unitxt/catalog/recipes/torr/tablebench_data_analysis/csv/no_augmentation_5_demos.json -> build/lib/unitxt/catalog/recipes/torr/tablebench_data_analysis/csv 2026-05-27T11:53:39,936 copying src/unitxt/catalog/recipes/torr/tablebench_data_analysis/csv/transpose_augmentation_5_demos.json -> build/lib/unitxt/catalog/recipes/torr/tablebench_data_analysis/csv 2026-05-27T11:53:39,938 copying src/unitxt/catalog/recipes/torr/tablebench_data_analysis/csv/shuffle_rows_augmentation_5_demos.json -> build/lib/unitxt/catalog/recipes/torr/tablebench_data_analysis/csv 2026-05-27T11:53:39,940 creating build/lib/unitxt/catalog/recipes/torr/tablebench_data_analysis/indexed_row_major 2026-05-27T11:53:39,942 copying src/unitxt/catalog/recipes/torr/tablebench_data_analysis/indexed_row_major/shuffle_cols_augmentation_5_demos.json -> build/lib/unitxt/catalog/recipes/torr/tablebench_data_analysis/indexed_row_major 2026-05-27T11:53:39,944 copying src/unitxt/catalog/recipes/torr/tablebench_data_analysis/indexed_row_major/insert_empty_rows_augmentation_5_demos.json -> build/lib/unitxt/catalog/recipes/torr/tablebench_data_analysis/indexed_row_major 2026-05-27T11:53:39,946 copying src/unitxt/catalog/recipes/torr/tablebench_data_analysis/indexed_row_major/no_augmentation_5_demos.json -> build/lib/unitxt/catalog/recipes/torr/tablebench_data_analysis/indexed_row_major 2026-05-27T11:53:39,949 copying src/unitxt/catalog/recipes/torr/tablebench_data_analysis/indexed_row_major/transpose_augmentation_5_demos.json -> build/lib/unitxt/catalog/recipes/torr/tablebench_data_analysis/indexed_row_major 2026-05-27T11:53:39,951 copying src/unitxt/catalog/recipes/torr/tablebench_data_analysis/indexed_row_major/shuffle_rows_augmentation_5_demos.json -> build/lib/unitxt/catalog/recipes/torr/tablebench_data_analysis/indexed_row_major 2026-05-27T11:53:39,953 creating build/lib/unitxt/catalog/recipes/torr/tablebench_data_analysis/html 2026-05-27T11:53:39,955 copying src/unitxt/catalog/recipes/torr/tablebench_data_analysis/html/shuffle_cols_augmentation_5_demos.json -> build/lib/unitxt/catalog/recipes/torr/tablebench_data_analysis/html 2026-05-27T11:53:39,957 copying src/unitxt/catalog/recipes/torr/tablebench_data_analysis/html/insert_empty_rows_augmentation_5_demos.json -> build/lib/unitxt/catalog/recipes/torr/tablebench_data_analysis/html 2026-05-27T11:53:39,960 copying src/unitxt/catalog/recipes/torr/tablebench_data_analysis/html/no_augmentation_5_demos.json -> build/lib/unitxt/catalog/recipes/torr/tablebench_data_analysis/html 2026-05-27T11:53:39,962 copying src/unitxt/catalog/recipes/torr/tablebench_data_analysis/html/transpose_augmentation_5_demos.json -> build/lib/unitxt/catalog/recipes/torr/tablebench_data_analysis/html 2026-05-27T11:53:39,965 copying src/unitxt/catalog/recipes/torr/tablebench_data_analysis/html/shuffle_rows_augmentation_5_demos.json -> build/lib/unitxt/catalog/recipes/torr/tablebench_data_analysis/html 2026-05-27T11:53:39,967 creating build/lib/unitxt/catalog/recipes/torr/wikitq/json 2026-05-27T11:53:39,968 copying src/unitxt/catalog/recipes/torr/wikitq/json/insert_empty_rows_augmentation_1_demos.json -> build/lib/unitxt/catalog/recipes/torr/wikitq/json 2026-05-27T11:53:39,971 copying src/unitxt/catalog/recipes/torr/wikitq/json/shuffle_rows_augmentation_1_demos.json -> build/lib/unitxt/catalog/recipes/torr/wikitq/json 2026-05-27T11:53:39,973 copying src/unitxt/catalog/recipes/torr/wikitq/json/no_augmentation_1_demos.json -> build/lib/unitxt/catalog/recipes/torr/wikitq/json 2026-05-27T11:53:39,975 copying src/unitxt/catalog/recipes/torr/wikitq/json/shuffle_cols_augmentation_1_demos.json -> build/lib/unitxt/catalog/recipes/torr/wikitq/json 2026-05-27T11:53:39,978 copying src/unitxt/catalog/recipes/torr/wikitq/json/transpose_augmentation_1_demos.json -> build/lib/unitxt/catalog/recipes/torr/wikitq/json 2026-05-27T11:53:39,980 creating build/lib/unitxt/catalog/recipes/torr/wikitq/df 2026-05-27T11:53:39,981 copying src/unitxt/catalog/recipes/torr/wikitq/df/insert_empty_rows_augmentation_1_demos.json -> build/lib/unitxt/catalog/recipes/torr/wikitq/df 2026-05-27T11:53:39,983 copying src/unitxt/catalog/recipes/torr/wikitq/df/shuffle_rows_augmentation_1_demos.json -> build/lib/unitxt/catalog/recipes/torr/wikitq/df 2026-05-27T11:53:39,986 copying src/unitxt/catalog/recipes/torr/wikitq/df/no_augmentation_1_demos.json -> build/lib/unitxt/catalog/recipes/torr/wikitq/df 2026-05-27T11:53:39,988 copying src/unitxt/catalog/recipes/torr/wikitq/df/shuffle_cols_augmentation_1_demos.json -> build/lib/unitxt/catalog/recipes/torr/wikitq/df 2026-05-27T11:53:39,991 copying src/unitxt/catalog/recipes/torr/wikitq/df/transpose_augmentation_1_demos.json -> build/lib/unitxt/catalog/recipes/torr/wikitq/df 2026-05-27T11:53:39,993 creating build/lib/unitxt/catalog/recipes/torr/wikitq/markdown 2026-05-27T11:53:39,994 copying src/unitxt/catalog/recipes/torr/wikitq/markdown/insert_empty_rows_augmentation_1_demos.json -> build/lib/unitxt/catalog/recipes/torr/wikitq/markdown 2026-05-27T11:53:39,996 copying src/unitxt/catalog/recipes/torr/wikitq/markdown/shuffle_rows_augmentation_1_demos.json -> build/lib/unitxt/catalog/recipes/torr/wikitq/markdown 2026-05-27T11:53:39,999 copying src/unitxt/catalog/recipes/torr/wikitq/markdown/no_augmentation_1_demos.json -> build/lib/unitxt/catalog/recipes/torr/wikitq/markdown 2026-05-27T11:53:40,001 copying src/unitxt/catalog/recipes/torr/wikitq/markdown/shuffle_cols_augmentation_1_demos.json -> build/lib/unitxt/catalog/recipes/torr/wikitq/markdown 2026-05-27T11:53:40,003 copying src/unitxt/catalog/recipes/torr/wikitq/markdown/transpose_augmentation_1_demos.json -> build/lib/unitxt/catalog/recipes/torr/wikitq/markdown 2026-05-27T11:53:40,006 creating build/lib/unitxt/catalog/recipes/torr/wikitq/concat 2026-05-27T11:53:40,007 copying src/unitxt/catalog/recipes/torr/wikitq/concat/insert_empty_rows_augmentation_1_demos.json -> build/lib/unitxt/catalog/recipes/torr/wikitq/concat 2026-05-27T11:53:40,009 copying src/unitxt/catalog/recipes/torr/wikitq/concat/shuffle_rows_augmentation_1_demos.json -> build/lib/unitxt/catalog/recipes/torr/wikitq/concat 2026-05-27T11:53:40,012 copying src/unitxt/catalog/recipes/torr/wikitq/concat/no_augmentation_1_demos.json -> build/lib/unitxt/catalog/recipes/torr/wikitq/concat 2026-05-27T11:53:40,014 copying src/unitxt/catalog/recipes/torr/wikitq/concat/shuffle_cols_augmentation_1_demos.json -> build/lib/unitxt/catalog/recipes/torr/wikitq/concat 2026-05-27T11:53:40,017 copying src/unitxt/catalog/recipes/torr/wikitq/concat/transpose_augmentation_1_demos.json -> build/lib/unitxt/catalog/recipes/torr/wikitq/concat 2026-05-27T11:53:40,019 creating build/lib/unitxt/catalog/recipes/torr/wikitq/csv 2026-05-27T11:53:40,020 copying src/unitxt/catalog/recipes/torr/wikitq/csv/insert_empty_rows_augmentation_1_demos.json -> build/lib/unitxt/catalog/recipes/torr/wikitq/csv 2026-05-27T11:53:40,022 copying src/unitxt/catalog/recipes/torr/wikitq/csv/shuffle_rows_augmentation_1_demos.json -> build/lib/unitxt/catalog/recipes/torr/wikitq/csv 2026-05-27T11:53:40,025 copying src/unitxt/catalog/recipes/torr/wikitq/csv/no_augmentation_1_demos.json -> build/lib/unitxt/catalog/recipes/torr/wikitq/csv 2026-05-27T11:53:40,027 copying src/unitxt/catalog/recipes/torr/wikitq/csv/shuffle_cols_augmentation_1_demos.json -> build/lib/unitxt/catalog/recipes/torr/wikitq/csv 2026-05-27T11:53:40,029 copying src/unitxt/catalog/recipes/torr/wikitq/csv/transpose_augmentation_1_demos.json -> build/lib/unitxt/catalog/recipes/torr/wikitq/csv 2026-05-27T11:53:40,031 creating build/lib/unitxt/catalog/recipes/torr/wikitq/indexed_row_major 2026-05-27T11:53:40,032 copying src/unitxt/catalog/recipes/torr/wikitq/indexed_row_major/insert_empty_rows_augmentation_1_demos.json -> build/lib/unitxt/catalog/recipes/torr/wikitq/indexed_row_major 2026-05-27T11:53:40,035 copying src/unitxt/catalog/recipes/torr/wikitq/indexed_row_major/shuffle_rows_augmentation_1_demos.json -> build/lib/unitxt/catalog/recipes/torr/wikitq/indexed_row_major 2026-05-27T11:53:40,037 copying src/unitxt/catalog/recipes/torr/wikitq/indexed_row_major/no_augmentation_1_demos.json -> build/lib/unitxt/catalog/recipes/torr/wikitq/indexed_row_major 2026-05-27T11:53:40,040 copying src/unitxt/catalog/recipes/torr/wikitq/indexed_row_major/shuffle_cols_augmentation_1_demos.json -> build/lib/unitxt/catalog/recipes/torr/wikitq/indexed_row_major 2026-05-27T11:53:40,042 copying src/unitxt/catalog/recipes/torr/wikitq/indexed_row_major/transpose_augmentation_1_demos.json -> build/lib/unitxt/catalog/recipes/torr/wikitq/indexed_row_major 2026-05-27T11:53:40,044 creating build/lib/unitxt/catalog/recipes/torr/wikitq/html 2026-05-27T11:53:40,045 copying src/unitxt/catalog/recipes/torr/wikitq/html/insert_empty_rows_augmentation_1_demos.json -> build/lib/unitxt/catalog/recipes/torr/wikitq/html 2026-05-27T11:53:40,048 copying src/unitxt/catalog/recipes/torr/wikitq/html/shuffle_rows_augmentation_1_demos.json -> build/lib/unitxt/catalog/recipes/torr/wikitq/html 2026-05-27T11:53:40,050 copying src/unitxt/catalog/recipes/torr/wikitq/html/no_augmentation_1_demos.json -> build/lib/unitxt/catalog/recipes/torr/wikitq/html 2026-05-27T11:53:40,052 copying src/unitxt/catalog/recipes/torr/wikitq/html/shuffle_cols_augmentation_1_demos.json -> build/lib/unitxt/catalog/recipes/torr/wikitq/html 2026-05-27T11:53:40,055 copying src/unitxt/catalog/recipes/torr/wikitq/html/transpose_augmentation_1_demos.json -> build/lib/unitxt/catalog/recipes/torr/wikitq/html 2026-05-27T11:53:40,057 creating build/lib/unitxt/catalog/recipes/torr/fin_qa/json 2026-05-27T11:53:40,059 copying src/unitxt/catalog/recipes/torr/fin_qa/json/shuffle_cols_augmentation_5_demos.json -> build/lib/unitxt/catalog/recipes/torr/fin_qa/json 2026-05-27T11:53:40,061 copying src/unitxt/catalog/recipes/torr/fin_qa/json/insert_empty_rows_augmentation_5_demos.json -> build/lib/unitxt/catalog/recipes/torr/fin_qa/json 2026-05-27T11:53:40,064 copying src/unitxt/catalog/recipes/torr/fin_qa/json/no_augmentation_5_demos.json -> build/lib/unitxt/catalog/recipes/torr/fin_qa/json 2026-05-27T11:53:40,066 copying src/unitxt/catalog/recipes/torr/fin_qa/json/transpose_augmentation_5_demos.json -> build/lib/unitxt/catalog/recipes/torr/fin_qa/json 2026-05-27T11:53:40,069 copying src/unitxt/catalog/recipes/torr/fin_qa/json/shuffle_rows_augmentation_5_demos.json -> build/lib/unitxt/catalog/recipes/torr/fin_qa/json 2026-05-27T11:53:40,071 creating build/lib/unitxt/catalog/recipes/torr/fin_qa/df 2026-05-27T11:53:40,072 copying src/unitxt/catalog/recipes/torr/fin_qa/df/shuffle_cols_augmentation_5_demos.json -> build/lib/unitxt/catalog/recipes/torr/fin_qa/df 2026-05-27T11:53:40,075 copying src/unitxt/catalog/recipes/torr/fin_qa/df/insert_empty_rows_augmentation_5_demos.json -> build/lib/unitxt/catalog/recipes/torr/fin_qa/df 2026-05-27T11:53:40,077 copying src/unitxt/catalog/recipes/torr/fin_qa/df/no_augmentation_5_demos.json -> build/lib/unitxt/catalog/recipes/torr/fin_qa/df 2026-05-27T11:53:40,079 copying src/unitxt/catalog/recipes/torr/fin_qa/df/transpose_augmentation_5_demos.json -> build/lib/unitxt/catalog/recipes/torr/fin_qa/df 2026-05-27T11:53:40,082 copying src/unitxt/catalog/recipes/torr/fin_qa/df/shuffle_rows_augmentation_5_demos.json -> build/lib/unitxt/catalog/recipes/torr/fin_qa/df 2026-05-27T11:53:40,084 creating build/lib/unitxt/catalog/recipes/torr/fin_qa/markdown 2026-05-27T11:53:40,085 copying src/unitxt/catalog/recipes/torr/fin_qa/markdown/shuffle_cols_augmentation_5_demos.json -> build/lib/unitxt/catalog/recipes/torr/fin_qa/markdown 2026-05-27T11:53:40,087 copying src/unitxt/catalog/recipes/torr/fin_qa/markdown/insert_empty_rows_augmentation_5_demos.json -> build/lib/unitxt/catalog/recipes/torr/fin_qa/markdown 2026-05-27T11:53:40,090 copying src/unitxt/catalog/recipes/torr/fin_qa/markdown/no_augmentation_5_demos.json -> build/lib/unitxt/catalog/recipes/torr/fin_qa/markdown 2026-05-27T11:53:40,092 copying src/unitxt/catalog/recipes/torr/fin_qa/markdown/transpose_augmentation_5_demos.json -> build/lib/unitxt/catalog/recipes/torr/fin_qa/markdown 2026-05-27T11:53:40,094 copying src/unitxt/catalog/recipes/torr/fin_qa/markdown/shuffle_rows_augmentation_5_demos.json -> build/lib/unitxt/catalog/recipes/torr/fin_qa/markdown 2026-05-27T11:53:40,096 creating build/lib/unitxt/catalog/recipes/torr/fin_qa/concat 2026-05-27T11:53:40,098 copying src/unitxt/catalog/recipes/torr/fin_qa/concat/shuffle_cols_augmentation_5_demos.json -> build/lib/unitxt/catalog/recipes/torr/fin_qa/concat 2026-05-27T11:53:40,100 copying src/unitxt/catalog/recipes/torr/fin_qa/concat/insert_empty_rows_augmentation_5_demos.json -> build/lib/unitxt/catalog/recipes/torr/fin_qa/concat 2026-05-27T11:53:40,102 copying src/unitxt/catalog/recipes/torr/fin_qa/concat/no_augmentation_5_demos.json -> build/lib/unitxt/catalog/recipes/torr/fin_qa/concat 2026-05-27T11:53:40,105 copying src/unitxt/catalog/recipes/torr/fin_qa/concat/transpose_augmentation_5_demos.json -> build/lib/unitxt/catalog/recipes/torr/fin_qa/concat 2026-05-27T11:53:40,107 copying src/unitxt/catalog/recipes/torr/fin_qa/concat/shuffle_rows_augmentation_5_demos.json -> build/lib/unitxt/catalog/recipes/torr/fin_qa/concat 2026-05-27T11:53:40,109 creating build/lib/unitxt/catalog/recipes/torr/fin_qa/csv 2026-05-27T11:53:40,110 copying src/unitxt/catalog/recipes/torr/fin_qa/csv/shuffle_cols_augmentation_5_demos.json -> build/lib/unitxt/catalog/recipes/torr/fin_qa/csv 2026-05-27T11:53:40,113 copying src/unitxt/catalog/recipes/torr/fin_qa/csv/insert_empty_rows_augmentation_5_demos.json -> build/lib/unitxt/catalog/recipes/torr/fin_qa/csv 2026-05-27T11:53:40,115 copying src/unitxt/catalog/recipes/torr/fin_qa/csv/no_augmentation_5_demos.json -> build/lib/unitxt/catalog/recipes/torr/fin_qa/csv 2026-05-27T11:53:40,117 copying src/unitxt/catalog/recipes/torr/fin_qa/csv/transpose_augmentation_5_demos.json -> build/lib/unitxt/catalog/recipes/torr/fin_qa/csv 2026-05-27T11:53:40,120 copying src/unitxt/catalog/recipes/torr/fin_qa/csv/shuffle_rows_augmentation_5_demos.json -> build/lib/unitxt/catalog/recipes/torr/fin_qa/csv 2026-05-27T11:53:40,122 creating build/lib/unitxt/catalog/recipes/torr/fin_qa/indexed_row_major 2026-05-27T11:53:40,123 copying src/unitxt/catalog/recipes/torr/fin_qa/indexed_row_major/shuffle_cols_augmentation_5_demos.json -> build/lib/unitxt/catalog/recipes/torr/fin_qa/indexed_row_major 2026-05-27T11:53:40,126 copying src/unitxt/catalog/recipes/torr/fin_qa/indexed_row_major/insert_empty_rows_augmentation_5_demos.json -> build/lib/unitxt/catalog/recipes/torr/fin_qa/indexed_row_major 2026-05-27T11:53:40,129 copying src/unitxt/catalog/recipes/torr/fin_qa/indexed_row_major/no_augmentation_5_demos.json -> build/lib/unitxt/catalog/recipes/torr/fin_qa/indexed_row_major 2026-05-27T11:53:40,131 copying src/unitxt/catalog/recipes/torr/fin_qa/indexed_row_major/transpose_augmentation_5_demos.json -> build/lib/unitxt/catalog/recipes/torr/fin_qa/indexed_row_major 2026-05-27T11:53:40,133 copying src/unitxt/catalog/recipes/torr/fin_qa/indexed_row_major/shuffle_rows_augmentation_5_demos.json -> build/lib/unitxt/catalog/recipes/torr/fin_qa/indexed_row_major 2026-05-27T11:53:40,135 creating build/lib/unitxt/catalog/recipes/torr/fin_qa/html 2026-05-27T11:53:40,136 copying src/unitxt/catalog/recipes/torr/fin_qa/html/shuffle_cols_augmentation_5_demos.json -> build/lib/unitxt/catalog/recipes/torr/fin_qa/html 2026-05-27T11:53:40,139 copying src/unitxt/catalog/recipes/torr/fin_qa/html/insert_empty_rows_augmentation_5_demos.json -> build/lib/unitxt/catalog/recipes/torr/fin_qa/html 2026-05-27T11:53:40,141 copying src/unitxt/catalog/recipes/torr/fin_qa/html/no_augmentation_5_demos.json -> build/lib/unitxt/catalog/recipes/torr/fin_qa/html 2026-05-27T11:53:40,144 copying src/unitxt/catalog/recipes/torr/fin_qa/html/transpose_augmentation_5_demos.json -> build/lib/unitxt/catalog/recipes/torr/fin_qa/html 2026-05-27T11:53:40,146 copying src/unitxt/catalog/recipes/torr/fin_qa/html/shuffle_rows_augmentation_5_demos.json -> build/lib/unitxt/catalog/recipes/torr/fin_qa/html 2026-05-27T11:53:40,148 creating build/lib/unitxt/catalog/recipes/torr/scigen/json 2026-05-27T11:53:40,150 copying src/unitxt/catalog/recipes/torr/scigen/json/shuffle_cols_augmentation_5_demos.json -> build/lib/unitxt/catalog/recipes/torr/scigen/json 2026-05-27T11:53:40,152 copying src/unitxt/catalog/recipes/torr/scigen/json/insert_empty_rows_augmentation_5_demos.json -> build/lib/unitxt/catalog/recipes/torr/scigen/json 2026-05-27T11:53:40,154 copying src/unitxt/catalog/recipes/torr/scigen/json/no_augmentation_5_demos.json -> build/lib/unitxt/catalog/recipes/torr/scigen/json 2026-05-27T11:53:40,157 copying src/unitxt/catalog/recipes/torr/scigen/json/transpose_augmentation_5_demos.json -> build/lib/unitxt/catalog/recipes/torr/scigen/json 2026-05-27T11:53:40,159 copying src/unitxt/catalog/recipes/torr/scigen/json/shuffle_rows_augmentation_5_demos.json -> build/lib/unitxt/catalog/recipes/torr/scigen/json 2026-05-27T11:53:40,161 creating build/lib/unitxt/catalog/recipes/torr/scigen/df 2026-05-27T11:53:40,162 copying src/unitxt/catalog/recipes/torr/scigen/df/shuffle_cols_augmentation_5_demos.json -> build/lib/unitxt/catalog/recipes/torr/scigen/df 2026-05-27T11:53:40,165 copying src/unitxt/catalog/recipes/torr/scigen/df/insert_empty_rows_augmentation_5_demos.json -> build/lib/unitxt/catalog/recipes/torr/scigen/df 2026-05-27T11:53:40,168 copying src/unitxt/catalog/recipes/torr/scigen/df/no_augmentation_5_demos.json -> build/lib/unitxt/catalog/recipes/torr/scigen/df 2026-05-27T11:53:40,170 copying src/unitxt/catalog/recipes/torr/scigen/df/transpose_augmentation_5_demos.json -> build/lib/unitxt/catalog/recipes/torr/scigen/df 2026-05-27T11:53:40,172 copying src/unitxt/catalog/recipes/torr/scigen/df/shuffle_rows_augmentation_5_demos.json -> build/lib/unitxt/catalog/recipes/torr/scigen/df 2026-05-27T11:53:40,174 creating build/lib/unitxt/catalog/recipes/torr/scigen/markdown 2026-05-27T11:53:40,176 copying src/unitxt/catalog/recipes/torr/scigen/markdown/shuffle_cols_augmentation_5_demos.json -> build/lib/unitxt/catalog/recipes/torr/scigen/markdown 2026-05-27T11:53:40,178 copying src/unitxt/catalog/recipes/torr/scigen/markdown/insert_empty_rows_augmentation_5_demos.json -> build/lib/unitxt/catalog/recipes/torr/scigen/markdown 2026-05-27T11:53:40,181 copying src/unitxt/catalog/recipes/torr/scigen/markdown/no_augmentation_5_demos.json -> build/lib/unitxt/catalog/recipes/torr/scigen/markdown 2026-05-27T11:53:40,184 copying src/unitxt/catalog/recipes/torr/scigen/markdown/transpose_augmentation_5_demos.json -> build/lib/unitxt/catalog/recipes/torr/scigen/markdown 2026-05-27T11:53:40,186 copying src/unitxt/catalog/recipes/torr/scigen/markdown/shuffle_rows_augmentation_5_demos.json -> build/lib/unitxt/catalog/recipes/torr/scigen/markdown 2026-05-27T11:53:40,188 creating build/lib/unitxt/catalog/recipes/torr/scigen/concat 2026-05-27T11:53:40,189 copying src/unitxt/catalog/recipes/torr/scigen/concat/shuffle_cols_augmentation_5_demos.json -> build/lib/unitxt/catalog/recipes/torr/scigen/concat 2026-05-27T11:53:40,192 copying src/unitxt/catalog/recipes/torr/scigen/concat/insert_empty_rows_augmentation_5_demos.json -> build/lib/unitxt/catalog/recipes/torr/scigen/concat 2026-05-27T11:53:40,194 copying src/unitxt/catalog/recipes/torr/scigen/concat/no_augmentation_5_demos.json -> build/lib/unitxt/catalog/recipes/torr/scigen/concat 2026-05-27T11:53:40,198 copying src/unitxt/catalog/recipes/torr/scigen/concat/transpose_augmentation_5_demos.json -> build/lib/unitxt/catalog/recipes/torr/scigen/concat 2026-05-27T11:53:40,200 copying src/unitxt/catalog/recipes/torr/scigen/concat/shuffle_rows_augmentation_5_demos.json -> build/lib/unitxt/catalog/recipes/torr/scigen/concat 2026-05-27T11:53:40,202 creating build/lib/unitxt/catalog/recipes/torr/scigen/csv 2026-05-27T11:53:40,203 copying src/unitxt/catalog/recipes/torr/scigen/csv/shuffle_cols_augmentation_5_demos.json -> build/lib/unitxt/catalog/recipes/torr/scigen/csv 2026-05-27T11:53:40,206 copying src/unitxt/catalog/recipes/torr/scigen/csv/insert_empty_rows_augmentation_5_demos.json -> build/lib/unitxt/catalog/recipes/torr/scigen/csv 2026-05-27T11:53:40,208 copying src/unitxt/catalog/recipes/torr/scigen/csv/no_augmentation_5_demos.json -> build/lib/unitxt/catalog/recipes/torr/scigen/csv 2026-05-27T11:53:40,211 copying src/unitxt/catalog/recipes/torr/scigen/csv/transpose_augmentation_5_demos.json -> build/lib/unitxt/catalog/recipes/torr/scigen/csv 2026-05-27T11:53:40,213 copying src/unitxt/catalog/recipes/torr/scigen/csv/shuffle_rows_augmentation_5_demos.json -> build/lib/unitxt/catalog/recipes/torr/scigen/csv 2026-05-27T11:53:40,215 creating build/lib/unitxt/catalog/recipes/torr/scigen/indexed_row_major 2026-05-27T11:53:40,217 copying src/unitxt/catalog/recipes/torr/scigen/indexed_row_major/shuffle_cols_augmentation_5_demos.json -> build/lib/unitxt/catalog/recipes/torr/scigen/indexed_row_major 2026-05-27T11:53:40,219 copying src/unitxt/catalog/recipes/torr/scigen/indexed_row_major/insert_empty_rows_augmentation_5_demos.json -> build/lib/unitxt/catalog/recipes/torr/scigen/indexed_row_major 2026-05-27T11:53:40,222 copying src/unitxt/catalog/recipes/torr/scigen/indexed_row_major/no_augmentation_5_demos.json -> build/lib/unitxt/catalog/recipes/torr/scigen/indexed_row_major 2026-05-27T11:53:40,224 copying src/unitxt/catalog/recipes/torr/scigen/indexed_row_major/transpose_augmentation_5_demos.json -> build/lib/unitxt/catalog/recipes/torr/scigen/indexed_row_major 2026-05-27T11:53:40,227 copying src/unitxt/catalog/recipes/torr/scigen/indexed_row_major/shuffle_rows_augmentation_5_demos.json -> build/lib/unitxt/catalog/recipes/torr/scigen/indexed_row_major 2026-05-27T11:53:40,230 creating build/lib/unitxt/catalog/recipes/torr/scigen/html 2026-05-27T11:53:40,231 copying src/unitxt/catalog/recipes/torr/scigen/html/shuffle_cols_augmentation_5_demos.json -> build/lib/unitxt/catalog/recipes/torr/scigen/html 2026-05-27T11:53:40,234 copying src/unitxt/catalog/recipes/torr/scigen/html/insert_empty_rows_augmentation_5_demos.json -> build/lib/unitxt/catalog/recipes/torr/scigen/html 2026-05-27T11:53:40,237 copying src/unitxt/catalog/recipes/torr/scigen/html/no_augmentation_5_demos.json -> build/lib/unitxt/catalog/recipes/torr/scigen/html 2026-05-27T11:53:40,239 copying src/unitxt/catalog/recipes/torr/scigen/html/transpose_augmentation_5_demos.json -> build/lib/unitxt/catalog/recipes/torr/scigen/html 2026-05-27T11:53:40,241 copying src/unitxt/catalog/recipes/torr/scigen/html/shuffle_rows_augmentation_5_demos.json -> build/lib/unitxt/catalog/recipes/torr/scigen/html 2026-05-27T11:53:40,243 creating build/lib/unitxt/catalog/recipes/torr/numeric_nlg/json 2026-05-27T11:53:40,245 copying src/unitxt/catalog/recipes/torr/numeric_nlg/json/shuffle_cols_augmentation_5_demos.json -> build/lib/unitxt/catalog/recipes/torr/numeric_nlg/json 2026-05-27T11:53:40,247 copying src/unitxt/catalog/recipes/torr/numeric_nlg/json/insert_empty_rows_augmentation_5_demos.json -> build/lib/unitxt/catalog/recipes/torr/numeric_nlg/json 2026-05-27T11:53:40,250 copying src/unitxt/catalog/recipes/torr/numeric_nlg/json/no_augmentation_5_demos.json -> build/lib/unitxt/catalog/recipes/torr/numeric_nlg/json 2026-05-27T11:53:40,252 copying src/unitxt/catalog/recipes/torr/numeric_nlg/json/transpose_augmentation_5_demos.json -> build/lib/unitxt/catalog/recipes/torr/numeric_nlg/json 2026-05-27T11:53:40,254 copying src/unitxt/catalog/recipes/torr/numeric_nlg/json/shuffle_rows_augmentation_5_demos.json -> build/lib/unitxt/catalog/recipes/torr/numeric_nlg/json 2026-05-27T11:53:40,256 creating build/lib/unitxt/catalog/recipes/torr/numeric_nlg/df 2026-05-27T11:53:40,257 copying src/unitxt/catalog/recipes/torr/numeric_nlg/df/shuffle_cols_augmentation_5_demos.json -> build/lib/unitxt/catalog/recipes/torr/numeric_nlg/df 2026-05-27T11:53:40,260 copying src/unitxt/catalog/recipes/torr/numeric_nlg/df/insert_empty_rows_augmentation_5_demos.json -> build/lib/unitxt/catalog/recipes/torr/numeric_nlg/df 2026-05-27T11:53:40,262 copying src/unitxt/catalog/recipes/torr/numeric_nlg/df/no_augmentation_5_demos.json -> build/lib/unitxt/catalog/recipes/torr/numeric_nlg/df 2026-05-27T11:53:40,264 copying src/unitxt/catalog/recipes/torr/numeric_nlg/df/transpose_augmentation_5_demos.json -> build/lib/unitxt/catalog/recipes/torr/numeric_nlg/df 2026-05-27T11:53:40,266 copying src/unitxt/catalog/recipes/torr/numeric_nlg/df/shuffle_rows_augmentation_5_demos.json -> build/lib/unitxt/catalog/recipes/torr/numeric_nlg/df 2026-05-27T11:53:40,269 creating build/lib/unitxt/catalog/recipes/torr/numeric_nlg/markdown 2026-05-27T11:53:40,270 copying src/unitxt/catalog/recipes/torr/numeric_nlg/markdown/shuffle_cols_augmentation_5_demos.json -> build/lib/unitxt/catalog/recipes/torr/numeric_nlg/markdown 2026-05-27T11:53:40,272 copying src/unitxt/catalog/recipes/torr/numeric_nlg/markdown/insert_empty_rows_augmentation_5_demos.json -> build/lib/unitxt/catalog/recipes/torr/numeric_nlg/markdown 2026-05-27T11:53:40,274 copying src/unitxt/catalog/recipes/torr/numeric_nlg/markdown/no_augmentation_5_demos.json -> build/lib/unitxt/catalog/recipes/torr/numeric_nlg/markdown 2026-05-27T11:53:40,277 copying src/unitxt/catalog/recipes/torr/numeric_nlg/markdown/transpose_augmentation_5_demos.json -> build/lib/unitxt/catalog/recipes/torr/numeric_nlg/markdown 2026-05-27T11:53:40,279 copying src/unitxt/catalog/recipes/torr/numeric_nlg/markdown/shuffle_rows_augmentation_5_demos.json -> build/lib/unitxt/catalog/recipes/torr/numeric_nlg/markdown 2026-05-27T11:53:40,281 creating build/lib/unitxt/catalog/recipes/torr/numeric_nlg/concat 2026-05-27T11:53:40,282 copying src/unitxt/catalog/recipes/torr/numeric_nlg/concat/shuffle_cols_augmentation_5_demos.json -> build/lib/unitxt/catalog/recipes/torr/numeric_nlg/concat 2026-05-27T11:53:40,284 copying src/unitxt/catalog/recipes/torr/numeric_nlg/concat/insert_empty_rows_augmentation_5_demos.json -> build/lib/unitxt/catalog/recipes/torr/numeric_nlg/concat 2026-05-27T11:53:40,287 copying src/unitxt/catalog/recipes/torr/numeric_nlg/concat/no_augmentation_5_demos.json -> build/lib/unitxt/catalog/recipes/torr/numeric_nlg/concat 2026-05-27T11:53:40,289 copying src/unitxt/catalog/recipes/torr/numeric_nlg/concat/transpose_augmentation_5_demos.json -> build/lib/unitxt/catalog/recipes/torr/numeric_nlg/concat 2026-05-27T11:53:40,291 copying src/unitxt/catalog/recipes/torr/numeric_nlg/concat/shuffle_rows_augmentation_5_demos.json -> build/lib/unitxt/catalog/recipes/torr/numeric_nlg/concat 2026-05-27T11:53:40,293 creating build/lib/unitxt/catalog/recipes/torr/numeric_nlg/csv 2026-05-27T11:53:40,294 copying src/unitxt/catalog/recipes/torr/numeric_nlg/csv/shuffle_cols_augmentation_5_demos.json -> build/lib/unitxt/catalog/recipes/torr/numeric_nlg/csv 2026-05-27T11:53:40,297 copying src/unitxt/catalog/recipes/torr/numeric_nlg/csv/insert_empty_rows_augmentation_5_demos.json -> build/lib/unitxt/catalog/recipes/torr/numeric_nlg/csv 2026-05-27T11:53:40,299 copying src/unitxt/catalog/recipes/torr/numeric_nlg/csv/no_augmentation_5_demos.json -> build/lib/unitxt/catalog/recipes/torr/numeric_nlg/csv 2026-05-27T11:53:40,301 copying src/unitxt/catalog/recipes/torr/numeric_nlg/csv/transpose_augmentation_5_demos.json -> build/lib/unitxt/catalog/recipes/torr/numeric_nlg/csv 2026-05-27T11:53:40,303 copying src/unitxt/catalog/recipes/torr/numeric_nlg/csv/shuffle_rows_augmentation_5_demos.json -> build/lib/unitxt/catalog/recipes/torr/numeric_nlg/csv 2026-05-27T11:53:40,305 creating build/lib/unitxt/catalog/recipes/torr/numeric_nlg/indexed_row_major 2026-05-27T11:53:40,306 copying src/unitxt/catalog/recipes/torr/numeric_nlg/indexed_row_major/shuffle_cols_augmentation_5_demos.json -> build/lib/unitxt/catalog/recipes/torr/numeric_nlg/indexed_row_major 2026-05-27T11:53:40,309 copying src/unitxt/catalog/recipes/torr/numeric_nlg/indexed_row_major/insert_empty_rows_augmentation_5_demos.json -> build/lib/unitxt/catalog/recipes/torr/numeric_nlg/indexed_row_major 2026-05-27T11:53:40,311 copying src/unitxt/catalog/recipes/torr/numeric_nlg/indexed_row_major/no_augmentation_5_demos.json -> build/lib/unitxt/catalog/recipes/torr/numeric_nlg/indexed_row_major 2026-05-27T11:53:40,313 copying src/unitxt/catalog/recipes/torr/numeric_nlg/indexed_row_major/transpose_augmentation_5_demos.json -> build/lib/unitxt/catalog/recipes/torr/numeric_nlg/indexed_row_major 2026-05-27T11:53:40,315 copying src/unitxt/catalog/recipes/torr/numeric_nlg/indexed_row_major/shuffle_rows_augmentation_5_demos.json -> build/lib/unitxt/catalog/recipes/torr/numeric_nlg/indexed_row_major 2026-05-27T11:53:40,318 creating build/lib/unitxt/catalog/recipes/torr/numeric_nlg/html 2026-05-27T11:53:40,319 copying src/unitxt/catalog/recipes/torr/numeric_nlg/html/shuffle_cols_augmentation_5_demos.json -> build/lib/unitxt/catalog/recipes/torr/numeric_nlg/html 2026-05-27T11:53:40,321 copying src/unitxt/catalog/recipes/torr/numeric_nlg/html/insert_empty_rows_augmentation_5_demos.json -> build/lib/unitxt/catalog/recipes/torr/numeric_nlg/html 2026-05-27T11:53:40,323 copying src/unitxt/catalog/recipes/torr/numeric_nlg/html/no_augmentation_5_demos.json -> build/lib/unitxt/catalog/recipes/torr/numeric_nlg/html 2026-05-27T11:53:40,325 copying src/unitxt/catalog/recipes/torr/numeric_nlg/html/transpose_augmentation_5_demos.json -> build/lib/unitxt/catalog/recipes/torr/numeric_nlg/html 2026-05-27T11:53:40,328 copying src/unitxt/catalog/recipes/torr/numeric_nlg/html/shuffle_rows_augmentation_5_demos.json -> build/lib/unitxt/catalog/recipes/torr/numeric_nlg/html 2026-05-27T11:53:40,330 creating build/lib/unitxt/catalog/recipes/torr/turl_col_type/json 2026-05-27T11:53:40,331 copying src/unitxt/catalog/recipes/torr/turl_col_type/json/shuffle_cols_augmentation_5_demos.json -> build/lib/unitxt/catalog/recipes/torr/turl_col_type/json 2026-05-27T11:53:40,334 copying src/unitxt/catalog/recipes/torr/turl_col_type/json/insert_empty_rows_augmentation_5_demos.json -> build/lib/unitxt/catalog/recipes/torr/turl_col_type/json 2026-05-27T11:53:40,336 copying src/unitxt/catalog/recipes/torr/turl_col_type/json/no_augmentation_5_demos.json -> build/lib/unitxt/catalog/recipes/torr/turl_col_type/json 2026-05-27T11:53:40,338 copying src/unitxt/catalog/recipes/torr/turl_col_type/json/transpose_augmentation_5_demos.json -> build/lib/unitxt/catalog/recipes/torr/turl_col_type/json 2026-05-27T11:53:40,340 copying src/unitxt/catalog/recipes/torr/turl_col_type/json/shuffle_rows_augmentation_5_demos.json -> build/lib/unitxt/catalog/recipes/torr/turl_col_type/json 2026-05-27T11:53:40,343 creating build/lib/unitxt/catalog/recipes/torr/turl_col_type/df 2026-05-27T11:53:40,344 copying src/unitxt/catalog/recipes/torr/turl_col_type/df/shuffle_cols_augmentation_5_demos.json -> build/lib/unitxt/catalog/recipes/torr/turl_col_type/df 2026-05-27T11:53:40,346 copying src/unitxt/catalog/recipes/torr/turl_col_type/df/insert_empty_rows_augmentation_5_demos.json -> build/lib/unitxt/catalog/recipes/torr/turl_col_type/df 2026-05-27T11:53:40,348 copying src/unitxt/catalog/recipes/torr/turl_col_type/df/no_augmentation_5_demos.json -> build/lib/unitxt/catalog/recipes/torr/turl_col_type/df 2026-05-27T11:53:40,350 copying src/unitxt/catalog/recipes/torr/turl_col_type/df/transpose_augmentation_5_demos.json -> build/lib/unitxt/catalog/recipes/torr/turl_col_type/df 2026-05-27T11:53:40,353 copying src/unitxt/catalog/recipes/torr/turl_col_type/df/shuffle_rows_augmentation_5_demos.json -> build/lib/unitxt/catalog/recipes/torr/turl_col_type/df 2026-05-27T11:53:40,355 creating build/lib/unitxt/catalog/recipes/torr/turl_col_type/markdown 2026-05-27T11:53:40,356 copying src/unitxt/catalog/recipes/torr/turl_col_type/markdown/shuffle_cols_augmentation_5_demos.json -> build/lib/unitxt/catalog/recipes/torr/turl_col_type/markdown 2026-05-27T11:53:40,358 copying src/unitxt/catalog/recipes/torr/turl_col_type/markdown/insert_empty_rows_augmentation_5_demos.json -> build/lib/unitxt/catalog/recipes/torr/turl_col_type/markdown 2026-05-27T11:53:40,360 copying src/unitxt/catalog/recipes/torr/turl_col_type/markdown/no_augmentation_5_demos.json -> build/lib/unitxt/catalog/recipes/torr/turl_col_type/markdown 2026-05-27T11:53:40,363 copying src/unitxt/catalog/recipes/torr/turl_col_type/markdown/transpose_augmentation_5_demos.json -> build/lib/unitxt/catalog/recipes/torr/turl_col_type/markdown 2026-05-27T11:53:40,365 copying src/unitxt/catalog/recipes/torr/turl_col_type/markdown/shuffle_rows_augmentation_5_demos.json -> build/lib/unitxt/catalog/recipes/torr/turl_col_type/markdown 2026-05-27T11:53:40,367 creating build/lib/unitxt/catalog/recipes/torr/turl_col_type/concat 2026-05-27T11:53:40,368 copying src/unitxt/catalog/recipes/torr/turl_col_type/concat/shuffle_cols_augmentation_5_demos.json -> build/lib/unitxt/catalog/recipes/torr/turl_col_type/concat 2026-05-27T11:53:40,370 copying src/unitxt/catalog/recipes/torr/turl_col_type/concat/insert_empty_rows_augmentation_5_demos.json -> build/lib/unitxt/catalog/recipes/torr/turl_col_type/concat 2026-05-27T11:53:40,372 copying src/unitxt/catalog/recipes/torr/turl_col_type/concat/no_augmentation_5_demos.json -> build/lib/unitxt/catalog/recipes/torr/turl_col_type/concat 2026-05-27T11:53:40,374 copying src/unitxt/catalog/recipes/torr/turl_col_type/concat/transpose_augmentation_5_demos.json -> build/lib/unitxt/catalog/recipes/torr/turl_col_type/concat 2026-05-27T11:53:40,377 copying src/unitxt/catalog/recipes/torr/turl_col_type/concat/shuffle_rows_augmentation_5_demos.json -> build/lib/unitxt/catalog/recipes/torr/turl_col_type/concat 2026-05-27T11:53:40,379 creating build/lib/unitxt/catalog/recipes/torr/turl_col_type/csv 2026-05-27T11:53:40,380 copying src/unitxt/catalog/recipes/torr/turl_col_type/csv/shuffle_cols_augmentation_5_demos.json -> build/lib/unitxt/catalog/recipes/torr/turl_col_type/csv 2026-05-27T11:53:40,382 copying src/unitxt/catalog/recipes/torr/turl_col_type/csv/insert_empty_rows_augmentation_5_demos.json -> build/lib/unitxt/catalog/recipes/torr/turl_col_type/csv 2026-05-27T11:53:40,384 copying src/unitxt/catalog/recipes/torr/turl_col_type/csv/no_augmentation_5_demos.json -> build/lib/unitxt/catalog/recipes/torr/turl_col_type/csv 2026-05-27T11:53:40,386 copying src/unitxt/catalog/recipes/torr/turl_col_type/csv/transpose_augmentation_5_demos.json -> build/lib/unitxt/catalog/recipes/torr/turl_col_type/csv 2026-05-27T11:53:40,388 copying src/unitxt/catalog/recipes/torr/turl_col_type/csv/shuffle_rows_augmentation_5_demos.json -> build/lib/unitxt/catalog/recipes/torr/turl_col_type/csv 2026-05-27T11:53:40,390 creating build/lib/unitxt/catalog/recipes/torr/turl_col_type/indexed_row_major 2026-05-27T11:53:40,392 copying src/unitxt/catalog/recipes/torr/turl_col_type/indexed_row_major/shuffle_cols_augmentation_5_demos.json -> build/lib/unitxt/catalog/recipes/torr/turl_col_type/indexed_row_major 2026-05-27T11:53:40,394 copying src/unitxt/catalog/recipes/torr/turl_col_type/indexed_row_major/insert_empty_rows_augmentation_5_demos.json -> build/lib/unitxt/catalog/recipes/torr/turl_col_type/indexed_row_major 2026-05-27T11:53:40,396 copying src/unitxt/catalog/recipes/torr/turl_col_type/indexed_row_major/no_augmentation_5_demos.json -> build/lib/unitxt/catalog/recipes/torr/turl_col_type/indexed_row_major 2026-05-27T11:53:40,398 copying src/unitxt/catalog/recipes/torr/turl_col_type/indexed_row_major/transpose_augmentation_5_demos.json -> build/lib/unitxt/catalog/recipes/torr/turl_col_type/indexed_row_major 2026-05-27T11:53:40,400 copying src/unitxt/catalog/recipes/torr/turl_col_type/indexed_row_major/shuffle_rows_augmentation_5_demos.json -> build/lib/unitxt/catalog/recipes/torr/turl_col_type/indexed_row_major 2026-05-27T11:53:40,402 creating build/lib/unitxt/catalog/recipes/torr/turl_col_type/html 2026-05-27T11:53:40,403 copying src/unitxt/catalog/recipes/torr/turl_col_type/html/shuffle_cols_augmentation_5_demos.json -> build/lib/unitxt/catalog/recipes/torr/turl_col_type/html 2026-05-27T11:53:40,406 copying src/unitxt/catalog/recipes/torr/turl_col_type/html/insert_empty_rows_augmentation_5_demos.json -> build/lib/unitxt/catalog/recipes/torr/turl_col_type/html 2026-05-27T11:53:40,408 copying src/unitxt/catalog/recipes/torr/turl_col_type/html/no_augmentation_5_demos.json -> build/lib/unitxt/catalog/recipes/torr/turl_col_type/html 2026-05-27T11:53:40,410 copying src/unitxt/catalog/recipes/torr/turl_col_type/html/transpose_augmentation_5_demos.json -> build/lib/unitxt/catalog/recipes/torr/turl_col_type/html 2026-05-27T11:53:40,412 copying src/unitxt/catalog/recipes/torr/turl_col_type/html/shuffle_rows_augmentation_5_demos.json -> build/lib/unitxt/catalog/recipes/torr/turl_col_type/html 2026-05-27T11:53:40,414 creating build/lib/unitxt/catalog/serializers/table 2026-05-27T11:53:40,416 copying src/unitxt/catalog/serializers/table/concat.json -> build/lib/unitxt/catalog/serializers/table 2026-05-27T11:53:40,418 copying src/unitxt/catalog/serializers/table/df.json -> build/lib/unitxt/catalog/serializers/table 2026-05-27T11:53:40,420 copying src/unitxt/catalog/serializers/table/image.json -> build/lib/unitxt/catalog/serializers/table 2026-05-27T11:53:40,422 copying src/unitxt/catalog/serializers/table/indexed_row_major.json -> build/lib/unitxt/catalog/serializers/table 2026-05-27T11:53:40,424 copying src/unitxt/catalog/serializers/table/json.json -> build/lib/unitxt/catalog/serializers/table 2026-05-27T11:53:40,427 copying src/unitxt/catalog/serializers/table/html.json -> build/lib/unitxt/catalog/serializers/table 2026-05-27T11:53:40,429 copying src/unitxt/catalog/serializers/table/markdown.json -> build/lib/unitxt/catalog/serializers/table 2026-05-27T11:53:40,431 creating build/lib/unitxt/catalog/serializers/text2sql 2026-05-27T11:53:40,432 copying src/unitxt/catalog/serializers/text2sql/schema.json -> build/lib/unitxt/catalog/serializers/text2sql 2026-05-27T11:53:40,434 creating build/lib/unitxt/catalog/tasks 2026-05-27T11:53:40,435 copying src/unitxt/catalog/tasks/text2sql.json -> build/lib/unitxt/catalog/tasks 2026-05-27T11:53:40,438 copying src/unitxt/catalog/tasks/language_identification.json -> build/lib/unitxt/catalog/tasks 2026-05-27T11:53:40,440 copying src/unitxt/catalog/tasks/grammatical_error_correction.json -> build/lib/unitxt/catalog/tasks 2026-05-27T11:53:40,442 copying src/unitxt/catalog/tasks/key_value_extraction.json -> build/lib/unitxt/catalog/tasks 2026-05-27T11:53:40,444 copying src/unitxt/catalog/tasks/schema_linking.json -> build/lib/unitxt/catalog/tasks 2026-05-27T11:53:40,446 copying src/unitxt/catalog/tasks/generation.json -> build/lib/unitxt/catalog/tasks 2026-05-27T11:53:40,448 copying src/unitxt/catalog/tasks/text2sql_logic.json -> build/lib/unitxt/catalog/tasks 2026-05-27T11:53:40,451 creating build/lib/unitxt/catalog/tasks/summarization 2026-05-27T11:53:40,452 copying src/unitxt/catalog/tasks/summarization/abstractive.json -> build/lib/unitxt/catalog/tasks/summarization 2026-05-27T11:53:40,454 creating build/lib/unitxt/catalog/tasks/translation 2026-05-27T11:53:40,455 copying src/unitxt/catalog/tasks/translation/directed.json -> build/lib/unitxt/catalog/tasks/translation 2026-05-27T11:53:40,457 creating build/lib/unitxt/catalog/tasks/tool_calling 2026-05-27T11:53:40,458 copying src/unitxt/catalog/tasks/tool_calling/supervised.json -> build/lib/unitxt/catalog/tasks/tool_calling 2026-05-27T11:53:40,460 copying src/unitxt/catalog/tasks/tool_calling/multi_turn.json -> build/lib/unitxt/catalog/tasks/tool_calling 2026-05-27T11:53:40,462 creating build/lib/unitxt/catalog/tasks/generation 2026-05-27T11:53:40,463 copying src/unitxt/catalog/tasks/generation/from_pair.json -> build/lib/unitxt/catalog/tasks/generation 2026-05-27T11:53:40,465 creating build/lib/unitxt/catalog/tasks/rag 2026-05-27T11:53:40,466 copying src/unitxt/catalog/tasks/rag/response_generation.json -> build/lib/unitxt/catalog/tasks/rag 2026-05-27T11:53:40,469 copying src/unitxt/catalog/tasks/rag/corpora.json -> build/lib/unitxt/catalog/tasks/rag 2026-05-27T11:53:40,471 copying src/unitxt/catalog/tasks/rag/end_to_end.json -> build/lib/unitxt/catalog/tasks/rag 2026-05-27T11:53:40,473 creating build/lib/unitxt/catalog/tasks/rewriting 2026-05-27T11:53:40,474 copying src/unitxt/catalog/tasks/rewriting/paraphrase.json -> build/lib/unitxt/catalog/tasks/rewriting 2026-05-27T11:53:40,476 copying src/unitxt/catalog/tasks/rewriting/by_attribute.json -> build/lib/unitxt/catalog/tasks/rewriting 2026-05-27T11:53:40,478 creating build/lib/unitxt/catalog/tasks/classification 2026-05-27T11:53:40,479 copying src/unitxt/catalog/tasks/classification/multi_class.json -> build/lib/unitxt/catalog/tasks/classification 2026-05-27T11:53:40,482 copying src/unitxt/catalog/tasks/classification/binary.json -> build/lib/unitxt/catalog/tasks/classification 2026-05-27T11:53:40,484 copying src/unitxt/catalog/tasks/classification/multi_label.json -> build/lib/unitxt/catalog/tasks/classification 2026-05-27T11:53:40,486 creating build/lib/unitxt/catalog/tasks/classification/binary 2026-05-27T11:53:40,487 copying src/unitxt/catalog/tasks/classification/binary/zero_or_one.json -> build/lib/unitxt/catalog/tasks/classification/binary 2026-05-27T11:53:40,489 creating build/lib/unitxt/catalog/tasks/classification/multi_class 2026-05-27T11:53:40,490 copying src/unitxt/catalog/tasks/classification/multi_class/with_classes_descriptions.json -> build/lib/unitxt/catalog/tasks/classification/multi_class 2026-05-27T11:53:40,493 copying src/unitxt/catalog/tasks/classification/multi_class/relation.json -> build/lib/unitxt/catalog/tasks/classification/multi_class 2026-05-27T11:53:40,495 copying src/unitxt/catalog/tasks/classification/multi_class/topic_classification.json -> build/lib/unitxt/catalog/tasks/classification/multi_class 2026-05-27T11:53:40,497 creating build/lib/unitxt/catalog/tasks/rag_eval/correctness_holistic 2026-05-27T11:53:40,499 copying src/unitxt/catalog/tasks/rag_eval/correctness_holistic/non_binary.json -> build/lib/unitxt/catalog/tasks/rag_eval/correctness_holistic 2026-05-27T11:53:40,501 copying src/unitxt/catalog/tasks/rag_eval/correctness_holistic/binary.json -> build/lib/unitxt/catalog/tasks/rag_eval/correctness_holistic 2026-05-27T11:53:40,503 creating build/lib/unitxt/catalog/tasks/rag_eval/context_relevance 2026-05-27T11:53:40,504 copying src/unitxt/catalog/tasks/rag_eval/context_relevance/non_binary.json -> build/lib/unitxt/catalog/tasks/rag_eval/context_relevance 2026-05-27T11:53:40,507 copying src/unitxt/catalog/tasks/rag_eval/context_relevance/binary.json -> build/lib/unitxt/catalog/tasks/rag_eval/context_relevance 2026-05-27T11:53:40,509 creating build/lib/unitxt/catalog/tasks/rag_eval/answer_correctness 2026-05-27T11:53:40,511 copying src/unitxt/catalog/tasks/rag_eval/answer_correctness/non_binary.json -> build/lib/unitxt/catalog/tasks/rag_eval/answer_correctness 2026-05-27T11:53:40,513 copying src/unitxt/catalog/tasks/rag_eval/answer_correctness/binary.json -> build/lib/unitxt/catalog/tasks/rag_eval/answer_correctness 2026-05-27T11:53:40,515 creating build/lib/unitxt/catalog/tasks/rag_eval/answer_relevance 2026-05-27T11:53:40,516 copying src/unitxt/catalog/tasks/rag_eval/answer_relevance/non_binary.json -> build/lib/unitxt/catalog/tasks/rag_eval/answer_relevance 2026-05-27T11:53:40,518 copying src/unitxt/catalog/tasks/rag_eval/answer_relevance/binary.json -> build/lib/unitxt/catalog/tasks/rag_eval/answer_relevance 2026-05-27T11:53:40,520 creating build/lib/unitxt/catalog/tasks/rag_eval/faithfulness 2026-05-27T11:53:40,521 copying src/unitxt/catalog/tasks/rag_eval/faithfulness/non_binary.json -> build/lib/unitxt/catalog/tasks/rag_eval/faithfulness 2026-05-27T11:53:40,523 copying src/unitxt/catalog/tasks/rag_eval/faithfulness/binary.json -> build/lib/unitxt/catalog/tasks/rag_eval/faithfulness 2026-05-27T11:53:40,525 creating build/lib/unitxt/catalog/tasks/ner 2026-05-27T11:53:40,526 copying src/unitxt/catalog/tasks/ner/all_entity_types.json -> build/lib/unitxt/catalog/tasks/ner 2026-05-27T11:53:40,529 copying src/unitxt/catalog/tasks/ner/single_entity_type.json -> build/lib/unitxt/catalog/tasks/ner 2026-05-27T11:53:40,531 creating build/lib/unitxt/catalog/tasks/response_assessment/pairwise_comparison 2026-05-27T11:53:40,532 copying src/unitxt/catalog/tasks/response_assessment/pairwise_comparison/multi_turn_with_reference.json -> build/lib/unitxt/catalog/tasks/response_assessment/pairwise_comparison 2026-05-27T11:53:40,535 copying src/unitxt/catalog/tasks/response_assessment/pairwise_comparison/single_turn.json -> build/lib/unitxt/catalog/tasks/response_assessment/pairwise_comparison 2026-05-27T11:53:40,537 copying src/unitxt/catalog/tasks/response_assessment/pairwise_comparison/multi_turn.json -> build/lib/unitxt/catalog/tasks/response_assessment/pairwise_comparison 2026-05-27T11:53:40,539 copying src/unitxt/catalog/tasks/response_assessment/pairwise_comparison/single_turn_with_reference.json -> build/lib/unitxt/catalog/tasks/response_assessment/pairwise_comparison 2026-05-27T11:53:40,541 creating build/lib/unitxt/catalog/tasks/response_assessment/pairwise_comparative_rating 2026-05-27T11:53:40,542 copying src/unitxt/catalog/tasks/response_assessment/pairwise_comparative_rating/single_turn.json -> build/lib/unitxt/catalog/tasks/response_assessment/pairwise_comparative_rating 2026-05-27T11:53:40,544 creating build/lib/unitxt/catalog/tasks/response_assessment/rating 2026-05-27T11:53:40,545 copying src/unitxt/catalog/tasks/response_assessment/rating/multi_turn_with_reference.json -> build/lib/unitxt/catalog/tasks/response_assessment/rating 2026-05-27T11:53:40,548 copying src/unitxt/catalog/tasks/response_assessment/rating/single_turn.json -> build/lib/unitxt/catalog/tasks/response_assessment/rating 2026-05-27T11:53:40,550 copying src/unitxt/catalog/tasks/response_assessment/rating/multi_turn.json -> build/lib/unitxt/catalog/tasks/response_assessment/rating 2026-05-27T11:53:40,552 copying src/unitxt/catalog/tasks/response_assessment/rating/single_turn_with_reference.json -> build/lib/unitxt/catalog/tasks/response_assessment/rating 2026-05-27T11:53:40,554 creating build/lib/unitxt/catalog/tasks/qa 2026-05-27T11:53:40,555 copying src/unitxt/catalog/tasks/qa/open.json -> build/lib/unitxt/catalog/tasks/qa 2026-05-27T11:53:40,557 copying src/unitxt/catalog/tasks/qa/extractive.json -> build/lib/unitxt/catalog/tasks/qa 2026-05-27T11:53:40,560 copying src/unitxt/catalog/tasks/qa/with_context.json -> build/lib/unitxt/catalog/tasks/qa 2026-05-27T11:53:40,562 creating build/lib/unitxt/catalog/tasks/qa/extractive 2026-05-27T11:53:40,563 copying src/unitxt/catalog/tasks/qa/extractive/multi_turn.json -> build/lib/unitxt/catalog/tasks/qa/extractive 2026-05-27T11:53:40,565 creating build/lib/unitxt/catalog/tasks/qa/with_context 2026-05-27T11:53:40,567 copying src/unitxt/catalog/tasks/qa/with_context/with_type.json -> build/lib/unitxt/catalog/tasks/qa/with_context 2026-05-27T11:53:40,570 copying src/unitxt/catalog/tasks/qa/with_context/abstractive.json -> build/lib/unitxt/catalog/tasks/qa/with_context 2026-05-27T11:53:40,573 copying src/unitxt/catalog/tasks/qa/with_context/extractive.json -> build/lib/unitxt/catalog/tasks/qa/with_context 2026-05-27T11:53:40,576 copying src/unitxt/catalog/tasks/qa/with_context/with_domain.json -> build/lib/unitxt/catalog/tasks/qa/with_context 2026-05-27T11:53:40,578 creating build/lib/unitxt/catalog/tasks/qa/multiple_choice 2026-05-27T11:53:40,580 copying src/unitxt/catalog/tasks/qa/multiple_choice/open.json -> build/lib/unitxt/catalog/tasks/qa/multiple_choice 2026-05-27T11:53:40,583 copying src/unitxt/catalog/tasks/qa/multiple_choice/with_context.json -> build/lib/unitxt/catalog/tasks/qa/multiple_choice 2026-05-27T11:53:40,586 copying src/unitxt/catalog/tasks/qa/multiple_choice/with_topic.json -> build/lib/unitxt/catalog/tasks/qa/multiple_choice 2026-05-27T11:53:40,589 creating build/lib/unitxt/catalog/tasks/qa/multiple_choice/with_context 2026-05-27T11:53:40,590 copying src/unitxt/catalog/tasks/qa/multiple_choice/with_context/with_topic.json -> build/lib/unitxt/catalog/tasks/qa/multiple_choice/with_context 2026-05-27T11:53:40,593 creating build/lib/unitxt/catalog/tasks/selection 2026-05-27T11:53:40,594 copying src/unitxt/catalog/tasks/selection/by_attribute.json -> build/lib/unitxt/catalog/tasks/selection 2026-05-27T11:53:40,597 creating build/lib/unitxt/catalog/tasks/evaluation 2026-05-27T11:53:40,599 copying src/unitxt/catalog/tasks/evaluation/preference.json -> build/lib/unitxt/catalog/tasks/evaluation 2026-05-27T11:53:40,602 creating build/lib/unitxt/catalog/tasks/targeted_sentiment_extraction 2026-05-27T11:53:40,603 copying src/unitxt/catalog/tasks/targeted_sentiment_extraction/all_sentiment_classes.json -> build/lib/unitxt/catalog/tasks/targeted_sentiment_extraction 2026-05-27T11:53:40,606 copying src/unitxt/catalog/tasks/targeted_sentiment_extraction/single_sentiment_class.json -> build/lib/unitxt/catalog/tasks/targeted_sentiment_extraction 2026-05-27T11:53:40,609 creating build/lib/unitxt/catalog/tasks/completion 2026-05-27T11:53:40,610 copying src/unitxt/catalog/tasks/completion/abstractive.json -> build/lib/unitxt/catalog/tasks/completion 2026-05-27T11:53:40,613 copying src/unitxt/catalog/tasks/completion/extractive.json -> build/lib/unitxt/catalog/tasks/completion 2026-05-27T11:53:40,616 copying src/unitxt/catalog/tasks/completion/multiple_choice.json -> build/lib/unitxt/catalog/tasks/completion 2026-05-27T11:53:40,619 creating build/lib/unitxt/catalog/tasks/span_labeling 2026-05-27T11:53:40,620 copying src/unitxt/catalog/tasks/span_labeling/extraction.json -> build/lib/unitxt/catalog/tasks/span_labeling 2026-05-27T11:53:40,623 creating build/lib/unitxt/catalog/tasks/regression 2026-05-27T11:53:40,625 copying src/unitxt/catalog/tasks/regression/single_text.json -> build/lib/unitxt/catalog/tasks/regression 2026-05-27T11:53:40,628 copying src/unitxt/catalog/tasks/regression/two_texts.json -> build/lib/unitxt/catalog/tasks/regression 2026-05-27T11:53:40,630 creating build/lib/unitxt/catalog/tasks/regression/two_texts 2026-05-27T11:53:40,632 copying src/unitxt/catalog/tasks/regression/two_texts/similarity.json -> build/lib/unitxt/catalog/tasks/regression/two_texts 2026-05-27T11:53:40,635 creating build/lib/unitxt/catalog/splitters 2026-05-27T11:53:40,637 copying src/unitxt/catalog/splitters/small_no_test.json -> build/lib/unitxt/catalog/splitters 2026-05-27T11:53:40,640 copying src/unitxt/catalog/splitters/large_no_test.json -> build/lib/unitxt/catalog/splitters 2026-05-27T11:53:40,643 copying src/unitxt/catalog/splitters/large_no_dev.json -> build/lib/unitxt/catalog/splitters 2026-05-27T11:53:40,645 copying src/unitxt/catalog/splitters/small_no_dev.json -> build/lib/unitxt/catalog/splitters 2026-05-27T11:53:40,648 copying src/unitxt/catalog/splitters/test_only.json -> build/lib/unitxt/catalog/splitters 2026-05-27T11:53:40,651 copying src/unitxt/catalog/splitters/diverse_labels_sampler.json -> build/lib/unitxt/catalog/splitters 2026-05-27T11:53:40,654 creating build/lib/unitxt/catalog/processors 2026-05-27T11:53:40,655 copying src/unitxt/catalog/processors/extract_arena_hard_numerical_judgment.json -> build/lib/unitxt/catalog/processors 2026-05-27T11:53:40,658 copying src/unitxt/catalog/processors/list_to_empty_entity_tuples.json -> build/lib/unitxt/catalog/processors 2026-05-27T11:53:40,661 copying src/unitxt/catalog/processors/to_string.json -> build/lib/unitxt/catalog/processors 2026-05-27T11:53:40,664 copying src/unitxt/catalog/processors/to_list_by_hyphen_space.json -> build/lib/unitxt/catalog/processors 2026-05-27T11:53:40,667 copying src/unitxt/catalog/processors/convert_to_boolean.json -> build/lib/unitxt/catalog/processors 2026-05-27T11:53:40,669 copying src/unitxt/catalog/processors/capitalize.json -> build/lib/unitxt/catalog/processors 2026-05-27T11:53:40,671 copying src/unitxt/catalog/processors/infer_logprobs_to_yes_no_probs.json -> build/lib/unitxt/catalog/processors 2026-05-27T11:53:40,674 copying src/unitxt/catalog/processors/load_json_predictions.json -> build/lib/unitxt/catalog/processors 2026-05-27T11:53:40,676 copying src/unitxt/catalog/processors/toxic_or_not_toxic.json -> build/lib/unitxt/catalog/processors 2026-05-27T11:53:40,679 copying src/unitxt/catalog/processors/upper_case.json -> build/lib/unitxt/catalog/processors 2026-05-27T11:53:40,681 copying src/unitxt/catalog/processors/cast_to_float_return_zero_if_failed.json -> build/lib/unitxt/catalog/processors 2026-05-27T11:53:40,683 copying src/unitxt/catalog/processors/to_yes_or_none.json -> build/lib/unitxt/catalog/processors 2026-05-27T11:53:40,685 copying src/unitxt/catalog/processors/cast_to_float_return_0_5_if_failed.json -> build/lib/unitxt/catalog/processors 2026-05-27T11:53:40,688 copying src/unitxt/catalog/processors/to_string_stripped.json -> build/lib/unitxt/catalog/processors 2026-05-27T11:53:40,690 copying src/unitxt/catalog/processors/dict_of_lists_to_value_key_pairs.json -> build/lib/unitxt/catalog/processors 2026-05-27T11:53:40,692 copying src/unitxt/catalog/processors/infer_last_token_logprobs_to_yes_no_probs.json -> build/lib/unitxt/catalog/processors 2026-05-27T11:53:40,695 copying src/unitxt/catalog/processors/hate_speech_or_not_hate_speech.json -> build/lib/unitxt/catalog/processors 2026-05-27T11:53:40,697 copying src/unitxt/catalog/processors/to_list_by_hyphen_space_from_references.json -> build/lib/unitxt/catalog/processors 2026-05-27T11:53:40,699 copying src/unitxt/catalog/processors/yes_no_to_int.json -> build/lib/unitxt/catalog/processors 2026-05-27T11:53:40,702 copying src/unitxt/catalog/processors/to_list_by_comma_space.json -> build/lib/unitxt/catalog/processors 2026-05-27T11:53:40,704 copying src/unitxt/catalog/processors/substring.json -> build/lib/unitxt/catalog/processors 2026-05-27T11:53:40,706 copying src/unitxt/catalog/processors/take_first_word.json -> build/lib/unitxt/catalog/processors 2026-05-27T11:53:40,709 copying src/unitxt/catalog/processors/remove_articles.json -> build/lib/unitxt/catalog/processors 2026-05-27T11:53:40,711 copying src/unitxt/catalog/processors/match_closest_option.json -> build/lib/unitxt/catalog/processors 2026-05-27T11:53:40,714 copying src/unitxt/catalog/processors/extract_mt_bench_rating_judgment.json -> build/lib/unitxt/catalog/processors 2026-05-27T11:53:40,716 copying src/unitxt/catalog/processors/to_list_by_comma.json -> build/lib/unitxt/catalog/processors 2026-05-27T11:53:40,719 copying src/unitxt/catalog/processors/predictions_yes_1_else_0.json -> build/lib/unitxt/catalog/processors 2026-05-27T11:53:40,721 copying src/unitxt/catalog/processors/fix_whitespace.json -> build/lib/unitxt/catalog/processors 2026-05-27T11:53:40,724 copying src/unitxt/catalog/processors/str_to_float_format.json -> build/lib/unitxt/catalog/processors 2026-05-27T11:53:40,726 copying src/unitxt/catalog/processors/load_json.json -> build/lib/unitxt/catalog/processors 2026-05-27T11:53:40,729 copying src/unitxt/catalog/processors/regex_parser_from_prediction.json -> build/lib/unitxt/catalog/processors 2026-05-27T11:53:40,731 copying src/unitxt/catalog/processors/take_first_non_empty_line.json -> build/lib/unitxt/catalog/processors 2026-05-27T11:53:40,734 copying src/unitxt/catalog/processors/load_json_from_predictions.json -> build/lib/unitxt/catalog/processors 2026-05-27T11:53:40,736 copying src/unitxt/catalog/processors/extract_harm_rating_judgment.json -> build/lib/unitxt/catalog/processors 2026-05-27T11:53:40,738 copying src/unitxt/catalog/processors/cast_to_float_return_nan_if_failed.json -> build/lib/unitxt/catalog/processors 2026-05-27T11:53:40,740 copying src/unitxt/catalog/processors/take_last_non_empty_line.json -> build/lib/unitxt/catalog/processors 2026-05-27T11:53:40,743 copying src/unitxt/catalog/processors/extract_mt_bench_label_judgment.json -> build/lib/unitxt/catalog/processors 2026-05-27T11:53:40,745 copying src/unitxt/catalog/processors/scale_0_10_to_0_1.json -> build/lib/unitxt/catalog/processors 2026-05-27T11:53:40,747 copying src/unitxt/catalog/processors/to_span_label_pairs.json -> build/lib/unitxt/catalog/processors 2026-05-27T11:53:40,749 copying src/unitxt/catalog/processors/lower_case_till_punc.json -> build/lib/unitxt/catalog/processors 2026-05-27T11:53:40,752 copying src/unitxt/catalog/processors/literal_eval.json -> build/lib/unitxt/catalog/processors 2026-05-27T11:53:40,754 copying src/unitxt/catalog/processors/remove_none_from_list.json -> build/lib/unitxt/catalog/processors 2026-05-27T11:53:40,756 copying src/unitxt/catalog/processors/to_span_label_pairs_surface_only.json -> build/lib/unitxt/catalog/processors 2026-05-27T11:53:40,759 copying src/unitxt/catalog/processors/lower_case.json -> build/lib/unitxt/catalog/processors 2026-05-27T11:53:40,761 copying src/unitxt/catalog/processors/to_list_by_comma_from_references.json -> build/lib/unitxt/catalog/processors 2026-05-27T11:53:40,763 copying src/unitxt/catalog/processors/get_string_after_colon.json -> build/lib/unitxt/catalog/processors 2026-05-27T11:53:40,765 copying src/unitxt/catalog/processors/extract_verbal_judgement_bad_good.json -> build/lib/unitxt/catalog/processors 2026-05-27T11:53:40,768 copying src/unitxt/catalog/processors/remove_punctuations.json -> build/lib/unitxt/catalog/processors 2026-05-27T11:53:40,770 copying src/unitxt/catalog/processors/load_json_or_empty_tool_call.json -> build/lib/unitxt/catalog/processors 2026-05-27T11:53:40,772 copying src/unitxt/catalog/processors/extract_verbal_judgement.json -> build/lib/unitxt/catalog/processors 2026-05-27T11:53:40,774 copying src/unitxt/catalog/processors/safe_unsafe.json -> build/lib/unitxt/catalog/processors 2026-05-27T11:53:40,777 copying src/unitxt/catalog/processors/stance_to_pro_con.json -> build/lib/unitxt/catalog/processors 2026-05-27T11:53:40,779 copying src/unitxt/catalog/processors/multi_tool_call.json -> build/lib/unitxt/catalog/processors 2026-05-27T11:53:40,782 copying src/unitxt/catalog/processors/extract_from_double_brackets.json -> build/lib/unitxt/catalog/processors 2026-05-27T11:53:40,784 copying src/unitxt/catalog/processors/first_character.json -> build/lib/unitxt/catalog/processors 2026-05-27T11:53:40,786 creating build/lib/unitxt/catalog/processors/text2sql 2026-05-27T11:53:40,787 copying src/unitxt/catalog/processors/text2sql/get_sql.json -> build/lib/unitxt/catalog/processors/text2sql 2026-05-27T11:53:40,789 creating build/lib/unitxt/catalog/metrics 2026-05-27T11:53:40,791 copying src/unitxt/catalog/metrics/tool_calling.json -> build/lib/unitxt/catalog/metrics 2026-05-27T11:53:40,793 copying src/unitxt/catalog/metrics/normalized_sacrebleu.json -> build/lib/unitxt/catalog/metrics 2026-05-27T11:53:40,796 copying src/unitxt/catalog/metrics/accuracy.json -> build/lib/unitxt/catalog/metrics 2026-05-27T11:53:40,798 copying src/unitxt/catalog/metrics/mean_squared_error.json -> build/lib/unitxt/catalog/metrics 2026-05-27T11:53:40,800 copying src/unitxt/catalog/metrics/ndcg.json -> build/lib/unitxt/catalog/metrics 2026-05-27T11:53:40,803 copying src/unitxt/catalog/metrics/rouge.json -> build/lib/unitxt/catalog/metrics 2026-05-27T11:53:40,805 copying src/unitxt/catalog/metrics/exact_match_mm.json -> build/lib/unitxt/catalog/metrics 2026-05-27T11:53:40,807 copying src/unitxt/catalog/metrics/accuracy_binary.json -> build/lib/unitxt/catalog/metrics 2026-05-27T11:53:40,809 copying src/unitxt/catalog/metrics/matthews_correlation.json -> build/lib/unitxt/catalog/metrics 2026-05-27T11:53:40,811 copying src/unitxt/catalog/metrics/pearson.json -> build/lib/unitxt/catalog/metrics 2026-05-27T11:53:40,813 copying src/unitxt/catalog/metrics/weighted_win_rate_correlation.json -> build/lib/unitxt/catalog/metrics 2026-05-27T11:53:40,816 copying src/unitxt/catalog/metrics/token_overlap_with_context.json -> build/lib/unitxt/catalog/metrics 2026-05-27T11:53:40,818 copying src/unitxt/catalog/metrics/jaccard_index_words.json -> build/lib/unitxt/catalog/metrics 2026-05-27T11:53:40,820 copying src/unitxt/catalog/metrics/jaccard_index.json -> build/lib/unitxt/catalog/metrics 2026-05-27T11:53:40,822 copying src/unitxt/catalog/metrics/kpa.json -> build/lib/unitxt/catalog/metrics 2026-05-27T11:53:40,824 copying src/unitxt/catalog/metrics/f1_micro.json -> build/lib/unitxt/catalog/metrics 2026-05-27T11:53:40,826 copying src/unitxt/catalog/metrics/root_mean_squared_error.json -> build/lib/unitxt/catalog/metrics 2026-05-27T11:53:40,829 copying src/unitxt/catalog/metrics/token_overlap.json -> build/lib/unitxt/catalog/metrics 2026-05-27T11:53:40,831 copying src/unitxt/catalog/metrics/map.json -> build/lib/unitxt/catalog/metrics 2026-05-27T11:53:40,833 copying src/unitxt/catalog/metrics/max_accuracy_binary.json -> build/lib/unitxt/catalog/metrics 2026-05-27T11:53:40,835 copying src/unitxt/catalog/metrics/f1_strings.json -> build/lib/unitxt/catalog/metrics 2026-05-27T11:53:40,837 copying src/unitxt/catalog/metrics/precision_macro_multi_label.json -> build/lib/unitxt/catalog/metrics 2026-05-27T11:53:40,840 copying src/unitxt/catalog/metrics/ner.json -> build/lib/unitxt/catalog/metrics 2026-05-27T11:53:40,842 copying src/unitxt/catalog/metrics/regard_metric.json -> build/lib/unitxt/catalog/metrics 2026-05-27T11:53:40,844 copying src/unitxt/catalog/metrics/meteor_hf.json -> build/lib/unitxt/catalog/metrics 2026-05-27T11:53:40,847 copying src/unitxt/catalog/metrics/spearman.json -> build/lib/unitxt/catalog/metrics 2026-05-27T11:53:40,849 copying src/unitxt/catalog/metrics/roc_auc.json -> build/lib/unitxt/catalog/metrics 2026-05-27T11:53:40,851 copying src/unitxt/catalog/metrics/unsorted_list_exact_match.json -> build/lib/unitxt/catalog/metrics 2026-05-27T11:53:40,853 copying src/unitxt/catalog/metrics/anls.json -> build/lib/unitxt/catalog/metrics 2026-05-27T11:53:40,855 copying src/unitxt/catalog/metrics/prediction_length.json -> build/lib/unitxt/catalog/metrics 2026-05-27T11:53:40,857 copying src/unitxt/catalog/metrics/retrieval_at_k.json -> build/lib/unitxt/catalog/metrics 2026-05-27T11:53:40,859 copying src/unitxt/catalog/metrics/fin_qa_metric.json -> build/lib/unitxt/catalog/metrics 2026-05-27T11:53:40,862 copying src/unitxt/catalog/metrics/recall_micro_multi_label.json -> build/lib/unitxt/catalog/metrics 2026-05-27T11:53:40,864 copying src/unitxt/catalog/metrics/string_containment.json -> build/lib/unitxt/catalog/metrics 2026-05-27T11:53:40,866 copying src/unitxt/catalog/metrics/precision_binary.json -> build/lib/unitxt/catalog/metrics 2026-05-27T11:53:40,868 copying src/unitxt/catalog/metrics/f1_macro_multi_label.json -> build/lib/unitxt/catalog/metrics 2026-05-27T11:53:40,871 copying src/unitxt/catalog/metrics/squad.json -> build/lib/unitxt/catalog/metrics 2026-05-27T11:53:40,873 copying src/unitxt/catalog/metrics/meteor.json -> build/lib/unitxt/catalog/metrics 2026-05-27T11:53:40,875 copying src/unitxt/catalog/metrics/f1_macro.json -> build/lib/unitxt/catalog/metrics 2026-05-27T11:53:40,877 copying src/unitxt/catalog/metrics/rouge_with_confidence_intervals.json -> build/lib/unitxt/catalog/metrics 2026-05-27T11:53:40,880 copying src/unitxt/catalog/metrics/string_containment_ratio.json -> build/lib/unitxt/catalog/metrics 2026-05-27T11:53:40,882 copying src/unitxt/catalog/metrics/is_code_mixed.json -> build/lib/unitxt/catalog/metrics 2026-05-27T11:53:40,884 copying src/unitxt/catalog/metrics/fuzzyner.json -> build/lib/unitxt/catalog/metrics 2026-05-27T11:53:40,886 copying src/unitxt/catalog/metrics/safety_metric.json -> build/lib/unitxt/catalog/metrics 2026-05-27T11:53:40,888 copying src/unitxt/catalog/metrics/sacrebleu.json -> build/lib/unitxt/catalog/metrics 2026-05-27T11:53:40,891 copying src/unitxt/catalog/metrics/mrr.json -> build/lib/unitxt/catalog/metrics 2026-05-27T11:53:40,893 copying src/unitxt/catalog/metrics/f1_micro_multi_label.json -> build/lib/unitxt/catalog/metrics 2026-05-27T11:53:40,895 copying src/unitxt/catalog/metrics/f1_binary.json -> build/lib/unitxt/catalog/metrics 2026-05-27T11:53:40,897 copying src/unitxt/catalog/metrics/bleu.json -> build/lib/unitxt/catalog/metrics 2026-05-27T11:53:40,899 copying src/unitxt/catalog/metrics/char_edit_distance.json -> build/lib/unitxt/catalog/metrics 2026-05-27T11:53:40,902 copying src/unitxt/catalog/metrics/wer.json -> build/lib/unitxt/catalog/metrics 2026-05-27T11:53:40,904 copying src/unitxt/catalog/metrics/rerank_recall.json -> build/lib/unitxt/catalog/metrics 2026-05-27T11:53:40,906 copying src/unitxt/catalog/metrics/precision_micro_multi_label.json -> build/lib/unitxt/catalog/metrics 2026-05-27T11:53:40,908 copying src/unitxt/catalog/metrics/f1_weighted.json -> build/lib/unitxt/catalog/metrics 2026-05-27T11:53:40,910 copying src/unitxt/catalog/metrics/max_f1_binary.json -> build/lib/unitxt/catalog/metrics 2026-05-27T11:53:40,912 copying src/unitxt/catalog/metrics/relaxed_correctness.json -> build/lib/unitxt/catalog/metrics 2026-05-27T11:53:40,914 copying src/unitxt/catalog/metrics/recall_binary.json -> build/lib/unitxt/catalog/metrics 2026-05-27T11:53:40,917 copying src/unitxt/catalog/metrics/char_edit_dist_accuracy.json -> build/lib/unitxt/catalog/metrics 2026-05-27T11:53:40,919 copying src/unitxt/catalog/metrics/kendalltau_b.json -> build/lib/unitxt/catalog/metrics 2026-05-27T11:53:40,921 copying src/unitxt/catalog/metrics/metric_based_ner.json -> build/lib/unitxt/catalog/metrics 2026-05-27T11:53:40,923 copying src/unitxt/catalog/metrics/vectara_groundedness_hhem_2_1.json -> build/lib/unitxt/catalog/metrics 2026-05-27T11:53:40,926 copying src/unitxt/catalog/metrics/recall_macro_multi_label.json -> build/lib/unitxt/catalog/metrics 2026-05-27T11:53:40,928 copying src/unitxt/catalog/metrics/websrc_squad_f1.json -> build/lib/unitxt/catalog/metrics 2026-05-27T11:53:40,930 creating build/lib/unitxt/catalog/metrics/perplexity_nli 2026-05-27T11:53:40,931 copying src/unitxt/catalog/metrics/perplexity_nli/t5_nli_mixture.json -> build/lib/unitxt/catalog/metrics/perplexity_nli 2026-05-27T11:53:40,933 creating build/lib/unitxt/catalog/metrics/sentence_bert 2026-05-27T11:53:40,934 copying src/unitxt/catalog/metrics/sentence_bert/mpnet_base_v2.json -> build/lib/unitxt/catalog/metrics/sentence_bert 2026-05-27T11:53:40,937 copying src/unitxt/catalog/metrics/sentence_bert/minilm_l12_v2.json -> build/lib/unitxt/catalog/metrics/sentence_bert 2026-05-27T11:53:40,939 copying src/unitxt/catalog/metrics/sentence_bert/bge_large_en_1_5.json -> build/lib/unitxt/catalog/metrics/sentence_bert 2026-05-27T11:53:40,941 creating build/lib/unitxt/catalog/metrics/perplexity_chat 2026-05-27T11:53:40,942 copying src/unitxt/catalog/metrics/perplexity_chat/flan_t5_small.json -> build/lib/unitxt/catalog/metrics/perplexity_chat 2026-05-27T11:53:40,944 creating build/lib/unitxt/catalog/metrics/tool_calling 2026-05-27T11:53:40,945 copying src/unitxt/catalog/metrics/tool_calling/reflection.json -> build/lib/unitxt/catalog/metrics/tool_calling 2026-05-27T11:53:40,948 creating build/lib/unitxt/catalog/metrics/tool_calling/correctness 2026-05-27T11:53:40,949 copying src/unitxt/catalog/metrics/tool_calling/correctness/llama_3_3_70b_instruct_judge.json -> build/lib/unitxt/catalog/metrics/tool_calling/correctness 2026-05-27T11:53:40,951 creating build/lib/unitxt/catalog/metrics/tool_calling/key_value 2026-05-27T11:53:40,952 copying src/unitxt/catalog/metrics/tool_calling/key_value/accuracy.json -> build/lib/unitxt/catalog/metrics/tool_calling/key_value 2026-05-27T11:53:40,954 copying src/unitxt/catalog/metrics/tool_calling/key_value/token_overlap.json -> build/lib/unitxt/catalog/metrics/tool_calling/key_value 2026-05-27T11:53:40,956 creating build/lib/unitxt/catalog/metrics/tool_calling/multi_turn 2026-05-27T11:53:40,957 copying src/unitxt/catalog/metrics/tool_calling/multi_turn/validity.json -> build/lib/unitxt/catalog/metrics/tool_calling/multi_turn 2026-05-27T11:53:40,959 creating build/lib/unitxt/catalog/metrics/tool_calling/multi_turn/correctness 2026-05-27T11:53:40,960 copying src/unitxt/catalog/metrics/tool_calling/multi_turn/correctness/llama_3_3_70b_instruct_judge.json -> build/lib/unitxt/catalog/metrics/tool_calling/multi_turn/correctness 2026-05-27T11:53:40,962 creating build/lib/unitxt/catalog/metrics/tool_calling/reflection 2026-05-27T11:53:40,963 copying src/unitxt/catalog/metrics/tool_calling/reflection/syntactic.json -> build/lib/unitxt/catalog/metrics/tool_calling/reflection 2026-05-27T11:53:40,965 creating build/lib/unitxt/catalog/metrics/rag 2026-05-27T11:53:40,966 copying src/unitxt/catalog/metrics/rag/granite_guardian_answer_relevance.json -> build/lib/unitxt/catalog/metrics/rag 2026-05-27T11:53:40,969 copying src/unitxt/catalog/metrics/rag/answer_reward.json -> build/lib/unitxt/catalog/metrics/rag 2026-05-27T11:53:40,971 copying src/unitxt/catalog/metrics/rag/answer_correctness.json -> build/lib/unitxt/catalog/metrics/rag 2026-05-27T11:53:40,973 copying src/unitxt/catalog/metrics/rag/faithfulness.json -> build/lib/unitxt/catalog/metrics/rag 2026-05-27T11:53:40,975 copying src/unitxt/catalog/metrics/rag/answer_inference.json -> build/lib/unitxt/catalog/metrics/rag 2026-05-27T11:53:40,977 copying src/unitxt/catalog/metrics/rag/granite_guardian_groundedness.json -> build/lib/unitxt/catalog/metrics/rag 2026-05-27T11:53:40,979 copying src/unitxt/catalog/metrics/rag/context_perplexity.json -> build/lib/unitxt/catalog/metrics/rag 2026-05-27T11:53:40,981 copying src/unitxt/catalog/metrics/rag/context_relevance.json -> build/lib/unitxt/catalog/metrics/rag 2026-05-27T11:53:40,984 copying src/unitxt/catalog/metrics/rag/granite_guardian_context_relevance.json -> build/lib/unitxt/catalog/metrics/rag 2026-05-27T11:53:40,986 copying src/unitxt/catalog/metrics/rag/context_correctness.json -> build/lib/unitxt/catalog/metrics/rag 2026-05-27T11:53:40,988 creating build/lib/unitxt/catalog/metrics/rag/correctness_holistic 2026-05-27T11:53:40,989 copying src/unitxt/catalog/metrics/rag/correctness_holistic/llama_3_3_70b_instruct_wml_q_c_a_numeric.json -> build/lib/unitxt/catalog/metrics/rag/correctness_holistic 2026-05-27T11:53:40,991 copying src/unitxt/catalog/metrics/rag/correctness_holistic/generic_inference_engine_q_c_a_numeric.json -> build/lib/unitxt/catalog/metrics/rag/correctness_holistic 2026-05-27T11:53:40,993 copying src/unitxt/catalog/metrics/rag/correctness_holistic/llama_3_3_70b_instruct_wml_q_c_a.json -> build/lib/unitxt/catalog/metrics/rag/correctness_holistic 2026-05-27T11:53:40,995 copying src/unitxt/catalog/metrics/rag/correctness_holistic/generic_inference_engine_q_c_a.json -> build/lib/unitxt/catalog/metrics/rag/correctness_holistic 2026-05-27T11:53:40,998 copying src/unitxt/catalog/metrics/rag/correctness_holistic/llama_3_3_70b_instruct_wml_q_c_a_logprobs.json -> build/lib/unitxt/catalog/metrics/rag/correctness_holistic 2026-05-27T11:53:41,000 creating build/lib/unitxt/catalog/metrics/rag/correctness 2026-05-27T11:53:41,001 copying src/unitxt/catalog/metrics/rag/correctness/llama_index_by_mock.json -> build/lib/unitxt/catalog/metrics/rag/correctness 2026-05-27T11:53:41,003 copying src/unitxt/catalog/metrics/rag/correctness/llama_index_by_gpt_3_5_turbo.json -> build/lib/unitxt/catalog/metrics/rag/correctness 2026-05-27T11:53:41,005 creating build/lib/unitxt/catalog/metrics/rag/end_to_end 2026-05-27T11:53:41,006 copying src/unitxt/catalog/metrics/rag/end_to_end/answer_reward.json -> build/lib/unitxt/catalog/metrics/rag/end_to_end 2026-05-27T11:53:41,008 copying src/unitxt/catalog/metrics/rag/end_to_end/answer_faithfulness.json -> build/lib/unitxt/catalog/metrics/rag/end_to_end 2026-05-27T11:53:41,011 copying src/unitxt/catalog/metrics/rag/end_to_end/answer_correctness.json -> build/lib/unitxt/catalog/metrics/rag/end_to_end 2026-05-27T11:53:41,013 copying src/unitxt/catalog/metrics/rag/end_to_end/context_relevance.json -> build/lib/unitxt/catalog/metrics/rag/end_to_end 2026-05-27T11:53:41,015 copying src/unitxt/catalog/metrics/rag/end_to_end/context_correctness.json -> build/lib/unitxt/catalog/metrics/rag/end_to_end 2026-05-27T11:53:41,017 creating build/lib/unitxt/catalog/metrics/rag/end_to_end/context_relevance 2026-05-27T11:53:41,019 copying src/unitxt/catalog/metrics/rag/end_to_end/context_relevance/llama_4_maverick_watsonx_judge.json -> build/lib/unitxt/catalog/metrics/rag/end_to_end/context_relevance 2026-05-27T11:53:41,021 copying src/unitxt/catalog/metrics/rag/end_to_end/context_relevance/mistral_large_instruct_rits_judge.json -> build/lib/unitxt/catalog/metrics/rag/end_to_end/context_relevance 2026-05-27T11:53:41,023 copying src/unitxt/catalog/metrics/rag/end_to_end/context_relevance/llama_3_3_70b_instruct_rits_judge.json -> build/lib/unitxt/catalog/metrics/rag/end_to_end/context_relevance 2026-05-27T11:53:41,025 copying src/unitxt/catalog/metrics/rag/end_to_end/context_relevance/generic_inference_engine_judge.json -> build/lib/unitxt/catalog/metrics/rag/end_to_end/context_relevance 2026-05-27T11:53:41,028 copying src/unitxt/catalog/metrics/rag/end_to_end/context_relevance/gpt_oss_120b_rits_judge.json -> build/lib/unitxt/catalog/metrics/rag/end_to_end/context_relevance 2026-05-27T11:53:41,030 copying src/unitxt/catalog/metrics/rag/end_to_end/context_relevance/token_precision.json -> build/lib/unitxt/catalog/metrics/rag/end_to_end/context_relevance 2026-05-27T11:53:41,032 copying src/unitxt/catalog/metrics/rag/end_to_end/context_relevance/mistral_large_instruct_watsonx_judge.json -> build/lib/unitxt/catalog/metrics/rag/end_to_end/context_relevance 2026-05-27T11:53:41,034 copying src/unitxt/catalog/metrics/rag/end_to_end/context_relevance/mistral_small_3_1_24b_instruct_2503_wml_judge.json -> build/lib/unitxt/catalog/metrics/rag/end_to_end/context_relevance 2026-05-27T11:53:41,036 copying src/unitxt/catalog/metrics/rag/end_to_end/context_relevance/sentence_bert_mini_lm.json -> build/lib/unitxt/catalog/metrics/rag/end_to_end/context_relevance 2026-05-27T11:53:41,039 copying src/unitxt/catalog/metrics/rag/end_to_end/context_relevance/llama_3_3_70b_instruct_watsonx_judge.json -> build/lib/unitxt/catalog/metrics/rag/end_to_end/context_relevance 2026-05-27T11:53:41,041 copying src/unitxt/catalog/metrics/rag/end_to_end/context_relevance/gpt_oss_120b_watsonx_judge.json -> build/lib/unitxt/catalog/metrics/rag/end_to_end/context_relevance 2026-05-27T11:53:41,043 copying src/unitxt/catalog/metrics/rag/end_to_end/context_relevance/perplexity_flan_t5_small.json -> build/lib/unitxt/catalog/metrics/rag/end_to_end/context_relevance 2026-05-27T11:53:41,045 copying src/unitxt/catalog/metrics/rag/end_to_end/context_relevance/gpt_4o_azure_judge.json -> build/lib/unitxt/catalog/metrics/rag/end_to_end/context_relevance 2026-05-27T11:53:41,048 copying src/unitxt/catalog/metrics/rag/end_to_end/context_relevance/sentence_bert_bge.json -> build/lib/unitxt/catalog/metrics/rag/end_to_end/context_relevance 2026-05-27T11:53:41,050 copying src/unitxt/catalog/metrics/rag/end_to_end/context_relevance/llama_4_maverick_rits_judge.json -> build/lib/unitxt/catalog/metrics/rag/end_to_end/context_relevance 2026-05-27T11:53:41,052 creating build/lib/unitxt/catalog/metrics/rag/end_to_end/answer_correctness 2026-05-27T11:53:41,053 copying src/unitxt/catalog/metrics/rag/end_to_end/answer_correctness/bert_score_recall.json -> build/lib/unitxt/catalog/metrics/rag/end_to_end/answer_correctness 2026-05-27T11:53:41,056 copying src/unitxt/catalog/metrics/rag/end_to_end/answer_correctness/llama_4_maverick_watsonx_judge.json -> build/lib/unitxt/catalog/metrics/rag/end_to_end/answer_correctness 2026-05-27T11:53:41,058 copying src/unitxt/catalog/metrics/rag/end_to_end/answer_correctness/mistral_large_instruct_rits_judge.json -> build/lib/unitxt/catalog/metrics/rag/end_to_end/answer_correctness 2026-05-27T11:53:41,060 copying src/unitxt/catalog/metrics/rag/end_to_end/answer_correctness/llama_3_3_70b_instruct_rits_judge.json -> build/lib/unitxt/catalog/metrics/rag/end_to_end/answer_correctness 2026-05-27T11:53:41,062 copying src/unitxt/catalog/metrics/rag/end_to_end/answer_correctness/generic_inference_engine_judge.json -> build/lib/unitxt/catalog/metrics/rag/end_to_end/answer_correctness 2026-05-27T11:53:41,065 copying src/unitxt/catalog/metrics/rag/end_to_end/answer_correctness/gpt_oss_120b_rits_judge.json -> build/lib/unitxt/catalog/metrics/rag/end_to_end/answer_correctness 2026-05-27T11:53:41,067 copying src/unitxt/catalog/metrics/rag/end_to_end/answer_correctness/mistral_large_instruct_watsonx_judge.json -> build/lib/unitxt/catalog/metrics/rag/end_to_end/answer_correctness 2026-05-27T11:53:41,069 copying src/unitxt/catalog/metrics/rag/end_to_end/answer_correctness/mistral_small_3_1_24b_instruct_2503_wml_judge.json -> build/lib/unitxt/catalog/metrics/rag/end_to_end/answer_correctness 2026-05-27T11:53:41,072 copying src/unitxt/catalog/metrics/rag/end_to_end/answer_correctness/sentence_bert_mini_lm.json -> build/lib/unitxt/catalog/metrics/rag/end_to_end/answer_correctness 2026-05-27T11:53:41,074 copying src/unitxt/catalog/metrics/rag/end_to_end/answer_correctness/token_recall.json -> build/lib/unitxt/catalog/metrics/rag/end_to_end/answer_correctness 2026-05-27T11:53:41,077 copying src/unitxt/catalog/metrics/rag/end_to_end/answer_correctness/llama_3_3_70b_instruct_watsonx_judge.json -> build/lib/unitxt/catalog/metrics/rag/end_to_end/answer_correctness 2026-05-27T11:53:41,079 copying src/unitxt/catalog/metrics/rag/end_to_end/answer_correctness/bert_score_recall_ml.json -> build/lib/unitxt/catalog/metrics/rag/end_to_end/answer_correctness 2026-05-27T11:53:41,081 copying src/unitxt/catalog/metrics/rag/end_to_end/answer_correctness/gpt_oss_120b_watsonx_judge.json -> build/lib/unitxt/catalog/metrics/rag/end_to_end/answer_correctness 2026-05-27T11:53:41,083 copying src/unitxt/catalog/metrics/rag/end_to_end/answer_correctness/gpt_4o_azure_judge.json -> build/lib/unitxt/catalog/metrics/rag/end_to_end/answer_correctness 2026-05-27T11:53:41,086 copying src/unitxt/catalog/metrics/rag/end_to_end/answer_correctness/sentence_bert_bge.json -> build/lib/unitxt/catalog/metrics/rag/end_to_end/answer_correctness 2026-05-27T11:53:41,088 copying src/unitxt/catalog/metrics/rag/end_to_end/answer_correctness/llama_4_maverick_rits_judge.json -> build/lib/unitxt/catalog/metrics/rag/end_to_end/answer_correctness 2026-05-27T11:53:41,090 creating build/lib/unitxt/catalog/metrics/rag/end_to_end/answer_relevance 2026-05-27T11:53:41,091 copying src/unitxt/catalog/metrics/rag/end_to_end/answer_relevance/llama_4_maverick_watsonx_judge.json -> build/lib/unitxt/catalog/metrics/rag/end_to_end/answer_relevance 2026-05-27T11:53:41,093 copying src/unitxt/catalog/metrics/rag/end_to_end/answer_relevance/mistral_large_instruct_rits_judge.json -> build/lib/unitxt/catalog/metrics/rag/end_to_end/answer_relevance 2026-05-27T11:53:41,096 copying src/unitxt/catalog/metrics/rag/end_to_end/answer_relevance/answer_reward.json -> build/lib/unitxt/catalog/metrics/rag/end_to_end/answer_relevance 2026-05-27T11:53:41,098 copying src/unitxt/catalog/metrics/rag/end_to_end/answer_relevance/llama_3_3_70b_instruct_rits_judge.json -> build/lib/unitxt/catalog/metrics/rag/end_to_end/answer_relevance 2026-05-27T11:53:41,100 copying src/unitxt/catalog/metrics/rag/end_to_end/answer_relevance/generic_inference_engine_judge.json -> build/lib/unitxt/catalog/metrics/rag/end_to_end/answer_relevance 2026-05-27T11:53:41,102 copying src/unitxt/catalog/metrics/rag/end_to_end/answer_relevance/gpt_oss_120b_rits_judge.json -> build/lib/unitxt/catalog/metrics/rag/end_to_end/answer_relevance 2026-05-27T11:53:41,105 copying src/unitxt/catalog/metrics/rag/end_to_end/answer_relevance/mistral_large_instruct_watsonx_judge.json -> build/lib/unitxt/catalog/metrics/rag/end_to_end/answer_relevance 2026-05-27T11:53:41,107 copying src/unitxt/catalog/metrics/rag/end_to_end/answer_relevance/mistral_small_3_1_24b_instruct_2503_wml_judge.json -> build/lib/unitxt/catalog/metrics/rag/end_to_end/answer_relevance 2026-05-27T11:53:41,109 copying src/unitxt/catalog/metrics/rag/end_to_end/answer_relevance/token_recall.json -> build/lib/unitxt/catalog/metrics/rag/end_to_end/answer_relevance 2026-05-27T11:53:41,111 copying src/unitxt/catalog/metrics/rag/end_to_end/answer_relevance/llama_3_3_70b_instruct_watsonx_judge.json -> build/lib/unitxt/catalog/metrics/rag/end_to_end/answer_relevance 2026-05-27T11:53:41,113 copying src/unitxt/catalog/metrics/rag/end_to_end/answer_relevance/gpt_oss_120b_watsonx_judge.json -> build/lib/unitxt/catalog/metrics/rag/end_to_end/answer_relevance 2026-05-27T11:53:41,115 copying src/unitxt/catalog/metrics/rag/end_to_end/answer_relevance/gpt_4o_azure_judge.json -> build/lib/unitxt/catalog/metrics/rag/end_to_end/answer_relevance 2026-05-27T11:53:41,118 copying src/unitxt/catalog/metrics/rag/end_to_end/answer_relevance/llama_4_maverick_rits_judge.json -> build/lib/unitxt/catalog/metrics/rag/end_to_end/answer_relevance 2026-05-27T11:53:41,120 creating build/lib/unitxt/catalog/metrics/rag/end_to_end/faithfulness 2026-05-27T11:53:41,121 copying src/unitxt/catalog/metrics/rag/end_to_end/faithfulness/llama_4_maverick_watsonx_judge.json -> build/lib/unitxt/catalog/metrics/rag/end_to_end/faithfulness 2026-05-27T11:53:41,123 copying src/unitxt/catalog/metrics/rag/end_to_end/faithfulness/bert_score_k_precision.json -> build/lib/unitxt/catalog/metrics/rag/end_to_end/faithfulness 2026-05-27T11:53:41,125 copying src/unitxt/catalog/metrics/rag/end_to_end/faithfulness/mistral_large_instruct_rits_judge.json -> build/lib/unitxt/catalog/metrics/rag/end_to_end/faithfulness 2026-05-27T11:53:41,128 copying src/unitxt/catalog/metrics/rag/end_to_end/faithfulness/token_k_precision.json -> build/lib/unitxt/catalog/metrics/rag/end_to_end/faithfulness 2026-05-27T11:53:41,130 copying src/unitxt/catalog/metrics/rag/end_to_end/faithfulness/llama_3_3_70b_instruct_rits_judge.json -> build/lib/unitxt/catalog/metrics/rag/end_to_end/faithfulness 2026-05-27T11:53:41,132 copying src/unitxt/catalog/metrics/rag/end_to_end/faithfulness/generic_inference_engine_judge.json -> build/lib/unitxt/catalog/metrics/rag/end_to_end/faithfulness 2026-05-27T11:53:41,135 copying src/unitxt/catalog/metrics/rag/end_to_end/faithfulness/gpt_oss_120b_rits_judge.json -> build/lib/unitxt/catalog/metrics/rag/end_to_end/faithfulness 2026-05-27T11:53:41,137 copying src/unitxt/catalog/metrics/rag/end_to_end/faithfulness/mistral_large_instruct_watsonx_judge.json -> build/lib/unitxt/catalog/metrics/rag/end_to_end/faithfulness 2026-05-27T11:53:41,140 copying src/unitxt/catalog/metrics/rag/end_to_end/faithfulness/mistral_small_3_1_24b_instruct_2503_wml_judge.json -> build/lib/unitxt/catalog/metrics/rag/end_to_end/faithfulness 2026-05-27T11:53:41,142 copying src/unitxt/catalog/metrics/rag/end_to_end/faithfulness/sentence_bert_mini_lm.json -> build/lib/unitxt/catalog/metrics/rag/end_to_end/faithfulness 2026-05-27T11:53:41,144 copying src/unitxt/catalog/metrics/rag/end_to_end/faithfulness/llama_3_3_70b_instruct_watsonx_judge.json -> build/lib/unitxt/catalog/metrics/rag/end_to_end/faithfulness 2026-05-27T11:53:41,147 copying src/unitxt/catalog/metrics/rag/end_to_end/faithfulness/gpt_oss_120b_watsonx_judge.json -> build/lib/unitxt/catalog/metrics/rag/end_to_end/faithfulness 2026-05-27T11:53:41,149 copying src/unitxt/catalog/metrics/rag/end_to_end/faithfulness/bert_score_k_precision_ml.json -> build/lib/unitxt/catalog/metrics/rag/end_to_end/faithfulness 2026-05-27T11:53:41,151 copying src/unitxt/catalog/metrics/rag/end_to_end/faithfulness/vectara_hhem_2_1.json -> build/lib/unitxt/catalog/metrics/rag/end_to_end/faithfulness 2026-05-27T11:53:41,154 copying src/unitxt/catalog/metrics/rag/end_to_end/faithfulness/gpt_4o_azure_judge.json -> build/lib/unitxt/catalog/metrics/rag/end_to_end/faithfulness 2026-05-27T11:53:41,156 copying src/unitxt/catalog/metrics/rag/end_to_end/faithfulness/sentence_bert_bge.json -> build/lib/unitxt/catalog/metrics/rag/end_to_end/faithfulness 2026-05-27T11:53:41,158 copying src/unitxt/catalog/metrics/rag/end_to_end/faithfulness/llama_4_maverick_rits_judge.json -> build/lib/unitxt/catalog/metrics/rag/end_to_end/faithfulness 2026-05-27T11:53:41,160 creating build/lib/unitxt/catalog/metrics/rag/end_to_end/context_correctness 2026-05-27T11:53:41,161 copying src/unitxt/catalog/metrics/rag/end_to_end/context_correctness/map.json -> build/lib/unitxt/catalog/metrics/rag/end_to_end/context_correctness 2026-05-27T11:53:41,164 copying src/unitxt/catalog/metrics/rag/end_to_end/context_correctness/retrieval_at_k.json -> build/lib/unitxt/catalog/metrics/rag/end_to_end/context_correctness 2026-05-27T11:53:41,166 copying src/unitxt/catalog/metrics/rag/end_to_end/context_correctness/mrr.json -> build/lib/unitxt/catalog/metrics/rag/end_to_end/context_correctness 2026-05-27T11:53:41,168 creating build/lib/unitxt/catalog/metrics/rag/end_to_end/recommended/cpu_only 2026-05-27T11:53:41,169 copying src/unitxt/catalog/metrics/rag/end_to_end/recommended/cpu_only/all.json -> build/lib/unitxt/catalog/metrics/rag/end_to_end/recommended/cpu_only 2026-05-27T11:53:41,172 creating build/lib/unitxt/catalog/metrics/rag/end_to_end/recommended/llmaj_azure 2026-05-27T11:53:41,173 copying src/unitxt/catalog/metrics/rag/end_to_end/recommended/llmaj_azure/all.json -> build/lib/unitxt/catalog/metrics/rag/end_to_end/recommended/llmaj_azure 2026-05-27T11:53:41,175 creating build/lib/unitxt/catalog/metrics/rag/end_to_end/recommended/llmaj_watsonx 2026-05-27T11:53:41,176 copying src/unitxt/catalog/metrics/rag/end_to_end/recommended/llmaj_watsonx/all.json -> build/lib/unitxt/catalog/metrics/rag/end_to_end/recommended/llmaj_watsonx 2026-05-27T11:53:41,178 creating build/lib/unitxt/catalog/metrics/rag/end_to_end/recommended/small_llm 2026-05-27T11:53:41,179 copying src/unitxt/catalog/metrics/rag/end_to_end/recommended/small_llm/all.json -> build/lib/unitxt/catalog/metrics/rag/end_to_end/recommended/small_llm 2026-05-27T11:53:41,182 creating build/lib/unitxt/catalog/metrics/rag/end_to_end/recommended/llmaj_rits 2026-05-27T11:53:41,183 copying src/unitxt/catalog/metrics/rag/end_to_end/recommended/llmaj_rits/all.json -> build/lib/unitxt/catalog/metrics/rag/end_to_end/recommended/llmaj_rits 2026-05-27T11:53:41,185 creating build/lib/unitxt/catalog/metrics/rag/context_relevance 2026-05-27T11:53:41,186 copying src/unitxt/catalog/metrics/rag/context_relevance/generic_inference_engine_q_c_ares.json -> build/lib/unitxt/catalog/metrics/rag/context_relevance 2026-05-27T11:53:41,188 copying src/unitxt/catalog/metrics/rag/context_relevance/llama_3_3_70b_instruct_wml_q_c_ares_logprobs.json -> build/lib/unitxt/catalog/metrics/rag/context_relevance 2026-05-27T11:53:41,191 copying src/unitxt/catalog/metrics/rag/context_relevance/token_precision.json -> build/lib/unitxt/catalog/metrics/rag/context_relevance 2026-05-27T11:53:41,193 copying src/unitxt/catalog/metrics/rag/context_relevance/generic_inference_engine_q_c_ares_numeric.json -> build/lib/unitxt/catalog/metrics/rag/context_relevance 2026-05-27T11:53:41,196 copying src/unitxt/catalog/metrics/rag/context_relevance/sentence_bert_mini_lm.json -> build/lib/unitxt/catalog/metrics/rag/context_relevance 2026-05-27T11:53:41,198 copying src/unitxt/catalog/metrics/rag/context_relevance/llama_3_3_70b_instruct_wml_q_c_ares.json -> build/lib/unitxt/catalog/metrics/rag/context_relevance 2026-05-27T11:53:41,201 copying src/unitxt/catalog/metrics/rag/context_relevance/perplexity_flan_t5_small.json -> build/lib/unitxt/catalog/metrics/rag/context_relevance 2026-05-27T11:53:41,203 copying src/unitxt/catalog/metrics/rag/context_relevance/llama_3_3_70b_instruct_wml_q_c_ares_numeric.json -> build/lib/unitxt/catalog/metrics/rag/context_relevance 2026-05-27T11:53:41,205 copying src/unitxt/catalog/metrics/rag/context_relevance/sentence_bert_bge.json -> build/lib/unitxt/catalog/metrics/rag/context_relevance 2026-05-27T11:53:41,207 creating build/lib/unitxt/catalog/metrics/rag/answer_correctness 2026-05-27T11:53:41,208 copying src/unitxt/catalog/metrics/rag/answer_correctness/bert_score_recall.json -> build/lib/unitxt/catalog/metrics/rag/answer_correctness 2026-05-27T11:53:41,211 copying src/unitxt/catalog/metrics/rag/answer_correctness/llama_3_3_70b_instruct_wml_q_a_gt_loose_logprobs.json -> build/lib/unitxt/catalog/metrics/rag/answer_correctness 2026-05-27T11:53:41,213 copying src/unitxt/catalog/metrics/rag/answer_correctness/generic_inference_engine_q_a_gt_loose_numeric.json -> build/lib/unitxt/catalog/metrics/rag/answer_correctness 2026-05-27T11:53:41,215 copying src/unitxt/catalog/metrics/rag/answer_correctness/generic_inference_engine_q_a_gt_loose.json -> build/lib/unitxt/catalog/metrics/rag/answer_correctness 2026-05-27T11:53:41,217 copying src/unitxt/catalog/metrics/rag/answer_correctness/llama_3_3_70b_instruct_wml_q_a_gt_loose_numeric.json -> build/lib/unitxt/catalog/metrics/rag/answer_correctness 2026-05-27T11:53:41,219 copying src/unitxt/catalog/metrics/rag/answer_correctness/sentence_bert_mini_lm.json -> build/lib/unitxt/catalog/metrics/rag/answer_correctness 2026-05-27T11:53:41,222 copying src/unitxt/catalog/metrics/rag/answer_correctness/token_recall.json -> build/lib/unitxt/catalog/metrics/rag/answer_correctness 2026-05-27T11:53:41,224 copying src/unitxt/catalog/metrics/rag/answer_correctness/llama_3_3_70b_instruct_wml_q_a_gt_loose.json -> build/lib/unitxt/catalog/metrics/rag/answer_correctness 2026-05-27T11:53:41,226 copying src/unitxt/catalog/metrics/rag/answer_correctness/bert_score_recall_ml.json -> build/lib/unitxt/catalog/metrics/rag/answer_correctness 2026-05-27T11:53:41,229 copying src/unitxt/catalog/metrics/rag/answer_correctness/sentence_bert_bge.json -> build/lib/unitxt/catalog/metrics/rag/answer_correctness 2026-05-27T11:53:41,231 creating build/lib/unitxt/catalog/metrics/rag/answer_relevance 2026-05-27T11:53:41,232 copying src/unitxt/catalog/metrics/rag/answer_relevance/generic_inference_engine_q_a.json -> build/lib/unitxt/catalog/metrics/rag/answer_relevance 2026-05-27T11:53:41,234 copying src/unitxt/catalog/metrics/rag/answer_relevance/generic_inference_engine_q_a_numeric.json -> build/lib/unitxt/catalog/metrics/rag/answer_relevance 2026-05-27T11:53:41,237 copying src/unitxt/catalog/metrics/rag/answer_relevance/llama_3_3_70b_instruct_wml_q_a.json -> build/lib/unitxt/catalog/metrics/rag/answer_relevance 2026-05-27T11:53:41,239 copying src/unitxt/catalog/metrics/rag/answer_relevance/token_recall.json -> build/lib/unitxt/catalog/metrics/rag/answer_relevance 2026-05-27T11:53:41,241 copying src/unitxt/catalog/metrics/rag/answer_relevance/llama_3_3_70b_instruct_wml_q_a_logprobs.json -> build/lib/unitxt/catalog/metrics/rag/answer_relevance 2026-05-27T11:53:41,243 copying src/unitxt/catalog/metrics/rag/answer_relevance/llama_3_3_70b_instruct_wml_q_a_numeric.json -> build/lib/unitxt/catalog/metrics/rag/answer_relevance 2026-05-27T11:53:41,245 creating build/lib/unitxt/catalog/metrics/rag/external_rag 2026-05-27T11:53:41,247 copying src/unitxt/catalog/metrics/rag/external_rag/answer_reward.json -> build/lib/unitxt/catalog/metrics/rag/external_rag 2026-05-27T11:53:41,249 copying src/unitxt/catalog/metrics/rag/external_rag/answer_correctness.json -> build/lib/unitxt/catalog/metrics/rag/external_rag 2026-05-27T11:53:41,252 copying src/unitxt/catalog/metrics/rag/external_rag/faithfulness.json -> build/lib/unitxt/catalog/metrics/rag/external_rag 2026-05-27T11:53:41,254 copying src/unitxt/catalog/metrics/rag/external_rag/context_relevance.json -> build/lib/unitxt/catalog/metrics/rag/external_rag 2026-05-27T11:53:41,257 copying src/unitxt/catalog/metrics/rag/external_rag/context_correctness.json -> build/lib/unitxt/catalog/metrics/rag/external_rag 2026-05-27T11:53:41,259 creating build/lib/unitxt/catalog/metrics/rag/external_rag/context_relevance 2026-05-27T11:53:41,260 copying src/unitxt/catalog/metrics/rag/external_rag/context_relevance/llama_4_maverick_watsonx_judge.json -> build/lib/unitxt/catalog/metrics/rag/external_rag/context_relevance 2026-05-27T11:53:41,262 copying src/unitxt/catalog/metrics/rag/external_rag/context_relevance/mistral_large_instruct_rits_judge.json -> build/lib/unitxt/catalog/metrics/rag/external_rag/context_relevance 2026-05-27T11:53:41,264 copying src/unitxt/catalog/metrics/rag/external_rag/context_relevance/llama_3_3_70b_instruct_rits_judge.json -> build/lib/unitxt/catalog/metrics/rag/external_rag/context_relevance 2026-05-27T11:53:41,267 copying src/unitxt/catalog/metrics/rag/external_rag/context_relevance/generic_inference_engine_judge.json -> build/lib/unitxt/catalog/metrics/rag/external_rag/context_relevance 2026-05-27T11:53:41,269 copying src/unitxt/catalog/metrics/rag/external_rag/context_relevance/gpt_oss_120b_rits_judge.json -> build/lib/unitxt/catalog/metrics/rag/external_rag/context_relevance 2026-05-27T11:53:41,272 copying src/unitxt/catalog/metrics/rag/external_rag/context_relevance/token_precision.json -> build/lib/unitxt/catalog/metrics/rag/external_rag/context_relevance 2026-05-27T11:53:41,274 copying src/unitxt/catalog/metrics/rag/external_rag/context_relevance/mistral_large_instruct_watsonx_judge.json -> build/lib/unitxt/catalog/metrics/rag/external_rag/context_relevance 2026-05-27T11:53:41,277 copying src/unitxt/catalog/metrics/rag/external_rag/context_relevance/mistral_small_3_1_24b_instruct_2503_wml_judge.json -> build/lib/unitxt/catalog/metrics/rag/external_rag/context_relevance 2026-05-27T11:53:41,279 copying src/unitxt/catalog/metrics/rag/external_rag/context_relevance/sentence_bert_mini_lm.json -> build/lib/unitxt/catalog/metrics/rag/external_rag/context_relevance 2026-05-27T11:53:41,281 copying src/unitxt/catalog/metrics/rag/external_rag/context_relevance/llama_3_3_70b_instruct_watsonx_judge.json -> build/lib/unitxt/catalog/metrics/rag/external_rag/context_relevance 2026-05-27T11:53:41,283 copying src/unitxt/catalog/metrics/rag/external_rag/context_relevance/gpt_oss_120b_watsonx_judge.json -> build/lib/unitxt/catalog/metrics/rag/external_rag/context_relevance 2026-05-27T11:53:41,286 copying src/unitxt/catalog/metrics/rag/external_rag/context_relevance/perplexity_flan_t5_small.json -> build/lib/unitxt/catalog/metrics/rag/external_rag/context_relevance 2026-05-27T11:53:41,288 copying src/unitxt/catalog/metrics/rag/external_rag/context_relevance/gpt_4o_azure_judge.json -> build/lib/unitxt/catalog/metrics/rag/external_rag/context_relevance 2026-05-27T11:53:41,290 copying src/unitxt/catalog/metrics/rag/external_rag/context_relevance/sentence_bert_bge.json -> build/lib/unitxt/catalog/metrics/rag/external_rag/context_relevance 2026-05-27T11:53:41,293 copying src/unitxt/catalog/metrics/rag/external_rag/context_relevance/llama_4_maverick_rits_judge.json -> build/lib/unitxt/catalog/metrics/rag/external_rag/context_relevance 2026-05-27T11:53:41,295 creating build/lib/unitxt/catalog/metrics/rag/external_rag/answer_correctness 2026-05-27T11:53:41,296 copying src/unitxt/catalog/metrics/rag/external_rag/answer_correctness/bert_score_recall.json -> build/lib/unitxt/catalog/metrics/rag/external_rag/answer_correctness 2026-05-27T11:53:41,299 copying src/unitxt/catalog/metrics/rag/external_rag/answer_correctness/llama_4_maverick_watsonx_judge.json -> build/lib/unitxt/catalog/metrics/rag/external_rag/answer_correctness 2026-05-27T11:53:41,301 copying src/unitxt/catalog/metrics/rag/external_rag/answer_correctness/mistral_large_instruct_rits_judge.json -> build/lib/unitxt/catalog/metrics/rag/external_rag/answer_correctness 2026-05-27T11:53:41,303 copying src/unitxt/catalog/metrics/rag/external_rag/answer_correctness/llama_3_3_70b_instruct_rits_judge.json -> build/lib/unitxt/catalog/metrics/rag/external_rag/answer_correctness 2026-05-27T11:53:41,305 copying src/unitxt/catalog/metrics/rag/external_rag/answer_correctness/generic_inference_engine_judge.json -> build/lib/unitxt/catalog/metrics/rag/external_rag/answer_correctness 2026-05-27T11:53:41,308 copying src/unitxt/catalog/metrics/rag/external_rag/answer_correctness/gpt_oss_120b_rits_judge.json -> build/lib/unitxt/catalog/metrics/rag/external_rag/answer_correctness 2026-05-27T11:53:41,311 copying src/unitxt/catalog/metrics/rag/external_rag/answer_correctness/mistral_large_instruct_watsonx_judge.json -> build/lib/unitxt/catalog/metrics/rag/external_rag/answer_correctness 2026-05-27T11:53:41,313 copying src/unitxt/catalog/metrics/rag/external_rag/answer_correctness/mistral_small_3_1_24b_instruct_2503_wml_judge.json -> build/lib/unitxt/catalog/metrics/rag/external_rag/answer_correctness 2026-05-27T11:53:41,316 copying src/unitxt/catalog/metrics/rag/external_rag/answer_correctness/sentence_bert_mini_lm.json -> build/lib/unitxt/catalog/metrics/rag/external_rag/answer_correctness 2026-05-27T11:53:41,318 copying src/unitxt/catalog/metrics/rag/external_rag/answer_correctness/token_recall.json -> build/lib/unitxt/catalog/metrics/rag/external_rag/answer_correctness 2026-05-27T11:53:41,320 copying src/unitxt/catalog/metrics/rag/external_rag/answer_correctness/llama_3_3_70b_instruct_watsonx_judge.json -> build/lib/unitxt/catalog/metrics/rag/external_rag/answer_correctness 2026-05-27T11:53:41,323 copying src/unitxt/catalog/metrics/rag/external_rag/answer_correctness/bert_score_recall_ml.json -> build/lib/unitxt/catalog/metrics/rag/external_rag/answer_correctness 2026-05-27T11:53:41,325 copying src/unitxt/catalog/metrics/rag/external_rag/answer_correctness/gpt_oss_120b_watsonx_judge.json -> build/lib/unitxt/catalog/metrics/rag/external_rag/answer_correctness 2026-05-27T11:53:41,327 copying src/unitxt/catalog/metrics/rag/external_rag/answer_correctness/gpt_4o_azure_judge.json -> build/lib/unitxt/catalog/metrics/rag/external_rag/answer_correctness 2026-05-27T11:53:41,330 copying src/unitxt/catalog/metrics/rag/external_rag/answer_correctness/sentence_bert_bge.json -> build/lib/unitxt/catalog/metrics/rag/external_rag/answer_correctness 2026-05-27T11:53:41,332 copying src/unitxt/catalog/metrics/rag/external_rag/answer_correctness/llama_4_maverick_rits_judge.json -> build/lib/unitxt/catalog/metrics/rag/external_rag/answer_correctness 2026-05-27T11:53:41,334 creating build/lib/unitxt/catalog/metrics/rag/external_rag/answer_relevance 2026-05-27T11:53:41,335 copying src/unitxt/catalog/metrics/rag/external_rag/answer_relevance/llama_4_maverick_watsonx_judge.json -> build/lib/unitxt/catalog/metrics/rag/external_rag/answer_relevance 2026-05-27T11:53:41,338 copying src/unitxt/catalog/metrics/rag/external_rag/answer_relevance/mistral_large_instruct_rits_judge.json -> build/lib/unitxt/catalog/metrics/rag/external_rag/answer_relevance 2026-05-27T11:53:41,340 copying src/unitxt/catalog/metrics/rag/external_rag/answer_relevance/answer_reward.json -> build/lib/unitxt/catalog/metrics/rag/external_rag/answer_relevance 2026-05-27T11:53:41,342 copying src/unitxt/catalog/metrics/rag/external_rag/answer_relevance/llama_3_3_70b_instruct_rits_judge.json -> build/lib/unitxt/catalog/metrics/rag/external_rag/answer_relevance 2026-05-27T11:53:41,345 copying src/unitxt/catalog/metrics/rag/external_rag/answer_relevance/generic_inference_engine_judge.json -> build/lib/unitxt/catalog/metrics/rag/external_rag/answer_relevance 2026-05-27T11:53:41,347 copying src/unitxt/catalog/metrics/rag/external_rag/answer_relevance/gpt_oss_120b_rits_judge.json -> build/lib/unitxt/catalog/metrics/rag/external_rag/answer_relevance 2026-05-27T11:53:41,349 copying src/unitxt/catalog/metrics/rag/external_rag/answer_relevance/mistral_large_instruct_watsonx_judge.json -> build/lib/unitxt/catalog/metrics/rag/external_rag/answer_relevance 2026-05-27T11:53:41,352 copying src/unitxt/catalog/metrics/rag/external_rag/answer_relevance/mistral_small_3_1_24b_instruct_2503_wml_judge.json -> build/lib/unitxt/catalog/metrics/rag/external_rag/answer_relevance 2026-05-27T11:53:41,354 copying src/unitxt/catalog/metrics/rag/external_rag/answer_relevance/token_recall.json -> build/lib/unitxt/catalog/metrics/rag/external_rag/answer_relevance 2026-05-27T11:53:41,356 copying src/unitxt/catalog/metrics/rag/external_rag/answer_relevance/llama_3_3_70b_instruct_watsonx_judge.json -> build/lib/unitxt/catalog/metrics/rag/external_rag/answer_relevance 2026-05-27T11:53:41,359 copying src/unitxt/catalog/metrics/rag/external_rag/answer_relevance/gpt_oss_120b_watsonx_judge.json -> build/lib/unitxt/catalog/metrics/rag/external_rag/answer_relevance 2026-05-27T11:53:41,361 copying src/unitxt/catalog/metrics/rag/external_rag/answer_relevance/gpt_4o_azure_judge.json -> build/lib/unitxt/catalog/metrics/rag/external_rag/answer_relevance 2026-05-27T11:53:41,363 copying src/unitxt/catalog/metrics/rag/external_rag/answer_relevance/llama_4_maverick_rits_judge.json -> build/lib/unitxt/catalog/metrics/rag/external_rag/answer_relevance 2026-05-27T11:53:41,365 creating build/lib/unitxt/catalog/metrics/rag/external_rag/faithfulness 2026-05-27T11:53:41,367 copying src/unitxt/catalog/metrics/rag/external_rag/faithfulness/llama_4_maverick_watsonx_judge.json -> build/lib/unitxt/catalog/metrics/rag/external_rag/faithfulness 2026-05-27T11:53:41,369 copying src/unitxt/catalog/metrics/rag/external_rag/faithfulness/bert_score_k_precision.json -> build/lib/unitxt/catalog/metrics/rag/external_rag/faithfulness 2026-05-27T11:53:41,371 copying src/unitxt/catalog/metrics/rag/external_rag/faithfulness/mistral_large_instruct_rits_judge.json -> build/lib/unitxt/catalog/metrics/rag/external_rag/faithfulness 2026-05-27T11:53:41,374 copying src/unitxt/catalog/metrics/rag/external_rag/faithfulness/token_k_precision.json -> build/lib/unitxt/catalog/metrics/rag/external_rag/faithfulness 2026-05-27T11:53:41,376 copying src/unitxt/catalog/metrics/rag/external_rag/faithfulness/llama_3_3_70b_instruct_rits_judge.json -> build/lib/unitxt/catalog/metrics/rag/external_rag/faithfulness 2026-05-27T11:53:41,378 copying src/unitxt/catalog/metrics/rag/external_rag/faithfulness/generic_inference_engine_judge.json -> build/lib/unitxt/catalog/metrics/rag/external_rag/faithfulness 2026-05-27T11:53:41,380 copying src/unitxt/catalog/metrics/rag/external_rag/faithfulness/gpt_oss_120b_rits_judge.json -> build/lib/unitxt/catalog/metrics/rag/external_rag/faithfulness 2026-05-27T11:53:41,383 copying src/unitxt/catalog/metrics/rag/external_rag/faithfulness/mistral_large_instruct_watsonx_judge.json -> build/lib/unitxt/catalog/metrics/rag/external_rag/faithfulness 2026-05-27T11:53:41,385 copying src/unitxt/catalog/metrics/rag/external_rag/faithfulness/mistral_small_3_1_24b_instruct_2503_wml_judge.json -> build/lib/unitxt/catalog/metrics/rag/external_rag/faithfulness 2026-05-27T11:53:41,387 copying src/unitxt/catalog/metrics/rag/external_rag/faithfulness/sentence_bert_mini_lm.json -> build/lib/unitxt/catalog/metrics/rag/external_rag/faithfulness 2026-05-27T11:53:41,390 copying src/unitxt/catalog/metrics/rag/external_rag/faithfulness/llama_3_3_70b_instruct_watsonx_judge.json -> build/lib/unitxt/catalog/metrics/rag/external_rag/faithfulness 2026-05-27T11:53:41,392 copying src/unitxt/catalog/metrics/rag/external_rag/faithfulness/gpt_oss_120b_watsonx_judge.json -> build/lib/unitxt/catalog/metrics/rag/external_rag/faithfulness 2026-05-27T11:53:41,395 copying src/unitxt/catalog/metrics/rag/external_rag/faithfulness/bert_score_k_precision_ml.json -> build/lib/unitxt/catalog/metrics/rag/external_rag/faithfulness 2026-05-27T11:53:41,397 copying src/unitxt/catalog/metrics/rag/external_rag/faithfulness/vectara_hhem_2_1.json -> build/lib/unitxt/catalog/metrics/rag/external_rag/faithfulness 2026-05-27T11:53:41,399 copying src/unitxt/catalog/metrics/rag/external_rag/faithfulness/gpt_4o_azure_judge.json -> build/lib/unitxt/catalog/metrics/rag/external_rag/faithfulness 2026-05-27T11:53:41,402 copying src/unitxt/catalog/metrics/rag/external_rag/faithfulness/sentence_bert_bge.json -> build/lib/unitxt/catalog/metrics/rag/external_rag/faithfulness 2026-05-27T11:53:41,404 copying src/unitxt/catalog/metrics/rag/external_rag/faithfulness/llama_4_maverick_rits_judge.json -> build/lib/unitxt/catalog/metrics/rag/external_rag/faithfulness 2026-05-27T11:53:41,406 creating build/lib/unitxt/catalog/metrics/rag/external_rag/context_correctness 2026-05-27T11:53:41,407 copying src/unitxt/catalog/metrics/rag/external_rag/context_correctness/map.json -> build/lib/unitxt/catalog/metrics/rag/external_rag/context_correctness 2026-05-27T11:53:41,409 copying src/unitxt/catalog/metrics/rag/external_rag/context_correctness/retrieval_at_k.json -> build/lib/unitxt/catalog/metrics/rag/external_rag/context_correctness 2026-05-27T11:53:41,412 copying src/unitxt/catalog/metrics/rag/external_rag/context_correctness/mrr.json -> build/lib/unitxt/catalog/metrics/rag/external_rag/context_correctness 2026-05-27T11:53:41,414 creating build/lib/unitxt/catalog/metrics/rag/external_rag/recommended/cpu_only 2026-05-27T11:53:41,416 copying src/unitxt/catalog/metrics/rag/external_rag/recommended/cpu_only/all.json -> build/lib/unitxt/catalog/metrics/rag/external_rag/recommended/cpu_only 2026-05-27T11:53:41,418 creating build/lib/unitxt/catalog/metrics/rag/external_rag/recommended/llmaj_azure 2026-05-27T11:53:41,419 copying src/unitxt/catalog/metrics/rag/external_rag/recommended/llmaj_azure/all.json -> build/lib/unitxt/catalog/metrics/rag/external_rag/recommended/llmaj_azure 2026-05-27T11:53:41,421 creating build/lib/unitxt/catalog/metrics/rag/external_rag/recommended/llmaj_watsonx 2026-05-27T11:53:41,422 copying src/unitxt/catalog/metrics/rag/external_rag/recommended/llmaj_watsonx/all.json -> build/lib/unitxt/catalog/metrics/rag/external_rag/recommended/llmaj_watsonx 2026-05-27T11:53:41,425 creating build/lib/unitxt/catalog/metrics/rag/external_rag/recommended/small_llm 2026-05-27T11:53:41,426 copying src/unitxt/catalog/metrics/rag/external_rag/recommended/small_llm/all.json -> build/lib/unitxt/catalog/metrics/rag/external_rag/recommended/small_llm 2026-05-27T11:53:41,428 creating build/lib/unitxt/catalog/metrics/rag/external_rag/recommended/llmaj_rits 2026-05-27T11:53:41,429 copying src/unitxt/catalog/metrics/rag/external_rag/recommended/llmaj_rits/all.json -> build/lib/unitxt/catalog/metrics/rag/external_rag/recommended/llmaj_rits 2026-05-27T11:53:41,432 creating build/lib/unitxt/catalog/metrics/rag/response_generation/adherence_with_format 2026-05-27T11:53:41,433 copying src/unitxt/catalog/metrics/rag/response_generation/adherence_with_format/llama_3_3_70b_instruct_judge.json -> build/lib/unitxt/catalog/metrics/rag/response_generation/adherence_with_format 2026-05-27T11:53:41,436 creating build/lib/unitxt/catalog/metrics/rag/response_generation/correctness 2026-05-27T11:53:41,437 copying src/unitxt/catalog/metrics/rag/response_generation/correctness/token_overlap.json -> build/lib/unitxt/catalog/metrics/rag/response_generation/correctness 2026-05-27T11:53:41,439 creating build/lib/unitxt/catalog/metrics/rag/response_generation/correctness/bert_score 2026-05-27T11:53:41,440 copying src/unitxt/catalog/metrics/rag/response_generation/correctness/bert_score/deberta_v3_base_mnli_xnli_ml.json -> build/lib/unitxt/catalog/metrics/rag/response_generation/correctness/bert_score 2026-05-27T11:53:41,443 copying src/unitxt/catalog/metrics/rag/response_generation/correctness/bert_score/deberta_large_mnli.json -> build/lib/unitxt/catalog/metrics/rag/response_generation/correctness/bert_score 2026-05-27T11:53:41,445 creating build/lib/unitxt/catalog/metrics/rag/response_generation/answer_completeness 2026-05-27T11:53:41,446 copying src/unitxt/catalog/metrics/rag/response_generation/answer_completeness/llama_3_3_70b_instruct_judge.json -> build/lib/unitxt/catalog/metrics/rag/response_generation/answer_completeness 2026-05-27T11:53:41,449 creating build/lib/unitxt/catalog/metrics/rag/response_generation/answer_correctness 2026-05-27T11:53:41,450 copying src/unitxt/catalog/metrics/rag/response_generation/answer_correctness/bert_score_recall.json -> build/lib/unitxt/catalog/metrics/rag/response_generation/answer_correctness 2026-05-27T11:53:41,452 copying src/unitxt/catalog/metrics/rag/response_generation/answer_correctness/llama_4_maverick_watsonx_judge.json -> build/lib/unitxt/catalog/metrics/rag/response_generation/answer_correctness 2026-05-27T11:53:41,455 copying src/unitxt/catalog/metrics/rag/response_generation/answer_correctness/mistral_large_instruct_rits_judge.json -> build/lib/unitxt/catalog/metrics/rag/response_generation/answer_correctness 2026-05-27T11:53:41,457 copying src/unitxt/catalog/metrics/rag/response_generation/answer_correctness/llama_3_3_70b_instruct_rits_judge.json -> build/lib/unitxt/catalog/metrics/rag/response_generation/answer_correctness 2026-05-27T11:53:41,459 copying src/unitxt/catalog/metrics/rag/response_generation/answer_correctness/generic_inference_engine_judge.json -> build/lib/unitxt/catalog/metrics/rag/response_generation/answer_correctness 2026-05-27T11:53:41,461 copying src/unitxt/catalog/metrics/rag/response_generation/answer_correctness/gpt_oss_120b_rits_judge.json -> build/lib/unitxt/catalog/metrics/rag/response_generation/answer_correctness 2026-05-27T11:53:41,464 copying src/unitxt/catalog/metrics/rag/response_generation/answer_correctness/mistral_large_instruct_watsonx_judge.json -> build/lib/unitxt/catalog/metrics/rag/response_generation/answer_correctness 2026-05-27T11:53:41,466 copying src/unitxt/catalog/metrics/rag/response_generation/answer_correctness/mistral_small_3_1_24b_instruct_2503_wml_judge.json -> build/lib/unitxt/catalog/metrics/rag/response_generation/answer_correctness 2026-05-27T11:53:41,468 copying src/unitxt/catalog/metrics/rag/response_generation/answer_correctness/sentence_bert_mini_lm.json -> build/lib/unitxt/catalog/metrics/rag/response_generation/answer_correctness 2026-05-27T11:53:41,471 copying src/unitxt/catalog/metrics/rag/response_generation/answer_correctness/token_recall.json -> build/lib/unitxt/catalog/metrics/rag/response_generation/answer_correctness 2026-05-27T11:53:41,473 copying src/unitxt/catalog/metrics/rag/response_generation/answer_correctness/llama_3_3_70b_instruct_watsonx_judge.json -> build/lib/unitxt/catalog/metrics/rag/response_generation/answer_correctness 2026-05-27T11:53:41,475 copying src/unitxt/catalog/metrics/rag/response_generation/answer_correctness/bert_score_recall_ml.json -> build/lib/unitxt/catalog/metrics/rag/response_generation/answer_correctness 2026-05-27T11:53:41,478 copying src/unitxt/catalog/metrics/rag/response_generation/answer_correctness/gpt_oss_120b_watsonx_judge.json -> build/lib/unitxt/catalog/metrics/rag/response_generation/answer_correctness 2026-05-27T11:53:41,480 copying src/unitxt/catalog/metrics/rag/response_generation/answer_correctness/gpt_4o_azure_judge.json -> build/lib/unitxt/catalog/metrics/rag/response_generation/answer_correctness 2026-05-27T11:53:41,483 copying src/unitxt/catalog/metrics/rag/response_generation/answer_correctness/sentence_bert_bge.json -> build/lib/unitxt/catalog/metrics/rag/response_generation/answer_correctness 2026-05-27T11:53:41,485 copying src/unitxt/catalog/metrics/rag/response_generation/answer_correctness/llama_4_maverick_rits_judge.json -> build/lib/unitxt/catalog/metrics/rag/response_generation/answer_correctness 2026-05-27T11:53:41,487 creating build/lib/unitxt/catalog/metrics/rag/response_generation/answer_relevance 2026-05-27T11:53:41,489 copying src/unitxt/catalog/metrics/rag/response_generation/answer_relevance/llama_4_maverick_watsonx_judge.json -> build/lib/unitxt/catalog/metrics/rag/response_generation/answer_relevance 2026-05-27T11:53:41,491 copying src/unitxt/catalog/metrics/rag/response_generation/answer_relevance/mistral_large_instruct_rits_judge.json -> build/lib/unitxt/catalog/metrics/rag/response_generation/answer_relevance 2026-05-27T11:53:41,494 copying src/unitxt/catalog/metrics/rag/response_generation/answer_relevance/answer_reward.json -> build/lib/unitxt/catalog/metrics/rag/response_generation/answer_relevance 2026-05-27T11:53:41,496 copying src/unitxt/catalog/metrics/rag/response_generation/answer_relevance/llama_3_3_70b_instruct_rits_judge.json -> build/lib/unitxt/catalog/metrics/rag/response_generation/answer_relevance 2026-05-27T11:53:41,498 copying src/unitxt/catalog/metrics/rag/response_generation/answer_relevance/generic_inference_engine_judge.json -> build/lib/unitxt/catalog/metrics/rag/response_generation/answer_relevance 2026-05-27T11:53:41,500 copying src/unitxt/catalog/metrics/rag/response_generation/answer_relevance/gpt_oss_120b_rits_judge.json -> build/lib/unitxt/catalog/metrics/rag/response_generation/answer_relevance 2026-05-27T11:53:41,503 copying src/unitxt/catalog/metrics/rag/response_generation/answer_relevance/mistral_large_instruct_watsonx_judge.json -> build/lib/unitxt/catalog/metrics/rag/response_generation/answer_relevance 2026-05-27T11:53:41,505 copying src/unitxt/catalog/metrics/rag/response_generation/answer_relevance/mistral_small_3_1_24b_instruct_2503_wml_judge.json -> build/lib/unitxt/catalog/metrics/rag/response_generation/answer_relevance 2026-05-27T11:53:41,507 copying src/unitxt/catalog/metrics/rag/response_generation/answer_relevance/token_recall.json -> build/lib/unitxt/catalog/metrics/rag/response_generation/answer_relevance 2026-05-27T11:53:41,510 copying src/unitxt/catalog/metrics/rag/response_generation/answer_relevance/llama_3_3_70b_instruct_watsonx_judge.json -> build/lib/unitxt/catalog/metrics/rag/response_generation/answer_relevance 2026-05-27T11:53:41,512 copying src/unitxt/catalog/metrics/rag/response_generation/answer_relevance/gpt_oss_120b_watsonx_judge.json -> build/lib/unitxt/catalog/metrics/rag/response_generation/answer_relevance 2026-05-27T11:53:41,515 copying src/unitxt/catalog/metrics/rag/response_generation/answer_relevance/gpt_4o_azure_judge.json -> build/lib/unitxt/catalog/metrics/rag/response_generation/answer_relevance 2026-05-27T11:53:41,517 copying src/unitxt/catalog/metrics/rag/response_generation/answer_relevance/llama_4_maverick_rits_judge.json -> build/lib/unitxt/catalog/metrics/rag/response_generation/answer_relevance 2026-05-27T11:53:41,520 creating build/lib/unitxt/catalog/metrics/rag/response_generation/faithfullness 2026-05-27T11:53:41,521 copying src/unitxt/catalog/metrics/rag/response_generation/faithfullness/token_overlap.json -> build/lib/unitxt/catalog/metrics/rag/response_generation/faithfullness 2026-05-27T11:53:41,523 creating build/lib/unitxt/catalog/metrics/rag/response_generation/faithfulness 2026-05-27T11:53:41,524 copying src/unitxt/catalog/metrics/rag/response_generation/faithfulness/llama_4_maverick_watsonx_judge.json -> build/lib/unitxt/catalog/metrics/rag/response_generation/faithfulness 2026-05-27T11:53:41,527 copying src/unitxt/catalog/metrics/rag/response_generation/faithfulness/bert_score_k_precision.json -> build/lib/unitxt/catalog/metrics/rag/response_generation/faithfulness 2026-05-27T11:53:41,529 copying src/unitxt/catalog/metrics/rag/response_generation/faithfulness/mistral_large_instruct_rits_judge.json -> build/lib/unitxt/catalog/metrics/rag/response_generation/faithfulness 2026-05-27T11:53:41,531 copying src/unitxt/catalog/metrics/rag/response_generation/faithfulness/token_k_precision.json -> build/lib/unitxt/catalog/metrics/rag/response_generation/faithfulness 2026-05-27T11:53:41,534 copying src/unitxt/catalog/metrics/rag/response_generation/faithfulness/llama_3_3_70b_instruct_rits_judge.json -> build/lib/unitxt/catalog/metrics/rag/response_generation/faithfulness 2026-05-27T11:53:41,536 copying src/unitxt/catalog/metrics/rag/response_generation/faithfulness/generic_inference_engine_judge.json -> build/lib/unitxt/catalog/metrics/rag/response_generation/faithfulness 2026-05-27T11:53:41,539 copying src/unitxt/catalog/metrics/rag/response_generation/faithfulness/gpt_oss_120b_rits_judge.json -> build/lib/unitxt/catalog/metrics/rag/response_generation/faithfulness 2026-05-27T11:53:41,541 copying src/unitxt/catalog/metrics/rag/response_generation/faithfulness/mistral_large_instruct_watsonx_judge.json -> build/lib/unitxt/catalog/metrics/rag/response_generation/faithfulness 2026-05-27T11:53:41,543 copying src/unitxt/catalog/metrics/rag/response_generation/faithfulness/mistral_small_3_1_24b_instruct_2503_wml_judge.json -> build/lib/unitxt/catalog/metrics/rag/response_generation/faithfulness 2026-05-27T11:53:41,545 copying src/unitxt/catalog/metrics/rag/response_generation/faithfulness/sentence_bert_mini_lm.json -> build/lib/unitxt/catalog/metrics/rag/response_generation/faithfulness 2026-05-27T11:53:41,548 copying src/unitxt/catalog/metrics/rag/response_generation/faithfulness/llama_3_3_70b_instruct_watsonx_judge.json -> build/lib/unitxt/catalog/metrics/rag/response_generation/faithfulness 2026-05-27T11:53:41,550 copying src/unitxt/catalog/metrics/rag/response_generation/faithfulness/gpt_oss_120b_watsonx_judge.json -> build/lib/unitxt/catalog/metrics/rag/response_generation/faithfulness 2026-05-27T11:53:41,552 copying src/unitxt/catalog/metrics/rag/response_generation/faithfulness/bert_score_k_precision_ml.json -> build/lib/unitxt/catalog/metrics/rag/response_generation/faithfulness 2026-05-27T11:53:41,555 copying src/unitxt/catalog/metrics/rag/response_generation/faithfulness/vectara_hhem_2_1.json -> build/lib/unitxt/catalog/metrics/rag/response_generation/faithfulness 2026-05-27T11:53:41,557 copying src/unitxt/catalog/metrics/rag/response_generation/faithfulness/gpt_4o_azure_judge.json -> build/lib/unitxt/catalog/metrics/rag/response_generation/faithfulness 2026-05-27T11:53:41,559 copying src/unitxt/catalog/metrics/rag/response_generation/faithfulness/sentence_bert_bge.json -> build/lib/unitxt/catalog/metrics/rag/response_generation/faithfulness 2026-05-27T11:53:41,562 copying src/unitxt/catalog/metrics/rag/response_generation/faithfulness/llama_4_maverick_rits_judge.json -> build/lib/unitxt/catalog/metrics/rag/response_generation/faithfulness 2026-05-27T11:53:41,564 creating build/lib/unitxt/catalog/metrics/rag/response_generation/recommended/cpu_only 2026-05-27T11:53:41,565 copying src/unitxt/catalog/metrics/rag/response_generation/recommended/cpu_only/all.json -> build/lib/unitxt/catalog/metrics/rag/response_generation/recommended/cpu_only 2026-05-27T11:53:41,568 creating build/lib/unitxt/catalog/metrics/rag/response_generation/recommended/llmaj_azure 2026-05-27T11:53:41,569 copying src/unitxt/catalog/metrics/rag/response_generation/recommended/llmaj_azure/all.json -> build/lib/unitxt/catalog/metrics/rag/response_generation/recommended/llmaj_azure 2026-05-27T11:53:41,571 creating build/lib/unitxt/catalog/metrics/rag/response_generation/recommended/llmaj_watsonx 2026-05-27T11:53:41,572 copying src/unitxt/catalog/metrics/rag/response_generation/recommended/llmaj_watsonx/all.json -> build/lib/unitxt/catalog/metrics/rag/response_generation/recommended/llmaj_watsonx 2026-05-27T11:53:41,575 creating build/lib/unitxt/catalog/metrics/rag/response_generation/recommended/small_llm 2026-05-27T11:53:41,576 copying src/unitxt/catalog/metrics/rag/response_generation/recommended/small_llm/all.json -> build/lib/unitxt/catalog/metrics/rag/response_generation/recommended/small_llm 2026-05-27T11:53:41,578 creating build/lib/unitxt/catalog/metrics/rag/response_generation/recommended/llmaj_rits 2026-05-27T11:53:41,580 copying src/unitxt/catalog/metrics/rag/response_generation/recommended/llmaj_rits/all.json -> build/lib/unitxt/catalog/metrics/rag/response_generation/recommended/llmaj_rits 2026-05-27T11:53:41,582 creating build/lib/unitxt/catalog/metrics/rag/faithfulness 2026-05-27T11:53:41,583 copying src/unitxt/catalog/metrics/rag/faithfulness/llama_3_3_70b_instruct_wml_c_a.json -> build/lib/unitxt/catalog/metrics/rag/faithfulness 2026-05-27T11:53:41,585 copying src/unitxt/catalog/metrics/rag/faithfulness/bert_score_k_precision.json -> build/lib/unitxt/catalog/metrics/rag/faithfulness 2026-05-27T11:53:41,588 copying src/unitxt/catalog/metrics/rag/faithfulness/token_k_precision.json -> build/lib/unitxt/catalog/metrics/rag/faithfulness 2026-05-27T11:53:41,590 copying src/unitxt/catalog/metrics/rag/faithfulness/llama_index_by_mock.json -> build/lib/unitxt/catalog/metrics/rag/faithfulness 2026-05-27T11:53:41,592 copying src/unitxt/catalog/metrics/rag/faithfulness/generic_inference_engine_c_a.json -> build/lib/unitxt/catalog/metrics/rag/faithfulness 2026-05-27T11:53:41,594 copying src/unitxt/catalog/metrics/rag/faithfulness/llama_3_3_70b_instruct_wml_q_c_a.json -> build/lib/unitxt/catalog/metrics/rag/faithfulness 2026-05-27T11:53:41,597 copying src/unitxt/catalog/metrics/rag/faithfulness/llama_index_by_gpt_3_5_turbo.json -> build/lib/unitxt/catalog/metrics/rag/faithfulness 2026-05-27T11:53:41,599 copying src/unitxt/catalog/metrics/rag/faithfulness/generic_inference_engine_q_c_a.json -> build/lib/unitxt/catalog/metrics/rag/faithfulness 2026-05-27T11:53:41,601 copying src/unitxt/catalog/metrics/rag/faithfulness/generic_inference_engine_c_a_verbal.json -> build/lib/unitxt/catalog/metrics/rag/faithfulness 2026-05-27T11:53:41,603 copying src/unitxt/catalog/metrics/rag/faithfulness/sentence_bert_mini_lm.json -> build/lib/unitxt/catalog/metrics/rag/faithfulness 2026-05-27T11:53:41,606 copying src/unitxt/catalog/metrics/rag/faithfulness/llama_3_3_70b_instruct_wml_c_a_verbal.json -> build/lib/unitxt/catalog/metrics/rag/faithfulness 2026-05-27T11:53:41,608 copying src/unitxt/catalog/metrics/rag/faithfulness/generic_inference_engine_q_c_a_verbal.json -> build/lib/unitxt/catalog/metrics/rag/faithfulness 2026-05-27T11:53:41,610 copying src/unitxt/catalog/metrics/rag/faithfulness/llama_3_3_70b_instruct_wml_q_c_a_verbal.json -> build/lib/unitxt/catalog/metrics/rag/faithfulness 2026-05-27T11:53:41,612 copying src/unitxt/catalog/metrics/rag/faithfulness/bert_score_k_precision_ml.json -> build/lib/unitxt/catalog/metrics/rag/faithfulness 2026-05-27T11:53:41,615 copying src/unitxt/catalog/metrics/rag/faithfulness/llama_3_3_70b_instruct_wml_q_c_a_logprobs.json -> build/lib/unitxt/catalog/metrics/rag/faithfulness 2026-05-27T11:53:41,617 copying src/unitxt/catalog/metrics/rag/faithfulness/vectara_hhem_2_1.json -> build/lib/unitxt/catalog/metrics/rag/faithfulness 2026-05-27T11:53:41,620 copying src/unitxt/catalog/metrics/rag/faithfulness/sentence_bert_bge.json -> build/lib/unitxt/catalog/metrics/rag/faithfulness 2026-05-27T11:53:41,622 copying src/unitxt/catalog/metrics/rag/faithfulness/llama_3_3_70b_instruct_wml_c_a_logprobs.json -> build/lib/unitxt/catalog/metrics/rag/faithfulness 2026-05-27T11:53:41,624 creating build/lib/unitxt/catalog/metrics/rag/context_correctness 2026-05-27T11:53:41,625 copying src/unitxt/catalog/metrics/rag/context_correctness/map.json -> build/lib/unitxt/catalog/metrics/rag/context_correctness 2026-05-27T11:53:41,627 copying src/unitxt/catalog/metrics/rag/context_correctness/retrieval_at_k.json -> build/lib/unitxt/catalog/metrics/rag/context_correctness 2026-05-27T11:53:41,630 copying src/unitxt/catalog/metrics/rag/context_correctness/mrr.json -> build/lib/unitxt/catalog/metrics/rag/context_correctness 2026-05-27T11:53:41,632 creating build/lib/unitxt/catalog/metrics/granite_guardian/assistant_risk 2026-05-27T11:53:41,634 copying src/unitxt/catalog/metrics/granite_guardian/assistant_risk/social_bias.json -> build/lib/unitxt/catalog/metrics/granite_guardian/assistant_risk 2026-05-27T11:53:41,636 copying src/unitxt/catalog/metrics/granite_guardian/assistant_risk/unethical_behavior.json -> build/lib/unitxt/catalog/metrics/granite_guardian/assistant_risk 2026-05-27T11:53:41,639 copying src/unitxt/catalog/metrics/granite_guardian/assistant_risk/harm.json -> build/lib/unitxt/catalog/metrics/granite_guardian/assistant_risk 2026-05-27T11:53:41,641 copying src/unitxt/catalog/metrics/granite_guardian/assistant_risk/violence.json -> build/lib/unitxt/catalog/metrics/granite_guardian/assistant_risk 2026-05-27T11:53:41,643 copying src/unitxt/catalog/metrics/granite_guardian/assistant_risk/profanity.json -> build/lib/unitxt/catalog/metrics/granite_guardian/assistant_risk 2026-05-27T11:53:41,645 creating build/lib/unitxt/catalog/metrics/granite_guardian/rag_risk 2026-05-27T11:53:41,646 copying src/unitxt/catalog/metrics/granite_guardian/rag_risk/answer_relevance.json -> build/lib/unitxt/catalog/metrics/granite_guardian/rag_risk 2026-05-27T11:53:41,649 copying src/unitxt/catalog/metrics/granite_guardian/rag_risk/groundedness.json -> build/lib/unitxt/catalog/metrics/granite_guardian/rag_risk 2026-05-27T11:53:41,651 copying src/unitxt/catalog/metrics/granite_guardian/rag_risk/context_relevance.json -> build/lib/unitxt/catalog/metrics/granite_guardian/rag_risk 2026-05-27T11:53:41,653 creating build/lib/unitxt/catalog/metrics/granite_guardian/agentic_risk 2026-05-27T11:53:41,654 copying src/unitxt/catalog/metrics/granite_guardian/agentic_risk/function_call.json -> build/lib/unitxt/catalog/metrics/granite_guardian/agentic_risk 2026-05-27T11:53:41,657 creating build/lib/unitxt/catalog/metrics/granite_guardian/user_risk 2026-05-27T11:53:41,658 copying src/unitxt/catalog/metrics/granite_guardian/user_risk/social_bias.json -> build/lib/unitxt/catalog/metrics/granite_guardian/user_risk 2026-05-27T11:53:41,660 copying src/unitxt/catalog/metrics/granite_guardian/user_risk/unethical_behavior.json -> build/lib/unitxt/catalog/metrics/granite_guardian/user_risk 2026-05-27T11:53:41,663 copying src/unitxt/catalog/metrics/granite_guardian/user_risk/harm.json -> build/lib/unitxt/catalog/metrics/granite_guardian/user_risk 2026-05-27T11:53:41,665 copying src/unitxt/catalog/metrics/granite_guardian/user_risk/jailbreak.json -> build/lib/unitxt/catalog/metrics/granite_guardian/user_risk 2026-05-27T11:53:41,667 copying src/unitxt/catalog/metrics/granite_guardian/user_risk/violence.json -> build/lib/unitxt/catalog/metrics/granite_guardian/user_risk 2026-05-27T11:53:41,670 copying src/unitxt/catalog/metrics/granite_guardian/user_risk/profanity.json -> build/lib/unitxt/catalog/metrics/granite_guardian/user_risk 2026-05-27T11:53:41,672 creating build/lib/unitxt/catalog/metrics/perplexity 2026-05-27T11:53:41,673 copying src/unitxt/catalog/metrics/perplexity/flan_t5_small.json -> build/lib/unitxt/catalog/metrics/perplexity 2026-05-27T11:53:41,675 creating build/lib/unitxt/catalog/metrics/reward 2026-05-27T11:53:41,677 copying src/unitxt/catalog/metrics/reward/deberta_v3_large_v2.json -> build/lib/unitxt/catalog/metrics/reward 2026-05-27T11:53:41,679 creating build/lib/unitxt/catalog/metrics/perplexity_a 2026-05-27T11:53:41,680 copying src/unitxt/catalog/metrics/perplexity_a/flan_t5_small.json -> build/lib/unitxt/catalog/metrics/perplexity_a 2026-05-27T11:53:41,682 creating build/lib/unitxt/catalog/metrics/robustness 2026-05-27T11:53:41,683 copying src/unitxt/catalog/metrics/robustness/group_mean_string_containment.json -> build/lib/unitxt/catalog/metrics/robustness 2026-05-27T11:53:41,686 copying src/unitxt/catalog/metrics/robustness/fixed_group_norm_hedges_g_paraphrase_accuracy.json -> build/lib/unitxt/catalog/metrics/robustness 2026-05-27T11:53:41,689 copying src/unitxt/catalog/metrics/robustness/fixed_group_mean_string_containment.json -> build/lib/unitxt/catalog/metrics/robustness 2026-05-27T11:53:41,691 copying src/unitxt/catalog/metrics/robustness/fixed_group_absval_norm_cohens_h_paraphrase_string_containment.json -> build/lib/unitxt/catalog/metrics/robustness 2026-05-27T11:53:41,693 copying src/unitxt/catalog/metrics/robustness/fixed_group_absval_norm_hedges_g_paraphrase_accuracy.json -> build/lib/unitxt/catalog/metrics/robustness 2026-05-27T11:53:41,695 copying src/unitxt/catalog/metrics/robustness/fixed_group_pdr_paraphrase_string_containment.json -> build/lib/unitxt/catalog/metrics/robustness 2026-05-27T11:53:41,698 copying src/unitxt/catalog/metrics/robustness/fixed_group_norm_hedges_g_paraphrase_string_containment.json -> build/lib/unitxt/catalog/metrics/robustness 2026-05-27T11:53:41,700 copying src/unitxt/catalog/metrics/robustness/group_mean_token_overlap.json -> build/lib/unitxt/catalog/metrics/robustness 2026-05-27T11:53:41,702 copying src/unitxt/catalog/metrics/robustness/fixed_group_absval_norm_cohens_h_paraphrase_accuracy.json -> build/lib/unitxt/catalog/metrics/robustness 2026-05-27T11:53:41,705 copying src/unitxt/catalog/metrics/robustness/fixed_group_pdr_paraphrase_accuracy.json -> build/lib/unitxt/catalog/metrics/robustness 2026-05-27T11:53:41,707 copying src/unitxt/catalog/metrics/robustness/fixed_group_mean_baseline_accuracy.json -> build/lib/unitxt/catalog/metrics/robustness 2026-05-27T11:53:41,709 copying src/unitxt/catalog/metrics/robustness/fixed_group_absval_norm_hedges_g_paraphrase_string_containment.json -> build/lib/unitxt/catalog/metrics/robustness 2026-05-27T11:53:41,712 copying src/unitxt/catalog/metrics/robustness/fixed_group_mean_accuracy.json -> build/lib/unitxt/catalog/metrics/robustness 2026-05-27T11:53:41,714 copying src/unitxt/catalog/metrics/robustness/fixed_group_mean_paraphrase_string_containment.json -> build/lib/unitxt/catalog/metrics/robustness 2026-05-27T11:53:41,716 copying src/unitxt/catalog/metrics/robustness/group_mean_accuracy.json -> build/lib/unitxt/catalog/metrics/robustness 2026-05-27T11:53:41,718 copying src/unitxt/catalog/metrics/robustness/fixed_group_norm_cohens_h_paraphrase_accuracy.json -> build/lib/unitxt/catalog/metrics/robustness 2026-05-27T11:53:41,720 copying src/unitxt/catalog/metrics/robustness/fixed_group_norm_cohens_h_paraphrase_string_containment.json -> build/lib/unitxt/catalog/metrics/robustness 2026-05-27T11:53:41,723 copying src/unitxt/catalog/metrics/robustness/fixed_group_mean_baseline_string_containment.json -> build/lib/unitxt/catalog/metrics/robustness 2026-05-27T11:53:41,725 copying src/unitxt/catalog/metrics/robustness/fixed_group_mean_paraphrase_accuracy.json -> build/lib/unitxt/catalog/metrics/robustness 2026-05-27T11:53:41,727 creating build/lib/unitxt/catalog/metrics/bert_score 2026-05-27T11:53:41,728 copying src/unitxt/catalog/metrics/bert_score/distilbert_base_uncased.json -> build/lib/unitxt/catalog/metrics/bert_score 2026-05-27T11:53:41,731 copying src/unitxt/catalog/metrics/bert_score/deberta_v3_base_mnli_xnli_ml.json -> build/lib/unitxt/catalog/metrics/bert_score 2026-05-27T11:53:41,733 copying src/unitxt/catalog/metrics/bert_score/bert_base_uncased.json -> build/lib/unitxt/catalog/metrics/bert_score 2026-05-27T11:53:41,735 copying src/unitxt/catalog/metrics/bert_score/deberta_base_mnli.json -> build/lib/unitxt/catalog/metrics/bert_score 2026-05-27T11:53:41,737 copying src/unitxt/catalog/metrics/bert_score/deberta_xlarge_mnli.json -> build/lib/unitxt/catalog/metrics/bert_score 2026-05-27T11:53:41,740 copying src/unitxt/catalog/metrics/bert_score/deberta_large_mnli.json -> build/lib/unitxt/catalog/metrics/bert_score 2026-05-27T11:53:41,742 creating build/lib/unitxt/catalog/metrics/text2sql 2026-05-27T11:53:41,743 copying src/unitxt/catalog/metrics/text2sql/non_execution_accuracy.json -> build/lib/unitxt/catalog/metrics/text2sql 2026-05-27T11:53:41,745 copying src/unitxt/catalog/metrics/text2sql/execution_accuracy.json -> build/lib/unitxt/catalog/metrics/text2sql 2026-05-27T11:53:41,748 copying src/unitxt/catalog/metrics/text2sql/execution_logic_accuracy.json -> build/lib/unitxt/catalog/metrics/text2sql 2026-05-27T11:53:41,750 creating build/lib/unitxt/catalog/metrics/qa/open 2026-05-27T11:53:41,752 copying src/unitxt/catalog/metrics/qa/open/recommended_llm_as_judge.json -> build/lib/unitxt/catalog/metrics/qa/open 2026-05-27T11:53:41,755 copying src/unitxt/catalog/metrics/qa/open/recommended_no_gpu.json -> build/lib/unitxt/catalog/metrics/qa/open 2026-05-27T11:53:41,757 copying src/unitxt/catalog/metrics/qa/open/recommended_local_gpu.json -> build/lib/unitxt/catalog/metrics/qa/open 2026-05-27T11:53:41,759 creating build/lib/unitxt/catalog/metrics/key_value_extraction 2026-05-27T11:53:41,761 copying src/unitxt/catalog/metrics/key_value_extraction/accuracy.json -> build/lib/unitxt/catalog/metrics/key_value_extraction 2026-05-27T11:53:41,763 copying src/unitxt/catalog/metrics/key_value_extraction/token_overlap.json -> build/lib/unitxt/catalog/metrics/key_value_extraction 2026-05-27T11:53:41,765 creating build/lib/unitxt/catalog/metrics/multi_turn 2026-05-27T11:53:41,767 copying src/unitxt/catalog/metrics/multi_turn/accuracy.json -> build/lib/unitxt/catalog/metrics/multi_turn 2026-05-27T11:53:41,769 copying src/unitxt/catalog/metrics/multi_turn/sequential_success_accuracy.json -> build/lib/unitxt/catalog/metrics/multi_turn 2026-05-27T11:53:41,771 creating build/lib/unitxt/catalog/metrics/llm_as_judge/binary 2026-05-27T11:53:41,773 copying src/unitxt/catalog/metrics/llm_as_judge/binary/generic_inference_engine_faithfulness_c_a.json -> build/lib/unitxt/catalog/metrics/llm_as_judge/binary 2026-05-27T11:53:41,775 copying src/unitxt/catalog/metrics/llm_as_judge/binary/llama_3_3_70b_instruct_wml_answer_correctness_q_a_gt_loose_logprobs.json -> build/lib/unitxt/catalog/metrics/llm_as_judge/binary 2026-05-27T11:53:41,777 copying src/unitxt/catalog/metrics/llm_as_judge/binary/llama_3_3_70b_instruct_wml_faithfulness_c_a.json -> build/lib/unitxt/catalog/metrics/llm_as_judge/binary 2026-05-27T11:53:41,780 copying src/unitxt/catalog/metrics/llm_as_judge/binary/generic_inference_engine_answer_correctness_q_a_gt_loose.json -> build/lib/unitxt/catalog/metrics/llm_as_judge/binary 2026-05-27T11:53:41,782 copying src/unitxt/catalog/metrics/llm_as_judge/binary/generic_inference_engine_correctness_holistic_q_c_a.json -> build/lib/unitxt/catalog/metrics/llm_as_judge/binary 2026-05-27T11:53:41,784 copying src/unitxt/catalog/metrics/llm_as_judge/binary/llama_3_3_70b_instruct_wml_context_relevance_q_c_ares_logprobs.json -> build/lib/unitxt/catalog/metrics/llm_as_judge/binary 2026-05-27T11:53:41,787 copying src/unitxt/catalog/metrics/llm_as_judge/binary/generic_inference_engine_faithfulness_q_c_a.json -> build/lib/unitxt/catalog/metrics/llm_as_judge/binary 2026-05-27T11:53:41,789 copying src/unitxt/catalog/metrics/llm_as_judge/binary/llama_3_3_70b_instruct_wml_context_relevance_q_c_ares.json -> build/lib/unitxt/catalog/metrics/llm_as_judge/binary 2026-05-27T11:53:41,792 copying src/unitxt/catalog/metrics/llm_as_judge/binary/llama_3_3_70b_instruct_wml_faithfulness_q_c_a_logprobs.json -> build/lib/unitxt/catalog/metrics/llm_as_judge/binary 2026-05-27T11:53:41,794 copying src/unitxt/catalog/metrics/llm_as_judge/binary/generic_inference_engine_context_relevance_q_c_ares.json -> build/lib/unitxt/catalog/metrics/llm_as_judge/binary 2026-05-27T11:53:41,796 copying src/unitxt/catalog/metrics/llm_as_judge/binary/llama_3_3_70b_instruct_wml_correctness_holistic_q_c_a_logprobs.json -> build/lib/unitxt/catalog/metrics/llm_as_judge/binary 2026-05-27T11:53:41,799 copying src/unitxt/catalog/metrics/llm_as_judge/binary/llama_3_3_70b_instruct_wml_faithfulness_q_c_a.json -> build/lib/unitxt/catalog/metrics/llm_as_judge/binary 2026-05-27T11:53:41,801 copying src/unitxt/catalog/metrics/llm_as_judge/binary/llama_3_3_70b_instruct_wml_answer_relevance_q_a_logprobs.json -> build/lib/unitxt/catalog/metrics/llm_as_judge/binary 2026-05-27T11:53:41,803 copying src/unitxt/catalog/metrics/llm_as_judge/binary/generic_inference_engine_answer_relevance_q_a.json -> build/lib/unitxt/catalog/metrics/llm_as_judge/binary 2026-05-27T11:53:41,806 copying src/unitxt/catalog/metrics/llm_as_judge/binary/llama_3_3_70b_instruct_wml_answer_correctness_q_a_gt_loose.json -> build/lib/unitxt/catalog/metrics/llm_as_judge/binary 2026-05-27T11:53:41,808 copying src/unitxt/catalog/metrics/llm_as_judge/binary/llama_3_3_70b_instruct_wml_answer_relevance_q_a.json -> build/lib/unitxt/catalog/metrics/llm_as_judge/binary 2026-05-27T11:53:41,810 copying src/unitxt/catalog/metrics/llm_as_judge/binary/llama_3_3_70b_instruct_wml_correctness_holistic_q_c_a.json -> build/lib/unitxt/catalog/metrics/llm_as_judge/binary 2026-05-27T11:53:41,813 copying src/unitxt/catalog/metrics/llm_as_judge/binary/llama_3_3_70b_instruct_wml_faithfulness_c_a_logprobs.json -> build/lib/unitxt/catalog/metrics/llm_as_judge/binary 2026-05-27T11:53:41,815 creating build/lib/unitxt/catalog/metrics/llm_as_judge/pairwise/replicate 2026-05-27T11:53:41,817 copying src/unitxt/catalog/metrics/llm_as_judge/pairwise/replicate/llama4_scout.json -> build/lib/unitxt/catalog/metrics/llm_as_judge/pairwise/replicate 2026-05-27T11:53:41,819 copying src/unitxt/catalog/metrics/llm_as_judge/pairwise/replicate/gpt_4_1.json -> build/lib/unitxt/catalog/metrics/llm_as_judge/pairwise/replicate 2026-05-27T11:53:41,821 copying src/unitxt/catalog/metrics/llm_as_judge/pairwise/replicate/llama4_maverick.json -> build/lib/unitxt/catalog/metrics/llm_as_judge/pairwise/replicate 2026-05-27T11:53:41,823 creating build/lib/unitxt/catalog/metrics/llm_as_judge/pairwise/openai 2026-05-27T11:53:41,824 copying src/unitxt/catalog/metrics/llm_as_judge/pairwise/openai/gpt_4o.json -> build/lib/unitxt/catalog/metrics/llm_as_judge/pairwise/openai 2026-05-27T11:53:41,826 copying src/unitxt/catalog/metrics/llm_as_judge/pairwise/openai/gpt_4_1.json -> build/lib/unitxt/catalog/metrics/llm_as_judge/pairwise/openai 2026-05-27T11:53:41,829 copying src/unitxt/catalog/metrics/llm_as_judge/pairwise/openai/o1_preview.json -> build/lib/unitxt/catalog/metrics/llm_as_judge/pairwise/openai 2026-05-27T11:53:41,831 copying src/unitxt/catalog/metrics/llm_as_judge/pairwise/openai/gpt_4_1_nano.json -> build/lib/unitxt/catalog/metrics/llm_as_judge/pairwise/openai 2026-05-27T11:53:41,833 copying src/unitxt/catalog/metrics/llm_as_judge/pairwise/openai/gpt_4_1_mini.json -> build/lib/unitxt/catalog/metrics/llm_as_judge/pairwise/openai 2026-05-27T11:53:41,836 copying src/unitxt/catalog/metrics/llm_as_judge/pairwise/openai/o1_mini.json -> build/lib/unitxt/catalog/metrics/llm_as_judge/pairwise/openai 2026-05-27T11:53:41,838 creating build/lib/unitxt/catalog/metrics/llm_as_judge/pairwise/ollama 2026-05-27T11:53:41,839 copying src/unitxt/catalog/metrics/llm_as_judge/pairwise/ollama/llama3_3_70b.json -> build/lib/unitxt/catalog/metrics/llm_as_judge/pairwise/ollama 2026-05-27T11:53:41,842 copying src/unitxt/catalog/metrics/llm_as_judge/pairwise/ollama/llama3_1_405b.json -> build/lib/unitxt/catalog/metrics/llm_as_judge/pairwise/ollama 2026-05-27T11:53:41,844 copying src/unitxt/catalog/metrics/llm_as_judge/pairwise/ollama/llama3_1_8b.json -> build/lib/unitxt/catalog/metrics/llm_as_judge/pairwise/ollama 2026-05-27T11:53:41,847 copying src/unitxt/catalog/metrics/llm_as_judge/pairwise/ollama/granite3_3_8b.json -> build/lib/unitxt/catalog/metrics/llm_as_judge/pairwise/ollama 2026-05-27T11:53:41,849 copying src/unitxt/catalog/metrics/llm_as_judge/pairwise/ollama/llama3_1_70b.json -> build/lib/unitxt/catalog/metrics/llm_as_judge/pairwise/ollama 2026-05-27T11:53:41,851 creating build/lib/unitxt/catalog/metrics/llm_as_judge/pairwise/vertex_ai 2026-05-27T11:53:41,852 copying src/unitxt/catalog/metrics/llm_as_judge/pairwise/vertex_ai/gemini_2_5_flash.json -> build/lib/unitxt/catalog/metrics/llm_as_judge/pairwise/vertex_ai 2026-05-27T11:53:41,855 copying src/unitxt/catalog/metrics/llm_as_judge/pairwise/vertex_ai/gemmini_2_5_pro.json -> build/lib/unitxt/catalog/metrics/llm_as_judge/pairwise/vertex_ai 2026-05-27T11:53:41,857 creating build/lib/unitxt/catalog/metrics/llm_as_judge/pairwise/azure_openai 2026-05-27T11:53:41,858 copying src/unitxt/catalog/metrics/llm_as_judge/pairwise/azure_openai/llama3_3_70b.json -> build/lib/unitxt/catalog/metrics/llm_as_judge/pairwise/azure_openai 2026-05-27T11:53:41,861 copying src/unitxt/catalog/metrics/llm_as_judge/pairwise/azure_openai/gpt_4o.json -> build/lib/unitxt/catalog/metrics/llm_as_judge/pairwise/azure_openai 2026-05-27T11:53:41,863 copying src/unitxt/catalog/metrics/llm_as_judge/pairwise/azure_openai/llama4_scout.json -> build/lib/unitxt/catalog/metrics/llm_as_judge/pairwise/azure_openai 2026-05-27T11:53:41,866 copying src/unitxt/catalog/metrics/llm_as_judge/pairwise/azure_openai/gpt_4_1.json -> build/lib/unitxt/catalog/metrics/llm_as_judge/pairwise/azure_openai 2026-05-27T11:53:41,868 copying src/unitxt/catalog/metrics/llm_as_judge/pairwise/azure_openai/o1_preview.json -> build/lib/unitxt/catalog/metrics/llm_as_judge/pairwise/azure_openai 2026-05-27T11:53:41,871 copying src/unitxt/catalog/metrics/llm_as_judge/pairwise/azure_openai/gpt_4_1_nano.json -> build/lib/unitxt/catalog/metrics/llm_as_judge/pairwise/azure_openai 2026-05-27T11:53:41,873 copying src/unitxt/catalog/metrics/llm_as_judge/pairwise/azure_openai/gpt_4_1_mini.json -> build/lib/unitxt/catalog/metrics/llm_as_judge/pairwise/azure_openai 2026-05-27T11:53:41,875 copying src/unitxt/catalog/metrics/llm_as_judge/pairwise/azure_openai/o1_mini.json -> build/lib/unitxt/catalog/metrics/llm_as_judge/pairwise/azure_openai 2026-05-27T11:53:41,878 copying src/unitxt/catalog/metrics/llm_as_judge/pairwise/azure_openai/llama4_maverick.json -> build/lib/unitxt/catalog/metrics/llm_as_judge/pairwise/azure_openai 2026-05-27T11:53:41,880 creating build/lib/unitxt/catalog/metrics/llm_as_judge/pairwise/aws 2026-05-27T11:53:41,881 copying src/unitxt/catalog/metrics/llm_as_judge/pairwise/aws/llama3_3_70b.json -> build/lib/unitxt/catalog/metrics/llm_as_judge/pairwise/aws 2026-05-27T11:53:41,884 copying src/unitxt/catalog/metrics/llm_as_judge/pairwise/aws/llama3_1_405b.json -> build/lib/unitxt/catalog/metrics/llm_as_judge/pairwise/aws 2026-05-27T11:53:41,886 copying src/unitxt/catalog/metrics/llm_as_judge/pairwise/aws/llama4_scout.json -> build/lib/unitxt/catalog/metrics/llm_as_judge/pairwise/aws 2026-05-27T11:53:41,889 copying src/unitxt/catalog/metrics/llm_as_judge/pairwise/aws/deepseek_v3.json -> build/lib/unitxt/catalog/metrics/llm_as_judge/pairwise/aws 2026-05-27T11:53:41,892 copying src/unitxt/catalog/metrics/llm_as_judge/pairwise/aws/mixtral_large.json -> build/lib/unitxt/catalog/metrics/llm_as_judge/pairwise/aws 2026-05-27T11:53:41,894 copying src/unitxt/catalog/metrics/llm_as_judge/pairwise/aws/llama4_maverick.json -> build/lib/unitxt/catalog/metrics/llm_as_judge/pairwise/aws 2026-05-27T11:53:41,896 creating build/lib/unitxt/catalog/metrics/llm_as_judge/pairwise/watsonx 2026-05-27T11:53:41,898 copying src/unitxt/catalog/metrics/llm_as_judge/pairwise/watsonx/llama3_3_70b.json -> build/lib/unitxt/catalog/metrics/llm_as_judge/pairwise/watsonx 2026-05-27T11:53:41,901 copying src/unitxt/catalog/metrics/llm_as_judge/pairwise/watsonx/llama3_1_405b.json -> build/lib/unitxt/catalog/metrics/llm_as_judge/pairwise/watsonx 2026-05-27T11:53:41,904 copying src/unitxt/catalog/metrics/llm_as_judge/pairwise/watsonx/granite3_2_8b.json -> build/lib/unitxt/catalog/metrics/llm_as_judge/pairwise/watsonx 2026-05-27T11:53:41,906 copying src/unitxt/catalog/metrics/llm_as_judge/pairwise/watsonx/granite3_0_8b.json -> build/lib/unitxt/catalog/metrics/llm_as_judge/pairwise/watsonx 2026-05-27T11:53:41,909 copying src/unitxt/catalog/metrics/llm_as_judge/pairwise/watsonx/llama3_1_8b.json -> build/lib/unitxt/catalog/metrics/llm_as_judge/pairwise/watsonx 2026-05-27T11:53:41,912 copying src/unitxt/catalog/metrics/llm_as_judge/pairwise/watsonx/granite3_3_8b.json -> build/lib/unitxt/catalog/metrics/llm_as_judge/pairwise/watsonx 2026-05-27T11:53:41,915 copying src/unitxt/catalog/metrics/llm_as_judge/pairwise/watsonx/mixtral_large.json -> build/lib/unitxt/catalog/metrics/llm_as_judge/pairwise/watsonx 2026-05-27T11:53:41,918 copying src/unitxt/catalog/metrics/llm_as_judge/pairwise/watsonx/llama3_1_70b.json -> build/lib/unitxt/catalog/metrics/llm_as_judge/pairwise/watsonx 2026-05-27T11:53:41,920 copying src/unitxt/catalog/metrics/llm_as_judge/pairwise/watsonx/mixtral8_7b.json -> build/lib/unitxt/catalog/metrics/llm_as_judge/pairwise/watsonx 2026-05-27T11:53:41,923 creating build/lib/unitxt/catalog/metrics/llm_as_judge/pairwise/together_ai 2026-05-27T11:53:41,925 copying src/unitxt/catalog/metrics/llm_as_judge/pairwise/together_ai/llama3_3_70b.json -> build/lib/unitxt/catalog/metrics/llm_as_judge/pairwise/together_ai 2026-05-27T11:53:41,927 copying src/unitxt/catalog/metrics/llm_as_judge/pairwise/together_ai/llama3_1_405b.json -> build/lib/unitxt/catalog/metrics/llm_as_judge/pairwise/together_ai 2026-05-27T11:53:41,930 copying src/unitxt/catalog/metrics/llm_as_judge/pairwise/together_ai/llama4_scout.json -> build/lib/unitxt/catalog/metrics/llm_as_judge/pairwise/together_ai 2026-05-27T11:53:41,933 copying src/unitxt/catalog/metrics/llm_as_judge/pairwise/together_ai/deepseek_v3.json -> build/lib/unitxt/catalog/metrics/llm_as_judge/pairwise/together_ai 2026-05-27T11:53:41,935 copying src/unitxt/catalog/metrics/llm_as_judge/pairwise/together_ai/llama3_1_8b.json -> build/lib/unitxt/catalog/metrics/llm_as_judge/pairwise/together_ai 2026-05-27T11:53:41,938 copying src/unitxt/catalog/metrics/llm_as_judge/pairwise/together_ai/llama3_1_70b.json -> build/lib/unitxt/catalog/metrics/llm_as_judge/pairwise/together_ai 2026-05-27T11:53:41,941 copying src/unitxt/catalog/metrics/llm_as_judge/pairwise/together_ai/llama4_maverick.json -> build/lib/unitxt/catalog/metrics/llm_as_judge/pairwise/together_ai 2026-05-27T11:53:41,943 creating build/lib/unitxt/catalog/metrics/llm_as_judge/pairwise/rits 2026-05-27T11:53:41,945 copying src/unitxt/catalog/metrics/llm_as_judge/pairwise/rits/llama3_3_70b.json -> build/lib/unitxt/catalog/metrics/llm_as_judge/pairwise/rits 2026-05-27T11:53:41,948 copying src/unitxt/catalog/metrics/llm_as_judge/pairwise/rits/llama3_1_405b.json -> build/lib/unitxt/catalog/metrics/llm_as_judge/pairwise/rits 2026-05-27T11:53:41,950 copying src/unitxt/catalog/metrics/llm_as_judge/pairwise/rits/granite3_2_8b.json -> build/lib/unitxt/catalog/metrics/llm_as_judge/pairwise/rits 2026-05-27T11:53:41,953 copying src/unitxt/catalog/metrics/llm_as_judge/pairwise/rits/llama4_scout.json -> build/lib/unitxt/catalog/metrics/llm_as_judge/pairwise/rits 2026-05-27T11:53:41,955 copying src/unitxt/catalog/metrics/llm_as_judge/pairwise/rits/deepseek_v3.json -> build/lib/unitxt/catalog/metrics/llm_as_judge/pairwise/rits 2026-05-27T11:53:41,958 copying src/unitxt/catalog/metrics/llm_as_judge/pairwise/rits/granite3_0_8b.json -> build/lib/unitxt/catalog/metrics/llm_as_judge/pairwise/rits 2026-05-27T11:53:41,961 copying src/unitxt/catalog/metrics/llm_as_judge/pairwise/rits/granite3_1_8b.json -> build/lib/unitxt/catalog/metrics/llm_as_judge/pairwise/rits 2026-05-27T11:53:41,964 copying src/unitxt/catalog/metrics/llm_as_judge/pairwise/rits/llama3_1_8b.json -> build/lib/unitxt/catalog/metrics/llm_as_judge/pairwise/rits 2026-05-27T11:53:41,966 copying src/unitxt/catalog/metrics/llm_as_judge/pairwise/rits/granite3_3_8b.json -> build/lib/unitxt/catalog/metrics/llm_as_judge/pairwise/rits 2026-05-27T11:53:41,969 copying src/unitxt/catalog/metrics/llm_as_judge/pairwise/rits/mixtral_large.json -> build/lib/unitxt/catalog/metrics/llm_as_judge/pairwise/rits 2026-05-27T11:53:41,971 copying src/unitxt/catalog/metrics/llm_as_judge/pairwise/rits/llama4_maverick.json -> build/lib/unitxt/catalog/metrics/llm_as_judge/pairwise/rits 2026-05-27T11:53:41,974 copying src/unitxt/catalog/metrics/llm_as_judge/pairwise/rits/mixtral8_7b.json -> build/lib/unitxt/catalog/metrics/llm_as_judge/pairwise/rits 2026-05-27T11:53:41,977 creating build/lib/unitxt/catalog/metrics/llm_as_judge/pairwise/criteria 2026-05-27T11:53:41,978 copying src/unitxt/catalog/metrics/llm_as_judge/pairwise/criteria/inclusivity.json -> build/lib/unitxt/catalog/metrics/llm_as_judge/pairwise/criteria 2026-05-27T11:53:41,981 copying src/unitxt/catalog/metrics/llm_as_judge/pairwise/criteria/summarization_preference.json -> build/lib/unitxt/catalog/metrics/llm_as_judge/pairwise/criteria 2026-05-27T11:53:41,984 copying src/unitxt/catalog/metrics/llm_as_judge/pairwise/criteria/email_inclusivity.json -> build/lib/unitxt/catalog/metrics/llm_as_judge/pairwise/criteria 2026-05-27T11:53:41,986 copying src/unitxt/catalog/metrics/llm_as_judge/pairwise/criteria/reference_document_faithfulness.json -> build/lib/unitxt/catalog/metrics/llm_as_judge/pairwise/criteria 2026-05-27T11:53:41,989 copying src/unitxt/catalog/metrics/llm_as_judge/pairwise/criteria/funny_joke.json -> build/lib/unitxt/catalog/metrics/llm_as_judge/pairwise/criteria 2026-05-27T11:53:41,992 copying src/unitxt/catalog/metrics/llm_as_judge/pairwise/criteria/factually_consistent.json -> build/lib/unitxt/catalog/metrics/llm_as_judge/pairwise/criteria 2026-05-27T11:53:41,994 copying src/unitxt/catalog/metrics/llm_as_judge/pairwise/criteria/temperature_in_celsius_and_fahrenheit.json -> build/lib/unitxt/catalog/metrics/llm_as_judge/pairwise/criteria 2026-05-27T11:53:41,997 creating build/lib/unitxt/catalog/metrics/llm_as_judge/safety 2026-05-27T11:53:41,998 copying src/unitxt/catalog/metrics/llm_as_judge/safety/llamaguard.json -> build/lib/unitxt/catalog/metrics/llm_as_judge/safety 2026-05-27T11:53:42,001 copying src/unitxt/catalog/metrics/llm_as_judge/safety/llama_3_3_70b_instruct_ibm_watsonx_template_harm_rating.json -> build/lib/unitxt/catalog/metrics/llm_as_judge/safety 2026-05-27T11:53:42,004 creating build/lib/unitxt/catalog/metrics/llm_as_judge/pairwise_comparative_rating 2026-05-27T11:53:42,005 copying src/unitxt/catalog/metrics/llm_as_judge/pairwise_comparative_rating/llama_3_70b_instruct_generic_engine_template_arena_hard_with_shuffling.json -> build/lib/unitxt/catalog/metrics/llm_as_judge/pairwise_comparative_rating 2026-05-27T11:53:42,008 copying src/unitxt/catalog/metrics/llm_as_judge/pairwise_comparative_rating/llama_3_8b_instruct_generic_engine_template_arena_hard.json -> build/lib/unitxt/catalog/metrics/llm_as_judge/pairwise_comparative_rating 2026-05-27T11:53:42,011 copying src/unitxt/catalog/metrics/llm_as_judge/pairwise_comparative_rating/llama_3_8b_instruct_generic_engine_template_arena_hard_with_shuffling.json -> build/lib/unitxt/catalog/metrics/llm_as_judge/pairwise_comparative_rating 2026-05-27T11:53:42,013 copying src/unitxt/catalog/metrics/llm_as_judge/pairwise_comparative_rating/llama_3_70b_instruct_ibm_wml_template_arena_hard_with_shuffling.json -> build/lib/unitxt/catalog/metrics/llm_as_judge/pairwise_comparative_rating 2026-05-27T11:53:42,016 copying src/unitxt/catalog/metrics/llm_as_judge/pairwise_comparative_rating/llama_3_70b_instruct_ibm_wml_template_arena_hard.json -> build/lib/unitxt/catalog/metrics/llm_as_judge/pairwise_comparative_rating 2026-05-27T11:53:42,019 copying src/unitxt/catalog/metrics/llm_as_judge/pairwise_comparative_rating/llama_3_70b_instruct_generic_engine_template_arena_hard.json -> build/lib/unitxt/catalog/metrics/llm_as_judge/pairwise_comparative_rating 2026-05-27T11:53:42,021 creating build/lib/unitxt/catalog/metrics/llm_as_judge/pairwise_comparative_rating/llama_3_3_70b_instruct 2026-05-27T11:53:42,023 copying src/unitxt/catalog/metrics/llm_as_judge/pairwise_comparative_rating/llama_3_3_70b_instruct/template_arena_hard.json -> build/lib/unitxt/catalog/metrics/llm_as_judge/pairwise_comparative_rating/llama_3_3_70b_instruct 2026-05-27T11:53:42,026 creating build/lib/unitxt/catalog/metrics/llm_as_judge/pairwise_comparative_rating/llama_3_8b_instruct 2026-05-27T11:53:42,027 copying src/unitxt/catalog/metrics/llm_as_judge/pairwise_comparative_rating/llama_3_8b_instruct/template_arena_hard.json -> build/lib/unitxt/catalog/metrics/llm_as_judge/pairwise_comparative_rating/llama_3_8b_instruct 2026-05-27T11:53:42,030 creating build/lib/unitxt/catalog/metrics/llm_as_judge/pairwise_comparative_rating/llama_3_70b_instruct 2026-05-27T11:53:42,031 copying src/unitxt/catalog/metrics/llm_as_judge/pairwise_comparative_rating/llama_3_70b_instruct/template_arena_hard.json -> build/lib/unitxt/catalog/metrics/llm_as_judge/pairwise_comparative_rating/llama_3_70b_instruct 2026-05-27T11:53:42,034 creating build/lib/unitxt/catalog/metrics/llm_as_judge/rating 2026-05-27T11:53:42,035 copying src/unitxt/catalog/metrics/llm_as_judge/rating/llama_3_1_70b_instruct_cross_provider_template_table2text_single_turn_with_reference.json -> build/lib/unitxt/catalog/metrics/llm_as_judge/rating 2026-05-27T11:53:42,038 copying src/unitxt/catalog/metrics/llm_as_judge/rating/llama_3_70b_instruct_template_table2text_single_turn_with_reference.json -> build/lib/unitxt/catalog/metrics/llm_as_judge/rating 2026-05-27T11:53:42,041 copying src/unitxt/catalog/metrics/llm_as_judge/rating/mistral_7b_instruct_v0_2_huggingface_template_mt_bench_single_turn.json -> build/lib/unitxt/catalog/metrics/llm_as_judge/rating 2026-05-27T11:53:42,044 creating build/lib/unitxt/catalog/metrics/llm_as_judge/rating/llama_3_8b_instruct 2026-05-27T11:53:42,046 copying src/unitxt/catalog/metrics/llm_as_judge/rating/llama_3_8b_instruct/mt_bench_single_turn.json -> build/lib/unitxt/catalog/metrics/llm_as_judge/rating/llama_3_8b_instruct 2026-05-27T11:53:42,048 creating build/lib/unitxt/catalog/metrics/llm_as_judge/rating/llama_3_70b_instruct 2026-05-27T11:53:42,050 copying src/unitxt/catalog/metrics/llm_as_judge/rating/llama_3_70b_instruct/generic_single_turn_with_reference.json -> build/lib/unitxt/catalog/metrics/llm_as_judge/rating/llama_3_70b_instruct 2026-05-27T11:53:42,052 copying src/unitxt/catalog/metrics/llm_as_judge/rating/llama_3_70b_instruct/generic_single_turn.json -> build/lib/unitxt/catalog/metrics/llm_as_judge/rating/llama_3_70b_instruct 2026-05-27T11:53:42,055 copying src/unitxt/catalog/metrics/llm_as_judge/rating/llama_3_70b_instruct/mt_bench_single_turn.json -> build/lib/unitxt/catalog/metrics/llm_as_judge/rating/llama_3_70b_instruct 2026-05-27T11:53:42,057 creating build/lib/unitxt/catalog/metrics/llm_as_judge/direct/replicate 2026-05-27T11:53:42,059 copying src/unitxt/catalog/metrics/llm_as_judge/direct/replicate/llama4_scout.json -> build/lib/unitxt/catalog/metrics/llm_as_judge/direct/replicate 2026-05-27T11:53:42,062 copying src/unitxt/catalog/metrics/llm_as_judge/direct/replicate/gpt_4_1.json -> build/lib/unitxt/catalog/metrics/llm_as_judge/direct/replicate 2026-05-27T11:53:42,064 copying src/unitxt/catalog/metrics/llm_as_judge/direct/replicate/llama4_maverick.json -> build/lib/unitxt/catalog/metrics/llm_as_judge/direct/replicate 2026-05-27T11:53:42,067 creating build/lib/unitxt/catalog/metrics/llm_as_judge/direct/openai 2026-05-27T11:53:42,069 copying src/unitxt/catalog/metrics/llm_as_judge/direct/openai/gpt_4o.json -> build/lib/unitxt/catalog/metrics/llm_as_judge/direct/openai 2026-05-27T11:53:42,071 copying src/unitxt/catalog/metrics/llm_as_judge/direct/openai/gpt_4_1.json -> build/lib/unitxt/catalog/metrics/llm_as_judge/direct/openai 2026-05-27T11:53:42,074 copying src/unitxt/catalog/metrics/llm_as_judge/direct/openai/o1_preview.json -> build/lib/unitxt/catalog/metrics/llm_as_judge/direct/openai 2026-05-27T11:53:42,077 copying src/unitxt/catalog/metrics/llm_as_judge/direct/openai/gpt_4_1_nano.json -> build/lib/unitxt/catalog/metrics/llm_as_judge/direct/openai 2026-05-27T11:53:42,079 copying src/unitxt/catalog/metrics/llm_as_judge/direct/openai/gpt_4_1_mini.json -> build/lib/unitxt/catalog/metrics/llm_as_judge/direct/openai 2026-05-27T11:53:42,082 copying src/unitxt/catalog/metrics/llm_as_judge/direct/openai/o1_mini.json -> build/lib/unitxt/catalog/metrics/llm_as_judge/direct/openai 2026-05-27T11:53:42,085 creating build/lib/unitxt/catalog/metrics/llm_as_judge/direct/ollama 2026-05-27T11:53:42,086 copying src/unitxt/catalog/metrics/llm_as_judge/direct/ollama/llama3_3_70b.json -> build/lib/unitxt/catalog/metrics/llm_as_judge/direct/ollama 2026-05-27T11:53:42,089 copying src/unitxt/catalog/metrics/llm_as_judge/direct/ollama/llama3_1_405b.json -> build/lib/unitxt/catalog/metrics/llm_as_judge/direct/ollama 2026-05-27T11:53:42,092 copying src/unitxt/catalog/metrics/llm_as_judge/direct/ollama/llama3_1_8b.json -> build/lib/unitxt/catalog/metrics/llm_as_judge/direct/ollama 2026-05-27T11:53:42,095 copying src/unitxt/catalog/metrics/llm_as_judge/direct/ollama/granite3_3_8b.json -> build/lib/unitxt/catalog/metrics/llm_as_judge/direct/ollama 2026-05-27T11:53:42,097 copying src/unitxt/catalog/metrics/llm_as_judge/direct/ollama/llama3_1_70b.json -> build/lib/unitxt/catalog/metrics/llm_as_judge/direct/ollama 2026-05-27T11:53:42,100 creating build/lib/unitxt/catalog/metrics/llm_as_judge/direct/vertex_ai 2026-05-27T11:53:42,101 copying src/unitxt/catalog/metrics/llm_as_judge/direct/vertex_ai/gemini_2_5_flash.json -> build/lib/unitxt/catalog/metrics/llm_as_judge/direct/vertex_ai 2026-05-27T11:53:42,104 copying src/unitxt/catalog/metrics/llm_as_judge/direct/vertex_ai/gemmini_2_5_pro.json -> build/lib/unitxt/catalog/metrics/llm_as_judge/direct/vertex_ai 2026-05-27T11:53:42,107 creating build/lib/unitxt/catalog/metrics/llm_as_judge/direct/azure_openai 2026-05-27T11:53:42,108 copying src/unitxt/catalog/metrics/llm_as_judge/direct/azure_openai/llama3_3_70b.json -> build/lib/unitxt/catalog/metrics/llm_as_judge/direct/azure_openai 2026-05-27T11:53:42,111 copying src/unitxt/catalog/metrics/llm_as_judge/direct/azure_openai/gpt_4o.json -> build/lib/unitxt/catalog/metrics/llm_as_judge/direct/azure_openai 2026-05-27T11:53:42,114 copying src/unitxt/catalog/metrics/llm_as_judge/direct/azure_openai/llama4_scout.json -> build/lib/unitxt/catalog/metrics/llm_as_judge/direct/azure_openai 2026-05-27T11:53:42,117 copying src/unitxt/catalog/metrics/llm_as_judge/direct/azure_openai/gpt_4_1.json -> build/lib/unitxt/catalog/metrics/llm_as_judge/direct/azure_openai 2026-05-27T11:53:42,119 copying src/unitxt/catalog/metrics/llm_as_judge/direct/azure_openai/o1_preview.json -> build/lib/unitxt/catalog/metrics/llm_as_judge/direct/azure_openai 2026-05-27T11:53:42,122 copying src/unitxt/catalog/metrics/llm_as_judge/direct/azure_openai/gpt_4_1_nano.json -> build/lib/unitxt/catalog/metrics/llm_as_judge/direct/azure_openai 2026-05-27T11:53:42,125 copying src/unitxt/catalog/metrics/llm_as_judge/direct/azure_openai/gpt_4_1_mini.json -> build/lib/unitxt/catalog/metrics/llm_as_judge/direct/azure_openai 2026-05-27T11:53:42,127 copying src/unitxt/catalog/metrics/llm_as_judge/direct/azure_openai/o1_mini.json -> build/lib/unitxt/catalog/metrics/llm_as_judge/direct/azure_openai 2026-05-27T11:53:42,130 copying src/unitxt/catalog/metrics/llm_as_judge/direct/azure_openai/llama4_maverick.json -> build/lib/unitxt/catalog/metrics/llm_as_judge/direct/azure_openai 2026-05-27T11:53:42,132 creating build/lib/unitxt/catalog/metrics/llm_as_judge/direct/aws 2026-05-27T11:53:42,134 copying src/unitxt/catalog/metrics/llm_as_judge/direct/aws/llama3_3_70b.json -> build/lib/unitxt/catalog/metrics/llm_as_judge/direct/aws 2026-05-27T11:53:42,137 copying src/unitxt/catalog/metrics/llm_as_judge/direct/aws/llama3_1_405b.json -> build/lib/unitxt/catalog/metrics/llm_as_judge/direct/aws 2026-05-27T11:53:42,139 copying src/unitxt/catalog/metrics/llm_as_judge/direct/aws/llama4_scout.json -> build/lib/unitxt/catalog/metrics/llm_as_judge/direct/aws 2026-05-27T11:53:42,142 copying src/unitxt/catalog/metrics/llm_as_judge/direct/aws/deepseek_v3.json -> build/lib/unitxt/catalog/metrics/llm_as_judge/direct/aws 2026-05-27T11:53:42,145 copying src/unitxt/catalog/metrics/llm_as_judge/direct/aws/mixtral_large.json -> build/lib/unitxt/catalog/metrics/llm_as_judge/direct/aws 2026-05-27T11:53:42,147 copying src/unitxt/catalog/metrics/llm_as_judge/direct/aws/llama4_maverick.json -> build/lib/unitxt/catalog/metrics/llm_as_judge/direct/aws 2026-05-27T11:53:42,150 creating build/lib/unitxt/catalog/metrics/llm_as_judge/direct/watsonx 2026-05-27T11:53:42,151 copying src/unitxt/catalog/metrics/llm_as_judge/direct/watsonx/llama3_3_70b.json -> build/lib/unitxt/catalog/metrics/llm_as_judge/direct/watsonx 2026-05-27T11:53:42,154 copying src/unitxt/catalog/metrics/llm_as_judge/direct/watsonx/llama3_1_405b.json -> build/lib/unitxt/catalog/metrics/llm_as_judge/direct/watsonx 2026-05-27T11:53:42,157 copying src/unitxt/catalog/metrics/llm_as_judge/direct/watsonx/granite3_2_8b.json -> build/lib/unitxt/catalog/metrics/llm_as_judge/direct/watsonx 2026-05-27T11:53:42,159 copying src/unitxt/catalog/metrics/llm_as_judge/direct/watsonx/granite3_0_8b.json -> build/lib/unitxt/catalog/metrics/llm_as_judge/direct/watsonx 2026-05-27T11:53:42,162 copying src/unitxt/catalog/metrics/llm_as_judge/direct/watsonx/llama3_1_8b.json -> build/lib/unitxt/catalog/metrics/llm_as_judge/direct/watsonx 2026-05-27T11:53:42,165 copying src/unitxt/catalog/metrics/llm_as_judge/direct/watsonx/granite3_3_8b.json -> build/lib/unitxt/catalog/metrics/llm_as_judge/direct/watsonx 2026-05-27T11:53:42,167 copying src/unitxt/catalog/metrics/llm_as_judge/direct/watsonx/mixtral_large.json -> build/lib/unitxt/catalog/metrics/llm_as_judge/direct/watsonx 2026-05-27T11:53:42,170 copying src/unitxt/catalog/metrics/llm_as_judge/direct/watsonx/llama3_1_70b.json -> build/lib/unitxt/catalog/metrics/llm_as_judge/direct/watsonx 2026-05-27T11:53:42,173 copying src/unitxt/catalog/metrics/llm_as_judge/direct/watsonx/mixtral8_7b.json -> build/lib/unitxt/catalog/metrics/llm_as_judge/direct/watsonx 2026-05-27T11:53:42,175 creating build/lib/unitxt/catalog/metrics/llm_as_judge/direct/together_ai 2026-05-27T11:53:42,176 copying src/unitxt/catalog/metrics/llm_as_judge/direct/together_ai/llama3_3_70b.json -> build/lib/unitxt/catalog/metrics/llm_as_judge/direct/together_ai 2026-05-27T11:53:42,179 copying src/unitxt/catalog/metrics/llm_as_judge/direct/together_ai/llama3_1_405b.json -> build/lib/unitxt/catalog/metrics/llm_as_judge/direct/together_ai 2026-05-27T11:53:42,182 copying src/unitxt/catalog/metrics/llm_as_judge/direct/together_ai/llama4_scout.json -> build/lib/unitxt/catalog/metrics/llm_as_judge/direct/together_ai 2026-05-27T11:53:42,184 copying src/unitxt/catalog/metrics/llm_as_judge/direct/together_ai/deepseek_v3.json -> build/lib/unitxt/catalog/metrics/llm_as_judge/direct/together_ai 2026-05-27T11:53:42,187 copying src/unitxt/catalog/metrics/llm_as_judge/direct/together_ai/llama3_1_8b.json -> build/lib/unitxt/catalog/metrics/llm_as_judge/direct/together_ai 2026-05-27T11:53:42,189 copying src/unitxt/catalog/metrics/llm_as_judge/direct/together_ai/llama3_1_70b.json -> build/lib/unitxt/catalog/metrics/llm_as_judge/direct/together_ai 2026-05-27T11:53:42,192 copying src/unitxt/catalog/metrics/llm_as_judge/direct/together_ai/llama4_maverick.json -> build/lib/unitxt/catalog/metrics/llm_as_judge/direct/together_ai 2026-05-27T11:53:42,194 creating build/lib/unitxt/catalog/metrics/llm_as_judge/direct/rits 2026-05-27T11:53:42,196 copying src/unitxt/catalog/metrics/llm_as_judge/direct/rits/llama3_3_70b.json -> build/lib/unitxt/catalog/metrics/llm_as_judge/direct/rits 2026-05-27T11:53:42,198 copying src/unitxt/catalog/metrics/llm_as_judge/direct/rits/llama3_1_405b.json -> build/lib/unitxt/catalog/metrics/llm_as_judge/direct/rits 2026-05-27T11:53:42,201 copying src/unitxt/catalog/metrics/llm_as_judge/direct/rits/granite3_2_8b.json -> build/lib/unitxt/catalog/metrics/llm_as_judge/direct/rits 2026-05-27T11:53:42,203 copying src/unitxt/catalog/metrics/llm_as_judge/direct/rits/llama4_scout.json -> build/lib/unitxt/catalog/metrics/llm_as_judge/direct/rits 2026-05-27T11:53:42,206 copying src/unitxt/catalog/metrics/llm_as_judge/direct/rits/deepseek_v3.json -> build/lib/unitxt/catalog/metrics/llm_as_judge/direct/rits 2026-05-27T11:53:42,208 copying src/unitxt/catalog/metrics/llm_as_judge/direct/rits/granite3_0_8b.json -> build/lib/unitxt/catalog/metrics/llm_as_judge/direct/rits 2026-05-27T11:53:42,210 copying src/unitxt/catalog/metrics/llm_as_judge/direct/rits/granite3_1_8b.json -> build/lib/unitxt/catalog/metrics/llm_as_judge/direct/rits 2026-05-27T11:53:42,213 copying src/unitxt/catalog/metrics/llm_as_judge/direct/rits/llama3_1_8b.json -> build/lib/unitxt/catalog/metrics/llm_as_judge/direct/rits 2026-05-27T11:53:42,215 copying src/unitxt/catalog/metrics/llm_as_judge/direct/rits/granite3_3_8b.json -> build/lib/unitxt/catalog/metrics/llm_as_judge/direct/rits 2026-05-27T11:53:42,218 copying src/unitxt/catalog/metrics/llm_as_judge/direct/rits/mixtral_large.json -> build/lib/unitxt/catalog/metrics/llm_as_judge/direct/rits 2026-05-27T11:53:42,220 copying src/unitxt/catalog/metrics/llm_as_judge/direct/rits/llama4_maverick.json -> build/lib/unitxt/catalog/metrics/llm_as_judge/direct/rits 2026-05-27T11:53:42,223 copying src/unitxt/catalog/metrics/llm_as_judge/direct/rits/mixtral8_7b.json -> build/lib/unitxt/catalog/metrics/llm_as_judge/direct/rits 2026-05-27T11:53:42,225 creating build/lib/unitxt/catalog/metrics/llm_as_judge/direct/criteria 2026-05-27T11:53:42,226 copying src/unitxt/catalog/metrics/llm_as_judge/direct/criteria/fluency.json -> build/lib/unitxt/catalog/metrics/llm_as_judge/direct/criteria 2026-05-27T11:53:42,228 copying src/unitxt/catalog/metrics/llm_as_judge/direct/criteria/logical_validity_of_reasoning.json -> build/lib/unitxt/catalog/metrics/llm_as_judge/direct/criteria 2026-05-27T11:53:42,231 copying src/unitxt/catalog/metrics/llm_as_judge/direct/criteria/adherence_with_format.json -> build/lib/unitxt/catalog/metrics/llm_as_judge/direct/criteria 2026-05-27T11:53:42,233 copying src/unitxt/catalog/metrics/llm_as_judge/direct/criteria/insensitivity.json -> build/lib/unitxt/catalog/metrics/llm_as_judge/direct/criteria 2026-05-27T11:53:42,236 copying src/unitxt/catalog/metrics/llm_as_judge/direct/criteria/objectivity.json -> build/lib/unitxt/catalog/metrics/llm_as_judge/direct/criteria 2026-05-27T11:53:42,238 copying src/unitxt/catalog/metrics/llm_as_judge/direct/criteria/harmfulness.json -> build/lib/unitxt/catalog/metrics/llm_as_judge/direct/criteria 2026-05-27T11:53:42,240 copying src/unitxt/catalog/metrics/llm_as_judge/direct/criteria/correctness_based_on_ground_truth.json -> build/lib/unitxt/catalog/metrics/llm_as_judge/direct/criteria 2026-05-27T11:53:42,242 copying src/unitxt/catalog/metrics/llm_as_judge/direct/criteria/assistant_message_unethical_behavior.json -> build/lib/unitxt/catalog/metrics/llm_as_judge/direct/criteria 2026-05-27T11:53:42,245 copying src/unitxt/catalog/metrics/llm_as_judge/direct/criteria/coherence.json -> build/lib/unitxt/catalog/metrics/llm_as_judge/direct/criteria 2026-05-27T11:53:42,247 copying src/unitxt/catalog/metrics/llm_as_judge/direct/criteria/step_by_step_reasoning_non_factual.json -> build/lib/unitxt/catalog/metrics/llm_as_judge/direct/criteria 2026-05-27T11:53:42,250 copying src/unitxt/catalog/metrics/llm_as_judge/direct/criteria/step_by_step_reasoning_non_coherent.json -> build/lib/unitxt/catalog/metrics/llm_as_judge/direct/criteria 2026-05-27T11:53:42,252 copying src/unitxt/catalog/metrics/llm_as_judge/direct/criteria/step_by_step_reasoning_contradiction.json -> build/lib/unitxt/catalog/metrics/llm_as_judge/direct/criteria 2026-05-27T11:53:42,254 copying src/unitxt/catalog/metrics/llm_as_judge/direct/criteria/summarization_fluency.json -> build/lib/unitxt/catalog/metrics/llm_as_judge/direct/criteria 2026-05-27T11:53:42,257 copying src/unitxt/catalog/metrics/llm_as_judge/direct/criteria/summarization_informativeness.json -> build/lib/unitxt/catalog/metrics/llm_as_judge/direct/criteria 2026-05-27T11:53:42,259 copying src/unitxt/catalog/metrics/llm_as_judge/direct/criteria/context_context_relevance.json -> build/lib/unitxt/catalog/metrics/llm_as_judge/direct/criteria 2026-05-27T11:53:42,261 copying src/unitxt/catalog/metrics/llm_as_judge/direct/criteria/user_message_jailbreak.json -> build/lib/unitxt/catalog/metrics/llm_as_judge/direct/criteria 2026-05-27T11:53:42,264 copying src/unitxt/catalog/metrics/llm_as_judge/direct/criteria/summarization_preference.json -> build/lib/unitxt/catalog/metrics/llm_as_judge/direct/criteria 2026-05-27T11:53:42,266 copying src/unitxt/catalog/metrics/llm_as_judge/direct/criteria/step_by_step_reasoning_repetition.json -> build/lib/unitxt/catalog/metrics/llm_as_judge/direct/criteria 2026-05-27T11:53:42,268 copying src/unitxt/catalog/metrics/llm_as_judge/direct/criteria/assistant_message_violence.json -> build/lib/unitxt/catalog/metrics/llm_as_judge/direct/criteria 2026-05-27T11:53:42,271 copying src/unitxt/catalog/metrics/llm_as_judge/direct/criteria/answer_relevance.json -> build/lib/unitxt/catalog/metrics/llm_as_judge/direct/criteria 2026-05-27T11:53:42,274 copying src/unitxt/catalog/metrics/llm_as_judge/direct/criteria/step_by_step_reasoning_hallucination.json -> build/lib/unitxt/catalog/metrics/llm_as_judge/direct/criteria 2026-05-27T11:53:42,276 copying src/unitxt/catalog/metrics/llm_as_judge/direct/criteria/relevance.json -> build/lib/unitxt/catalog/metrics/llm_as_judge/direct/criteria 2026-05-27T11:53:42,279 copying src/unitxt/catalog/metrics/llm_as_judge/direct/criteria/email_structure.json -> build/lib/unitxt/catalog/metrics/llm_as_judge/direct/criteria 2026-05-27T11:53:42,281 copying src/unitxt/catalog/metrics/llm_as_judge/direct/criteria/question_answer_quality.json -> build/lib/unitxt/catalog/metrics/llm_as_judge/direct/criteria 2026-05-27T11:53:42,283 copying src/unitxt/catalog/metrics/llm_as_judge/direct/criteria/summarization_relevance.json -> build/lib/unitxt/catalog/metrics/llm_as_judge/direct/criteria 2026-05-27T11:53:42,286 copying src/unitxt/catalog/metrics/llm_as_judge/direct/criteria/assistant_message_compliance.json -> build/lib/unitxt/catalog/metrics/llm_as_judge/direct/criteria 2026-05-27T11:53:42,288 copying src/unitxt/catalog/metrics/llm_as_judge/direct/criteria/user_message_general_harm.json -> build/lib/unitxt/catalog/metrics/llm_as_judge/direct/criteria 2026-05-27T11:53:42,291 copying src/unitxt/catalog/metrics/llm_as_judge/direct/criteria/step_by_step_reasoning_commonsense.json -> build/lib/unitxt/catalog/metrics/llm_as_judge/direct/criteria 2026-05-27T11:53:42,293 copying src/unitxt/catalog/metrics/llm_as_judge/direct/criteria/answer_completeness.json -> build/lib/unitxt/catalog/metrics/llm_as_judge/direct/criteria 2026-05-27T11:53:42,295 copying src/unitxt/catalog/metrics/llm_as_judge/direct/criteria/assistant_message_general_harm.json -> build/lib/unitxt/catalog/metrics/llm_as_judge/direct/criteria 2026-05-27T11:53:42,298 copying src/unitxt/catalog/metrics/llm_as_judge/direct/criteria/consistency.json -> build/lib/unitxt/catalog/metrics/llm_as_judge/direct/criteria 2026-05-27T11:53:42,300 copying src/unitxt/catalog/metrics/llm_as_judge/direct/criteria/assistant_message_groundedness.json -> build/lib/unitxt/catalog/metrics/llm_as_judge/direct/criteria 2026-05-27T11:53:42,302 copying src/unitxt/catalog/metrics/llm_as_judge/direct/criteria/translation_quality.json -> build/lib/unitxt/catalog/metrics/llm_as_judge/direct/criteria 2026-05-27T11:53:42,305 copying src/unitxt/catalog/metrics/llm_as_judge/direct/criteria/reference_document_faithfulness.json -> build/lib/unitxt/catalog/metrics/llm_as_judge/direct/criteria 2026-05-27T11:53:42,307 copying src/unitxt/catalog/metrics/llm_as_judge/direct/criteria/conciseness.json -> build/lib/unitxt/catalog/metrics/llm_as_judge/direct/criteria 2026-05-27T11:53:42,310 copying src/unitxt/catalog/metrics/llm_as_judge/direct/criteria/step_by_step_reasoning_arithmetic.json -> build/lib/unitxt/catalog/metrics/llm_as_judge/direct/criteria 2026-05-27T11:53:42,312 copying src/unitxt/catalog/metrics/llm_as_judge/direct/criteria/grammar_and_punctuation.json -> build/lib/unitxt/catalog/metrics/llm_as_judge/direct/criteria 2026-05-27T11:53:42,314 copying src/unitxt/catalog/metrics/llm_as_judge/direct/criteria/step_by_step_reasoning_missing_steps.json -> build/lib/unitxt/catalog/metrics/llm_as_judge/direct/criteria 2026-05-27T11:53:42,317 copying src/unitxt/catalog/metrics/llm_as_judge/direct/criteria/summarization_coherence.json -> build/lib/unitxt/catalog/metrics/llm_as_judge/direct/criteria 2026-05-27T11:53:42,319 copying src/unitxt/catalog/metrics/llm_as_judge/direct/criteria/assistant_message_answer_relevance.json -> build/lib/unitxt/catalog/metrics/llm_as_judge/direct/criteria 2026-05-27T11:53:42,322 copying src/unitxt/catalog/metrics/llm_as_judge/direct/criteria/professional_tone.json -> build/lib/unitxt/catalog/metrics/llm_as_judge/direct/criteria 2026-05-27T11:53:42,324 copying src/unitxt/catalog/metrics/llm_as_judge/direct/criteria/examples_and_details.json -> build/lib/unitxt/catalog/metrics/llm_as_judge/direct/criteria 2026-05-27T11:53:42,326 copying src/unitxt/catalog/metrics/llm_as_judge/direct/criteria/step_by_step_reasoning_redundancy.json -> build/lib/unitxt/catalog/metrics/llm_as_judge/direct/criteria 2026-05-27T11:53:42,328 copying src/unitxt/catalog/metrics/llm_as_judge/direct/criteria/user_message_unethical_behavior.json -> build/lib/unitxt/catalog/metrics/llm_as_judge/direct/criteria 2026-05-27T11:53:42,331 copying src/unitxt/catalog/metrics/llm_as_judge/direct/criteria/user_message_profanity.json -> build/lib/unitxt/catalog/metrics/llm_as_judge/direct/criteria 2026-05-27T11:53:42,333 copying src/unitxt/catalog/metrics/llm_as_judge/direct/criteria/temperature_in_celsius_and_fahrenheit.json -> build/lib/unitxt/catalog/metrics/llm_as_judge/direct/criteria 2026-05-27T11:53:42,335 copying src/unitxt/catalog/metrics/llm_as_judge/direct/criteria/assistant_message_profanity.json -> build/lib/unitxt/catalog/metrics/llm_as_judge/direct/criteria 2026-05-27T11:53:42,337 copying src/unitxt/catalog/metrics/llm_as_judge/direct/criteria/information_outside_reference.json -> build/lib/unitxt/catalog/metrics/llm_as_judge/direct/criteria 2026-05-27T11:53:42,340 copying src/unitxt/catalog/metrics/llm_as_judge/direct/criteria/toxicity.json -> build/lib/unitxt/catalog/metrics/llm_as_judge/direct/criteria 2026-05-27T11:53:42,342 copying src/unitxt/catalog/metrics/llm_as_judge/direct/criteria/naturalness.json -> build/lib/unitxt/catalog/metrics/llm_as_judge/direct/criteria 2026-05-27T11:53:42,344 copying src/unitxt/catalog/metrics/llm_as_judge/direct/criteria/manipulative_email.json -> build/lib/unitxt/catalog/metrics/llm_as_judge/direct/criteria 2026-05-27T11:53:42,347 copying src/unitxt/catalog/metrics/llm_as_judge/direct/criteria/assistant_message_social_bias.json -> build/lib/unitxt/catalog/metrics/llm_as_judge/direct/criteria 2026-05-27T11:53:42,349 copying src/unitxt/catalog/metrics/llm_as_judge/direct/criteria/user_message_violence.json -> build/lib/unitxt/catalog/metrics/llm_as_judge/direct/criteria 2026-05-27T11:53:42,352 copying src/unitxt/catalog/metrics/llm_as_judge/direct/criteria/step_by_step_reasoning_bad_grammar.json -> build/lib/unitxt/catalog/metrics/llm_as_judge/direct/criteria 2026-05-27T11:53:42,354 copying src/unitxt/catalog/metrics/llm_as_judge/direct/criteria/engagement.json -> build/lib/unitxt/catalog/metrics/llm_as_judge/direct/criteria 2026-05-27T11:53:42,356 copying src/unitxt/catalog/metrics/llm_as_judge/direct/criteria/truthfulness.json -> build/lib/unitxt/catalog/metrics/llm_as_judge/direct/criteria 2026-05-27T11:53:42,358 copying src/unitxt/catalog/metrics/llm_as_judge/direct/criteria/step_by_step_reasoning_bad_final_answer.json -> build/lib/unitxt/catalog/metrics/llm_as_judge/direct/criteria 2026-05-27T11:53:42,361 copying src/unitxt/catalog/metrics/llm_as_judge/direct/criteria/information_from_reference.json -> build/lib/unitxt/catalog/metrics/llm_as_judge/direct/criteria 2026-05-27T11:53:42,363 copying src/unitxt/catalog/metrics/llm_as_judge/direct/criteria/step_by_step_reasoning_overall_quality.json -> build/lib/unitxt/catalog/metrics/llm_as_judge/direct/criteria 2026-05-27T11:53:42,365 copying src/unitxt/catalog/metrics/llm_as_judge/direct/criteria/empathy.json -> build/lib/unitxt/catalog/metrics/llm_as_judge/direct/criteria 2026-05-27T11:53:42,368 copying src/unitxt/catalog/metrics/llm_as_judge/direct/criteria/user_message_social_bias.json -> build/lib/unitxt/catalog/metrics/llm_as_judge/direct/criteria 2026-05-27T11:53:42,370 copying src/unitxt/catalog/metrics/llm_as_judge/direct/criteria/conversational.json -> build/lib/unitxt/catalog/metrics/llm_as_judge/direct/criteria 2026-05-27T11:53:42,372 copying src/unitxt/catalog/metrics/llm_as_judge/direct/criteria/tool_calling_correctness.json -> build/lib/unitxt/catalog/metrics/llm_as_judge/direct/criteria 2026-05-27T11:53:42,375 copying src/unitxt/catalog/metrics/llm_as_judge/direct/criteria/irrelevant_information.json -> build/lib/unitxt/catalog/metrics/llm_as_judge/direct/criteria 2026-05-27T11:53:42,377 copying src/unitxt/catalog/metrics/llm_as_judge/direct/criteria/step_by_step_reasoning_coherency.json -> build/lib/unitxt/catalog/metrics/llm_as_judge/direct/criteria 2026-05-27T11:53:42,380 copying src/unitxt/catalog/metrics/llm_as_judge/direct/criteria/email_effectiveness.json -> build/lib/unitxt/catalog/metrics/llm_as_judge/direct/criteria 2026-05-27T11:53:42,382 creating build/lib/unitxt/catalog/metrics/perplexity_q 2026-05-27T11:53:42,384 copying src/unitxt/catalog/metrics/perplexity_q/flan_t5_small.json -> build/lib/unitxt/catalog/metrics/perplexity_q 2026-05-27T11:53:42,386 copying src/unitxt/ui/banner.png -> build/lib/unitxt/ui 2026-05-27T11:53:42,391 copying src/unitxt/assistant/embeddings.npz -> build/lib/unitxt/assistant 2026-05-27T11:53:42,760 copying src/unitxt/assistant/metadata.parquet -> build/lib/unitxt/assistant 2026-05-27T11:53:45,758 installing to build/bdist.linux-armv7l/wheel 2026-05-27T11:53:45,759 running install 2026-05-27T11:53:45,782 running install_lib 2026-05-27T11:53:45,787 creating build/bdist.linux-armv7l/wheel 2026-05-27T11:53:45,791 creating build/bdist.linux-armv7l/wheel/unitxt 2026-05-27T11:53:45,792 copying build/lib/unitxt/parsing_utils.py -> build/bdist.linux-armv7l/wheel/./unitxt 2026-05-27T11:53:45,794 copying build/lib/unitxt/dataset_utils.py -> build/bdist.linux-armv7l/wheel/./unitxt 2026-05-27T11:53:45,796 copying build/lib/unitxt/inference.py -> build/bdist.linux-armv7l/wheel/./unitxt 2026-05-27T11:53:45,801 copying build/lib/unitxt/evaluate_cli.py -> build/bdist.linux-armv7l/wheel/./unitxt 2026-05-27T11:53:45,804 copying build/lib/unitxt/benchmark.py -> build/bdist.linux-armv7l/wheel/./unitxt 2026-05-27T11:53:45,805 copying build/lib/unitxt/span_lableing_operators.py -> build/bdist.linux-armv7l/wheel/./unitxt 2026-05-27T11:53:45,807 copying build/lib/unitxt/processors.py -> build/bdist.linux-armv7l/wheel/./unitxt 2026-05-27T11:53:45,810 copying build/lib/unitxt/error_utils.py -> build/bdist.linux-armv7l/wheel/./unitxt 2026-05-27T11:53:45,812 copying build/lib/unitxt/artifact.py -> build/bdist.linux-armv7l/wheel/./unitxt 2026-05-27T11:53:45,815 copying build/lib/unitxt/hf_utils.py -> build/bdist.linux-armv7l/wheel/./unitxt 2026-05-27T11:53:45,817 copying build/lib/unitxt/utils.py -> build/bdist.linux-armv7l/wheel/./unitxt 2026-05-27T11:53:45,819 copying build/lib/unitxt/api.py -> build/bdist.linux-armv7l/wheel/./unitxt 2026-05-27T11:53:45,822 copying build/lib/unitxt/serializers.py -> build/bdist.linux-armv7l/wheel/./unitxt 2026-05-27T11:53:45,824 copying build/lib/unitxt/validate.py -> build/bdist.linux-armv7l/wheel/./unitxt 2026-05-27T11:53:45,826 copying build/lib/unitxt/dataclass.py -> build/bdist.linux-armv7l/wheel/./unitxt 2026-05-27T11:53:45,829 copying build/lib/unitxt/operator.py -> build/bdist.linux-armv7l/wheel/./unitxt 2026-05-27T11:53:45,831 copying build/lib/unitxt/llm_as_judge.py -> build/bdist.linux-armv7l/wheel/./unitxt 2026-05-27T11:53:45,835 creating build/bdist.linux-armv7l/wheel/unitxt/service 2026-05-27T11:53:45,836 copying build/lib/unitxt/service/__init__.py -> build/bdist.linux-armv7l/wheel/./unitxt/service 2026-05-27T11:53:45,838 creating build/bdist.linux-armv7l/wheel/unitxt/service/metrics 2026-05-27T11:53:45,839 copying build/lib/unitxt/service/metrics/tokens.py -> build/bdist.linux-armv7l/wheel/./unitxt/service/metrics 2026-05-27T11:53:45,841 copying build/lib/unitxt/service/metrics/__init__.py -> build/bdist.linux-armv7l/wheel/./unitxt/service/metrics 2026-05-27T11:53:45,843 copying build/lib/unitxt/service/metrics/main.py -> build/bdist.linux-armv7l/wheel/./unitxt/service/metrics 2026-05-27T11:53:45,845 copying build/lib/unitxt/splitters.py -> build/bdist.linux-armv7l/wheel/./unitxt 2026-05-27T11:53:45,848 creating build/bdist.linux-armv7l/wheel/unitxt/test_utils 2026-05-27T11:53:45,849 copying build/lib/unitxt/test_utils/artifact.py -> build/bdist.linux-armv7l/wheel/./unitxt/test_utils 2026-05-27T11:53:45,851 copying build/lib/unitxt/test_utils/catalog.py -> build/bdist.linux-armv7l/wheel/./unitxt/test_utils 2026-05-27T11:53:45,853 copying build/lib/unitxt/test_utils/operators.py -> build/bdist.linux-armv7l/wheel/./unitxt/test_utils 2026-05-27T11:53:45,855 copying build/lib/unitxt/test_utils/card.py -> build/bdist.linux-armv7l/wheel/./unitxt/test_utils 2026-05-27T11:53:45,857 copying build/lib/unitxt/test_utils/storage.py -> build/bdist.linux-armv7l/wheel/./unitxt/test_utils 2026-05-27T11:53:45,859 copying build/lib/unitxt/test_utils/__init__.py -> build/bdist.linux-armv7l/wheel/./unitxt/test_utils 2026-05-27T11:53:45,861 copying build/lib/unitxt/test_utils/metrics.py -> build/bdist.linux-armv7l/wheel/./unitxt/test_utils 2026-05-27T11:53:45,863 copying build/lib/unitxt/llm_as_judge_operators.py -> build/bdist.linux-armv7l/wheel/./unitxt 2026-05-27T11:53:45,865 copying build/lib/unitxt/templates.py -> build/bdist.linux-armv7l/wheel/./unitxt 2026-05-27T11:53:45,867 copying build/lib/unitxt/system_prompts.py -> build/bdist.linux-armv7l/wheel/./unitxt 2026-05-27T11:53:45,869 copying build/lib/unitxt/schema.py -> build/bdist.linux-armv7l/wheel/./unitxt 2026-05-27T11:53:45,871 copying build/lib/unitxt/deprecation_utils.py -> build/bdist.linux-armv7l/wheel/./unitxt 2026-05-27T11:53:45,873 copying build/lib/unitxt/dialog_operators.py -> build/bdist.linux-armv7l/wheel/./unitxt 2026-05-27T11:53:45,875 copying build/lib/unitxt/catalog.py -> build/bdist.linux-armv7l/wheel/./unitxt 2026-05-27T11:53:45,877 copying build/lib/unitxt/formats.py -> build/bdist.linux-armv7l/wheel/./unitxt 2026-05-27T11:53:45,880 copying build/lib/unitxt/generator_utils.py -> build/bdist.linux-armv7l/wheel/./unitxt 2026-05-27T11:53:45,882 copying build/lib/unitxt/collections_operators.py -> build/bdist.linux-armv7l/wheel/./unitxt 2026-05-27T11:53:45,884 copying build/lib/unitxt/file_utils.py -> build/bdist.linux-armv7l/wheel/./unitxt 2026-05-27T11:53:45,887 creating build/bdist.linux-armv7l/wheel/unitxt/catalog 2026-05-27T11:53:45,888 creating build/bdist.linux-armv7l/wheel/unitxt/catalog/benchmarks 2026-05-27T11:53:45,889 copying build/lib/unitxt/catalog/benchmarks/tool_calling.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/benchmarks 2026-05-27T11:53:45,892 copying build/lib/unitxt/catalog/benchmarks/vision_default.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/benchmarks 2026-05-27T11:53:45,894 copying build/lib/unitxt/catalog/benchmarks/torr.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/benchmarks 2026-05-27T11:53:45,897 copying build/lib/unitxt/catalog/benchmarks/vision_full.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/benchmarks 2026-05-27T11:53:45,899 copying build/lib/unitxt/catalog/benchmarks/llama_vision.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/benchmarks 2026-05-27T11:53:45,901 copying build/lib/unitxt/catalog/benchmarks/bluebench.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/benchmarks 2026-05-27T11:53:45,903 copying build/lib/unitxt/catalog/benchmarks/glue.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/benchmarks 2026-05-27T11:53:45,906 creating build/bdist.linux-armv7l/wheel/unitxt/catalog/templates 2026-05-27T11:53:45,907 creating build/bdist.linux-armv7l/wheel/unitxt/catalog/templates/schema_linking 2026-05-27T11:53:45,909 copying build/lib/unitxt/catalog/templates/schema_linking/default.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/templates/schema_linking 2026-05-27T11:53:45,911 copying build/lib/unitxt/catalog/templates/schema_linking/with_hint.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/templates/schema_linking 2026-05-27T11:53:45,913 copying build/lib/unitxt/catalog/templates/schema_linking/all.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/templates/schema_linking 2026-05-27T11:53:45,915 creating build/bdist.linux-armv7l/wheel/unitxt/catalog/templates/summarization 2026-05-27T11:53:45,917 creating build/bdist.linux-armv7l/wheel/unitxt/catalog/templates/summarization/abstractive 2026-05-27T11:53:45,918 copying build/lib/unitxt/catalog/templates/summarization/abstractive/professional.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/templates/summarization/abstractive 2026-05-27T11:53:45,920 copying build/lib/unitxt/catalog/templates/summarization/abstractive/instruct_passive.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/templates/summarization/abstractive 2026-05-27T11:53:45,922 copying build/lib/unitxt/catalog/templates/summarization/abstractive/casual.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/templates/summarization/abstractive 2026-05-27T11:53:45,924 copying build/lib/unitxt/catalog/templates/summarization/abstractive/one_sentence.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/templates/summarization/abstractive 2026-05-27T11:53:45,925 copying build/lib/unitxt/catalog/templates/summarization/abstractive/formal.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/templates/summarization/abstractive 2026-05-27T11:53:45,927 copying build/lib/unitxt/catalog/templates/summarization/abstractive/title.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/templates/summarization/abstractive 2026-05-27T11:53:45,929 copying build/lib/unitxt/catalog/templates/summarization/abstractive/instruct_write_succinct.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/templates/summarization/abstractive 2026-05-27T11:53:45,931 copying build/lib/unitxt/catalog/templates/summarization/abstractive/instruct_tldr.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/templates/summarization/abstractive 2026-05-27T11:53:45,932 copying build/lib/unitxt/catalog/templates/summarization/abstractive/bluebench.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/templates/summarization/abstractive 2026-05-27T11:53:45,934 copying build/lib/unitxt/catalog/templates/summarization/abstractive/instruct_full.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/templates/summarization/abstractive 2026-05-27T11:53:45,936 copying build/lib/unitxt/catalog/templates/summarization/abstractive/instruct_one_sentence.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/templates/summarization/abstractive 2026-05-27T11:53:45,937 copying build/lib/unitxt/catalog/templates/summarization/abstractive/formal_without_label.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/templates/summarization/abstractive 2026-05-27T11:53:45,939 copying build/lib/unitxt/catalog/templates/summarization/abstractive/passive.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/templates/summarization/abstractive 2026-05-27T11:53:45,941 copying build/lib/unitxt/catalog/templates/summarization/abstractive/all.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/templates/summarization/abstractive 2026-05-27T11:53:45,943 copying build/lib/unitxt/catalog/templates/summarization/abstractive/write_succinct.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/templates/summarization/abstractive 2026-05-27T11:53:45,944 copying build/lib/unitxt/catalog/templates/summarization/abstractive/full.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/templates/summarization/abstractive 2026-05-27T11:53:45,946 copying build/lib/unitxt/catalog/templates/summarization/abstractive/instructive.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/templates/summarization/abstractive 2026-05-27T11:53:45,948 creating build/bdist.linux-armv7l/wheel/unitxt/catalog/templates/translation 2026-05-27T11:53:45,950 creating build/bdist.linux-armv7l/wheel/unitxt/catalog/templates/translation/directed 2026-05-27T11:53:45,951 copying build/lib/unitxt/catalog/templates/translation/directed/casual.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/templates/translation/directed 2026-05-27T11:53:45,953 copying build/lib/unitxt/catalog/templates/translation/directed/formal.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/templates/translation/directed 2026-05-27T11:53:45,955 copying build/lib/unitxt/catalog/templates/translation/directed/instructional.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/templates/translation/directed 2026-05-27T11:53:45,957 copying build/lib/unitxt/catalog/templates/translation/directed/title.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/templates/translation/directed 2026-05-27T11:53:45,959 copying build/lib/unitxt/catalog/templates/translation/directed/playful.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/templates/translation/directed 2026-05-27T11:53:45,961 copying build/lib/unitxt/catalog/templates/translation/directed/bluebench.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/templates/translation/directed 2026-05-27T11:53:45,963 copying build/lib/unitxt/catalog/templates/translation/directed/simple.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/templates/translation/directed 2026-05-27T11:53:45,964 copying build/lib/unitxt/catalog/templates/translation/directed/all.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/templates/translation/directed 2026-05-27T11:53:45,966 copying build/lib/unitxt/catalog/templates/key_val_with_new_lines.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/templates 2026-05-27T11:53:45,968 creating build/bdist.linux-armv7l/wheel/unitxt/catalog/templates/tool_calling 2026-05-27T11:53:45,969 copying build/lib/unitxt/catalog/templates/tool_calling/base.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/templates/tool_calling 2026-05-27T11:53:45,971 copying build/lib/unitxt/catalog/templates/tool_calling/multi_turn.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/templates/tool_calling 2026-05-27T11:53:45,973 copying build/lib/unitxt/catalog/templates/key_val.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/templates 2026-05-27T11:53:45,975 creating build/bdist.linux-armv7l/wheel/unitxt/catalog/templates/generation 2026-05-27T11:53:45,976 copying build/lib/unitxt/catalog/templates/generation/default.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/templates/generation 2026-05-27T11:53:45,979 creating build/bdist.linux-armv7l/wheel/unitxt/catalog/templates/generation/from_pair 2026-05-27T11:53:45,980 copying build/lib/unitxt/catalog/templates/generation/from_pair/default.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/templates/generation/from_pair 2026-05-27T11:53:45,982 copying build/lib/unitxt/catalog/templates/generation/from_pair/all.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/templates/generation/from_pair 2026-05-27T11:53:45,983 copying build/lib/unitxt/catalog/templates/generation/empty.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/templates/generation 2026-05-27T11:53:45,985 copying build/lib/unitxt/catalog/templates/generation/all.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/templates/generation 2026-05-27T11:53:45,988 creating build/bdist.linux-armv7l/wheel/unitxt/catalog/templates/rag 2026-05-27T11:53:45,989 creating build/bdist.linux-armv7l/wheel/unitxt/catalog/templates/rag/end_to_end 2026-05-27T11:53:45,990 copying build/lib/unitxt/catalog/templates/rag/end_to_end/json_predictions.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/templates/rag/end_to_end 2026-05-27T11:53:45,993 creating build/bdist.linux-armv7l/wheel/unitxt/catalog/templates/rag/response_generation 2026-05-27T11:53:45,994 copying build/lib/unitxt/catalog/templates/rag/response_generation/please_respond_chat.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/templates/rag/response_generation 2026-05-27T11:53:45,996 copying build/lib/unitxt/catalog/templates/rag/response_generation/please_respond.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/templates/rag/response_generation 2026-05-27T11:53:45,998 copying build/lib/unitxt/catalog/templates/rag/response_generation/answer_based_on_context.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/templates/rag/response_generation 2026-05-27T11:53:46,000 copying build/lib/unitxt/catalog/templates/rag/response_generation/bluebench.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/templates/rag/response_generation 2026-05-27T11:53:46,002 copying build/lib/unitxt/catalog/templates/rag/response_generation/answer_based_on_context_inverted.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/templates/rag/response_generation 2026-05-27T11:53:46,004 creating build/bdist.linux-armv7l/wheel/unitxt/catalog/templates/grammatical_error_detection 2026-05-27T11:53:46,005 copying build/lib/unitxt/catalog/templates/grammatical_error_detection/all.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/templates/grammatical_error_detection 2026-05-27T11:53:46,008 copying build/lib/unitxt/catalog/templates/grammatical_error_detection/yes_no.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/templates/grammatical_error_detection 2026-05-27T11:53:46,010 creating build/bdist.linux-armv7l/wheel/unitxt/catalog/templates/rewriting 2026-05-27T11:53:46,012 creating build/bdist.linux-armv7l/wheel/unitxt/catalog/templates/rewriting/by_attribute 2026-05-27T11:53:46,013 copying build/lib/unitxt/catalog/templates/rewriting/by_attribute/default.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/templates/rewriting/by_attribute 2026-05-27T11:53:46,015 copying build/lib/unitxt/catalog/templates/rewriting/by_attribute/all.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/templates/rewriting/by_attribute 2026-05-27T11:53:46,017 creating build/bdist.linux-armv7l/wheel/unitxt/catalog/templates/rewriting/paraphrase 2026-05-27T11:53:46,018 copying build/lib/unitxt/catalog/templates/rewriting/paraphrase/default.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/templates/rewriting/paraphrase 2026-05-27T11:53:46,020 copying build/lib/unitxt/catalog/templates/rewriting/paraphrase/all.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/templates/rewriting/paraphrase 2026-05-27T11:53:46,022 creating build/bdist.linux-armv7l/wheel/unitxt/catalog/templates/classification 2026-05-27T11:53:46,024 creating build/bdist.linux-armv7l/wheel/unitxt/catalog/templates/classification/multi_class 2026-05-27T11:53:46,025 copying build/lib/unitxt/catalog/templates/classification/multi_class/default.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/templates/classification/multi_class 2026-05-27T11:53:46,027 copying build/lib/unitxt/catalog/templates/classification/multi_class/instruction.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/templates/classification/multi_class 2026-05-27T11:53:46,030 creating build/bdist.linux-armv7l/wheel/unitxt/catalog/templates/classification/multi_class/relation 2026-05-27T11:53:46,031 copying build/lib/unitxt/catalog/templates/classification/multi_class/relation/default.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/templates/classification/multi_class/relation 2026-05-27T11:53:46,033 creating build/bdist.linux-armv7l/wheel/unitxt/catalog/templates/classification/multi_class/relation/truthfulness 2026-05-27T11:53:46,034 copying build/lib/unitxt/catalog/templates/classification/multi_class/relation/truthfulness/flan_4.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/templates/classification/multi_class/relation/truthfulness 2026-05-27T11:53:46,036 copying build/lib/unitxt/catalog/templates/classification/multi_class/relation/truthfulness/flan_1.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/templates/classification/multi_class/relation/truthfulness 2026-05-27T11:53:46,038 copying build/lib/unitxt/catalog/templates/classification/multi_class/relation/truthfulness/flan_3.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/templates/classification/multi_class/relation/truthfulness 2026-05-27T11:53:46,040 copying build/lib/unitxt/catalog/templates/classification/multi_class/relation/truthfulness/flan_6.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/templates/classification/multi_class/relation/truthfulness 2026-05-27T11:53:46,042 copying build/lib/unitxt/catalog/templates/classification/multi_class/relation/truthfulness/flan_7.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/templates/classification/multi_class/relation/truthfulness 2026-05-27T11:53:46,044 copying build/lib/unitxt/catalog/templates/classification/multi_class/relation/truthfulness/flan_2.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/templates/classification/multi_class/relation/truthfulness 2026-05-27T11:53:46,046 copying build/lib/unitxt/catalog/templates/classification/multi_class/relation/truthfulness/all.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/templates/classification/multi_class/relation/truthfulness 2026-05-27T11:53:46,048 copying build/lib/unitxt/catalog/templates/classification/multi_class/relation/truthfulness/flan_5.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/templates/classification/multi_class/relation/truthfulness 2026-05-27T11:53:46,050 copying build/lib/unitxt/catalog/templates/classification/multi_class/relation/simple.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/templates/classification/multi_class/relation 2026-05-27T11:53:46,052 copying build/lib/unitxt/catalog/templates/classification/multi_class/relation/all.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/templates/classification/multi_class/relation 2026-05-27T11:53:46,053 copying build/lib/unitxt/catalog/templates/classification/multi_class/title.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/templates/classification/multi_class 2026-05-27T11:53:46,055 copying build/lib/unitxt/catalog/templates/classification/multi_class/instruct_question_selects.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/templates/classification/multi_class 2026-05-27T11:53:46,057 copying build/lib/unitxt/catalog/templates/classification/multi_class/instruct_select_question.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/templates/classification/multi_class 2026-05-27T11:53:46,059 copying build/lib/unitxt/catalog/templates/classification/multi_class/bluebench.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/templates/classification/multi_class 2026-05-27T11:53:46,060 copying build/lib/unitxt/catalog/templates/classification/multi_class/empty.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/templates/classification/multi_class 2026-05-27T11:53:46,062 copying build/lib/unitxt/catalog/templates/classification/multi_class/instruct_question_select_i_think.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/templates/classification/multi_class 2026-05-27T11:53:46,064 copying build/lib/unitxt/catalog/templates/classification/multi_class/all.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/templates/classification/multi_class 2026-05-27T11:53:46,066 creating build/bdist.linux-armv7l/wheel/unitxt/catalog/templates/classification/multi_label 2026-05-27T11:53:46,067 copying build/lib/unitxt/catalog/templates/classification/multi_label/default.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/templates/classification/multi_label 2026-05-27T11:53:46,069 copying build/lib/unitxt/catalog/templates/classification/multi_label/instruction.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/templates/classification/multi_label 2026-05-27T11:53:46,071 copying build/lib/unitxt/catalog/templates/classification/multi_label/title.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/templates/classification/multi_label 2026-05-27T11:53:46,073 copying build/lib/unitxt/catalog/templates/classification/multi_label/empty.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/templates/classification/multi_label 2026-05-27T11:53:46,075 copying build/lib/unitxt/catalog/templates/classification/multi_label/all.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/templates/classification/multi_label 2026-05-27T11:53:46,078 creating build/bdist.linux-armv7l/wheel/unitxt/catalog/templates/safety 2026-05-27T11:53:46,079 copying build/lib/unitxt/catalog/templates/safety/llamaguard.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/templates/safety 2026-05-27T11:53:46,081 copying build/lib/unitxt/catalog/templates/safety/harm_rating.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/templates/safety 2026-05-27T11:53:46,084 creating build/bdist.linux-armv7l/wheel/unitxt/catalog/templates/rag_eval 2026-05-27T11:53:46,086 creating build/bdist.linux-armv7l/wheel/unitxt/catalog/templates/rag_eval/correctness_holistic 2026-05-27T11:53:46,087 copying build/lib/unitxt/catalog/templates/rag_eval/correctness_holistic/judge_correctness_simple_numeric.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/templates/rag_eval/correctness_holistic 2026-05-27T11:53:46,089 copying build/lib/unitxt/catalog/templates/rag_eval/correctness_holistic/metric_template.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/templates/rag_eval/correctness_holistic 2026-05-27T11:53:46,091 copying build/lib/unitxt/catalog/templates/rag_eval/correctness_holistic/judge_correctness_simple.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/templates/rag_eval/correctness_holistic 2026-05-27T11:53:46,093 copying build/lib/unitxt/catalog/templates/rag_eval/correctness_holistic/judge_correctness_explain_first_logprobs.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/templates/rag_eval/correctness_holistic 2026-05-27T11:53:46,095 copying build/lib/unitxt/catalog/templates/rag_eval/correctness_holistic/judge_correctness_simple_logprobs.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/templates/rag_eval/correctness_holistic 2026-05-27T11:53:46,097 copying build/lib/unitxt/catalog/templates/rag_eval/correctness_holistic/judge_correctness_explain_first.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/templates/rag_eval/correctness_holistic 2026-05-27T11:53:46,099 copying build/lib/unitxt/catalog/templates/rag_eval/correctness_holistic/all.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/templates/rag_eval/correctness_holistic 2026-05-27T11:53:46,101 creating build/bdist.linux-armv7l/wheel/unitxt/catalog/templates/rag_eval/context_relevance 2026-05-27T11:53:46,103 copying build/lib/unitxt/catalog/templates/rag_eval/context_relevance/judge_context_relevance_ares_verbal.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/templates/rag_eval/context_relevance 2026-05-27T11:53:46,105 copying build/lib/unitxt/catalog/templates/rag_eval/context_relevance/judge_context_relevance.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/templates/rag_eval/context_relevance 2026-05-27T11:53:46,107 copying build/lib/unitxt/catalog/templates/rag_eval/context_relevance/metric_template.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/templates/rag_eval/context_relevance 2026-05-27T11:53:46,108 copying build/lib/unitxt/catalog/templates/rag_eval/context_relevance/judge_context_relevance_ares.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/templates/rag_eval/context_relevance 2026-05-27T11:53:46,110 copying build/lib/unitxt/catalog/templates/rag_eval/context_relevance/judge_context_relevance_ares_logprobs.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/templates/rag_eval/context_relevance 2026-05-27T11:53:46,112 copying build/lib/unitxt/catalog/templates/rag_eval/context_relevance/judge_context_relevance_ares_verbal_good_bad.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/templates/rag_eval/context_relevance 2026-05-27T11:53:46,114 copying build/lib/unitxt/catalog/templates/rag_eval/context_relevance/judge_context_relevance_logprobs.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/templates/rag_eval/context_relevance 2026-05-27T11:53:46,116 copying build/lib/unitxt/catalog/templates/rag_eval/context_relevance/judge_context_relevance_ares_numeric.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/templates/rag_eval/context_relevance 2026-05-27T11:53:46,118 copying build/lib/unitxt/catalog/templates/rag_eval/context_relevance/all.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/templates/rag_eval/context_relevance 2026-05-27T11:53:46,120 creating build/bdist.linux-armv7l/wheel/unitxt/catalog/templates/rag_eval/answer_correctness 2026-05-27T11:53:46,121 copying build/lib/unitxt/catalog/templates/rag_eval/answer_correctness/judge_simplified_no_context.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/templates/rag_eval/answer_correctness 2026-05-27T11:53:46,123 copying build/lib/unitxt/catalog/templates/rag_eval/answer_correctness/metric_template.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/templates/rag_eval/answer_correctness 2026-05-27T11:53:46,125 copying build/lib/unitxt/catalog/templates/rag_eval/answer_correctness/judge_instruct_qa_format_logprobs.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/templates/rag_eval/answer_correctness 2026-05-27T11:53:46,127 copying build/lib/unitxt/catalog/templates/rag_eval/answer_correctness/judge_loose_match_no_context_verbal_good_bad.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/templates/rag_eval/answer_correctness 2026-05-27T11:53:46,129 copying build/lib/unitxt/catalog/templates/rag_eval/answer_correctness/judge_simplified_with_context_logprobs.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/templates/rag_eval/answer_correctness 2026-05-27T11:53:46,131 copying build/lib/unitxt/catalog/templates/rag_eval/answer_correctness/judge_simplified_format.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/templates/rag_eval/answer_correctness 2026-05-27T11:53:46,133 copying build/lib/unitxt/catalog/templates/rag_eval/answer_correctness/judge_simplified_format_logprobs.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/templates/rag_eval/answer_correctness 2026-05-27T11:53:46,135 copying build/lib/unitxt/catalog/templates/rag_eval/answer_correctness/judge_loose_match_no_context_numeric.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/templates/rag_eval/answer_correctness 2026-05-27T11:53:46,137 copying build/lib/unitxt/catalog/templates/rag_eval/answer_correctness/judge_loose_match_no_context_logprobs.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/templates/rag_eval/answer_correctness 2026-05-27T11:53:46,139 copying build/lib/unitxt/catalog/templates/rag_eval/answer_correctness/judge_simplified_no_context_logprobs.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/templates/rag_eval/answer_correctness 2026-05-27T11:53:46,141 copying build/lib/unitxt/catalog/templates/rag_eval/answer_correctness/judge_loose_match_no_context_verbal.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/templates/rag_eval/answer_correctness 2026-05-27T11:53:46,142 copying build/lib/unitxt/catalog/templates/rag_eval/answer_correctness/all.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/templates/rag_eval/answer_correctness 2026-05-27T11:53:46,144 copying build/lib/unitxt/catalog/templates/rag_eval/answer_correctness/judge_instruct_qa_format.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/templates/rag_eval/answer_correctness 2026-05-27T11:53:46,147 copying build/lib/unitxt/catalog/templates/rag_eval/answer_correctness/judge_simplified_with_context.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/templates/rag_eval/answer_correctness 2026-05-27T11:53:46,148 copying build/lib/unitxt/catalog/templates/rag_eval/answer_correctness/judge_loose_match_no_context.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/templates/rag_eval/answer_correctness 2026-05-27T11:53:46,151 creating build/bdist.linux-armv7l/wheel/unitxt/catalog/templates/rag_eval/answer_relevance 2026-05-27T11:53:46,152 copying build/lib/unitxt/catalog/templates/rag_eval/answer_relevance/metric_template.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/templates/rag_eval/answer_relevance 2026-05-27T11:53:46,154 copying build/lib/unitxt/catalog/templates/rag_eval/answer_relevance/judge_answer_relevance_logprobs.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/templates/rag_eval/answer_relevance 2026-05-27T11:53:46,156 copying build/lib/unitxt/catalog/templates/rag_eval/answer_relevance/judge_answer_relevance.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/templates/rag_eval/answer_relevance 2026-05-27T11:53:46,158 copying build/lib/unitxt/catalog/templates/rag_eval/answer_relevance/judge_answer_relevance_numeric.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/templates/rag_eval/answer_relevance 2026-05-27T11:53:46,159 copying build/lib/unitxt/catalog/templates/rag_eval/answer_relevance/judge_answer_relevance_verbal_good_bad.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/templates/rag_eval/answer_relevance 2026-05-27T11:53:46,161 copying build/lib/unitxt/catalog/templates/rag_eval/answer_relevance/all.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/templates/rag_eval/answer_relevance 2026-05-27T11:53:46,164 creating build/bdist.linux-armv7l/wheel/unitxt/catalog/templates/rag_eval/faithfulness 2026-05-27T11:53:46,165 copying build/lib/unitxt/catalog/templates/rag_eval/faithfulness/judge_no_question_simplified_explain_logprobs.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/templates/rag_eval/faithfulness 2026-05-27T11:53:46,167 copying build/lib/unitxt/catalog/templates/rag_eval/faithfulness/judge_with_question_simplified_verbal.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/templates/rag_eval/faithfulness 2026-05-27T11:53:46,169 copying build/lib/unitxt/catalog/templates/rag_eval/faithfulness/judge_no_question_simplified_verbal_good_bad.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/templates/rag_eval/faithfulness 2026-05-27T11:53:46,170 copying build/lib/unitxt/catalog/templates/rag_eval/faithfulness/metric_template.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/templates/rag_eval/faithfulness 2026-05-27T11:53:46,173 copying build/lib/unitxt/catalog/templates/rag_eval/faithfulness/judge_with_question_full.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/templates/rag_eval/faithfulness 2026-05-27T11:53:46,175 copying build/lib/unitxt/catalog/templates/rag_eval/faithfulness/judge_no_question_simplified_logprobs.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/templates/rag_eval/faithfulness 2026-05-27T11:53:46,176 copying build/lib/unitxt/catalog/templates/rag_eval/faithfulness/judge_no_question_simplified_verbal.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/templates/rag_eval/faithfulness 2026-05-27T11:53:46,178 copying build/lib/unitxt/catalog/templates/rag_eval/faithfulness/judge_no_question_simplified.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/templates/rag_eval/faithfulness 2026-05-27T11:53:46,180 copying build/lib/unitxt/catalog/templates/rag_eval/faithfulness/judge_with_question_simplified_logprobs.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/templates/rag_eval/faithfulness 2026-05-27T11:53:46,181 copying build/lib/unitxt/catalog/templates/rag_eval/faithfulness/judge_with_question_full_logprobs.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/templates/rag_eval/faithfulness 2026-05-27T11:53:46,183 copying build/lib/unitxt/catalog/templates/rag_eval/faithfulness/judge_with_question_simplified.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/templates/rag_eval/faithfulness 2026-05-27T11:53:46,185 copying build/lib/unitxt/catalog/templates/rag_eval/faithfulness/judge_no_question_simplified_explain.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/templates/rag_eval/faithfulness 2026-05-27T11:53:46,187 copying build/lib/unitxt/catalog/templates/rag_eval/faithfulness/judge_with_question_simplified_numeric.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/templates/rag_eval/faithfulness 2026-05-27T11:53:46,188 copying build/lib/unitxt/catalog/templates/rag_eval/faithfulness/judge_with_question_simplified_verbal_good_bad.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/templates/rag_eval/faithfulness 2026-05-27T11:53:46,190 copying build/lib/unitxt/catalog/templates/rag_eval/faithfulness/judge_no_question_simplified_numeric.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/templates/rag_eval/faithfulness 2026-05-27T11:53:46,192 copying build/lib/unitxt/catalog/templates/rag_eval/faithfulness/judge_no_question_full.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/templates/rag_eval/faithfulness 2026-05-27T11:53:46,194 copying build/lib/unitxt/catalog/templates/rag_eval/faithfulness/all.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/templates/rag_eval/faithfulness 2026-05-27T11:53:46,196 copying build/lib/unitxt/catalog/templates/rag_eval/faithfulness/judge_no_question_full_logprobs.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/templates/rag_eval/faithfulness 2026-05-27T11:53:46,198 copying build/lib/unitxt/catalog/templates/empty.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/templates 2026-05-27T11:53:46,200 creating build/bdist.linux-armv7l/wheel/unitxt/catalog/templates/text2sql 2026-05-27T11:53:46,202 copying build/lib/unitxt/catalog/templates/text2sql/you_are_given.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/templates/text2sql 2026-05-27T11:53:46,204 copying build/lib/unitxt/catalog/templates/text2sql/you_are_given_no_system_with_hint.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/templates/text2sql 2026-05-27T11:53:46,206 copying build/lib/unitxt/catalog/templates/text2sql/you_are_given_no_system.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/templates/text2sql 2026-05-27T11:53:46,208 copying build/lib/unitxt/catalog/templates/text2sql/empty.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/templates/text2sql 2026-05-27T11:53:46,209 copying build/lib/unitxt/catalog/templates/text2sql/you_are_given_with_hint.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/templates/text2sql 2026-05-27T11:53:46,211 copying build/lib/unitxt/catalog/templates/text2sql/you_are_given_with_hint_answer_sql_prefix_no_inst.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/templates/text2sql 2026-05-27T11:53:46,213 copying build/lib/unitxt/catalog/templates/text2sql/all.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/templates/text2sql 2026-05-27T11:53:46,214 copying build/lib/unitxt/catalog/templates/text2sql/you_are_given_with_hint_with_out_sql_prefix.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/templates/text2sql 2026-05-27T11:53:46,216 copying build/lib/unitxt/catalog/templates/text2sql/you_are_given_with_hint_with_sql_prefix.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/templates/text2sql 2026-05-27T11:53:46,218 copying build/lib/unitxt/catalog/templates/text2sql/you_are_given_with_sql_prefix.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/templates/text2sql 2026-05-27T11:53:46,220 creating build/bdist.linux-armv7l/wheel/unitxt/catalog/templates/response_assessment 2026-05-27T11:53:46,222 creating build/bdist.linux-armv7l/wheel/unitxt/catalog/templates/response_assessment/pairwise_comparison 2026-05-27T11:53:46,223 copying build/lib/unitxt/catalog/templates/response_assessment/pairwise_comparison/mt_bench_single_turn_with_reference_with_shuffling.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/templates/response_assessment/pairwise_comparison 2026-05-27T11:53:46,225 copying build/lib/unitxt/catalog/templates/response_assessment/pairwise_comparison/mt_bench_single_turn_with_shuffling.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/templates/response_assessment/pairwise_comparison 2026-05-27T11:53:46,227 copying build/lib/unitxt/catalog/templates/response_assessment/pairwise_comparison/mt_bench_multi_turn.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/templates/response_assessment/pairwise_comparison 2026-05-27T11:53:46,229 copying build/lib/unitxt/catalog/templates/response_assessment/pairwise_comparison/mt_bench_multi_turn_with_shuffling.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/templates/response_assessment/pairwise_comparison 2026-05-27T11:53:46,231 copying build/lib/unitxt/catalog/templates/response_assessment/pairwise_comparison/mt_bench_multi_turn_with_reference_with_shuffling.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/templates/response_assessment/pairwise_comparison 2026-05-27T11:53:46,234 copying build/lib/unitxt/catalog/templates/response_assessment/pairwise_comparison/mt_bench_single_turn.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/templates/response_assessment/pairwise_comparison 2026-05-27T11:53:46,236 copying build/lib/unitxt/catalog/templates/response_assessment/pairwise_comparison/mt_bench_single_turn_with_reference.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/templates/response_assessment/pairwise_comparison 2026-05-27T11:53:46,238 copying build/lib/unitxt/catalog/templates/response_assessment/pairwise_comparison/mt_bench_multi_turn_with_reference.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/templates/response_assessment/pairwise_comparison 2026-05-27T11:53:46,240 creating build/bdist.linux-armv7l/wheel/unitxt/catalog/templates/response_assessment/pairwise_comparative_rating 2026-05-27T11:53:46,242 copying build/lib/unitxt/catalog/templates/response_assessment/pairwise_comparative_rating/prometheus_arena_hard_with_shuffling.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/templates/response_assessment/pairwise_comparative_rating 2026-05-27T11:53:46,244 copying build/lib/unitxt/catalog/templates/response_assessment/pairwise_comparative_rating/arena_hard_with_shuffling.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/templates/response_assessment/pairwise_comparative_rating 2026-05-27T11:53:46,245 copying build/lib/unitxt/catalog/templates/response_assessment/pairwise_comparative_rating/arena_hard.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/templates/response_assessment/pairwise_comparative_rating 2026-05-27T11:53:46,247 copying build/lib/unitxt/catalog/templates/response_assessment/pairwise_comparative_rating/prometheus_arena_hard.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/templates/response_assessment/pairwise_comparative_rating 2026-05-27T11:53:46,250 creating build/bdist.linux-armv7l/wheel/unitxt/catalog/templates/response_assessment/rating 2026-05-27T11:53:46,251 copying build/lib/unitxt/catalog/templates/response_assessment/rating/mt_bench_multi_turn.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/templates/response_assessment/rating 2026-05-27T11:53:46,252 copying build/lib/unitxt/catalog/templates/response_assessment/rating/table2text_single_turn_with_reference.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/templates/response_assessment/rating 2026-05-27T11:53:46,254 copying build/lib/unitxt/catalog/templates/response_assessment/rating/generic_single_turn_with_reference.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/templates/response_assessment/rating 2026-05-27T11:53:46,256 copying build/lib/unitxt/catalog/templates/response_assessment/rating/generic_single_turn.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/templates/response_assessment/rating 2026-05-27T11:53:46,258 copying build/lib/unitxt/catalog/templates/response_assessment/rating/mt_bench_single_turn.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/templates/response_assessment/rating 2026-05-27T11:53:46,260 copying build/lib/unitxt/catalog/templates/response_assessment/rating/mt_bench_single_turn_with_reference.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/templates/response_assessment/rating 2026-05-27T11:53:46,262 copying build/lib/unitxt/catalog/templates/response_assessment/rating/mt_bench_multi_turn_with_reference.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/templates/response_assessment/rating 2026-05-27T11:53:46,265 creating build/bdist.linux-armv7l/wheel/unitxt/catalog/templates/language_identification 2026-05-27T11:53:46,266 copying build/lib/unitxt/catalog/templates/language_identification/simple.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/templates/language_identification 2026-05-27T11:53:46,267 copying build/lib/unitxt/catalog/templates/language_identification/all.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/templates/language_identification 2026-05-27T11:53:46,270 creating build/bdist.linux-armv7l/wheel/unitxt/catalog/templates/qa 2026-05-27T11:53:46,271 creating build/bdist.linux-armv7l/wheel/unitxt/catalog/templates/qa/with_context 2026-05-27T11:53:46,273 copying build/lib/unitxt/catalog/templates/qa/with_context/with_type.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/templates/qa/with_context 2026-05-27T11:53:46,275 copying build/lib/unitxt/catalog/templates/qa/with_context/info_vqa.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/templates/qa/with_context 2026-05-27T11:53:46,277 copying build/lib/unitxt/catalog/templates/qa/with_context/doc_vqa.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/templates/qa/with_context 2026-05-27T11:53:46,278 copying build/lib/unitxt/catalog/templates/qa/with_context/qtsumm.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/templates/qa/with_context 2026-05-27T11:53:46,280 copying build/lib/unitxt/catalog/templates/qa/with_context/title.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/templates/qa/with_context 2026-05-27T11:53:46,282 copying build/lib/unitxt/catalog/templates/qa/with_context/ffqa.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/templates/qa/with_context 2026-05-27T11:53:46,284 copying build/lib/unitxt/catalog/templates/qa/with_context/question_first.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/templates/qa/with_context 2026-05-27T11:53:46,285 copying build/lib/unitxt/catalog/templates/qa/with_context/chart_qa.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/templates/qa/with_context 2026-05-27T11:53:46,287 copying build/lib/unitxt/catalog/templates/qa/with_context/lmms_eval.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/templates/qa/with_context 2026-05-27T11:53:46,289 copying build/lib/unitxt/catalog/templates/qa/with_context/websrc.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/templates/qa/with_context 2026-05-27T11:53:46,291 copying build/lib/unitxt/catalog/templates/qa/with_context/simple2.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/templates/qa/with_context 2026-05-27T11:53:46,292 copying build/lib/unitxt/catalog/templates/qa/with_context/simple.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/templates/qa/with_context 2026-05-27T11:53:46,294 copying build/lib/unitxt/catalog/templates/qa/with_context/all.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/templates/qa/with_context 2026-05-27T11:53:46,296 copying build/lib/unitxt/catalog/templates/qa/open.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/templates/qa 2026-05-27T11:53:46,298 creating build/bdist.linux-armv7l/wheel/unitxt/catalog/templates/qa/multiple_choice 2026-05-27T11:53:46,300 creating build/bdist.linux-armv7l/wheel/unitxt/catalog/templates/qa/multiple_choice/with_context 2026-05-27T11:53:46,302 creating build/bdist.linux-armv7l/wheel/unitxt/catalog/templates/qa/multiple_choice/with_context/no_intro 2026-05-27T11:53:46,303 copying build/lib/unitxt/catalog/templates/qa/multiple_choice/with_context/no_intro/mmlu.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/templates/qa/multiple_choice/with_context/no_intro 2026-05-27T11:53:46,305 creating build/bdist.linux-armv7l/wheel/unitxt/catalog/templates/qa/multiple_choice/with_context/no_intro/ja 2026-05-27T11:53:46,306 copying build/lib/unitxt/catalog/templates/qa/multiple_choice/with_context/no_intro/ja/mmlu.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/templates/qa/multiple_choice/with_context/no_intro/ja 2026-05-27T11:53:46,308 copying build/lib/unitxt/catalog/templates/qa/multiple_choice/with_context/no_intro/ja/helm.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/templates/qa/multiple_choice/with_context/no_intro/ja 2026-05-27T11:53:46,310 copying build/lib/unitxt/catalog/templates/qa/multiple_choice/with_context/no_intro/ja/all.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/templates/qa/multiple_choice/with_context/no_intro/ja 2026-05-27T11:53:46,312 copying build/lib/unitxt/catalog/templates/qa/multiple_choice/with_context/no_intro/ja/lm_eval_harness.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/templates/qa/multiple_choice/with_context/no_intro/ja 2026-05-27T11:53:46,314 copying build/lib/unitxt/catalog/templates/qa/multiple_choice/with_context/no_intro/helm.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/templates/qa/multiple_choice/with_context/no_intro 2026-05-27T11:53:46,316 creating build/bdist.linux-armv7l/wheel/unitxt/catalog/templates/qa/multiple_choice/with_context/no_intro/fr 2026-05-27T11:53:46,318 copying build/lib/unitxt/catalog/templates/qa/multiple_choice/with_context/no_intro/fr/mmlu.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/templates/qa/multiple_choice/with_context/no_intro/fr 2026-05-27T11:53:46,320 copying build/lib/unitxt/catalog/templates/qa/multiple_choice/with_context/no_intro/fr/helm.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/templates/qa/multiple_choice/with_context/no_intro/fr 2026-05-27T11:53:46,321 copying build/lib/unitxt/catalog/templates/qa/multiple_choice/with_context/no_intro/fr/all.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/templates/qa/multiple_choice/with_context/no_intro/fr 2026-05-27T11:53:46,323 copying build/lib/unitxt/catalog/templates/qa/multiple_choice/with_context/no_intro/fr/lm_eval_harness.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/templates/qa/multiple_choice/with_context/no_intro/fr 2026-05-27T11:53:46,326 creating build/bdist.linux-armv7l/wheel/unitxt/catalog/templates/qa/multiple_choice/with_context/no_intro/de 2026-05-27T11:53:46,327 copying build/lib/unitxt/catalog/templates/qa/multiple_choice/with_context/no_intro/de/mmlu.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/templates/qa/multiple_choice/with_context/no_intro/de 2026-05-27T11:53:46,329 copying build/lib/unitxt/catalog/templates/qa/multiple_choice/with_context/no_intro/de/helm.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/templates/qa/multiple_choice/with_context/no_intro/de 2026-05-27T11:53:46,331 copying build/lib/unitxt/catalog/templates/qa/multiple_choice/with_context/no_intro/de/all.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/templates/qa/multiple_choice/with_context/no_intro/de 2026-05-27T11:53:46,333 copying build/lib/unitxt/catalog/templates/qa/multiple_choice/with_context/no_intro/de/lm_eval_harness.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/templates/qa/multiple_choice/with_context/no_intro/de 2026-05-27T11:53:46,335 creating build/bdist.linux-armv7l/wheel/unitxt/catalog/templates/qa/multiple_choice/with_context/no_intro/es 2026-05-27T11:53:46,336 copying build/lib/unitxt/catalog/templates/qa/multiple_choice/with_context/no_intro/es/mmlu.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/templates/qa/multiple_choice/with_context/no_intro/es 2026-05-27T11:53:46,338 copying build/lib/unitxt/catalog/templates/qa/multiple_choice/with_context/no_intro/es/helm.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/templates/qa/multiple_choice/with_context/no_intro/es 2026-05-27T11:53:46,340 copying build/lib/unitxt/catalog/templates/qa/multiple_choice/with_context/no_intro/es/all.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/templates/qa/multiple_choice/with_context/no_intro/es 2026-05-27T11:53:46,342 copying build/lib/unitxt/catalog/templates/qa/multiple_choice/with_context/no_intro/es/lm_eval_harness.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/templates/qa/multiple_choice/with_context/no_intro/es 2026-05-27T11:53:46,344 copying build/lib/unitxt/catalog/templates/qa/multiple_choice/with_context/no_intro/all.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/templates/qa/multiple_choice/with_context/no_intro 2026-05-27T11:53:46,346 creating build/bdist.linux-armv7l/wheel/unitxt/catalog/templates/qa/multiple_choice/with_context/no_intro/pt 2026-05-27T11:53:46,347 copying build/lib/unitxt/catalog/templates/qa/multiple_choice/with_context/no_intro/pt/mmlu.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/templates/qa/multiple_choice/with_context/no_intro/pt 2026-05-27T11:53:46,349 copying build/lib/unitxt/catalog/templates/qa/multiple_choice/with_context/no_intro/pt/helm.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/templates/qa/multiple_choice/with_context/no_intro/pt 2026-05-27T11:53:46,351 copying build/lib/unitxt/catalog/templates/qa/multiple_choice/with_context/no_intro/pt/all.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/templates/qa/multiple_choice/with_context/no_intro/pt 2026-05-27T11:53:46,353 copying build/lib/unitxt/catalog/templates/qa/multiple_choice/with_context/no_intro/pt/lm_eval_harness.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/templates/qa/multiple_choice/with_context/no_intro/pt 2026-05-27T11:53:46,355 copying build/lib/unitxt/catalog/templates/qa/multiple_choice/with_context/no_intro/lm_eval_harness.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/templates/qa/multiple_choice/with_context/no_intro 2026-05-27T11:53:46,357 copying build/lib/unitxt/catalog/templates/qa/multiple_choice/with_context/ai2d.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/templates/qa/multiple_choice/with_context 2026-05-27T11:53:46,359 copying build/lib/unitxt/catalog/templates/qa/multiple_choice/with_context/title.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/templates/qa/multiple_choice/with_context 2026-05-27T11:53:46,360 copying build/lib/unitxt/catalog/templates/qa/multiple_choice/with_context/bluebench.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/templates/qa/multiple_choice/with_context 2026-05-27T11:53:46,362 copying build/lib/unitxt/catalog/templates/qa/multiple_choice/with_context/match.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/templates/qa/multiple_choice/with_context 2026-05-27T11:53:46,364 copying build/lib/unitxt/catalog/templates/qa/multiple_choice/with_context/lmms_eval.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/templates/qa/multiple_choice/with_context 2026-05-27T11:53:46,366 creating build/bdist.linux-armv7l/wheel/unitxt/catalog/templates/qa/multiple_choice/with_context/with_topic 2026-05-27T11:53:46,367 copying build/lib/unitxt/catalog/templates/qa/multiple_choice/with_context/with_topic/mmlu.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/templates/qa/multiple_choice/with_context/with_topic 2026-05-27T11:53:46,369 creating build/bdist.linux-armv7l/wheel/unitxt/catalog/templates/qa/multiple_choice/with_context/with_topic/ja 2026-05-27T11:53:46,371 copying build/lib/unitxt/catalog/templates/qa/multiple_choice/with_context/with_topic/ja/mmlu.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/templates/qa/multiple_choice/with_context/with_topic/ja 2026-05-27T11:53:46,372 copying build/lib/unitxt/catalog/templates/qa/multiple_choice/with_context/with_topic/ja/helm.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/templates/qa/multiple_choice/with_context/with_topic/ja 2026-05-27T11:53:46,374 copying build/lib/unitxt/catalog/templates/qa/multiple_choice/with_context/with_topic/ja/all.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/templates/qa/multiple_choice/with_context/with_topic/ja 2026-05-27T11:53:46,376 copying build/lib/unitxt/catalog/templates/qa/multiple_choice/with_context/with_topic/ja/lm_eval_harness.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/templates/qa/multiple_choice/with_context/with_topic/ja 2026-05-27T11:53:46,378 copying build/lib/unitxt/catalog/templates/qa/multiple_choice/with_context/with_topic/helm.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/templates/qa/multiple_choice/with_context/with_topic 2026-05-27T11:53:46,380 copying build/lib/unitxt/catalog/templates/qa/multiple_choice/with_context/with_topic/title.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/templates/qa/multiple_choice/with_context/with_topic 2026-05-27T11:53:46,382 creating build/bdist.linux-armv7l/wheel/unitxt/catalog/templates/qa/multiple_choice/with_context/with_topic/fr 2026-05-27T11:53:46,383 copying build/lib/unitxt/catalog/templates/qa/multiple_choice/with_context/with_topic/fr/mmlu.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/templates/qa/multiple_choice/with_context/with_topic/fr 2026-05-27T11:53:46,385 copying build/lib/unitxt/catalog/templates/qa/multiple_choice/with_context/with_topic/fr/helm.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/templates/qa/multiple_choice/with_context/with_topic/fr 2026-05-27T11:53:46,387 copying build/lib/unitxt/catalog/templates/qa/multiple_choice/with_context/with_topic/fr/all.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/templates/qa/multiple_choice/with_context/with_topic/fr 2026-05-27T11:53:46,388 copying build/lib/unitxt/catalog/templates/qa/multiple_choice/with_context/with_topic/fr/lm_eval_harness.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/templates/qa/multiple_choice/with_context/with_topic/fr 2026-05-27T11:53:46,390 copying build/lib/unitxt/catalog/templates/qa/multiple_choice/with_context/with_topic/match.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/templates/qa/multiple_choice/with_context/with_topic 2026-05-27T11:53:46,393 creating build/bdist.linux-armv7l/wheel/unitxt/catalog/templates/qa/multiple_choice/with_context/with_topic/de 2026-05-27T11:53:46,394 copying build/lib/unitxt/catalog/templates/qa/multiple_choice/with_context/with_topic/de/mmlu.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/templates/qa/multiple_choice/with_context/with_topic/de 2026-05-27T11:53:46,396 copying build/lib/unitxt/catalog/templates/qa/multiple_choice/with_context/with_topic/de/helm.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/templates/qa/multiple_choice/with_context/with_topic/de 2026-05-27T11:53:46,397 copying build/lib/unitxt/catalog/templates/qa/multiple_choice/with_context/with_topic/de/all.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/templates/qa/multiple_choice/with_context/with_topic/de 2026-05-27T11:53:46,399 copying build/lib/unitxt/catalog/templates/qa/multiple_choice/with_context/with_topic/de/lm_eval_harness.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/templates/qa/multiple_choice/with_context/with_topic/de 2026-05-27T11:53:46,401 creating build/bdist.linux-armv7l/wheel/unitxt/catalog/templates/qa/multiple_choice/with_context/with_topic/es 2026-05-27T11:53:46,402 copying build/lib/unitxt/catalog/templates/qa/multiple_choice/with_context/with_topic/es/mmlu.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/templates/qa/multiple_choice/with_context/with_topic/es 2026-05-27T11:53:46,404 copying build/lib/unitxt/catalog/templates/qa/multiple_choice/with_context/with_topic/es/helm.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/templates/qa/multiple_choice/with_context/with_topic/es 2026-05-27T11:53:46,406 copying build/lib/unitxt/catalog/templates/qa/multiple_choice/with_context/with_topic/es/all.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/templates/qa/multiple_choice/with_context/with_topic/es 2026-05-27T11:53:46,408 copying build/lib/unitxt/catalog/templates/qa/multiple_choice/with_context/with_topic/es/lm_eval_harness.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/templates/qa/multiple_choice/with_context/with_topic/es 2026-05-27T11:53:46,410 copying build/lib/unitxt/catalog/templates/qa/multiple_choice/with_context/with_topic/fm_eval.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/templates/qa/multiple_choice/with_context/with_topic 2026-05-27T11:53:46,412 copying build/lib/unitxt/catalog/templates/qa/multiple_choice/with_context/with_topic/all.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/templates/qa/multiple_choice/with_context/with_topic 2026-05-27T11:53:46,415 creating build/bdist.linux-armv7l/wheel/unitxt/catalog/templates/qa/multiple_choice/with_context/with_topic/pt 2026-05-27T11:53:46,416 copying build/lib/unitxt/catalog/templates/qa/multiple_choice/with_context/with_topic/pt/mmlu.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/templates/qa/multiple_choice/with_context/with_topic/pt 2026-05-27T11:53:46,419 copying build/lib/unitxt/catalog/templates/qa/multiple_choice/with_context/with_topic/pt/helm.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/templates/qa/multiple_choice/with_context/with_topic/pt 2026-05-27T11:53:46,421 copying build/lib/unitxt/catalog/templates/qa/multiple_choice/with_context/with_topic/pt/all.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/templates/qa/multiple_choice/with_context/with_topic/pt 2026-05-27T11:53:46,424 copying build/lib/unitxt/catalog/templates/qa/multiple_choice/with_context/with_topic/pt/lm_eval_harness.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/templates/qa/multiple_choice/with_context/with_topic/pt 2026-05-27T11:53:46,426 copying build/lib/unitxt/catalog/templates/qa/multiple_choice/with_context/with_topic/lm_eval_harness.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/templates/qa/multiple_choice/with_context/with_topic 2026-05-27T11:53:46,429 copying build/lib/unitxt/catalog/templates/qa/multiple_choice/with_context/exact_answer_instruct.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/templates/qa/multiple_choice/with_context 2026-05-27T11:53:46,431 copying build/lib/unitxt/catalog/templates/qa/multiple_choice/with_context/all.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/templates/qa/multiple_choice/with_context 2026-05-27T11:53:46,434 copying build/lib/unitxt/catalog/templates/qa/multiple_choice/with_context/lm_eval_harness.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/templates/qa/multiple_choice/with_context 2026-05-27T11:53:46,436 copying build/lib/unitxt/catalog/templates/qa/multiple_choice/helm.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/templates/qa/multiple_choice 2026-05-27T11:53:46,438 copying build/lib/unitxt/catalog/templates/qa/multiple_choice/title.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/templates/qa/multiple_choice 2026-05-27T11:53:46,441 copying build/lib/unitxt/catalog/templates/qa/multiple_choice/match.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/templates/qa/multiple_choice 2026-05-27T11:53:46,444 creating build/bdist.linux-armv7l/wheel/unitxt/catalog/templates/qa/multiple_choice/open 2026-05-27T11:53:46,445 copying build/lib/unitxt/catalog/templates/qa/multiple_choice/open/mmlu.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/templates/qa/multiple_choice/open 2026-05-27T11:53:46,448 creating build/bdist.linux-armv7l/wheel/unitxt/catalog/templates/qa/multiple_choice/open/ja 2026-05-27T11:53:46,449 copying build/lib/unitxt/catalog/templates/qa/multiple_choice/open/ja/mmlu.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/templates/qa/multiple_choice/open/ja 2026-05-27T11:53:46,452 copying build/lib/unitxt/catalog/templates/qa/multiple_choice/open/ja/helm.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/templates/qa/multiple_choice/open/ja 2026-05-27T11:53:46,454 copying build/lib/unitxt/catalog/templates/qa/multiple_choice/open/ja/all.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/templates/qa/multiple_choice/open/ja 2026-05-27T11:53:46,457 copying build/lib/unitxt/catalog/templates/qa/multiple_choice/open/ja/lm_eval_harness.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/templates/qa/multiple_choice/open/ja 2026-05-27T11:53:46,459 copying build/lib/unitxt/catalog/templates/qa/multiple_choice/open/helm.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/templates/qa/multiple_choice/open 2026-05-27T11:53:46,462 creating build/bdist.linux-armv7l/wheel/unitxt/catalog/templates/qa/multiple_choice/open/fr 2026-05-27T11:53:46,464 copying build/lib/unitxt/catalog/templates/qa/multiple_choice/open/fr/mmlu.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/templates/qa/multiple_choice/open/fr 2026-05-27T11:53:46,466 copying build/lib/unitxt/catalog/templates/qa/multiple_choice/open/fr/helm.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/templates/qa/multiple_choice/open/fr 2026-05-27T11:53:46,469 copying build/lib/unitxt/catalog/templates/qa/multiple_choice/open/fr/all.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/templates/qa/multiple_choice/open/fr 2026-05-27T11:53:46,471 copying build/lib/unitxt/catalog/templates/qa/multiple_choice/open/fr/lm_eval_harness.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/templates/qa/multiple_choice/open/fr 2026-05-27T11:53:46,473 copying build/lib/unitxt/catalog/templates/qa/multiple_choice/open/bluebench.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/templates/qa/multiple_choice/open 2026-05-27T11:53:46,477 creating build/bdist.linux-armv7l/wheel/unitxt/catalog/templates/qa/multiple_choice/open/de 2026-05-27T11:53:46,478 copying build/lib/unitxt/catalog/templates/qa/multiple_choice/open/de/mmlu.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/templates/qa/multiple_choice/open/de 2026-05-27T11:53:46,481 copying build/lib/unitxt/catalog/templates/qa/multiple_choice/open/de/helm.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/templates/qa/multiple_choice/open/de 2026-05-27T11:53:46,484 copying build/lib/unitxt/catalog/templates/qa/multiple_choice/open/de/all.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/templates/qa/multiple_choice/open/de 2026-05-27T11:53:46,486 copying build/lib/unitxt/catalog/templates/qa/multiple_choice/open/de/lm_eval_harness.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/templates/qa/multiple_choice/open/de 2026-05-27T11:53:46,489 creating build/bdist.linux-armv7l/wheel/unitxt/catalog/templates/qa/multiple_choice/open/es 2026-05-27T11:53:46,490 copying build/lib/unitxt/catalog/templates/qa/multiple_choice/open/es/mmlu.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/templates/qa/multiple_choice/open/es 2026-05-27T11:53:46,493 copying build/lib/unitxt/catalog/templates/qa/multiple_choice/open/es/helm.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/templates/qa/multiple_choice/open/es 2026-05-27T11:53:46,495 copying build/lib/unitxt/catalog/templates/qa/multiple_choice/open/es/all.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/templates/qa/multiple_choice/open/es 2026-05-27T11:53:46,497 copying build/lib/unitxt/catalog/templates/qa/multiple_choice/open/es/lm_eval_harness.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/templates/qa/multiple_choice/open/es 2026-05-27T11:53:46,500 copying build/lib/unitxt/catalog/templates/qa/multiple_choice/open/all.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/templates/qa/multiple_choice/open 2026-05-27T11:53:46,502 creating build/bdist.linux-armv7l/wheel/unitxt/catalog/templates/qa/multiple_choice/open/pt 2026-05-27T11:53:46,504 copying build/lib/unitxt/catalog/templates/qa/multiple_choice/open/pt/mmlu.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/templates/qa/multiple_choice/open/pt 2026-05-27T11:53:46,506 copying build/lib/unitxt/catalog/templates/qa/multiple_choice/open/pt/helm.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/templates/qa/multiple_choice/open/pt 2026-05-27T11:53:46,509 copying build/lib/unitxt/catalog/templates/qa/multiple_choice/open/pt/all.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/templates/qa/multiple_choice/open/pt 2026-05-27T11:53:46,511 copying build/lib/unitxt/catalog/templates/qa/multiple_choice/open/pt/lm_eval_harness.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/templates/qa/multiple_choice/open/pt 2026-05-27T11:53:46,513 copying build/lib/unitxt/catalog/templates/qa/multiple_choice/open/lm_eval_harness.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/templates/qa/multiple_choice/open 2026-05-27T11:53:46,516 creating build/bdist.linux-armv7l/wheel/unitxt/catalog/templates/qa/multiple_choice/with_topic 2026-05-27T11:53:46,517 copying build/lib/unitxt/catalog/templates/qa/multiple_choice/with_topic/mmlu.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/templates/qa/multiple_choice/with_topic 2026-05-27T11:53:46,519 creating build/bdist.linux-armv7l/wheel/unitxt/catalog/templates/qa/multiple_choice/with_topic/ja 2026-05-27T11:53:46,521 copying build/lib/unitxt/catalog/templates/qa/multiple_choice/with_topic/ja/mmlu.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/templates/qa/multiple_choice/with_topic/ja 2026-05-27T11:53:46,523 copying build/lib/unitxt/catalog/templates/qa/multiple_choice/with_topic/ja/helm.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/templates/qa/multiple_choice/with_topic/ja 2026-05-27T11:53:46,525 copying build/lib/unitxt/catalog/templates/qa/multiple_choice/with_topic/ja/all.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/templates/qa/multiple_choice/with_topic/ja 2026-05-27T11:53:46,527 copying build/lib/unitxt/catalog/templates/qa/multiple_choice/with_topic/ja/lm_eval_harness.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/templates/qa/multiple_choice/with_topic/ja 2026-05-27T11:53:46,529 copying build/lib/unitxt/catalog/templates/qa/multiple_choice/with_topic/helm.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/templates/qa/multiple_choice/with_topic 2026-05-27T11:53:46,531 copying build/lib/unitxt/catalog/templates/qa/multiple_choice/with_topic/title.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/templates/qa/multiple_choice/with_topic 2026-05-27T11:53:46,533 creating build/bdist.linux-armv7l/wheel/unitxt/catalog/templates/qa/multiple_choice/with_topic/fr 2026-05-27T11:53:46,534 copying build/lib/unitxt/catalog/templates/qa/multiple_choice/with_topic/fr/mmlu.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/templates/qa/multiple_choice/with_topic/fr 2026-05-27T11:53:46,536 copying build/lib/unitxt/catalog/templates/qa/multiple_choice/with_topic/fr/helm.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/templates/qa/multiple_choice/with_topic/fr 2026-05-27T11:53:46,538 copying build/lib/unitxt/catalog/templates/qa/multiple_choice/with_topic/fr/all.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/templates/qa/multiple_choice/with_topic/fr 2026-05-27T11:53:46,540 copying build/lib/unitxt/catalog/templates/qa/multiple_choice/with_topic/fr/lm_eval_harness.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/templates/qa/multiple_choice/with_topic/fr 2026-05-27T11:53:46,542 copying build/lib/unitxt/catalog/templates/qa/multiple_choice/with_topic/bluebench.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/templates/qa/multiple_choice/with_topic 2026-05-27T11:53:46,544 copying build/lib/unitxt/catalog/templates/qa/multiple_choice/with_topic/match.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/templates/qa/multiple_choice/with_topic 2026-05-27T11:53:46,546 creating build/bdist.linux-armv7l/wheel/unitxt/catalog/templates/qa/multiple_choice/with_topic/de 2026-05-27T11:53:46,548 copying build/lib/unitxt/catalog/templates/qa/multiple_choice/with_topic/de/mmlu.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/templates/qa/multiple_choice/with_topic/de 2026-05-27T11:53:46,550 copying build/lib/unitxt/catalog/templates/qa/multiple_choice/with_topic/de/helm.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/templates/qa/multiple_choice/with_topic/de 2026-05-27T11:53:46,552 copying build/lib/unitxt/catalog/templates/qa/multiple_choice/with_topic/de/all.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/templates/qa/multiple_choice/with_topic/de 2026-05-27T11:53:46,554 copying build/lib/unitxt/catalog/templates/qa/multiple_choice/with_topic/de/lm_eval_harness.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/templates/qa/multiple_choice/with_topic/de 2026-05-27T11:53:46,557 creating build/bdist.linux-armv7l/wheel/unitxt/catalog/templates/qa/multiple_choice/with_topic/es 2026-05-27T11:53:46,558 copying build/lib/unitxt/catalog/templates/qa/multiple_choice/with_topic/es/mmlu.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/templates/qa/multiple_choice/with_topic/es 2026-05-27T11:53:46,560 copying build/lib/unitxt/catalog/templates/qa/multiple_choice/with_topic/es/helm.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/templates/qa/multiple_choice/with_topic/es 2026-05-27T11:53:46,562 copying build/lib/unitxt/catalog/templates/qa/multiple_choice/with_topic/es/all.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/templates/qa/multiple_choice/with_topic/es 2026-05-27T11:53:46,564 copying build/lib/unitxt/catalog/templates/qa/multiple_choice/with_topic/es/lm_eval_harness.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/templates/qa/multiple_choice/with_topic/es 2026-05-27T11:53:46,566 copying build/lib/unitxt/catalog/templates/qa/multiple_choice/with_topic/fm_eval.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/templates/qa/multiple_choice/with_topic 2026-05-27T11:53:46,568 copying build/lib/unitxt/catalog/templates/qa/multiple_choice/with_topic/all.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/templates/qa/multiple_choice/with_topic 2026-05-27T11:53:46,571 creating build/bdist.linux-armv7l/wheel/unitxt/catalog/templates/qa/multiple_choice/with_topic/pt 2026-05-27T11:53:46,572 copying build/lib/unitxt/catalog/templates/qa/multiple_choice/with_topic/pt/mmlu.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/templates/qa/multiple_choice/with_topic/pt 2026-05-27T11:53:46,574 copying build/lib/unitxt/catalog/templates/qa/multiple_choice/with_topic/pt/helm.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/templates/qa/multiple_choice/with_topic/pt 2026-05-27T11:53:46,576 copying build/lib/unitxt/catalog/templates/qa/multiple_choice/with_topic/pt/all.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/templates/qa/multiple_choice/with_topic/pt 2026-05-27T11:53:46,577 copying build/lib/unitxt/catalog/templates/qa/multiple_choice/with_topic/pt/lm_eval_harness.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/templates/qa/multiple_choice/with_topic/pt 2026-05-27T11:53:46,579 copying build/lib/unitxt/catalog/templates/qa/multiple_choice/with_topic/lm_eval_harness.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/templates/qa/multiple_choice/with_topic 2026-05-27T11:53:46,581 copying build/lib/unitxt/catalog/templates/qa/multiple_choice/lm_eval_harness.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/templates/qa/multiple_choice 2026-05-27T11:53:46,582 copying build/lib/unitxt/catalog/templates/qa/extractive.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/templates/qa 2026-05-27T11:53:46,584 copying build/lib/unitxt/catalog/templates/qa/with_context.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/templates/qa 2026-05-27T11:53:46,586 creating build/bdist.linux-armv7l/wheel/unitxt/catalog/templates/qa/open 2026-05-27T11:53:46,587 copying build/lib/unitxt/catalog/templates/qa/open/title.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/templates/qa/open 2026-05-27T11:53:46,589 copying build/lib/unitxt/catalog/templates/qa/open/empty.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/templates/qa/open 2026-05-27T11:53:46,591 copying build/lib/unitxt/catalog/templates/qa/open/simple2.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/templates/qa/open 2026-05-27T11:53:46,593 copying build/lib/unitxt/catalog/templates/qa/open/simple.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/templates/qa/open 2026-05-27T11:53:46,595 copying build/lib/unitxt/catalog/templates/qa/open/all.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/templates/qa/open 2026-05-27T11:53:46,597 creating build/bdist.linux-armv7l/wheel/unitxt/catalog/templates/qa/llama_vision 2026-05-27T11:53:46,599 creating build/bdist.linux-armv7l/wheel/unitxt/catalog/templates/qa/llama_vision/with_context 2026-05-27T11:53:46,600 copying build/lib/unitxt/catalog/templates/qa/llama_vision/with_context/info_vqa.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/templates/qa/llama_vision/with_context 2026-05-27T11:53:46,602 copying build/lib/unitxt/catalog/templates/qa/llama_vision/with_context/doc_vqa.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/templates/qa/llama_vision/with_context 2026-05-27T11:53:46,604 copying build/lib/unitxt/catalog/templates/qa/llama_vision/with_context/chart_qa.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/templates/qa/llama_vision/with_context 2026-05-27T11:53:46,607 creating build/bdist.linux-armv7l/wheel/unitxt/catalog/templates/qa/llama_vision/multiple_choice 2026-05-27T11:53:46,608 creating build/bdist.linux-armv7l/wheel/unitxt/catalog/templates/qa/llama_vision/multiple_choice/with_context 2026-05-27T11:53:46,610 copying build/lib/unitxt/catalog/templates/qa/llama_vision/multiple_choice/with_context/ai2d.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/templates/qa/llama_vision/multiple_choice/with_context 2026-05-27T11:53:46,612 creating build/bdist.linux-armv7l/wheel/unitxt/catalog/templates/qa/multi_turn 2026-05-27T11:53:46,614 creating build/bdist.linux-armv7l/wheel/unitxt/catalog/templates/qa/multi_turn/with_context 2026-05-27T11:53:46,615 copying build/lib/unitxt/catalog/templates/qa/multi_turn/with_context/simple.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/templates/qa/multi_turn/with_context 2026-05-27T11:53:46,618 creating build/bdist.linux-armv7l/wheel/unitxt/catalog/templates/selection 2026-05-27T11:53:46,619 creating build/bdist.linux-armv7l/wheel/unitxt/catalog/templates/selection/by_attribute 2026-05-27T11:53:46,620 copying build/lib/unitxt/catalog/templates/selection/by_attribute/default.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/templates/selection/by_attribute 2026-05-27T11:53:46,622 copying build/lib/unitxt/catalog/templates/selection/by_attribute/all.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/templates/selection/by_attribute 2026-05-27T11:53:46,625 creating build/bdist.linux-armv7l/wheel/unitxt/catalog/templates/grammatical_error_correction 2026-05-27T11:53:46,626 copying build/lib/unitxt/catalog/templates/grammatical_error_correction/simple.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/templates/grammatical_error_correction 2026-05-27T11:53:46,628 copying build/lib/unitxt/catalog/templates/grammatical_error_correction/all.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/templates/grammatical_error_correction 2026-05-27T11:53:46,630 creating build/bdist.linux-armv7l/wheel/unitxt/catalog/templates/key_value_extraction 2026-05-27T11:53:46,632 copying build/lib/unitxt/catalog/templates/key_value_extraction/extract_in_json_format.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/templates/key_value_extraction 2026-05-27T11:53:46,634 creating build/bdist.linux-armv7l/wheel/unitxt/catalog/templates/evaluation 2026-05-27T11:53:46,636 creating build/bdist.linux-armv7l/wheel/unitxt/catalog/templates/evaluation/preference 2026-05-27T11:53:46,637 copying build/lib/unitxt/catalog/templates/evaluation/preference/default.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/templates/evaluation/preference 2026-05-27T11:53:46,640 copying build/lib/unitxt/catalog/templates/evaluation/preference/all.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/templates/evaluation/preference 2026-05-27T11:53:46,642 creating build/bdist.linux-armv7l/wheel/unitxt/catalog/templates/targeted_sentiment_extraction 2026-05-27T11:53:46,644 creating build/bdist.linux-armv7l/wheel/unitxt/catalog/templates/targeted_sentiment_extraction/positive 2026-05-27T11:53:46,645 copying build/lib/unitxt/catalog/templates/targeted_sentiment_extraction/positive/empty.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/templates/targeted_sentiment_extraction/positive 2026-05-27T11:53:46,647 copying build/lib/unitxt/catalog/templates/targeted_sentiment_extraction/positive/sentiment_extracted.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/templates/targeted_sentiment_extraction/positive 2026-05-27T11:53:46,649 copying build/lib/unitxt/catalog/templates/targeted_sentiment_extraction/positive/having_sentiment.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/templates/targeted_sentiment_extraction/positive 2026-05-27T11:53:46,650 copying build/lib/unitxt/catalog/templates/targeted_sentiment_extraction/positive/all.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/templates/targeted_sentiment_extraction/positive 2026-05-27T11:53:46,653 creating build/bdist.linux-armv7l/wheel/unitxt/catalog/templates/targeted_sentiment_extraction/as_json 2026-05-27T11:53:46,654 copying build/lib/unitxt/catalog/templates/targeted_sentiment_extraction/as_json/convert_with_explicit_keys.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/templates/targeted_sentiment_extraction/as_json 2026-05-27T11:53:46,656 copying build/lib/unitxt/catalog/templates/targeted_sentiment_extraction/as_json/empty.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/templates/targeted_sentiment_extraction/as_json 2026-05-27T11:53:46,658 copying build/lib/unitxt/catalog/templates/targeted_sentiment_extraction/as_json/convert_with_implicit_keys.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/templates/targeted_sentiment_extraction/as_json 2026-05-27T11:53:46,661 creating build/bdist.linux-armv7l/wheel/unitxt/catalog/templates/targeted_sentiment_extraction/neutral 2026-05-27T11:53:46,662 copying build/lib/unitxt/catalog/templates/targeted_sentiment_extraction/neutral/empty.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/templates/targeted_sentiment_extraction/neutral 2026-05-27T11:53:46,664 copying build/lib/unitxt/catalog/templates/targeted_sentiment_extraction/neutral/sentiment_extracted.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/templates/targeted_sentiment_extraction/neutral 2026-05-27T11:53:46,665 copying build/lib/unitxt/catalog/templates/targeted_sentiment_extraction/neutral/having_sentiment.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/templates/targeted_sentiment_extraction/neutral 2026-05-27T11:53:46,667 copying build/lib/unitxt/catalog/templates/targeted_sentiment_extraction/neutral/all.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/templates/targeted_sentiment_extraction/neutral 2026-05-27T11:53:46,669 copying build/lib/unitxt/catalog/templates/targeted_sentiment_extraction/carry_sentiment.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/templates/targeted_sentiment_extraction 2026-05-27T11:53:46,671 copying build/lib/unitxt/catalog/templates/targeted_sentiment_extraction/entities_sentiment.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/templates/targeted_sentiment_extraction 2026-05-27T11:53:46,673 copying build/lib/unitxt/catalog/templates/targeted_sentiment_extraction/empty.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/templates/targeted_sentiment_extraction 2026-05-27T11:53:46,676 creating build/bdist.linux-armv7l/wheel/unitxt/catalog/templates/targeted_sentiment_extraction/negative 2026-05-27T11:53:46,677 copying build/lib/unitxt/catalog/templates/targeted_sentiment_extraction/negative/empty.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/templates/targeted_sentiment_extraction/negative 2026-05-27T11:53:46,680 copying build/lib/unitxt/catalog/templates/targeted_sentiment_extraction/negative/sentiment_extracted.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/templates/targeted_sentiment_extraction/negative 2026-05-27T11:53:46,682 copying build/lib/unitxt/catalog/templates/targeted_sentiment_extraction/negative/having_sentiment.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/templates/targeted_sentiment_extraction/negative 2026-05-27T11:53:46,684 copying build/lib/unitxt/catalog/templates/targeted_sentiment_extraction/negative/all.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/templates/targeted_sentiment_extraction/negative 2026-05-27T11:53:46,685 copying build/lib/unitxt/catalog/templates/targeted_sentiment_extraction/extract_sentiment.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/templates/targeted_sentiment_extraction 2026-05-27T11:53:46,687 copying build/lib/unitxt/catalog/templates/targeted_sentiment_extraction/having_sentiment.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/templates/targeted_sentiment_extraction 2026-05-27T11:53:46,689 copying build/lib/unitxt/catalog/templates/targeted_sentiment_extraction/all.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/templates/targeted_sentiment_extraction 2026-05-27T11:53:46,692 creating build/bdist.linux-armv7l/wheel/unitxt/catalog/templates/completion 2026-05-27T11:53:46,693 creating build/bdist.linux-armv7l/wheel/unitxt/catalog/templates/completion/multiple_choice 2026-05-27T11:53:46,695 copying build/lib/unitxt/catalog/templates/completion/multiple_choice/enumerated.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/templates/completion/multiple_choice 2026-05-27T11:53:46,697 copying build/lib/unitxt/catalog/templates/completion/multiple_choice/title.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/templates/completion/multiple_choice 2026-05-27T11:53:46,699 copying build/lib/unitxt/catalog/templates/completion/multiple_choice/bluebench.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/templates/completion/multiple_choice 2026-05-27T11:53:46,701 copying build/lib/unitxt/catalog/templates/completion/multiple_choice/standard.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/templates/completion/multiple_choice 2026-05-27T11:53:46,702 copying build/lib/unitxt/catalog/templates/completion/multiple_choice/simple.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/templates/completion/multiple_choice 2026-05-27T11:53:46,704 copying build/lib/unitxt/catalog/templates/completion/multiple_choice/all.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/templates/completion/multiple_choice 2026-05-27T11:53:46,706 creating build/bdist.linux-armv7l/wheel/unitxt/catalog/templates/completion/abstractive 2026-05-27T11:53:46,707 copying build/lib/unitxt/catalog/templates/completion/abstractive/empty.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/templates/completion/abstractive 2026-05-27T11:53:46,709 copying build/lib/unitxt/catalog/templates/completion/abstractive/standard.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/templates/completion/abstractive 2026-05-27T11:53:46,712 copying build/lib/unitxt/catalog/templates/completion/abstractive/all.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/templates/completion/abstractive 2026-05-27T11:53:46,714 creating build/bdist.linux-armv7l/wheel/unitxt/catalog/templates/span_labeling 2026-05-27T11:53:46,716 creating build/bdist.linux-armv7l/wheel/unitxt/catalog/templates/span_labeling/extraction 2026-05-27T11:53:46,717 copying build/lib/unitxt/catalog/templates/span_labeling/extraction/having.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/templates/span_labeling/extraction 2026-05-27T11:53:46,719 copying build/lib/unitxt/catalog/templates/span_labeling/extraction/identify.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/templates/span_labeling/extraction 2026-05-27T11:53:46,722 copying build/lib/unitxt/catalog/templates/span_labeling/extraction/carry.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/templates/span_labeling/extraction 2026-05-27T11:53:46,724 copying build/lib/unitxt/catalog/templates/span_labeling/extraction/title.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/templates/span_labeling/extraction 2026-05-27T11:53:46,726 copying build/lib/unitxt/catalog/templates/span_labeling/extraction/empty.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/templates/span_labeling/extraction 2026-05-27T11:53:46,727 copying build/lib/unitxt/catalog/templates/span_labeling/extraction/extract.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/templates/span_labeling/extraction 2026-05-27T11:53:46,729 copying build/lib/unitxt/catalog/templates/span_labeling/extraction/detailed.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/templates/span_labeling/extraction 2026-05-27T11:53:46,731 copying build/lib/unitxt/catalog/templates/span_labeling/extraction/all.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/templates/span_labeling/extraction 2026-05-27T11:53:46,734 creating build/bdist.linux-armv7l/wheel/unitxt/catalog/templates/regression 2026-05-27T11:53:46,735 creating build/bdist.linux-armv7l/wheel/unitxt/catalog/templates/regression/single_text 2026-05-27T11:53:46,737 copying build/lib/unitxt/catalog/templates/regression/single_text/title.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/templates/regression/single_text 2026-05-27T11:53:46,739 copying build/lib/unitxt/catalog/templates/regression/single_text/simple.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/templates/regression/single_text 2026-05-27T11:53:46,740 copying build/lib/unitxt/catalog/templates/regression/single_text/all.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/templates/regression/single_text 2026-05-27T11:53:46,743 creating build/bdist.linux-armv7l/wheel/unitxt/catalog/templates/regression/two_texts 2026-05-27T11:53:46,744 creating build/bdist.linux-armv7l/wheel/unitxt/catalog/templates/regression/two_texts/similarity 2026-05-27T11:53:46,746 copying build/lib/unitxt/catalog/templates/regression/two_texts/similarity/flan.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/templates/regression/two_texts/similarity 2026-05-27T11:53:46,748 copying build/lib/unitxt/catalog/templates/regression/two_texts/title.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/templates/regression/two_texts 2026-05-27T11:53:46,750 copying build/lib/unitxt/catalog/templates/regression/two_texts/simple.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/templates/regression/two_texts 2026-05-27T11:53:46,752 copying build/lib/unitxt/catalog/templates/regression/two_texts/all.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/templates/regression/two_texts 2026-05-27T11:53:46,755 creating build/bdist.linux-armv7l/wheel/unitxt/catalog/operators 2026-05-27T11:53:46,757 copying build/lib/unitxt/catalog/operators/extract_arena_hard_numerical_judgment.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/operators 2026-05-27T11:53:46,759 copying build/lib/unitxt/catalog/operators/convert_to_boolean.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/operators 2026-05-27T11:53:46,760 copying build/lib/unitxt/catalog/operators/capitalize.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/operators 2026-05-27T11:53:46,762 copying build/lib/unitxt/catalog/operators/toxic_or_not_toxic.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/operators 2026-05-27T11:53:46,764 copying build/lib/unitxt/catalog/operators/upper_case.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/operators 2026-05-27T11:53:46,766 copying build/lib/unitxt/catalog/operators/cast_to_float_return_zero_if_failed.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/operators 2026-05-27T11:53:46,768 creating build/bdist.linux-armv7l/wheel/unitxt/catalog/operators/balancers 2026-05-27T11:53:46,770 creating build/bdist.linux-armv7l/wheel/unitxt/catalog/operators/balancers/classification 2026-05-27T11:53:46,771 copying build/lib/unitxt/catalog/operators/balancers/classification/minimum_one_example_per_class.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/operators/balancers/classification 2026-05-27T11:53:46,773 copying build/lib/unitxt/catalog/operators/balancers/classification/by_label.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/operators/balancers/classification 2026-05-27T11:53:46,776 creating build/bdist.linux-armv7l/wheel/unitxt/catalog/operators/balancers/ner 2026-05-27T11:53:46,777 copying build/lib/unitxt/catalog/operators/balancers/ner/zero_vs_many_entities.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/operators/balancers/ner 2026-05-27T11:53:46,779 creating build/bdist.linux-armv7l/wheel/unitxt/catalog/operators/balancers/qa 2026-05-27T11:53:46,780 copying build/lib/unitxt/catalog/operators/balancers/qa/by_answer.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/operators/balancers/qa 2026-05-27T11:53:46,783 creating build/bdist.linux-armv7l/wheel/unitxt/catalog/operators/balancers/multi_label 2026-05-27T11:53:46,784 copying build/lib/unitxt/catalog/operators/balancers/multi_label/zero_vs_many_labels.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/operators/balancers/multi_label 2026-05-27T11:53:46,786 copying build/lib/unitxt/catalog/operators/to_yes_or_none.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/operators 2026-05-27T11:53:46,788 copying build/lib/unitxt/catalog/operators/cast_to_float_return_0_5_if_failed.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/operators 2026-05-27T11:53:46,790 copying build/lib/unitxt/catalog/operators/hate_speech_or_not_hate_speech.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/operators 2026-05-27T11:53:46,792 copying build/lib/unitxt/catalog/operators/yes_no_to_int.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/operators 2026-05-27T11:53:46,794 copying build/lib/unitxt/catalog/operators/substring.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/operators 2026-05-27T11:53:46,796 copying build/lib/unitxt/catalog/operators/take_first_word.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/operators 2026-05-27T11:53:46,798 copying build/lib/unitxt/catalog/operators/remove_articles.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/operators 2026-05-27T11:53:46,799 copying build/lib/unitxt/catalog/operators/match_closest_option.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/operators 2026-05-27T11:53:46,801 copying build/lib/unitxt/catalog/operators/arena_hard_hf_space_processing_steps.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/operators 2026-05-27T11:53:46,804 copying build/lib/unitxt/catalog/operators/extract_mt_bench_rating_judgment.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/operators 2026-05-27T11:53:46,805 copying build/lib/unitxt/catalog/operators/predictions_yes_1_else_0.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/operators 2026-05-27T11:53:46,807 copying build/lib/unitxt/catalog/operators/fix_whitespace.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/operators 2026-05-27T11:53:46,809 copying build/lib/unitxt/catalog/operators/str_to_float_format.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/operators 2026-05-27T11:53:46,811 copying build/lib/unitxt/catalog/operators/take_first_non_empty_line.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/operators 2026-05-27T11:53:46,813 copying build/lib/unitxt/catalog/operators/extract_harm_rating_judgment.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/operators 2026-05-27T11:53:46,814 copying build/lib/unitxt/catalog/operators/cast_to_float_return_nan_if_failed.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/operators 2026-05-27T11:53:46,816 copying build/lib/unitxt/catalog/operators/take_last_non_empty_line.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/operators 2026-05-27T11:53:46,818 copying build/lib/unitxt/catalog/operators/extract_mt_bench_label_judgment.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/operators 2026-05-27T11:53:46,821 copying build/lib/unitxt/catalog/operators/scale_0_10_to_0_1.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/operators 2026-05-27T11:53:46,822 copying build/lib/unitxt/catalog/operators/fix_json_schema.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/operators 2026-05-27T11:53:46,824 copying build/lib/unitxt/catalog/operators/lower_case_till_punc.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/operators 2026-05-27T11:53:46,826 copying build/lib/unitxt/catalog/operators/literal_eval.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/operators 2026-05-27T11:53:46,829 creating build/bdist.linux-armv7l/wheel/unitxt/catalog/operators/mt_bench 2026-05-27T11:53:46,830 copying build/lib/unitxt/catalog/operators/mt_bench/pairwise_hf_space_processing_steps.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/operators/mt_bench 2026-05-27T11:53:46,832 copying build/lib/unitxt/catalog/operators/mt_bench/rating_hf_space_processing_steps.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/operators/mt_bench 2026-05-27T11:53:46,834 copying build/lib/unitxt/catalog/operators/remove_none_from_list.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/operators 2026-05-27T11:53:46,836 copying build/lib/unitxt/catalog/operators/lower_case.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/operators 2026-05-27T11:53:46,838 copying build/lib/unitxt/catalog/operators/get_string_after_colon.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/operators 2026-05-27T11:53:46,840 copying build/lib/unitxt/catalog/operators/extract_verbal_judgement_bad_good.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/operators 2026-05-27T11:53:46,842 copying build/lib/unitxt/catalog/operators/remove_punctuations.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/operators 2026-05-27T11:53:46,844 copying build/lib/unitxt/catalog/operators/regex_parser.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/operators 2026-05-27T11:53:46,846 copying build/lib/unitxt/catalog/operators/extract_verbal_judgement.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/operators 2026-05-27T11:53:46,848 copying build/lib/unitxt/catalog/operators/stance_to_pro_con.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/operators 2026-05-27T11:53:46,850 copying build/lib/unitxt/catalog/operators/extract_from_double_brackets.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/operators 2026-05-27T11:53:46,851 copying build/lib/unitxt/catalog/operators/first_character.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/operators 2026-05-27T11:53:46,854 creating build/bdist.linux-armv7l/wheel/unitxt/catalog/system_prompts 2026-05-27T11:53:46,855 creating build/bdist.linux-armv7l/wheel/unitxt/catalog/system_prompts/general 2026-05-27T11:53:46,856 copying build/lib/unitxt/catalog/system_prompts/general/be_concise.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/system_prompts/general 2026-05-27T11:53:46,859 creating build/bdist.linux-armv7l/wheel/unitxt/catalog/system_prompts/model 2026-05-27T11:53:46,860 copying build/lib/unitxt/catalog/system_prompts/model/granite.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/system_prompts/model 2026-05-27T11:53:46,862 creating build/bdist.linux-armv7l/wheel/unitxt/catalog/system_prompts/models 2026-05-27T11:53:46,863 copying build/lib/unitxt/catalog/system_prompts/models/llava_next_llama3_8b.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/system_prompts/models 2026-05-27T11:53:46,865 copying build/lib/unitxt/catalog/system_prompts/models/llama.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/system_prompts/models 2026-05-27T11:53:46,867 copying build/lib/unitxt/catalog/system_prompts/models/labradorite.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/system_prompts/models 2026-05-27T11:53:46,869 copying build/lib/unitxt/catalog/system_prompts/models/japanese_llama.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/system_prompts/models 2026-05-27T11:53:46,871 copying build/lib/unitxt/catalog/system_prompts/models/deepseek_coder.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/system_prompts/models 2026-05-27T11:53:46,873 copying build/lib/unitxt/catalog/system_prompts/models/alpaca.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/system_prompts/models 2026-05-27T11:53:46,875 copying build/lib/unitxt/catalog/system_prompts/models/llama2.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/system_prompts/models 2026-05-27T11:53:46,877 copying build/lib/unitxt/catalog/system_prompts/empty.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/system_prompts 2026-05-27T11:53:46,878 copying build/lib/unitxt/catalog/system_prompts/boolqa.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/system_prompts 2026-05-27T11:53:46,881 creating build/bdist.linux-armv7l/wheel/unitxt/catalog/engines 2026-05-27T11:53:46,882 creating build/bdist.linux-armv7l/wheel/unitxt/catalog/engines/openai 2026-05-27T11:53:46,884 copying build/lib/unitxt/catalog/engines/openai/gpt_4o.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/engines/openai 2026-05-27T11:53:46,886 creating build/bdist.linux-armv7l/wheel/unitxt/catalog/engines/ollama 2026-05-27T11:53:46,887 copying build/lib/unitxt/catalog/engines/ollama/llama2.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/engines/ollama 2026-05-27T11:53:46,890 creating build/bdist.linux-armv7l/wheel/unitxt/catalog/engines/cross_provider 2026-05-27T11:53:46,891 copying build/lib/unitxt/catalog/engines/cross_provider/llama_3_8b_instruct.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/engines/cross_provider 2026-05-27T11:53:46,893 copying build/lib/unitxt/catalog/engines/cross_provider/llama_3_70b_instruct.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/engines/cross_provider 2026-05-27T11:53:46,895 creating build/bdist.linux-armv7l/wheel/unitxt/catalog/engines/model 2026-05-27T11:53:46,896 copying build/lib/unitxt/catalog/engines/model/llama_3_8b_instruct.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/engines/model 2026-05-27T11:53:46,899 creating build/bdist.linux-armv7l/wheel/unitxt/catalog/engines/model/flan 2026-05-27T11:53:46,901 creating build/bdist.linux-armv7l/wheel/unitxt/catalog/engines/model/flan/t5_small 2026-05-27T11:53:46,902 copying build/lib/unitxt/catalog/engines/model/flan/t5_small/hf.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/engines/model/flan/t5_small 2026-05-27T11:53:46,905 creating build/bdist.linux-armv7l/wheel/unitxt/catalog/engines/classification 2026-05-27T11:53:46,906 copying build/lib/unitxt/catalog/engines/classification/llama_3_1_70b_instruct_wml.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/engines/classification 2026-05-27T11:53:46,908 copying build/lib/unitxt/catalog/engines/classification/gpt_4o_2024_08_06_azure_openai.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/engines/classification 2026-05-27T11:53:46,910 copying build/lib/unitxt/catalog/engines/classification/gpt_oss_120b_rits.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/engines/classification 2026-05-27T11:53:46,912 copying build/lib/unitxt/catalog/engines/classification/llama_4_maverick_17b_128e_instruct_fp8_watsonx.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/engines/classification 2026-05-27T11:53:46,914 copying build/lib/unitxt/catalog/engines/classification/llama_3_405b_instruct_wml.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/engines/classification 2026-05-27T11:53:46,916 copying build/lib/unitxt/catalog/engines/classification/llama_3_3_70b_instruct_wml.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/engines/classification 2026-05-27T11:53:46,918 copying build/lib/unitxt/catalog/engines/classification/mistral_large_watsonx.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/engines/classification 2026-05-27T11:53:46,920 copying build/lib/unitxt/catalog/engines/classification/llama3_3_ollama.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/engines/classification 2026-05-27T11:53:46,922 copying build/lib/unitxt/catalog/engines/classification/llama_4_maverick_17b_128e_instruct_fp8_rits.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/engines/classification 2026-05-27T11:53:46,924 copying build/lib/unitxt/catalog/engines/classification/mistral_small_3_1_24b_instruct_2503_wml.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/engines/classification 2026-05-27T11:53:46,925 copying build/lib/unitxt/catalog/engines/classification/llama_3_3_70b_instruct_watsonx.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/engines/classification 2026-05-27T11:53:46,928 copying build/lib/unitxt/catalog/engines/classification/mistral_large_instruct_2407_rits.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/engines/classification 2026-05-27T11:53:46,929 copying build/lib/unitxt/catalog/engines/classification/gpt_4_turbo_open_ai.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/engines/classification 2026-05-27T11:53:46,931 copying build/lib/unitxt/catalog/engines/classification/mixtral_8x7b_instruct_v01_wml.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/engines/classification 2026-05-27T11:53:46,933 copying build/lib/unitxt/catalog/engines/classification/gpt_4o_open_ai.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/engines/classification 2026-05-27T11:53:46,935 copying build/lib/unitxt/catalog/engines/classification/llama_3_1_405b_instruct_fp8_rits.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/engines/classification 2026-05-27T11:53:46,937 copying build/lib/unitxt/catalog/engines/classification/llama_3_1_70b_instruct_watsonx.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/engines/classification 2026-05-27T11:53:46,939 copying build/lib/unitxt/catalog/engines/classification/llama_3_1_70b_instruct_rits.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/engines/classification 2026-05-27T11:53:46,941 copying build/lib/unitxt/catalog/engines/classification/llama_3_3_70b_instruct_rits.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/engines/classification 2026-05-27T11:53:46,943 copying build/lib/unitxt/catalog/engines/classification/llama3_8b_ollama.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/engines/classification 2026-05-27T11:53:46,944 copying build/lib/unitxt/catalog/engines/classification/gpt_4_turbo_2024_04_09_azure_openai.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/engines/classification 2026-05-27T11:53:46,946 copying build/lib/unitxt/catalog/engines/classification/gpt_oss_120b_watsonx.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/engines/classification 2026-05-27T11:53:46,948 creating build/bdist.linux-armv7l/wheel/unitxt/catalog/engines/ibm_wml 2026-05-27T11:53:46,949 copying build/lib/unitxt/catalog/engines/ibm_wml/llama_3_3_70b_instruct.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/engines/ibm_wml 2026-05-27T11:53:46,952 creating build/bdist.linux-armv7l/wheel/unitxt/catalog/engines/rits 2026-05-27T11:53:46,953 creating build/bdist.linux-armv7l/wheel/unitxt/catalog/engines/rits/llama_3 2026-05-27T11:53:46,954 copying build/lib/unitxt/catalog/engines/rits/llama_3/1_8b_instruct.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/engines/rits/llama_3 2026-05-27T11:53:46,956 copying build/lib/unitxt/catalog/engines/rits/llama_3_1_70b_instruct.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/engines/rits 2026-05-27T11:53:46,958 copying build/lib/unitxt/catalog/engines/rits/llama_3_1_405b_instruct_fp8.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/engines/rits 2026-05-27T11:53:46,961 creating build/bdist.linux-armv7l/wheel/unitxt/catalog/augmentors 2026-05-27T11:53:46,962 copying build/lib/unitxt/catalog/augmentors/augment_whitespace_task_input.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/augmentors 2026-05-27T11:53:46,964 copying build/lib/unitxt/catalog/augmentors/no_augmentation.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/augmentors 2026-05-27T11:53:46,966 creating build/bdist.linux-armv7l/wheel/unitxt/catalog/augmentors/text 2026-05-27T11:53:46,967 copying build/lib/unitxt/catalog/augmentors/text/whitespace_prefix_suffix.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/augmentors/text 2026-05-27T11:53:46,969 copying build/lib/unitxt/catalog/augmentors/text/white_space.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/augmentors/text 2026-05-27T11:53:46,972 creating build/bdist.linux-armv7l/wheel/unitxt/catalog/augmentors/table 2026-05-27T11:53:46,973 copying build/lib/unitxt/catalog/augmentors/table/insert_empty_rows.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/augmentors/table 2026-05-27T11:53:46,975 copying build/lib/unitxt/catalog/augmentors/table/shuffle_cols.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/augmentors/table 2026-05-27T11:53:46,976 copying build/lib/unitxt/catalog/augmentors/table/duplicate_rows.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/augmentors/table 2026-05-27T11:53:46,978 copying build/lib/unitxt/catalog/augmentors/table/mask_cols_names.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/augmentors/table 2026-05-27T11:53:46,980 copying build/lib/unitxt/catalog/augmentors/table/shuffle_rows.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/augmentors/table 2026-05-27T11:53:46,982 copying build/lib/unitxt/catalog/augmentors/table/duplicate_columns.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/augmentors/table 2026-05-27T11:53:46,984 copying build/lib/unitxt/catalog/augmentors/table/transpose.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/augmentors/table 2026-05-27T11:53:46,986 copying build/lib/unitxt/catalog/augmentors/table/truncate_rows.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/augmentors/table 2026-05-27T11:53:46,988 copying build/lib/unitxt/catalog/augmentors/table/shuffle_cols_names.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/augmentors/table 2026-05-27T11:53:46,990 creating build/bdist.linux-armv7l/wheel/unitxt/catalog/augmentors/image 2026-05-27T11:53:46,991 copying build/lib/unitxt/catalog/augmentors/image/grey_scale.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/augmentors/image 2026-05-27T11:53:46,993 copying build/lib/unitxt/catalog/augmentors/image/oldify.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/augmentors/image 2026-05-27T11:53:46,995 copying build/lib/unitxt/catalog/augmentors/image/white_noise.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/augmentors/image 2026-05-27T11:53:46,997 copying build/lib/unitxt/catalog/augmentors/image/grid_lines.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/augmentors/image 2026-05-27T11:53:46,998 copying build/lib/unitxt/catalog/augmentors/augment_whitespace_prefix_and_suffix_task_input.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/augmentors 2026-05-27T11:53:47,001 creating build/bdist.linux-armv7l/wheel/unitxt/catalog/formats 2026-05-27T11:53:47,002 copying build/lib/unitxt/catalog/formats/llama3_instruct_all_demos_in_one_turn.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/formats 2026-05-27T11:53:47,004 copying build/lib/unitxt/catalog/formats/chat_api.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/formats 2026-05-27T11:53:47,005 copying build/lib/unitxt/catalog/formats/llama.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/formats 2026-05-27T11:53:47,007 copying build/lib/unitxt/catalog/formats/user_agent.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/formats 2026-05-27T11:53:47,009 copying build/lib/unitxt/catalog/formats/human_assistant.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/formats 2026-05-27T11:53:47,011 copying build/lib/unitxt/catalog/formats/deepseek_coder.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/formats 2026-05-27T11:53:47,013 copying build/lib/unitxt/catalog/formats/llama3_instruct.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/formats 2026-05-27T11:53:47,015 creating build/bdist.linux-armv7l/wheel/unitxt/catalog/formats/models 2026-05-27T11:53:47,016 copying build/lib/unitxt/catalog/formats/models/starling.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/formats/models 2026-05-27T11:53:47,019 creating build/bdist.linux-armv7l/wheel/unitxt/catalog/formats/models/labradorite 2026-05-27T11:53:47,020 copying build/lib/unitxt/catalog/formats/models/labradorite/zero_shot.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/formats/models/labradorite 2026-05-27T11:53:47,022 copying build/lib/unitxt/catalog/formats/models/labradorite/few_shot.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/formats/models/labradorite 2026-05-27T11:53:47,024 copying build/lib/unitxt/catalog/formats/models/llava.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/formats/models 2026-05-27T11:53:47,026 creating build/bdist.linux-armv7l/wheel/unitxt/catalog/formats/models/mistral 2026-05-27T11:53:47,027 copying build/lib/unitxt/catalog/formats/models/mistral/instruction.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/formats/models/mistral 2026-05-27T11:53:47,030 creating build/bdist.linux-armv7l/wheel/unitxt/catalog/formats/models/mistral/instruction 2026-05-27T11:53:47,031 copying build/lib/unitxt/catalog/formats/models/mistral/instruction/with_system_prompt.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/formats/models/mistral/instruction 2026-05-27T11:53:47,033 copying build/lib/unitxt/catalog/formats/models/alpaca_instruct.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/formats/models 2026-05-27T11:53:47,035 copying build/lib/unitxt/catalog/formats/models/llava_interleave.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/formats/models 2026-05-27T11:53:47,037 copying build/lib/unitxt/catalog/formats/models/phi_3.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/formats/models 2026-05-27T11:53:47,039 creating build/bdist.linux-armv7l/wheel/unitxt/catalog/formats/models/flan 2026-05-27T11:53:47,040 copying build/lib/unitxt/catalog/formats/models/flan/exq_exa.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/formats/models/flan 2026-05-27T11:53:47,043 copying build/lib/unitxt/catalog/formats/models/flan/few_shot.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/formats/models/flan 2026-05-27T11:53:47,044 copying build/lib/unitxt/catalog/formats/models/granite_3_1_documents.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/formats/models 2026-05-27T11:53:47,046 copying build/lib/unitxt/catalog/formats/empty.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/formats 2026-05-27T11:53:47,048 copying build/lib/unitxt/catalog/formats/textual_assistant.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/formats 2026-05-27T11:53:47,050 copying build/lib/unitxt/catalog/formats/llama2.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/formats 2026-05-27T11:53:47,052 copying build/lib/unitxt/catalog/formats/chat_api_with_tokenizer_chat_template.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/formats 2026-05-27T11:53:47,053 copying build/lib/unitxt/catalog/formats/llamaguard2.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/formats 2026-05-27T11:53:47,055 copying build/lib/unitxt/catalog/formats/empty_input_output_separator.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/formats 2026-05-27T11:53:47,057 copying build/lib/unitxt/catalog/formats/user_assistant.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/formats 2026-05-27T11:53:47,062 creating build/bdist.linux-armv7l/wheel/unitxt/catalog/cards 2026-05-27T11:53:47,063 copying build/lib/unitxt/catalog/cards/rte.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards 2026-05-27T11:53:47,065 creating build/bdist.linux-armv7l/wheel/unitxt/catalog/cards/biggen_bench 2026-05-27T11:53:47,067 creating build/bdist.linux-armv7l/wheel/unitxt/catalog/cards/biggen_bench/results 2026-05-27T11:53:47,068 copying build/lib/unitxt/catalog/cards/biggen_bench/results/human_eval.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/biggen_bench/results 2026-05-27T11:53:47,071 copying build/lib/unitxt/catalog/cards/tldr_document_filtered_to_6000_chars.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards 2026-05-27T11:53:47,073 creating build/bdist.linux-armv7l/wheel/unitxt/catalog/cards/ffqa_filtered 2026-05-27T11:53:47,075 copying build/lib/unitxt/catalog/cards/ffqa_filtered/2k.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/ffqa_filtered 2026-05-27T11:53:47,077 copying build/lib/unitxt/catalog/cards/ffqa_filtered/8k.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/ffqa_filtered 2026-05-27T11:53:47,079 copying build/lib/unitxt/catalog/cards/ffqa_filtered/16k.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/ffqa_filtered 2026-05-27T11:53:47,081 copying build/lib/unitxt/catalog/cards/ffqa_filtered/4k.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/ffqa_filtered 2026-05-27T11:53:47,083 copying build/lib/unitxt/catalog/cards/ledgar.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards 2026-05-27T11:53:47,086 copying build/lib/unitxt/catalog/cards/copa.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards 2026-05-27T11:53:47,088 copying build/lib/unitxt/catalog/cards/qqp.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards 2026-05-27T11:53:47,090 copying build/lib/unitxt/catalog/cards/quality.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards 2026-05-27T11:53:47,092 copying build/lib/unitxt/catalog/cards/openbook_qa.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards 2026-05-27T11:53:47,094 creating build/bdist.linux-armv7l/wheel/unitxt/catalog/cards/mmlu_pro 2026-05-27T11:53:47,095 copying build/lib/unitxt/catalog/cards/mmlu_pro/economics.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/mmlu_pro 2026-05-27T11:53:47,097 copying build/lib/unitxt/catalog/cards/mmlu_pro/law.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/mmlu_pro 2026-05-27T11:53:47,099 copying build/lib/unitxt/catalog/cards/mmlu_pro/chemistry.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/mmlu_pro 2026-05-27T11:53:47,101 copying build/lib/unitxt/catalog/cards/mmlu_pro/physics.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/mmlu_pro 2026-05-27T11:53:47,103 copying build/lib/unitxt/catalog/cards/mmlu_pro/computer_science.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/mmlu_pro 2026-05-27T11:53:47,105 copying build/lib/unitxt/catalog/cards/mmlu_pro/health.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/mmlu_pro 2026-05-27T11:53:47,107 copying build/lib/unitxt/catalog/cards/mmlu_pro/business.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/mmlu_pro 2026-05-27T11:53:47,108 copying build/lib/unitxt/catalog/cards/mmlu_pro/philosophy.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/mmlu_pro 2026-05-27T11:53:47,110 copying build/lib/unitxt/catalog/cards/mmlu_pro/psychology.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/mmlu_pro 2026-05-27T11:53:47,112 copying build/lib/unitxt/catalog/cards/mmlu_pro/math.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/mmlu_pro 2026-05-27T11:53:47,114 copying build/lib/unitxt/catalog/cards/mmlu_pro/history.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/mmlu_pro 2026-05-27T11:53:47,116 copying build/lib/unitxt/catalog/cards/mmlu_pro/biology.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/mmlu_pro 2026-05-27T11:53:47,118 copying build/lib/unitxt/catalog/cards/mmlu_pro/engineering.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/mmlu_pro 2026-05-27T11:53:47,120 copying build/lib/unitxt/catalog/cards/mmlu_pro/other.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/mmlu_pro 2026-05-27T11:53:47,122 copying build/lib/unitxt/catalog/cards/open_australian_legal_qa.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards 2026-05-27T11:53:47,123 copying build/lib/unitxt/catalog/cards/ethos_binary.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards 2026-05-27T11:53:47,126 copying build/lib/unitxt/catalog/cards/ai2d.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards 2026-05-27T11:53:47,128 copying build/lib/unitxt/catalog/cards/long_bench_v2.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards 2026-05-27T11:53:47,130 creating build/bdist.linux-armv7l/wheel/unitxt/catalog/cards/almost_evil 2026-05-27T11:53:47,131 copying build/lib/unitxt/catalog/cards/almost_evil/de.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/almost_evil 2026-05-27T11:53:47,133 copying build/lib/unitxt/catalog/cards/almost_evil/it.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/almost_evil 2026-05-27T11:53:47,135 copying build/lib/unitxt/catalog/cards/almost_evil/ru.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/almost_evil 2026-05-27T11:53:47,137 copying build/lib/unitxt/catalog/cards/almost_evil/fr.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/almost_evil 2026-05-27T11:53:47,139 copying build/lib/unitxt/catalog/cards/almost_evil/es.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/almost_evil 2026-05-27T11:53:47,141 copying build/lib/unitxt/catalog/cards/almost_evil/en.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/almost_evil 2026-05-27T11:53:47,143 copying build/lib/unitxt/catalog/cards/almost_evil/pt.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/almost_evil 2026-05-27T11:53:47,145 copying build/lib/unitxt/catalog/cards/almost_evil/nl.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/almost_evil 2026-05-27T11:53:47,147 copying build/lib/unitxt/catalog/cards/news_category_classification_headline.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards 2026-05-27T11:53:47,149 copying build/lib/unitxt/catalog/cards/sst2.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards 2026-05-27T11:53:47,151 copying build/lib/unitxt/catalog/cards/tablerow_classify.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards 2026-05-27T11:53:47,153 creating build/bdist.linux-armv7l/wheel/unitxt/catalog/cards/milu 2026-05-27T11:53:47,155 creating build/bdist.linux-armv7l/wheel/unitxt/catalog/cards/milu/Bengali 2026-05-27T11:53:47,156 copying build/lib/unitxt/catalog/cards/milu/Bengali/Law_and_Governance.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/milu/Bengali 2026-05-27T11:53:47,158 copying build/lib/unitxt/catalog/cards/milu/Bengali/Health_and_Medicine.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/milu/Bengali 2026-05-27T11:53:47,160 copying build/lib/unitxt/catalog/cards/milu/Bengali/Social_Sciences.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/milu/Bengali 2026-05-27T11:53:47,162 copying build/lib/unitxt/catalog/cards/milu/Bengali/Science.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/milu/Bengali 2026-05-27T11:53:47,164 copying build/lib/unitxt/catalog/cards/milu/Bengali/Engineering_and_Tech.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/milu/Bengali 2026-05-27T11:53:47,166 copying build/lib/unitxt/catalog/cards/milu/Bengali/Business_Studies.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/milu/Bengali 2026-05-27T11:53:47,167 copying build/lib/unitxt/catalog/cards/milu/Bengali/Arts_and_Humanities.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/milu/Bengali 2026-05-27T11:53:47,169 copying build/lib/unitxt/catalog/cards/milu/Bengali/Environmental_Sciences.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/milu/Bengali 2026-05-27T11:53:47,172 creating build/bdist.linux-armv7l/wheel/unitxt/catalog/cards/milu/Marathi 2026-05-27T11:53:47,173 copying build/lib/unitxt/catalog/cards/milu/Marathi/Law_and_Governance.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/milu/Marathi 2026-05-27T11:53:47,175 copying build/lib/unitxt/catalog/cards/milu/Marathi/Health_and_Medicine.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/milu/Marathi 2026-05-27T11:53:47,176 copying build/lib/unitxt/catalog/cards/milu/Marathi/Social_Sciences.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/milu/Marathi 2026-05-27T11:53:47,178 copying build/lib/unitxt/catalog/cards/milu/Marathi/Science.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/milu/Marathi 2026-05-27T11:53:47,180 copying build/lib/unitxt/catalog/cards/milu/Marathi/Engineering_and_Tech.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/milu/Marathi 2026-05-27T11:53:47,182 copying build/lib/unitxt/catalog/cards/milu/Marathi/Business_Studies.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/milu/Marathi 2026-05-27T11:53:47,184 copying build/lib/unitxt/catalog/cards/milu/Marathi/Arts_and_Humanities.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/milu/Marathi 2026-05-27T11:53:47,186 copying build/lib/unitxt/catalog/cards/milu/Marathi/Environmental_Sciences.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/milu/Marathi 2026-05-27T11:53:47,189 creating build/bdist.linux-armv7l/wheel/unitxt/catalog/cards/milu/Gujarati 2026-05-27T11:53:47,190 copying build/lib/unitxt/catalog/cards/milu/Gujarati/Law_and_Governance.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/milu/Gujarati 2026-05-27T11:53:47,192 copying build/lib/unitxt/catalog/cards/milu/Gujarati/Health_and_Medicine.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/milu/Gujarati 2026-05-27T11:53:47,194 copying build/lib/unitxt/catalog/cards/milu/Gujarati/Social_Sciences.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/milu/Gujarati 2026-05-27T11:53:47,196 copying build/lib/unitxt/catalog/cards/milu/Gujarati/Science.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/milu/Gujarati 2026-05-27T11:53:47,198 copying build/lib/unitxt/catalog/cards/milu/Gujarati/Engineering_and_Tech.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/milu/Gujarati 2026-05-27T11:53:47,200 copying build/lib/unitxt/catalog/cards/milu/Gujarati/Business_Studies.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/milu/Gujarati 2026-05-27T11:53:47,202 copying build/lib/unitxt/catalog/cards/milu/Gujarati/Arts_and_Humanities.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/milu/Gujarati 2026-05-27T11:53:47,204 copying build/lib/unitxt/catalog/cards/milu/Gujarati/Environmental_Sciences.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/milu/Gujarati 2026-05-27T11:53:47,206 creating build/bdist.linux-armv7l/wheel/unitxt/catalog/cards/milu/Malayalam 2026-05-27T11:53:47,207 copying build/lib/unitxt/catalog/cards/milu/Malayalam/Law_and_Governance.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/milu/Malayalam 2026-05-27T11:53:47,209 copying build/lib/unitxt/catalog/cards/milu/Malayalam/Health_and_Medicine.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/milu/Malayalam 2026-05-27T11:53:47,211 copying build/lib/unitxt/catalog/cards/milu/Malayalam/Social_Sciences.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/milu/Malayalam 2026-05-27T11:53:47,213 copying build/lib/unitxt/catalog/cards/milu/Malayalam/Science.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/milu/Malayalam 2026-05-27T11:53:47,215 copying build/lib/unitxt/catalog/cards/milu/Malayalam/Engineering_and_Tech.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/milu/Malayalam 2026-05-27T11:53:47,217 copying build/lib/unitxt/catalog/cards/milu/Malayalam/Business_Studies.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/milu/Malayalam 2026-05-27T11:53:47,219 copying build/lib/unitxt/catalog/cards/milu/Malayalam/Arts_and_Humanities.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/milu/Malayalam 2026-05-27T11:53:47,221 copying build/lib/unitxt/catalog/cards/milu/Malayalam/Environmental_Sciences.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/milu/Malayalam 2026-05-27T11:53:47,224 creating build/bdist.linux-armv7l/wheel/unitxt/catalog/cards/milu/Punjabi 2026-05-27T11:53:47,225 copying build/lib/unitxt/catalog/cards/milu/Punjabi/Law_and_Governance.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/milu/Punjabi 2026-05-27T11:53:47,228 copying build/lib/unitxt/catalog/cards/milu/Punjabi/Health_and_Medicine.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/milu/Punjabi 2026-05-27T11:53:47,230 copying build/lib/unitxt/catalog/cards/milu/Punjabi/Social_Sciences.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/milu/Punjabi 2026-05-27T11:53:47,232 copying build/lib/unitxt/catalog/cards/milu/Punjabi/Science.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/milu/Punjabi 2026-05-27T11:53:47,235 copying build/lib/unitxt/catalog/cards/milu/Punjabi/Engineering_and_Tech.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/milu/Punjabi 2026-05-27T11:53:47,237 copying build/lib/unitxt/catalog/cards/milu/Punjabi/Business_Studies.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/milu/Punjabi 2026-05-27T11:53:47,240 copying build/lib/unitxt/catalog/cards/milu/Punjabi/Arts_and_Humanities.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/milu/Punjabi 2026-05-27T11:53:47,242 copying build/lib/unitxt/catalog/cards/milu/Punjabi/Environmental_Sciences.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/milu/Punjabi 2026-05-27T11:53:47,245 creating build/bdist.linux-armv7l/wheel/unitxt/catalog/cards/milu/Odia 2026-05-27T11:53:47,247 copying build/lib/unitxt/catalog/cards/milu/Odia/Law_and_Governance.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/milu/Odia 2026-05-27T11:53:47,249 copying build/lib/unitxt/catalog/cards/milu/Odia/Health_and_Medicine.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/milu/Odia 2026-05-27T11:53:47,252 copying build/lib/unitxt/catalog/cards/milu/Odia/Social_Sciences.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/milu/Odia 2026-05-27T11:53:47,254 copying build/lib/unitxt/catalog/cards/milu/Odia/Science.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/milu/Odia 2026-05-27T11:53:47,257 copying build/lib/unitxt/catalog/cards/milu/Odia/Engineering_and_Tech.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/milu/Odia 2026-05-27T11:53:47,259 copying build/lib/unitxt/catalog/cards/milu/Odia/Business_Studies.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/milu/Odia 2026-05-27T11:53:47,261 copying build/lib/unitxt/catalog/cards/milu/Odia/Arts_and_Humanities.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/milu/Odia 2026-05-27T11:53:47,263 copying build/lib/unitxt/catalog/cards/milu/Odia/Environmental_Sciences.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/milu/Odia 2026-05-27T11:53:47,266 creating build/bdist.linux-armv7l/wheel/unitxt/catalog/cards/milu/Hindi 2026-05-27T11:53:47,268 copying build/lib/unitxt/catalog/cards/milu/Hindi/Law_and_Governance.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/milu/Hindi 2026-05-27T11:53:47,270 copying build/lib/unitxt/catalog/cards/milu/Hindi/Health_and_Medicine.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/milu/Hindi 2026-05-27T11:53:47,272 copying build/lib/unitxt/catalog/cards/milu/Hindi/Social_Sciences.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/milu/Hindi 2026-05-27T11:53:47,275 copying build/lib/unitxt/catalog/cards/milu/Hindi/Science.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/milu/Hindi 2026-05-27T11:53:47,277 copying build/lib/unitxt/catalog/cards/milu/Hindi/Engineering_and_Tech.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/milu/Hindi 2026-05-27T11:53:47,279 copying build/lib/unitxt/catalog/cards/milu/Hindi/Business_Studies.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/milu/Hindi 2026-05-27T11:53:47,282 copying build/lib/unitxt/catalog/cards/milu/Hindi/Arts_and_Humanities.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/milu/Hindi 2026-05-27T11:53:47,284 copying build/lib/unitxt/catalog/cards/milu/Hindi/Environmental_Sciences.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/milu/Hindi 2026-05-27T11:53:47,287 creating build/bdist.linux-armv7l/wheel/unitxt/catalog/cards/milu/English 2026-05-27T11:53:47,289 copying build/lib/unitxt/catalog/cards/milu/English/Law_and_Governance.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/milu/English 2026-05-27T11:53:47,291 copying build/lib/unitxt/catalog/cards/milu/English/Health_and_Medicine.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/milu/English 2026-05-27T11:53:47,294 copying build/lib/unitxt/catalog/cards/milu/English/Social_Sciences.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/milu/English 2026-05-27T11:53:47,296 copying build/lib/unitxt/catalog/cards/milu/English/Science.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/milu/English 2026-05-27T11:53:47,299 copying build/lib/unitxt/catalog/cards/milu/English/Engineering_and_Tech.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/milu/English 2026-05-27T11:53:47,301 copying build/lib/unitxt/catalog/cards/milu/English/Business_Studies.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/milu/English 2026-05-27T11:53:47,303 copying build/lib/unitxt/catalog/cards/milu/English/Arts_and_Humanities.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/milu/English 2026-05-27T11:53:47,306 copying build/lib/unitxt/catalog/cards/milu/English/Environmental_Sciences.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/milu/English 2026-05-27T11:53:47,309 creating build/bdist.linux-armv7l/wheel/unitxt/catalog/cards/milu/Tamil 2026-05-27T11:53:47,311 copying build/lib/unitxt/catalog/cards/milu/Tamil/Law_and_Governance.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/milu/Tamil 2026-05-27T11:53:47,313 copying build/lib/unitxt/catalog/cards/milu/Tamil/Health_and_Medicine.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/milu/Tamil 2026-05-27T11:53:47,316 copying build/lib/unitxt/catalog/cards/milu/Tamil/Social_Sciences.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/milu/Tamil 2026-05-27T11:53:47,318 copying build/lib/unitxt/catalog/cards/milu/Tamil/Science.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/milu/Tamil 2026-05-27T11:53:47,320 copying build/lib/unitxt/catalog/cards/milu/Tamil/Engineering_and_Tech.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/milu/Tamil 2026-05-27T11:53:47,322 copying build/lib/unitxt/catalog/cards/milu/Tamil/Business_Studies.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/milu/Tamil 2026-05-27T11:53:47,324 copying build/lib/unitxt/catalog/cards/milu/Tamil/Arts_and_Humanities.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/milu/Tamil 2026-05-27T11:53:47,326 copying build/lib/unitxt/catalog/cards/milu/Tamil/Environmental_Sciences.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/milu/Tamil 2026-05-27T11:53:47,328 creating build/bdist.linux-armv7l/wheel/unitxt/catalog/cards/milu/Kannada 2026-05-27T11:53:47,330 copying build/lib/unitxt/catalog/cards/milu/Kannada/Law_and_Governance.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/milu/Kannada 2026-05-27T11:53:47,332 copying build/lib/unitxt/catalog/cards/milu/Kannada/Health_and_Medicine.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/milu/Kannada 2026-05-27T11:53:47,334 copying build/lib/unitxt/catalog/cards/milu/Kannada/Social_Sciences.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/milu/Kannada 2026-05-27T11:53:47,335 copying build/lib/unitxt/catalog/cards/milu/Kannada/Science.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/milu/Kannada 2026-05-27T11:53:47,337 copying build/lib/unitxt/catalog/cards/milu/Kannada/Engineering_and_Tech.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/milu/Kannada 2026-05-27T11:53:47,339 copying build/lib/unitxt/catalog/cards/milu/Kannada/Business_Studies.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/milu/Kannada 2026-05-27T11:53:47,341 copying build/lib/unitxt/catalog/cards/milu/Kannada/Arts_and_Humanities.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/milu/Kannada 2026-05-27T11:53:47,343 copying build/lib/unitxt/catalog/cards/milu/Kannada/Environmental_Sciences.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/milu/Kannada 2026-05-27T11:53:47,345 creating build/bdist.linux-armv7l/wheel/unitxt/catalog/cards/milu/Telugu 2026-05-27T11:53:47,347 copying build/lib/unitxt/catalog/cards/milu/Telugu/Law_and_Governance.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/milu/Telugu 2026-05-27T11:53:47,349 copying build/lib/unitxt/catalog/cards/milu/Telugu/Health_and_Medicine.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/milu/Telugu 2026-05-27T11:53:47,351 copying build/lib/unitxt/catalog/cards/milu/Telugu/Social_Sciences.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/milu/Telugu 2026-05-27T11:53:47,353 copying build/lib/unitxt/catalog/cards/milu/Telugu/Science.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/milu/Telugu 2026-05-27T11:53:47,355 copying build/lib/unitxt/catalog/cards/milu/Telugu/Engineering_and_Tech.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/milu/Telugu 2026-05-27T11:53:47,356 copying build/lib/unitxt/catalog/cards/milu/Telugu/Business_Studies.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/milu/Telugu 2026-05-27T11:53:47,358 copying build/lib/unitxt/catalog/cards/milu/Telugu/Arts_and_Humanities.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/milu/Telugu 2026-05-27T11:53:47,360 copying build/lib/unitxt/catalog/cards/milu/Telugu/Environmental_Sciences.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/milu/Telugu 2026-05-27T11:53:47,363 creating build/bdist.linux-armv7l/wheel/unitxt/catalog/cards/judge_bench 2026-05-27T11:53:47,364 creating build/bdist.linux-armv7l/wheel/unitxt/catalog/cards/judge_bench/dices 2026-05-27T11:53:47,365 copying build/lib/unitxt/catalog/cards/judge_bench/dices/safety.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/judge_bench/dices 2026-05-27T11:53:47,368 creating build/bdist.linux-armv7l/wheel/unitxt/catalog/cards/judge_bench/roscoe 2026-05-27T11:53:47,370 creating build/bdist.linux-armv7l/wheel/unitxt/catalog/cards/judge_bench/roscoe/overall 2026-05-27T11:53:47,372 creating build/bdist.linux-armv7l/wheel/unitxt/catalog/cards/judge_bench/roscoe/overall/esnli 2026-05-27T11:53:47,373 copying build/lib/unitxt/catalog/cards/judge_bench/roscoe/overall/esnli/coherence.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/judge_bench/roscoe/overall/esnli 2026-05-27T11:53:47,375 copying build/lib/unitxt/catalog/cards/judge_bench/roscoe/overall/esnli/overall_quality.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/judge_bench/roscoe/overall/esnli 2026-05-27T11:53:47,377 copying build/lib/unitxt/catalog/cards/judge_bench/roscoe/overall/esnli/missing_steps.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/judge_bench/roscoe/overall/esnli 2026-05-27T11:53:47,379 copying build/lib/unitxt/catalog/cards/judge_bench/roscoe/overall/esnli/contradiction.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/judge_bench/roscoe/overall/esnli 2026-05-27T11:53:47,381 creating build/bdist.linux-armv7l/wheel/unitxt/catalog/cards/judge_bench/roscoe/overall/cosmos 2026-05-27T11:53:47,382 copying build/lib/unitxt/catalog/cards/judge_bench/roscoe/overall/cosmos/coherence.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/judge_bench/roscoe/overall/cosmos 2026-05-27T11:53:47,384 copying build/lib/unitxt/catalog/cards/judge_bench/roscoe/overall/cosmos/overall_quality.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/judge_bench/roscoe/overall/cosmos 2026-05-27T11:53:47,386 copying build/lib/unitxt/catalog/cards/judge_bench/roscoe/overall/cosmos/missing_steps.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/judge_bench/roscoe/overall/cosmos 2026-05-27T11:53:47,388 copying build/lib/unitxt/catalog/cards/judge_bench/roscoe/overall/cosmos/contradiction.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/judge_bench/roscoe/overall/cosmos 2026-05-27T11:53:47,391 creating build/bdist.linux-armv7l/wheel/unitxt/catalog/cards/judge_bench/roscoe/overall/drop 2026-05-27T11:53:47,392 copying build/lib/unitxt/catalog/cards/judge_bench/roscoe/overall/drop/coherence.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/judge_bench/roscoe/overall/drop 2026-05-27T11:53:47,394 copying build/lib/unitxt/catalog/cards/judge_bench/roscoe/overall/drop/overall_quality.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/judge_bench/roscoe/overall/drop 2026-05-27T11:53:47,396 copying build/lib/unitxt/catalog/cards/judge_bench/roscoe/overall/drop/missing_steps.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/judge_bench/roscoe/overall/drop 2026-05-27T11:53:47,398 copying build/lib/unitxt/catalog/cards/judge_bench/roscoe/overall/drop/contradiction.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/judge_bench/roscoe/overall/drop 2026-05-27T11:53:47,401 creating build/bdist.linux-armv7l/wheel/unitxt/catalog/cards/judge_bench/roscoe/stepwise 2026-05-27T11:53:47,403 creating build/bdist.linux-armv7l/wheel/unitxt/catalog/cards/judge_bench/roscoe/stepwise/esnli 2026-05-27T11:53:47,405 copying build/lib/unitxt/catalog/cards/judge_bench/roscoe/stepwise/esnli/hallucination.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/judge_bench/roscoe/stepwise/esnli 2026-05-27T11:53:47,407 copying build/lib/unitxt/catalog/cards/judge_bench/roscoe/stepwise/esnli/final_answer.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/judge_bench/roscoe/stepwise/esnli 2026-05-27T11:53:47,409 copying build/lib/unitxt/catalog/cards/judge_bench/roscoe/stepwise/esnli/redundancy.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/judge_bench/roscoe/stepwise/esnli 2026-05-27T11:53:47,411 copying build/lib/unitxt/catalog/cards/judge_bench/roscoe/stepwise/esnli/arithmetic.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/judge_bench/roscoe/stepwise/esnli 2026-05-27T11:53:47,413 copying build/lib/unitxt/catalog/cards/judge_bench/roscoe/stepwise/esnli/factuality.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/judge_bench/roscoe/stepwise/esnli 2026-05-27T11:53:47,415 copying build/lib/unitxt/catalog/cards/judge_bench/roscoe/stepwise/esnli/repetition.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/judge_bench/roscoe/stepwise/esnli 2026-05-27T11:53:47,417 copying build/lib/unitxt/catalog/cards/judge_bench/roscoe/stepwise/esnli/commonsense.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/judge_bench/roscoe/stepwise/esnli 2026-05-27T11:53:47,419 copying build/lib/unitxt/catalog/cards/judge_bench/roscoe/stepwise/esnli/coherency_and_logic.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/judge_bench/roscoe/stepwise/esnli 2026-05-27T11:53:47,420 copying build/lib/unitxt/catalog/cards/judge_bench/roscoe/stepwise/esnli/grammar.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/judge_bench/roscoe/stepwise/esnli 2026-05-27T11:53:47,423 creating build/bdist.linux-armv7l/wheel/unitxt/catalog/cards/judge_bench/roscoe/stepwise/cosmos 2026-05-27T11:53:47,424 copying build/lib/unitxt/catalog/cards/judge_bench/roscoe/stepwise/cosmos/hallucination.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/judge_bench/roscoe/stepwise/cosmos 2026-05-27T11:53:47,426 copying build/lib/unitxt/catalog/cards/judge_bench/roscoe/stepwise/cosmos/final_answer.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/judge_bench/roscoe/stepwise/cosmos 2026-05-27T11:53:47,428 copying build/lib/unitxt/catalog/cards/judge_bench/roscoe/stepwise/cosmos/redundancy.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/judge_bench/roscoe/stepwise/cosmos 2026-05-27T11:53:47,430 copying build/lib/unitxt/catalog/cards/judge_bench/roscoe/stepwise/cosmos/arithmetic.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/judge_bench/roscoe/stepwise/cosmos 2026-05-27T11:53:47,432 copying build/lib/unitxt/catalog/cards/judge_bench/roscoe/stepwise/cosmos/factuality.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/judge_bench/roscoe/stepwise/cosmos 2026-05-27T11:53:47,434 copying build/lib/unitxt/catalog/cards/judge_bench/roscoe/stepwise/cosmos/repetition.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/judge_bench/roscoe/stepwise/cosmos 2026-05-27T11:53:47,436 copying build/lib/unitxt/catalog/cards/judge_bench/roscoe/stepwise/cosmos/commonsense.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/judge_bench/roscoe/stepwise/cosmos 2026-05-27T11:53:47,438 copying build/lib/unitxt/catalog/cards/judge_bench/roscoe/stepwise/cosmos/coherency_and_logic.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/judge_bench/roscoe/stepwise/cosmos 2026-05-27T11:53:47,440 copying build/lib/unitxt/catalog/cards/judge_bench/roscoe/stepwise/cosmos/grammar.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/judge_bench/roscoe/stepwise/cosmos 2026-05-27T11:53:47,443 creating build/bdist.linux-armv7l/wheel/unitxt/catalog/cards/judge_bench/roscoe/stepwise/drop 2026-05-27T11:53:47,444 copying build/lib/unitxt/catalog/cards/judge_bench/roscoe/stepwise/drop/hallucination.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/judge_bench/roscoe/stepwise/drop 2026-05-27T11:53:47,446 copying build/lib/unitxt/catalog/cards/judge_bench/roscoe/stepwise/drop/final_answer.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/judge_bench/roscoe/stepwise/drop 2026-05-27T11:53:47,448 copying build/lib/unitxt/catalog/cards/judge_bench/roscoe/stepwise/drop/redundancy.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/judge_bench/roscoe/stepwise/drop 2026-05-27T11:53:47,450 copying build/lib/unitxt/catalog/cards/judge_bench/roscoe/stepwise/drop/arithmetic.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/judge_bench/roscoe/stepwise/drop 2026-05-27T11:53:47,452 copying build/lib/unitxt/catalog/cards/judge_bench/roscoe/stepwise/drop/factuality.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/judge_bench/roscoe/stepwise/drop 2026-05-27T11:53:47,454 copying build/lib/unitxt/catalog/cards/judge_bench/roscoe/stepwise/drop/repetition.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/judge_bench/roscoe/stepwise/drop 2026-05-27T11:53:47,456 copying build/lib/unitxt/catalog/cards/judge_bench/roscoe/stepwise/drop/commonsense.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/judge_bench/roscoe/stepwise/drop 2026-05-27T11:53:47,458 copying build/lib/unitxt/catalog/cards/judge_bench/roscoe/stepwise/drop/coherency_and_logic.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/judge_bench/roscoe/stepwise/drop 2026-05-27T11:53:47,459 copying build/lib/unitxt/catalog/cards/judge_bench/roscoe/stepwise/drop/grammar.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/judge_bench/roscoe/stepwise/drop 2026-05-27T11:53:47,462 creating build/bdist.linux-armv7l/wheel/unitxt/catalog/cards/judge_bench/cola 2026-05-27T11:53:47,463 copying build/lib/unitxt/catalog/cards/judge_bench/cola/grammaticality.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/judge_bench/cola 2026-05-27T11:53:47,465 creating build/bdist.linux-armv7l/wheel/unitxt/catalog/cards/judge_bench/newswoom 2026-05-27T11:53:47,467 copying build/lib/unitxt/catalog/cards/judge_bench/newswoom/fluency.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/judge_bench/newswoom 2026-05-27T11:53:47,469 copying build/lib/unitxt/catalog/cards/judge_bench/newswoom/coherence.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/judge_bench/newswoom 2026-05-27T11:53:47,471 copying build/lib/unitxt/catalog/cards/judge_bench/newswoom/relevance.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/judge_bench/newswoom 2026-05-27T11:53:47,473 copying build/lib/unitxt/catalog/cards/judge_bench/newswoom/informativeness.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/judge_bench/newswoom 2026-05-27T11:53:47,475 creating build/bdist.linux-armv7l/wheel/unitxt/catalog/cards/judge_bench/wmt_human 2026-05-27T11:53:47,477 creating build/bdist.linux-armv7l/wheel/unitxt/catalog/cards/judge_bench/wmt_human/english_to_german 2026-05-27T11:53:47,478 copying build/lib/unitxt/catalog/cards/judge_bench/wmt_human/english_to_german/quality.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/judge_bench/wmt_human/english_to_german 2026-05-27T11:53:47,481 creating build/bdist.linux-armv7l/wheel/unitxt/catalog/cards/judge_bench/wmt_human/chinese_to_english 2026-05-27T11:53:47,482 copying build/lib/unitxt/catalog/cards/judge_bench/wmt_human/chinese_to_english/quality.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/judge_bench/wmt_human/chinese_to_english 2026-05-27T11:53:47,484 creating build/bdist.linux-armv7l/wheel/unitxt/catalog/cards/judge_bench/toxic_chat 2026-05-27T11:53:47,485 copying build/lib/unitxt/catalog/cards/judge_bench/toxic_chat/jailbreaking.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/judge_bench/toxic_chat 2026-05-27T11:53:47,488 copying build/lib/unitxt/catalog/cards/judge_bench/toxic_chat/toxicity.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/judge_bench/toxic_chat 2026-05-27T11:53:47,490 creating build/bdist.linux-armv7l/wheel/unitxt/catalog/cards/judge_bench/inferential_strategies 2026-05-27T11:53:47,491 copying build/lib/unitxt/catalog/cards/judge_bench/inferential_strategies/sound_reasoning.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/judge_bench/inferential_strategies 2026-05-27T11:53:47,494 copying build/lib/unitxt/catalog/cards/scigen.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards 2026-05-27T11:53:47,496 copying build/lib/unitxt/catalog/cards/20_newsgroups.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards 2026-05-27T11:53:47,498 copying build/lib/unitxt/catalog/cards/coedit_error_detection.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards 2026-05-27T11:53:47,499 copying build/lib/unitxt/catalog/cards/info_vqa.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards 2026-05-27T11:53:47,502 creating build/bdist.linux-armv7l/wheel/unitxt/catalog/cards/ragbench 2026-05-27T11:53:47,503 copying build/lib/unitxt/catalog/cards/ragbench/expertqa.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/ragbench 2026-05-27T11:53:47,505 copying build/lib/unitxt/catalog/cards/ragbench/cuad.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/ragbench 2026-05-27T11:53:47,506 copying build/lib/unitxt/catalog/cards/ragbench/hotpotqa.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/ragbench 2026-05-27T11:53:47,508 copying build/lib/unitxt/catalog/cards/ragbench/pubmedqa.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/ragbench 2026-05-27T11:53:47,510 copying build/lib/unitxt/catalog/cards/ragbench/techqa.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/ragbench 2026-05-27T11:53:47,512 copying build/lib/unitxt/catalog/cards/ragbench/hagrid.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/ragbench 2026-05-27T11:53:47,514 copying build/lib/unitxt/catalog/cards/ragbench/msmarco.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/ragbench 2026-05-27T11:53:47,515 copying build/lib/unitxt/catalog/cards/ragbench/delucionqa.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/ragbench 2026-05-27T11:53:47,518 copying build/lib/unitxt/catalog/cards/ragbench/finqa.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/ragbench 2026-05-27T11:53:47,519 copying build/lib/unitxt/catalog/cards/ragbench/covidqa.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/ragbench 2026-05-27T11:53:47,521 copying build/lib/unitxt/catalog/cards/ragbench/tatqa.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/ragbench 2026-05-27T11:53:47,523 copying build/lib/unitxt/catalog/cards/ragbench/emanual.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/ragbench 2026-05-27T11:53:47,525 copying build/lib/unitxt/catalog/cards/language_identification.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards 2026-05-27T11:53:47,527 copying build/lib/unitxt/catalog/cards/pop_qa_robust.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards 2026-05-27T11:53:47,530 creating build/bdist.linux-armv7l/wheel/unitxt/catalog/cards/reuters21578 2026-05-27T11:53:47,531 copying build/lib/unitxt/catalog/cards/reuters21578/ModHayes.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/reuters21578 2026-05-27T11:53:47,533 copying build/lib/unitxt/catalog/cards/reuters21578/ModLewis.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/reuters21578 2026-05-27T11:53:47,535 copying build/lib/unitxt/catalog/cards/reuters21578/ModApte.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/reuters21578 2026-05-27T11:53:47,538 copying build/lib/unitxt/catalog/cards/sciq.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards 2026-05-27T11:53:47,540 copying build/lib/unitxt/catalog/cards/human_eval.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards 2026-05-27T11:53:47,542 copying build/lib/unitxt/catalog/cards/billsum_document_filtered_to_6000_chars.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards 2026-05-27T11:53:47,544 creating build/bdist.linux-armv7l/wheel/unitxt/catalog/cards/universal_ner 2026-05-27T11:53:47,546 creating build/bdist.linux-armv7l/wheel/unitxt/catalog/cards/universal_ner/sv 2026-05-27T11:53:47,547 copying build/lib/unitxt/catalog/cards/universal_ner/sv/pud.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/universal_ner/sv 2026-05-27T11:53:47,550 copying build/lib/unitxt/catalog/cards/universal_ner/sv/talbanken.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/universal_ner/sv 2026-05-27T11:53:47,552 creating build/bdist.linux-armv7l/wheel/unitxt/catalog/cards/universal_ner/da 2026-05-27T11:53:47,553 copying build/lib/unitxt/catalog/cards/universal_ner/da/ddt.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/universal_ner/da 2026-05-27T11:53:47,556 creating build/bdist.linux-armv7l/wheel/unitxt/catalog/cards/universal_ner/sk 2026-05-27T11:53:47,557 copying build/lib/unitxt/catalog/cards/universal_ner/sk/snk.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/universal_ner/sk 2026-05-27T11:53:47,560 creating build/bdist.linux-armv7l/wheel/unitxt/catalog/cards/universal_ner/tl 2026-05-27T11:53:47,561 copying build/lib/unitxt/catalog/cards/universal_ner/tl/trg.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/universal_ner/tl 2026-05-27T11:53:47,563 copying build/lib/unitxt/catalog/cards/universal_ner/tl/ugnayan.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/universal_ner/tl 2026-05-27T11:53:47,566 creating build/bdist.linux-armv7l/wheel/unitxt/catalog/cards/universal_ner/sr 2026-05-27T11:53:47,567 copying build/lib/unitxt/catalog/cards/universal_ner/sr/set.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/universal_ner/sr 2026-05-27T11:53:47,570 creating build/bdist.linux-armv7l/wheel/unitxt/catalog/cards/universal_ner/en 2026-05-27T11:53:47,571 copying build/lib/unitxt/catalog/cards/universal_ner/en/ewt.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/universal_ner/en 2026-05-27T11:53:47,573 copying build/lib/unitxt/catalog/cards/universal_ner/en/pud.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/universal_ner/en 2026-05-27T11:53:47,576 creating build/bdist.linux-armv7l/wheel/unitxt/catalog/cards/universal_ner/de 2026-05-27T11:53:47,577 copying build/lib/unitxt/catalog/cards/universal_ner/de/pud.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/universal_ner/de 2026-05-27T11:53:47,580 creating build/bdist.linux-armv7l/wheel/unitxt/catalog/cards/universal_ner/ceb 2026-05-27T11:53:47,581 copying build/lib/unitxt/catalog/cards/universal_ner/ceb/gja.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/universal_ner/ceb 2026-05-27T11:53:47,583 creating build/bdist.linux-armv7l/wheel/unitxt/catalog/cards/universal_ner/ru 2026-05-27T11:53:47,585 copying build/lib/unitxt/catalog/cards/universal_ner/ru/pud.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/universal_ner/ru 2026-05-27T11:53:47,587 creating build/bdist.linux-armv7l/wheel/unitxt/catalog/cards/universal_ner/pt 2026-05-27T11:53:47,589 copying build/lib/unitxt/catalog/cards/universal_ner/pt/bosque.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/universal_ner/pt 2026-05-27T11:53:47,591 copying build/lib/unitxt/catalog/cards/universal_ner/pt/pud.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/universal_ner/pt 2026-05-27T11:53:47,593 creating build/bdist.linux-armv7l/wheel/unitxt/catalog/cards/universal_ner/hr 2026-05-27T11:53:47,594 copying build/lib/unitxt/catalog/cards/universal_ner/hr/set.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/universal_ner/hr 2026-05-27T11:53:47,596 creating build/bdist.linux-armv7l/wheel/unitxt/catalog/cards/universal_ner/zh 2026-05-27T11:53:47,598 copying build/lib/unitxt/catalog/cards/universal_ner/zh/gsd.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/universal_ner/zh 2026-05-27T11:53:47,600 copying build/lib/unitxt/catalog/cards/universal_ner/zh/gsdsimp.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/universal_ner/zh 2026-05-27T11:53:47,601 copying build/lib/unitxt/catalog/cards/universal_ner/zh/pud.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/universal_ner/zh 2026-05-27T11:53:47,604 creating build/bdist.linux-armv7l/wheel/unitxt/catalog/cards/mt 2026-05-27T11:53:47,605 creating build/bdist.linux-armv7l/wheel/unitxt/catalog/cards/mt/flores_101 2026-05-27T11:53:47,607 copying build/lib/unitxt/catalog/cards/mt/flores_101/eng_jpn.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/mt/flores_101 2026-05-27T11:53:47,609 copying build/lib/unitxt/catalog/cards/mt/flores_101/eng_spa.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/mt/flores_101 2026-05-27T11:53:47,611 copying build/lib/unitxt/catalog/cards/mt/flores_101/eng_kor.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/mt/flores_101 2026-05-27T11:53:47,612 copying build/lib/unitxt/catalog/cards/mt/flores_101/eng_fra.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/mt/flores_101 2026-05-27T11:53:47,614 copying build/lib/unitxt/catalog/cards/mt/flores_101/ara_eng.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/mt/flores_101 2026-05-27T11:53:47,616 copying build/lib/unitxt/catalog/cards/mt/flores_101/por_eng.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/mt/flores_101 2026-05-27T11:53:47,618 copying build/lib/unitxt/catalog/cards/mt/flores_101/kor_eng.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/mt/flores_101 2026-05-27T11:53:47,620 copying build/lib/unitxt/catalog/cards/mt/flores_101/jpn_eng.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/mt/flores_101 2026-05-27T11:53:47,622 copying build/lib/unitxt/catalog/cards/mt/flores_101/eng_ara.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/mt/flores_101 2026-05-27T11:53:47,624 copying build/lib/unitxt/catalog/cards/mt/flores_101/eng_por.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/mt/flores_101 2026-05-27T11:53:47,625 copying build/lib/unitxt/catalog/cards/mt/flores_101/deu_eng.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/mt/flores_101 2026-05-27T11:53:47,627 copying build/lib/unitxt/catalog/cards/mt/flores_101/fra_eng.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/mt/flores_101 2026-05-27T11:53:47,629 copying build/lib/unitxt/catalog/cards/mt/flores_101/ron_eng.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/mt/flores_101 2026-05-27T11:53:47,631 copying build/lib/unitxt/catalog/cards/mt/flores_101/eng_deu.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/mt/flores_101 2026-05-27T11:53:47,633 copying build/lib/unitxt/catalog/cards/mt/flores_101/eng_ron.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/mt/flores_101 2026-05-27T11:53:47,635 copying build/lib/unitxt/catalog/cards/mt/flores_101/spa_eng.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/mt/flores_101 2026-05-27T11:53:47,638 creating build/bdist.linux-armv7l/wheel/unitxt/catalog/cards/mmmu 2026-05-27T11:53:47,639 copying build/lib/unitxt/catalog/cards/mmmu/art.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/mmmu 2026-05-27T11:53:47,641 copying build/lib/unitxt/catalog/cards/mmmu/pharmacy.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/mmmu 2026-05-27T11:53:47,643 copying build/lib/unitxt/catalog/cards/mmmu/economics.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/mmmu 2026-05-27T11:53:47,645 copying build/lib/unitxt/catalog/cards/mmmu/clinical_medicine.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/mmmu 2026-05-27T11:53:47,647 copying build/lib/unitxt/catalog/cards/mmmu/chemistry.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/mmmu 2026-05-27T11:53:47,649 copying build/lib/unitxt/catalog/cards/mmmu/literature.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/mmmu 2026-05-27T11:53:47,651 copying build/lib/unitxt/catalog/cards/mmmu/physics.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/mmmu 2026-05-27T11:53:47,653 copying build/lib/unitxt/catalog/cards/mmmu/sociology.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/mmmu 2026-05-27T11:53:47,655 copying build/lib/unitxt/catalog/cards/mmmu/diagnostics_and_laboratory_medicine.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/mmmu 2026-05-27T11:53:47,657 copying build/lib/unitxt/catalog/cards/mmmu/computer_science.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/mmmu 2026-05-27T11:53:47,659 copying build/lib/unitxt/catalog/cards/mmmu/finance.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/mmmu 2026-05-27T11:53:47,661 copying build/lib/unitxt/catalog/cards/mmmu/music.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/mmmu 2026-05-27T11:53:47,663 copying build/lib/unitxt/catalog/cards/mmmu/mechanical_engineering.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/mmmu 2026-05-27T11:53:47,665 copying build/lib/unitxt/catalog/cards/mmmu/public_health.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/mmmu 2026-05-27T11:53:47,667 copying build/lib/unitxt/catalog/cards/mmmu/manage.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/mmmu 2026-05-27T11:53:47,669 copying build/lib/unitxt/catalog/cards/mmmu/psychology.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/mmmu 2026-05-27T11:53:47,671 copying build/lib/unitxt/catalog/cards/mmmu/math.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/mmmu 2026-05-27T11:53:47,673 copying build/lib/unitxt/catalog/cards/mmmu/geography.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/mmmu 2026-05-27T11:53:47,675 copying build/lib/unitxt/catalog/cards/mmmu/materials.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/mmmu 2026-05-27T11:53:47,677 copying build/lib/unitxt/catalog/cards/mmmu/history.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/mmmu 2026-05-27T11:53:47,679 copying build/lib/unitxt/catalog/cards/mmmu/art_theory.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/mmmu 2026-05-27T11:53:47,681 copying build/lib/unitxt/catalog/cards/mmmu/design.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/mmmu 2026-05-27T11:53:47,683 copying build/lib/unitxt/catalog/cards/mmmu/marketing.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/mmmu 2026-05-27T11:53:47,685 copying build/lib/unitxt/catalog/cards/mmmu/biology.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/mmmu 2026-05-27T11:53:47,687 copying build/lib/unitxt/catalog/cards/mmmu/basic_medical_science.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/mmmu 2026-05-27T11:53:47,689 copying build/lib/unitxt/catalog/cards/mmmu/accounting.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/mmmu 2026-05-27T11:53:47,690 copying build/lib/unitxt/catalog/cards/mmmu/architecture_and_engineering.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/mmmu 2026-05-27T11:53:47,692 copying build/lib/unitxt/catalog/cards/mmmu/agriculture.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/mmmu 2026-05-27T11:53:47,694 copying build/lib/unitxt/catalog/cards/mmmu/energy_and_power.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/mmmu 2026-05-27T11:53:47,696 copying build/lib/unitxt/catalog/cards/mmmu/electronics.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/mmmu 2026-05-27T11:53:47,698 copying build/lib/unitxt/catalog/cards/tab_fact.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards 2026-05-27T11:53:47,700 copying build/lib/unitxt/catalog/cards/dart.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards 2026-05-27T11:53:47,702 copying build/lib/unitxt/catalog/cards/financial_tweets.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards 2026-05-27T11:53:47,704 copying build/lib/unitxt/catalog/cards/attaq.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards 2026-05-27T11:53:47,707 creating build/bdist.linux-armv7l/wheel/unitxt/catalog/cards/winogrande 2026-05-27T11:53:47,708 copying build/lib/unitxt/catalog/cards/winogrande/xl.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/winogrande 2026-05-27T11:53:47,710 copying build/lib/unitxt/catalog/cards/winogrande/debiased.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/winogrande 2026-05-27T11:53:47,712 copying build/lib/unitxt/catalog/cards/winogrande/s.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/winogrande 2026-05-27T11:53:47,714 copying build/lib/unitxt/catalog/cards/winogrande/xs.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/winogrande 2026-05-27T11:53:47,716 copying build/lib/unitxt/catalog/cards/winogrande/l.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/winogrande 2026-05-27T11:53:47,718 copying build/lib/unitxt/catalog/cards/winogrande/m.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/winogrande 2026-05-27T11:53:47,720 creating build/bdist.linux-armv7l/wheel/unitxt/catalog/cards/wmt 2026-05-27T11:53:47,721 copying build/lib/unitxt/catalog/cards/wmt/en_fr.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/wmt 2026-05-27T11:53:47,723 copying build/lib/unitxt/catalog/cards/wmt/en_ro.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/wmt 2026-05-27T11:53:47,725 copying build/lib/unitxt/catalog/cards/wmt/en_de.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/wmt 2026-05-27T11:53:47,728 creating build/bdist.linux-armv7l/wheel/unitxt/catalog/cards/tablebench_fact_checking 2026-05-27T11:53:47,730 copying build/lib/unitxt/catalog/cards/tablebench_fact_checking/legacy.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/tablebench_fact_checking 2026-05-27T11:53:47,733 creating build/bdist.linux-armv7l/wheel/unitxt/catalog/cards/tablebench_numerical_reasoning 2026-05-27T11:53:47,734 copying build/lib/unitxt/catalog/cards/tablebench_numerical_reasoning/legacy.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/tablebench_numerical_reasoning 2026-05-27T11:53:47,736 copying build/lib/unitxt/catalog/cards/chart_qa_lmms_eval.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards 2026-05-27T11:53:47,738 creating build/bdist.linux-armv7l/wheel/unitxt/catalog/cards/wnli 2026-05-27T11:53:47,740 copying build/lib/unitxt/catalog/cards/wnli/truthfulness.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/wnli 2026-05-27T11:53:47,742 copying build/lib/unitxt/catalog/cards/qtsumm.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards 2026-05-27T11:53:47,744 copying build/lib/unitxt/catalog/cards/mrpc.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards 2026-05-27T11:53:47,746 copying build/lib/unitxt/catalog/cards/qnli.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards 2026-05-27T11:53:47,748 copying build/lib/unitxt/catalog/cards/simple_qa.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards 2026-05-27T11:53:47,750 creating build/bdist.linux-armv7l/wheel/unitxt/catalog/cards/rag 2026-05-27T11:53:47,752 creating build/bdist.linux-armv7l/wheel/unitxt/catalog/cards/rag/documents 2026-05-27T11:53:47,754 creating build/bdist.linux-armv7l/wheel/unitxt/catalog/cards/rag/documents/real_mm_rag_fin_report 2026-05-27T11:53:47,755 copying build/lib/unitxt/catalog/cards/rag/documents/real_mm_rag_fin_report/en.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/rag/documents/real_mm_rag_fin_report 2026-05-27T11:53:47,758 creating build/bdist.linux-armv7l/wheel/unitxt/catalog/cards/rag/documents/miniwiki 2026-05-27T11:53:47,759 copying build/lib/unitxt/catalog/cards/rag/documents/miniwiki/en.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/rag/documents/miniwiki 2026-05-27T11:53:47,762 creating build/bdist.linux-armv7l/wheel/unitxt/catalog/cards/rag/documents/real_mm_rag_fin_slides 2026-05-27T11:53:47,763 copying build/lib/unitxt/catalog/cards/rag/documents/real_mm_rag_fin_slides/en.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/rag/documents/real_mm_rag_fin_slides 2026-05-27T11:53:47,765 creating build/bdist.linux-armv7l/wheel/unitxt/catalog/cards/rag/documents/hotpotqa 2026-05-27T11:53:47,767 copying build/lib/unitxt/catalog/cards/rag/documents/hotpotqa/en.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/rag/documents/hotpotqa 2026-05-27T11:53:47,769 creating build/bdist.linux-armv7l/wheel/unitxt/catalog/cards/rag/documents/watsonxqa 2026-05-27T11:53:47,770 copying build/lib/unitxt/catalog/cards/rag/documents/watsonxqa/en.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/rag/documents/watsonxqa 2026-05-27T11:53:47,773 creating build/bdist.linux-armv7l/wheel/unitxt/catalog/cards/rag/documents/bioasq 2026-05-27T11:53:47,774 copying build/lib/unitxt/catalog/cards/rag/documents/bioasq/en.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/rag/documents/bioasq 2026-05-27T11:53:47,776 creating build/bdist.linux-armv7l/wheel/unitxt/catalog/cards/rag/documents/real_mm_rag_tech_slides 2026-05-27T11:53:47,777 copying build/lib/unitxt/catalog/cards/rag/documents/real_mm_rag_tech_slides/en.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/rag/documents/real_mm_rag_tech_slides 2026-05-27T11:53:47,780 creating build/bdist.linux-armv7l/wheel/unitxt/catalog/cards/rag/documents/real_mm_rag_tech_report 2026-05-27T11:53:47,781 copying build/lib/unitxt/catalog/cards/rag/documents/real_mm_rag_tech_report/en.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/rag/documents/real_mm_rag_tech_report 2026-05-27T11:53:47,783 creating build/bdist.linux-armv7l/wheel/unitxt/catalog/cards/rag/documents/clap_nq 2026-05-27T11:53:47,785 copying build/lib/unitxt/catalog/cards/rag/documents/clap_nq/en.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/rag/documents/clap_nq 2026-05-27T11:53:47,787 copying build/lib/unitxt/catalog/cards/rag/mtrag.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/rag 2026-05-27T11:53:47,789 creating build/bdist.linux-armv7l/wheel/unitxt/catalog/cards/rag/benchmark 2026-05-27T11:53:47,791 creating build/bdist.linux-armv7l/wheel/unitxt/catalog/cards/rag/benchmark/real_mm_rag_fin_report 2026-05-27T11:53:47,792 copying build/lib/unitxt/catalog/cards/rag/benchmark/real_mm_rag_fin_report/en.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/rag/benchmark/real_mm_rag_fin_report 2026-05-27T11:53:47,795 creating build/bdist.linux-armv7l/wheel/unitxt/catalog/cards/rag/benchmark/miniwiki 2026-05-27T11:53:47,796 copying build/lib/unitxt/catalog/cards/rag/benchmark/miniwiki/en.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/rag/benchmark/miniwiki 2026-05-27T11:53:47,799 creating build/bdist.linux-armv7l/wheel/unitxt/catalog/cards/rag/benchmark/real_mm_rag_fin_slides 2026-05-27T11:53:47,800 copying build/lib/unitxt/catalog/cards/rag/benchmark/real_mm_rag_fin_slides/en.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/rag/benchmark/real_mm_rag_fin_slides 2026-05-27T11:53:47,803 creating build/bdist.linux-armv7l/wheel/unitxt/catalog/cards/rag/benchmark/hotpotqa 2026-05-27T11:53:47,804 copying build/lib/unitxt/catalog/cards/rag/benchmark/hotpotqa/en.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/rag/benchmark/hotpotqa 2026-05-27T11:53:47,807 creating build/bdist.linux-armv7l/wheel/unitxt/catalog/cards/rag/benchmark/watsonxqa 2026-05-27T11:53:47,808 copying build/lib/unitxt/catalog/cards/rag/benchmark/watsonxqa/en.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/rag/benchmark/watsonxqa 2026-05-27T11:53:47,811 creating build/bdist.linux-armv7l/wheel/unitxt/catalog/cards/rag/benchmark/bioasq 2026-05-27T11:53:47,813 copying build/lib/unitxt/catalog/cards/rag/benchmark/bioasq/en.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/rag/benchmark/bioasq 2026-05-27T11:53:47,816 creating build/bdist.linux-armv7l/wheel/unitxt/catalog/cards/rag/benchmark/real_mm_rag_tech_slides 2026-05-27T11:53:47,818 copying build/lib/unitxt/catalog/cards/rag/benchmark/real_mm_rag_tech_slides/en.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/rag/benchmark/real_mm_rag_tech_slides 2026-05-27T11:53:47,820 creating build/bdist.linux-armv7l/wheel/unitxt/catalog/cards/rag/benchmark/real_mm_rag_tech_report 2026-05-27T11:53:47,822 copying build/lib/unitxt/catalog/cards/rag/benchmark/real_mm_rag_tech_report/en.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/rag/benchmark/real_mm_rag_tech_report 2026-05-27T11:53:47,824 creating build/bdist.linux-armv7l/wheel/unitxt/catalog/cards/rag/benchmark/clap_nq 2026-05-27T11:53:47,825 copying build/lib/unitxt/catalog/cards/rag/benchmark/clap_nq/en.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/rag/benchmark/clap_nq 2026-05-27T11:53:47,828 creating build/bdist.linux-armv7l/wheel/unitxt/catalog/cards/rag/response_generation 2026-05-27T11:53:47,830 creating build/bdist.linux-armv7l/wheel/unitxt/catalog/cards/rag/response_generation/train 2026-05-27T11:53:47,831 copying build/lib/unitxt/catalog/cards/rag/response_generation/train/open_australian_legal_qa.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/rag/response_generation/train 2026-05-27T11:53:47,833 copying build/lib/unitxt/catalog/cards/rag/response_generation/train/clapnq.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/rag/response_generation/train 2026-05-27T11:53:47,836 creating build/bdist.linux-armv7l/wheel/unitxt/catalog/cards/rag/response_generation/ragbench 2026-05-27T11:53:47,837 copying build/lib/unitxt/catalog/cards/rag/response_generation/ragbench/expertqa.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/rag/response_generation/ragbench 2026-05-27T11:53:47,839 copying build/lib/unitxt/catalog/cards/rag/response_generation/ragbench/cuad.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/rag/response_generation/ragbench 2026-05-27T11:53:47,841 copying build/lib/unitxt/catalog/cards/rag/response_generation/ragbench/hotpotqa.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/rag/response_generation/ragbench 2026-05-27T11:53:47,843 copying build/lib/unitxt/catalog/cards/rag/response_generation/ragbench/pubmedqa.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/rag/response_generation/ragbench 2026-05-27T11:53:47,845 copying build/lib/unitxt/catalog/cards/rag/response_generation/ragbench/techqa.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/rag/response_generation/ragbench 2026-05-27T11:53:47,847 copying build/lib/unitxt/catalog/cards/rag/response_generation/ragbench/hagrid.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/rag/response_generation/ragbench 2026-05-27T11:53:47,848 copying build/lib/unitxt/catalog/cards/rag/response_generation/ragbench/msmarco.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/rag/response_generation/ragbench 2026-05-27T11:53:47,850 copying build/lib/unitxt/catalog/cards/rag/response_generation/ragbench/delucionqa.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/rag/response_generation/ragbench 2026-05-27T11:53:47,852 copying build/lib/unitxt/catalog/cards/rag/response_generation/ragbench/finqa.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/rag/response_generation/ragbench 2026-05-27T11:53:47,854 copying build/lib/unitxt/catalog/cards/rag/response_generation/ragbench/covidqa.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/rag/response_generation/ragbench 2026-05-27T11:53:47,856 copying build/lib/unitxt/catalog/cards/rag/response_generation/ragbench/tatqa.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/rag/response_generation/ragbench 2026-05-27T11:53:47,858 copying build/lib/unitxt/catalog/cards/rag/response_generation/ragbench/emanual.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/rag/response_generation/ragbench 2026-05-27T11:53:47,861 creating build/bdist.linux-armv7l/wheel/unitxt/catalog/cards/rag/response_generation/chat_rag_bench 2026-05-27T11:53:47,862 creating build/bdist.linux-armv7l/wheel/unitxt/catalog/cards/rag/response_generation/chat_rag_bench/train 2026-05-27T11:53:47,864 creating build/bdist.linux-armv7l/wheel/unitxt/catalog/cards/rag/response_generation/chat_rag_bench/train/user_assistant_format 2026-05-27T11:53:47,865 copying build/lib/unitxt/catalog/cards/rag/response_generation/chat_rag_bench/train/user_assistant_format/doc2dial.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/rag/response_generation/chat_rag_bench/train/user_assistant_format 2026-05-27T11:53:47,868 copying build/lib/unitxt/catalog/cards/rag/response_generation/chat_rag_bench/train/user_assistant_format/doqa_travel.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/rag/response_generation/chat_rag_bench/train/user_assistant_format 2026-05-27T11:53:47,870 copying build/lib/unitxt/catalog/cards/rag/response_generation/chat_rag_bench/train/user_assistant_format/hybridial.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/rag/response_generation/chat_rag_bench/train/user_assistant_format 2026-05-27T11:53:47,872 copying build/lib/unitxt/catalog/cards/rag/response_generation/chat_rag_bench/train/user_assistant_format/doqa_cooking.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/rag/response_generation/chat_rag_bench/train/user_assistant_format 2026-05-27T11:53:47,874 copying build/lib/unitxt/catalog/cards/rag/response_generation/chat_rag_bench/train/user_assistant_format/doqa_movies.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/rag/response_generation/chat_rag_bench/train/user_assistant_format 2026-05-27T11:53:47,877 creating build/bdist.linux-armv7l/wheel/unitxt/catalog/cards/rag/response_generation/chat_rag_bench/user_assistant_format 2026-05-27T11:53:47,878 copying build/lib/unitxt/catalog/cards/rag/response_generation/chat_rag_bench/user_assistant_format/doc2dial.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/rag/response_generation/chat_rag_bench/user_assistant_format 2026-05-27T11:53:47,880 copying build/lib/unitxt/catalog/cards/rag/response_generation/chat_rag_bench/user_assistant_format/doqa_travel.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/rag/response_generation/chat_rag_bench/user_assistant_format 2026-05-27T11:53:47,882 copying build/lib/unitxt/catalog/cards/rag/response_generation/chat_rag_bench/user_assistant_format/hybridial.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/rag/response_generation/chat_rag_bench/user_assistant_format 2026-05-27T11:53:47,884 copying build/lib/unitxt/catalog/cards/rag/response_generation/chat_rag_bench/user_assistant_format/doqa_cooking.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/rag/response_generation/chat_rag_bench/user_assistant_format 2026-05-27T11:53:47,886 copying build/lib/unitxt/catalog/cards/rag/response_generation/chat_rag_bench/user_assistant_format/doqa_movies.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/rag/response_generation/chat_rag_bench/user_assistant_format 2026-05-27T11:53:47,888 copying build/lib/unitxt/catalog/cards/rag/response_generation/clapnq.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/rag/response_generation 2026-05-27T11:53:47,890 creating build/bdist.linux-armv7l/wheel/unitxt/catalog/cards/rag/mtrag 2026-05-27T11:53:47,892 creating build/bdist.linux-armv7l/wheel/unitxt/catalog/cards/rag/mtrag/documents 2026-05-27T11:53:47,893 copying build/lib/unitxt/catalog/cards/rag/mtrag/documents/fiqa.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/rag/mtrag/documents 2026-05-27T11:53:47,896 copying build/lib/unitxt/catalog/cards/rag/mtrag/documents/clapnq.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/rag/mtrag/documents 2026-05-27T11:53:47,899 copying build/lib/unitxt/catalog/cards/rag/mtrag/documents/cloud.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/rag/mtrag/documents 2026-05-27T11:53:47,901 copying build/lib/unitxt/catalog/cards/rag/mtrag/documents/govt.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/rag/mtrag/documents 2026-05-27T11:53:47,904 creating build/bdist.linux-armv7l/wheel/unitxt/catalog/cards/CFPB 2026-05-27T11:53:47,905 creating build/bdist.linux-armv7l/wheel/unitxt/catalog/cards/CFPB/product 2026-05-27T11:53:47,907 copying build/lib/unitxt/catalog/cards/CFPB/product/watsonx.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/CFPB/product 2026-05-27T11:53:47,909 copying build/lib/unitxt/catalog/cards/CFPB/product/2023.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/CFPB/product 2026-05-27T11:53:47,912 copying build/lib/unitxt/catalog/cards/almost_evil.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards 2026-05-27T11:53:47,914 copying build/lib/unitxt/catalog/cards/race_all.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards 2026-05-27T11:53:47,916 copying build/lib/unitxt/catalog/cards/mnli.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards 2026-05-27T11:53:47,918 copying build/lib/unitxt/catalog/cards/tablebench_data_analysis.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards 2026-05-27T11:53:47,920 copying build/lib/unitxt/catalog/cards/attaq_500.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards 2026-05-27T11:53:47,925 creating build/bdist.linux-armv7l/wheel/unitxt/catalog/cards/mmlu 2026-05-27T11:53:47,926 copying build/lib/unitxt/catalog/cards/mmlu/moral_disputes.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/mmlu 2026-05-27T11:53:47,928 copying build/lib/unitxt/catalog/cards/mmlu/high_school_biology.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/mmlu 2026-05-27T11:53:47,930 copying build/lib/unitxt/catalog/cards/mmlu/jurisprudence.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/mmlu 2026-05-27T11:53:47,932 copying build/lib/unitxt/catalog/cards/mmlu/logical_fallacies.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/mmlu 2026-05-27T11:53:47,934 copying build/lib/unitxt/catalog/cards/mmlu/college_chemistry.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/mmlu 2026-05-27T11:53:47,937 copying build/lib/unitxt/catalog/cards/mmlu/high_school_government_and_politics.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/mmlu 2026-05-27T11:53:47,939 copying build/lib/unitxt/catalog/cards/mmlu/college_mathematics.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/mmlu 2026-05-27T11:53:47,941 copying build/lib/unitxt/catalog/cards/mmlu/econometrics.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/mmlu 2026-05-27T11:53:47,943 copying build/lib/unitxt/catalog/cards/mmlu/high_school_macroeconomics.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/mmlu 2026-05-27T11:53:47,945 copying build/lib/unitxt/catalog/cards/mmlu/high_school_psychology.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/mmlu 2026-05-27T11:53:47,947 copying build/lib/unitxt/catalog/cards/mmlu/computer_security.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/mmlu 2026-05-27T11:53:47,949 copying build/lib/unitxt/catalog/cards/mmlu/sociology.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/mmlu 2026-05-27T11:53:47,951 copying build/lib/unitxt/catalog/cards/mmlu/nutrition.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/mmlu 2026-05-27T11:53:47,953 copying build/lib/unitxt/catalog/cards/mmlu/professional_medicine.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/mmlu 2026-05-27T11:53:47,955 copying build/lib/unitxt/catalog/cards/mmlu/college_biology.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/mmlu 2026-05-27T11:53:47,957 copying build/lib/unitxt/catalog/cards/mmlu/anatomy.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/mmlu 2026-05-27T11:53:47,959 copying build/lib/unitxt/catalog/cards/mmlu/professional_law.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/mmlu 2026-05-27T11:53:47,961 copying build/lib/unitxt/catalog/cards/mmlu/machine_learning.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/mmlu 2026-05-27T11:53:47,963 copying build/lib/unitxt/catalog/cards/mmlu/international_law.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/mmlu 2026-05-27T11:53:47,965 copying build/lib/unitxt/catalog/cards/mmlu/medical_genetics.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/mmlu 2026-05-27T11:53:47,967 copying build/lib/unitxt/catalog/cards/mmlu/high_school_computer_science.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/mmlu 2026-05-27T11:53:47,968 copying build/lib/unitxt/catalog/cards/mmlu/clinical_knowledge.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/mmlu 2026-05-27T11:53:47,970 copying build/lib/unitxt/catalog/cards/mmlu/college_physics.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/mmlu 2026-05-27T11:53:47,972 copying build/lib/unitxt/catalog/cards/mmlu/global_facts.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/mmlu 2026-05-27T11:53:47,974 copying build/lib/unitxt/catalog/cards/mmlu/college_computer_science.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/mmlu 2026-05-27T11:53:47,975 copying build/lib/unitxt/catalog/cards/mmlu/us_foreign_policy.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/mmlu 2026-05-27T11:53:47,977 copying build/lib/unitxt/catalog/cards/mmlu/professional_accounting.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/mmlu 2026-05-27T11:53:47,979 copying build/lib/unitxt/catalog/cards/mmlu/professional_psychology.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/mmlu 2026-05-27T11:53:47,981 copying build/lib/unitxt/catalog/cards/mmlu/philosophy.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/mmlu 2026-05-27T11:53:47,983 copying build/lib/unitxt/catalog/cards/mmlu/elementary_mathematics.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/mmlu 2026-05-27T11:53:47,986 copying build/lib/unitxt/catalog/cards/mmlu/conceptual_physics.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/mmlu 2026-05-27T11:53:47,988 copying build/lib/unitxt/catalog/cards/mmlu/high_school_geography.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/mmlu 2026-05-27T11:53:47,990 copying build/lib/unitxt/catalog/cards/mmlu/human_aging.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/mmlu 2026-05-27T11:53:47,992 copying build/lib/unitxt/catalog/cards/mmlu/electrical_engineering.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/mmlu 2026-05-27T11:53:47,995 copying build/lib/unitxt/catalog/cards/mmlu/management.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/mmlu 2026-05-27T11:53:47,997 copying build/lib/unitxt/catalog/cards/mmlu/high_school_world_history.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/mmlu 2026-05-27T11:53:47,999 copying build/lib/unitxt/catalog/cards/mmlu/marketing.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/mmlu 2026-05-27T11:53:48,001 copying build/lib/unitxt/catalog/cards/mmlu/high_school_european_history.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/mmlu 2026-05-27T11:53:48,003 copying build/lib/unitxt/catalog/cards/mmlu/astronomy.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/mmlu 2026-05-27T11:53:48,005 copying build/lib/unitxt/catalog/cards/mmlu/high_school_physics.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/mmlu 2026-05-27T11:53:48,007 copying build/lib/unitxt/catalog/cards/mmlu/public_relations.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/mmlu 2026-05-27T11:53:48,009 copying build/lib/unitxt/catalog/cards/mmlu/high_school_microeconomics.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/mmlu 2026-05-27T11:53:48,011 copying build/lib/unitxt/catalog/cards/mmlu/virology.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/mmlu 2026-05-27T11:53:48,013 copying build/lib/unitxt/catalog/cards/mmlu/high_school_us_history.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/mmlu 2026-05-27T11:53:48,015 copying build/lib/unitxt/catalog/cards/mmlu/high_school_statistics.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/mmlu 2026-05-27T11:53:48,017 copying build/lib/unitxt/catalog/cards/mmlu/miscellaneous.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/mmlu 2026-05-27T11:53:48,019 copying build/lib/unitxt/catalog/cards/mmlu/high_school_mathematics.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/mmlu 2026-05-27T11:53:48,021 copying build/lib/unitxt/catalog/cards/mmlu/formal_logic.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/mmlu 2026-05-27T11:53:48,023 copying build/lib/unitxt/catalog/cards/mmlu/high_school_chemistry.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/mmlu 2026-05-27T11:53:48,025 copying build/lib/unitxt/catalog/cards/mmlu/abstract_algebra.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/mmlu 2026-05-27T11:53:48,027 copying build/lib/unitxt/catalog/cards/mmlu/moral_scenarios.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/mmlu 2026-05-27T11:53:48,029 copying build/lib/unitxt/catalog/cards/mmlu/world_religions.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/mmlu 2026-05-27T11:53:48,030 copying build/lib/unitxt/catalog/cards/mmlu/business_ethics.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/mmlu 2026-05-27T11:53:48,032 copying build/lib/unitxt/catalog/cards/mmlu/security_studies.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/mmlu 2026-05-27T11:53:48,034 copying build/lib/unitxt/catalog/cards/mmlu/college_medicine.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/mmlu 2026-05-27T11:53:48,036 copying build/lib/unitxt/catalog/cards/mmlu/human_sexuality.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/mmlu 2026-05-27T11:53:48,038 copying build/lib/unitxt/catalog/cards/mmlu/prehistory.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/mmlu 2026-05-27T11:53:48,040 creating build/bdist.linux-armv7l/wheel/unitxt/catalog/cards/coqa 2026-05-27T11:53:48,041 copying build/lib/unitxt/catalog/cards/coqa/qa.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/coqa 2026-05-27T11:53:48,043 copying build/lib/unitxt/catalog/cards/coqa/multi_turn.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/coqa 2026-05-27T11:53:48,045 copying build/lib/unitxt/catalog/cards/coqa/completion.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/coqa 2026-05-27T11:53:48,047 copying build/lib/unitxt/catalog/cards/banking77.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards 2026-05-27T11:53:48,050 copying build/lib/unitxt/catalog/cards/medical_abstracts.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards 2026-05-27T11:53:48,051 copying build/lib/unitxt/catalog/cards/numeric_nlg.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards 2026-05-27T11:53:48,056 creating build/bdist.linux-armv7l/wheel/unitxt/catalog/cards/belebele 2026-05-27T11:53:48,057 copying build/lib/unitxt/catalog/cards/belebele/sun_latn.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/belebele 2026-05-27T11:53:48,059 copying build/lib/unitxt/catalog/cards/belebele/lit_latn.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/belebele 2026-05-27T11:53:48,061 copying build/lib/unitxt/catalog/cards/belebele/ron_latn.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/belebele 2026-05-27T11:53:48,063 copying build/lib/unitxt/catalog/cards/belebele/pes_arab.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/belebele 2026-05-27T11:53:48,065 copying build/lib/unitxt/catalog/cards/belebele/kor_hang.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/belebele 2026-05-27T11:53:48,068 copying build/lib/unitxt/catalog/cards/belebele/tso_latn.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/belebele 2026-05-27T11:53:48,070 copying build/lib/unitxt/catalog/cards/belebele/asm_beng.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/belebele 2026-05-27T11:53:48,073 copying build/lib/unitxt/catalog/cards/belebele/sin_latn.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/belebele 2026-05-27T11:53:48,075 copying build/lib/unitxt/catalog/cards/belebele/bod_tibt.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/belebele 2026-05-27T11:53:48,077 copying build/lib/unitxt/catalog/cards/belebele/hrv_latn.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/belebele 2026-05-27T11:53:48,079 copying build/lib/unitxt/catalog/cards/belebele/kan_knda.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/belebele 2026-05-27T11:53:48,081 copying build/lib/unitxt/catalog/cards/belebele/ita_latn.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/belebele 2026-05-27T11:53:48,082 copying build/lib/unitxt/catalog/cards/belebele/arb_arab.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/belebele 2026-05-27T11:53:48,084 copying build/lib/unitxt/catalog/cards/belebele/deu_latn.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/belebele 2026-05-27T11:53:48,086 copying build/lib/unitxt/catalog/cards/belebele/apc_arab.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/belebele 2026-05-27T11:53:48,088 copying build/lib/unitxt/catalog/cards/belebele/kac_latn.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/belebele 2026-05-27T11:53:48,090 copying build/lib/unitxt/catalog/cards/belebele/sin_sinh.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/belebele 2026-05-27T11:53:48,092 copying build/lib/unitxt/catalog/cards/belebele/pbt_arab.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/belebele 2026-05-27T11:53:48,094 copying build/lib/unitxt/catalog/cards/belebele/lug_latn.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/belebele 2026-05-27T11:53:48,096 copying build/lib/unitxt/catalog/cards/belebele/spa_latn.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/belebele 2026-05-27T11:53:48,098 copying build/lib/unitxt/catalog/cards/belebele/slk_latn.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/belebele 2026-05-27T11:53:48,099 copying build/lib/unitxt/catalog/cards/belebele/urd_latn.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/belebele 2026-05-27T11:53:48,101 copying build/lib/unitxt/catalog/cards/belebele/nya_latn.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/belebele 2026-05-27T11:53:48,103 copying build/lib/unitxt/catalog/cards/belebele/dan_latn.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/belebele 2026-05-27T11:53:48,105 copying build/lib/unitxt/catalog/cards/belebele/hye_armn.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/belebele 2026-05-27T11:53:48,107 copying build/lib/unitxt/catalog/cards/belebele/sna_latn.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/belebele 2026-05-27T11:53:48,109 copying build/lib/unitxt/catalog/cards/belebele/mri_latn.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/belebele 2026-05-27T11:53:48,111 copying build/lib/unitxt/catalog/cards/belebele/cat_latn.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/belebele 2026-05-27T11:53:48,113 copying build/lib/unitxt/catalog/cards/belebele/urd_arab.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/belebele 2026-05-27T11:53:48,115 copying build/lib/unitxt/catalog/cards/belebele/kir_cyrl.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/belebele 2026-05-27T11:53:48,117 copying build/lib/unitxt/catalog/cards/belebele/tgk_cyrl.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/belebele 2026-05-27T11:53:48,119 copying build/lib/unitxt/catalog/cards/belebele/khk_cyrl.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/belebele 2026-05-27T11:53:48,121 copying build/lib/unitxt/catalog/cards/belebele/ben_latn.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/belebele 2026-05-27T11:53:48,123 copying build/lib/unitxt/catalog/cards/belebele/tam_taml.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/belebele 2026-05-27T11:53:48,125 copying build/lib/unitxt/catalog/cards/belebele/jav_latn.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/belebele 2026-05-27T11:53:48,127 copying build/lib/unitxt/catalog/cards/belebele/fra_latn.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/belebele 2026-05-27T11:53:48,129 copying build/lib/unitxt/catalog/cards/belebele/ary_arab.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/belebele 2026-05-27T11:53:48,131 copying build/lib/unitxt/catalog/cards/belebele/afr_latn.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/belebele 2026-05-27T11:53:48,133 copying build/lib/unitxt/catalog/cards/belebele/plt_latn.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/belebele 2026-05-27T11:53:48,135 copying build/lib/unitxt/catalog/cards/belebele/hat_latn.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/belebele 2026-05-27T11:53:48,137 copying build/lib/unitxt/catalog/cards/belebele/war_latn.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/belebele 2026-05-27T11:53:48,139 copying build/lib/unitxt/catalog/cards/belebele/kaz_cyrl.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/belebele 2026-05-27T11:53:48,141 copying build/lib/unitxt/catalog/cards/belebele/ceb_latn.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/belebele 2026-05-27T11:53:48,143 copying build/lib/unitxt/catalog/cards/belebele/eus_latn.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/belebele 2026-05-27T11:53:48,145 copying build/lib/unitxt/catalog/cards/belebele/tir_ethi.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/belebele 2026-05-27T11:53:48,147 copying build/lib/unitxt/catalog/cards/belebele/kea_latn.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/belebele 2026-05-27T11:53:48,149 copying build/lib/unitxt/catalog/cards/belebele/fuv_latn.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/belebele 2026-05-27T11:53:48,151 copying build/lib/unitxt/catalog/cards/belebele/mkd_cyrl.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/belebele 2026-05-27T11:53:48,153 copying build/lib/unitxt/catalog/cards/belebele/ilo_latn.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/belebele 2026-05-27T11:53:48,155 copying build/lib/unitxt/catalog/cards/belebele/khm_khmr.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/belebele 2026-05-27T11:53:48,157 copying build/lib/unitxt/catalog/cards/belebele/srp_cyrl.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/belebele 2026-05-27T11:53:48,159 copying build/lib/unitxt/catalog/cards/belebele/zho_hant.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/belebele 2026-05-27T11:53:48,162 copying build/lib/unitxt/catalog/cards/belebele/lvs_latn.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/belebele 2026-05-27T11:53:48,164 copying build/lib/unitxt/catalog/cards/belebele/snd_arab.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/belebele 2026-05-27T11:53:48,167 copying build/lib/unitxt/catalog/cards/belebele/lin_latn.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/belebele 2026-05-27T11:53:48,170 copying build/lib/unitxt/catalog/cards/belebele/slv_latn.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/belebele 2026-05-27T11:53:48,172 copying build/lib/unitxt/catalog/cards/belebele/nob_latn.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/belebele 2026-05-27T11:53:48,174 copying build/lib/unitxt/catalog/cards/belebele/ukr_cyrl.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/belebele 2026-05-27T11:53:48,176 copying build/lib/unitxt/catalog/cards/belebele/swe_latn.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/belebele 2026-05-27T11:53:48,178 copying build/lib/unitxt/catalog/cards/belebele/ory_orya.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/belebele 2026-05-27T11:53:48,180 copying build/lib/unitxt/catalog/cards/belebele/ssw_latn.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/belebele 2026-05-27T11:53:48,182 copying build/lib/unitxt/catalog/cards/belebele/tsn_latn.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/belebele 2026-05-27T11:53:48,184 copying build/lib/unitxt/catalog/cards/belebele/mya_mymr.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/belebele 2026-05-27T11:53:48,186 copying build/lib/unitxt/catalog/cards/belebele/pol_latn.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/belebele 2026-05-27T11:53:48,188 copying build/lib/unitxt/catalog/cards/belebele/tel_telu.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/belebele 2026-05-27T11:53:48,190 copying build/lib/unitxt/catalog/cards/belebele/xho_latn.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/belebele 2026-05-27T11:53:48,191 copying build/lib/unitxt/catalog/cards/belebele/shn_mymr.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/belebele 2026-05-27T11:53:48,193 copying build/lib/unitxt/catalog/cards/belebele/ben_beng.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/belebele 2026-05-27T11:53:48,195 copying build/lib/unitxt/catalog/cards/belebele/mar_deva.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/belebele 2026-05-27T11:53:48,197 copying build/lib/unitxt/catalog/cards/belebele/hau_latn.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/belebele 2026-05-27T11:53:48,199 copying build/lib/unitxt/catalog/cards/belebele/hin_latn.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/belebele 2026-05-27T11:53:48,201 copying build/lib/unitxt/catalog/cards/belebele/npi_deva.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/belebele 2026-05-27T11:53:48,203 copying build/lib/unitxt/catalog/cards/belebele/wol_latn.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/belebele 2026-05-27T11:53:48,205 copying build/lib/unitxt/catalog/cards/belebele/pan_guru.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/belebele 2026-05-27T11:53:48,207 copying build/lib/unitxt/catalog/cards/belebele/ell_grek.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/belebele 2026-05-27T11:53:48,208 copying build/lib/unitxt/catalog/cards/belebele/kat_geor.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/belebele 2026-05-27T11:53:48,210 copying build/lib/unitxt/catalog/cards/belebele/ckb_arab.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/belebele 2026-05-27T11:53:48,212 copying build/lib/unitxt/catalog/cards/belebele/tgl_latn.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/belebele 2026-05-27T11:53:48,214 copying build/lib/unitxt/catalog/cards/belebele/kin_latn.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/belebele 2026-05-27T11:53:48,216 copying build/lib/unitxt/catalog/cards/belebele/hun_latn.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/belebele 2026-05-27T11:53:48,218 copying build/lib/unitxt/catalog/cards/belebele/azj_latn.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/belebele 2026-05-27T11:53:48,220 copying build/lib/unitxt/catalog/cards/belebele/rus_cyrl.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/belebele 2026-05-27T11:53:48,222 copying build/lib/unitxt/catalog/cards/belebele/bul_cyrl.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/belebele 2026-05-27T11:53:48,224 copying build/lib/unitxt/catalog/cards/belebele/vie_latn.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/belebele 2026-05-27T11:53:48,226 copying build/lib/unitxt/catalog/cards/belebele/nso_latn.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/belebele 2026-05-27T11:53:48,228 copying build/lib/unitxt/catalog/cards/belebele/nld_latn.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/belebele 2026-05-27T11:53:48,230 copying build/lib/unitxt/catalog/cards/belebele/grn_latn.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/belebele 2026-05-27T11:53:48,232 copying build/lib/unitxt/catalog/cards/belebele/yor_latn.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/belebele 2026-05-27T11:53:48,234 copying build/lib/unitxt/catalog/cards/belebele/uzn_latn.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/belebele 2026-05-27T11:53:48,236 copying build/lib/unitxt/catalog/cards/belebele/npi_latn.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/belebele 2026-05-27T11:53:48,238 copying build/lib/unitxt/catalog/cards/belebele/amh_ethi.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/belebele 2026-05-27T11:53:48,241 copying build/lib/unitxt/catalog/cards/belebele/ces_latn.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/belebele 2026-05-27T11:53:48,242 copying build/lib/unitxt/catalog/cards/belebele/som_latn.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/belebele 2026-05-27T11:53:48,244 copying build/lib/unitxt/catalog/cards/belebele/est_latn.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/belebele 2026-05-27T11:53:48,246 copying build/lib/unitxt/catalog/cards/belebele/jpn_jpan.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/belebele 2026-05-27T11:53:48,248 copying build/lib/unitxt/catalog/cards/belebele/arz_arab.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/belebele 2026-05-27T11:53:48,250 copying build/lib/unitxt/catalog/cards/belebele/por_latn.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/belebele 2026-05-27T11:53:48,252 copying build/lib/unitxt/catalog/cards/belebele/mlt_latn.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/belebele 2026-05-27T11:53:48,255 copying build/lib/unitxt/catalog/cards/belebele/ind_latn.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/belebele 2026-05-27T11:53:48,257 copying build/lib/unitxt/catalog/cards/belebele/als_latn.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/belebele 2026-05-27T11:53:48,260 copying build/lib/unitxt/catalog/cards/belebele/luo_latn.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/belebele 2026-05-27T11:53:48,262 copying build/lib/unitxt/catalog/cards/belebele/eng_latn.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/belebele 2026-05-27T11:53:48,264 copying build/lib/unitxt/catalog/cards/belebele/bam_latn.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/belebele 2026-05-27T11:53:48,266 copying build/lib/unitxt/catalog/cards/belebele/mal_mlym.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/belebele 2026-05-27T11:53:48,268 copying build/lib/unitxt/catalog/cards/belebele/heb_hebr.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/belebele 2026-05-27T11:53:48,270 copying build/lib/unitxt/catalog/cards/belebele/zul_latn.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/belebele 2026-05-27T11:53:48,272 copying build/lib/unitxt/catalog/cards/belebele/ars_arab.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/belebele 2026-05-27T11:53:48,274 copying build/lib/unitxt/catalog/cards/belebele/guj_gujr.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/belebele 2026-05-27T11:53:48,276 copying build/lib/unitxt/catalog/cards/belebele/arb_latn.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/belebele 2026-05-27T11:53:48,278 copying build/lib/unitxt/catalog/cards/belebele/isl_latn.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/belebele 2026-05-27T11:53:48,280 copying build/lib/unitxt/catalog/cards/belebele/fin_latn.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/belebele 2026-05-27T11:53:48,282 copying build/lib/unitxt/catalog/cards/belebele/zsm_latn.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/belebele 2026-05-27T11:53:48,284 copying build/lib/unitxt/catalog/cards/belebele/ibo_latn.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/belebele 2026-05-27T11:53:48,286 copying build/lib/unitxt/catalog/cards/belebele/tur_latn.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/belebele 2026-05-27T11:53:48,288 copying build/lib/unitxt/catalog/cards/belebele/sot_latn.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/belebele 2026-05-27T11:53:48,290 copying build/lib/unitxt/catalog/cards/belebele/tha_thai.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/belebele 2026-05-27T11:53:48,292 copying build/lib/unitxt/catalog/cards/belebele/zho_hans.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/belebele 2026-05-27T11:53:48,294 copying build/lib/unitxt/catalog/cards/belebele/acm_arab.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/belebele 2026-05-27T11:53:48,296 copying build/lib/unitxt/catalog/cards/belebele/lao_laoo.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/belebele 2026-05-27T11:53:48,298 copying build/lib/unitxt/catalog/cards/belebele/swh_latn.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/belebele 2026-05-27T11:53:48,300 copying build/lib/unitxt/catalog/cards/belebele/hin_deva.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/belebele 2026-05-27T11:53:48,302 copying build/lib/unitxt/catalog/cards/belebele/gaz_latn.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/belebele 2026-05-27T11:53:48,304 copying build/lib/unitxt/catalog/cards/atis.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards 2026-05-27T11:53:48,307 copying build/lib/unitxt/catalog/cards/info_vqa_lmms_eval.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards 2026-05-27T11:53:48,309 copying build/lib/unitxt/catalog/cards/cnn_dailymail.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards 2026-05-27T11:53:48,311 creating build/bdist.linux-armv7l/wheel/unitxt/catalog/cards/dynamic_cards_for_llm_judges 2026-05-27T11:53:48,313 creating build/bdist.linux-armv7l/wheel/unitxt/catalog/cards/dynamic_cards_for_llm_judges/pairwise_comparative_rating 2026-05-27T11:53:48,314 copying build/lib/unitxt/catalog/cards/dynamic_cards_for_llm_judges/pairwise_comparative_rating/single_turn.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/dynamic_cards_for_llm_judges/pairwise_comparative_rating 2026-05-27T11:53:48,316 creating build/bdist.linux-armv7l/wheel/unitxt/catalog/cards/dynamic_cards_for_llm_judges/rating 2026-05-27T11:53:48,317 copying build/lib/unitxt/catalog/cards/dynamic_cards_for_llm_judges/rating/single_turn.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/dynamic_cards_for_llm_judges/rating 2026-05-27T11:53:48,319 copying build/lib/unitxt/catalog/cards/dynamic_cards_for_llm_judges/rating/single_turn_with_reference.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/dynamic_cards_for_llm_judges/rating 2026-05-27T11:53:48,322 creating build/bdist.linux-armv7l/wheel/unitxt/catalog/cards/safety 2026-05-27T11:53:48,323 copying build/lib/unitxt/catalog/cards/safety/simple_safety_tests.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/safety 2026-05-27T11:53:48,325 copying build/lib/unitxt/catalog/cards/safety/mlcommons_ailuminate.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/safety 2026-05-27T11:53:48,327 copying build/lib/unitxt/catalog/cards/safety/airbench2024.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/safety 2026-05-27T11:53:48,329 creating build/bdist.linux-armv7l/wheel/unitxt/catalog/cards/safety/discrim_eval 2026-05-27T11:53:48,330 copying build/lib/unitxt/catalog/cards/safety/discrim_eval/implicit.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/safety/discrim_eval 2026-05-27T11:53:48,332 copying build/lib/unitxt/catalog/cards/safety/discrim_eval/explicit.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/safety/discrim_eval 2026-05-27T11:53:48,334 copying build/lib/unitxt/catalog/cards/safety/provoq.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/safety 2026-05-27T11:53:48,337 copying build/lib/unitxt/catalog/cards/safety/truthful_qa.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/safety 2026-05-27T11:53:48,340 creating build/bdist.linux-armv7l/wheel/unitxt/catalog/cards/safety/bbq 2026-05-27T11:53:48,342 copying build/lib/unitxt/catalog/cards/safety/bbq/Disability_status.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/safety/bbq 2026-05-27T11:53:48,344 copying build/lib/unitxt/catalog/cards/safety/bbq/Race_x_gender.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/safety/bbq 2026-05-27T11:53:48,346 copying build/lib/unitxt/catalog/cards/safety/bbq/Nationality.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/safety/bbq 2026-05-27T11:53:48,348 copying build/lib/unitxt/catalog/cards/safety/bbq/Race_x_SES.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/safety/bbq 2026-05-27T11:53:48,350 copying build/lib/unitxt/catalog/cards/safety/bbq/Physical_appearance.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/safety/bbq 2026-05-27T11:53:48,351 copying build/lib/unitxt/catalog/cards/safety/bbq/Sexual_orientation.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/safety/bbq 2026-05-27T11:53:48,353 copying build/lib/unitxt/catalog/cards/safety/bbq/SES.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/safety/bbq 2026-05-27T11:53:48,355 copying build/lib/unitxt/catalog/cards/safety/bbq/Race_ethnicity.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/safety/bbq 2026-05-27T11:53:48,357 copying build/lib/unitxt/catalog/cards/safety/bbq/Religion.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/safety/bbq 2026-05-27T11:53:48,359 copying build/lib/unitxt/catalog/cards/safety/bbq/Age.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/safety/bbq 2026-05-27T11:53:48,361 copying build/lib/unitxt/catalog/cards/safety/bbq/Gender_identity.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/safety/bbq 2026-05-27T11:53:48,363 copying build/lib/unitxt/catalog/cards/safety/xstest.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/safety 2026-05-27T11:53:48,365 creating build/bdist.linux-armv7l/wheel/unitxt/catalog/cards/tablebench_data_analysis 2026-05-27T11:53:48,366 copying build/lib/unitxt/catalog/cards/tablebench_data_analysis/legacy.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/tablebench_data_analysis 2026-05-27T11:53:48,369 creating build/bdist.linux-armv7l/wheel/unitxt/catalog/cards/global_mmlu 2026-05-27T11:53:48,372 creating build/bdist.linux-armv7l/wheel/unitxt/catalog/cards/global_mmlu/sv 2026-05-27T11:53:48,373 copying build/lib/unitxt/catalog/cards/global_mmlu/sv/moral_disputes.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/sv 2026-05-27T11:53:48,375 copying build/lib/unitxt/catalog/cards/global_mmlu/sv/high_school_biology.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/sv 2026-05-27T11:53:48,377 copying build/lib/unitxt/catalog/cards/global_mmlu/sv/jurisprudence.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/sv 2026-05-27T11:53:48,379 copying build/lib/unitxt/catalog/cards/global_mmlu/sv/logical_fallacies.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/sv 2026-05-27T11:53:48,381 copying build/lib/unitxt/catalog/cards/global_mmlu/sv/college_chemistry.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/sv 2026-05-27T11:53:48,383 copying build/lib/unitxt/catalog/cards/global_mmlu/sv/high_school_government_and_politics.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/sv 2026-05-27T11:53:48,385 copying build/lib/unitxt/catalog/cards/global_mmlu/sv/college_mathematics.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/sv 2026-05-27T11:53:48,387 copying build/lib/unitxt/catalog/cards/global_mmlu/sv/econometrics.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/sv 2026-05-27T11:53:48,389 copying build/lib/unitxt/catalog/cards/global_mmlu/sv/high_school_macroeconomics.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/sv 2026-05-27T11:53:48,391 copying build/lib/unitxt/catalog/cards/global_mmlu/sv/high_school_psychology.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/sv 2026-05-27T11:53:48,393 copying build/lib/unitxt/catalog/cards/global_mmlu/sv/computer_security.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/sv 2026-05-27T11:53:48,395 copying build/lib/unitxt/catalog/cards/global_mmlu/sv/sociology.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/sv 2026-05-27T11:53:48,397 copying build/lib/unitxt/catalog/cards/global_mmlu/sv/nutrition.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/sv 2026-05-27T11:53:48,399 copying build/lib/unitxt/catalog/cards/global_mmlu/sv/professional_medicine.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/sv 2026-05-27T11:53:48,401 copying build/lib/unitxt/catalog/cards/global_mmlu/sv/college_biology.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/sv 2026-05-27T11:53:48,402 copying build/lib/unitxt/catalog/cards/global_mmlu/sv/anatomy.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/sv 2026-05-27T11:53:48,404 copying build/lib/unitxt/catalog/cards/global_mmlu/sv/professional_law.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/sv 2026-05-27T11:53:48,406 copying build/lib/unitxt/catalog/cards/global_mmlu/sv/machine_learning.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/sv 2026-05-27T11:53:48,408 copying build/lib/unitxt/catalog/cards/global_mmlu/sv/international_law.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/sv 2026-05-27T11:53:48,410 copying build/lib/unitxt/catalog/cards/global_mmlu/sv/medical_genetics.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/sv 2026-05-27T11:53:48,412 copying build/lib/unitxt/catalog/cards/global_mmlu/sv/high_school_computer_science.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/sv 2026-05-27T11:53:48,414 copying build/lib/unitxt/catalog/cards/global_mmlu/sv/clinical_knowledge.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/sv 2026-05-27T11:53:48,417 copying build/lib/unitxt/catalog/cards/global_mmlu/sv/college_physics.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/sv 2026-05-27T11:53:48,419 copying build/lib/unitxt/catalog/cards/global_mmlu/sv/global_facts.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/sv 2026-05-27T11:53:48,422 copying build/lib/unitxt/catalog/cards/global_mmlu/sv/college_computer_science.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/sv 2026-05-27T11:53:48,425 copying build/lib/unitxt/catalog/cards/global_mmlu/sv/us_foreign_policy.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/sv 2026-05-27T11:53:48,427 copying build/lib/unitxt/catalog/cards/global_mmlu/sv/professional_accounting.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/sv 2026-05-27T11:53:48,429 copying build/lib/unitxt/catalog/cards/global_mmlu/sv/professional_psychology.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/sv 2026-05-27T11:53:48,431 copying build/lib/unitxt/catalog/cards/global_mmlu/sv/philosophy.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/sv 2026-05-27T11:53:48,433 copying build/lib/unitxt/catalog/cards/global_mmlu/sv/elementary_mathematics.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/sv 2026-05-27T11:53:48,435 copying build/lib/unitxt/catalog/cards/global_mmlu/sv/conceptual_physics.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/sv 2026-05-27T11:53:48,437 copying build/lib/unitxt/catalog/cards/global_mmlu/sv/high_school_geography.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/sv 2026-05-27T11:53:48,439 copying build/lib/unitxt/catalog/cards/global_mmlu/sv/human_aging.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/sv 2026-05-27T11:53:48,441 copying build/lib/unitxt/catalog/cards/global_mmlu/sv/electrical_engineering.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/sv 2026-05-27T11:53:48,442 copying build/lib/unitxt/catalog/cards/global_mmlu/sv/management.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/sv 2026-05-27T11:53:48,444 copying build/lib/unitxt/catalog/cards/global_mmlu/sv/high_school_world_history.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/sv 2026-05-27T11:53:48,446 copying build/lib/unitxt/catalog/cards/global_mmlu/sv/marketing.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/sv 2026-05-27T11:53:48,448 copying build/lib/unitxt/catalog/cards/global_mmlu/sv/high_school_european_history.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/sv 2026-05-27T11:53:48,450 copying build/lib/unitxt/catalog/cards/global_mmlu/sv/astronomy.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/sv 2026-05-27T11:53:48,452 copying build/lib/unitxt/catalog/cards/global_mmlu/sv/high_school_physics.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/sv 2026-05-27T11:53:48,454 copying build/lib/unitxt/catalog/cards/global_mmlu/sv/public_relations.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/sv 2026-05-27T11:53:48,455 copying build/lib/unitxt/catalog/cards/global_mmlu/sv/high_school_microeconomics.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/sv 2026-05-27T11:53:48,457 copying build/lib/unitxt/catalog/cards/global_mmlu/sv/virology.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/sv 2026-05-27T11:53:48,459 copying build/lib/unitxt/catalog/cards/global_mmlu/sv/high_school_us_history.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/sv 2026-05-27T11:53:48,461 copying build/lib/unitxt/catalog/cards/global_mmlu/sv/high_school_statistics.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/sv 2026-05-27T11:53:48,463 copying build/lib/unitxt/catalog/cards/global_mmlu/sv/miscellaneous.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/sv 2026-05-27T11:53:48,465 copying build/lib/unitxt/catalog/cards/global_mmlu/sv/high_school_mathematics.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/sv 2026-05-27T11:53:48,467 copying build/lib/unitxt/catalog/cards/global_mmlu/sv/formal_logic.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/sv 2026-05-27T11:53:48,469 copying build/lib/unitxt/catalog/cards/global_mmlu/sv/high_school_chemistry.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/sv 2026-05-27T11:53:48,471 copying build/lib/unitxt/catalog/cards/global_mmlu/sv/abstract_algebra.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/sv 2026-05-27T11:53:48,473 copying build/lib/unitxt/catalog/cards/global_mmlu/sv/moral_scenarios.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/sv 2026-05-27T11:53:48,475 copying build/lib/unitxt/catalog/cards/global_mmlu/sv/world_religions.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/sv 2026-05-27T11:53:48,477 copying build/lib/unitxt/catalog/cards/global_mmlu/sv/business_ethics.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/sv 2026-05-27T11:53:48,479 copying build/lib/unitxt/catalog/cards/global_mmlu/sv/security_studies.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/sv 2026-05-27T11:53:48,481 copying build/lib/unitxt/catalog/cards/global_mmlu/sv/college_medicine.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/sv 2026-05-27T11:53:48,483 copying build/lib/unitxt/catalog/cards/global_mmlu/sv/human_sexuality.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/sv 2026-05-27T11:53:48,485 copying build/lib/unitxt/catalog/cards/global_mmlu/sv/prehistory.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/sv 2026-05-27T11:53:48,488 creating build/bdist.linux-armv7l/wheel/unitxt/catalog/cards/global_mmlu/ny 2026-05-27T11:53:48,489 copying build/lib/unitxt/catalog/cards/global_mmlu/ny/moral_disputes.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/ny 2026-05-27T11:53:48,491 copying build/lib/unitxt/catalog/cards/global_mmlu/ny/high_school_biology.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/ny 2026-05-27T11:53:48,493 copying build/lib/unitxt/catalog/cards/global_mmlu/ny/jurisprudence.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/ny 2026-05-27T11:53:48,495 copying build/lib/unitxt/catalog/cards/global_mmlu/ny/logical_fallacies.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/ny 2026-05-27T11:53:48,497 copying build/lib/unitxt/catalog/cards/global_mmlu/ny/college_chemistry.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/ny 2026-05-27T11:53:48,499 copying build/lib/unitxt/catalog/cards/global_mmlu/ny/high_school_government_and_politics.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/ny 2026-05-27T11:53:48,501 copying build/lib/unitxt/catalog/cards/global_mmlu/ny/college_mathematics.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/ny 2026-05-27T11:53:48,503 copying build/lib/unitxt/catalog/cards/global_mmlu/ny/econometrics.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/ny 2026-05-27T11:53:48,506 copying build/lib/unitxt/catalog/cards/global_mmlu/ny/high_school_macroeconomics.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/ny 2026-05-27T11:53:48,508 copying build/lib/unitxt/catalog/cards/global_mmlu/ny/high_school_psychology.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/ny 2026-05-27T11:53:48,510 copying build/lib/unitxt/catalog/cards/global_mmlu/ny/computer_security.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/ny 2026-05-27T11:53:48,512 copying build/lib/unitxt/catalog/cards/global_mmlu/ny/sociology.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/ny 2026-05-27T11:53:48,514 copying build/lib/unitxt/catalog/cards/global_mmlu/ny/nutrition.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/ny 2026-05-27T11:53:48,516 copying build/lib/unitxt/catalog/cards/global_mmlu/ny/professional_medicine.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/ny 2026-05-27T11:53:48,518 copying build/lib/unitxt/catalog/cards/global_mmlu/ny/college_biology.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/ny 2026-05-27T11:53:48,520 copying build/lib/unitxt/catalog/cards/global_mmlu/ny/anatomy.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/ny 2026-05-27T11:53:48,522 copying build/lib/unitxt/catalog/cards/global_mmlu/ny/professional_law.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/ny 2026-05-27T11:53:48,524 copying build/lib/unitxt/catalog/cards/global_mmlu/ny/machine_learning.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/ny 2026-05-27T11:53:48,526 copying build/lib/unitxt/catalog/cards/global_mmlu/ny/international_law.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/ny 2026-05-27T11:53:48,528 copying build/lib/unitxt/catalog/cards/global_mmlu/ny/medical_genetics.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/ny 2026-05-27T11:53:48,530 copying build/lib/unitxt/catalog/cards/global_mmlu/ny/high_school_computer_science.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/ny 2026-05-27T11:53:48,532 copying build/lib/unitxt/catalog/cards/global_mmlu/ny/clinical_knowledge.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/ny 2026-05-27T11:53:48,534 copying build/lib/unitxt/catalog/cards/global_mmlu/ny/college_physics.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/ny 2026-05-27T11:53:48,536 copying build/lib/unitxt/catalog/cards/global_mmlu/ny/global_facts.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/ny 2026-05-27T11:53:48,538 copying build/lib/unitxt/catalog/cards/global_mmlu/ny/college_computer_science.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/ny 2026-05-27T11:53:48,540 copying build/lib/unitxt/catalog/cards/global_mmlu/ny/us_foreign_policy.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/ny 2026-05-27T11:53:48,542 copying build/lib/unitxt/catalog/cards/global_mmlu/ny/professional_accounting.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/ny 2026-05-27T11:53:48,543 copying build/lib/unitxt/catalog/cards/global_mmlu/ny/professional_psychology.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/ny 2026-05-27T11:53:48,545 copying build/lib/unitxt/catalog/cards/global_mmlu/ny/philosophy.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/ny 2026-05-27T11:53:48,547 copying build/lib/unitxt/catalog/cards/global_mmlu/ny/elementary_mathematics.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/ny 2026-05-27T11:53:48,549 copying build/lib/unitxt/catalog/cards/global_mmlu/ny/conceptual_physics.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/ny 2026-05-27T11:53:48,551 copying build/lib/unitxt/catalog/cards/global_mmlu/ny/high_school_geography.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/ny 2026-05-27T11:53:48,553 copying build/lib/unitxt/catalog/cards/global_mmlu/ny/human_aging.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/ny 2026-05-27T11:53:48,555 copying build/lib/unitxt/catalog/cards/global_mmlu/ny/electrical_engineering.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/ny 2026-05-27T11:53:48,557 copying build/lib/unitxt/catalog/cards/global_mmlu/ny/management.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/ny 2026-05-27T11:53:48,558 copying build/lib/unitxt/catalog/cards/global_mmlu/ny/high_school_world_history.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/ny 2026-05-27T11:53:48,560 copying build/lib/unitxt/catalog/cards/global_mmlu/ny/marketing.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/ny 2026-05-27T11:53:48,562 copying build/lib/unitxt/catalog/cards/global_mmlu/ny/high_school_european_history.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/ny 2026-05-27T11:53:48,564 copying build/lib/unitxt/catalog/cards/global_mmlu/ny/astronomy.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/ny 2026-05-27T11:53:48,566 copying build/lib/unitxt/catalog/cards/global_mmlu/ny/high_school_physics.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/ny 2026-05-27T11:53:48,568 copying build/lib/unitxt/catalog/cards/global_mmlu/ny/public_relations.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/ny 2026-05-27T11:53:48,570 copying build/lib/unitxt/catalog/cards/global_mmlu/ny/high_school_microeconomics.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/ny 2026-05-27T11:53:48,572 copying build/lib/unitxt/catalog/cards/global_mmlu/ny/virology.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/ny 2026-05-27T11:53:48,574 copying build/lib/unitxt/catalog/cards/global_mmlu/ny/high_school_us_history.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/ny 2026-05-27T11:53:48,576 copying build/lib/unitxt/catalog/cards/global_mmlu/ny/high_school_statistics.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/ny 2026-05-27T11:53:48,578 copying build/lib/unitxt/catalog/cards/global_mmlu/ny/miscellaneous.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/ny 2026-05-27T11:53:48,580 copying build/lib/unitxt/catalog/cards/global_mmlu/ny/high_school_mathematics.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/ny 2026-05-27T11:53:48,582 copying build/lib/unitxt/catalog/cards/global_mmlu/ny/formal_logic.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/ny 2026-05-27T11:53:48,584 copying build/lib/unitxt/catalog/cards/global_mmlu/ny/high_school_chemistry.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/ny 2026-05-27T11:53:48,586 copying build/lib/unitxt/catalog/cards/global_mmlu/ny/abstract_algebra.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/ny 2026-05-27T11:53:48,588 copying build/lib/unitxt/catalog/cards/global_mmlu/ny/moral_scenarios.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/ny 2026-05-27T11:53:48,590 copying build/lib/unitxt/catalog/cards/global_mmlu/ny/world_religions.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/ny 2026-05-27T11:53:48,592 copying build/lib/unitxt/catalog/cards/global_mmlu/ny/business_ethics.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/ny 2026-05-27T11:53:48,594 copying build/lib/unitxt/catalog/cards/global_mmlu/ny/security_studies.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/ny 2026-05-27T11:53:48,596 copying build/lib/unitxt/catalog/cards/global_mmlu/ny/college_medicine.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/ny 2026-05-27T11:53:48,599 copying build/lib/unitxt/catalog/cards/global_mmlu/ny/human_sexuality.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/ny 2026-05-27T11:53:48,601 copying build/lib/unitxt/catalog/cards/global_mmlu/ny/prehistory.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/ny 2026-05-27T11:53:48,605 creating build/bdist.linux-armv7l/wheel/unitxt/catalog/cards/global_mmlu/si 2026-05-27T11:53:48,606 copying build/lib/unitxt/catalog/cards/global_mmlu/si/moral_disputes.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/si 2026-05-27T11:53:48,608 copying build/lib/unitxt/catalog/cards/global_mmlu/si/high_school_biology.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/si 2026-05-27T11:53:48,610 copying build/lib/unitxt/catalog/cards/global_mmlu/si/jurisprudence.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/si 2026-05-27T11:53:48,612 copying build/lib/unitxt/catalog/cards/global_mmlu/si/logical_fallacies.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/si 2026-05-27T11:53:48,614 copying build/lib/unitxt/catalog/cards/global_mmlu/si/college_chemistry.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/si 2026-05-27T11:53:48,616 copying build/lib/unitxt/catalog/cards/global_mmlu/si/high_school_government_and_politics.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/si 2026-05-27T11:53:48,618 copying build/lib/unitxt/catalog/cards/global_mmlu/si/college_mathematics.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/si 2026-05-27T11:53:48,620 copying build/lib/unitxt/catalog/cards/global_mmlu/si/econometrics.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/si 2026-05-27T11:53:48,622 copying build/lib/unitxt/catalog/cards/global_mmlu/si/high_school_macroeconomics.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/si 2026-05-27T11:53:48,624 copying build/lib/unitxt/catalog/cards/global_mmlu/si/high_school_psychology.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/si 2026-05-27T11:53:48,626 copying build/lib/unitxt/catalog/cards/global_mmlu/si/computer_security.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/si 2026-05-27T11:53:48,628 copying build/lib/unitxt/catalog/cards/global_mmlu/si/sociology.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/si 2026-05-27T11:53:48,630 copying build/lib/unitxt/catalog/cards/global_mmlu/si/nutrition.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/si 2026-05-27T11:53:48,632 copying build/lib/unitxt/catalog/cards/global_mmlu/si/professional_medicine.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/si 2026-05-27T11:53:48,634 copying build/lib/unitxt/catalog/cards/global_mmlu/si/college_biology.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/si 2026-05-27T11:53:48,636 copying build/lib/unitxt/catalog/cards/global_mmlu/si/anatomy.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/si 2026-05-27T11:53:48,638 copying build/lib/unitxt/catalog/cards/global_mmlu/si/professional_law.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/si 2026-05-27T11:53:48,640 copying build/lib/unitxt/catalog/cards/global_mmlu/si/machine_learning.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/si 2026-05-27T11:53:48,642 copying build/lib/unitxt/catalog/cards/global_mmlu/si/international_law.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/si 2026-05-27T11:53:48,644 copying build/lib/unitxt/catalog/cards/global_mmlu/si/medical_genetics.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/si 2026-05-27T11:53:48,646 copying build/lib/unitxt/catalog/cards/global_mmlu/si/high_school_computer_science.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/si 2026-05-27T11:53:48,648 copying build/lib/unitxt/catalog/cards/global_mmlu/si/clinical_knowledge.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/si 2026-05-27T11:53:48,650 copying build/lib/unitxt/catalog/cards/global_mmlu/si/college_physics.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/si 2026-05-27T11:53:48,652 copying build/lib/unitxt/catalog/cards/global_mmlu/si/global_facts.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/si 2026-05-27T11:53:48,654 copying build/lib/unitxt/catalog/cards/global_mmlu/si/college_computer_science.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/si 2026-05-27T11:53:48,656 copying build/lib/unitxt/catalog/cards/global_mmlu/si/us_foreign_policy.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/si 2026-05-27T11:53:48,658 copying build/lib/unitxt/catalog/cards/global_mmlu/si/professional_accounting.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/si 2026-05-27T11:53:48,660 copying build/lib/unitxt/catalog/cards/global_mmlu/si/professional_psychology.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/si 2026-05-27T11:53:48,662 copying build/lib/unitxt/catalog/cards/global_mmlu/si/philosophy.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/si 2026-05-27T11:53:48,664 copying build/lib/unitxt/catalog/cards/global_mmlu/si/elementary_mathematics.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/si 2026-05-27T11:53:48,666 copying build/lib/unitxt/catalog/cards/global_mmlu/si/conceptual_physics.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/si 2026-05-27T11:53:48,668 copying build/lib/unitxt/catalog/cards/global_mmlu/si/high_school_geography.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/si 2026-05-27T11:53:48,670 copying build/lib/unitxt/catalog/cards/global_mmlu/si/human_aging.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/si 2026-05-27T11:53:48,672 copying build/lib/unitxt/catalog/cards/global_mmlu/si/electrical_engineering.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/si 2026-05-27T11:53:48,674 copying build/lib/unitxt/catalog/cards/global_mmlu/si/management.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/si 2026-05-27T11:53:48,676 copying build/lib/unitxt/catalog/cards/global_mmlu/si/high_school_world_history.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/si 2026-05-27T11:53:48,678 copying build/lib/unitxt/catalog/cards/global_mmlu/si/marketing.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/si 2026-05-27T11:53:48,680 copying build/lib/unitxt/catalog/cards/global_mmlu/si/high_school_european_history.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/si 2026-05-27T11:53:48,683 copying build/lib/unitxt/catalog/cards/global_mmlu/si/astronomy.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/si 2026-05-27T11:53:48,685 copying build/lib/unitxt/catalog/cards/global_mmlu/si/high_school_physics.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/si 2026-05-27T11:53:48,687 copying build/lib/unitxt/catalog/cards/global_mmlu/si/public_relations.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/si 2026-05-27T11:53:48,689 copying build/lib/unitxt/catalog/cards/global_mmlu/si/high_school_microeconomics.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/si 2026-05-27T11:53:48,691 copying build/lib/unitxt/catalog/cards/global_mmlu/si/virology.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/si 2026-05-27T11:53:48,693 copying build/lib/unitxt/catalog/cards/global_mmlu/si/high_school_us_history.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/si 2026-05-27T11:53:48,695 copying build/lib/unitxt/catalog/cards/global_mmlu/si/high_school_statistics.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/si 2026-05-27T11:53:48,697 copying build/lib/unitxt/catalog/cards/global_mmlu/si/miscellaneous.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/si 2026-05-27T11:53:48,699 copying build/lib/unitxt/catalog/cards/global_mmlu/si/high_school_mathematics.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/si 2026-05-27T11:53:48,701 copying build/lib/unitxt/catalog/cards/global_mmlu/si/formal_logic.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/si 2026-05-27T11:53:48,703 copying build/lib/unitxt/catalog/cards/global_mmlu/si/high_school_chemistry.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/si 2026-05-27T11:53:48,704 copying build/lib/unitxt/catalog/cards/global_mmlu/si/abstract_algebra.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/si 2026-05-27T11:53:48,706 copying build/lib/unitxt/catalog/cards/global_mmlu/si/moral_scenarios.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/si 2026-05-27T11:53:48,708 copying build/lib/unitxt/catalog/cards/global_mmlu/si/world_religions.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/si 2026-05-27T11:53:48,710 copying build/lib/unitxt/catalog/cards/global_mmlu/si/business_ethics.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/si 2026-05-27T11:53:48,712 copying build/lib/unitxt/catalog/cards/global_mmlu/si/security_studies.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/si 2026-05-27T11:53:48,714 copying build/lib/unitxt/catalog/cards/global_mmlu/si/college_medicine.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/si 2026-05-27T11:53:48,716 copying build/lib/unitxt/catalog/cards/global_mmlu/si/human_sexuality.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/si 2026-05-27T11:53:48,718 copying build/lib/unitxt/catalog/cards/global_mmlu/si/prehistory.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/si 2026-05-27T11:53:48,722 creating build/bdist.linux-armv7l/wheel/unitxt/catalog/cards/global_mmlu/mg 2026-05-27T11:53:48,723 copying build/lib/unitxt/catalog/cards/global_mmlu/mg/moral_disputes.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/mg 2026-05-27T11:53:48,725 copying build/lib/unitxt/catalog/cards/global_mmlu/mg/high_school_biology.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/mg 2026-05-27T11:53:48,727 copying build/lib/unitxt/catalog/cards/global_mmlu/mg/jurisprudence.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/mg 2026-05-27T11:53:48,729 copying build/lib/unitxt/catalog/cards/global_mmlu/mg/logical_fallacies.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/mg 2026-05-27T11:53:48,732 copying build/lib/unitxt/catalog/cards/global_mmlu/mg/college_chemistry.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/mg 2026-05-27T11:53:48,734 copying build/lib/unitxt/catalog/cards/global_mmlu/mg/high_school_government_and_politics.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/mg 2026-05-27T11:53:48,736 copying build/lib/unitxt/catalog/cards/global_mmlu/mg/college_mathematics.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/mg 2026-05-27T11:53:48,739 copying build/lib/unitxt/catalog/cards/global_mmlu/mg/econometrics.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/mg 2026-05-27T11:53:48,741 copying build/lib/unitxt/catalog/cards/global_mmlu/mg/high_school_macroeconomics.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/mg 2026-05-27T11:53:48,743 copying build/lib/unitxt/catalog/cards/global_mmlu/mg/high_school_psychology.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/mg 2026-05-27T11:53:48,746 copying build/lib/unitxt/catalog/cards/global_mmlu/mg/computer_security.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/mg 2026-05-27T11:53:48,748 copying build/lib/unitxt/catalog/cards/global_mmlu/mg/sociology.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/mg 2026-05-27T11:53:48,750 copying build/lib/unitxt/catalog/cards/global_mmlu/mg/nutrition.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/mg 2026-05-27T11:53:48,753 copying build/lib/unitxt/catalog/cards/global_mmlu/mg/professional_medicine.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/mg 2026-05-27T11:53:48,755 copying build/lib/unitxt/catalog/cards/global_mmlu/mg/college_biology.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/mg 2026-05-27T11:53:48,757 copying build/lib/unitxt/catalog/cards/global_mmlu/mg/anatomy.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/mg 2026-05-27T11:53:48,760 copying build/lib/unitxt/catalog/cards/global_mmlu/mg/professional_law.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/mg 2026-05-27T11:53:48,762 copying build/lib/unitxt/catalog/cards/global_mmlu/mg/machine_learning.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/mg 2026-05-27T11:53:48,765 copying build/lib/unitxt/catalog/cards/global_mmlu/mg/international_law.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/mg 2026-05-27T11:53:48,767 copying build/lib/unitxt/catalog/cards/global_mmlu/mg/medical_genetics.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/mg 2026-05-27T11:53:48,770 copying build/lib/unitxt/catalog/cards/global_mmlu/mg/high_school_computer_science.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/mg 2026-05-27T11:53:48,772 copying build/lib/unitxt/catalog/cards/global_mmlu/mg/clinical_knowledge.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/mg 2026-05-27T11:53:48,775 copying build/lib/unitxt/catalog/cards/global_mmlu/mg/college_physics.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/mg 2026-05-27T11:53:48,778 copying build/lib/unitxt/catalog/cards/global_mmlu/mg/global_facts.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/mg 2026-05-27T11:53:48,781 copying build/lib/unitxt/catalog/cards/global_mmlu/mg/college_computer_science.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/mg 2026-05-27T11:53:48,783 copying build/lib/unitxt/catalog/cards/global_mmlu/mg/us_foreign_policy.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/mg 2026-05-27T11:53:48,786 copying build/lib/unitxt/catalog/cards/global_mmlu/mg/professional_accounting.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/mg 2026-05-27T11:53:48,788 copying build/lib/unitxt/catalog/cards/global_mmlu/mg/professional_psychology.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/mg 2026-05-27T11:53:48,790 copying build/lib/unitxt/catalog/cards/global_mmlu/mg/philosophy.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/mg 2026-05-27T11:53:48,793 copying build/lib/unitxt/catalog/cards/global_mmlu/mg/elementary_mathematics.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/mg 2026-05-27T11:53:48,795 copying build/lib/unitxt/catalog/cards/global_mmlu/mg/conceptual_physics.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/mg 2026-05-27T11:53:48,797 copying build/lib/unitxt/catalog/cards/global_mmlu/mg/high_school_geography.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/mg 2026-05-27T11:53:48,800 copying build/lib/unitxt/catalog/cards/global_mmlu/mg/human_aging.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/mg 2026-05-27T11:53:48,802 copying build/lib/unitxt/catalog/cards/global_mmlu/mg/electrical_engineering.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/mg 2026-05-27T11:53:48,804 copying build/lib/unitxt/catalog/cards/global_mmlu/mg/management.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/mg 2026-05-27T11:53:48,807 copying build/lib/unitxt/catalog/cards/global_mmlu/mg/high_school_world_history.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/mg 2026-05-27T11:53:48,809 copying build/lib/unitxt/catalog/cards/global_mmlu/mg/marketing.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/mg 2026-05-27T11:53:48,811 copying build/lib/unitxt/catalog/cards/global_mmlu/mg/high_school_european_history.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/mg 2026-05-27T11:53:48,814 copying build/lib/unitxt/catalog/cards/global_mmlu/mg/astronomy.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/mg 2026-05-27T11:53:48,816 copying build/lib/unitxt/catalog/cards/global_mmlu/mg/high_school_physics.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/mg 2026-05-27T11:53:48,819 copying build/lib/unitxt/catalog/cards/global_mmlu/mg/public_relations.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/mg 2026-05-27T11:53:48,821 copying build/lib/unitxt/catalog/cards/global_mmlu/mg/high_school_microeconomics.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/mg 2026-05-27T11:53:48,823 copying build/lib/unitxt/catalog/cards/global_mmlu/mg/virology.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/mg 2026-05-27T11:53:48,826 copying build/lib/unitxt/catalog/cards/global_mmlu/mg/high_school_us_history.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/mg 2026-05-27T11:53:48,828 copying build/lib/unitxt/catalog/cards/global_mmlu/mg/high_school_statistics.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/mg 2026-05-27T11:53:48,830 copying build/lib/unitxt/catalog/cards/global_mmlu/mg/miscellaneous.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/mg 2026-05-27T11:53:48,832 copying build/lib/unitxt/catalog/cards/global_mmlu/mg/high_school_mathematics.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/mg 2026-05-27T11:53:48,834 copying build/lib/unitxt/catalog/cards/global_mmlu/mg/formal_logic.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/mg 2026-05-27T11:53:48,836 copying build/lib/unitxt/catalog/cards/global_mmlu/mg/high_school_chemistry.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/mg 2026-05-27T11:53:48,839 copying build/lib/unitxt/catalog/cards/global_mmlu/mg/abstract_algebra.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/mg 2026-05-27T11:53:48,841 copying build/lib/unitxt/catalog/cards/global_mmlu/mg/moral_scenarios.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/mg 2026-05-27T11:53:48,843 copying build/lib/unitxt/catalog/cards/global_mmlu/mg/world_religions.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/mg 2026-05-27T11:53:48,844 copying build/lib/unitxt/catalog/cards/global_mmlu/mg/business_ethics.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/mg 2026-05-27T11:53:48,846 copying build/lib/unitxt/catalog/cards/global_mmlu/mg/security_studies.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/mg 2026-05-27T11:53:48,848 copying build/lib/unitxt/catalog/cards/global_mmlu/mg/college_medicine.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/mg 2026-05-27T11:53:48,850 copying build/lib/unitxt/catalog/cards/global_mmlu/mg/human_sexuality.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/mg 2026-05-27T11:53:48,852 copying build/lib/unitxt/catalog/cards/global_mmlu/mg/prehistory.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/mg 2026-05-27T11:53:48,856 creating build/bdist.linux-armv7l/wheel/unitxt/catalog/cards/global_mmlu/ms 2026-05-27T11:53:48,857 copying build/lib/unitxt/catalog/cards/global_mmlu/ms/moral_disputes.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/ms 2026-05-27T11:53:48,860 copying build/lib/unitxt/catalog/cards/global_mmlu/ms/high_school_biology.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/ms 2026-05-27T11:53:48,862 copying build/lib/unitxt/catalog/cards/global_mmlu/ms/jurisprudence.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/ms 2026-05-27T11:53:48,864 copying build/lib/unitxt/catalog/cards/global_mmlu/ms/logical_fallacies.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/ms 2026-05-27T11:53:48,866 copying build/lib/unitxt/catalog/cards/global_mmlu/ms/college_chemistry.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/ms 2026-05-27T11:53:48,868 copying build/lib/unitxt/catalog/cards/global_mmlu/ms/high_school_government_and_politics.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/ms 2026-05-27T11:53:48,870 copying build/lib/unitxt/catalog/cards/global_mmlu/ms/college_mathematics.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/ms 2026-05-27T11:53:48,872 copying build/lib/unitxt/catalog/cards/global_mmlu/ms/econometrics.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/ms 2026-05-27T11:53:48,874 copying build/lib/unitxt/catalog/cards/global_mmlu/ms/high_school_macroeconomics.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/ms 2026-05-27T11:53:48,876 copying build/lib/unitxt/catalog/cards/global_mmlu/ms/high_school_psychology.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/ms 2026-05-27T11:53:48,878 copying build/lib/unitxt/catalog/cards/global_mmlu/ms/computer_security.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/ms 2026-05-27T11:53:48,880 copying build/lib/unitxt/catalog/cards/global_mmlu/ms/sociology.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/ms 2026-05-27T11:53:48,882 copying build/lib/unitxt/catalog/cards/global_mmlu/ms/nutrition.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/ms 2026-05-27T11:53:48,884 copying build/lib/unitxt/catalog/cards/global_mmlu/ms/professional_medicine.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/ms 2026-05-27T11:53:48,886 copying build/lib/unitxt/catalog/cards/global_mmlu/ms/college_biology.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/ms 2026-05-27T11:53:48,888 copying build/lib/unitxt/catalog/cards/global_mmlu/ms/anatomy.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/ms 2026-05-27T11:53:48,890 copying build/lib/unitxt/catalog/cards/global_mmlu/ms/professional_law.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/ms 2026-05-27T11:53:48,892 copying build/lib/unitxt/catalog/cards/global_mmlu/ms/machine_learning.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/ms 2026-05-27T11:53:48,894 copying build/lib/unitxt/catalog/cards/global_mmlu/ms/international_law.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/ms 2026-05-27T11:53:48,895 copying build/lib/unitxt/catalog/cards/global_mmlu/ms/medical_genetics.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/ms 2026-05-27T11:53:48,897 copying build/lib/unitxt/catalog/cards/global_mmlu/ms/high_school_computer_science.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/ms 2026-05-27T11:53:48,899 copying build/lib/unitxt/catalog/cards/global_mmlu/ms/clinical_knowledge.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/ms 2026-05-27T11:53:48,901 copying build/lib/unitxt/catalog/cards/global_mmlu/ms/college_physics.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/ms 2026-05-27T11:53:48,903 copying build/lib/unitxt/catalog/cards/global_mmlu/ms/global_facts.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/ms 2026-05-27T11:53:48,905 copying build/lib/unitxt/catalog/cards/global_mmlu/ms/college_computer_science.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/ms 2026-05-27T11:53:48,907 copying build/lib/unitxt/catalog/cards/global_mmlu/ms/us_foreign_policy.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/ms 2026-05-27T11:53:48,909 copying build/lib/unitxt/catalog/cards/global_mmlu/ms/professional_accounting.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/ms 2026-05-27T11:53:48,911 copying build/lib/unitxt/catalog/cards/global_mmlu/ms/professional_psychology.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/ms 2026-05-27T11:53:48,913 copying build/lib/unitxt/catalog/cards/global_mmlu/ms/philosophy.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/ms 2026-05-27T11:53:48,915 copying build/lib/unitxt/catalog/cards/global_mmlu/ms/elementary_mathematics.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/ms 2026-05-27T11:53:48,917 copying build/lib/unitxt/catalog/cards/global_mmlu/ms/conceptual_physics.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/ms 2026-05-27T11:53:48,919 copying build/lib/unitxt/catalog/cards/global_mmlu/ms/high_school_geography.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/ms 2026-05-27T11:53:48,921 copying build/lib/unitxt/catalog/cards/global_mmlu/ms/human_aging.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/ms 2026-05-27T11:53:48,923 copying build/lib/unitxt/catalog/cards/global_mmlu/ms/electrical_engineering.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/ms 2026-05-27T11:53:48,925 copying build/lib/unitxt/catalog/cards/global_mmlu/ms/management.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/ms 2026-05-27T11:53:48,927 copying build/lib/unitxt/catalog/cards/global_mmlu/ms/high_school_world_history.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/ms 2026-05-27T11:53:48,929 copying build/lib/unitxt/catalog/cards/global_mmlu/ms/marketing.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/ms 2026-05-27T11:53:48,931 copying build/lib/unitxt/catalog/cards/global_mmlu/ms/high_school_european_history.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/ms 2026-05-27T11:53:48,933 copying build/lib/unitxt/catalog/cards/global_mmlu/ms/astronomy.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/ms 2026-05-27T11:53:48,935 copying build/lib/unitxt/catalog/cards/global_mmlu/ms/high_school_physics.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/ms 2026-05-27T11:53:48,937 copying build/lib/unitxt/catalog/cards/global_mmlu/ms/public_relations.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/ms 2026-05-27T11:53:48,939 copying build/lib/unitxt/catalog/cards/global_mmlu/ms/high_school_microeconomics.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/ms 2026-05-27T11:53:48,942 copying build/lib/unitxt/catalog/cards/global_mmlu/ms/virology.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/ms 2026-05-27T11:53:48,944 copying build/lib/unitxt/catalog/cards/global_mmlu/ms/high_school_us_history.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/ms 2026-05-27T11:53:48,947 copying build/lib/unitxt/catalog/cards/global_mmlu/ms/high_school_statistics.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/ms 2026-05-27T11:53:48,949 copying build/lib/unitxt/catalog/cards/global_mmlu/ms/miscellaneous.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/ms 2026-05-27T11:53:48,951 copying build/lib/unitxt/catalog/cards/global_mmlu/ms/high_school_mathematics.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/ms 2026-05-27T11:53:48,953 copying build/lib/unitxt/catalog/cards/global_mmlu/ms/formal_logic.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/ms 2026-05-27T11:53:48,955 copying build/lib/unitxt/catalog/cards/global_mmlu/ms/high_school_chemistry.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/ms 2026-05-27T11:53:48,957 copying build/lib/unitxt/catalog/cards/global_mmlu/ms/abstract_algebra.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/ms 2026-05-27T11:53:48,959 copying build/lib/unitxt/catalog/cards/global_mmlu/ms/moral_scenarios.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/ms 2026-05-27T11:53:48,961 copying build/lib/unitxt/catalog/cards/global_mmlu/ms/world_religions.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/ms 2026-05-27T11:53:48,963 copying build/lib/unitxt/catalog/cards/global_mmlu/ms/business_ethics.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/ms 2026-05-27T11:53:48,965 copying build/lib/unitxt/catalog/cards/global_mmlu/ms/security_studies.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/ms 2026-05-27T11:53:48,967 copying build/lib/unitxt/catalog/cards/global_mmlu/ms/college_medicine.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/ms 2026-05-27T11:53:48,969 copying build/lib/unitxt/catalog/cards/global_mmlu/ms/human_sexuality.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/ms 2026-05-27T11:53:48,971 copying build/lib/unitxt/catalog/cards/global_mmlu/ms/prehistory.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/ms 2026-05-27T11:53:48,974 creating build/bdist.linux-armv7l/wheel/unitxt/catalog/cards/global_mmlu/hi 2026-05-27T11:53:48,975 copying build/lib/unitxt/catalog/cards/global_mmlu/hi/moral_disputes.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/hi 2026-05-27T11:53:48,977 copying build/lib/unitxt/catalog/cards/global_mmlu/hi/high_school_biology.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/hi 2026-05-27T11:53:48,979 copying build/lib/unitxt/catalog/cards/global_mmlu/hi/jurisprudence.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/hi 2026-05-27T11:53:48,981 copying build/lib/unitxt/catalog/cards/global_mmlu/hi/logical_fallacies.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/hi 2026-05-27T11:53:48,983 copying build/lib/unitxt/catalog/cards/global_mmlu/hi/college_chemistry.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/hi 2026-05-27T11:53:48,985 copying build/lib/unitxt/catalog/cards/global_mmlu/hi/high_school_government_and_politics.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/hi 2026-05-27T11:53:48,987 copying build/lib/unitxt/catalog/cards/global_mmlu/hi/college_mathematics.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/hi 2026-05-27T11:53:48,989 copying build/lib/unitxt/catalog/cards/global_mmlu/hi/econometrics.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/hi 2026-05-27T11:53:48,991 copying build/lib/unitxt/catalog/cards/global_mmlu/hi/high_school_macroeconomics.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/hi 2026-05-27T11:53:48,993 copying build/lib/unitxt/catalog/cards/global_mmlu/hi/high_school_psychology.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/hi 2026-05-27T11:53:48,995 copying build/lib/unitxt/catalog/cards/global_mmlu/hi/computer_security.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/hi 2026-05-27T11:53:48,997 copying build/lib/unitxt/catalog/cards/global_mmlu/hi/sociology.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/hi 2026-05-27T11:53:48,999 copying build/lib/unitxt/catalog/cards/global_mmlu/hi/nutrition.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/hi 2026-05-27T11:53:49,001 copying build/lib/unitxt/catalog/cards/global_mmlu/hi/professional_medicine.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/hi 2026-05-27T11:53:49,003 copying build/lib/unitxt/catalog/cards/global_mmlu/hi/college_biology.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/hi 2026-05-27T11:53:49,005 copying build/lib/unitxt/catalog/cards/global_mmlu/hi/anatomy.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/hi 2026-05-27T11:53:49,007 copying build/lib/unitxt/catalog/cards/global_mmlu/hi/professional_law.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/hi 2026-05-27T11:53:49,009 copying build/lib/unitxt/catalog/cards/global_mmlu/hi/machine_learning.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/hi 2026-05-27T11:53:49,011 copying build/lib/unitxt/catalog/cards/global_mmlu/hi/international_law.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/hi 2026-05-27T11:53:49,013 copying build/lib/unitxt/catalog/cards/global_mmlu/hi/medical_genetics.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/hi 2026-05-27T11:53:49,015 copying build/lib/unitxt/catalog/cards/global_mmlu/hi/high_school_computer_science.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/hi 2026-05-27T11:53:49,017 copying build/lib/unitxt/catalog/cards/global_mmlu/hi/clinical_knowledge.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/hi 2026-05-27T11:53:49,019 copying build/lib/unitxt/catalog/cards/global_mmlu/hi/college_physics.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/hi 2026-05-27T11:53:49,021 copying build/lib/unitxt/catalog/cards/global_mmlu/hi/global_facts.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/hi 2026-05-27T11:53:49,023 copying build/lib/unitxt/catalog/cards/global_mmlu/hi/college_computer_science.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/hi 2026-05-27T11:53:49,025 copying build/lib/unitxt/catalog/cards/global_mmlu/hi/us_foreign_policy.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/hi 2026-05-27T11:53:49,027 copying build/lib/unitxt/catalog/cards/global_mmlu/hi/professional_accounting.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/hi 2026-05-27T11:53:49,030 copying build/lib/unitxt/catalog/cards/global_mmlu/hi/professional_psychology.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/hi 2026-05-27T11:53:49,033 copying build/lib/unitxt/catalog/cards/global_mmlu/hi/philosophy.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/hi 2026-05-27T11:53:49,035 copying build/lib/unitxt/catalog/cards/global_mmlu/hi/elementary_mathematics.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/hi 2026-05-27T11:53:49,038 copying build/lib/unitxt/catalog/cards/global_mmlu/hi/conceptual_physics.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/hi 2026-05-27T11:53:49,040 copying build/lib/unitxt/catalog/cards/global_mmlu/hi/high_school_geography.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/hi 2026-05-27T11:53:49,041 copying build/lib/unitxt/catalog/cards/global_mmlu/hi/human_aging.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/hi 2026-05-27T11:53:49,043 copying build/lib/unitxt/catalog/cards/global_mmlu/hi/electrical_engineering.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/hi 2026-05-27T11:53:49,045 copying build/lib/unitxt/catalog/cards/global_mmlu/hi/management.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/hi 2026-05-27T11:53:49,047 copying build/lib/unitxt/catalog/cards/global_mmlu/hi/high_school_world_history.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/hi 2026-05-27T11:53:49,049 copying build/lib/unitxt/catalog/cards/global_mmlu/hi/marketing.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/hi 2026-05-27T11:53:49,051 copying build/lib/unitxt/catalog/cards/global_mmlu/hi/high_school_european_history.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/hi 2026-05-27T11:53:49,053 copying build/lib/unitxt/catalog/cards/global_mmlu/hi/astronomy.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/hi 2026-05-27T11:53:49,055 copying build/lib/unitxt/catalog/cards/global_mmlu/hi/high_school_physics.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/hi 2026-05-27T11:53:49,057 copying build/lib/unitxt/catalog/cards/global_mmlu/hi/public_relations.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/hi 2026-05-27T11:53:49,059 copying build/lib/unitxt/catalog/cards/global_mmlu/hi/high_school_microeconomics.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/hi 2026-05-27T11:53:49,061 copying build/lib/unitxt/catalog/cards/global_mmlu/hi/virology.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/hi 2026-05-27T11:53:49,063 copying build/lib/unitxt/catalog/cards/global_mmlu/hi/high_school_us_history.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/hi 2026-05-27T11:53:49,065 copying build/lib/unitxt/catalog/cards/global_mmlu/hi/high_school_statistics.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/hi 2026-05-27T11:53:49,068 copying build/lib/unitxt/catalog/cards/global_mmlu/hi/miscellaneous.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/hi 2026-05-27T11:53:49,070 copying build/lib/unitxt/catalog/cards/global_mmlu/hi/high_school_mathematics.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/hi 2026-05-27T11:53:49,072 copying build/lib/unitxt/catalog/cards/global_mmlu/hi/formal_logic.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/hi 2026-05-27T11:53:49,074 copying build/lib/unitxt/catalog/cards/global_mmlu/hi/high_school_chemistry.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/hi 2026-05-27T11:53:49,076 copying build/lib/unitxt/catalog/cards/global_mmlu/hi/abstract_algebra.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/hi 2026-05-27T11:53:49,078 copying build/lib/unitxt/catalog/cards/global_mmlu/hi/moral_scenarios.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/hi 2026-05-27T11:53:49,081 copying build/lib/unitxt/catalog/cards/global_mmlu/hi/world_religions.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/hi 2026-05-27T11:53:49,083 copying build/lib/unitxt/catalog/cards/global_mmlu/hi/business_ethics.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/hi 2026-05-27T11:53:49,085 copying build/lib/unitxt/catalog/cards/global_mmlu/hi/security_studies.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/hi 2026-05-27T11:53:49,087 copying build/lib/unitxt/catalog/cards/global_mmlu/hi/college_medicine.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/hi 2026-05-27T11:53:49,088 copying build/lib/unitxt/catalog/cards/global_mmlu/hi/human_sexuality.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/hi 2026-05-27T11:53:49,090 copying build/lib/unitxt/catalog/cards/global_mmlu/hi/prehistory.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/hi 2026-05-27T11:53:49,094 creating build/bdist.linux-armv7l/wheel/unitxt/catalog/cards/global_mmlu/lt 2026-05-27T11:53:49,095 copying build/lib/unitxt/catalog/cards/global_mmlu/lt/moral_disputes.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/lt 2026-05-27T11:53:49,097 copying build/lib/unitxt/catalog/cards/global_mmlu/lt/high_school_biology.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/lt 2026-05-27T11:53:49,099 copying build/lib/unitxt/catalog/cards/global_mmlu/lt/jurisprudence.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/lt 2026-05-27T11:53:49,101 copying build/lib/unitxt/catalog/cards/global_mmlu/lt/logical_fallacies.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/lt 2026-05-27T11:53:49,103 copying build/lib/unitxt/catalog/cards/global_mmlu/lt/college_chemistry.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/lt 2026-05-27T11:53:49,105 copying build/lib/unitxt/catalog/cards/global_mmlu/lt/high_school_government_and_politics.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/lt 2026-05-27T11:53:49,107 copying build/lib/unitxt/catalog/cards/global_mmlu/lt/college_mathematics.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/lt 2026-05-27T11:53:49,109 copying build/lib/unitxt/catalog/cards/global_mmlu/lt/econometrics.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/lt 2026-05-27T11:53:49,112 copying build/lib/unitxt/catalog/cards/global_mmlu/lt/high_school_macroeconomics.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/lt 2026-05-27T11:53:49,114 copying build/lib/unitxt/catalog/cards/global_mmlu/lt/high_school_psychology.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/lt 2026-05-27T11:53:49,117 copying build/lib/unitxt/catalog/cards/global_mmlu/lt/computer_security.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/lt 2026-05-27T11:53:49,120 copying build/lib/unitxt/catalog/cards/global_mmlu/lt/sociology.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/lt 2026-05-27T11:53:49,123 copying build/lib/unitxt/catalog/cards/global_mmlu/lt/nutrition.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/lt 2026-05-27T11:53:49,125 copying build/lib/unitxt/catalog/cards/global_mmlu/lt/professional_medicine.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/lt 2026-05-27T11:53:49,127 copying build/lib/unitxt/catalog/cards/global_mmlu/lt/college_biology.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/lt 2026-05-27T11:53:49,129 copying build/lib/unitxt/catalog/cards/global_mmlu/lt/anatomy.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/lt 2026-05-27T11:53:49,131 copying build/lib/unitxt/catalog/cards/global_mmlu/lt/professional_law.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/lt 2026-05-27T11:53:49,133 copying build/lib/unitxt/catalog/cards/global_mmlu/lt/machine_learning.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/lt 2026-05-27T11:53:49,135 copying build/lib/unitxt/catalog/cards/global_mmlu/lt/international_law.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/lt 2026-05-27T11:53:49,137 copying build/lib/unitxt/catalog/cards/global_mmlu/lt/medical_genetics.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/lt 2026-05-27T11:53:49,139 copying build/lib/unitxt/catalog/cards/global_mmlu/lt/high_school_computer_science.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/lt 2026-05-27T11:53:49,141 copying build/lib/unitxt/catalog/cards/global_mmlu/lt/clinical_knowledge.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/lt 2026-05-27T11:53:49,143 copying build/lib/unitxt/catalog/cards/global_mmlu/lt/college_physics.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/lt 2026-05-27T11:53:49,145 copying build/lib/unitxt/catalog/cards/global_mmlu/lt/global_facts.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/lt 2026-05-27T11:53:49,147 copying build/lib/unitxt/catalog/cards/global_mmlu/lt/college_computer_science.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/lt 2026-05-27T11:53:49,149 copying build/lib/unitxt/catalog/cards/global_mmlu/lt/us_foreign_policy.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/lt 2026-05-27T11:53:49,151 copying build/lib/unitxt/catalog/cards/global_mmlu/lt/professional_accounting.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/lt 2026-05-27T11:53:49,153 copying build/lib/unitxt/catalog/cards/global_mmlu/lt/professional_psychology.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/lt 2026-05-27T11:53:49,155 copying build/lib/unitxt/catalog/cards/global_mmlu/lt/philosophy.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/lt 2026-05-27T11:53:49,157 copying build/lib/unitxt/catalog/cards/global_mmlu/lt/elementary_mathematics.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/lt 2026-05-27T11:53:49,159 copying build/lib/unitxt/catalog/cards/global_mmlu/lt/conceptual_physics.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/lt 2026-05-27T11:53:49,161 copying build/lib/unitxt/catalog/cards/global_mmlu/lt/high_school_geography.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/lt 2026-05-27T11:53:49,164 copying build/lib/unitxt/catalog/cards/global_mmlu/lt/human_aging.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/lt 2026-05-27T11:53:49,166 copying build/lib/unitxt/catalog/cards/global_mmlu/lt/electrical_engineering.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/lt 2026-05-27T11:53:49,168 copying build/lib/unitxt/catalog/cards/global_mmlu/lt/management.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/lt 2026-05-27T11:53:49,170 copying build/lib/unitxt/catalog/cards/global_mmlu/lt/high_school_world_history.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/lt 2026-05-27T11:53:49,172 copying build/lib/unitxt/catalog/cards/global_mmlu/lt/marketing.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/lt 2026-05-27T11:53:49,174 copying build/lib/unitxt/catalog/cards/global_mmlu/lt/high_school_european_history.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/lt 2026-05-27T11:53:49,176 copying build/lib/unitxt/catalog/cards/global_mmlu/lt/astronomy.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/lt 2026-05-27T11:53:49,178 copying build/lib/unitxt/catalog/cards/global_mmlu/lt/high_school_physics.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/lt 2026-05-27T11:53:49,180 copying build/lib/unitxt/catalog/cards/global_mmlu/lt/public_relations.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/lt 2026-05-27T11:53:49,182 copying build/lib/unitxt/catalog/cards/global_mmlu/lt/high_school_microeconomics.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/lt 2026-05-27T11:53:49,184 copying build/lib/unitxt/catalog/cards/global_mmlu/lt/virology.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/lt 2026-05-27T11:53:49,186 copying build/lib/unitxt/catalog/cards/global_mmlu/lt/high_school_us_history.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/lt 2026-05-27T11:53:49,188 copying build/lib/unitxt/catalog/cards/global_mmlu/lt/high_school_statistics.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/lt 2026-05-27T11:53:49,190 copying build/lib/unitxt/catalog/cards/global_mmlu/lt/miscellaneous.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/lt 2026-05-27T11:53:49,192 copying build/lib/unitxt/catalog/cards/global_mmlu/lt/high_school_mathematics.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/lt 2026-05-27T11:53:49,194 copying build/lib/unitxt/catalog/cards/global_mmlu/lt/formal_logic.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/lt 2026-05-27T11:53:49,196 copying build/lib/unitxt/catalog/cards/global_mmlu/lt/high_school_chemistry.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/lt 2026-05-27T11:53:49,198 copying build/lib/unitxt/catalog/cards/global_mmlu/lt/abstract_algebra.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/lt 2026-05-27T11:53:49,200 copying build/lib/unitxt/catalog/cards/global_mmlu/lt/moral_scenarios.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/lt 2026-05-27T11:53:49,202 copying build/lib/unitxt/catalog/cards/global_mmlu/lt/world_religions.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/lt 2026-05-27T11:53:49,204 copying build/lib/unitxt/catalog/cards/global_mmlu/lt/business_ethics.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/lt 2026-05-27T11:53:49,207 copying build/lib/unitxt/catalog/cards/global_mmlu/lt/security_studies.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/lt 2026-05-27T11:53:49,208 copying build/lib/unitxt/catalog/cards/global_mmlu/lt/college_medicine.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/lt 2026-05-27T11:53:49,210 copying build/lib/unitxt/catalog/cards/global_mmlu/lt/human_sexuality.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/lt 2026-05-27T11:53:49,212 copying build/lib/unitxt/catalog/cards/global_mmlu/lt/prehistory.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/lt 2026-05-27T11:53:49,216 creating build/bdist.linux-armv7l/wheel/unitxt/catalog/cards/global_mmlu/ky 2026-05-27T11:53:49,217 copying build/lib/unitxt/catalog/cards/global_mmlu/ky/moral_disputes.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/ky 2026-05-27T11:53:49,219 copying build/lib/unitxt/catalog/cards/global_mmlu/ky/high_school_biology.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/ky 2026-05-27T11:53:49,221 copying build/lib/unitxt/catalog/cards/global_mmlu/ky/jurisprudence.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/ky 2026-05-27T11:53:49,223 copying build/lib/unitxt/catalog/cards/global_mmlu/ky/logical_fallacies.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/ky 2026-05-27T11:53:49,225 copying build/lib/unitxt/catalog/cards/global_mmlu/ky/college_chemistry.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/ky 2026-05-27T11:53:49,227 copying build/lib/unitxt/catalog/cards/global_mmlu/ky/high_school_government_and_politics.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/ky 2026-05-27T11:53:49,229 copying build/lib/unitxt/catalog/cards/global_mmlu/ky/college_mathematics.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/ky 2026-05-27T11:53:49,232 copying build/lib/unitxt/catalog/cards/global_mmlu/ky/econometrics.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/ky 2026-05-27T11:53:49,233 copying build/lib/unitxt/catalog/cards/global_mmlu/ky/high_school_macroeconomics.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/ky 2026-05-27T11:53:49,235 copying build/lib/unitxt/catalog/cards/global_mmlu/ky/high_school_psychology.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/ky 2026-05-27T11:53:49,237 copying build/lib/unitxt/catalog/cards/global_mmlu/ky/computer_security.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/ky 2026-05-27T11:53:49,239 copying build/lib/unitxt/catalog/cards/global_mmlu/ky/sociology.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/ky 2026-05-27T11:53:49,241 copying build/lib/unitxt/catalog/cards/global_mmlu/ky/nutrition.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/ky 2026-05-27T11:53:49,243 copying build/lib/unitxt/catalog/cards/global_mmlu/ky/professional_medicine.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/ky 2026-05-27T11:53:49,245 copying build/lib/unitxt/catalog/cards/global_mmlu/ky/college_biology.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/ky 2026-05-27T11:53:49,247 copying build/lib/unitxt/catalog/cards/global_mmlu/ky/anatomy.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/ky 2026-05-27T11:53:49,249 copying build/lib/unitxt/catalog/cards/global_mmlu/ky/professional_law.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/ky 2026-05-27T11:53:49,251 copying build/lib/unitxt/catalog/cards/global_mmlu/ky/machine_learning.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/ky 2026-05-27T11:53:49,253 copying build/lib/unitxt/catalog/cards/global_mmlu/ky/international_law.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/ky 2026-05-27T11:53:49,255 copying build/lib/unitxt/catalog/cards/global_mmlu/ky/medical_genetics.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/ky 2026-05-27T11:53:49,257 copying build/lib/unitxt/catalog/cards/global_mmlu/ky/high_school_computer_science.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/ky 2026-05-27T11:53:49,260 copying build/lib/unitxt/catalog/cards/global_mmlu/ky/clinical_knowledge.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/ky 2026-05-27T11:53:49,263 copying build/lib/unitxt/catalog/cards/global_mmlu/ky/college_physics.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/ky 2026-05-27T11:53:49,265 copying build/lib/unitxt/catalog/cards/global_mmlu/ky/global_facts.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/ky 2026-05-27T11:53:49,267 copying build/lib/unitxt/catalog/cards/global_mmlu/ky/college_computer_science.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/ky 2026-05-27T11:53:49,269 copying build/lib/unitxt/catalog/cards/global_mmlu/ky/us_foreign_policy.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/ky 2026-05-27T11:53:49,271 copying build/lib/unitxt/catalog/cards/global_mmlu/ky/professional_accounting.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/ky 2026-05-27T11:53:49,273 copying build/lib/unitxt/catalog/cards/global_mmlu/ky/professional_psychology.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/ky 2026-05-27T11:53:49,275 copying build/lib/unitxt/catalog/cards/global_mmlu/ky/philosophy.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/ky 2026-05-27T11:53:49,277 copying build/lib/unitxt/catalog/cards/global_mmlu/ky/elementary_mathematics.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/ky 2026-05-27T11:53:49,279 copying build/lib/unitxt/catalog/cards/global_mmlu/ky/conceptual_physics.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/ky 2026-05-27T11:53:49,281 copying build/lib/unitxt/catalog/cards/global_mmlu/ky/high_school_geography.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/ky 2026-05-27T11:53:49,283 copying build/lib/unitxt/catalog/cards/global_mmlu/ky/human_aging.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/ky 2026-05-27T11:53:49,285 copying build/lib/unitxt/catalog/cards/global_mmlu/ky/electrical_engineering.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/ky 2026-05-27T11:53:49,287 copying build/lib/unitxt/catalog/cards/global_mmlu/ky/management.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/ky 2026-05-27T11:53:49,289 copying build/lib/unitxt/catalog/cards/global_mmlu/ky/high_school_world_history.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/ky 2026-05-27T11:53:49,291 copying build/lib/unitxt/catalog/cards/global_mmlu/ky/marketing.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/ky 2026-05-27T11:53:49,293 copying build/lib/unitxt/catalog/cards/global_mmlu/ky/high_school_european_history.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/ky 2026-05-27T11:53:49,295 copying build/lib/unitxt/catalog/cards/global_mmlu/ky/astronomy.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/ky 2026-05-27T11:53:49,297 copying build/lib/unitxt/catalog/cards/global_mmlu/ky/high_school_physics.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/ky 2026-05-27T11:53:49,299 copying build/lib/unitxt/catalog/cards/global_mmlu/ky/public_relations.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/ky 2026-05-27T11:53:49,301 copying build/lib/unitxt/catalog/cards/global_mmlu/ky/high_school_microeconomics.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/ky 2026-05-27T11:53:49,303 copying build/lib/unitxt/catalog/cards/global_mmlu/ky/virology.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/ky 2026-05-27T11:53:49,305 copying build/lib/unitxt/catalog/cards/global_mmlu/ky/high_school_us_history.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/ky 2026-05-27T11:53:49,307 copying build/lib/unitxt/catalog/cards/global_mmlu/ky/high_school_statistics.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/ky 2026-05-27T11:53:49,309 copying build/lib/unitxt/catalog/cards/global_mmlu/ky/miscellaneous.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/ky 2026-05-27T11:53:49,311 copying build/lib/unitxt/catalog/cards/global_mmlu/ky/high_school_mathematics.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/ky 2026-05-27T11:53:49,313 copying build/lib/unitxt/catalog/cards/global_mmlu/ky/formal_logic.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/ky 2026-05-27T11:53:49,315 copying build/lib/unitxt/catalog/cards/global_mmlu/ky/high_school_chemistry.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/ky 2026-05-27T11:53:49,317 copying build/lib/unitxt/catalog/cards/global_mmlu/ky/abstract_algebra.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/ky 2026-05-27T11:53:49,319 copying build/lib/unitxt/catalog/cards/global_mmlu/ky/moral_scenarios.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/ky 2026-05-27T11:53:49,321 copying build/lib/unitxt/catalog/cards/global_mmlu/ky/world_religions.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/ky 2026-05-27T11:53:49,323 copying build/lib/unitxt/catalog/cards/global_mmlu/ky/business_ethics.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/ky 2026-05-27T11:53:49,325 copying build/lib/unitxt/catalog/cards/global_mmlu/ky/security_studies.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/ky 2026-05-27T11:53:49,327 copying build/lib/unitxt/catalog/cards/global_mmlu/ky/college_medicine.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/ky 2026-05-27T11:53:49,329 copying build/lib/unitxt/catalog/cards/global_mmlu/ky/human_sexuality.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/ky 2026-05-27T11:53:49,331 copying build/lib/unitxt/catalog/cards/global_mmlu/ky/prehistory.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/ky 2026-05-27T11:53:49,334 creating build/bdist.linux-armv7l/wheel/unitxt/catalog/cards/global_mmlu/id 2026-05-27T11:53:49,336 copying build/lib/unitxt/catalog/cards/global_mmlu/id/moral_disputes.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/id 2026-05-27T11:53:49,338 copying build/lib/unitxt/catalog/cards/global_mmlu/id/high_school_biology.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/id 2026-05-27T11:53:49,340 copying build/lib/unitxt/catalog/cards/global_mmlu/id/jurisprudence.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/id 2026-05-27T11:53:49,342 copying build/lib/unitxt/catalog/cards/global_mmlu/id/logical_fallacies.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/id 2026-05-27T11:53:49,344 copying build/lib/unitxt/catalog/cards/global_mmlu/id/college_chemistry.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/id 2026-05-27T11:53:49,346 copying build/lib/unitxt/catalog/cards/global_mmlu/id/high_school_government_and_politics.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/id 2026-05-27T11:53:49,348 copying build/lib/unitxt/catalog/cards/global_mmlu/id/college_mathematics.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/id 2026-05-27T11:53:49,349 copying build/lib/unitxt/catalog/cards/global_mmlu/id/econometrics.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/id 2026-05-27T11:53:49,351 copying build/lib/unitxt/catalog/cards/global_mmlu/id/high_school_macroeconomics.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/id 2026-05-27T11:53:49,353 copying build/lib/unitxt/catalog/cards/global_mmlu/id/high_school_psychology.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/id 2026-05-27T11:53:49,355 copying build/lib/unitxt/catalog/cards/global_mmlu/id/computer_security.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/id 2026-05-27T11:53:49,357 copying build/lib/unitxt/catalog/cards/global_mmlu/id/sociology.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/id 2026-05-27T11:53:49,359 copying build/lib/unitxt/catalog/cards/global_mmlu/id/nutrition.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/id 2026-05-27T11:53:49,361 copying build/lib/unitxt/catalog/cards/global_mmlu/id/professional_medicine.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/id 2026-05-27T11:53:49,363 copying build/lib/unitxt/catalog/cards/global_mmlu/id/college_biology.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/id 2026-05-27T11:53:49,365 copying build/lib/unitxt/catalog/cards/global_mmlu/id/anatomy.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/id 2026-05-27T11:53:49,367 copying build/lib/unitxt/catalog/cards/global_mmlu/id/professional_law.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/id 2026-05-27T11:53:49,369 copying build/lib/unitxt/catalog/cards/global_mmlu/id/machine_learning.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/id 2026-05-27T11:53:49,371 copying build/lib/unitxt/catalog/cards/global_mmlu/id/international_law.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/id 2026-05-27T11:53:49,373 copying build/lib/unitxt/catalog/cards/global_mmlu/id/medical_genetics.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/id 2026-05-27T11:53:49,375 copying build/lib/unitxt/catalog/cards/global_mmlu/id/high_school_computer_science.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/id 2026-05-27T11:53:49,377 copying build/lib/unitxt/catalog/cards/global_mmlu/id/clinical_knowledge.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/id 2026-05-27T11:53:49,378 copying build/lib/unitxt/catalog/cards/global_mmlu/id/college_physics.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/id 2026-05-27T11:53:49,380 copying build/lib/unitxt/catalog/cards/global_mmlu/id/global_facts.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/id 2026-05-27T11:53:49,382 copying build/lib/unitxt/catalog/cards/global_mmlu/id/college_computer_science.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/id 2026-05-27T11:53:49,384 copying build/lib/unitxt/catalog/cards/global_mmlu/id/us_foreign_policy.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/id 2026-05-27T11:53:49,386 copying build/lib/unitxt/catalog/cards/global_mmlu/id/professional_accounting.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/id 2026-05-27T11:53:49,388 copying build/lib/unitxt/catalog/cards/global_mmlu/id/professional_psychology.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/id 2026-05-27T11:53:49,390 copying build/lib/unitxt/catalog/cards/global_mmlu/id/philosophy.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/id 2026-05-27T11:53:49,392 copying build/lib/unitxt/catalog/cards/global_mmlu/id/elementary_mathematics.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/id 2026-05-27T11:53:49,394 copying build/lib/unitxt/catalog/cards/global_mmlu/id/conceptual_physics.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/id 2026-05-27T11:53:49,396 copying build/lib/unitxt/catalog/cards/global_mmlu/id/high_school_geography.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/id 2026-05-27T11:53:49,398 copying build/lib/unitxt/catalog/cards/global_mmlu/id/human_aging.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/id 2026-05-27T11:53:49,400 copying build/lib/unitxt/catalog/cards/global_mmlu/id/electrical_engineering.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/id 2026-05-27T11:53:49,401 copying build/lib/unitxt/catalog/cards/global_mmlu/id/management.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/id 2026-05-27T11:53:49,403 copying build/lib/unitxt/catalog/cards/global_mmlu/id/high_school_world_history.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/id 2026-05-27T11:53:49,405 copying build/lib/unitxt/catalog/cards/global_mmlu/id/marketing.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/id 2026-05-27T11:53:49,407 copying build/lib/unitxt/catalog/cards/global_mmlu/id/high_school_european_history.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/id 2026-05-27T11:53:49,409 copying build/lib/unitxt/catalog/cards/global_mmlu/id/astronomy.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/id 2026-05-27T11:53:49,411 copying build/lib/unitxt/catalog/cards/global_mmlu/id/high_school_physics.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/id 2026-05-27T11:53:49,413 copying build/lib/unitxt/catalog/cards/global_mmlu/id/public_relations.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/id 2026-05-27T11:53:49,415 copying build/lib/unitxt/catalog/cards/global_mmlu/id/high_school_microeconomics.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/id 2026-05-27T11:53:49,417 copying build/lib/unitxt/catalog/cards/global_mmlu/id/virology.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/id 2026-05-27T11:53:49,419 copying build/lib/unitxt/catalog/cards/global_mmlu/id/high_school_us_history.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/id 2026-05-27T11:53:49,421 copying build/lib/unitxt/catalog/cards/global_mmlu/id/high_school_statistics.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/id 2026-05-27T11:53:49,423 copying build/lib/unitxt/catalog/cards/global_mmlu/id/miscellaneous.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/id 2026-05-27T11:53:49,425 copying build/lib/unitxt/catalog/cards/global_mmlu/id/high_school_mathematics.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/id 2026-05-27T11:53:49,426 copying build/lib/unitxt/catalog/cards/global_mmlu/id/formal_logic.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/id 2026-05-27T11:53:49,428 copying build/lib/unitxt/catalog/cards/global_mmlu/id/high_school_chemistry.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/id 2026-05-27T11:53:49,430 copying build/lib/unitxt/catalog/cards/global_mmlu/id/abstract_algebra.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/id 2026-05-27T11:53:49,432 copying build/lib/unitxt/catalog/cards/global_mmlu/id/moral_scenarios.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/id 2026-05-27T11:53:49,434 copying build/lib/unitxt/catalog/cards/global_mmlu/id/world_religions.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/id 2026-05-27T11:53:49,436 copying build/lib/unitxt/catalog/cards/global_mmlu/id/business_ethics.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/id 2026-05-27T11:53:49,438 copying build/lib/unitxt/catalog/cards/global_mmlu/id/security_studies.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/id 2026-05-27T11:53:49,440 copying build/lib/unitxt/catalog/cards/global_mmlu/id/college_medicine.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/id 2026-05-27T11:53:49,442 copying build/lib/unitxt/catalog/cards/global_mmlu/id/human_sexuality.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/id 2026-05-27T11:53:49,443 copying build/lib/unitxt/catalog/cards/global_mmlu/id/prehistory.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/id 2026-05-27T11:53:49,447 creating build/bdist.linux-armv7l/wheel/unitxt/catalog/cards/global_mmlu/he 2026-05-27T11:53:49,448 copying build/lib/unitxt/catalog/cards/global_mmlu/he/moral_disputes.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/he 2026-05-27T11:53:49,450 copying build/lib/unitxt/catalog/cards/global_mmlu/he/high_school_biology.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/he 2026-05-27T11:53:49,452 copying build/lib/unitxt/catalog/cards/global_mmlu/he/jurisprudence.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/he 2026-05-27T11:53:49,454 copying build/lib/unitxt/catalog/cards/global_mmlu/he/logical_fallacies.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/he 2026-05-27T11:53:49,456 copying build/lib/unitxt/catalog/cards/global_mmlu/he/college_chemistry.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/he 2026-05-27T11:53:49,458 copying build/lib/unitxt/catalog/cards/global_mmlu/he/high_school_government_and_politics.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/he 2026-05-27T11:53:49,460 copying build/lib/unitxt/catalog/cards/global_mmlu/he/college_mathematics.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/he 2026-05-27T11:53:49,462 copying build/lib/unitxt/catalog/cards/global_mmlu/he/econometrics.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/he 2026-05-27T11:53:49,463 copying build/lib/unitxt/catalog/cards/global_mmlu/he/high_school_macroeconomics.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/he 2026-05-27T11:53:49,465 copying build/lib/unitxt/catalog/cards/global_mmlu/he/high_school_psychology.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/he 2026-05-27T11:53:49,468 copying build/lib/unitxt/catalog/cards/global_mmlu/he/computer_security.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/he 2026-05-27T11:53:49,469 copying build/lib/unitxt/catalog/cards/global_mmlu/he/sociology.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/he 2026-05-27T11:53:49,471 copying build/lib/unitxt/catalog/cards/global_mmlu/he/nutrition.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/he 2026-05-27T11:53:49,473 copying build/lib/unitxt/catalog/cards/global_mmlu/he/professional_medicine.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/he 2026-05-27T11:53:49,475 copying build/lib/unitxt/catalog/cards/global_mmlu/he/college_biology.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/he 2026-05-27T11:53:49,477 copying build/lib/unitxt/catalog/cards/global_mmlu/he/anatomy.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/he 2026-05-27T11:53:49,478 copying build/lib/unitxt/catalog/cards/global_mmlu/he/professional_law.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/he 2026-05-27T11:53:49,480 copying build/lib/unitxt/catalog/cards/global_mmlu/he/machine_learning.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/he 2026-05-27T11:53:49,482 copying build/lib/unitxt/catalog/cards/global_mmlu/he/international_law.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/he 2026-05-27T11:53:49,484 copying build/lib/unitxt/catalog/cards/global_mmlu/he/medical_genetics.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/he 2026-05-27T11:53:49,486 copying build/lib/unitxt/catalog/cards/global_mmlu/he/high_school_computer_science.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/he 2026-05-27T11:53:49,488 copying build/lib/unitxt/catalog/cards/global_mmlu/he/clinical_knowledge.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/he 2026-05-27T11:53:49,490 copying build/lib/unitxt/catalog/cards/global_mmlu/he/college_physics.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/he 2026-05-27T11:53:49,492 copying build/lib/unitxt/catalog/cards/global_mmlu/he/global_facts.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/he 2026-05-27T11:53:49,494 copying build/lib/unitxt/catalog/cards/global_mmlu/he/college_computer_science.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/he 2026-05-27T11:53:49,496 copying build/lib/unitxt/catalog/cards/global_mmlu/he/us_foreign_policy.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/he 2026-05-27T11:53:49,498 copying build/lib/unitxt/catalog/cards/global_mmlu/he/professional_accounting.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/he 2026-05-27T11:53:49,500 copying build/lib/unitxt/catalog/cards/global_mmlu/he/professional_psychology.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/he 2026-05-27T11:53:49,502 copying build/lib/unitxt/catalog/cards/global_mmlu/he/philosophy.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/he 2026-05-27T11:53:49,504 copying build/lib/unitxt/catalog/cards/global_mmlu/he/elementary_mathematics.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/he 2026-05-27T11:53:49,506 copying build/lib/unitxt/catalog/cards/global_mmlu/he/conceptual_physics.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/he 2026-05-27T11:53:49,508 copying build/lib/unitxt/catalog/cards/global_mmlu/he/high_school_geography.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/he 2026-05-27T11:53:49,510 copying build/lib/unitxt/catalog/cards/global_mmlu/he/human_aging.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/he 2026-05-27T11:53:49,512 copying build/lib/unitxt/catalog/cards/global_mmlu/he/electrical_engineering.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/he 2026-05-27T11:53:49,514 copying build/lib/unitxt/catalog/cards/global_mmlu/he/management.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/he 2026-05-27T11:53:49,516 copying build/lib/unitxt/catalog/cards/global_mmlu/he/high_school_world_history.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/he 2026-05-27T11:53:49,518 copying build/lib/unitxt/catalog/cards/global_mmlu/he/marketing.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/he 2026-05-27T11:53:49,520 copying build/lib/unitxt/catalog/cards/global_mmlu/he/high_school_european_history.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/he 2026-05-27T11:53:49,521 copying build/lib/unitxt/catalog/cards/global_mmlu/he/astronomy.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/he 2026-05-27T11:53:49,523 copying build/lib/unitxt/catalog/cards/global_mmlu/he/high_school_physics.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/he 2026-05-27T11:53:49,525 copying build/lib/unitxt/catalog/cards/global_mmlu/he/public_relations.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/he 2026-05-27T11:53:49,527 copying build/lib/unitxt/catalog/cards/global_mmlu/he/high_school_microeconomics.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/he 2026-05-27T11:53:49,529 copying build/lib/unitxt/catalog/cards/global_mmlu/he/virology.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/he 2026-05-27T11:53:49,532 copying build/lib/unitxt/catalog/cards/global_mmlu/he/high_school_us_history.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/he 2026-05-27T11:53:49,534 copying build/lib/unitxt/catalog/cards/global_mmlu/he/high_school_statistics.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/he 2026-05-27T11:53:49,536 copying build/lib/unitxt/catalog/cards/global_mmlu/he/miscellaneous.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/he 2026-05-27T11:53:49,538 copying build/lib/unitxt/catalog/cards/global_mmlu/he/high_school_mathematics.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/he 2026-05-27T11:53:49,540 copying build/lib/unitxt/catalog/cards/global_mmlu/he/formal_logic.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/he 2026-05-27T11:53:49,543 copying build/lib/unitxt/catalog/cards/global_mmlu/he/high_school_chemistry.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/he 2026-05-27T11:53:49,545 copying build/lib/unitxt/catalog/cards/global_mmlu/he/abstract_algebra.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/he 2026-05-27T11:53:49,547 copying build/lib/unitxt/catalog/cards/global_mmlu/he/moral_scenarios.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/he 2026-05-27T11:53:49,550 copying build/lib/unitxt/catalog/cards/global_mmlu/he/world_religions.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/he 2026-05-27T11:53:49,552 copying build/lib/unitxt/catalog/cards/global_mmlu/he/business_ethics.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/he 2026-05-27T11:53:49,555 copying build/lib/unitxt/catalog/cards/global_mmlu/he/security_studies.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/he 2026-05-27T11:53:49,557 copying build/lib/unitxt/catalog/cards/global_mmlu/he/college_medicine.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/he 2026-05-27T11:53:49,559 copying build/lib/unitxt/catalog/cards/global_mmlu/he/human_sexuality.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/he 2026-05-27T11:53:49,562 copying build/lib/unitxt/catalog/cards/global_mmlu/he/prehistory.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/he 2026-05-27T11:53:49,566 creating build/bdist.linux-armv7l/wheel/unitxt/catalog/cards/global_mmlu/ja 2026-05-27T11:53:49,567 copying build/lib/unitxt/catalog/cards/global_mmlu/ja/moral_disputes.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/ja 2026-05-27T11:53:49,569 copying build/lib/unitxt/catalog/cards/global_mmlu/ja/high_school_biology.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/ja 2026-05-27T11:53:49,572 copying build/lib/unitxt/catalog/cards/global_mmlu/ja/jurisprudence.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/ja 2026-05-27T11:53:49,574 copying build/lib/unitxt/catalog/cards/global_mmlu/ja/logical_fallacies.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/ja 2026-05-27T11:53:49,576 copying build/lib/unitxt/catalog/cards/global_mmlu/ja/college_chemistry.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/ja 2026-05-27T11:53:49,579 copying build/lib/unitxt/catalog/cards/global_mmlu/ja/high_school_government_and_politics.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/ja 2026-05-27T11:53:49,581 copying build/lib/unitxt/catalog/cards/global_mmlu/ja/college_mathematics.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/ja 2026-05-27T11:53:49,584 copying build/lib/unitxt/catalog/cards/global_mmlu/ja/econometrics.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/ja 2026-05-27T11:53:49,586 copying build/lib/unitxt/catalog/cards/global_mmlu/ja/high_school_macroeconomics.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/ja 2026-05-27T11:53:49,588 copying build/lib/unitxt/catalog/cards/global_mmlu/ja/high_school_psychology.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/ja 2026-05-27T11:53:49,591 copying build/lib/unitxt/catalog/cards/global_mmlu/ja/computer_security.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/ja 2026-05-27T11:53:49,593 copying build/lib/unitxt/catalog/cards/global_mmlu/ja/sociology.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/ja 2026-05-27T11:53:49,595 copying build/lib/unitxt/catalog/cards/global_mmlu/ja/nutrition.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/ja 2026-05-27T11:53:49,598 copying build/lib/unitxt/catalog/cards/global_mmlu/ja/professional_medicine.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/ja 2026-05-27T11:53:49,600 copying build/lib/unitxt/catalog/cards/global_mmlu/ja/college_biology.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/ja 2026-05-27T11:53:49,603 copying build/lib/unitxt/catalog/cards/global_mmlu/ja/anatomy.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/ja 2026-05-27T11:53:49,605 copying build/lib/unitxt/catalog/cards/global_mmlu/ja/professional_law.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/ja 2026-05-27T11:53:49,607 copying build/lib/unitxt/catalog/cards/global_mmlu/ja/machine_learning.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/ja 2026-05-27T11:53:49,610 copying build/lib/unitxt/catalog/cards/global_mmlu/ja/international_law.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/ja 2026-05-27T11:53:49,612 copying build/lib/unitxt/catalog/cards/global_mmlu/ja/medical_genetics.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/ja 2026-05-27T11:53:49,614 copying build/lib/unitxt/catalog/cards/global_mmlu/ja/high_school_computer_science.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/ja 2026-05-27T11:53:49,617 copying build/lib/unitxt/catalog/cards/global_mmlu/ja/clinical_knowledge.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/ja 2026-05-27T11:53:49,619 copying build/lib/unitxt/catalog/cards/global_mmlu/ja/college_physics.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/ja 2026-05-27T11:53:49,621 copying build/lib/unitxt/catalog/cards/global_mmlu/ja/global_facts.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/ja 2026-05-27T11:53:49,624 copying build/lib/unitxt/catalog/cards/global_mmlu/ja/college_computer_science.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/ja 2026-05-27T11:53:49,626 copying build/lib/unitxt/catalog/cards/global_mmlu/ja/us_foreign_policy.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/ja 2026-05-27T11:53:49,628 copying build/lib/unitxt/catalog/cards/global_mmlu/ja/professional_accounting.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/ja 2026-05-27T11:53:49,631 copying build/lib/unitxt/catalog/cards/global_mmlu/ja/professional_psychology.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/ja 2026-05-27T11:53:49,633 copying build/lib/unitxt/catalog/cards/global_mmlu/ja/philosophy.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/ja 2026-05-27T11:53:49,636 copying build/lib/unitxt/catalog/cards/global_mmlu/ja/elementary_mathematics.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/ja 2026-05-27T11:53:49,638 copying build/lib/unitxt/catalog/cards/global_mmlu/ja/conceptual_physics.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/ja 2026-05-27T11:53:49,640 copying build/lib/unitxt/catalog/cards/global_mmlu/ja/high_school_geography.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/ja 2026-05-27T11:53:49,641 copying build/lib/unitxt/catalog/cards/global_mmlu/ja/human_aging.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/ja 2026-05-27T11:53:49,643 copying build/lib/unitxt/catalog/cards/global_mmlu/ja/electrical_engineering.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/ja 2026-05-27T11:53:49,645 copying build/lib/unitxt/catalog/cards/global_mmlu/ja/management.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/ja 2026-05-27T11:53:49,647 copying build/lib/unitxt/catalog/cards/global_mmlu/ja/high_school_world_history.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/ja 2026-05-27T11:53:49,649 copying build/lib/unitxt/catalog/cards/global_mmlu/ja/marketing.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/ja 2026-05-27T11:53:49,651 copying build/lib/unitxt/catalog/cards/global_mmlu/ja/high_school_european_history.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/ja 2026-05-27T11:53:49,654 copying build/lib/unitxt/catalog/cards/global_mmlu/ja/astronomy.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/ja 2026-05-27T11:53:49,656 copying build/lib/unitxt/catalog/cards/global_mmlu/ja/high_school_physics.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/ja 2026-05-27T11:53:49,658 copying build/lib/unitxt/catalog/cards/global_mmlu/ja/public_relations.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/ja 2026-05-27T11:53:49,661 copying build/lib/unitxt/catalog/cards/global_mmlu/ja/high_school_microeconomics.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/ja 2026-05-27T11:53:49,663 copying build/lib/unitxt/catalog/cards/global_mmlu/ja/virology.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/ja 2026-05-27T11:53:49,665 copying build/lib/unitxt/catalog/cards/global_mmlu/ja/high_school_us_history.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/ja 2026-05-27T11:53:49,666 copying build/lib/unitxt/catalog/cards/global_mmlu/ja/high_school_statistics.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/ja 2026-05-27T11:53:49,668 copying build/lib/unitxt/catalog/cards/global_mmlu/ja/miscellaneous.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/ja 2026-05-27T11:53:49,670 copying build/lib/unitxt/catalog/cards/global_mmlu/ja/high_school_mathematics.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/ja 2026-05-27T11:53:49,672 copying build/lib/unitxt/catalog/cards/global_mmlu/ja/formal_logic.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/ja 2026-05-27T11:53:49,674 copying build/lib/unitxt/catalog/cards/global_mmlu/ja/high_school_chemistry.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/ja 2026-05-27T11:53:49,676 copying build/lib/unitxt/catalog/cards/global_mmlu/ja/abstract_algebra.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/ja 2026-05-27T11:53:49,677 copying build/lib/unitxt/catalog/cards/global_mmlu/ja/moral_scenarios.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/ja 2026-05-27T11:53:49,679 copying build/lib/unitxt/catalog/cards/global_mmlu/ja/world_religions.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/ja 2026-05-27T11:53:49,681 copying build/lib/unitxt/catalog/cards/global_mmlu/ja/business_ethics.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/ja 2026-05-27T11:53:49,683 copying build/lib/unitxt/catalog/cards/global_mmlu/ja/security_studies.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/ja 2026-05-27T11:53:49,685 copying build/lib/unitxt/catalog/cards/global_mmlu/ja/college_medicine.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/ja 2026-05-27T11:53:49,687 copying build/lib/unitxt/catalog/cards/global_mmlu/ja/human_sexuality.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/ja 2026-05-27T11:53:49,689 copying build/lib/unitxt/catalog/cards/global_mmlu/ja/prehistory.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/ja 2026-05-27T11:53:49,692 creating build/bdist.linux-armv7l/wheel/unitxt/catalog/cards/global_mmlu/bn 2026-05-27T11:53:49,693 copying build/lib/unitxt/catalog/cards/global_mmlu/bn/moral_disputes.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/bn 2026-05-27T11:53:49,695 copying build/lib/unitxt/catalog/cards/global_mmlu/bn/high_school_biology.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/bn 2026-05-27T11:53:49,697 copying build/lib/unitxt/catalog/cards/global_mmlu/bn/jurisprudence.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/bn 2026-05-27T11:53:49,699 copying build/lib/unitxt/catalog/cards/global_mmlu/bn/logical_fallacies.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/bn 2026-05-27T11:53:49,701 copying build/lib/unitxt/catalog/cards/global_mmlu/bn/college_chemistry.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/bn 2026-05-27T11:53:49,703 copying build/lib/unitxt/catalog/cards/global_mmlu/bn/high_school_government_and_politics.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/bn 2026-05-27T11:53:49,705 copying build/lib/unitxt/catalog/cards/global_mmlu/bn/college_mathematics.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/bn 2026-05-27T11:53:49,707 copying build/lib/unitxt/catalog/cards/global_mmlu/bn/econometrics.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/bn 2026-05-27T11:53:49,709 copying build/lib/unitxt/catalog/cards/global_mmlu/bn/high_school_macroeconomics.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/bn 2026-05-27T11:53:49,711 copying build/lib/unitxt/catalog/cards/global_mmlu/bn/high_school_psychology.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/bn 2026-05-27T11:53:49,713 copying build/lib/unitxt/catalog/cards/global_mmlu/bn/computer_security.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/bn 2026-05-27T11:53:49,714 copying build/lib/unitxt/catalog/cards/global_mmlu/bn/sociology.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/bn 2026-05-27T11:53:49,716 copying build/lib/unitxt/catalog/cards/global_mmlu/bn/nutrition.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/bn 2026-05-27T11:53:49,718 copying build/lib/unitxt/catalog/cards/global_mmlu/bn/professional_medicine.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/bn 2026-05-27T11:53:49,720 copying build/lib/unitxt/catalog/cards/global_mmlu/bn/college_biology.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/bn 2026-05-27T11:53:49,722 copying build/lib/unitxt/catalog/cards/global_mmlu/bn/anatomy.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/bn 2026-05-27T11:53:49,723 copying build/lib/unitxt/catalog/cards/global_mmlu/bn/professional_law.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/bn 2026-05-27T11:53:49,725 copying build/lib/unitxt/catalog/cards/global_mmlu/bn/machine_learning.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/bn 2026-05-27T11:53:49,727 copying build/lib/unitxt/catalog/cards/global_mmlu/bn/international_law.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/bn 2026-05-27T11:53:49,729 copying build/lib/unitxt/catalog/cards/global_mmlu/bn/medical_genetics.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/bn 2026-05-27T11:53:49,731 copying build/lib/unitxt/catalog/cards/global_mmlu/bn/high_school_computer_science.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/bn 2026-05-27T11:53:49,733 copying build/lib/unitxt/catalog/cards/global_mmlu/bn/clinical_knowledge.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/bn 2026-05-27T11:53:49,735 copying build/lib/unitxt/catalog/cards/global_mmlu/bn/college_physics.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/bn 2026-05-27T11:53:49,737 copying build/lib/unitxt/catalog/cards/global_mmlu/bn/global_facts.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/bn 2026-05-27T11:53:49,739 copying build/lib/unitxt/catalog/cards/global_mmlu/bn/college_computer_science.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/bn 2026-05-27T11:53:49,741 copying build/lib/unitxt/catalog/cards/global_mmlu/bn/us_foreign_policy.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/bn 2026-05-27T11:53:49,744 copying build/lib/unitxt/catalog/cards/global_mmlu/bn/professional_accounting.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/bn 2026-05-27T11:53:49,746 copying build/lib/unitxt/catalog/cards/global_mmlu/bn/professional_psychology.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/bn 2026-05-27T11:53:49,748 copying build/lib/unitxt/catalog/cards/global_mmlu/bn/philosophy.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/bn 2026-05-27T11:53:49,750 copying build/lib/unitxt/catalog/cards/global_mmlu/bn/elementary_mathematics.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/bn 2026-05-27T11:53:49,752 copying build/lib/unitxt/catalog/cards/global_mmlu/bn/conceptual_physics.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/bn 2026-05-27T11:53:49,754 copying build/lib/unitxt/catalog/cards/global_mmlu/bn/high_school_geography.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/bn 2026-05-27T11:53:49,756 copying build/lib/unitxt/catalog/cards/global_mmlu/bn/human_aging.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/bn 2026-05-27T11:53:49,758 copying build/lib/unitxt/catalog/cards/global_mmlu/bn/electrical_engineering.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/bn 2026-05-27T11:53:49,759 copying build/lib/unitxt/catalog/cards/global_mmlu/bn/management.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/bn 2026-05-27T11:53:49,761 copying build/lib/unitxt/catalog/cards/global_mmlu/bn/high_school_world_history.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/bn 2026-05-27T11:53:49,763 copying build/lib/unitxt/catalog/cards/global_mmlu/bn/marketing.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/bn 2026-05-27T11:53:49,765 copying build/lib/unitxt/catalog/cards/global_mmlu/bn/high_school_european_history.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/bn 2026-05-27T11:53:49,767 copying build/lib/unitxt/catalog/cards/global_mmlu/bn/astronomy.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/bn 2026-05-27T11:53:49,769 copying build/lib/unitxt/catalog/cards/global_mmlu/bn/high_school_physics.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/bn 2026-05-27T11:53:49,771 copying build/lib/unitxt/catalog/cards/global_mmlu/bn/public_relations.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/bn 2026-05-27T11:53:49,772 copying build/lib/unitxt/catalog/cards/global_mmlu/bn/high_school_microeconomics.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/bn 2026-05-27T11:53:49,774 copying build/lib/unitxt/catalog/cards/global_mmlu/bn/virology.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/bn 2026-05-27T11:53:49,776 copying build/lib/unitxt/catalog/cards/global_mmlu/bn/high_school_us_history.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/bn 2026-05-27T11:53:49,778 copying build/lib/unitxt/catalog/cards/global_mmlu/bn/high_school_statistics.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/bn 2026-05-27T11:53:49,780 copying build/lib/unitxt/catalog/cards/global_mmlu/bn/miscellaneous.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/bn 2026-05-27T11:53:49,782 copying build/lib/unitxt/catalog/cards/global_mmlu/bn/high_school_mathematics.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/bn 2026-05-27T11:53:49,784 copying build/lib/unitxt/catalog/cards/global_mmlu/bn/formal_logic.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/bn 2026-05-27T11:53:49,786 copying build/lib/unitxt/catalog/cards/global_mmlu/bn/high_school_chemistry.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/bn 2026-05-27T11:53:49,788 copying build/lib/unitxt/catalog/cards/global_mmlu/bn/abstract_algebra.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/bn 2026-05-27T11:53:49,790 copying build/lib/unitxt/catalog/cards/global_mmlu/bn/moral_scenarios.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/bn 2026-05-27T11:53:49,792 copying build/lib/unitxt/catalog/cards/global_mmlu/bn/world_religions.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/bn 2026-05-27T11:53:49,793 copying build/lib/unitxt/catalog/cards/global_mmlu/bn/business_ethics.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/bn 2026-05-27T11:53:49,796 copying build/lib/unitxt/catalog/cards/global_mmlu/bn/security_studies.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/bn 2026-05-27T11:53:49,797 copying build/lib/unitxt/catalog/cards/global_mmlu/bn/college_medicine.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/bn 2026-05-27T11:53:49,799 copying build/lib/unitxt/catalog/cards/global_mmlu/bn/human_sexuality.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/bn 2026-05-27T11:53:49,801 copying build/lib/unitxt/catalog/cards/global_mmlu/bn/prehistory.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/bn 2026-05-27T11:53:49,805 creating build/bdist.linux-armv7l/wheel/unitxt/catalog/cards/global_mmlu/el 2026-05-27T11:53:49,806 copying build/lib/unitxt/catalog/cards/global_mmlu/el/moral_disputes.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/el 2026-05-27T11:53:49,808 copying build/lib/unitxt/catalog/cards/global_mmlu/el/high_school_biology.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/el 2026-05-27T11:53:49,810 copying build/lib/unitxt/catalog/cards/global_mmlu/el/jurisprudence.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/el 2026-05-27T11:53:49,811 copying build/lib/unitxt/catalog/cards/global_mmlu/el/logical_fallacies.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/el 2026-05-27T11:53:49,813 copying build/lib/unitxt/catalog/cards/global_mmlu/el/college_chemistry.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/el 2026-05-27T11:53:49,815 copying build/lib/unitxt/catalog/cards/global_mmlu/el/high_school_government_and_politics.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/el 2026-05-27T11:53:49,817 copying build/lib/unitxt/catalog/cards/global_mmlu/el/college_mathematics.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/el 2026-05-27T11:53:49,819 copying build/lib/unitxt/catalog/cards/global_mmlu/el/econometrics.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/el 2026-05-27T11:53:49,821 copying build/lib/unitxt/catalog/cards/global_mmlu/el/high_school_macroeconomics.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/el 2026-05-27T11:53:49,824 copying build/lib/unitxt/catalog/cards/global_mmlu/el/high_school_psychology.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/el 2026-05-27T11:53:49,826 copying build/lib/unitxt/catalog/cards/global_mmlu/el/computer_security.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/el 2026-05-27T11:53:49,828 copying build/lib/unitxt/catalog/cards/global_mmlu/el/sociology.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/el 2026-05-27T11:53:49,830 copying build/lib/unitxt/catalog/cards/global_mmlu/el/nutrition.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/el 2026-05-27T11:53:49,832 copying build/lib/unitxt/catalog/cards/global_mmlu/el/professional_medicine.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/el 2026-05-27T11:53:49,834 copying build/lib/unitxt/catalog/cards/global_mmlu/el/college_biology.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/el 2026-05-27T11:53:49,836 copying build/lib/unitxt/catalog/cards/global_mmlu/el/anatomy.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/el 2026-05-27T11:53:49,838 copying build/lib/unitxt/catalog/cards/global_mmlu/el/professional_law.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/el 2026-05-27T11:53:49,839 copying build/lib/unitxt/catalog/cards/global_mmlu/el/machine_learning.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/el 2026-05-27T11:53:49,841 copying build/lib/unitxt/catalog/cards/global_mmlu/el/international_law.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/el 2026-05-27T11:53:49,843 copying build/lib/unitxt/catalog/cards/global_mmlu/el/medical_genetics.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/el 2026-05-27T11:53:49,845 copying build/lib/unitxt/catalog/cards/global_mmlu/el/high_school_computer_science.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/el 2026-05-27T11:53:49,847 copying build/lib/unitxt/catalog/cards/global_mmlu/el/clinical_knowledge.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/el 2026-05-27T11:53:49,849 copying build/lib/unitxt/catalog/cards/global_mmlu/el/college_physics.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/el 2026-05-27T11:53:49,851 copying build/lib/unitxt/catalog/cards/global_mmlu/el/global_facts.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/el 2026-05-27T11:53:49,853 copying build/lib/unitxt/catalog/cards/global_mmlu/el/college_computer_science.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/el 2026-05-27T11:53:49,854 copying build/lib/unitxt/catalog/cards/global_mmlu/el/us_foreign_policy.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/el 2026-05-27T11:53:49,856 copying build/lib/unitxt/catalog/cards/global_mmlu/el/professional_accounting.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/el 2026-05-27T11:53:49,858 copying build/lib/unitxt/catalog/cards/global_mmlu/el/professional_psychology.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/el 2026-05-27T11:53:49,860 copying build/lib/unitxt/catalog/cards/global_mmlu/el/philosophy.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/el 2026-05-27T11:53:49,862 copying build/lib/unitxt/catalog/cards/global_mmlu/el/elementary_mathematics.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/el 2026-05-27T11:53:49,864 copying build/lib/unitxt/catalog/cards/global_mmlu/el/conceptual_physics.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/el 2026-05-27T11:53:49,866 copying build/lib/unitxt/catalog/cards/global_mmlu/el/high_school_geography.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/el 2026-05-27T11:53:49,867 copying build/lib/unitxt/catalog/cards/global_mmlu/el/human_aging.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/el 2026-05-27T11:53:49,869 copying build/lib/unitxt/catalog/cards/global_mmlu/el/electrical_engineering.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/el 2026-05-27T11:53:49,871 copying build/lib/unitxt/catalog/cards/global_mmlu/el/management.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/el 2026-05-27T11:53:49,873 copying build/lib/unitxt/catalog/cards/global_mmlu/el/high_school_world_history.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/el 2026-05-27T11:53:49,875 copying build/lib/unitxt/catalog/cards/global_mmlu/el/marketing.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/el 2026-05-27T11:53:49,877 copying build/lib/unitxt/catalog/cards/global_mmlu/el/high_school_european_history.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/el 2026-05-27T11:53:49,879 copying build/lib/unitxt/catalog/cards/global_mmlu/el/astronomy.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/el 2026-05-27T11:53:49,880 copying build/lib/unitxt/catalog/cards/global_mmlu/el/high_school_physics.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/el 2026-05-27T11:53:49,882 copying build/lib/unitxt/catalog/cards/global_mmlu/el/public_relations.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/el 2026-05-27T11:53:49,884 copying build/lib/unitxt/catalog/cards/global_mmlu/el/high_school_microeconomics.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/el 2026-05-27T11:53:49,886 copying build/lib/unitxt/catalog/cards/global_mmlu/el/virology.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/el 2026-05-27T11:53:49,888 copying build/lib/unitxt/catalog/cards/global_mmlu/el/high_school_us_history.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/el 2026-05-27T11:53:49,890 copying build/lib/unitxt/catalog/cards/global_mmlu/el/high_school_statistics.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/el 2026-05-27T11:53:49,892 copying build/lib/unitxt/catalog/cards/global_mmlu/el/miscellaneous.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/el 2026-05-27T11:53:49,894 copying build/lib/unitxt/catalog/cards/global_mmlu/el/high_school_mathematics.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/el 2026-05-27T11:53:49,895 copying build/lib/unitxt/catalog/cards/global_mmlu/el/formal_logic.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/el 2026-05-27T11:53:49,897 copying build/lib/unitxt/catalog/cards/global_mmlu/el/high_school_chemistry.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/el 2026-05-27T11:53:49,899 copying build/lib/unitxt/catalog/cards/global_mmlu/el/abstract_algebra.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/el 2026-05-27T11:53:49,901 copying build/lib/unitxt/catalog/cards/global_mmlu/el/moral_scenarios.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/el 2026-05-27T11:53:49,903 copying build/lib/unitxt/catalog/cards/global_mmlu/el/world_religions.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/el 2026-05-27T11:53:49,905 copying build/lib/unitxt/catalog/cards/global_mmlu/el/business_ethics.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/el 2026-05-27T11:53:49,908 copying build/lib/unitxt/catalog/cards/global_mmlu/el/security_studies.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/el 2026-05-27T11:53:49,910 copying build/lib/unitxt/catalog/cards/global_mmlu/el/college_medicine.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/el 2026-05-27T11:53:49,912 copying build/lib/unitxt/catalog/cards/global_mmlu/el/human_sexuality.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/el 2026-05-27T11:53:49,914 copying build/lib/unitxt/catalog/cards/global_mmlu/el/prehistory.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/el 2026-05-27T11:53:49,917 creating build/bdist.linux-armv7l/wheel/unitxt/catalog/cards/global_mmlu/ig 2026-05-27T11:53:49,918 copying build/lib/unitxt/catalog/cards/global_mmlu/ig/moral_disputes.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/ig 2026-05-27T11:53:49,920 copying build/lib/unitxt/catalog/cards/global_mmlu/ig/high_school_biology.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/ig 2026-05-27T11:53:49,922 copying build/lib/unitxt/catalog/cards/global_mmlu/ig/jurisprudence.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/ig 2026-05-27T11:53:49,924 copying build/lib/unitxt/catalog/cards/global_mmlu/ig/logical_fallacies.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/ig 2026-05-27T11:53:49,926 copying build/lib/unitxt/catalog/cards/global_mmlu/ig/college_chemistry.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/ig 2026-05-27T11:53:49,927 copying build/lib/unitxt/catalog/cards/global_mmlu/ig/high_school_government_and_politics.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/ig 2026-05-27T11:53:49,930 copying build/lib/unitxt/catalog/cards/global_mmlu/ig/college_mathematics.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/ig 2026-05-27T11:53:49,932 copying build/lib/unitxt/catalog/cards/global_mmlu/ig/econometrics.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/ig 2026-05-27T11:53:49,934 copying build/lib/unitxt/catalog/cards/global_mmlu/ig/high_school_macroeconomics.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/ig 2026-05-27T11:53:49,935 copying build/lib/unitxt/catalog/cards/global_mmlu/ig/high_school_psychology.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/ig 2026-05-27T11:53:49,937 copying build/lib/unitxt/catalog/cards/global_mmlu/ig/computer_security.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/ig 2026-05-27T11:53:49,939 copying build/lib/unitxt/catalog/cards/global_mmlu/ig/sociology.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/ig 2026-05-27T11:53:49,941 copying build/lib/unitxt/catalog/cards/global_mmlu/ig/nutrition.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/ig 2026-05-27T11:53:49,943 copying build/lib/unitxt/catalog/cards/global_mmlu/ig/professional_medicine.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/ig 2026-05-27T11:53:49,945 copying build/lib/unitxt/catalog/cards/global_mmlu/ig/college_biology.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/ig 2026-05-27T11:53:49,947 copying build/lib/unitxt/catalog/cards/global_mmlu/ig/anatomy.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/ig 2026-05-27T11:53:49,949 copying build/lib/unitxt/catalog/cards/global_mmlu/ig/professional_law.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/ig 2026-05-27T11:53:49,951 copying build/lib/unitxt/catalog/cards/global_mmlu/ig/machine_learning.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/ig 2026-05-27T11:53:49,953 copying build/lib/unitxt/catalog/cards/global_mmlu/ig/international_law.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/ig 2026-05-27T11:53:49,954 copying build/lib/unitxt/catalog/cards/global_mmlu/ig/medical_genetics.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/ig 2026-05-27T11:53:49,956 copying build/lib/unitxt/catalog/cards/global_mmlu/ig/high_school_computer_science.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/ig 2026-05-27T11:53:49,958 copying build/lib/unitxt/catalog/cards/global_mmlu/ig/clinical_knowledge.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/ig 2026-05-27T11:53:49,960 copying build/lib/unitxt/catalog/cards/global_mmlu/ig/college_physics.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/ig 2026-05-27T11:53:49,962 copying build/lib/unitxt/catalog/cards/global_mmlu/ig/global_facts.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/ig 2026-05-27T11:53:49,964 copying build/lib/unitxt/catalog/cards/global_mmlu/ig/college_computer_science.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/ig 2026-05-27T11:53:49,966 copying build/lib/unitxt/catalog/cards/global_mmlu/ig/us_foreign_policy.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/ig 2026-05-27T11:53:49,968 copying build/lib/unitxt/catalog/cards/global_mmlu/ig/professional_accounting.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/ig 2026-05-27T11:53:49,970 copying build/lib/unitxt/catalog/cards/global_mmlu/ig/professional_psychology.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/ig 2026-05-27T11:53:49,972 copying build/lib/unitxt/catalog/cards/global_mmlu/ig/philosophy.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/ig 2026-05-27T11:53:49,974 copying build/lib/unitxt/catalog/cards/global_mmlu/ig/elementary_mathematics.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/ig 2026-05-27T11:53:49,977 copying build/lib/unitxt/catalog/cards/global_mmlu/ig/conceptual_physics.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/ig 2026-05-27T11:53:49,979 copying build/lib/unitxt/catalog/cards/global_mmlu/ig/high_school_geography.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/ig 2026-05-27T11:53:49,981 copying build/lib/unitxt/catalog/cards/global_mmlu/ig/human_aging.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/ig 2026-05-27T11:53:49,984 copying build/lib/unitxt/catalog/cards/global_mmlu/ig/electrical_engineering.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/ig 2026-05-27T11:53:49,985 copying build/lib/unitxt/catalog/cards/global_mmlu/ig/management.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/ig 2026-05-27T11:53:49,987 copying build/lib/unitxt/catalog/cards/global_mmlu/ig/high_school_world_history.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/ig 2026-05-27T11:53:49,989 copying build/lib/unitxt/catalog/cards/global_mmlu/ig/marketing.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/ig 2026-05-27T11:53:49,991 copying build/lib/unitxt/catalog/cards/global_mmlu/ig/high_school_european_history.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/ig 2026-05-27T11:53:49,994 copying build/lib/unitxt/catalog/cards/global_mmlu/ig/astronomy.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/ig 2026-05-27T11:53:49,996 copying build/lib/unitxt/catalog/cards/global_mmlu/ig/high_school_physics.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/ig 2026-05-27T11:53:49,998 copying build/lib/unitxt/catalog/cards/global_mmlu/ig/public_relations.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/ig 2026-05-27T11:53:50,000 copying build/lib/unitxt/catalog/cards/global_mmlu/ig/high_school_microeconomics.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/ig 2026-05-27T11:53:50,002 copying build/lib/unitxt/catalog/cards/global_mmlu/ig/virology.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/ig 2026-05-27T11:53:50,004 copying build/lib/unitxt/catalog/cards/global_mmlu/ig/high_school_us_history.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/ig 2026-05-27T11:53:50,006 copying build/lib/unitxt/catalog/cards/global_mmlu/ig/high_school_statistics.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/ig 2026-05-27T11:53:50,008 copying build/lib/unitxt/catalog/cards/global_mmlu/ig/miscellaneous.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/ig 2026-05-27T11:53:50,010 copying build/lib/unitxt/catalog/cards/global_mmlu/ig/high_school_mathematics.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/ig 2026-05-27T11:53:50,011 copying build/lib/unitxt/catalog/cards/global_mmlu/ig/formal_logic.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/ig 2026-05-27T11:53:50,013 copying build/lib/unitxt/catalog/cards/global_mmlu/ig/high_school_chemistry.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/ig 2026-05-27T11:53:50,015 copying build/lib/unitxt/catalog/cards/global_mmlu/ig/abstract_algebra.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/ig 2026-05-27T11:53:50,017 copying build/lib/unitxt/catalog/cards/global_mmlu/ig/moral_scenarios.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/ig 2026-05-27T11:53:50,019 copying build/lib/unitxt/catalog/cards/global_mmlu/ig/world_religions.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/ig 2026-05-27T11:53:50,021 copying build/lib/unitxt/catalog/cards/global_mmlu/ig/business_ethics.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/ig 2026-05-27T11:53:50,023 copying build/lib/unitxt/catalog/cards/global_mmlu/ig/security_studies.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/ig 2026-05-27T11:53:50,025 copying build/lib/unitxt/catalog/cards/global_mmlu/ig/college_medicine.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/ig 2026-05-27T11:53:50,027 copying build/lib/unitxt/catalog/cards/global_mmlu/ig/human_sexuality.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/ig 2026-05-27T11:53:50,028 copying build/lib/unitxt/catalog/cards/global_mmlu/ig/prehistory.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/ig 2026-05-27T11:53:50,032 creating build/bdist.linux-armv7l/wheel/unitxt/catalog/cards/global_mmlu/te 2026-05-27T11:53:50,033 copying build/lib/unitxt/catalog/cards/global_mmlu/te/moral_disputes.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/te 2026-05-27T11:53:50,035 copying build/lib/unitxt/catalog/cards/global_mmlu/te/high_school_biology.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/te 2026-05-27T11:53:50,037 copying build/lib/unitxt/catalog/cards/global_mmlu/te/jurisprudence.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/te 2026-05-27T11:53:50,039 copying build/lib/unitxt/catalog/cards/global_mmlu/te/logical_fallacies.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/te 2026-05-27T11:53:50,040 copying build/lib/unitxt/catalog/cards/global_mmlu/te/college_chemistry.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/te 2026-05-27T11:53:50,042 copying build/lib/unitxt/catalog/cards/global_mmlu/te/high_school_government_and_politics.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/te 2026-05-27T11:53:50,044 copying build/lib/unitxt/catalog/cards/global_mmlu/te/college_mathematics.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/te 2026-05-27T11:53:50,046 copying build/lib/unitxt/catalog/cards/global_mmlu/te/econometrics.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/te 2026-05-27T11:53:50,048 copying build/lib/unitxt/catalog/cards/global_mmlu/te/high_school_macroeconomics.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/te 2026-05-27T11:53:50,049 copying build/lib/unitxt/catalog/cards/global_mmlu/te/high_school_psychology.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/te 2026-05-27T11:53:50,051 copying build/lib/unitxt/catalog/cards/global_mmlu/te/computer_security.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/te 2026-05-27T11:53:50,053 copying build/lib/unitxt/catalog/cards/global_mmlu/te/sociology.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/te 2026-05-27T11:53:50,055 copying build/lib/unitxt/catalog/cards/global_mmlu/te/nutrition.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/te 2026-05-27T11:53:50,057 copying build/lib/unitxt/catalog/cards/global_mmlu/te/professional_medicine.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/te 2026-05-27T11:53:50,059 copying build/lib/unitxt/catalog/cards/global_mmlu/te/college_biology.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/te 2026-05-27T11:53:50,061 copying build/lib/unitxt/catalog/cards/global_mmlu/te/anatomy.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/te 2026-05-27T11:53:50,063 copying build/lib/unitxt/catalog/cards/global_mmlu/te/professional_law.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/te 2026-05-27T11:53:50,064 copying build/lib/unitxt/catalog/cards/global_mmlu/te/machine_learning.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/te 2026-05-27T11:53:50,066 copying build/lib/unitxt/catalog/cards/global_mmlu/te/international_law.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/te 2026-05-27T11:53:50,068 copying build/lib/unitxt/catalog/cards/global_mmlu/te/medical_genetics.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/te 2026-05-27T11:53:50,070 copying build/lib/unitxt/catalog/cards/global_mmlu/te/high_school_computer_science.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/te 2026-05-27T11:53:50,072 copying build/lib/unitxt/catalog/cards/global_mmlu/te/clinical_knowledge.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/te 2026-05-27T11:53:50,075 copying build/lib/unitxt/catalog/cards/global_mmlu/te/college_physics.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/te 2026-05-27T11:53:50,077 copying build/lib/unitxt/catalog/cards/global_mmlu/te/global_facts.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/te 2026-05-27T11:53:50,079 copying build/lib/unitxt/catalog/cards/global_mmlu/te/college_computer_science.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/te 2026-05-27T11:53:50,081 copying build/lib/unitxt/catalog/cards/global_mmlu/te/us_foreign_policy.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/te 2026-05-27T11:53:50,083 copying build/lib/unitxt/catalog/cards/global_mmlu/te/professional_accounting.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/te 2026-05-27T11:53:50,085 copying build/lib/unitxt/catalog/cards/global_mmlu/te/professional_psychology.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/te 2026-05-27T11:53:50,087 copying build/lib/unitxt/catalog/cards/global_mmlu/te/philosophy.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/te 2026-05-27T11:53:50,089 copying build/lib/unitxt/catalog/cards/global_mmlu/te/elementary_mathematics.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/te 2026-05-27T11:53:50,091 copying build/lib/unitxt/catalog/cards/global_mmlu/te/conceptual_physics.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/te 2026-05-27T11:53:50,092 copying build/lib/unitxt/catalog/cards/global_mmlu/te/high_school_geography.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/te 2026-05-27T11:53:50,094 copying build/lib/unitxt/catalog/cards/global_mmlu/te/human_aging.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/te 2026-05-27T11:53:50,096 copying build/lib/unitxt/catalog/cards/global_mmlu/te/electrical_engineering.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/te 2026-05-27T11:53:50,098 copying build/lib/unitxt/catalog/cards/global_mmlu/te/management.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/te 2026-05-27T11:53:50,100 copying build/lib/unitxt/catalog/cards/global_mmlu/te/high_school_world_history.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/te 2026-05-27T11:53:50,102 copying build/lib/unitxt/catalog/cards/global_mmlu/te/marketing.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/te 2026-05-27T11:53:50,104 copying build/lib/unitxt/catalog/cards/global_mmlu/te/high_school_european_history.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/te 2026-05-27T11:53:50,106 copying build/lib/unitxt/catalog/cards/global_mmlu/te/astronomy.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/te 2026-05-27T11:53:50,108 copying build/lib/unitxt/catalog/cards/global_mmlu/te/high_school_physics.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/te 2026-05-27T11:53:50,110 copying build/lib/unitxt/catalog/cards/global_mmlu/te/public_relations.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/te 2026-05-27T11:53:50,112 copying build/lib/unitxt/catalog/cards/global_mmlu/te/high_school_microeconomics.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/te 2026-05-27T11:53:50,113 copying build/lib/unitxt/catalog/cards/global_mmlu/te/virology.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/te 2026-05-27T11:53:50,115 copying build/lib/unitxt/catalog/cards/global_mmlu/te/high_school_us_history.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/te 2026-05-27T11:53:50,117 copying build/lib/unitxt/catalog/cards/global_mmlu/te/high_school_statistics.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/te 2026-05-27T11:53:50,119 copying build/lib/unitxt/catalog/cards/global_mmlu/te/miscellaneous.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/te 2026-05-27T11:53:50,121 copying build/lib/unitxt/catalog/cards/global_mmlu/te/high_school_mathematics.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/te 2026-05-27T11:53:50,123 copying build/lib/unitxt/catalog/cards/global_mmlu/te/formal_logic.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/te 2026-05-27T11:53:50,125 copying build/lib/unitxt/catalog/cards/global_mmlu/te/high_school_chemistry.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/te 2026-05-27T11:53:50,127 copying build/lib/unitxt/catalog/cards/global_mmlu/te/abstract_algebra.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/te 2026-05-27T11:53:50,129 copying build/lib/unitxt/catalog/cards/global_mmlu/te/moral_scenarios.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/te 2026-05-27T11:53:50,130 copying build/lib/unitxt/catalog/cards/global_mmlu/te/world_religions.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/te 2026-05-27T11:53:50,132 copying build/lib/unitxt/catalog/cards/global_mmlu/te/business_ethics.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/te 2026-05-27T11:53:50,134 copying build/lib/unitxt/catalog/cards/global_mmlu/te/security_studies.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/te 2026-05-27T11:53:50,136 copying build/lib/unitxt/catalog/cards/global_mmlu/te/college_medicine.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/te 2026-05-27T11:53:50,137 copying build/lib/unitxt/catalog/cards/global_mmlu/te/human_sexuality.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/te 2026-05-27T11:53:50,139 copying build/lib/unitxt/catalog/cards/global_mmlu/te/prehistory.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/te 2026-05-27T11:53:50,143 creating build/bdist.linux-armv7l/wheel/unitxt/catalog/cards/global_mmlu/fil 2026-05-27T11:53:50,144 copying build/lib/unitxt/catalog/cards/global_mmlu/fil/moral_disputes.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/fil 2026-05-27T11:53:50,146 copying build/lib/unitxt/catalog/cards/global_mmlu/fil/high_school_biology.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/fil 2026-05-27T11:53:50,148 copying build/lib/unitxt/catalog/cards/global_mmlu/fil/jurisprudence.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/fil 2026-05-27T11:53:50,149 copying build/lib/unitxt/catalog/cards/global_mmlu/fil/logical_fallacies.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/fil 2026-05-27T11:53:50,151 copying build/lib/unitxt/catalog/cards/global_mmlu/fil/college_chemistry.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/fil 2026-05-27T11:53:50,153 copying build/lib/unitxt/catalog/cards/global_mmlu/fil/high_school_government_and_politics.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/fil 2026-05-27T11:53:50,155 copying build/lib/unitxt/catalog/cards/global_mmlu/fil/college_mathematics.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/fil 2026-05-27T11:53:50,158 copying build/lib/unitxt/catalog/cards/global_mmlu/fil/econometrics.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/fil 2026-05-27T11:53:50,160 copying build/lib/unitxt/catalog/cards/global_mmlu/fil/high_school_macroeconomics.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/fil 2026-05-27T11:53:50,162 copying build/lib/unitxt/catalog/cards/global_mmlu/fil/high_school_psychology.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/fil 2026-05-27T11:53:50,165 copying build/lib/unitxt/catalog/cards/global_mmlu/fil/computer_security.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/fil 2026-05-27T11:53:50,167 copying build/lib/unitxt/catalog/cards/global_mmlu/fil/sociology.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/fil 2026-05-27T11:53:50,169 copying build/lib/unitxt/catalog/cards/global_mmlu/fil/nutrition.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/fil 2026-05-27T11:53:50,170 copying build/lib/unitxt/catalog/cards/global_mmlu/fil/professional_medicine.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/fil 2026-05-27T11:53:50,172 copying build/lib/unitxt/catalog/cards/global_mmlu/fil/college_biology.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/fil 2026-05-27T11:53:50,174 copying build/lib/unitxt/catalog/cards/global_mmlu/fil/anatomy.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/fil 2026-05-27T11:53:50,176 copying build/lib/unitxt/catalog/cards/global_mmlu/fil/professional_law.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/fil 2026-05-27T11:53:50,178 copying build/lib/unitxt/catalog/cards/global_mmlu/fil/machine_learning.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/fil 2026-05-27T11:53:50,179 copying build/lib/unitxt/catalog/cards/global_mmlu/fil/international_law.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/fil 2026-05-27T11:53:50,181 copying build/lib/unitxt/catalog/cards/global_mmlu/fil/medical_genetics.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/fil 2026-05-27T11:53:50,183 copying build/lib/unitxt/catalog/cards/global_mmlu/fil/high_school_computer_science.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/fil 2026-05-27T11:53:50,185 copying build/lib/unitxt/catalog/cards/global_mmlu/fil/clinical_knowledge.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/fil 2026-05-27T11:53:50,187 copying build/lib/unitxt/catalog/cards/global_mmlu/fil/college_physics.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/fil 2026-05-27T11:53:50,189 copying build/lib/unitxt/catalog/cards/global_mmlu/fil/global_facts.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/fil 2026-05-27T11:53:50,191 copying build/lib/unitxt/catalog/cards/global_mmlu/fil/college_computer_science.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/fil 2026-05-27T11:53:50,192 copying build/lib/unitxt/catalog/cards/global_mmlu/fil/us_foreign_policy.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/fil 2026-05-27T11:53:50,194 copying build/lib/unitxt/catalog/cards/global_mmlu/fil/professional_accounting.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/fil 2026-05-27T11:53:50,196 copying build/lib/unitxt/catalog/cards/global_mmlu/fil/professional_psychology.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/fil 2026-05-27T11:53:50,198 copying build/lib/unitxt/catalog/cards/global_mmlu/fil/philosophy.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/fil 2026-05-27T11:53:50,200 copying build/lib/unitxt/catalog/cards/global_mmlu/fil/elementary_mathematics.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/fil 2026-05-27T11:53:50,202 copying build/lib/unitxt/catalog/cards/global_mmlu/fil/conceptual_physics.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/fil 2026-05-27T11:53:50,204 copying build/lib/unitxt/catalog/cards/global_mmlu/fil/high_school_geography.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/fil 2026-05-27T11:53:50,206 copying build/lib/unitxt/catalog/cards/global_mmlu/fil/human_aging.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/fil 2026-05-27T11:53:50,208 copying build/lib/unitxt/catalog/cards/global_mmlu/fil/electrical_engineering.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/fil 2026-05-27T11:53:50,210 copying build/lib/unitxt/catalog/cards/global_mmlu/fil/management.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/fil 2026-05-27T11:53:50,212 copying build/lib/unitxt/catalog/cards/global_mmlu/fil/high_school_world_history.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/fil 2026-05-27T11:53:50,214 copying build/lib/unitxt/catalog/cards/global_mmlu/fil/marketing.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/fil 2026-05-27T11:53:50,216 copying build/lib/unitxt/catalog/cards/global_mmlu/fil/high_school_european_history.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/fil 2026-05-27T11:53:50,218 copying build/lib/unitxt/catalog/cards/global_mmlu/fil/astronomy.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/fil 2026-05-27T11:53:50,220 copying build/lib/unitxt/catalog/cards/global_mmlu/fil/high_school_physics.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/fil 2026-05-27T11:53:50,221 copying build/lib/unitxt/catalog/cards/global_mmlu/fil/public_relations.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/fil 2026-05-27T11:53:50,223 copying build/lib/unitxt/catalog/cards/global_mmlu/fil/high_school_microeconomics.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/fil 2026-05-27T11:53:50,225 copying build/lib/unitxt/catalog/cards/global_mmlu/fil/virology.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/fil 2026-05-27T11:53:50,227 copying build/lib/unitxt/catalog/cards/global_mmlu/fil/high_school_us_history.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/fil 2026-05-27T11:53:50,229 copying build/lib/unitxt/catalog/cards/global_mmlu/fil/high_school_statistics.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/fil 2026-05-27T11:53:50,231 copying build/lib/unitxt/catalog/cards/global_mmlu/fil/miscellaneous.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/fil 2026-05-27T11:53:50,233 copying build/lib/unitxt/catalog/cards/global_mmlu/fil/high_school_mathematics.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/fil 2026-05-27T11:53:50,235 copying build/lib/unitxt/catalog/cards/global_mmlu/fil/formal_logic.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/fil 2026-05-27T11:53:50,237 copying build/lib/unitxt/catalog/cards/global_mmlu/fil/high_school_chemistry.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/fil 2026-05-27T11:53:50,239 copying build/lib/unitxt/catalog/cards/global_mmlu/fil/abstract_algebra.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/fil 2026-05-27T11:53:50,241 copying build/lib/unitxt/catalog/cards/global_mmlu/fil/moral_scenarios.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/fil 2026-05-27T11:53:50,244 copying build/lib/unitxt/catalog/cards/global_mmlu/fil/world_religions.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/fil 2026-05-27T11:53:50,246 copying build/lib/unitxt/catalog/cards/global_mmlu/fil/business_ethics.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/fil 2026-05-27T11:53:50,248 copying build/lib/unitxt/catalog/cards/global_mmlu/fil/security_studies.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/fil 2026-05-27T11:53:50,251 copying build/lib/unitxt/catalog/cards/global_mmlu/fil/college_medicine.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/fil 2026-05-27T11:53:50,253 copying build/lib/unitxt/catalog/cards/global_mmlu/fil/human_sexuality.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/fil 2026-05-27T11:53:50,254 copying build/lib/unitxt/catalog/cards/global_mmlu/fil/prehistory.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/fil 2026-05-27T11:53:50,258 creating build/bdist.linux-armv7l/wheel/unitxt/catalog/cards/global_mmlu/ro 2026-05-27T11:53:50,259 copying build/lib/unitxt/catalog/cards/global_mmlu/ro/moral_disputes.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/ro 2026-05-27T11:53:50,261 copying build/lib/unitxt/catalog/cards/global_mmlu/ro/high_school_biology.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/ro 2026-05-27T11:53:50,263 copying build/lib/unitxt/catalog/cards/global_mmlu/ro/jurisprudence.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/ro 2026-05-27T11:53:50,265 copying build/lib/unitxt/catalog/cards/global_mmlu/ro/logical_fallacies.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/ro 2026-05-27T11:53:50,267 copying build/lib/unitxt/catalog/cards/global_mmlu/ro/college_chemistry.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/ro 2026-05-27T11:53:50,269 copying build/lib/unitxt/catalog/cards/global_mmlu/ro/high_school_government_and_politics.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/ro 2026-05-27T11:53:50,271 copying build/lib/unitxt/catalog/cards/global_mmlu/ro/college_mathematics.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/ro 2026-05-27T11:53:50,273 copying build/lib/unitxt/catalog/cards/global_mmlu/ro/econometrics.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/ro 2026-05-27T11:53:50,275 copying build/lib/unitxt/catalog/cards/global_mmlu/ro/high_school_macroeconomics.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/ro 2026-05-27T11:53:50,277 copying build/lib/unitxt/catalog/cards/global_mmlu/ro/high_school_psychology.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/ro 2026-05-27T11:53:50,279 copying build/lib/unitxt/catalog/cards/global_mmlu/ro/computer_security.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/ro 2026-05-27T11:53:50,281 copying build/lib/unitxt/catalog/cards/global_mmlu/ro/sociology.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/ro 2026-05-27T11:53:50,283 copying build/lib/unitxt/catalog/cards/global_mmlu/ro/nutrition.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/ro 2026-05-27T11:53:50,285 copying build/lib/unitxt/catalog/cards/global_mmlu/ro/professional_medicine.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/ro 2026-05-27T11:53:50,287 copying build/lib/unitxt/catalog/cards/global_mmlu/ro/college_biology.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/ro 2026-05-27T11:53:50,289 copying build/lib/unitxt/catalog/cards/global_mmlu/ro/anatomy.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/ro 2026-05-27T11:53:50,291 copying build/lib/unitxt/catalog/cards/global_mmlu/ro/professional_law.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/ro 2026-05-27T11:53:50,293 copying build/lib/unitxt/catalog/cards/global_mmlu/ro/machine_learning.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/ro 2026-05-27T11:53:50,295 copying build/lib/unitxt/catalog/cards/global_mmlu/ro/international_law.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/ro 2026-05-27T11:53:50,297 copying build/lib/unitxt/catalog/cards/global_mmlu/ro/medical_genetics.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/ro 2026-05-27T11:53:50,299 copying build/lib/unitxt/catalog/cards/global_mmlu/ro/high_school_computer_science.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/ro 2026-05-27T11:53:50,301 copying build/lib/unitxt/catalog/cards/global_mmlu/ro/clinical_knowledge.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/ro 2026-05-27T11:53:50,303 copying build/lib/unitxt/catalog/cards/global_mmlu/ro/college_physics.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/ro 2026-05-27T11:53:50,305 copying build/lib/unitxt/catalog/cards/global_mmlu/ro/global_facts.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/ro 2026-05-27T11:53:50,307 copying build/lib/unitxt/catalog/cards/global_mmlu/ro/college_computer_science.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/ro 2026-05-27T11:53:50,310 copying build/lib/unitxt/catalog/cards/global_mmlu/ro/us_foreign_policy.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/ro 2026-05-27T11:53:50,312 copying build/lib/unitxt/catalog/cards/global_mmlu/ro/professional_accounting.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/ro 2026-05-27T11:53:50,314 copying build/lib/unitxt/catalog/cards/global_mmlu/ro/professional_psychology.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/ro 2026-05-27T11:53:50,316 copying build/lib/unitxt/catalog/cards/global_mmlu/ro/philosophy.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/ro 2026-05-27T11:53:50,318 copying build/lib/unitxt/catalog/cards/global_mmlu/ro/elementary_mathematics.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/ro 2026-05-27T11:53:50,320 copying build/lib/unitxt/catalog/cards/global_mmlu/ro/conceptual_physics.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/ro 2026-05-27T11:53:50,322 copying build/lib/unitxt/catalog/cards/global_mmlu/ro/high_school_geography.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/ro 2026-05-27T11:53:50,324 copying build/lib/unitxt/catalog/cards/global_mmlu/ro/human_aging.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/ro 2026-05-27T11:53:50,326 copying build/lib/unitxt/catalog/cards/global_mmlu/ro/electrical_engineering.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/ro 2026-05-27T11:53:50,328 copying build/lib/unitxt/catalog/cards/global_mmlu/ro/management.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/ro 2026-05-27T11:53:50,330 copying build/lib/unitxt/catalog/cards/global_mmlu/ro/high_school_world_history.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/ro 2026-05-27T11:53:50,332 copying build/lib/unitxt/catalog/cards/global_mmlu/ro/marketing.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/ro 2026-05-27T11:53:50,335 copying build/lib/unitxt/catalog/cards/global_mmlu/ro/high_school_european_history.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/ro 2026-05-27T11:53:50,337 copying build/lib/unitxt/catalog/cards/global_mmlu/ro/astronomy.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/ro 2026-05-27T11:53:50,340 copying build/lib/unitxt/catalog/cards/global_mmlu/ro/high_school_physics.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/ro 2026-05-27T11:53:50,343 copying build/lib/unitxt/catalog/cards/global_mmlu/ro/public_relations.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/ro 2026-05-27T11:53:50,345 copying build/lib/unitxt/catalog/cards/global_mmlu/ro/high_school_microeconomics.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/ro 2026-05-27T11:53:50,348 copying build/lib/unitxt/catalog/cards/global_mmlu/ro/virology.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/ro 2026-05-27T11:53:50,351 copying build/lib/unitxt/catalog/cards/global_mmlu/ro/high_school_us_history.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/ro 2026-05-27T11:53:50,353 copying build/lib/unitxt/catalog/cards/global_mmlu/ro/high_school_statistics.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/ro 2026-05-27T11:53:50,356 copying build/lib/unitxt/catalog/cards/global_mmlu/ro/miscellaneous.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/ro 2026-05-27T11:53:50,359 copying build/lib/unitxt/catalog/cards/global_mmlu/ro/high_school_mathematics.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/ro 2026-05-27T11:53:50,361 copying build/lib/unitxt/catalog/cards/global_mmlu/ro/formal_logic.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/ro 2026-05-27T11:53:50,364 copying build/lib/unitxt/catalog/cards/global_mmlu/ro/high_school_chemistry.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/ro 2026-05-27T11:53:50,367 copying build/lib/unitxt/catalog/cards/global_mmlu/ro/abstract_algebra.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/ro 2026-05-27T11:53:50,369 copying build/lib/unitxt/catalog/cards/global_mmlu/ro/moral_scenarios.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/ro 2026-05-27T11:53:50,372 copying build/lib/unitxt/catalog/cards/global_mmlu/ro/world_religions.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/ro 2026-05-27T11:53:50,374 copying build/lib/unitxt/catalog/cards/global_mmlu/ro/business_ethics.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/ro 2026-05-27T11:53:50,377 copying build/lib/unitxt/catalog/cards/global_mmlu/ro/security_studies.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/ro 2026-05-27T11:53:50,379 copying build/lib/unitxt/catalog/cards/global_mmlu/ro/college_medicine.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/ro 2026-05-27T11:53:50,382 copying build/lib/unitxt/catalog/cards/global_mmlu/ro/human_sexuality.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/ro 2026-05-27T11:53:50,384 copying build/lib/unitxt/catalog/cards/global_mmlu/ro/prehistory.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/ro 2026-05-27T11:53:50,389 creating build/bdist.linux-armv7l/wheel/unitxt/catalog/cards/global_mmlu/fr 2026-05-27T11:53:50,391 copying build/lib/unitxt/catalog/cards/global_mmlu/fr/moral_disputes.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/fr 2026-05-27T11:53:50,393 copying build/lib/unitxt/catalog/cards/global_mmlu/fr/high_school_biology.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/fr 2026-05-27T11:53:50,396 copying build/lib/unitxt/catalog/cards/global_mmlu/fr/jurisprudence.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/fr 2026-05-27T11:53:50,398 copying build/lib/unitxt/catalog/cards/global_mmlu/fr/logical_fallacies.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/fr 2026-05-27T11:53:50,401 copying build/lib/unitxt/catalog/cards/global_mmlu/fr/college_chemistry.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/fr 2026-05-27T11:53:50,403 copying build/lib/unitxt/catalog/cards/global_mmlu/fr/high_school_government_and_politics.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/fr 2026-05-27T11:53:50,406 copying build/lib/unitxt/catalog/cards/global_mmlu/fr/college_mathematics.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/fr 2026-05-27T11:53:50,409 copying build/lib/unitxt/catalog/cards/global_mmlu/fr/econometrics.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/fr 2026-05-27T11:53:50,412 copying build/lib/unitxt/catalog/cards/global_mmlu/fr/high_school_macroeconomics.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/fr 2026-05-27T11:53:50,414 copying build/lib/unitxt/catalog/cards/global_mmlu/fr/high_school_psychology.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/fr 2026-05-27T11:53:50,417 copying build/lib/unitxt/catalog/cards/global_mmlu/fr/computer_security.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/fr 2026-05-27T11:53:50,420 copying build/lib/unitxt/catalog/cards/global_mmlu/fr/sociology.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/fr 2026-05-27T11:53:50,423 copying build/lib/unitxt/catalog/cards/global_mmlu/fr/nutrition.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/fr 2026-05-27T11:53:50,426 copying build/lib/unitxt/catalog/cards/global_mmlu/fr/professional_medicine.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/fr 2026-05-27T11:53:50,429 copying build/lib/unitxt/catalog/cards/global_mmlu/fr/college_biology.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/fr 2026-05-27T11:53:50,432 copying build/lib/unitxt/catalog/cards/global_mmlu/fr/anatomy.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/fr 2026-05-27T11:53:50,434 copying build/lib/unitxt/catalog/cards/global_mmlu/fr/professional_law.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/fr 2026-05-27T11:53:50,437 copying build/lib/unitxt/catalog/cards/global_mmlu/fr/machine_learning.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/fr 2026-05-27T11:53:50,439 copying build/lib/unitxt/catalog/cards/global_mmlu/fr/international_law.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/fr 2026-05-27T11:53:50,441 copying build/lib/unitxt/catalog/cards/global_mmlu/fr/medical_genetics.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/fr 2026-05-27T11:53:50,443 copying build/lib/unitxt/catalog/cards/global_mmlu/fr/high_school_computer_science.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/fr 2026-05-27T11:53:50,445 copying build/lib/unitxt/catalog/cards/global_mmlu/fr/clinical_knowledge.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/fr 2026-05-27T11:53:50,447 copying build/lib/unitxt/catalog/cards/global_mmlu/fr/college_physics.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/fr 2026-05-27T11:53:50,449 copying build/lib/unitxt/catalog/cards/global_mmlu/fr/global_facts.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/fr 2026-05-27T11:53:50,451 copying build/lib/unitxt/catalog/cards/global_mmlu/fr/college_computer_science.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/fr 2026-05-27T11:53:50,453 copying build/lib/unitxt/catalog/cards/global_mmlu/fr/us_foreign_policy.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/fr 2026-05-27T11:53:50,455 copying build/lib/unitxt/catalog/cards/global_mmlu/fr/professional_accounting.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/fr 2026-05-27T11:53:50,457 copying build/lib/unitxt/catalog/cards/global_mmlu/fr/professional_psychology.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/fr 2026-05-27T11:53:50,459 copying build/lib/unitxt/catalog/cards/global_mmlu/fr/philosophy.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/fr 2026-05-27T11:53:50,461 copying build/lib/unitxt/catalog/cards/global_mmlu/fr/elementary_mathematics.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/fr 2026-05-27T11:53:50,463 copying build/lib/unitxt/catalog/cards/global_mmlu/fr/conceptual_physics.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/fr 2026-05-27T11:53:50,465 copying build/lib/unitxt/catalog/cards/global_mmlu/fr/high_school_geography.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/fr 2026-05-27T11:53:50,467 copying build/lib/unitxt/catalog/cards/global_mmlu/fr/human_aging.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/fr 2026-05-27T11:53:50,469 copying build/lib/unitxt/catalog/cards/global_mmlu/fr/electrical_engineering.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/fr 2026-05-27T11:53:50,471 copying build/lib/unitxt/catalog/cards/global_mmlu/fr/management.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/fr 2026-05-27T11:53:50,473 copying build/lib/unitxt/catalog/cards/global_mmlu/fr/high_school_world_history.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/fr 2026-05-27T11:53:50,475 copying build/lib/unitxt/catalog/cards/global_mmlu/fr/marketing.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/fr 2026-05-27T11:53:50,477 copying build/lib/unitxt/catalog/cards/global_mmlu/fr/high_school_european_history.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/fr 2026-05-27T11:53:50,480 copying build/lib/unitxt/catalog/cards/global_mmlu/fr/astronomy.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/fr 2026-05-27T11:53:50,481 copying build/lib/unitxt/catalog/cards/global_mmlu/fr/high_school_physics.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/fr 2026-05-27T11:53:50,483 copying build/lib/unitxt/catalog/cards/global_mmlu/fr/public_relations.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/fr 2026-05-27T11:53:50,485 copying build/lib/unitxt/catalog/cards/global_mmlu/fr/high_school_microeconomics.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/fr 2026-05-27T11:53:50,487 copying build/lib/unitxt/catalog/cards/global_mmlu/fr/virology.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/fr 2026-05-27T11:53:50,489 copying build/lib/unitxt/catalog/cards/global_mmlu/fr/high_school_us_history.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/fr 2026-05-27T11:53:50,491 copying build/lib/unitxt/catalog/cards/global_mmlu/fr/high_school_statistics.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/fr 2026-05-27T11:53:50,492 copying build/lib/unitxt/catalog/cards/global_mmlu/fr/miscellaneous.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/fr 2026-05-27T11:53:50,494 copying build/lib/unitxt/catalog/cards/global_mmlu/fr/high_school_mathematics.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/fr 2026-05-27T11:53:50,496 copying build/lib/unitxt/catalog/cards/global_mmlu/fr/formal_logic.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/fr 2026-05-27T11:53:50,498 copying build/lib/unitxt/catalog/cards/global_mmlu/fr/high_school_chemistry.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/fr 2026-05-27T11:53:50,500 copying build/lib/unitxt/catalog/cards/global_mmlu/fr/abstract_algebra.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/fr 2026-05-27T11:53:50,502 copying build/lib/unitxt/catalog/cards/global_mmlu/fr/moral_scenarios.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/fr 2026-05-27T11:53:50,504 copying build/lib/unitxt/catalog/cards/global_mmlu/fr/world_religions.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/fr 2026-05-27T11:53:50,506 copying build/lib/unitxt/catalog/cards/global_mmlu/fr/business_ethics.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/fr 2026-05-27T11:53:50,508 copying build/lib/unitxt/catalog/cards/global_mmlu/fr/security_studies.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/fr 2026-05-27T11:53:50,510 copying build/lib/unitxt/catalog/cards/global_mmlu/fr/college_medicine.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/fr 2026-05-27T11:53:50,513 copying build/lib/unitxt/catalog/cards/global_mmlu/fr/human_sexuality.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/fr 2026-05-27T11:53:50,514 copying build/lib/unitxt/catalog/cards/global_mmlu/fr/prehistory.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/fr 2026-05-27T11:53:50,518 creating build/bdist.linux-armv7l/wheel/unitxt/catalog/cards/global_mmlu/vi 2026-05-27T11:53:50,519 copying build/lib/unitxt/catalog/cards/global_mmlu/vi/moral_disputes.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/vi 2026-05-27T11:53:50,521 copying build/lib/unitxt/catalog/cards/global_mmlu/vi/high_school_biology.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/vi 2026-05-27T11:53:50,523 copying build/lib/unitxt/catalog/cards/global_mmlu/vi/jurisprudence.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/vi 2026-05-27T11:53:50,524 copying build/lib/unitxt/catalog/cards/global_mmlu/vi/logical_fallacies.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/vi 2026-05-27T11:53:50,526 copying build/lib/unitxt/catalog/cards/global_mmlu/vi/college_chemistry.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/vi 2026-05-27T11:53:50,528 copying build/lib/unitxt/catalog/cards/global_mmlu/vi/high_school_government_and_politics.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/vi 2026-05-27T11:53:50,530 copying build/lib/unitxt/catalog/cards/global_mmlu/vi/college_mathematics.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/vi 2026-05-27T11:53:50,531 copying build/lib/unitxt/catalog/cards/global_mmlu/vi/econometrics.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/vi 2026-05-27T11:53:50,533 copying build/lib/unitxt/catalog/cards/global_mmlu/vi/high_school_macroeconomics.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/vi 2026-05-27T11:53:50,535 copying build/lib/unitxt/catalog/cards/global_mmlu/vi/high_school_psychology.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/vi 2026-05-27T11:53:50,537 copying build/lib/unitxt/catalog/cards/global_mmlu/vi/computer_security.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/vi 2026-05-27T11:53:50,539 copying build/lib/unitxt/catalog/cards/global_mmlu/vi/sociology.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/vi 2026-05-27T11:53:50,540 copying build/lib/unitxt/catalog/cards/global_mmlu/vi/nutrition.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/vi 2026-05-27T11:53:50,542 copying build/lib/unitxt/catalog/cards/global_mmlu/vi/professional_medicine.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/vi 2026-05-27T11:53:50,544 copying build/lib/unitxt/catalog/cards/global_mmlu/vi/college_biology.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/vi 2026-05-27T11:53:50,546 copying build/lib/unitxt/catalog/cards/global_mmlu/vi/anatomy.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/vi 2026-05-27T11:53:50,548 copying build/lib/unitxt/catalog/cards/global_mmlu/vi/professional_law.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/vi 2026-05-27T11:53:50,550 copying build/lib/unitxt/catalog/cards/global_mmlu/vi/machine_learning.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/vi 2026-05-27T11:53:50,552 copying build/lib/unitxt/catalog/cards/global_mmlu/vi/international_law.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/vi 2026-05-27T11:53:50,553 copying build/lib/unitxt/catalog/cards/global_mmlu/vi/medical_genetics.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/vi 2026-05-27T11:53:50,555 copying build/lib/unitxt/catalog/cards/global_mmlu/vi/high_school_computer_science.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/vi 2026-05-27T11:53:50,557 copying build/lib/unitxt/catalog/cards/global_mmlu/vi/clinical_knowledge.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/vi 2026-05-27T11:53:50,559 copying build/lib/unitxt/catalog/cards/global_mmlu/vi/college_physics.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/vi 2026-05-27T11:53:50,561 copying build/lib/unitxt/catalog/cards/global_mmlu/vi/global_facts.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/vi 2026-05-27T11:53:50,563 copying build/lib/unitxt/catalog/cards/global_mmlu/vi/college_computer_science.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/vi 2026-05-27T11:53:50,565 copying build/lib/unitxt/catalog/cards/global_mmlu/vi/us_foreign_policy.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/vi 2026-05-27T11:53:50,567 copying build/lib/unitxt/catalog/cards/global_mmlu/vi/professional_accounting.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/vi 2026-05-27T11:53:50,569 copying build/lib/unitxt/catalog/cards/global_mmlu/vi/professional_psychology.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/vi 2026-05-27T11:53:50,570 copying build/lib/unitxt/catalog/cards/global_mmlu/vi/philosophy.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/vi 2026-05-27T11:53:50,572 copying build/lib/unitxt/catalog/cards/global_mmlu/vi/elementary_mathematics.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/vi 2026-05-27T11:53:50,574 copying build/lib/unitxt/catalog/cards/global_mmlu/vi/conceptual_physics.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/vi 2026-05-27T11:53:50,576 copying build/lib/unitxt/catalog/cards/global_mmlu/vi/high_school_geography.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/vi 2026-05-27T11:53:50,578 copying build/lib/unitxt/catalog/cards/global_mmlu/vi/human_aging.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/vi 2026-05-27T11:53:50,579 copying build/lib/unitxt/catalog/cards/global_mmlu/vi/electrical_engineering.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/vi 2026-05-27T11:53:50,581 copying build/lib/unitxt/catalog/cards/global_mmlu/vi/management.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/vi 2026-05-27T11:53:50,583 copying build/lib/unitxt/catalog/cards/global_mmlu/vi/high_school_world_history.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/vi 2026-05-27T11:53:50,585 copying build/lib/unitxt/catalog/cards/global_mmlu/vi/marketing.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/vi 2026-05-27T11:53:50,588 copying build/lib/unitxt/catalog/cards/global_mmlu/vi/high_school_european_history.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/vi 2026-05-27T11:53:50,590 copying build/lib/unitxt/catalog/cards/global_mmlu/vi/astronomy.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/vi 2026-05-27T11:53:50,593 copying build/lib/unitxt/catalog/cards/global_mmlu/vi/high_school_physics.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/vi 2026-05-27T11:53:50,595 copying build/lib/unitxt/catalog/cards/global_mmlu/vi/public_relations.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/vi 2026-05-27T11:53:50,597 copying build/lib/unitxt/catalog/cards/global_mmlu/vi/high_school_microeconomics.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/vi 2026-05-27T11:53:50,599 copying build/lib/unitxt/catalog/cards/global_mmlu/vi/virology.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/vi 2026-05-27T11:53:50,601 copying build/lib/unitxt/catalog/cards/global_mmlu/vi/high_school_us_history.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/vi 2026-05-27T11:53:50,603 copying build/lib/unitxt/catalog/cards/global_mmlu/vi/high_school_statistics.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/vi 2026-05-27T11:53:50,605 copying build/lib/unitxt/catalog/cards/global_mmlu/vi/miscellaneous.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/vi 2026-05-27T11:53:50,607 copying build/lib/unitxt/catalog/cards/global_mmlu/vi/high_school_mathematics.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/vi 2026-05-27T11:53:50,609 copying build/lib/unitxt/catalog/cards/global_mmlu/vi/formal_logic.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/vi 2026-05-27T11:53:50,611 copying build/lib/unitxt/catalog/cards/global_mmlu/vi/high_school_chemistry.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/vi 2026-05-27T11:53:50,613 copying build/lib/unitxt/catalog/cards/global_mmlu/vi/abstract_algebra.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/vi 2026-05-27T11:53:50,615 copying build/lib/unitxt/catalog/cards/global_mmlu/vi/moral_scenarios.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/vi 2026-05-27T11:53:50,617 copying build/lib/unitxt/catalog/cards/global_mmlu/vi/world_religions.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/vi 2026-05-27T11:53:50,619 copying build/lib/unitxt/catalog/cards/global_mmlu/vi/business_ethics.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/vi 2026-05-27T11:53:50,621 copying build/lib/unitxt/catalog/cards/global_mmlu/vi/security_studies.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/vi 2026-05-27T11:53:50,623 copying build/lib/unitxt/catalog/cards/global_mmlu/vi/college_medicine.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/vi 2026-05-27T11:53:50,625 copying build/lib/unitxt/catalog/cards/global_mmlu/vi/human_sexuality.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/vi 2026-05-27T11:53:50,626 copying build/lib/unitxt/catalog/cards/global_mmlu/vi/prehistory.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/vi 2026-05-27T11:53:50,630 creating build/bdist.linux-armv7l/wheel/unitxt/catalog/cards/global_mmlu/ne 2026-05-27T11:53:50,631 copying build/lib/unitxt/catalog/cards/global_mmlu/ne/moral_disputes.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/ne 2026-05-27T11:53:50,633 copying build/lib/unitxt/catalog/cards/global_mmlu/ne/high_school_biology.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/ne 2026-05-27T11:53:50,635 copying build/lib/unitxt/catalog/cards/global_mmlu/ne/jurisprudence.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/ne 2026-05-27T11:53:50,637 copying build/lib/unitxt/catalog/cards/global_mmlu/ne/logical_fallacies.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/ne 2026-05-27T11:53:50,639 copying build/lib/unitxt/catalog/cards/global_mmlu/ne/college_chemistry.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/ne 2026-05-27T11:53:50,641 copying build/lib/unitxt/catalog/cards/global_mmlu/ne/high_school_government_and_politics.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/ne 2026-05-27T11:53:50,643 copying build/lib/unitxt/catalog/cards/global_mmlu/ne/college_mathematics.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/ne 2026-05-27T11:53:50,645 copying build/lib/unitxt/catalog/cards/global_mmlu/ne/econometrics.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/ne 2026-05-27T11:53:50,647 copying build/lib/unitxt/catalog/cards/global_mmlu/ne/high_school_macroeconomics.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/ne 2026-05-27T11:53:50,649 copying build/lib/unitxt/catalog/cards/global_mmlu/ne/high_school_psychology.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/ne 2026-05-27T11:53:50,651 copying build/lib/unitxt/catalog/cards/global_mmlu/ne/computer_security.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/ne 2026-05-27T11:53:50,653 copying build/lib/unitxt/catalog/cards/global_mmlu/ne/sociology.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/ne 2026-05-27T11:53:50,655 copying build/lib/unitxt/catalog/cards/global_mmlu/ne/nutrition.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/ne 2026-05-27T11:53:50,657 copying build/lib/unitxt/catalog/cards/global_mmlu/ne/professional_medicine.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/ne 2026-05-27T11:53:50,659 copying build/lib/unitxt/catalog/cards/global_mmlu/ne/college_biology.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/ne 2026-05-27T11:53:50,661 copying build/lib/unitxt/catalog/cards/global_mmlu/ne/anatomy.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/ne 2026-05-27T11:53:50,663 copying build/lib/unitxt/catalog/cards/global_mmlu/ne/professional_law.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/ne 2026-05-27T11:53:50,665 copying build/lib/unitxt/catalog/cards/global_mmlu/ne/machine_learning.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/ne 2026-05-27T11:53:50,667 copying build/lib/unitxt/catalog/cards/global_mmlu/ne/international_law.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/ne 2026-05-27T11:53:50,669 copying build/lib/unitxt/catalog/cards/global_mmlu/ne/medical_genetics.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/ne 2026-05-27T11:53:50,671 copying build/lib/unitxt/catalog/cards/global_mmlu/ne/high_school_computer_science.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/ne 2026-05-27T11:53:50,674 copying build/lib/unitxt/catalog/cards/global_mmlu/ne/clinical_knowledge.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/ne 2026-05-27T11:53:50,676 copying build/lib/unitxt/catalog/cards/global_mmlu/ne/college_physics.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/ne 2026-05-27T11:53:50,679 copying build/lib/unitxt/catalog/cards/global_mmlu/ne/global_facts.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/ne 2026-05-27T11:53:50,681 copying build/lib/unitxt/catalog/cards/global_mmlu/ne/college_computer_science.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/ne 2026-05-27T11:53:50,682 copying build/lib/unitxt/catalog/cards/global_mmlu/ne/us_foreign_policy.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/ne 2026-05-27T11:53:50,684 copying build/lib/unitxt/catalog/cards/global_mmlu/ne/professional_accounting.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/ne 2026-05-27T11:53:50,686 copying build/lib/unitxt/catalog/cards/global_mmlu/ne/professional_psychology.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/ne 2026-05-27T11:53:50,688 copying build/lib/unitxt/catalog/cards/global_mmlu/ne/philosophy.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/ne 2026-05-27T11:53:50,690 copying build/lib/unitxt/catalog/cards/global_mmlu/ne/elementary_mathematics.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/ne 2026-05-27T11:53:50,692 copying build/lib/unitxt/catalog/cards/global_mmlu/ne/conceptual_physics.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/ne 2026-05-27T11:53:50,694 copying build/lib/unitxt/catalog/cards/global_mmlu/ne/high_school_geography.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/ne 2026-05-27T11:53:50,696 copying build/lib/unitxt/catalog/cards/global_mmlu/ne/human_aging.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/ne 2026-05-27T11:53:50,698 copying build/lib/unitxt/catalog/cards/global_mmlu/ne/electrical_engineering.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/ne 2026-05-27T11:53:50,700 copying build/lib/unitxt/catalog/cards/global_mmlu/ne/management.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/ne 2026-05-27T11:53:50,702 copying build/lib/unitxt/catalog/cards/global_mmlu/ne/high_school_world_history.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/ne 2026-05-27T11:53:50,704 copying build/lib/unitxt/catalog/cards/global_mmlu/ne/marketing.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/ne 2026-05-27T11:53:50,706 copying build/lib/unitxt/catalog/cards/global_mmlu/ne/high_school_european_history.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/ne 2026-05-27T11:53:50,708 copying build/lib/unitxt/catalog/cards/global_mmlu/ne/astronomy.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/ne 2026-05-27T11:53:50,710 copying build/lib/unitxt/catalog/cards/global_mmlu/ne/high_school_physics.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/ne 2026-05-27T11:53:50,712 copying build/lib/unitxt/catalog/cards/global_mmlu/ne/public_relations.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/ne 2026-05-27T11:53:50,714 copying build/lib/unitxt/catalog/cards/global_mmlu/ne/high_school_microeconomics.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/ne 2026-05-27T11:53:50,716 copying build/lib/unitxt/catalog/cards/global_mmlu/ne/virology.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/ne 2026-05-27T11:53:50,718 copying build/lib/unitxt/catalog/cards/global_mmlu/ne/high_school_us_history.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/ne 2026-05-27T11:53:50,720 copying build/lib/unitxt/catalog/cards/global_mmlu/ne/high_school_statistics.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/ne 2026-05-27T11:53:50,721 copying build/lib/unitxt/catalog/cards/global_mmlu/ne/miscellaneous.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/ne 2026-05-27T11:53:50,723 copying build/lib/unitxt/catalog/cards/global_mmlu/ne/high_school_mathematics.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/ne 2026-05-27T11:53:50,725 copying build/lib/unitxt/catalog/cards/global_mmlu/ne/formal_logic.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/ne 2026-05-27T11:53:50,727 copying build/lib/unitxt/catalog/cards/global_mmlu/ne/high_school_chemistry.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/ne 2026-05-27T11:53:50,729 copying build/lib/unitxt/catalog/cards/global_mmlu/ne/abstract_algebra.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/ne 2026-05-27T11:53:50,731 copying build/lib/unitxt/catalog/cards/global_mmlu/ne/moral_scenarios.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/ne 2026-05-27T11:53:50,733 copying build/lib/unitxt/catalog/cards/global_mmlu/ne/world_religions.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/ne 2026-05-27T11:53:50,735 copying build/lib/unitxt/catalog/cards/global_mmlu/ne/business_ethics.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/ne 2026-05-27T11:53:50,737 copying build/lib/unitxt/catalog/cards/global_mmlu/ne/security_studies.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/ne 2026-05-27T11:53:50,739 copying build/lib/unitxt/catalog/cards/global_mmlu/ne/college_medicine.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/ne 2026-05-27T11:53:50,741 copying build/lib/unitxt/catalog/cards/global_mmlu/ne/human_sexuality.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/ne 2026-05-27T11:53:50,743 copying build/lib/unitxt/catalog/cards/global_mmlu/ne/prehistory.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/ne 2026-05-27T11:53:50,746 creating build/bdist.linux-armv7l/wheel/unitxt/catalog/cards/global_mmlu/nl 2026-05-27T11:53:50,748 copying build/lib/unitxt/catalog/cards/global_mmlu/nl/moral_disputes.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/nl 2026-05-27T11:53:50,750 copying build/lib/unitxt/catalog/cards/global_mmlu/nl/high_school_biology.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/nl 2026-05-27T11:53:50,752 copying build/lib/unitxt/catalog/cards/global_mmlu/nl/jurisprudence.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/nl 2026-05-27T11:53:50,754 copying build/lib/unitxt/catalog/cards/global_mmlu/nl/logical_fallacies.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/nl 2026-05-27T11:53:50,756 copying build/lib/unitxt/catalog/cards/global_mmlu/nl/college_chemistry.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/nl 2026-05-27T11:53:50,758 copying build/lib/unitxt/catalog/cards/global_mmlu/nl/high_school_government_and_politics.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/nl 2026-05-27T11:53:50,760 copying build/lib/unitxt/catalog/cards/global_mmlu/nl/college_mathematics.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/nl 2026-05-27T11:53:50,762 copying build/lib/unitxt/catalog/cards/global_mmlu/nl/econometrics.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/nl 2026-05-27T11:53:50,764 copying build/lib/unitxt/catalog/cards/global_mmlu/nl/high_school_macroeconomics.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/nl 2026-05-27T11:53:50,766 copying build/lib/unitxt/catalog/cards/global_mmlu/nl/high_school_psychology.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/nl 2026-05-27T11:53:50,768 copying build/lib/unitxt/catalog/cards/global_mmlu/nl/computer_security.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/nl 2026-05-27T11:53:50,770 copying build/lib/unitxt/catalog/cards/global_mmlu/nl/sociology.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/nl 2026-05-27T11:53:50,772 copying build/lib/unitxt/catalog/cards/global_mmlu/nl/nutrition.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/nl 2026-05-27T11:53:50,774 copying build/lib/unitxt/catalog/cards/global_mmlu/nl/professional_medicine.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/nl 2026-05-27T11:53:50,776 copying build/lib/unitxt/catalog/cards/global_mmlu/nl/college_biology.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/nl 2026-05-27T11:53:50,779 copying build/lib/unitxt/catalog/cards/global_mmlu/nl/anatomy.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/nl 2026-05-27T11:53:50,781 copying build/lib/unitxt/catalog/cards/global_mmlu/nl/professional_law.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/nl 2026-05-27T11:53:50,783 copying build/lib/unitxt/catalog/cards/global_mmlu/nl/machine_learning.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/nl 2026-05-27T11:53:50,785 copying build/lib/unitxt/catalog/cards/global_mmlu/nl/international_law.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/nl 2026-05-27T11:53:50,787 copying build/lib/unitxt/catalog/cards/global_mmlu/nl/medical_genetics.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/nl 2026-05-27T11:53:50,789 copying build/lib/unitxt/catalog/cards/global_mmlu/nl/high_school_computer_science.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/nl 2026-05-27T11:53:50,791 copying build/lib/unitxt/catalog/cards/global_mmlu/nl/clinical_knowledge.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/nl 2026-05-27T11:53:50,793 copying build/lib/unitxt/catalog/cards/global_mmlu/nl/college_physics.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/nl 2026-05-27T11:53:50,795 copying build/lib/unitxt/catalog/cards/global_mmlu/nl/global_facts.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/nl 2026-05-27T11:53:50,797 copying build/lib/unitxt/catalog/cards/global_mmlu/nl/college_computer_science.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/nl 2026-05-27T11:53:50,799 copying build/lib/unitxt/catalog/cards/global_mmlu/nl/us_foreign_policy.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/nl 2026-05-27T11:53:50,801 copying build/lib/unitxt/catalog/cards/global_mmlu/nl/professional_accounting.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/nl 2026-05-27T11:53:50,803 copying build/lib/unitxt/catalog/cards/global_mmlu/nl/professional_psychology.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/nl 2026-05-27T11:53:50,805 copying build/lib/unitxt/catalog/cards/global_mmlu/nl/philosophy.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/nl 2026-05-27T11:53:50,807 copying build/lib/unitxt/catalog/cards/global_mmlu/nl/elementary_mathematics.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/nl 2026-05-27T11:53:50,809 copying build/lib/unitxt/catalog/cards/global_mmlu/nl/conceptual_physics.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/nl 2026-05-27T11:53:50,811 copying build/lib/unitxt/catalog/cards/global_mmlu/nl/high_school_geography.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/nl 2026-05-27T11:53:50,812 copying build/lib/unitxt/catalog/cards/global_mmlu/nl/human_aging.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/nl 2026-05-27T11:53:50,814 copying build/lib/unitxt/catalog/cards/global_mmlu/nl/electrical_engineering.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/nl 2026-05-27T11:53:50,816 copying build/lib/unitxt/catalog/cards/global_mmlu/nl/management.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/nl 2026-05-27T11:53:50,818 copying build/lib/unitxt/catalog/cards/global_mmlu/nl/high_school_world_history.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/nl 2026-05-27T11:53:50,820 copying build/lib/unitxt/catalog/cards/global_mmlu/nl/marketing.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/nl 2026-05-27T11:53:50,822 copying build/lib/unitxt/catalog/cards/global_mmlu/nl/high_school_european_history.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/nl 2026-05-27T11:53:50,824 copying build/lib/unitxt/catalog/cards/global_mmlu/nl/astronomy.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/nl 2026-05-27T11:53:50,826 copying build/lib/unitxt/catalog/cards/global_mmlu/nl/high_school_physics.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/nl 2026-05-27T11:53:50,828 copying build/lib/unitxt/catalog/cards/global_mmlu/nl/public_relations.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/nl 2026-05-27T11:53:50,830 copying build/lib/unitxt/catalog/cards/global_mmlu/nl/high_school_microeconomics.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/nl 2026-05-27T11:53:50,832 copying build/lib/unitxt/catalog/cards/global_mmlu/nl/virology.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/nl 2026-05-27T11:53:50,834 copying build/lib/unitxt/catalog/cards/global_mmlu/nl/high_school_us_history.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/nl 2026-05-27T11:53:50,836 copying build/lib/unitxt/catalog/cards/global_mmlu/nl/high_school_statistics.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/nl 2026-05-27T11:53:50,838 copying build/lib/unitxt/catalog/cards/global_mmlu/nl/miscellaneous.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/nl 2026-05-27T11:53:50,840 copying build/lib/unitxt/catalog/cards/global_mmlu/nl/high_school_mathematics.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/nl 2026-05-27T11:53:50,842 copying build/lib/unitxt/catalog/cards/global_mmlu/nl/formal_logic.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/nl 2026-05-27T11:53:50,844 copying build/lib/unitxt/catalog/cards/global_mmlu/nl/high_school_chemistry.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/nl 2026-05-27T11:53:50,846 copying build/lib/unitxt/catalog/cards/global_mmlu/nl/abstract_algebra.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/nl 2026-05-27T11:53:50,848 copying build/lib/unitxt/catalog/cards/global_mmlu/nl/moral_scenarios.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/nl 2026-05-27T11:53:50,850 copying build/lib/unitxt/catalog/cards/global_mmlu/nl/world_religions.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/nl 2026-05-27T11:53:50,852 copying build/lib/unitxt/catalog/cards/global_mmlu/nl/business_ethics.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/nl 2026-05-27T11:53:50,854 copying build/lib/unitxt/catalog/cards/global_mmlu/nl/security_studies.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/nl 2026-05-27T11:53:50,856 copying build/lib/unitxt/catalog/cards/global_mmlu/nl/college_medicine.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/nl 2026-05-27T11:53:50,858 copying build/lib/unitxt/catalog/cards/global_mmlu/nl/human_sexuality.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/nl 2026-05-27T11:53:50,860 copying build/lib/unitxt/catalog/cards/global_mmlu/nl/prehistory.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/nl 2026-05-27T11:53:50,865 creating build/bdist.linux-armv7l/wheel/unitxt/catalog/cards/global_mmlu/sr 2026-05-27T11:53:50,866 copying build/lib/unitxt/catalog/cards/global_mmlu/sr/moral_disputes.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/sr 2026-05-27T11:53:50,868 copying build/lib/unitxt/catalog/cards/global_mmlu/sr/high_school_biology.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/sr 2026-05-27T11:53:50,870 copying build/lib/unitxt/catalog/cards/global_mmlu/sr/jurisprudence.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/sr 2026-05-27T11:53:50,872 copying build/lib/unitxt/catalog/cards/global_mmlu/sr/logical_fallacies.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/sr 2026-05-27T11:53:50,874 copying build/lib/unitxt/catalog/cards/global_mmlu/sr/college_chemistry.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/sr 2026-05-27T11:53:50,876 copying build/lib/unitxt/catalog/cards/global_mmlu/sr/high_school_government_and_politics.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/sr 2026-05-27T11:53:50,878 copying build/lib/unitxt/catalog/cards/global_mmlu/sr/college_mathematics.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/sr 2026-05-27T11:53:50,880 copying build/lib/unitxt/catalog/cards/global_mmlu/sr/econometrics.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/sr 2026-05-27T11:53:50,882 copying build/lib/unitxt/catalog/cards/global_mmlu/sr/high_school_macroeconomics.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/sr 2026-05-27T11:53:50,884 copying build/lib/unitxt/catalog/cards/global_mmlu/sr/high_school_psychology.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/sr 2026-05-27T11:53:50,886 copying build/lib/unitxt/catalog/cards/global_mmlu/sr/computer_security.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/sr 2026-05-27T11:53:50,888 copying build/lib/unitxt/catalog/cards/global_mmlu/sr/sociology.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/sr 2026-05-27T11:53:50,890 copying build/lib/unitxt/catalog/cards/global_mmlu/sr/nutrition.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/sr 2026-05-27T11:53:50,892 copying build/lib/unitxt/catalog/cards/global_mmlu/sr/professional_medicine.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/sr 2026-05-27T11:53:50,894 copying build/lib/unitxt/catalog/cards/global_mmlu/sr/college_biology.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/sr 2026-05-27T11:53:50,896 copying build/lib/unitxt/catalog/cards/global_mmlu/sr/anatomy.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/sr 2026-05-27T11:53:50,898 copying build/lib/unitxt/catalog/cards/global_mmlu/sr/professional_law.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/sr 2026-05-27T11:53:50,900 copying build/lib/unitxt/catalog/cards/global_mmlu/sr/machine_learning.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/sr 2026-05-27T11:53:50,901 copying build/lib/unitxt/catalog/cards/global_mmlu/sr/international_law.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/sr 2026-05-27T11:53:50,903 copying build/lib/unitxt/catalog/cards/global_mmlu/sr/medical_genetics.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/sr 2026-05-27T11:53:50,905 copying build/lib/unitxt/catalog/cards/global_mmlu/sr/high_school_computer_science.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/sr 2026-05-27T11:53:50,907 copying build/lib/unitxt/catalog/cards/global_mmlu/sr/clinical_knowledge.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/sr 2026-05-27T11:53:50,909 copying build/lib/unitxt/catalog/cards/global_mmlu/sr/college_physics.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/sr 2026-05-27T11:53:50,911 copying build/lib/unitxt/catalog/cards/global_mmlu/sr/global_facts.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/sr 2026-05-27T11:53:50,913 copying build/lib/unitxt/catalog/cards/global_mmlu/sr/college_computer_science.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/sr 2026-05-27T11:53:50,915 copying build/lib/unitxt/catalog/cards/global_mmlu/sr/us_foreign_policy.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/sr 2026-05-27T11:53:50,917 copying build/lib/unitxt/catalog/cards/global_mmlu/sr/professional_accounting.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/sr 2026-05-27T11:53:50,919 copying build/lib/unitxt/catalog/cards/global_mmlu/sr/professional_psychology.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/sr 2026-05-27T11:53:50,921 copying build/lib/unitxt/catalog/cards/global_mmlu/sr/philosophy.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/sr 2026-05-27T11:53:50,923 copying build/lib/unitxt/catalog/cards/global_mmlu/sr/elementary_mathematics.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/sr 2026-05-27T11:53:50,925 copying build/lib/unitxt/catalog/cards/global_mmlu/sr/conceptual_physics.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/sr 2026-05-27T11:53:50,927 copying build/lib/unitxt/catalog/cards/global_mmlu/sr/high_school_geography.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/sr 2026-05-27T11:53:50,929 copying build/lib/unitxt/catalog/cards/global_mmlu/sr/human_aging.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/sr 2026-05-27T11:53:50,931 copying build/lib/unitxt/catalog/cards/global_mmlu/sr/electrical_engineering.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/sr 2026-05-27T11:53:50,933 copying build/lib/unitxt/catalog/cards/global_mmlu/sr/management.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/sr 2026-05-27T11:53:50,935 copying build/lib/unitxt/catalog/cards/global_mmlu/sr/high_school_world_history.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/sr 2026-05-27T11:53:50,937 copying build/lib/unitxt/catalog/cards/global_mmlu/sr/marketing.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/sr 2026-05-27T11:53:50,939 copying build/lib/unitxt/catalog/cards/global_mmlu/sr/high_school_european_history.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/sr 2026-05-27T11:53:50,941 copying build/lib/unitxt/catalog/cards/global_mmlu/sr/astronomy.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/sr 2026-05-27T11:53:50,943 copying build/lib/unitxt/catalog/cards/global_mmlu/sr/high_school_physics.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/sr 2026-05-27T11:53:50,945 copying build/lib/unitxt/catalog/cards/global_mmlu/sr/public_relations.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/sr 2026-05-27T11:53:50,948 copying build/lib/unitxt/catalog/cards/global_mmlu/sr/high_school_microeconomics.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/sr 2026-05-27T11:53:50,950 copying build/lib/unitxt/catalog/cards/global_mmlu/sr/virology.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/sr 2026-05-27T11:53:50,953 copying build/lib/unitxt/catalog/cards/global_mmlu/sr/high_school_us_history.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/sr 2026-05-27T11:53:50,955 copying build/lib/unitxt/catalog/cards/global_mmlu/sr/high_school_statistics.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/sr 2026-05-27T11:53:50,957 copying build/lib/unitxt/catalog/cards/global_mmlu/sr/miscellaneous.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/sr 2026-05-27T11:53:50,959 copying build/lib/unitxt/catalog/cards/global_mmlu/sr/high_school_mathematics.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/sr 2026-05-27T11:53:50,961 copying build/lib/unitxt/catalog/cards/global_mmlu/sr/formal_logic.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/sr 2026-05-27T11:53:50,962 copying build/lib/unitxt/catalog/cards/global_mmlu/sr/high_school_chemistry.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/sr 2026-05-27T11:53:50,964 copying build/lib/unitxt/catalog/cards/global_mmlu/sr/abstract_algebra.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/sr 2026-05-27T11:53:50,966 copying build/lib/unitxt/catalog/cards/global_mmlu/sr/moral_scenarios.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/sr 2026-05-27T11:53:50,968 copying build/lib/unitxt/catalog/cards/global_mmlu/sr/world_religions.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/sr 2026-05-27T11:53:50,970 copying build/lib/unitxt/catalog/cards/global_mmlu/sr/business_ethics.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/sr 2026-05-27T11:53:50,972 copying build/lib/unitxt/catalog/cards/global_mmlu/sr/security_studies.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/sr 2026-05-27T11:53:50,974 copying build/lib/unitxt/catalog/cards/global_mmlu/sr/college_medicine.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/sr 2026-05-27T11:53:50,976 copying build/lib/unitxt/catalog/cards/global_mmlu/sr/human_sexuality.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/sr 2026-05-27T11:53:50,978 copying build/lib/unitxt/catalog/cards/global_mmlu/sr/prehistory.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/sr 2026-05-27T11:53:50,981 creating build/bdist.linux-armv7l/wheel/unitxt/catalog/cards/global_mmlu/cs 2026-05-27T11:53:50,982 copying build/lib/unitxt/catalog/cards/global_mmlu/cs/moral_disputes.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/cs 2026-05-27T11:53:50,985 copying build/lib/unitxt/catalog/cards/global_mmlu/cs/high_school_biology.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/cs 2026-05-27T11:53:50,987 copying build/lib/unitxt/catalog/cards/global_mmlu/cs/jurisprudence.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/cs 2026-05-27T11:53:50,989 copying build/lib/unitxt/catalog/cards/global_mmlu/cs/logical_fallacies.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/cs 2026-05-27T11:53:50,991 copying build/lib/unitxt/catalog/cards/global_mmlu/cs/college_chemistry.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/cs 2026-05-27T11:53:50,993 copying build/lib/unitxt/catalog/cards/global_mmlu/cs/high_school_government_and_politics.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/cs 2026-05-27T11:53:50,995 copying build/lib/unitxt/catalog/cards/global_mmlu/cs/college_mathematics.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/cs 2026-05-27T11:53:50,997 copying build/lib/unitxt/catalog/cards/global_mmlu/cs/econometrics.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/cs 2026-05-27T11:53:50,999 copying build/lib/unitxt/catalog/cards/global_mmlu/cs/high_school_macroeconomics.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/cs 2026-05-27T11:53:51,001 copying build/lib/unitxt/catalog/cards/global_mmlu/cs/high_school_psychology.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/cs 2026-05-27T11:53:51,003 copying build/lib/unitxt/catalog/cards/global_mmlu/cs/computer_security.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/cs 2026-05-27T11:53:51,005 copying build/lib/unitxt/catalog/cards/global_mmlu/cs/sociology.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/cs 2026-05-27T11:53:51,006 copying build/lib/unitxt/catalog/cards/global_mmlu/cs/nutrition.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/cs 2026-05-27T11:53:51,008 copying build/lib/unitxt/catalog/cards/global_mmlu/cs/professional_medicine.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/cs 2026-05-27T11:53:51,010 copying build/lib/unitxt/catalog/cards/global_mmlu/cs/college_biology.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/cs 2026-05-27T11:53:51,012 copying build/lib/unitxt/catalog/cards/global_mmlu/cs/anatomy.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/cs 2026-05-27T11:53:51,014 copying build/lib/unitxt/catalog/cards/global_mmlu/cs/professional_law.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/cs 2026-05-27T11:53:51,016 copying build/lib/unitxt/catalog/cards/global_mmlu/cs/machine_learning.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/cs 2026-05-27T11:53:51,018 copying build/lib/unitxt/catalog/cards/global_mmlu/cs/international_law.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/cs 2026-05-27T11:53:51,020 copying build/lib/unitxt/catalog/cards/global_mmlu/cs/medical_genetics.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/cs 2026-05-27T11:53:51,022 copying build/lib/unitxt/catalog/cards/global_mmlu/cs/high_school_computer_science.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/cs 2026-05-27T11:53:51,024 copying build/lib/unitxt/catalog/cards/global_mmlu/cs/clinical_knowledge.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/cs 2026-05-27T11:53:51,026 copying build/lib/unitxt/catalog/cards/global_mmlu/cs/college_physics.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/cs 2026-05-27T11:53:51,028 copying build/lib/unitxt/catalog/cards/global_mmlu/cs/global_facts.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/cs 2026-05-27T11:53:51,031 copying build/lib/unitxt/catalog/cards/global_mmlu/cs/college_computer_science.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/cs 2026-05-27T11:53:51,033 copying build/lib/unitxt/catalog/cards/global_mmlu/cs/us_foreign_policy.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/cs 2026-05-27T11:53:51,036 copying build/lib/unitxt/catalog/cards/global_mmlu/cs/professional_accounting.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/cs 2026-05-27T11:53:51,038 copying build/lib/unitxt/catalog/cards/global_mmlu/cs/professional_psychology.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/cs 2026-05-27T11:53:51,040 copying build/lib/unitxt/catalog/cards/global_mmlu/cs/philosophy.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/cs 2026-05-27T11:53:51,042 copying build/lib/unitxt/catalog/cards/global_mmlu/cs/elementary_mathematics.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/cs 2026-05-27T11:53:51,044 copying build/lib/unitxt/catalog/cards/global_mmlu/cs/conceptual_physics.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/cs 2026-05-27T11:53:51,046 copying build/lib/unitxt/catalog/cards/global_mmlu/cs/high_school_geography.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/cs 2026-05-27T11:53:51,048 copying build/lib/unitxt/catalog/cards/global_mmlu/cs/human_aging.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/cs 2026-05-27T11:53:51,050 copying build/lib/unitxt/catalog/cards/global_mmlu/cs/electrical_engineering.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/cs 2026-05-27T11:53:51,052 copying build/lib/unitxt/catalog/cards/global_mmlu/cs/management.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/cs 2026-05-27T11:53:51,053 copying build/lib/unitxt/catalog/cards/global_mmlu/cs/high_school_world_history.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/cs 2026-05-27T11:53:51,055 copying build/lib/unitxt/catalog/cards/global_mmlu/cs/marketing.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/cs 2026-05-27T11:53:51,057 copying build/lib/unitxt/catalog/cards/global_mmlu/cs/high_school_european_history.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/cs 2026-05-27T11:53:51,059 copying build/lib/unitxt/catalog/cards/global_mmlu/cs/astronomy.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/cs 2026-05-27T11:53:51,061 copying build/lib/unitxt/catalog/cards/global_mmlu/cs/high_school_physics.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/cs 2026-05-27T11:53:51,063 copying build/lib/unitxt/catalog/cards/global_mmlu/cs/public_relations.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/cs 2026-05-27T11:53:51,065 copying build/lib/unitxt/catalog/cards/global_mmlu/cs/high_school_microeconomics.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/cs 2026-05-27T11:53:51,066 copying build/lib/unitxt/catalog/cards/global_mmlu/cs/virology.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/cs 2026-05-27T11:53:51,069 copying build/lib/unitxt/catalog/cards/global_mmlu/cs/high_school_us_history.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/cs 2026-05-27T11:53:51,070 copying build/lib/unitxt/catalog/cards/global_mmlu/cs/high_school_statistics.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/cs 2026-05-27T11:53:51,072 copying build/lib/unitxt/catalog/cards/global_mmlu/cs/miscellaneous.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/cs 2026-05-27T11:53:51,074 copying build/lib/unitxt/catalog/cards/global_mmlu/cs/high_school_mathematics.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/cs 2026-05-27T11:53:51,077 copying build/lib/unitxt/catalog/cards/global_mmlu/cs/formal_logic.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/cs 2026-05-27T11:53:51,079 copying build/lib/unitxt/catalog/cards/global_mmlu/cs/high_school_chemistry.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/cs 2026-05-27T11:53:51,081 copying build/lib/unitxt/catalog/cards/global_mmlu/cs/abstract_algebra.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/cs 2026-05-27T11:53:51,083 copying build/lib/unitxt/catalog/cards/global_mmlu/cs/moral_scenarios.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/cs 2026-05-27T11:53:51,085 copying build/lib/unitxt/catalog/cards/global_mmlu/cs/world_religions.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/cs 2026-05-27T11:53:51,087 copying build/lib/unitxt/catalog/cards/global_mmlu/cs/business_ethics.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/cs 2026-05-27T11:53:51,089 copying build/lib/unitxt/catalog/cards/global_mmlu/cs/security_studies.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/cs 2026-05-27T11:53:51,091 copying build/lib/unitxt/catalog/cards/global_mmlu/cs/college_medicine.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/cs 2026-05-27T11:53:51,093 copying build/lib/unitxt/catalog/cards/global_mmlu/cs/human_sexuality.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/cs 2026-05-27T11:53:51,095 copying build/lib/unitxt/catalog/cards/global_mmlu/cs/prehistory.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/cs 2026-05-27T11:53:51,098 creating build/bdist.linux-armv7l/wheel/unitxt/catalog/cards/global_mmlu/tr 2026-05-27T11:53:51,099 copying build/lib/unitxt/catalog/cards/global_mmlu/tr/moral_disputes.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/tr 2026-05-27T11:53:51,101 copying build/lib/unitxt/catalog/cards/global_mmlu/tr/high_school_biology.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/tr 2026-05-27T11:53:51,103 copying build/lib/unitxt/catalog/cards/global_mmlu/tr/jurisprudence.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/tr 2026-05-27T11:53:51,105 copying build/lib/unitxt/catalog/cards/global_mmlu/tr/logical_fallacies.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/tr 2026-05-27T11:53:51,107 copying build/lib/unitxt/catalog/cards/global_mmlu/tr/college_chemistry.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/tr 2026-05-27T11:53:51,109 copying build/lib/unitxt/catalog/cards/global_mmlu/tr/high_school_government_and_politics.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/tr 2026-05-27T11:53:51,111 copying build/lib/unitxt/catalog/cards/global_mmlu/tr/college_mathematics.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/tr 2026-05-27T11:53:51,113 copying build/lib/unitxt/catalog/cards/global_mmlu/tr/econometrics.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/tr 2026-05-27T11:53:51,116 copying build/lib/unitxt/catalog/cards/global_mmlu/tr/high_school_macroeconomics.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/tr 2026-05-27T11:53:51,119 copying build/lib/unitxt/catalog/cards/global_mmlu/tr/high_school_psychology.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/tr 2026-05-27T11:53:51,122 copying build/lib/unitxt/catalog/cards/global_mmlu/tr/computer_security.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/tr 2026-05-27T11:53:51,124 copying build/lib/unitxt/catalog/cards/global_mmlu/tr/sociology.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/tr 2026-05-27T11:53:51,126 copying build/lib/unitxt/catalog/cards/global_mmlu/tr/nutrition.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/tr 2026-05-27T11:53:51,128 copying build/lib/unitxt/catalog/cards/global_mmlu/tr/professional_medicine.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/tr 2026-05-27T11:53:51,130 copying build/lib/unitxt/catalog/cards/global_mmlu/tr/college_biology.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/tr 2026-05-27T11:53:51,132 copying build/lib/unitxt/catalog/cards/global_mmlu/tr/anatomy.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/tr 2026-05-27T11:53:51,133 copying build/lib/unitxt/catalog/cards/global_mmlu/tr/professional_law.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/tr 2026-05-27T11:53:51,135 copying build/lib/unitxt/catalog/cards/global_mmlu/tr/machine_learning.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/tr 2026-05-27T11:53:51,137 copying build/lib/unitxt/catalog/cards/global_mmlu/tr/international_law.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/tr 2026-05-27T11:53:51,139 copying build/lib/unitxt/catalog/cards/global_mmlu/tr/medical_genetics.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/tr 2026-05-27T11:53:51,141 copying build/lib/unitxt/catalog/cards/global_mmlu/tr/high_school_computer_science.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/tr 2026-05-27T11:53:51,143 copying build/lib/unitxt/catalog/cards/global_mmlu/tr/clinical_knowledge.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/tr 2026-05-27T11:53:51,145 copying build/lib/unitxt/catalog/cards/global_mmlu/tr/college_physics.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/tr 2026-05-27T11:53:51,147 copying build/lib/unitxt/catalog/cards/global_mmlu/tr/global_facts.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/tr 2026-05-27T11:53:51,149 copying build/lib/unitxt/catalog/cards/global_mmlu/tr/college_computer_science.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/tr 2026-05-27T11:53:51,151 copying build/lib/unitxt/catalog/cards/global_mmlu/tr/us_foreign_policy.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/tr 2026-05-27T11:53:51,154 copying build/lib/unitxt/catalog/cards/global_mmlu/tr/professional_accounting.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/tr 2026-05-27T11:53:51,156 copying build/lib/unitxt/catalog/cards/global_mmlu/tr/professional_psychology.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/tr 2026-05-27T11:53:51,158 copying build/lib/unitxt/catalog/cards/global_mmlu/tr/philosophy.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/tr 2026-05-27T11:53:51,161 copying build/lib/unitxt/catalog/cards/global_mmlu/tr/elementary_mathematics.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/tr 2026-05-27T11:53:51,163 copying build/lib/unitxt/catalog/cards/global_mmlu/tr/conceptual_physics.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/tr 2026-05-27T11:53:51,165 copying build/lib/unitxt/catalog/cards/global_mmlu/tr/high_school_geography.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/tr 2026-05-27T11:53:51,168 copying build/lib/unitxt/catalog/cards/global_mmlu/tr/human_aging.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/tr 2026-05-27T11:53:51,170 copying build/lib/unitxt/catalog/cards/global_mmlu/tr/electrical_engineering.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/tr 2026-05-27T11:53:51,172 copying build/lib/unitxt/catalog/cards/global_mmlu/tr/management.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/tr 2026-05-27T11:53:51,175 copying build/lib/unitxt/catalog/cards/global_mmlu/tr/high_school_world_history.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/tr 2026-05-27T11:53:51,177 copying build/lib/unitxt/catalog/cards/global_mmlu/tr/marketing.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/tr 2026-05-27T11:53:51,179 copying build/lib/unitxt/catalog/cards/global_mmlu/tr/high_school_european_history.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/tr 2026-05-27T11:53:51,182 copying build/lib/unitxt/catalog/cards/global_mmlu/tr/astronomy.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/tr 2026-05-27T11:53:51,184 copying build/lib/unitxt/catalog/cards/global_mmlu/tr/high_school_physics.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/tr 2026-05-27T11:53:51,187 copying build/lib/unitxt/catalog/cards/global_mmlu/tr/public_relations.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/tr 2026-05-27T11:53:51,189 copying build/lib/unitxt/catalog/cards/global_mmlu/tr/high_school_microeconomics.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/tr 2026-05-27T11:53:51,191 copying build/lib/unitxt/catalog/cards/global_mmlu/tr/virology.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/tr 2026-05-27T11:53:51,194 copying build/lib/unitxt/catalog/cards/global_mmlu/tr/high_school_us_history.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/tr 2026-05-27T11:53:51,196 copying build/lib/unitxt/catalog/cards/global_mmlu/tr/high_school_statistics.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/tr 2026-05-27T11:53:51,199 copying build/lib/unitxt/catalog/cards/global_mmlu/tr/miscellaneous.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/tr 2026-05-27T11:53:51,203 copying build/lib/unitxt/catalog/cards/global_mmlu/tr/high_school_mathematics.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/tr 2026-05-27T11:53:51,206 copying build/lib/unitxt/catalog/cards/global_mmlu/tr/formal_logic.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/tr 2026-05-27T11:53:51,208 copying build/lib/unitxt/catalog/cards/global_mmlu/tr/high_school_chemistry.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/tr 2026-05-27T11:53:51,211 copying build/lib/unitxt/catalog/cards/global_mmlu/tr/abstract_algebra.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/tr 2026-05-27T11:53:51,213 copying build/lib/unitxt/catalog/cards/global_mmlu/tr/moral_scenarios.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/tr 2026-05-27T11:53:51,215 copying build/lib/unitxt/catalog/cards/global_mmlu/tr/world_religions.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/tr 2026-05-27T11:53:51,218 copying build/lib/unitxt/catalog/cards/global_mmlu/tr/business_ethics.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/tr 2026-05-27T11:53:51,220 copying build/lib/unitxt/catalog/cards/global_mmlu/tr/security_studies.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/tr 2026-05-27T11:53:51,222 copying build/lib/unitxt/catalog/cards/global_mmlu/tr/college_medicine.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/tr 2026-05-27T11:53:51,225 copying build/lib/unitxt/catalog/cards/global_mmlu/tr/human_sexuality.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/tr 2026-05-27T11:53:51,227 copying build/lib/unitxt/catalog/cards/global_mmlu/tr/prehistory.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/tr 2026-05-27T11:53:51,231 creating build/bdist.linux-armv7l/wheel/unitxt/catalog/cards/global_mmlu/so 2026-05-27T11:53:51,232 copying build/lib/unitxt/catalog/cards/global_mmlu/so/moral_disputes.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/so 2026-05-27T11:53:51,235 copying build/lib/unitxt/catalog/cards/global_mmlu/so/high_school_biology.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/so 2026-05-27T11:53:51,238 copying build/lib/unitxt/catalog/cards/global_mmlu/so/jurisprudence.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/so 2026-05-27T11:53:51,240 copying build/lib/unitxt/catalog/cards/global_mmlu/so/logical_fallacies.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/so 2026-05-27T11:53:51,242 copying build/lib/unitxt/catalog/cards/global_mmlu/so/college_chemistry.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/so 2026-05-27T11:53:51,245 copying build/lib/unitxt/catalog/cards/global_mmlu/so/high_school_government_and_politics.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/so 2026-05-27T11:53:51,247 copying build/lib/unitxt/catalog/cards/global_mmlu/so/college_mathematics.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/so 2026-05-27T11:53:51,249 copying build/lib/unitxt/catalog/cards/global_mmlu/so/econometrics.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/so 2026-05-27T11:53:51,251 copying build/lib/unitxt/catalog/cards/global_mmlu/so/high_school_macroeconomics.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/so 2026-05-27T11:53:51,253 copying build/lib/unitxt/catalog/cards/global_mmlu/so/high_school_psychology.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/so 2026-05-27T11:53:51,255 copying build/lib/unitxt/catalog/cards/global_mmlu/so/computer_security.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/so 2026-05-27T11:53:51,257 copying build/lib/unitxt/catalog/cards/global_mmlu/so/sociology.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/so 2026-05-27T11:53:51,258 copying build/lib/unitxt/catalog/cards/global_mmlu/so/nutrition.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/so 2026-05-27T11:53:51,260 copying build/lib/unitxt/catalog/cards/global_mmlu/so/professional_medicine.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/so 2026-05-27T11:53:51,262 copying build/lib/unitxt/catalog/cards/global_mmlu/so/college_biology.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/so 2026-05-27T11:53:51,264 copying build/lib/unitxt/catalog/cards/global_mmlu/so/anatomy.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/so 2026-05-27T11:53:51,266 copying build/lib/unitxt/catalog/cards/global_mmlu/so/professional_law.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/so 2026-05-27T11:53:51,268 copying build/lib/unitxt/catalog/cards/global_mmlu/so/machine_learning.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/so 2026-05-27T11:53:51,270 copying build/lib/unitxt/catalog/cards/global_mmlu/so/international_law.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/so 2026-05-27T11:53:51,272 copying build/lib/unitxt/catalog/cards/global_mmlu/so/medical_genetics.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/so 2026-05-27T11:53:51,274 copying build/lib/unitxt/catalog/cards/global_mmlu/so/high_school_computer_science.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/so 2026-05-27T11:53:51,276 copying build/lib/unitxt/catalog/cards/global_mmlu/so/clinical_knowledge.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/so 2026-05-27T11:53:51,278 copying build/lib/unitxt/catalog/cards/global_mmlu/so/college_physics.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/so 2026-05-27T11:53:51,280 copying build/lib/unitxt/catalog/cards/global_mmlu/so/global_facts.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/so 2026-05-27T11:53:51,282 copying build/lib/unitxt/catalog/cards/global_mmlu/so/college_computer_science.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/so 2026-05-27T11:53:51,284 copying build/lib/unitxt/catalog/cards/global_mmlu/so/us_foreign_policy.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/so 2026-05-27T11:53:51,287 copying build/lib/unitxt/catalog/cards/global_mmlu/so/professional_accounting.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/so 2026-05-27T11:53:51,289 copying build/lib/unitxt/catalog/cards/global_mmlu/so/professional_psychology.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/so 2026-05-27T11:53:51,292 copying build/lib/unitxt/catalog/cards/global_mmlu/so/philosophy.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/so 2026-05-27T11:53:51,294 copying build/lib/unitxt/catalog/cards/global_mmlu/so/elementary_mathematics.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/so 2026-05-27T11:53:51,296 copying build/lib/unitxt/catalog/cards/global_mmlu/so/conceptual_physics.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/so 2026-05-27T11:53:51,298 copying build/lib/unitxt/catalog/cards/global_mmlu/so/high_school_geography.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/so 2026-05-27T11:53:51,300 copying build/lib/unitxt/catalog/cards/global_mmlu/so/human_aging.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/so 2026-05-27T11:53:51,302 copying build/lib/unitxt/catalog/cards/global_mmlu/so/electrical_engineering.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/so 2026-05-27T11:53:51,304 copying build/lib/unitxt/catalog/cards/global_mmlu/so/management.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/so 2026-05-27T11:53:51,306 copying build/lib/unitxt/catalog/cards/global_mmlu/so/high_school_world_history.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/so 2026-05-27T11:53:51,308 copying build/lib/unitxt/catalog/cards/global_mmlu/so/marketing.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/so 2026-05-27T11:53:51,310 copying build/lib/unitxt/catalog/cards/global_mmlu/so/high_school_european_history.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/so 2026-05-27T11:53:51,312 copying build/lib/unitxt/catalog/cards/global_mmlu/so/astronomy.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/so 2026-05-27T11:53:51,314 copying build/lib/unitxt/catalog/cards/global_mmlu/so/high_school_physics.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/so 2026-05-27T11:53:51,316 copying build/lib/unitxt/catalog/cards/global_mmlu/so/public_relations.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/so 2026-05-27T11:53:51,318 copying build/lib/unitxt/catalog/cards/global_mmlu/so/high_school_microeconomics.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/so 2026-05-27T11:53:51,319 copying build/lib/unitxt/catalog/cards/global_mmlu/so/virology.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/so 2026-05-27T11:53:51,321 copying build/lib/unitxt/catalog/cards/global_mmlu/so/high_school_us_history.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/so 2026-05-27T11:53:51,323 copying build/lib/unitxt/catalog/cards/global_mmlu/so/high_school_statistics.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/so 2026-05-27T11:53:51,325 copying build/lib/unitxt/catalog/cards/global_mmlu/so/miscellaneous.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/so 2026-05-27T11:53:51,327 copying build/lib/unitxt/catalog/cards/global_mmlu/so/high_school_mathematics.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/so 2026-05-27T11:53:51,329 copying build/lib/unitxt/catalog/cards/global_mmlu/so/formal_logic.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/so 2026-05-27T11:53:51,331 copying build/lib/unitxt/catalog/cards/global_mmlu/so/high_school_chemistry.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/so 2026-05-27T11:53:51,333 copying build/lib/unitxt/catalog/cards/global_mmlu/so/abstract_algebra.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/so 2026-05-27T11:53:51,335 copying build/lib/unitxt/catalog/cards/global_mmlu/so/moral_scenarios.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/so 2026-05-27T11:53:51,337 copying build/lib/unitxt/catalog/cards/global_mmlu/so/world_religions.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/so 2026-05-27T11:53:51,339 copying build/lib/unitxt/catalog/cards/global_mmlu/so/business_ethics.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/so 2026-05-27T11:53:51,342 copying build/lib/unitxt/catalog/cards/global_mmlu/so/security_studies.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/so 2026-05-27T11:53:51,344 copying build/lib/unitxt/catalog/cards/global_mmlu/so/college_medicine.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/so 2026-05-27T11:53:51,346 copying build/lib/unitxt/catalog/cards/global_mmlu/so/human_sexuality.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/so 2026-05-27T11:53:51,348 copying build/lib/unitxt/catalog/cards/global_mmlu/so/prehistory.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/so 2026-05-27T11:53:51,351 creating build/bdist.linux-armv7l/wheel/unitxt/catalog/cards/global_mmlu/ko 2026-05-27T11:53:51,352 copying build/lib/unitxt/catalog/cards/global_mmlu/ko/moral_disputes.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/ko 2026-05-27T11:53:51,354 copying build/lib/unitxt/catalog/cards/global_mmlu/ko/high_school_biology.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/ko 2026-05-27T11:53:51,356 copying build/lib/unitxt/catalog/cards/global_mmlu/ko/jurisprudence.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/ko 2026-05-27T11:53:51,358 copying build/lib/unitxt/catalog/cards/global_mmlu/ko/logical_fallacies.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/ko 2026-05-27T11:53:51,360 copying build/lib/unitxt/catalog/cards/global_mmlu/ko/college_chemistry.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/ko 2026-05-27T11:53:51,362 copying build/lib/unitxt/catalog/cards/global_mmlu/ko/high_school_government_and_politics.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/ko 2026-05-27T11:53:51,364 copying build/lib/unitxt/catalog/cards/global_mmlu/ko/college_mathematics.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/ko 2026-05-27T11:53:51,366 copying build/lib/unitxt/catalog/cards/global_mmlu/ko/econometrics.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/ko 2026-05-27T11:53:51,368 copying build/lib/unitxt/catalog/cards/global_mmlu/ko/high_school_macroeconomics.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/ko 2026-05-27T11:53:51,370 copying build/lib/unitxt/catalog/cards/global_mmlu/ko/high_school_psychology.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/ko 2026-05-27T11:53:51,372 copying build/lib/unitxt/catalog/cards/global_mmlu/ko/computer_security.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/ko 2026-05-27T11:53:51,375 copying build/lib/unitxt/catalog/cards/global_mmlu/ko/sociology.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/ko 2026-05-27T11:53:51,377 copying build/lib/unitxt/catalog/cards/global_mmlu/ko/nutrition.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/ko 2026-05-27T11:53:51,380 copying build/lib/unitxt/catalog/cards/global_mmlu/ko/professional_medicine.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/ko 2026-05-27T11:53:51,382 copying build/lib/unitxt/catalog/cards/global_mmlu/ko/college_biology.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/ko 2026-05-27T11:53:51,384 copying build/lib/unitxt/catalog/cards/global_mmlu/ko/anatomy.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/ko 2026-05-27T11:53:51,386 copying build/lib/unitxt/catalog/cards/global_mmlu/ko/professional_law.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/ko 2026-05-27T11:53:51,388 copying build/lib/unitxt/catalog/cards/global_mmlu/ko/machine_learning.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/ko 2026-05-27T11:53:51,389 copying build/lib/unitxt/catalog/cards/global_mmlu/ko/international_law.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/ko 2026-05-27T11:53:51,391 copying build/lib/unitxt/catalog/cards/global_mmlu/ko/medical_genetics.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/ko 2026-05-27T11:53:51,393 copying build/lib/unitxt/catalog/cards/global_mmlu/ko/high_school_computer_science.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/ko 2026-05-27T11:53:51,395 copying build/lib/unitxt/catalog/cards/global_mmlu/ko/clinical_knowledge.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/ko 2026-05-27T11:53:51,398 copying build/lib/unitxt/catalog/cards/global_mmlu/ko/college_physics.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/ko 2026-05-27T11:53:51,399 copying build/lib/unitxt/catalog/cards/global_mmlu/ko/global_facts.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/ko 2026-05-27T11:53:51,401 copying build/lib/unitxt/catalog/cards/global_mmlu/ko/college_computer_science.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/ko 2026-05-27T11:53:51,403 copying build/lib/unitxt/catalog/cards/global_mmlu/ko/us_foreign_policy.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/ko 2026-05-27T11:53:51,405 copying build/lib/unitxt/catalog/cards/global_mmlu/ko/professional_accounting.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/ko 2026-05-27T11:53:51,407 copying build/lib/unitxt/catalog/cards/global_mmlu/ko/professional_psychology.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/ko 2026-05-27T11:53:51,409 copying build/lib/unitxt/catalog/cards/global_mmlu/ko/philosophy.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/ko 2026-05-27T11:53:51,411 copying build/lib/unitxt/catalog/cards/global_mmlu/ko/elementary_mathematics.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/ko 2026-05-27T11:53:51,413 copying build/lib/unitxt/catalog/cards/global_mmlu/ko/conceptual_physics.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/ko 2026-05-27T11:53:51,415 copying build/lib/unitxt/catalog/cards/global_mmlu/ko/high_school_geography.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/ko 2026-05-27T11:53:51,417 copying build/lib/unitxt/catalog/cards/global_mmlu/ko/human_aging.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/ko 2026-05-27T11:53:51,419 copying build/lib/unitxt/catalog/cards/global_mmlu/ko/electrical_engineering.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/ko 2026-05-27T11:53:51,421 copying build/lib/unitxt/catalog/cards/global_mmlu/ko/management.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/ko 2026-05-27T11:53:51,423 copying build/lib/unitxt/catalog/cards/global_mmlu/ko/high_school_world_history.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/ko 2026-05-27T11:53:51,425 copying build/lib/unitxt/catalog/cards/global_mmlu/ko/marketing.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/ko 2026-05-27T11:53:51,427 copying build/lib/unitxt/catalog/cards/global_mmlu/ko/high_school_european_history.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/ko 2026-05-27T11:53:51,429 copying build/lib/unitxt/catalog/cards/global_mmlu/ko/astronomy.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/ko 2026-05-27T11:53:51,431 copying build/lib/unitxt/catalog/cards/global_mmlu/ko/high_school_physics.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/ko 2026-05-27T11:53:51,433 copying build/lib/unitxt/catalog/cards/global_mmlu/ko/public_relations.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/ko 2026-05-27T11:53:51,436 copying build/lib/unitxt/catalog/cards/global_mmlu/ko/high_school_microeconomics.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/ko 2026-05-27T11:53:51,438 copying build/lib/unitxt/catalog/cards/global_mmlu/ko/virology.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/ko 2026-05-27T11:53:51,440 copying build/lib/unitxt/catalog/cards/global_mmlu/ko/high_school_us_history.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/ko 2026-05-27T11:53:51,442 copying build/lib/unitxt/catalog/cards/global_mmlu/ko/high_school_statistics.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/ko 2026-05-27T11:53:51,444 copying build/lib/unitxt/catalog/cards/global_mmlu/ko/miscellaneous.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/ko 2026-05-27T11:53:51,446 copying build/lib/unitxt/catalog/cards/global_mmlu/ko/high_school_mathematics.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/ko 2026-05-27T11:53:51,448 copying build/lib/unitxt/catalog/cards/global_mmlu/ko/formal_logic.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/ko 2026-05-27T11:53:51,450 copying build/lib/unitxt/catalog/cards/global_mmlu/ko/high_school_chemistry.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/ko 2026-05-27T11:53:51,451 copying build/lib/unitxt/catalog/cards/global_mmlu/ko/abstract_algebra.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/ko 2026-05-27T11:53:51,453 copying build/lib/unitxt/catalog/cards/global_mmlu/ko/moral_scenarios.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/ko 2026-05-27T11:53:51,455 copying build/lib/unitxt/catalog/cards/global_mmlu/ko/world_religions.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/ko 2026-05-27T11:53:51,458 copying build/lib/unitxt/catalog/cards/global_mmlu/ko/business_ethics.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/ko 2026-05-27T11:53:51,460 copying build/lib/unitxt/catalog/cards/global_mmlu/ko/security_studies.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/ko 2026-05-27T11:53:51,463 copying build/lib/unitxt/catalog/cards/global_mmlu/ko/college_medicine.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/ko 2026-05-27T11:53:51,465 copying build/lib/unitxt/catalog/cards/global_mmlu/ko/human_sexuality.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/ko 2026-05-27T11:53:51,467 copying build/lib/unitxt/catalog/cards/global_mmlu/ko/prehistory.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/ko 2026-05-27T11:53:51,471 creating build/bdist.linux-armv7l/wheel/unitxt/catalog/cards/global_mmlu/en 2026-05-27T11:53:51,472 copying build/lib/unitxt/catalog/cards/global_mmlu/en/moral_disputes.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/en 2026-05-27T11:53:51,474 copying build/lib/unitxt/catalog/cards/global_mmlu/en/high_school_biology.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/en 2026-05-27T11:53:51,477 copying build/lib/unitxt/catalog/cards/global_mmlu/en/jurisprudence.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/en 2026-05-27T11:53:51,479 copying build/lib/unitxt/catalog/cards/global_mmlu/en/logical_fallacies.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/en 2026-05-27T11:53:51,481 copying build/lib/unitxt/catalog/cards/global_mmlu/en/college_chemistry.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/en 2026-05-27T11:53:51,483 copying build/lib/unitxt/catalog/cards/global_mmlu/en/high_school_government_and_politics.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/en 2026-05-27T11:53:51,485 copying build/lib/unitxt/catalog/cards/global_mmlu/en/college_mathematics.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/en 2026-05-27T11:53:51,487 copying build/lib/unitxt/catalog/cards/global_mmlu/en/econometrics.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/en 2026-05-27T11:53:51,489 copying build/lib/unitxt/catalog/cards/global_mmlu/en/high_school_macroeconomics.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/en 2026-05-27T11:53:51,491 copying build/lib/unitxt/catalog/cards/global_mmlu/en/high_school_psychology.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/en 2026-05-27T11:53:51,493 copying build/lib/unitxt/catalog/cards/global_mmlu/en/computer_security.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/en 2026-05-27T11:53:51,495 copying build/lib/unitxt/catalog/cards/global_mmlu/en/sociology.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/en 2026-05-27T11:53:51,497 copying build/lib/unitxt/catalog/cards/global_mmlu/en/nutrition.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/en 2026-05-27T11:53:51,499 copying build/lib/unitxt/catalog/cards/global_mmlu/en/professional_medicine.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/en 2026-05-27T11:53:51,501 copying build/lib/unitxt/catalog/cards/global_mmlu/en/college_biology.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/en 2026-05-27T11:53:51,503 copying build/lib/unitxt/catalog/cards/global_mmlu/en/anatomy.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/en 2026-05-27T11:53:51,505 copying build/lib/unitxt/catalog/cards/global_mmlu/en/professional_law.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/en 2026-05-27T11:53:51,507 copying build/lib/unitxt/catalog/cards/global_mmlu/en/machine_learning.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/en 2026-05-27T11:53:51,509 copying build/lib/unitxt/catalog/cards/global_mmlu/en/international_law.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/en 2026-05-27T11:53:51,512 copying build/lib/unitxt/catalog/cards/global_mmlu/en/medical_genetics.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/en 2026-05-27T11:53:51,514 copying build/lib/unitxt/catalog/cards/global_mmlu/en/high_school_computer_science.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/en 2026-05-27T11:53:51,516 copying build/lib/unitxt/catalog/cards/global_mmlu/en/clinical_knowledge.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/en 2026-05-27T11:53:51,518 copying build/lib/unitxt/catalog/cards/global_mmlu/en/college_physics.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/en 2026-05-27T11:53:51,520 copying build/lib/unitxt/catalog/cards/global_mmlu/en/global_facts.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/en 2026-05-27T11:53:51,522 copying build/lib/unitxt/catalog/cards/global_mmlu/en/college_computer_science.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/en 2026-05-27T11:53:51,524 copying build/lib/unitxt/catalog/cards/global_mmlu/en/us_foreign_policy.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/en 2026-05-27T11:53:51,526 copying build/lib/unitxt/catalog/cards/global_mmlu/en/professional_accounting.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/en 2026-05-27T11:53:51,529 copying build/lib/unitxt/catalog/cards/global_mmlu/en/professional_psychology.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/en 2026-05-27T11:53:51,531 copying build/lib/unitxt/catalog/cards/global_mmlu/en/philosophy.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/en 2026-05-27T11:53:51,533 copying build/lib/unitxt/catalog/cards/global_mmlu/en/elementary_mathematics.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/en 2026-05-27T11:53:51,535 copying build/lib/unitxt/catalog/cards/global_mmlu/en/conceptual_physics.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/en 2026-05-27T11:53:51,537 copying build/lib/unitxt/catalog/cards/global_mmlu/en/high_school_geography.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/en 2026-05-27T11:53:51,539 copying build/lib/unitxt/catalog/cards/global_mmlu/en/human_aging.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/en 2026-05-27T11:53:51,541 copying build/lib/unitxt/catalog/cards/global_mmlu/en/electrical_engineering.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/en 2026-05-27T11:53:51,543 copying build/lib/unitxt/catalog/cards/global_mmlu/en/management.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/en 2026-05-27T11:53:51,545 copying build/lib/unitxt/catalog/cards/global_mmlu/en/high_school_world_history.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/en 2026-05-27T11:53:51,549 copying build/lib/unitxt/catalog/cards/global_mmlu/en/marketing.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/en 2026-05-27T11:53:51,551 copying build/lib/unitxt/catalog/cards/global_mmlu/en/high_school_european_history.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/en 2026-05-27T11:53:51,553 copying build/lib/unitxt/catalog/cards/global_mmlu/en/astronomy.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/en 2026-05-27T11:53:51,555 copying build/lib/unitxt/catalog/cards/global_mmlu/en/high_school_physics.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/en 2026-05-27T11:53:51,557 copying build/lib/unitxt/catalog/cards/global_mmlu/en/public_relations.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/en 2026-05-27T11:53:51,559 copying build/lib/unitxt/catalog/cards/global_mmlu/en/high_school_microeconomics.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/en 2026-05-27T11:53:51,561 copying build/lib/unitxt/catalog/cards/global_mmlu/en/virology.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/en 2026-05-27T11:53:51,563 copying build/lib/unitxt/catalog/cards/global_mmlu/en/high_school_us_history.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/en 2026-05-27T11:53:51,565 copying build/lib/unitxt/catalog/cards/global_mmlu/en/high_school_statistics.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/en 2026-05-27T11:53:51,567 copying build/lib/unitxt/catalog/cards/global_mmlu/en/miscellaneous.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/en 2026-05-27T11:53:51,569 copying build/lib/unitxt/catalog/cards/global_mmlu/en/high_school_mathematics.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/en 2026-05-27T11:53:51,571 copying build/lib/unitxt/catalog/cards/global_mmlu/en/formal_logic.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/en 2026-05-27T11:53:51,573 copying build/lib/unitxt/catalog/cards/global_mmlu/en/high_school_chemistry.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/en 2026-05-27T11:53:51,575 copying build/lib/unitxt/catalog/cards/global_mmlu/en/abstract_algebra.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/en 2026-05-27T11:53:51,577 copying build/lib/unitxt/catalog/cards/global_mmlu/en/moral_scenarios.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/en 2026-05-27T11:53:51,579 copying build/lib/unitxt/catalog/cards/global_mmlu/en/world_religions.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/en 2026-05-27T11:53:51,581 copying build/lib/unitxt/catalog/cards/global_mmlu/en/business_ethics.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/en 2026-05-27T11:53:51,583 copying build/lib/unitxt/catalog/cards/global_mmlu/en/security_studies.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/en 2026-05-27T11:53:51,585 copying build/lib/unitxt/catalog/cards/global_mmlu/en/college_medicine.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/en 2026-05-27T11:53:51,587 copying build/lib/unitxt/catalog/cards/global_mmlu/en/human_sexuality.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/en 2026-05-27T11:53:51,589 copying build/lib/unitxt/catalog/cards/global_mmlu/en/prehistory.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/en 2026-05-27T11:53:51,593 creating build/bdist.linux-armv7l/wheel/unitxt/catalog/cards/global_mmlu/it 2026-05-27T11:53:51,594 copying build/lib/unitxt/catalog/cards/global_mmlu/it/moral_disputes.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/it 2026-05-27T11:53:51,596 copying build/lib/unitxt/catalog/cards/global_mmlu/it/high_school_biology.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/it 2026-05-27T11:53:51,598 copying build/lib/unitxt/catalog/cards/global_mmlu/it/jurisprudence.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/it 2026-05-27T11:53:51,599 copying build/lib/unitxt/catalog/cards/global_mmlu/it/logical_fallacies.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/it 2026-05-27T11:53:51,601 copying build/lib/unitxt/catalog/cards/global_mmlu/it/college_chemistry.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/it 2026-05-27T11:53:51,603 copying build/lib/unitxt/catalog/cards/global_mmlu/it/high_school_government_and_politics.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/it 2026-05-27T11:53:51,605 copying build/lib/unitxt/catalog/cards/global_mmlu/it/college_mathematics.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/it 2026-05-27T11:53:51,607 copying build/lib/unitxt/catalog/cards/global_mmlu/it/econometrics.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/it 2026-05-27T11:53:51,609 copying build/lib/unitxt/catalog/cards/global_mmlu/it/high_school_macroeconomics.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/it 2026-05-27T11:53:51,611 copying build/lib/unitxt/catalog/cards/global_mmlu/it/high_school_psychology.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/it 2026-05-27T11:53:51,613 copying build/lib/unitxt/catalog/cards/global_mmlu/it/computer_security.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/it 2026-05-27T11:53:51,615 copying build/lib/unitxt/catalog/cards/global_mmlu/it/sociology.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/it 2026-05-27T11:53:51,617 copying build/lib/unitxt/catalog/cards/global_mmlu/it/nutrition.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/it 2026-05-27T11:53:51,619 copying build/lib/unitxt/catalog/cards/global_mmlu/it/professional_medicine.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/it 2026-05-27T11:53:51,621 copying build/lib/unitxt/catalog/cards/global_mmlu/it/college_biology.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/it 2026-05-27T11:53:51,624 copying build/lib/unitxt/catalog/cards/global_mmlu/it/anatomy.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/it 2026-05-27T11:53:51,626 copying build/lib/unitxt/catalog/cards/global_mmlu/it/professional_law.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/it 2026-05-27T11:53:51,628 copying build/lib/unitxt/catalog/cards/global_mmlu/it/machine_learning.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/it 2026-05-27T11:53:51,630 copying build/lib/unitxt/catalog/cards/global_mmlu/it/international_law.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/it 2026-05-27T11:53:51,633 copying build/lib/unitxt/catalog/cards/global_mmlu/it/medical_genetics.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/it 2026-05-27T11:53:51,636 copying build/lib/unitxt/catalog/cards/global_mmlu/it/high_school_computer_science.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/it 2026-05-27T11:53:51,638 copying build/lib/unitxt/catalog/cards/global_mmlu/it/clinical_knowledge.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/it 2026-05-27T11:53:51,640 copying build/lib/unitxt/catalog/cards/global_mmlu/it/college_physics.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/it 2026-05-27T11:53:51,642 copying build/lib/unitxt/catalog/cards/global_mmlu/it/global_facts.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/it 2026-05-27T11:53:51,644 copying build/lib/unitxt/catalog/cards/global_mmlu/it/college_computer_science.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/it 2026-05-27T11:53:51,646 copying build/lib/unitxt/catalog/cards/global_mmlu/it/us_foreign_policy.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/it 2026-05-27T11:53:51,648 copying build/lib/unitxt/catalog/cards/global_mmlu/it/professional_accounting.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/it 2026-05-27T11:53:51,650 copying build/lib/unitxt/catalog/cards/global_mmlu/it/professional_psychology.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/it 2026-05-27T11:53:51,652 copying build/lib/unitxt/catalog/cards/global_mmlu/it/philosophy.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/it 2026-05-27T11:53:51,654 copying build/lib/unitxt/catalog/cards/global_mmlu/it/elementary_mathematics.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/it 2026-05-27T11:53:51,656 copying build/lib/unitxt/catalog/cards/global_mmlu/it/conceptual_physics.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/it 2026-05-27T11:53:51,658 copying build/lib/unitxt/catalog/cards/global_mmlu/it/high_school_geography.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/it 2026-05-27T11:53:51,660 copying build/lib/unitxt/catalog/cards/global_mmlu/it/human_aging.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/it 2026-05-27T11:53:51,662 copying build/lib/unitxt/catalog/cards/global_mmlu/it/electrical_engineering.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/it 2026-05-27T11:53:51,664 copying build/lib/unitxt/catalog/cards/global_mmlu/it/management.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/it 2026-05-27T11:53:51,666 copying build/lib/unitxt/catalog/cards/global_mmlu/it/high_school_world_history.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/it 2026-05-27T11:53:51,668 copying build/lib/unitxt/catalog/cards/global_mmlu/it/marketing.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/it 2026-05-27T11:53:51,670 copying build/lib/unitxt/catalog/cards/global_mmlu/it/high_school_european_history.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/it 2026-05-27T11:53:51,672 copying build/lib/unitxt/catalog/cards/global_mmlu/it/astronomy.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/it 2026-05-27T11:53:51,674 copying build/lib/unitxt/catalog/cards/global_mmlu/it/high_school_physics.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/it 2026-05-27T11:53:51,676 copying build/lib/unitxt/catalog/cards/global_mmlu/it/public_relations.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/it 2026-05-27T11:53:51,678 copying build/lib/unitxt/catalog/cards/global_mmlu/it/high_school_microeconomics.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/it 2026-05-27T11:53:51,680 copying build/lib/unitxt/catalog/cards/global_mmlu/it/virology.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/it 2026-05-27T11:53:51,682 copying build/lib/unitxt/catalog/cards/global_mmlu/it/high_school_us_history.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/it 2026-05-27T11:53:51,684 copying build/lib/unitxt/catalog/cards/global_mmlu/it/high_school_statistics.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/it 2026-05-27T11:53:51,686 copying build/lib/unitxt/catalog/cards/global_mmlu/it/miscellaneous.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/it 2026-05-27T11:53:51,688 copying build/lib/unitxt/catalog/cards/global_mmlu/it/high_school_mathematics.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/it 2026-05-27T11:53:51,691 copying build/lib/unitxt/catalog/cards/global_mmlu/it/formal_logic.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/it 2026-05-27T11:53:51,693 copying build/lib/unitxt/catalog/cards/global_mmlu/it/high_school_chemistry.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/it 2026-05-27T11:53:51,694 copying build/lib/unitxt/catalog/cards/global_mmlu/it/abstract_algebra.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/it 2026-05-27T11:53:51,697 copying build/lib/unitxt/catalog/cards/global_mmlu/it/moral_scenarios.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/it 2026-05-27T11:53:51,699 copying build/lib/unitxt/catalog/cards/global_mmlu/it/world_religions.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/it 2026-05-27T11:53:51,701 copying build/lib/unitxt/catalog/cards/global_mmlu/it/business_ethics.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/it 2026-05-27T11:53:51,702 copying build/lib/unitxt/catalog/cards/global_mmlu/it/security_studies.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/it 2026-05-27T11:53:51,704 copying build/lib/unitxt/catalog/cards/global_mmlu/it/college_medicine.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/it 2026-05-27T11:53:51,706 copying build/lib/unitxt/catalog/cards/global_mmlu/it/human_sexuality.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/it 2026-05-27T11:53:51,708 copying build/lib/unitxt/catalog/cards/global_mmlu/it/prehistory.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/it 2026-05-27T11:53:51,713 creating build/bdist.linux-armv7l/wheel/unitxt/catalog/cards/global_mmlu/de 2026-05-27T11:53:51,714 copying build/lib/unitxt/catalog/cards/global_mmlu/de/moral_disputes.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/de 2026-05-27T11:53:51,717 copying build/lib/unitxt/catalog/cards/global_mmlu/de/high_school_biology.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/de 2026-05-27T11:53:51,719 copying build/lib/unitxt/catalog/cards/global_mmlu/de/jurisprudence.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/de 2026-05-27T11:53:51,721 copying build/lib/unitxt/catalog/cards/global_mmlu/de/logical_fallacies.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/de 2026-05-27T11:53:51,723 copying build/lib/unitxt/catalog/cards/global_mmlu/de/college_chemistry.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/de 2026-05-27T11:53:51,725 copying build/lib/unitxt/catalog/cards/global_mmlu/de/high_school_government_and_politics.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/de 2026-05-27T11:53:51,727 copying build/lib/unitxt/catalog/cards/global_mmlu/de/college_mathematics.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/de 2026-05-27T11:53:51,729 copying build/lib/unitxt/catalog/cards/global_mmlu/de/econometrics.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/de 2026-05-27T11:53:51,731 copying build/lib/unitxt/catalog/cards/global_mmlu/de/high_school_macroeconomics.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/de 2026-05-27T11:53:51,733 copying build/lib/unitxt/catalog/cards/global_mmlu/de/high_school_psychology.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/de 2026-05-27T11:53:51,735 copying build/lib/unitxt/catalog/cards/global_mmlu/de/computer_security.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/de 2026-05-27T11:53:51,738 copying build/lib/unitxt/catalog/cards/global_mmlu/de/sociology.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/de 2026-05-27T11:53:51,740 copying build/lib/unitxt/catalog/cards/global_mmlu/de/nutrition.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/de 2026-05-27T11:53:51,742 copying build/lib/unitxt/catalog/cards/global_mmlu/de/professional_medicine.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/de 2026-05-27T11:53:51,744 copying build/lib/unitxt/catalog/cards/global_mmlu/de/college_biology.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/de 2026-05-27T11:53:51,746 copying build/lib/unitxt/catalog/cards/global_mmlu/de/anatomy.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/de 2026-05-27T11:53:51,748 copying build/lib/unitxt/catalog/cards/global_mmlu/de/professional_law.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/de 2026-05-27T11:53:51,749 copying build/lib/unitxt/catalog/cards/global_mmlu/de/machine_learning.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/de 2026-05-27T11:53:51,751 copying build/lib/unitxt/catalog/cards/global_mmlu/de/international_law.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/de 2026-05-27T11:53:51,753 copying build/lib/unitxt/catalog/cards/global_mmlu/de/medical_genetics.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/de 2026-05-27T11:53:51,755 copying build/lib/unitxt/catalog/cards/global_mmlu/de/high_school_computer_science.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/de 2026-05-27T11:53:51,757 copying build/lib/unitxt/catalog/cards/global_mmlu/de/clinical_knowledge.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/de 2026-05-27T11:53:51,759 copying build/lib/unitxt/catalog/cards/global_mmlu/de/college_physics.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/de 2026-05-27T11:53:51,761 copying build/lib/unitxt/catalog/cards/global_mmlu/de/global_facts.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/de 2026-05-27T11:53:51,763 copying build/lib/unitxt/catalog/cards/global_mmlu/de/college_computer_science.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/de 2026-05-27T11:53:51,765 copying build/lib/unitxt/catalog/cards/global_mmlu/de/us_foreign_policy.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/de 2026-05-27T11:53:51,768 copying build/lib/unitxt/catalog/cards/global_mmlu/de/professional_accounting.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/de 2026-05-27T11:53:51,770 copying build/lib/unitxt/catalog/cards/global_mmlu/de/professional_psychology.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/de 2026-05-27T11:53:51,772 copying build/lib/unitxt/catalog/cards/global_mmlu/de/philosophy.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/de 2026-05-27T11:53:51,774 copying build/lib/unitxt/catalog/cards/global_mmlu/de/elementary_mathematics.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/de 2026-05-27T11:53:51,776 copying build/lib/unitxt/catalog/cards/global_mmlu/de/conceptual_physics.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/de 2026-05-27T11:53:51,778 copying build/lib/unitxt/catalog/cards/global_mmlu/de/high_school_geography.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/de 2026-05-27T11:53:51,780 copying build/lib/unitxt/catalog/cards/global_mmlu/de/human_aging.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/de 2026-05-27T11:53:51,782 copying build/lib/unitxt/catalog/cards/global_mmlu/de/electrical_engineering.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/de 2026-05-27T11:53:51,785 copying build/lib/unitxt/catalog/cards/global_mmlu/de/management.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/de 2026-05-27T11:53:51,786 copying build/lib/unitxt/catalog/cards/global_mmlu/de/high_school_world_history.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/de 2026-05-27T11:53:51,788 copying build/lib/unitxt/catalog/cards/global_mmlu/de/marketing.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/de 2026-05-27T11:53:51,791 copying build/lib/unitxt/catalog/cards/global_mmlu/de/high_school_european_history.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/de 2026-05-27T11:53:51,794 copying build/lib/unitxt/catalog/cards/global_mmlu/de/astronomy.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/de 2026-05-27T11:53:51,796 copying build/lib/unitxt/catalog/cards/global_mmlu/de/high_school_physics.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/de 2026-05-27T11:53:51,798 copying build/lib/unitxt/catalog/cards/global_mmlu/de/public_relations.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/de 2026-05-27T11:53:51,800 copying build/lib/unitxt/catalog/cards/global_mmlu/de/high_school_microeconomics.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/de 2026-05-27T11:53:51,802 copying build/lib/unitxt/catalog/cards/global_mmlu/de/virology.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/de 2026-05-27T11:53:51,804 copying build/lib/unitxt/catalog/cards/global_mmlu/de/high_school_us_history.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/de 2026-05-27T11:53:51,806 copying build/lib/unitxt/catalog/cards/global_mmlu/de/high_school_statistics.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/de 2026-05-27T11:53:51,808 copying build/lib/unitxt/catalog/cards/global_mmlu/de/miscellaneous.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/de 2026-05-27T11:53:51,810 copying build/lib/unitxt/catalog/cards/global_mmlu/de/high_school_mathematics.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/de 2026-05-27T11:53:51,812 copying build/lib/unitxt/catalog/cards/global_mmlu/de/formal_logic.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/de 2026-05-27T11:53:51,814 copying build/lib/unitxt/catalog/cards/global_mmlu/de/high_school_chemistry.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/de 2026-05-27T11:53:51,816 copying build/lib/unitxt/catalog/cards/global_mmlu/de/abstract_algebra.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/de 2026-05-27T11:53:51,818 copying build/lib/unitxt/catalog/cards/global_mmlu/de/moral_scenarios.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/de 2026-05-27T11:53:51,820 copying build/lib/unitxt/catalog/cards/global_mmlu/de/world_religions.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/de 2026-05-27T11:53:51,822 copying build/lib/unitxt/catalog/cards/global_mmlu/de/business_ethics.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/de 2026-05-27T11:53:51,824 copying build/lib/unitxt/catalog/cards/global_mmlu/de/security_studies.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/de 2026-05-27T11:53:51,826 copying build/lib/unitxt/catalog/cards/global_mmlu/de/college_medicine.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/de 2026-05-27T11:53:51,828 copying build/lib/unitxt/catalog/cards/global_mmlu/de/human_sexuality.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/de 2026-05-27T11:53:51,830 copying build/lib/unitxt/catalog/cards/global_mmlu/de/prehistory.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/de 2026-05-27T11:53:51,833 creating build/bdist.linux-armv7l/wheel/unitxt/catalog/cards/global_mmlu/yo 2026-05-27T11:53:51,834 copying build/lib/unitxt/catalog/cards/global_mmlu/yo/moral_disputes.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/yo 2026-05-27T11:53:51,837 copying build/lib/unitxt/catalog/cards/global_mmlu/yo/high_school_biology.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/yo 2026-05-27T11:53:51,839 copying build/lib/unitxt/catalog/cards/global_mmlu/yo/jurisprudence.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/yo 2026-05-27T11:53:51,841 copying build/lib/unitxt/catalog/cards/global_mmlu/yo/logical_fallacies.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/yo 2026-05-27T11:53:51,842 copying build/lib/unitxt/catalog/cards/global_mmlu/yo/college_chemistry.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/yo 2026-05-27T11:53:51,844 copying build/lib/unitxt/catalog/cards/global_mmlu/yo/high_school_government_and_politics.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/yo 2026-05-27T11:53:51,846 copying build/lib/unitxt/catalog/cards/global_mmlu/yo/college_mathematics.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/yo 2026-05-27T11:53:51,848 copying build/lib/unitxt/catalog/cards/global_mmlu/yo/econometrics.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/yo 2026-05-27T11:53:51,850 copying build/lib/unitxt/catalog/cards/global_mmlu/yo/high_school_macroeconomics.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/yo 2026-05-27T11:53:51,852 copying build/lib/unitxt/catalog/cards/global_mmlu/yo/high_school_psychology.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/yo 2026-05-27T11:53:51,854 copying build/lib/unitxt/catalog/cards/global_mmlu/yo/computer_security.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/yo 2026-05-27T11:53:51,856 copying build/lib/unitxt/catalog/cards/global_mmlu/yo/sociology.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/yo 2026-05-27T11:53:51,858 copying build/lib/unitxt/catalog/cards/global_mmlu/yo/nutrition.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/yo 2026-05-27T11:53:51,860 copying build/lib/unitxt/catalog/cards/global_mmlu/yo/professional_medicine.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/yo 2026-05-27T11:53:51,862 copying build/lib/unitxt/catalog/cards/global_mmlu/yo/college_biology.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/yo 2026-05-27T11:53:51,864 copying build/lib/unitxt/catalog/cards/global_mmlu/yo/anatomy.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/yo 2026-05-27T11:53:51,866 copying build/lib/unitxt/catalog/cards/global_mmlu/yo/professional_law.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/yo 2026-05-27T11:53:51,868 copying build/lib/unitxt/catalog/cards/global_mmlu/yo/machine_learning.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/yo 2026-05-27T11:53:51,870 copying build/lib/unitxt/catalog/cards/global_mmlu/yo/international_law.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/yo 2026-05-27T11:53:51,872 copying build/lib/unitxt/catalog/cards/global_mmlu/yo/medical_genetics.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/yo 2026-05-27T11:53:51,875 copying build/lib/unitxt/catalog/cards/global_mmlu/yo/high_school_computer_science.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/yo 2026-05-27T11:53:51,877 copying build/lib/unitxt/catalog/cards/global_mmlu/yo/clinical_knowledge.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/yo 2026-05-27T11:53:51,880 copying build/lib/unitxt/catalog/cards/global_mmlu/yo/college_physics.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/yo 2026-05-27T11:53:51,882 copying build/lib/unitxt/catalog/cards/global_mmlu/yo/global_facts.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/yo 2026-05-27T11:53:51,884 copying build/lib/unitxt/catalog/cards/global_mmlu/yo/college_computer_science.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/yo 2026-05-27T11:53:51,886 copying build/lib/unitxt/catalog/cards/global_mmlu/yo/us_foreign_policy.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/yo 2026-05-27T11:53:51,888 copying build/lib/unitxt/catalog/cards/global_mmlu/yo/professional_accounting.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/yo 2026-05-27T11:53:51,890 copying build/lib/unitxt/catalog/cards/global_mmlu/yo/professional_psychology.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/yo 2026-05-27T11:53:51,892 copying build/lib/unitxt/catalog/cards/global_mmlu/yo/philosophy.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/yo 2026-05-27T11:53:51,894 copying build/lib/unitxt/catalog/cards/global_mmlu/yo/elementary_mathematics.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/yo 2026-05-27T11:53:51,895 copying build/lib/unitxt/catalog/cards/global_mmlu/yo/conceptual_physics.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/yo 2026-05-27T11:53:51,897 copying build/lib/unitxt/catalog/cards/global_mmlu/yo/high_school_geography.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/yo 2026-05-27T11:53:51,899 copying build/lib/unitxt/catalog/cards/global_mmlu/yo/human_aging.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/yo 2026-05-27T11:53:51,901 copying build/lib/unitxt/catalog/cards/global_mmlu/yo/electrical_engineering.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/yo 2026-05-27T11:53:51,903 copying build/lib/unitxt/catalog/cards/global_mmlu/yo/management.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/yo 2026-05-27T11:53:51,905 copying build/lib/unitxt/catalog/cards/global_mmlu/yo/high_school_world_history.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/yo 2026-05-27T11:53:51,907 copying build/lib/unitxt/catalog/cards/global_mmlu/yo/marketing.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/yo 2026-05-27T11:53:51,909 copying build/lib/unitxt/catalog/cards/global_mmlu/yo/high_school_european_history.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/yo 2026-05-27T11:53:51,911 copying build/lib/unitxt/catalog/cards/global_mmlu/yo/astronomy.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/yo 2026-05-27T11:53:51,913 copying build/lib/unitxt/catalog/cards/global_mmlu/yo/high_school_physics.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/yo 2026-05-27T11:53:51,915 copying build/lib/unitxt/catalog/cards/global_mmlu/yo/public_relations.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/yo 2026-05-27T11:53:51,917 copying build/lib/unitxt/catalog/cards/global_mmlu/yo/high_school_microeconomics.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/yo 2026-05-27T11:53:51,919 copying build/lib/unitxt/catalog/cards/global_mmlu/yo/virology.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/yo 2026-05-27T11:53:51,921 copying build/lib/unitxt/catalog/cards/global_mmlu/yo/high_school_us_history.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/yo 2026-05-27T11:53:51,923 copying build/lib/unitxt/catalog/cards/global_mmlu/yo/high_school_statistics.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/yo 2026-05-27T11:53:51,925 copying build/lib/unitxt/catalog/cards/global_mmlu/yo/miscellaneous.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/yo 2026-05-27T11:53:51,927 copying build/lib/unitxt/catalog/cards/global_mmlu/yo/high_school_mathematics.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/yo 2026-05-27T11:53:51,929 copying build/lib/unitxt/catalog/cards/global_mmlu/yo/formal_logic.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/yo 2026-05-27T11:53:51,932 copying build/lib/unitxt/catalog/cards/global_mmlu/yo/high_school_chemistry.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/yo 2026-05-27T11:53:51,933 copying build/lib/unitxt/catalog/cards/global_mmlu/yo/abstract_algebra.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/yo 2026-05-27T11:53:51,935 copying build/lib/unitxt/catalog/cards/global_mmlu/yo/moral_scenarios.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/yo 2026-05-27T11:53:51,937 copying build/lib/unitxt/catalog/cards/global_mmlu/yo/world_religions.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/yo 2026-05-27T11:53:51,939 copying build/lib/unitxt/catalog/cards/global_mmlu/yo/business_ethics.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/yo 2026-05-27T11:53:51,941 copying build/lib/unitxt/catalog/cards/global_mmlu/yo/security_studies.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/yo 2026-05-27T11:53:51,943 copying build/lib/unitxt/catalog/cards/global_mmlu/yo/college_medicine.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/yo 2026-05-27T11:53:51,945 copying build/lib/unitxt/catalog/cards/global_mmlu/yo/human_sexuality.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/yo 2026-05-27T11:53:51,947 copying build/lib/unitxt/catalog/cards/global_mmlu/yo/prehistory.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/yo 2026-05-27T11:53:51,950 creating build/bdist.linux-armv7l/wheel/unitxt/catalog/cards/global_mmlu/ar 2026-05-27T11:53:51,951 copying build/lib/unitxt/catalog/cards/global_mmlu/ar/moral_disputes.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/ar 2026-05-27T11:53:51,954 copying build/lib/unitxt/catalog/cards/global_mmlu/ar/high_school_biology.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/ar 2026-05-27T11:53:51,957 copying build/lib/unitxt/catalog/cards/global_mmlu/ar/jurisprudence.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/ar 2026-05-27T11:53:51,960 copying build/lib/unitxt/catalog/cards/global_mmlu/ar/logical_fallacies.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/ar 2026-05-27T11:53:51,963 copying build/lib/unitxt/catalog/cards/global_mmlu/ar/college_chemistry.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/ar 2026-05-27T11:53:51,965 copying build/lib/unitxt/catalog/cards/global_mmlu/ar/high_school_government_and_politics.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/ar 2026-05-27T11:53:51,968 copying build/lib/unitxt/catalog/cards/global_mmlu/ar/college_mathematics.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/ar 2026-05-27T11:53:51,971 copying build/lib/unitxt/catalog/cards/global_mmlu/ar/econometrics.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/ar 2026-05-27T11:53:51,973 copying build/lib/unitxt/catalog/cards/global_mmlu/ar/high_school_macroeconomics.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/ar 2026-05-27T11:53:51,976 copying build/lib/unitxt/catalog/cards/global_mmlu/ar/high_school_psychology.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/ar 2026-05-27T11:53:51,978 copying build/lib/unitxt/catalog/cards/global_mmlu/ar/computer_security.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/ar 2026-05-27T11:53:51,980 copying build/lib/unitxt/catalog/cards/global_mmlu/ar/sociology.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/ar 2026-05-27T11:53:51,983 copying build/lib/unitxt/catalog/cards/global_mmlu/ar/nutrition.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/ar 2026-05-27T11:53:51,985 copying build/lib/unitxt/catalog/cards/global_mmlu/ar/professional_medicine.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/ar 2026-05-27T11:53:51,988 copying build/lib/unitxt/catalog/cards/global_mmlu/ar/college_biology.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/ar 2026-05-27T11:53:51,990 copying build/lib/unitxt/catalog/cards/global_mmlu/ar/anatomy.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/ar 2026-05-27T11:53:51,993 copying build/lib/unitxt/catalog/cards/global_mmlu/ar/professional_law.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/ar 2026-05-27T11:53:51,995 copying build/lib/unitxt/catalog/cards/global_mmlu/ar/machine_learning.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/ar 2026-05-27T11:53:51,997 copying build/lib/unitxt/catalog/cards/global_mmlu/ar/international_law.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/ar 2026-05-27T11:53:52,000 copying build/lib/unitxt/catalog/cards/global_mmlu/ar/medical_genetics.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/ar 2026-05-27T11:53:52,002 copying build/lib/unitxt/catalog/cards/global_mmlu/ar/high_school_computer_science.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/ar 2026-05-27T11:53:52,004 copying build/lib/unitxt/catalog/cards/global_mmlu/ar/clinical_knowledge.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/ar 2026-05-27T11:53:52,007 copying build/lib/unitxt/catalog/cards/global_mmlu/ar/college_physics.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/ar 2026-05-27T11:53:52,009 copying build/lib/unitxt/catalog/cards/global_mmlu/ar/global_facts.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/ar 2026-05-27T11:53:52,011 copying build/lib/unitxt/catalog/cards/global_mmlu/ar/college_computer_science.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/ar 2026-05-27T11:53:52,014 copying build/lib/unitxt/catalog/cards/global_mmlu/ar/us_foreign_policy.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/ar 2026-05-27T11:53:52,016 copying build/lib/unitxt/catalog/cards/global_mmlu/ar/professional_accounting.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/ar 2026-05-27T11:53:52,019 copying build/lib/unitxt/catalog/cards/global_mmlu/ar/professional_psychology.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/ar 2026-05-27T11:53:52,021 copying build/lib/unitxt/catalog/cards/global_mmlu/ar/philosophy.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/ar 2026-05-27T11:53:52,023 copying build/lib/unitxt/catalog/cards/global_mmlu/ar/elementary_mathematics.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/ar 2026-05-27T11:53:52,026 copying build/lib/unitxt/catalog/cards/global_mmlu/ar/conceptual_physics.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/ar 2026-05-27T11:53:52,028 copying build/lib/unitxt/catalog/cards/global_mmlu/ar/high_school_geography.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/ar 2026-05-27T11:53:52,031 copying build/lib/unitxt/catalog/cards/global_mmlu/ar/human_aging.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/ar 2026-05-27T11:53:52,033 copying build/lib/unitxt/catalog/cards/global_mmlu/ar/electrical_engineering.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/ar 2026-05-27T11:53:52,035 copying build/lib/unitxt/catalog/cards/global_mmlu/ar/management.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/ar 2026-05-27T11:53:52,038 copying build/lib/unitxt/catalog/cards/global_mmlu/ar/high_school_world_history.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/ar 2026-05-27T11:53:52,041 copying build/lib/unitxt/catalog/cards/global_mmlu/ar/marketing.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/ar 2026-05-27T11:53:52,044 copying build/lib/unitxt/catalog/cards/global_mmlu/ar/high_school_european_history.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/ar 2026-05-27T11:53:52,047 copying build/lib/unitxt/catalog/cards/global_mmlu/ar/astronomy.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/ar 2026-05-27T11:53:52,049 copying build/lib/unitxt/catalog/cards/global_mmlu/ar/high_school_physics.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/ar 2026-05-27T11:53:52,052 copying build/lib/unitxt/catalog/cards/global_mmlu/ar/public_relations.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/ar 2026-05-27T11:53:52,054 copying build/lib/unitxt/catalog/cards/global_mmlu/ar/high_school_microeconomics.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/ar 2026-05-27T11:53:52,056 copying build/lib/unitxt/catalog/cards/global_mmlu/ar/virology.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/ar 2026-05-27T11:53:52,059 copying build/lib/unitxt/catalog/cards/global_mmlu/ar/high_school_us_history.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/ar 2026-05-27T11:53:52,061 copying build/lib/unitxt/catalog/cards/global_mmlu/ar/high_school_statistics.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/ar 2026-05-27T11:53:52,064 copying build/lib/unitxt/catalog/cards/global_mmlu/ar/miscellaneous.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/ar 2026-05-27T11:53:52,066 copying build/lib/unitxt/catalog/cards/global_mmlu/ar/high_school_mathematics.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/ar 2026-05-27T11:53:52,068 copying build/lib/unitxt/catalog/cards/global_mmlu/ar/formal_logic.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/ar 2026-05-27T11:53:52,071 copying build/lib/unitxt/catalog/cards/global_mmlu/ar/high_school_chemistry.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/ar 2026-05-27T11:53:52,073 copying build/lib/unitxt/catalog/cards/global_mmlu/ar/abstract_algebra.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/ar 2026-05-27T11:53:52,075 copying build/lib/unitxt/catalog/cards/global_mmlu/ar/moral_scenarios.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/ar 2026-05-27T11:53:52,078 copying build/lib/unitxt/catalog/cards/global_mmlu/ar/world_religions.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/ar 2026-05-27T11:53:52,080 copying build/lib/unitxt/catalog/cards/global_mmlu/ar/business_ethics.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/ar 2026-05-27T11:53:52,083 copying build/lib/unitxt/catalog/cards/global_mmlu/ar/security_studies.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/ar 2026-05-27T11:53:52,085 copying build/lib/unitxt/catalog/cards/global_mmlu/ar/college_medicine.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/ar 2026-05-27T11:53:52,088 copying build/lib/unitxt/catalog/cards/global_mmlu/ar/human_sexuality.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/ar 2026-05-27T11:53:52,090 copying build/lib/unitxt/catalog/cards/global_mmlu/ar/prehistory.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/ar 2026-05-27T11:53:52,094 creating build/bdist.linux-armv7l/wheel/unitxt/catalog/cards/global_mmlu/ha 2026-05-27T11:53:52,096 copying build/lib/unitxt/catalog/cards/global_mmlu/ha/moral_disputes.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/ha 2026-05-27T11:53:52,098 copying build/lib/unitxt/catalog/cards/global_mmlu/ha/high_school_biology.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/ha 2026-05-27T11:53:52,101 copying build/lib/unitxt/catalog/cards/global_mmlu/ha/jurisprudence.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/ha 2026-05-27T11:53:52,103 copying build/lib/unitxt/catalog/cards/global_mmlu/ha/logical_fallacies.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/ha 2026-05-27T11:53:52,106 copying build/lib/unitxt/catalog/cards/global_mmlu/ha/college_chemistry.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/ha 2026-05-27T11:53:52,108 copying build/lib/unitxt/catalog/cards/global_mmlu/ha/high_school_government_and_politics.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/ha 2026-05-27T11:53:52,111 copying build/lib/unitxt/catalog/cards/global_mmlu/ha/college_mathematics.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/ha 2026-05-27T11:53:52,113 copying build/lib/unitxt/catalog/cards/global_mmlu/ha/econometrics.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/ha 2026-05-27T11:53:52,115 copying build/lib/unitxt/catalog/cards/global_mmlu/ha/high_school_macroeconomics.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/ha 2026-05-27T11:53:52,118 copying build/lib/unitxt/catalog/cards/global_mmlu/ha/high_school_psychology.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/ha 2026-05-27T11:53:52,120 copying build/lib/unitxt/catalog/cards/global_mmlu/ha/computer_security.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/ha 2026-05-27T11:53:52,122 copying build/lib/unitxt/catalog/cards/global_mmlu/ha/sociology.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/ha 2026-05-27T11:53:52,124 copying build/lib/unitxt/catalog/cards/global_mmlu/ha/nutrition.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/ha 2026-05-27T11:53:52,127 copying build/lib/unitxt/catalog/cards/global_mmlu/ha/professional_medicine.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/ha 2026-05-27T11:53:52,130 copying build/lib/unitxt/catalog/cards/global_mmlu/ha/college_biology.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/ha 2026-05-27T11:53:52,133 copying build/lib/unitxt/catalog/cards/global_mmlu/ha/anatomy.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/ha 2026-05-27T11:53:52,136 copying build/lib/unitxt/catalog/cards/global_mmlu/ha/professional_law.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/ha 2026-05-27T11:53:52,138 copying build/lib/unitxt/catalog/cards/global_mmlu/ha/machine_learning.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/ha 2026-05-27T11:53:52,141 copying build/lib/unitxt/catalog/cards/global_mmlu/ha/international_law.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/ha 2026-05-27T11:53:52,143 copying build/lib/unitxt/catalog/cards/global_mmlu/ha/medical_genetics.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/ha 2026-05-27T11:53:52,145 copying build/lib/unitxt/catalog/cards/global_mmlu/ha/high_school_computer_science.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/ha 2026-05-27T11:53:52,148 copying build/lib/unitxt/catalog/cards/global_mmlu/ha/clinical_knowledge.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/ha 2026-05-27T11:53:52,150 copying build/lib/unitxt/catalog/cards/global_mmlu/ha/college_physics.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/ha 2026-05-27T11:53:52,153 copying build/lib/unitxt/catalog/cards/global_mmlu/ha/global_facts.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/ha 2026-05-27T11:53:52,155 copying build/lib/unitxt/catalog/cards/global_mmlu/ha/college_computer_science.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/ha 2026-05-27T11:53:52,158 copying build/lib/unitxt/catalog/cards/global_mmlu/ha/us_foreign_policy.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/ha 2026-05-27T11:53:52,160 copying build/lib/unitxt/catalog/cards/global_mmlu/ha/professional_accounting.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/ha 2026-05-27T11:53:52,162 copying build/lib/unitxt/catalog/cards/global_mmlu/ha/professional_psychology.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/ha 2026-05-27T11:53:52,165 copying build/lib/unitxt/catalog/cards/global_mmlu/ha/philosophy.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/ha 2026-05-27T11:53:52,167 copying build/lib/unitxt/catalog/cards/global_mmlu/ha/elementary_mathematics.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/ha 2026-05-27T11:53:52,169 copying build/lib/unitxt/catalog/cards/global_mmlu/ha/conceptual_physics.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/ha 2026-05-27T11:53:52,172 copying build/lib/unitxt/catalog/cards/global_mmlu/ha/high_school_geography.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/ha 2026-05-27T11:53:52,174 copying build/lib/unitxt/catalog/cards/global_mmlu/ha/human_aging.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/ha 2026-05-27T11:53:52,176 copying build/lib/unitxt/catalog/cards/global_mmlu/ha/electrical_engineering.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/ha 2026-05-27T11:53:52,179 copying build/lib/unitxt/catalog/cards/global_mmlu/ha/management.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/ha 2026-05-27T11:53:52,181 copying build/lib/unitxt/catalog/cards/global_mmlu/ha/high_school_world_history.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/ha 2026-05-27T11:53:52,184 copying build/lib/unitxt/catalog/cards/global_mmlu/ha/marketing.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/ha 2026-05-27T11:53:52,186 copying build/lib/unitxt/catalog/cards/global_mmlu/ha/high_school_european_history.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/ha 2026-05-27T11:53:52,189 copying build/lib/unitxt/catalog/cards/global_mmlu/ha/astronomy.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/ha 2026-05-27T11:53:52,191 copying build/lib/unitxt/catalog/cards/global_mmlu/ha/high_school_physics.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/ha 2026-05-27T11:53:52,194 copying build/lib/unitxt/catalog/cards/global_mmlu/ha/public_relations.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/ha 2026-05-27T11:53:52,196 copying build/lib/unitxt/catalog/cards/global_mmlu/ha/high_school_microeconomics.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/ha 2026-05-27T11:53:52,198 copying build/lib/unitxt/catalog/cards/global_mmlu/ha/virology.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/ha 2026-05-27T11:53:52,201 copying build/lib/unitxt/catalog/cards/global_mmlu/ha/high_school_us_history.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/ha 2026-05-27T11:53:52,203 copying build/lib/unitxt/catalog/cards/global_mmlu/ha/high_school_statistics.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/ha 2026-05-27T11:53:52,206 copying build/lib/unitxt/catalog/cards/global_mmlu/ha/miscellaneous.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/ha 2026-05-27T11:53:52,209 copying build/lib/unitxt/catalog/cards/global_mmlu/ha/high_school_mathematics.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/ha 2026-05-27T11:53:52,212 copying build/lib/unitxt/catalog/cards/global_mmlu/ha/formal_logic.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/ha 2026-05-27T11:53:52,215 copying build/lib/unitxt/catalog/cards/global_mmlu/ha/high_school_chemistry.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/ha 2026-05-27T11:53:52,218 copying build/lib/unitxt/catalog/cards/global_mmlu/ha/abstract_algebra.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/ha 2026-05-27T11:53:52,220 copying build/lib/unitxt/catalog/cards/global_mmlu/ha/moral_scenarios.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/ha 2026-05-27T11:53:52,222 copying build/lib/unitxt/catalog/cards/global_mmlu/ha/world_religions.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/ha 2026-05-27T11:53:52,225 copying build/lib/unitxt/catalog/cards/global_mmlu/ha/business_ethics.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/ha 2026-05-27T11:53:52,227 copying build/lib/unitxt/catalog/cards/global_mmlu/ha/security_studies.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/ha 2026-05-27T11:53:52,229 copying build/lib/unitxt/catalog/cards/global_mmlu/ha/college_medicine.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/ha 2026-05-27T11:53:52,232 copying build/lib/unitxt/catalog/cards/global_mmlu/ha/human_sexuality.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/ha 2026-05-27T11:53:52,234 copying build/lib/unitxt/catalog/cards/global_mmlu/ha/prehistory.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/ha 2026-05-27T11:53:52,239 creating build/bdist.linux-armv7l/wheel/unitxt/catalog/cards/global_mmlu/es 2026-05-27T11:53:52,240 copying build/lib/unitxt/catalog/cards/global_mmlu/es/moral_disputes.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/es 2026-05-27T11:53:52,243 copying build/lib/unitxt/catalog/cards/global_mmlu/es/high_school_biology.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/es 2026-05-27T11:53:52,245 copying build/lib/unitxt/catalog/cards/global_mmlu/es/jurisprudence.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/es 2026-05-27T11:53:52,248 copying build/lib/unitxt/catalog/cards/global_mmlu/es/logical_fallacies.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/es 2026-05-27T11:53:52,250 copying build/lib/unitxt/catalog/cards/global_mmlu/es/college_chemistry.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/es 2026-05-27T11:53:52,252 copying build/lib/unitxt/catalog/cards/global_mmlu/es/high_school_government_and_politics.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/es 2026-05-27T11:53:52,255 copying build/lib/unitxt/catalog/cards/global_mmlu/es/college_mathematics.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/es 2026-05-27T11:53:52,257 copying build/lib/unitxt/catalog/cards/global_mmlu/es/econometrics.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/es 2026-05-27T11:53:52,260 copying build/lib/unitxt/catalog/cards/global_mmlu/es/high_school_macroeconomics.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/es 2026-05-27T11:53:52,262 copying build/lib/unitxt/catalog/cards/global_mmlu/es/high_school_psychology.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/es 2026-05-27T11:53:52,265 copying build/lib/unitxt/catalog/cards/global_mmlu/es/computer_security.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/es 2026-05-27T11:53:52,267 copying build/lib/unitxt/catalog/cards/global_mmlu/es/sociology.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/es 2026-05-27T11:53:52,269 copying build/lib/unitxt/catalog/cards/global_mmlu/es/nutrition.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/es 2026-05-27T11:53:52,272 copying build/lib/unitxt/catalog/cards/global_mmlu/es/professional_medicine.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/es 2026-05-27T11:53:52,274 copying build/lib/unitxt/catalog/cards/global_mmlu/es/college_biology.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/es 2026-05-27T11:53:52,277 copying build/lib/unitxt/catalog/cards/global_mmlu/es/anatomy.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/es 2026-05-27T11:53:52,280 copying build/lib/unitxt/catalog/cards/global_mmlu/es/professional_law.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/es 2026-05-27T11:53:52,282 copying build/lib/unitxt/catalog/cards/global_mmlu/es/machine_learning.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/es 2026-05-27T11:53:52,284 copying build/lib/unitxt/catalog/cards/global_mmlu/es/international_law.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/es 2026-05-27T11:53:52,287 copying build/lib/unitxt/catalog/cards/global_mmlu/es/medical_genetics.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/es 2026-05-27T11:53:52,289 copying build/lib/unitxt/catalog/cards/global_mmlu/es/high_school_computer_science.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/es 2026-05-27T11:53:52,291 copying build/lib/unitxt/catalog/cards/global_mmlu/es/clinical_knowledge.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/es 2026-05-27T11:53:52,294 copying build/lib/unitxt/catalog/cards/global_mmlu/es/college_physics.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/es 2026-05-27T11:53:52,297 copying build/lib/unitxt/catalog/cards/global_mmlu/es/global_facts.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/es 2026-05-27T11:53:52,300 copying build/lib/unitxt/catalog/cards/global_mmlu/es/college_computer_science.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/es 2026-05-27T11:53:52,303 copying build/lib/unitxt/catalog/cards/global_mmlu/es/us_foreign_policy.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/es 2026-05-27T11:53:52,305 copying build/lib/unitxt/catalog/cards/global_mmlu/es/professional_accounting.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/es 2026-05-27T11:53:52,308 copying build/lib/unitxt/catalog/cards/global_mmlu/es/professional_psychology.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/es 2026-05-27T11:53:52,310 copying build/lib/unitxt/catalog/cards/global_mmlu/es/philosophy.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/es 2026-05-27T11:53:52,313 copying build/lib/unitxt/catalog/cards/global_mmlu/es/elementary_mathematics.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/es 2026-05-27T11:53:52,315 copying build/lib/unitxt/catalog/cards/global_mmlu/es/conceptual_physics.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/es 2026-05-27T11:53:52,318 copying build/lib/unitxt/catalog/cards/global_mmlu/es/high_school_geography.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/es 2026-05-27T11:53:52,321 copying build/lib/unitxt/catalog/cards/global_mmlu/es/human_aging.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/es 2026-05-27T11:53:52,323 copying build/lib/unitxt/catalog/cards/global_mmlu/es/electrical_engineering.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/es 2026-05-27T11:53:52,326 copying build/lib/unitxt/catalog/cards/global_mmlu/es/management.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/es 2026-05-27T11:53:52,328 copying build/lib/unitxt/catalog/cards/global_mmlu/es/high_school_world_history.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/es 2026-05-27T11:53:52,331 copying build/lib/unitxt/catalog/cards/global_mmlu/es/marketing.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/es 2026-05-27T11:53:52,333 copying build/lib/unitxt/catalog/cards/global_mmlu/es/high_school_european_history.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/es 2026-05-27T11:53:52,336 copying build/lib/unitxt/catalog/cards/global_mmlu/es/astronomy.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/es 2026-05-27T11:53:52,338 copying build/lib/unitxt/catalog/cards/global_mmlu/es/high_school_physics.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/es 2026-05-27T11:53:52,341 copying build/lib/unitxt/catalog/cards/global_mmlu/es/public_relations.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/es 2026-05-27T11:53:52,343 copying build/lib/unitxt/catalog/cards/global_mmlu/es/high_school_microeconomics.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/es 2026-05-27T11:53:52,346 copying build/lib/unitxt/catalog/cards/global_mmlu/es/virology.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/es 2026-05-27T11:53:52,348 copying build/lib/unitxt/catalog/cards/global_mmlu/es/high_school_us_history.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/es 2026-05-27T11:53:52,350 copying build/lib/unitxt/catalog/cards/global_mmlu/es/high_school_statistics.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/es 2026-05-27T11:53:52,353 copying build/lib/unitxt/catalog/cards/global_mmlu/es/miscellaneous.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/es 2026-05-27T11:53:52,355 copying build/lib/unitxt/catalog/cards/global_mmlu/es/high_school_mathematics.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/es 2026-05-27T11:53:52,358 copying build/lib/unitxt/catalog/cards/global_mmlu/es/formal_logic.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/es 2026-05-27T11:53:52,360 copying build/lib/unitxt/catalog/cards/global_mmlu/es/high_school_chemistry.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/es 2026-05-27T11:53:52,362 copying build/lib/unitxt/catalog/cards/global_mmlu/es/abstract_algebra.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/es 2026-05-27T11:53:52,364 copying build/lib/unitxt/catalog/cards/global_mmlu/es/moral_scenarios.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/es 2026-05-27T11:53:52,367 copying build/lib/unitxt/catalog/cards/global_mmlu/es/world_religions.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/es 2026-05-27T11:53:52,370 copying build/lib/unitxt/catalog/cards/global_mmlu/es/business_ethics.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/es 2026-05-27T11:53:52,372 copying build/lib/unitxt/catalog/cards/global_mmlu/es/security_studies.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/es 2026-05-27T11:53:52,375 copying build/lib/unitxt/catalog/cards/global_mmlu/es/college_medicine.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/es 2026-05-27T11:53:52,377 copying build/lib/unitxt/catalog/cards/global_mmlu/es/human_sexuality.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/es 2026-05-27T11:53:52,380 copying build/lib/unitxt/catalog/cards/global_mmlu/es/prehistory.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/es 2026-05-27T11:53:52,385 creating build/bdist.linux-armv7l/wheel/unitxt/catalog/cards/global_mmlu/fa 2026-05-27T11:53:52,386 copying build/lib/unitxt/catalog/cards/global_mmlu/fa/moral_disputes.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/fa 2026-05-27T11:53:52,389 copying build/lib/unitxt/catalog/cards/global_mmlu/fa/high_school_biology.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/fa 2026-05-27T11:53:52,391 copying build/lib/unitxt/catalog/cards/global_mmlu/fa/jurisprudence.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/fa 2026-05-27T11:53:52,394 copying build/lib/unitxt/catalog/cards/global_mmlu/fa/logical_fallacies.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/fa 2026-05-27T11:53:52,396 copying build/lib/unitxt/catalog/cards/global_mmlu/fa/college_chemistry.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/fa 2026-05-27T11:53:52,399 copying build/lib/unitxt/catalog/cards/global_mmlu/fa/high_school_government_and_politics.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/fa 2026-05-27T11:53:52,401 copying build/lib/unitxt/catalog/cards/global_mmlu/fa/college_mathematics.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/fa 2026-05-27T11:53:52,403 copying build/lib/unitxt/catalog/cards/global_mmlu/fa/econometrics.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/fa 2026-05-27T11:53:52,406 copying build/lib/unitxt/catalog/cards/global_mmlu/fa/high_school_macroeconomics.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/fa 2026-05-27T11:53:52,408 copying build/lib/unitxt/catalog/cards/global_mmlu/fa/high_school_psychology.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/fa 2026-05-27T11:53:52,411 copying build/lib/unitxt/catalog/cards/global_mmlu/fa/computer_security.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/fa 2026-05-27T11:53:52,413 copying build/lib/unitxt/catalog/cards/global_mmlu/fa/sociology.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/fa 2026-05-27T11:53:52,415 copying build/lib/unitxt/catalog/cards/global_mmlu/fa/nutrition.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/fa 2026-05-27T11:53:52,418 copying build/lib/unitxt/catalog/cards/global_mmlu/fa/professional_medicine.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/fa 2026-05-27T11:53:52,420 copying build/lib/unitxt/catalog/cards/global_mmlu/fa/college_biology.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/fa 2026-05-27T11:53:52,423 copying build/lib/unitxt/catalog/cards/global_mmlu/fa/anatomy.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/fa 2026-05-27T11:53:52,425 copying build/lib/unitxt/catalog/cards/global_mmlu/fa/professional_law.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/fa 2026-05-27T11:53:52,427 copying build/lib/unitxt/catalog/cards/global_mmlu/fa/machine_learning.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/fa 2026-05-27T11:53:52,430 copying build/lib/unitxt/catalog/cards/global_mmlu/fa/international_law.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/fa 2026-05-27T11:53:52,432 copying build/lib/unitxt/catalog/cards/global_mmlu/fa/medical_genetics.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/fa 2026-05-27T11:53:52,435 copying build/lib/unitxt/catalog/cards/global_mmlu/fa/high_school_computer_science.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/fa 2026-05-27T11:53:52,437 copying build/lib/unitxt/catalog/cards/global_mmlu/fa/clinical_knowledge.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/fa 2026-05-27T11:53:52,440 copying build/lib/unitxt/catalog/cards/global_mmlu/fa/college_physics.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/fa 2026-05-27T11:53:52,442 copying build/lib/unitxt/catalog/cards/global_mmlu/fa/global_facts.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/fa 2026-05-27T11:53:52,445 copying build/lib/unitxt/catalog/cards/global_mmlu/fa/college_computer_science.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/fa 2026-05-27T11:53:52,447 copying build/lib/unitxt/catalog/cards/global_mmlu/fa/us_foreign_policy.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/fa 2026-05-27T11:53:52,450 copying build/lib/unitxt/catalog/cards/global_mmlu/fa/professional_accounting.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/fa 2026-05-27T11:53:52,452 copying build/lib/unitxt/catalog/cards/global_mmlu/fa/professional_psychology.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/fa 2026-05-27T11:53:52,454 copying build/lib/unitxt/catalog/cards/global_mmlu/fa/philosophy.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/fa 2026-05-27T11:53:52,457 copying build/lib/unitxt/catalog/cards/global_mmlu/fa/elementary_mathematics.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/fa 2026-05-27T11:53:52,459 copying build/lib/unitxt/catalog/cards/global_mmlu/fa/conceptual_physics.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/fa 2026-05-27T11:53:52,462 copying build/lib/unitxt/catalog/cards/global_mmlu/fa/high_school_geography.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/fa 2026-05-27T11:53:52,465 copying build/lib/unitxt/catalog/cards/global_mmlu/fa/human_aging.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/fa 2026-05-27T11:53:52,467 copying build/lib/unitxt/catalog/cards/global_mmlu/fa/electrical_engineering.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/fa 2026-05-27T11:53:52,470 copying build/lib/unitxt/catalog/cards/global_mmlu/fa/management.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/fa 2026-05-27T11:53:52,472 copying build/lib/unitxt/catalog/cards/global_mmlu/fa/high_school_world_history.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/fa 2026-05-27T11:53:52,475 copying build/lib/unitxt/catalog/cards/global_mmlu/fa/marketing.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/fa 2026-05-27T11:53:52,477 copying build/lib/unitxt/catalog/cards/global_mmlu/fa/high_school_european_history.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/fa 2026-05-27T11:53:52,479 copying build/lib/unitxt/catalog/cards/global_mmlu/fa/astronomy.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/fa 2026-05-27T11:53:52,482 copying build/lib/unitxt/catalog/cards/global_mmlu/fa/high_school_physics.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/fa 2026-05-27T11:53:52,484 copying build/lib/unitxt/catalog/cards/global_mmlu/fa/public_relations.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/fa 2026-05-27T11:53:52,487 copying build/lib/unitxt/catalog/cards/global_mmlu/fa/high_school_microeconomics.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/fa 2026-05-27T11:53:52,489 copying build/lib/unitxt/catalog/cards/global_mmlu/fa/virology.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/fa 2026-05-27T11:53:52,491 copying build/lib/unitxt/catalog/cards/global_mmlu/fa/high_school_us_history.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/fa 2026-05-27T11:53:52,494 copying build/lib/unitxt/catalog/cards/global_mmlu/fa/high_school_statistics.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/fa 2026-05-27T11:53:52,496 copying build/lib/unitxt/catalog/cards/global_mmlu/fa/miscellaneous.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/fa 2026-05-27T11:53:52,498 copying build/lib/unitxt/catalog/cards/global_mmlu/fa/high_school_mathematics.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/fa 2026-05-27T11:53:52,501 copying build/lib/unitxt/catalog/cards/global_mmlu/fa/formal_logic.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/fa 2026-05-27T11:53:52,503 copying build/lib/unitxt/catalog/cards/global_mmlu/fa/high_school_chemistry.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/fa 2026-05-27T11:53:52,506 copying build/lib/unitxt/catalog/cards/global_mmlu/fa/abstract_algebra.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/fa 2026-05-27T11:53:52,508 copying build/lib/unitxt/catalog/cards/global_mmlu/fa/moral_scenarios.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/fa 2026-05-27T11:53:52,511 copying build/lib/unitxt/catalog/cards/global_mmlu/fa/world_religions.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/fa 2026-05-27T11:53:52,513 copying build/lib/unitxt/catalog/cards/global_mmlu/fa/business_ethics.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/fa 2026-05-27T11:53:52,515 copying build/lib/unitxt/catalog/cards/global_mmlu/fa/security_studies.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/fa 2026-05-27T11:53:52,518 copying build/lib/unitxt/catalog/cards/global_mmlu/fa/college_medicine.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/fa 2026-05-27T11:53:52,520 copying build/lib/unitxt/catalog/cards/global_mmlu/fa/human_sexuality.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/fa 2026-05-27T11:53:52,522 copying build/lib/unitxt/catalog/cards/global_mmlu/fa/prehistory.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/fa 2026-05-27T11:53:52,527 creating build/bdist.linux-armv7l/wheel/unitxt/catalog/cards/global_mmlu/ru 2026-05-27T11:53:52,528 copying build/lib/unitxt/catalog/cards/global_mmlu/ru/moral_disputes.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/ru 2026-05-27T11:53:52,531 copying build/lib/unitxt/catalog/cards/global_mmlu/ru/high_school_biology.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/ru 2026-05-27T11:53:52,533 copying build/lib/unitxt/catalog/cards/global_mmlu/ru/jurisprudence.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/ru 2026-05-27T11:53:52,535 copying build/lib/unitxt/catalog/cards/global_mmlu/ru/logical_fallacies.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/ru 2026-05-27T11:53:52,538 copying build/lib/unitxt/catalog/cards/global_mmlu/ru/college_chemistry.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/ru 2026-05-27T11:53:52,540 copying build/lib/unitxt/catalog/cards/global_mmlu/ru/high_school_government_and_politics.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/ru 2026-05-27T11:53:52,543 copying build/lib/unitxt/catalog/cards/global_mmlu/ru/college_mathematics.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/ru 2026-05-27T11:53:52,545 copying build/lib/unitxt/catalog/cards/global_mmlu/ru/econometrics.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/ru 2026-05-27T11:53:52,548 copying build/lib/unitxt/catalog/cards/global_mmlu/ru/high_school_macroeconomics.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/ru 2026-05-27T11:53:52,551 copying build/lib/unitxt/catalog/cards/global_mmlu/ru/high_school_psychology.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/ru 2026-05-27T11:53:52,554 copying build/lib/unitxt/catalog/cards/global_mmlu/ru/computer_security.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/ru 2026-05-27T11:53:52,557 copying build/lib/unitxt/catalog/cards/global_mmlu/ru/sociology.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/ru 2026-05-27T11:53:52,559 copying build/lib/unitxt/catalog/cards/global_mmlu/ru/nutrition.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/ru 2026-05-27T11:53:52,562 copying build/lib/unitxt/catalog/cards/global_mmlu/ru/professional_medicine.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/ru 2026-05-27T11:53:52,564 copying build/lib/unitxt/catalog/cards/global_mmlu/ru/college_biology.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/ru 2026-05-27T11:53:52,567 copying build/lib/unitxt/catalog/cards/global_mmlu/ru/anatomy.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/ru 2026-05-27T11:53:52,570 copying build/lib/unitxt/catalog/cards/global_mmlu/ru/professional_law.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/ru 2026-05-27T11:53:52,572 copying build/lib/unitxt/catalog/cards/global_mmlu/ru/machine_learning.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/ru 2026-05-27T11:53:52,575 copying build/lib/unitxt/catalog/cards/global_mmlu/ru/international_law.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/ru 2026-05-27T11:53:52,577 copying build/lib/unitxt/catalog/cards/global_mmlu/ru/medical_genetics.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/ru 2026-05-27T11:53:52,579 copying build/lib/unitxt/catalog/cards/global_mmlu/ru/high_school_computer_science.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/ru 2026-05-27T11:53:52,582 copying build/lib/unitxt/catalog/cards/global_mmlu/ru/clinical_knowledge.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/ru 2026-05-27T11:53:52,584 copying build/lib/unitxt/catalog/cards/global_mmlu/ru/college_physics.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/ru 2026-05-27T11:53:52,586 copying build/lib/unitxt/catalog/cards/global_mmlu/ru/global_facts.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/ru 2026-05-27T11:53:52,589 copying build/lib/unitxt/catalog/cards/global_mmlu/ru/college_computer_science.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/ru 2026-05-27T11:53:52,591 copying build/lib/unitxt/catalog/cards/global_mmlu/ru/us_foreign_policy.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/ru 2026-05-27T11:53:52,593 copying build/lib/unitxt/catalog/cards/global_mmlu/ru/professional_accounting.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/ru 2026-05-27T11:53:52,596 copying build/lib/unitxt/catalog/cards/global_mmlu/ru/professional_psychology.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/ru 2026-05-27T11:53:52,599 copying build/lib/unitxt/catalog/cards/global_mmlu/ru/philosophy.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/ru 2026-05-27T11:53:52,601 copying build/lib/unitxt/catalog/cards/global_mmlu/ru/elementary_mathematics.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/ru 2026-05-27T11:53:52,603 copying build/lib/unitxt/catalog/cards/global_mmlu/ru/conceptual_physics.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/ru 2026-05-27T11:53:52,606 copying build/lib/unitxt/catalog/cards/global_mmlu/ru/high_school_geography.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/ru 2026-05-27T11:53:52,608 copying build/lib/unitxt/catalog/cards/global_mmlu/ru/human_aging.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/ru 2026-05-27T11:53:52,611 copying build/lib/unitxt/catalog/cards/global_mmlu/ru/electrical_engineering.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/ru 2026-05-27T11:53:52,613 copying build/lib/unitxt/catalog/cards/global_mmlu/ru/management.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/ru 2026-05-27T11:53:52,616 copying build/lib/unitxt/catalog/cards/global_mmlu/ru/high_school_world_history.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/ru 2026-05-27T11:53:52,619 copying build/lib/unitxt/catalog/cards/global_mmlu/ru/marketing.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/ru 2026-05-27T11:53:52,621 copying build/lib/unitxt/catalog/cards/global_mmlu/ru/high_school_european_history.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/ru 2026-05-27T11:53:52,624 copying build/lib/unitxt/catalog/cards/global_mmlu/ru/astronomy.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/ru 2026-05-27T11:53:52,626 copying build/lib/unitxt/catalog/cards/global_mmlu/ru/high_school_physics.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/ru 2026-05-27T11:53:52,629 copying build/lib/unitxt/catalog/cards/global_mmlu/ru/public_relations.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/ru 2026-05-27T11:53:52,633 copying build/lib/unitxt/catalog/cards/global_mmlu/ru/high_school_microeconomics.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/ru 2026-05-27T11:53:52,636 copying build/lib/unitxt/catalog/cards/global_mmlu/ru/virology.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/ru 2026-05-27T11:53:52,639 copying build/lib/unitxt/catalog/cards/global_mmlu/ru/high_school_us_history.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/ru 2026-05-27T11:53:52,641 copying build/lib/unitxt/catalog/cards/global_mmlu/ru/high_school_statistics.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/ru 2026-05-27T11:53:52,643 copying build/lib/unitxt/catalog/cards/global_mmlu/ru/miscellaneous.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/ru 2026-05-27T11:53:52,646 copying build/lib/unitxt/catalog/cards/global_mmlu/ru/high_school_mathematics.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/ru 2026-05-27T11:53:52,648 copying build/lib/unitxt/catalog/cards/global_mmlu/ru/formal_logic.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/ru 2026-05-27T11:53:52,651 copying build/lib/unitxt/catalog/cards/global_mmlu/ru/high_school_chemistry.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/ru 2026-05-27T11:53:52,653 copying build/lib/unitxt/catalog/cards/global_mmlu/ru/abstract_algebra.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/ru 2026-05-27T11:53:52,655 copying build/lib/unitxt/catalog/cards/global_mmlu/ru/moral_scenarios.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/ru 2026-05-27T11:53:52,658 copying build/lib/unitxt/catalog/cards/global_mmlu/ru/world_religions.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/ru 2026-05-27T11:53:52,660 copying build/lib/unitxt/catalog/cards/global_mmlu/ru/business_ethics.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/ru 2026-05-27T11:53:52,662 copying build/lib/unitxt/catalog/cards/global_mmlu/ru/security_studies.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/ru 2026-05-27T11:53:52,665 copying build/lib/unitxt/catalog/cards/global_mmlu/ru/college_medicine.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/ru 2026-05-27T11:53:52,667 copying build/lib/unitxt/catalog/cards/global_mmlu/ru/human_sexuality.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/ru 2026-05-27T11:53:52,670 copying build/lib/unitxt/catalog/cards/global_mmlu/ru/prehistory.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/ru 2026-05-27T11:53:52,674 creating build/bdist.linux-armv7l/wheel/unitxt/catalog/cards/global_mmlu/pl 2026-05-27T11:53:52,676 copying build/lib/unitxt/catalog/cards/global_mmlu/pl/moral_disputes.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/pl 2026-05-27T11:53:52,679 copying build/lib/unitxt/catalog/cards/global_mmlu/pl/high_school_biology.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/pl 2026-05-27T11:53:52,681 copying build/lib/unitxt/catalog/cards/global_mmlu/pl/jurisprudence.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/pl 2026-05-27T11:53:52,684 copying build/lib/unitxt/catalog/cards/global_mmlu/pl/logical_fallacies.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/pl 2026-05-27T11:53:52,686 copying build/lib/unitxt/catalog/cards/global_mmlu/pl/college_chemistry.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/pl 2026-05-27T11:53:52,689 copying build/lib/unitxt/catalog/cards/global_mmlu/pl/high_school_government_and_politics.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/pl 2026-05-27T11:53:52,691 copying build/lib/unitxt/catalog/cards/global_mmlu/pl/college_mathematics.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/pl 2026-05-27T11:53:52,694 copying build/lib/unitxt/catalog/cards/global_mmlu/pl/econometrics.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/pl 2026-05-27T11:53:52,696 copying build/lib/unitxt/catalog/cards/global_mmlu/pl/high_school_macroeconomics.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/pl 2026-05-27T11:53:52,699 copying build/lib/unitxt/catalog/cards/global_mmlu/pl/high_school_psychology.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/pl 2026-05-27T11:53:52,701 copying build/lib/unitxt/catalog/cards/global_mmlu/pl/computer_security.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/pl 2026-05-27T11:53:52,703 copying build/lib/unitxt/catalog/cards/global_mmlu/pl/sociology.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/pl 2026-05-27T11:53:52,706 copying build/lib/unitxt/catalog/cards/global_mmlu/pl/nutrition.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/pl 2026-05-27T11:53:52,708 copying build/lib/unitxt/catalog/cards/global_mmlu/pl/professional_medicine.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/pl 2026-05-27T11:53:52,711 copying build/lib/unitxt/catalog/cards/global_mmlu/pl/college_biology.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/pl 2026-05-27T11:53:52,714 copying build/lib/unitxt/catalog/cards/global_mmlu/pl/anatomy.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/pl 2026-05-27T11:53:52,717 copying build/lib/unitxt/catalog/cards/global_mmlu/pl/professional_law.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/pl 2026-05-27T11:53:52,720 copying build/lib/unitxt/catalog/cards/global_mmlu/pl/machine_learning.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/pl 2026-05-27T11:53:52,723 copying build/lib/unitxt/catalog/cards/global_mmlu/pl/international_law.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/pl 2026-05-27T11:53:52,725 copying build/lib/unitxt/catalog/cards/global_mmlu/pl/medical_genetics.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/pl 2026-05-27T11:53:52,728 copying build/lib/unitxt/catalog/cards/global_mmlu/pl/high_school_computer_science.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/pl 2026-05-27T11:53:52,730 copying build/lib/unitxt/catalog/cards/global_mmlu/pl/clinical_knowledge.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/pl 2026-05-27T11:53:52,732 copying build/lib/unitxt/catalog/cards/global_mmlu/pl/college_physics.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/pl 2026-05-27T11:53:52,735 copying build/lib/unitxt/catalog/cards/global_mmlu/pl/global_facts.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/pl 2026-05-27T11:53:52,737 copying build/lib/unitxt/catalog/cards/global_mmlu/pl/college_computer_science.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/pl 2026-05-27T11:53:52,740 copying build/lib/unitxt/catalog/cards/global_mmlu/pl/us_foreign_policy.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/pl 2026-05-27T11:53:52,742 copying build/lib/unitxt/catalog/cards/global_mmlu/pl/professional_accounting.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/pl 2026-05-27T11:53:52,745 copying build/lib/unitxt/catalog/cards/global_mmlu/pl/professional_psychology.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/pl 2026-05-27T11:53:52,747 copying build/lib/unitxt/catalog/cards/global_mmlu/pl/philosophy.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/pl 2026-05-27T11:53:52,750 copying build/lib/unitxt/catalog/cards/global_mmlu/pl/elementary_mathematics.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/pl 2026-05-27T11:53:52,752 copying build/lib/unitxt/catalog/cards/global_mmlu/pl/conceptual_physics.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/pl 2026-05-27T11:53:52,755 copying build/lib/unitxt/catalog/cards/global_mmlu/pl/high_school_geography.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/pl 2026-05-27T11:53:52,757 copying build/lib/unitxt/catalog/cards/global_mmlu/pl/human_aging.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/pl 2026-05-27T11:53:52,759 copying build/lib/unitxt/catalog/cards/global_mmlu/pl/electrical_engineering.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/pl 2026-05-27T11:53:52,761 copying build/lib/unitxt/catalog/cards/global_mmlu/pl/management.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/pl 2026-05-27T11:53:52,763 copying build/lib/unitxt/catalog/cards/global_mmlu/pl/high_school_world_history.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/pl 2026-05-27T11:53:52,764 copying build/lib/unitxt/catalog/cards/global_mmlu/pl/marketing.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/pl 2026-05-27T11:53:52,766 copying build/lib/unitxt/catalog/cards/global_mmlu/pl/high_school_european_history.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/pl 2026-05-27T11:53:52,768 copying build/lib/unitxt/catalog/cards/global_mmlu/pl/astronomy.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/pl 2026-05-27T11:53:52,770 copying build/lib/unitxt/catalog/cards/global_mmlu/pl/high_school_physics.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/pl 2026-05-27T11:53:52,772 copying build/lib/unitxt/catalog/cards/global_mmlu/pl/public_relations.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/pl 2026-05-27T11:53:52,774 copying build/lib/unitxt/catalog/cards/global_mmlu/pl/high_school_microeconomics.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/pl 2026-05-27T11:53:52,776 copying build/lib/unitxt/catalog/cards/global_mmlu/pl/virology.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/pl 2026-05-27T11:53:52,779 copying build/lib/unitxt/catalog/cards/global_mmlu/pl/high_school_us_history.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/pl 2026-05-27T11:53:52,780 copying build/lib/unitxt/catalog/cards/global_mmlu/pl/high_school_statistics.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/pl 2026-05-27T11:53:52,782 copying build/lib/unitxt/catalog/cards/global_mmlu/pl/miscellaneous.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/pl 2026-05-27T11:53:52,784 copying build/lib/unitxt/catalog/cards/global_mmlu/pl/high_school_mathematics.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/pl 2026-05-27T11:53:52,786 copying build/lib/unitxt/catalog/cards/global_mmlu/pl/formal_logic.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/pl 2026-05-27T11:53:52,788 copying build/lib/unitxt/catalog/cards/global_mmlu/pl/high_school_chemistry.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/pl 2026-05-27T11:53:52,790 copying build/lib/unitxt/catalog/cards/global_mmlu/pl/abstract_algebra.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/pl 2026-05-27T11:53:52,793 copying build/lib/unitxt/catalog/cards/global_mmlu/pl/moral_scenarios.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/pl 2026-05-27T11:53:52,795 copying build/lib/unitxt/catalog/cards/global_mmlu/pl/world_religions.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/pl 2026-05-27T11:53:52,797 copying build/lib/unitxt/catalog/cards/global_mmlu/pl/business_ethics.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/pl 2026-05-27T11:53:52,799 copying build/lib/unitxt/catalog/cards/global_mmlu/pl/security_studies.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/pl 2026-05-27T11:53:52,802 copying build/lib/unitxt/catalog/cards/global_mmlu/pl/college_medicine.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/pl 2026-05-27T11:53:52,804 copying build/lib/unitxt/catalog/cards/global_mmlu/pl/human_sexuality.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/pl 2026-05-27T11:53:52,806 copying build/lib/unitxt/catalog/cards/global_mmlu/pl/prehistory.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/pl 2026-05-27T11:53:52,810 creating build/bdist.linux-armv7l/wheel/unitxt/catalog/cards/global_mmlu/am 2026-05-27T11:53:52,811 copying build/lib/unitxt/catalog/cards/global_mmlu/am/moral_disputes.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/am 2026-05-27T11:53:52,813 copying build/lib/unitxt/catalog/cards/global_mmlu/am/high_school_biology.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/am 2026-05-27T11:53:52,815 copying build/lib/unitxt/catalog/cards/global_mmlu/am/jurisprudence.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/am 2026-05-27T11:53:52,816 copying build/lib/unitxt/catalog/cards/global_mmlu/am/logical_fallacies.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/am 2026-05-27T11:53:52,818 copying build/lib/unitxt/catalog/cards/global_mmlu/am/college_chemistry.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/am 2026-05-27T11:53:52,820 copying build/lib/unitxt/catalog/cards/global_mmlu/am/high_school_government_and_politics.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/am 2026-05-27T11:53:52,822 copying build/lib/unitxt/catalog/cards/global_mmlu/am/college_mathematics.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/am 2026-05-27T11:53:52,824 copying build/lib/unitxt/catalog/cards/global_mmlu/am/econometrics.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/am 2026-05-27T11:53:52,826 copying build/lib/unitxt/catalog/cards/global_mmlu/am/high_school_macroeconomics.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/am 2026-05-27T11:53:52,828 copying build/lib/unitxt/catalog/cards/global_mmlu/am/high_school_psychology.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/am 2026-05-27T11:53:52,830 copying build/lib/unitxt/catalog/cards/global_mmlu/am/computer_security.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/am 2026-05-27T11:53:52,832 copying build/lib/unitxt/catalog/cards/global_mmlu/am/sociology.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/am 2026-05-27T11:53:52,834 copying build/lib/unitxt/catalog/cards/global_mmlu/am/nutrition.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/am 2026-05-27T11:53:52,836 copying build/lib/unitxt/catalog/cards/global_mmlu/am/professional_medicine.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/am 2026-05-27T11:53:52,838 copying build/lib/unitxt/catalog/cards/global_mmlu/am/college_biology.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/am 2026-05-27T11:53:52,840 copying build/lib/unitxt/catalog/cards/global_mmlu/am/anatomy.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/am 2026-05-27T11:53:52,842 copying build/lib/unitxt/catalog/cards/global_mmlu/am/professional_law.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/am 2026-05-27T11:53:52,844 copying build/lib/unitxt/catalog/cards/global_mmlu/am/machine_learning.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/am 2026-05-27T11:53:52,846 copying build/lib/unitxt/catalog/cards/global_mmlu/am/international_law.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/am 2026-05-27T11:53:52,848 copying build/lib/unitxt/catalog/cards/global_mmlu/am/medical_genetics.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/am 2026-05-27T11:53:52,850 copying build/lib/unitxt/catalog/cards/global_mmlu/am/high_school_computer_science.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/am 2026-05-27T11:53:52,852 copying build/lib/unitxt/catalog/cards/global_mmlu/am/clinical_knowledge.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/am 2026-05-27T11:53:52,854 copying build/lib/unitxt/catalog/cards/global_mmlu/am/college_physics.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/am 2026-05-27T11:53:52,856 copying build/lib/unitxt/catalog/cards/global_mmlu/am/global_facts.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/am 2026-05-27T11:53:52,859 copying build/lib/unitxt/catalog/cards/global_mmlu/am/college_computer_science.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/am 2026-05-27T11:53:52,861 copying build/lib/unitxt/catalog/cards/global_mmlu/am/us_foreign_policy.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/am 2026-05-27T11:53:52,863 copying build/lib/unitxt/catalog/cards/global_mmlu/am/professional_accounting.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/am 2026-05-27T11:53:52,865 copying build/lib/unitxt/catalog/cards/global_mmlu/am/professional_psychology.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/am 2026-05-27T11:53:52,867 copying build/lib/unitxt/catalog/cards/global_mmlu/am/philosophy.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/am 2026-05-27T11:53:52,869 copying build/lib/unitxt/catalog/cards/global_mmlu/am/elementary_mathematics.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/am 2026-05-27T11:53:52,871 copying build/lib/unitxt/catalog/cards/global_mmlu/am/conceptual_physics.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/am 2026-05-27T11:53:52,873 copying build/lib/unitxt/catalog/cards/global_mmlu/am/high_school_geography.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/am 2026-05-27T11:53:52,875 copying build/lib/unitxt/catalog/cards/global_mmlu/am/human_aging.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/am 2026-05-27T11:53:52,877 copying build/lib/unitxt/catalog/cards/global_mmlu/am/electrical_engineering.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/am 2026-05-27T11:53:52,879 copying build/lib/unitxt/catalog/cards/global_mmlu/am/management.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/am 2026-05-27T11:53:52,880 copying build/lib/unitxt/catalog/cards/global_mmlu/am/high_school_world_history.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/am 2026-05-27T11:53:52,882 copying build/lib/unitxt/catalog/cards/global_mmlu/am/marketing.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/am 2026-05-27T11:53:52,884 copying build/lib/unitxt/catalog/cards/global_mmlu/am/high_school_european_history.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/am 2026-05-27T11:53:52,886 copying build/lib/unitxt/catalog/cards/global_mmlu/am/astronomy.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/am 2026-05-27T11:53:52,888 copying build/lib/unitxt/catalog/cards/global_mmlu/am/high_school_physics.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/am 2026-05-27T11:53:52,890 copying build/lib/unitxt/catalog/cards/global_mmlu/am/public_relations.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/am 2026-05-27T11:53:52,892 copying build/lib/unitxt/catalog/cards/global_mmlu/am/high_school_microeconomics.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/am 2026-05-27T11:53:52,895 copying build/lib/unitxt/catalog/cards/global_mmlu/am/virology.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/am 2026-05-27T11:53:52,897 copying build/lib/unitxt/catalog/cards/global_mmlu/am/high_school_us_history.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/am 2026-05-27T11:53:52,900 copying build/lib/unitxt/catalog/cards/global_mmlu/am/high_school_statistics.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/am 2026-05-27T11:53:52,902 copying build/lib/unitxt/catalog/cards/global_mmlu/am/miscellaneous.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/am 2026-05-27T11:53:52,904 copying build/lib/unitxt/catalog/cards/global_mmlu/am/high_school_mathematics.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/am 2026-05-27T11:53:52,906 copying build/lib/unitxt/catalog/cards/global_mmlu/am/formal_logic.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/am 2026-05-27T11:53:52,908 copying build/lib/unitxt/catalog/cards/global_mmlu/am/high_school_chemistry.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/am 2026-05-27T11:53:52,910 copying build/lib/unitxt/catalog/cards/global_mmlu/am/abstract_algebra.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/am 2026-05-27T11:53:52,912 copying build/lib/unitxt/catalog/cards/global_mmlu/am/moral_scenarios.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/am 2026-05-27T11:53:52,914 copying build/lib/unitxt/catalog/cards/global_mmlu/am/world_religions.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/am 2026-05-27T11:53:52,915 copying build/lib/unitxt/catalog/cards/global_mmlu/am/business_ethics.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/am 2026-05-27T11:53:52,917 copying build/lib/unitxt/catalog/cards/global_mmlu/am/security_studies.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/am 2026-05-27T11:53:52,919 copying build/lib/unitxt/catalog/cards/global_mmlu/am/college_medicine.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/am 2026-05-27T11:53:52,921 copying build/lib/unitxt/catalog/cards/global_mmlu/am/human_sexuality.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/am 2026-05-27T11:53:52,923 copying build/lib/unitxt/catalog/cards/global_mmlu/am/prehistory.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/am 2026-05-27T11:53:52,926 creating build/bdist.linux-armv7l/wheel/unitxt/catalog/cards/global_mmlu/uk 2026-05-27T11:53:52,928 copying build/lib/unitxt/catalog/cards/global_mmlu/uk/moral_disputes.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/uk 2026-05-27T11:53:52,930 copying build/lib/unitxt/catalog/cards/global_mmlu/uk/high_school_biology.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/uk 2026-05-27T11:53:52,932 copying build/lib/unitxt/catalog/cards/global_mmlu/uk/jurisprudence.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/uk 2026-05-27T11:53:52,934 copying build/lib/unitxt/catalog/cards/global_mmlu/uk/logical_fallacies.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/uk 2026-05-27T11:53:52,936 copying build/lib/unitxt/catalog/cards/global_mmlu/uk/college_chemistry.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/uk 2026-05-27T11:53:52,937 copying build/lib/unitxt/catalog/cards/global_mmlu/uk/high_school_government_and_politics.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/uk 2026-05-27T11:53:52,939 copying build/lib/unitxt/catalog/cards/global_mmlu/uk/college_mathematics.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/uk 2026-05-27T11:53:52,942 copying build/lib/unitxt/catalog/cards/global_mmlu/uk/econometrics.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/uk 2026-05-27T11:53:52,943 copying build/lib/unitxt/catalog/cards/global_mmlu/uk/high_school_macroeconomics.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/uk 2026-05-27T11:53:52,945 copying build/lib/unitxt/catalog/cards/global_mmlu/uk/high_school_psychology.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/uk 2026-05-27T11:53:52,947 copying build/lib/unitxt/catalog/cards/global_mmlu/uk/computer_security.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/uk 2026-05-27T11:53:52,949 copying build/lib/unitxt/catalog/cards/global_mmlu/uk/sociology.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/uk 2026-05-27T11:53:52,951 copying build/lib/unitxt/catalog/cards/global_mmlu/uk/nutrition.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/uk 2026-05-27T11:53:52,953 copying build/lib/unitxt/catalog/cards/global_mmlu/uk/professional_medicine.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/uk 2026-05-27T11:53:52,955 copying build/lib/unitxt/catalog/cards/global_mmlu/uk/college_biology.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/uk 2026-05-27T11:53:52,956 copying build/lib/unitxt/catalog/cards/global_mmlu/uk/anatomy.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/uk 2026-05-27T11:53:52,958 copying build/lib/unitxt/catalog/cards/global_mmlu/uk/professional_law.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/uk 2026-05-27T11:53:52,960 copying build/lib/unitxt/catalog/cards/global_mmlu/uk/machine_learning.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/uk 2026-05-27T11:53:52,962 copying build/lib/unitxt/catalog/cards/global_mmlu/uk/international_law.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/uk 2026-05-27T11:53:52,964 copying build/lib/unitxt/catalog/cards/global_mmlu/uk/medical_genetics.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/uk 2026-05-27T11:53:52,966 copying build/lib/unitxt/catalog/cards/global_mmlu/uk/high_school_computer_science.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/uk 2026-05-27T11:53:52,968 copying build/lib/unitxt/catalog/cards/global_mmlu/uk/clinical_knowledge.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/uk 2026-05-27T11:53:52,970 copying build/lib/unitxt/catalog/cards/global_mmlu/uk/college_physics.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/uk 2026-05-27T11:53:52,972 copying build/lib/unitxt/catalog/cards/global_mmlu/uk/global_facts.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/uk 2026-05-27T11:53:52,974 copying build/lib/unitxt/catalog/cards/global_mmlu/uk/college_computer_science.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/uk 2026-05-27T11:53:52,976 copying build/lib/unitxt/catalog/cards/global_mmlu/uk/us_foreign_policy.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/uk 2026-05-27T11:53:52,978 copying build/lib/unitxt/catalog/cards/global_mmlu/uk/professional_accounting.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/uk 2026-05-27T11:53:52,980 copying build/lib/unitxt/catalog/cards/global_mmlu/uk/professional_psychology.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/uk 2026-05-27T11:53:52,983 copying build/lib/unitxt/catalog/cards/global_mmlu/uk/philosophy.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/uk 2026-05-27T11:53:52,985 copying build/lib/unitxt/catalog/cards/global_mmlu/uk/elementary_mathematics.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/uk 2026-05-27T11:53:52,988 copying build/lib/unitxt/catalog/cards/global_mmlu/uk/conceptual_physics.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/uk 2026-05-27T11:53:52,990 copying build/lib/unitxt/catalog/cards/global_mmlu/uk/high_school_geography.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/uk 2026-05-27T11:53:52,992 copying build/lib/unitxt/catalog/cards/global_mmlu/uk/human_aging.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/uk 2026-05-27T11:53:52,994 copying build/lib/unitxt/catalog/cards/global_mmlu/uk/electrical_engineering.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/uk 2026-05-27T11:53:52,996 copying build/lib/unitxt/catalog/cards/global_mmlu/uk/management.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/uk 2026-05-27T11:53:52,997 copying build/lib/unitxt/catalog/cards/global_mmlu/uk/high_school_world_history.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/uk 2026-05-27T11:53:52,999 copying build/lib/unitxt/catalog/cards/global_mmlu/uk/marketing.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/uk 2026-05-27T11:53:53,001 copying build/lib/unitxt/catalog/cards/global_mmlu/uk/high_school_european_history.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/uk 2026-05-27T11:53:53,003 copying build/lib/unitxt/catalog/cards/global_mmlu/uk/astronomy.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/uk 2026-05-27T11:53:53,005 copying build/lib/unitxt/catalog/cards/global_mmlu/uk/high_school_physics.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/uk 2026-05-27T11:53:53,007 copying build/lib/unitxt/catalog/cards/global_mmlu/uk/public_relations.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/uk 2026-05-27T11:53:53,009 copying build/lib/unitxt/catalog/cards/global_mmlu/uk/high_school_microeconomics.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/uk 2026-05-27T11:53:53,012 copying build/lib/unitxt/catalog/cards/global_mmlu/uk/virology.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/uk 2026-05-27T11:53:53,014 copying build/lib/unitxt/catalog/cards/global_mmlu/uk/high_school_us_history.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/uk 2026-05-27T11:53:53,017 copying build/lib/unitxt/catalog/cards/global_mmlu/uk/high_school_statistics.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/uk 2026-05-27T11:53:53,019 copying build/lib/unitxt/catalog/cards/global_mmlu/uk/miscellaneous.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/uk 2026-05-27T11:53:53,021 copying build/lib/unitxt/catalog/cards/global_mmlu/uk/high_school_mathematics.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/uk 2026-05-27T11:53:53,023 copying build/lib/unitxt/catalog/cards/global_mmlu/uk/formal_logic.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/uk 2026-05-27T11:53:53,025 copying build/lib/unitxt/catalog/cards/global_mmlu/uk/high_school_chemistry.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/uk 2026-05-27T11:53:53,028 copying build/lib/unitxt/catalog/cards/global_mmlu/uk/abstract_algebra.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/uk 2026-05-27T11:53:53,029 copying build/lib/unitxt/catalog/cards/global_mmlu/uk/moral_scenarios.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/uk 2026-05-27T11:53:53,031 copying build/lib/unitxt/catalog/cards/global_mmlu/uk/world_religions.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/uk 2026-05-27T11:53:53,034 copying build/lib/unitxt/catalog/cards/global_mmlu/uk/business_ethics.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/uk 2026-05-27T11:53:53,036 copying build/lib/unitxt/catalog/cards/global_mmlu/uk/security_studies.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/uk 2026-05-27T11:53:53,038 copying build/lib/unitxt/catalog/cards/global_mmlu/uk/college_medicine.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/uk 2026-05-27T11:53:53,040 copying build/lib/unitxt/catalog/cards/global_mmlu/uk/human_sexuality.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/uk 2026-05-27T11:53:53,042 copying build/lib/unitxt/catalog/cards/global_mmlu/uk/prehistory.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/uk 2026-05-27T11:53:53,045 creating build/bdist.linux-armv7l/wheel/unitxt/catalog/cards/global_mmlu/sw 2026-05-27T11:53:53,046 copying build/lib/unitxt/catalog/cards/global_mmlu/sw/moral_disputes.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/sw 2026-05-27T11:53:53,048 copying build/lib/unitxt/catalog/cards/global_mmlu/sw/high_school_biology.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/sw 2026-05-27T11:53:53,050 copying build/lib/unitxt/catalog/cards/global_mmlu/sw/jurisprudence.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/sw 2026-05-27T11:53:53,052 copying build/lib/unitxt/catalog/cards/global_mmlu/sw/logical_fallacies.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/sw 2026-05-27T11:53:53,054 copying build/lib/unitxt/catalog/cards/global_mmlu/sw/college_chemistry.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/sw 2026-05-27T11:53:53,056 copying build/lib/unitxt/catalog/cards/global_mmlu/sw/high_school_government_and_politics.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/sw 2026-05-27T11:53:53,058 copying build/lib/unitxt/catalog/cards/global_mmlu/sw/college_mathematics.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/sw 2026-05-27T11:53:53,060 copying build/lib/unitxt/catalog/cards/global_mmlu/sw/econometrics.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/sw 2026-05-27T11:53:53,062 copying build/lib/unitxt/catalog/cards/global_mmlu/sw/high_school_macroeconomics.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/sw 2026-05-27T11:53:53,064 copying build/lib/unitxt/catalog/cards/global_mmlu/sw/high_school_psychology.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/sw 2026-05-27T11:53:53,066 copying build/lib/unitxt/catalog/cards/global_mmlu/sw/computer_security.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/sw 2026-05-27T11:53:53,069 copying build/lib/unitxt/catalog/cards/global_mmlu/sw/sociology.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/sw 2026-05-27T11:53:53,071 copying build/lib/unitxt/catalog/cards/global_mmlu/sw/nutrition.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/sw 2026-05-27T11:53:53,074 copying build/lib/unitxt/catalog/cards/global_mmlu/sw/professional_medicine.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/sw 2026-05-27T11:53:53,076 copying build/lib/unitxt/catalog/cards/global_mmlu/sw/college_biology.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/sw 2026-05-27T11:53:53,078 copying build/lib/unitxt/catalog/cards/global_mmlu/sw/anatomy.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/sw 2026-05-27T11:53:53,080 copying build/lib/unitxt/catalog/cards/global_mmlu/sw/professional_law.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/sw 2026-05-27T11:53:53,082 copying build/lib/unitxt/catalog/cards/global_mmlu/sw/machine_learning.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/sw 2026-05-27T11:53:53,084 copying build/lib/unitxt/catalog/cards/global_mmlu/sw/international_law.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/sw 2026-05-27T11:53:53,086 copying build/lib/unitxt/catalog/cards/global_mmlu/sw/medical_genetics.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/sw 2026-05-27T11:53:53,088 copying build/lib/unitxt/catalog/cards/global_mmlu/sw/high_school_computer_science.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/sw 2026-05-27T11:53:53,090 copying build/lib/unitxt/catalog/cards/global_mmlu/sw/clinical_knowledge.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/sw 2026-05-27T11:53:53,092 copying build/lib/unitxt/catalog/cards/global_mmlu/sw/college_physics.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/sw 2026-05-27T11:53:53,094 copying build/lib/unitxt/catalog/cards/global_mmlu/sw/global_facts.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/sw 2026-05-27T11:53:53,095 copying build/lib/unitxt/catalog/cards/global_mmlu/sw/college_computer_science.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/sw 2026-05-27T11:53:53,097 copying build/lib/unitxt/catalog/cards/global_mmlu/sw/us_foreign_policy.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/sw 2026-05-27T11:53:53,099 copying build/lib/unitxt/catalog/cards/global_mmlu/sw/professional_accounting.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/sw 2026-05-27T11:53:53,101 copying build/lib/unitxt/catalog/cards/global_mmlu/sw/professional_psychology.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/sw 2026-05-27T11:53:53,103 copying build/lib/unitxt/catalog/cards/global_mmlu/sw/philosophy.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/sw 2026-05-27T11:53:53,105 copying build/lib/unitxt/catalog/cards/global_mmlu/sw/elementary_mathematics.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/sw 2026-05-27T11:53:53,107 copying build/lib/unitxt/catalog/cards/global_mmlu/sw/conceptual_physics.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/sw 2026-05-27T11:53:53,109 copying build/lib/unitxt/catalog/cards/global_mmlu/sw/high_school_geography.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/sw 2026-05-27T11:53:53,111 copying build/lib/unitxt/catalog/cards/global_mmlu/sw/human_aging.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/sw 2026-05-27T11:53:53,112 copying build/lib/unitxt/catalog/cards/global_mmlu/sw/electrical_engineering.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/sw 2026-05-27T11:53:53,114 copying build/lib/unitxt/catalog/cards/global_mmlu/sw/management.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/sw 2026-05-27T11:53:53,116 copying build/lib/unitxt/catalog/cards/global_mmlu/sw/high_school_world_history.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/sw 2026-05-27T11:53:53,118 copying build/lib/unitxt/catalog/cards/global_mmlu/sw/marketing.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/sw 2026-05-27T11:53:53,120 copying build/lib/unitxt/catalog/cards/global_mmlu/sw/high_school_european_history.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/sw 2026-05-27T11:53:53,122 copying build/lib/unitxt/catalog/cards/global_mmlu/sw/astronomy.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/sw 2026-05-27T11:53:53,124 copying build/lib/unitxt/catalog/cards/global_mmlu/sw/high_school_physics.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/sw 2026-05-27T11:53:53,126 copying build/lib/unitxt/catalog/cards/global_mmlu/sw/public_relations.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/sw 2026-05-27T11:53:53,128 copying build/lib/unitxt/catalog/cards/global_mmlu/sw/high_school_microeconomics.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/sw 2026-05-27T11:53:53,130 copying build/lib/unitxt/catalog/cards/global_mmlu/sw/virology.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/sw 2026-05-27T11:53:53,132 copying build/lib/unitxt/catalog/cards/global_mmlu/sw/high_school_us_history.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/sw 2026-05-27T11:53:53,134 copying build/lib/unitxt/catalog/cards/global_mmlu/sw/high_school_statistics.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/sw 2026-05-27T11:53:53,136 copying build/lib/unitxt/catalog/cards/global_mmlu/sw/miscellaneous.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/sw 2026-05-27T11:53:53,138 copying build/lib/unitxt/catalog/cards/global_mmlu/sw/high_school_mathematics.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/sw 2026-05-27T11:53:53,139 copying build/lib/unitxt/catalog/cards/global_mmlu/sw/formal_logic.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/sw 2026-05-27T11:53:53,141 copying build/lib/unitxt/catalog/cards/global_mmlu/sw/high_school_chemistry.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/sw 2026-05-27T11:53:53,143 copying build/lib/unitxt/catalog/cards/global_mmlu/sw/abstract_algebra.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/sw 2026-05-27T11:53:53,145 copying build/lib/unitxt/catalog/cards/global_mmlu/sw/moral_scenarios.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/sw 2026-05-27T11:53:53,147 copying build/lib/unitxt/catalog/cards/global_mmlu/sw/world_religions.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/sw 2026-05-27T11:53:53,149 copying build/lib/unitxt/catalog/cards/global_mmlu/sw/business_ethics.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/sw 2026-05-27T11:53:53,150 copying build/lib/unitxt/catalog/cards/global_mmlu/sw/security_studies.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/sw 2026-05-27T11:53:53,152 copying build/lib/unitxt/catalog/cards/global_mmlu/sw/college_medicine.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/sw 2026-05-27T11:53:53,154 copying build/lib/unitxt/catalog/cards/global_mmlu/sw/human_sexuality.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/sw 2026-05-27T11:53:53,156 copying build/lib/unitxt/catalog/cards/global_mmlu/sw/prehistory.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/sw 2026-05-27T11:53:53,160 creating build/bdist.linux-armv7l/wheel/unitxt/catalog/cards/global_mmlu/pt 2026-05-27T11:53:53,161 copying build/lib/unitxt/catalog/cards/global_mmlu/pt/moral_disputes.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/pt 2026-05-27T11:53:53,163 copying build/lib/unitxt/catalog/cards/global_mmlu/pt/high_school_biology.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/pt 2026-05-27T11:53:53,165 copying build/lib/unitxt/catalog/cards/global_mmlu/pt/jurisprudence.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/pt 2026-05-27T11:53:53,167 copying build/lib/unitxt/catalog/cards/global_mmlu/pt/logical_fallacies.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/pt 2026-05-27T11:53:53,169 copying build/lib/unitxt/catalog/cards/global_mmlu/pt/college_chemistry.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/pt 2026-05-27T11:53:53,172 copying build/lib/unitxt/catalog/cards/global_mmlu/pt/high_school_government_and_politics.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/pt 2026-05-27T11:53:53,174 copying build/lib/unitxt/catalog/cards/global_mmlu/pt/college_mathematics.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/pt 2026-05-27T11:53:53,176 copying build/lib/unitxt/catalog/cards/global_mmlu/pt/econometrics.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/pt 2026-05-27T11:53:53,178 copying build/lib/unitxt/catalog/cards/global_mmlu/pt/high_school_macroeconomics.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/pt 2026-05-27T11:53:53,180 copying build/lib/unitxt/catalog/cards/global_mmlu/pt/high_school_psychology.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/pt 2026-05-27T11:53:53,182 copying build/lib/unitxt/catalog/cards/global_mmlu/pt/computer_security.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/pt 2026-05-27T11:53:53,184 copying build/lib/unitxt/catalog/cards/global_mmlu/pt/sociology.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/pt 2026-05-27T11:53:53,186 copying build/lib/unitxt/catalog/cards/global_mmlu/pt/nutrition.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/pt 2026-05-27T11:53:53,188 copying build/lib/unitxt/catalog/cards/global_mmlu/pt/professional_medicine.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/pt 2026-05-27T11:53:53,190 copying build/lib/unitxt/catalog/cards/global_mmlu/pt/college_biology.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/pt 2026-05-27T11:53:53,192 copying build/lib/unitxt/catalog/cards/global_mmlu/pt/anatomy.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/pt 2026-05-27T11:53:53,194 copying build/lib/unitxt/catalog/cards/global_mmlu/pt/professional_law.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/pt 2026-05-27T11:53:53,196 copying build/lib/unitxt/catalog/cards/global_mmlu/pt/machine_learning.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/pt 2026-05-27T11:53:53,197 copying build/lib/unitxt/catalog/cards/global_mmlu/pt/international_law.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/pt 2026-05-27T11:53:53,199 copying build/lib/unitxt/catalog/cards/global_mmlu/pt/medical_genetics.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/pt 2026-05-27T11:53:53,201 copying build/lib/unitxt/catalog/cards/global_mmlu/pt/high_school_computer_science.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/pt 2026-05-27T11:53:53,203 copying build/lib/unitxt/catalog/cards/global_mmlu/pt/clinical_knowledge.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/pt 2026-05-27T11:53:53,205 copying build/lib/unitxt/catalog/cards/global_mmlu/pt/college_physics.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/pt 2026-05-27T11:53:53,207 copying build/lib/unitxt/catalog/cards/global_mmlu/pt/global_facts.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/pt 2026-05-27T11:53:53,209 copying build/lib/unitxt/catalog/cards/global_mmlu/pt/college_computer_science.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/pt 2026-05-27T11:53:53,211 copying build/lib/unitxt/catalog/cards/global_mmlu/pt/us_foreign_policy.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/pt 2026-05-27T11:53:53,213 copying build/lib/unitxt/catalog/cards/global_mmlu/pt/professional_accounting.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/pt 2026-05-27T11:53:53,215 copying build/lib/unitxt/catalog/cards/global_mmlu/pt/professional_psychology.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/pt 2026-05-27T11:53:53,217 copying build/lib/unitxt/catalog/cards/global_mmlu/pt/philosophy.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/pt 2026-05-27T11:53:53,219 copying build/lib/unitxt/catalog/cards/global_mmlu/pt/elementary_mathematics.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/pt 2026-05-27T11:53:53,221 copying build/lib/unitxt/catalog/cards/global_mmlu/pt/conceptual_physics.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/pt 2026-05-27T11:53:53,223 copying build/lib/unitxt/catalog/cards/global_mmlu/pt/high_school_geography.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/pt 2026-05-27T11:53:53,225 copying build/lib/unitxt/catalog/cards/global_mmlu/pt/human_aging.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/pt 2026-05-27T11:53:53,227 copying build/lib/unitxt/catalog/cards/global_mmlu/pt/electrical_engineering.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/pt 2026-05-27T11:53:53,229 copying build/lib/unitxt/catalog/cards/global_mmlu/pt/management.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/pt 2026-05-27T11:53:53,231 copying build/lib/unitxt/catalog/cards/global_mmlu/pt/high_school_world_history.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/pt 2026-05-27T11:53:53,233 copying build/lib/unitxt/catalog/cards/global_mmlu/pt/marketing.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/pt 2026-05-27T11:53:53,235 copying build/lib/unitxt/catalog/cards/global_mmlu/pt/high_school_european_history.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/pt 2026-05-27T11:53:53,237 copying build/lib/unitxt/catalog/cards/global_mmlu/pt/astronomy.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/pt 2026-05-27T11:53:53,239 copying build/lib/unitxt/catalog/cards/global_mmlu/pt/high_school_physics.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/pt 2026-05-27T11:53:53,241 copying build/lib/unitxt/catalog/cards/global_mmlu/pt/public_relations.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/pt 2026-05-27T11:53:53,243 copying build/lib/unitxt/catalog/cards/global_mmlu/pt/high_school_microeconomics.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/pt 2026-05-27T11:53:53,244 copying build/lib/unitxt/catalog/cards/global_mmlu/pt/virology.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/pt 2026-05-27T11:53:53,246 copying build/lib/unitxt/catalog/cards/global_mmlu/pt/high_school_us_history.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/pt 2026-05-27T11:53:53,248 copying build/lib/unitxt/catalog/cards/global_mmlu/pt/high_school_statistics.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/pt 2026-05-27T11:53:53,250 copying build/lib/unitxt/catalog/cards/global_mmlu/pt/miscellaneous.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/pt 2026-05-27T11:53:53,253 copying build/lib/unitxt/catalog/cards/global_mmlu/pt/high_school_mathematics.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/pt 2026-05-27T11:53:53,255 copying build/lib/unitxt/catalog/cards/global_mmlu/pt/formal_logic.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/pt 2026-05-27T11:53:53,258 copying build/lib/unitxt/catalog/cards/global_mmlu/pt/high_school_chemistry.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/pt 2026-05-27T11:53:53,260 copying build/lib/unitxt/catalog/cards/global_mmlu/pt/abstract_algebra.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/pt 2026-05-27T11:53:53,262 copying build/lib/unitxt/catalog/cards/global_mmlu/pt/moral_scenarios.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/pt 2026-05-27T11:53:53,264 copying build/lib/unitxt/catalog/cards/global_mmlu/pt/world_religions.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/pt 2026-05-27T11:53:53,266 copying build/lib/unitxt/catalog/cards/global_mmlu/pt/business_ethics.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/pt 2026-05-27T11:53:53,269 copying build/lib/unitxt/catalog/cards/global_mmlu/pt/security_studies.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/pt 2026-05-27T11:53:53,271 copying build/lib/unitxt/catalog/cards/global_mmlu/pt/college_medicine.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/pt 2026-05-27T11:53:53,273 copying build/lib/unitxt/catalog/cards/global_mmlu/pt/human_sexuality.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/pt 2026-05-27T11:53:53,276 copying build/lib/unitxt/catalog/cards/global_mmlu/pt/prehistory.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/pt 2026-05-27T11:53:53,280 creating build/bdist.linux-armv7l/wheel/unitxt/catalog/cards/global_mmlu/sn 2026-05-27T11:53:53,282 copying build/lib/unitxt/catalog/cards/global_mmlu/sn/moral_disputes.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/sn 2026-05-27T11:53:53,284 copying build/lib/unitxt/catalog/cards/global_mmlu/sn/high_school_biology.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/sn 2026-05-27T11:53:53,287 copying build/lib/unitxt/catalog/cards/global_mmlu/sn/jurisprudence.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/sn 2026-05-27T11:53:53,289 copying build/lib/unitxt/catalog/cards/global_mmlu/sn/logical_fallacies.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/sn 2026-05-27T11:53:53,291 copying build/lib/unitxt/catalog/cards/global_mmlu/sn/college_chemistry.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/sn 2026-05-27T11:53:53,293 copying build/lib/unitxt/catalog/cards/global_mmlu/sn/high_school_government_and_politics.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/sn 2026-05-27T11:53:53,295 copying build/lib/unitxt/catalog/cards/global_mmlu/sn/college_mathematics.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/sn 2026-05-27T11:53:53,298 copying build/lib/unitxt/catalog/cards/global_mmlu/sn/econometrics.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/sn 2026-05-27T11:53:53,300 copying build/lib/unitxt/catalog/cards/global_mmlu/sn/high_school_macroeconomics.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/sn 2026-05-27T11:53:53,301 copying build/lib/unitxt/catalog/cards/global_mmlu/sn/high_school_psychology.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/sn 2026-05-27T11:53:53,304 copying build/lib/unitxt/catalog/cards/global_mmlu/sn/computer_security.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/sn 2026-05-27T11:53:53,306 copying build/lib/unitxt/catalog/cards/global_mmlu/sn/sociology.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/sn 2026-05-27T11:53:53,308 copying build/lib/unitxt/catalog/cards/global_mmlu/sn/nutrition.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/sn 2026-05-27T11:53:53,310 copying build/lib/unitxt/catalog/cards/global_mmlu/sn/professional_medicine.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/sn 2026-05-27T11:53:53,312 copying build/lib/unitxt/catalog/cards/global_mmlu/sn/college_biology.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/sn 2026-05-27T11:53:53,314 copying build/lib/unitxt/catalog/cards/global_mmlu/sn/anatomy.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/sn 2026-05-27T11:53:53,316 copying build/lib/unitxt/catalog/cards/global_mmlu/sn/professional_law.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/sn 2026-05-27T11:53:53,318 copying build/lib/unitxt/catalog/cards/global_mmlu/sn/machine_learning.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/sn 2026-05-27T11:53:53,320 copying build/lib/unitxt/catalog/cards/global_mmlu/sn/international_law.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/sn 2026-05-27T11:53:53,322 copying build/lib/unitxt/catalog/cards/global_mmlu/sn/medical_genetics.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/sn 2026-05-27T11:53:53,324 copying build/lib/unitxt/catalog/cards/global_mmlu/sn/high_school_computer_science.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/sn 2026-05-27T11:53:53,326 copying build/lib/unitxt/catalog/cards/global_mmlu/sn/clinical_knowledge.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/sn 2026-05-27T11:53:53,328 copying build/lib/unitxt/catalog/cards/global_mmlu/sn/college_physics.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/sn 2026-05-27T11:53:53,330 copying build/lib/unitxt/catalog/cards/global_mmlu/sn/global_facts.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/sn 2026-05-27T11:53:53,332 copying build/lib/unitxt/catalog/cards/global_mmlu/sn/college_computer_science.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/sn 2026-05-27T11:53:53,334 copying build/lib/unitxt/catalog/cards/global_mmlu/sn/us_foreign_policy.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/sn 2026-05-27T11:53:53,336 copying build/lib/unitxt/catalog/cards/global_mmlu/sn/professional_accounting.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/sn 2026-05-27T11:53:53,338 copying build/lib/unitxt/catalog/cards/global_mmlu/sn/professional_psychology.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/sn 2026-05-27T11:53:53,341 copying build/lib/unitxt/catalog/cards/global_mmlu/sn/philosophy.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/sn 2026-05-27T11:53:53,343 copying build/lib/unitxt/catalog/cards/global_mmlu/sn/elementary_mathematics.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/sn 2026-05-27T11:53:53,346 copying build/lib/unitxt/catalog/cards/global_mmlu/sn/conceptual_physics.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/sn 2026-05-27T11:53:53,348 copying build/lib/unitxt/catalog/cards/global_mmlu/sn/high_school_geography.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/sn 2026-05-27T11:53:53,350 copying build/lib/unitxt/catalog/cards/global_mmlu/sn/human_aging.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/sn 2026-05-27T11:53:53,352 copying build/lib/unitxt/catalog/cards/global_mmlu/sn/electrical_engineering.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/sn 2026-05-27T11:53:53,354 copying build/lib/unitxt/catalog/cards/global_mmlu/sn/management.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/sn 2026-05-27T11:53:53,356 copying build/lib/unitxt/catalog/cards/global_mmlu/sn/high_school_world_history.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/sn 2026-05-27T11:53:53,358 copying build/lib/unitxt/catalog/cards/global_mmlu/sn/marketing.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/sn 2026-05-27T11:53:53,360 copying build/lib/unitxt/catalog/cards/global_mmlu/sn/high_school_european_history.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/sn 2026-05-27T11:53:53,362 copying build/lib/unitxt/catalog/cards/global_mmlu/sn/astronomy.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/sn 2026-05-27T11:53:53,364 copying build/lib/unitxt/catalog/cards/global_mmlu/sn/high_school_physics.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/sn 2026-05-27T11:53:53,366 copying build/lib/unitxt/catalog/cards/global_mmlu/sn/public_relations.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/sn 2026-05-27T11:53:53,368 copying build/lib/unitxt/catalog/cards/global_mmlu/sn/high_school_microeconomics.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/sn 2026-05-27T11:53:53,370 copying build/lib/unitxt/catalog/cards/global_mmlu/sn/virology.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/sn 2026-05-27T11:53:53,372 copying build/lib/unitxt/catalog/cards/global_mmlu/sn/high_school_us_history.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/sn 2026-05-27T11:53:53,374 copying build/lib/unitxt/catalog/cards/global_mmlu/sn/high_school_statistics.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/sn 2026-05-27T11:53:53,376 copying build/lib/unitxt/catalog/cards/global_mmlu/sn/miscellaneous.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/sn 2026-05-27T11:53:53,379 copying build/lib/unitxt/catalog/cards/global_mmlu/sn/high_school_mathematics.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/sn 2026-05-27T11:53:53,381 copying build/lib/unitxt/catalog/cards/global_mmlu/sn/formal_logic.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/sn 2026-05-27T11:53:53,382 copying build/lib/unitxt/catalog/cards/global_mmlu/sn/high_school_chemistry.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/sn 2026-05-27T11:53:53,384 copying build/lib/unitxt/catalog/cards/global_mmlu/sn/abstract_algebra.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/sn 2026-05-27T11:53:53,386 copying build/lib/unitxt/catalog/cards/global_mmlu/sn/moral_scenarios.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/sn 2026-05-27T11:53:53,388 copying build/lib/unitxt/catalog/cards/global_mmlu/sn/world_religions.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/sn 2026-05-27T11:53:53,390 copying build/lib/unitxt/catalog/cards/global_mmlu/sn/business_ethics.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/sn 2026-05-27T11:53:53,392 copying build/lib/unitxt/catalog/cards/global_mmlu/sn/security_studies.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/sn 2026-05-27T11:53:53,394 copying build/lib/unitxt/catalog/cards/global_mmlu/sn/college_medicine.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/sn 2026-05-27T11:53:53,396 copying build/lib/unitxt/catalog/cards/global_mmlu/sn/human_sexuality.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/sn 2026-05-27T11:53:53,398 copying build/lib/unitxt/catalog/cards/global_mmlu/sn/prehistory.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/sn 2026-05-27T11:53:53,401 creating build/bdist.linux-armv7l/wheel/unitxt/catalog/cards/global_mmlu/zh 2026-05-27T11:53:53,402 copying build/lib/unitxt/catalog/cards/global_mmlu/zh/moral_disputes.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/zh 2026-05-27T11:53:53,404 copying build/lib/unitxt/catalog/cards/global_mmlu/zh/high_school_biology.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/zh 2026-05-27T11:53:53,406 copying build/lib/unitxt/catalog/cards/global_mmlu/zh/jurisprudence.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/zh 2026-05-27T11:53:53,408 copying build/lib/unitxt/catalog/cards/global_mmlu/zh/logical_fallacies.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/zh 2026-05-27T11:53:53,410 copying build/lib/unitxt/catalog/cards/global_mmlu/zh/college_chemistry.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/zh 2026-05-27T11:53:53,412 copying build/lib/unitxt/catalog/cards/global_mmlu/zh/high_school_government_and_politics.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/zh 2026-05-27T11:53:53,414 copying build/lib/unitxt/catalog/cards/global_mmlu/zh/college_mathematics.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/zh 2026-05-27T11:53:53,416 copying build/lib/unitxt/catalog/cards/global_mmlu/zh/econometrics.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/zh 2026-05-27T11:53:53,418 copying build/lib/unitxt/catalog/cards/global_mmlu/zh/high_school_macroeconomics.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/zh 2026-05-27T11:53:53,420 copying build/lib/unitxt/catalog/cards/global_mmlu/zh/high_school_psychology.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/zh 2026-05-27T11:53:53,422 copying build/lib/unitxt/catalog/cards/global_mmlu/zh/computer_security.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/zh 2026-05-27T11:53:53,425 copying build/lib/unitxt/catalog/cards/global_mmlu/zh/sociology.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/zh 2026-05-27T11:53:53,427 copying build/lib/unitxt/catalog/cards/global_mmlu/zh/nutrition.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/zh 2026-05-27T11:53:53,429 copying build/lib/unitxt/catalog/cards/global_mmlu/zh/professional_medicine.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/zh 2026-05-27T11:53:53,430 copying build/lib/unitxt/catalog/cards/global_mmlu/zh/college_biology.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/zh 2026-05-27T11:53:53,433 copying build/lib/unitxt/catalog/cards/global_mmlu/zh/anatomy.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/zh 2026-05-27T11:53:53,435 copying build/lib/unitxt/catalog/cards/global_mmlu/zh/professional_law.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/zh 2026-05-27T11:53:53,438 copying build/lib/unitxt/catalog/cards/global_mmlu/zh/machine_learning.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/zh 2026-05-27T11:53:53,440 copying build/lib/unitxt/catalog/cards/global_mmlu/zh/international_law.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/zh 2026-05-27T11:53:53,442 copying build/lib/unitxt/catalog/cards/global_mmlu/zh/medical_genetics.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/zh 2026-05-27T11:53:53,444 copying build/lib/unitxt/catalog/cards/global_mmlu/zh/high_school_computer_science.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/zh 2026-05-27T11:53:53,446 copying build/lib/unitxt/catalog/cards/global_mmlu/zh/clinical_knowledge.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/zh 2026-05-27T11:53:53,448 copying build/lib/unitxt/catalog/cards/global_mmlu/zh/college_physics.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/zh 2026-05-27T11:53:53,450 copying build/lib/unitxt/catalog/cards/global_mmlu/zh/global_facts.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/zh 2026-05-27T11:53:53,452 copying build/lib/unitxt/catalog/cards/global_mmlu/zh/college_computer_science.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/zh 2026-05-27T11:53:53,454 copying build/lib/unitxt/catalog/cards/global_mmlu/zh/us_foreign_policy.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/zh 2026-05-27T11:53:53,455 copying build/lib/unitxt/catalog/cards/global_mmlu/zh/professional_accounting.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/zh 2026-05-27T11:53:53,457 copying build/lib/unitxt/catalog/cards/global_mmlu/zh/professional_psychology.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/zh 2026-05-27T11:53:53,460 copying build/lib/unitxt/catalog/cards/global_mmlu/zh/philosophy.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/zh 2026-05-27T11:53:53,462 copying build/lib/unitxt/catalog/cards/global_mmlu/zh/elementary_mathematics.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/zh 2026-05-27T11:53:53,464 copying build/lib/unitxt/catalog/cards/global_mmlu/zh/conceptual_physics.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/zh 2026-05-27T11:53:53,467 copying build/lib/unitxt/catalog/cards/global_mmlu/zh/high_school_geography.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/zh 2026-05-27T11:53:53,469 copying build/lib/unitxt/catalog/cards/global_mmlu/zh/human_aging.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/zh 2026-05-27T11:53:53,472 copying build/lib/unitxt/catalog/cards/global_mmlu/zh/electrical_engineering.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/zh 2026-05-27T11:53:53,474 copying build/lib/unitxt/catalog/cards/global_mmlu/zh/management.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/zh 2026-05-27T11:53:53,477 copying build/lib/unitxt/catalog/cards/global_mmlu/zh/high_school_world_history.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/zh 2026-05-27T11:53:53,479 copying build/lib/unitxt/catalog/cards/global_mmlu/zh/marketing.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/zh 2026-05-27T11:53:53,481 copying build/lib/unitxt/catalog/cards/global_mmlu/zh/high_school_european_history.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/zh 2026-05-27T11:53:53,483 copying build/lib/unitxt/catalog/cards/global_mmlu/zh/astronomy.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/zh 2026-05-27T11:53:53,486 copying build/lib/unitxt/catalog/cards/global_mmlu/zh/high_school_physics.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/zh 2026-05-27T11:53:53,488 copying build/lib/unitxt/catalog/cards/global_mmlu/zh/public_relations.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/zh 2026-05-27T11:53:53,490 copying build/lib/unitxt/catalog/cards/global_mmlu/zh/high_school_microeconomics.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/zh 2026-05-27T11:53:53,492 copying build/lib/unitxt/catalog/cards/global_mmlu/zh/virology.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/zh 2026-05-27T11:53:53,494 copying build/lib/unitxt/catalog/cards/global_mmlu/zh/high_school_us_history.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/zh 2026-05-27T11:53:53,496 copying build/lib/unitxt/catalog/cards/global_mmlu/zh/high_school_statistics.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/zh 2026-05-27T11:53:53,499 copying build/lib/unitxt/catalog/cards/global_mmlu/zh/miscellaneous.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/zh 2026-05-27T11:53:53,501 copying build/lib/unitxt/catalog/cards/global_mmlu/zh/high_school_mathematics.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/zh 2026-05-27T11:53:53,503 copying build/lib/unitxt/catalog/cards/global_mmlu/zh/formal_logic.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/zh 2026-05-27T11:53:53,505 copying build/lib/unitxt/catalog/cards/global_mmlu/zh/high_school_chemistry.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/zh 2026-05-27T11:53:53,508 copying build/lib/unitxt/catalog/cards/global_mmlu/zh/abstract_algebra.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/zh 2026-05-27T11:53:53,510 copying build/lib/unitxt/catalog/cards/global_mmlu/zh/moral_scenarios.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/zh 2026-05-27T11:53:53,513 copying build/lib/unitxt/catalog/cards/global_mmlu/zh/world_religions.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/zh 2026-05-27T11:53:53,515 copying build/lib/unitxt/catalog/cards/global_mmlu/zh/business_ethics.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/zh 2026-05-27T11:53:53,518 copying build/lib/unitxt/catalog/cards/global_mmlu/zh/security_studies.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/zh 2026-05-27T11:53:53,520 copying build/lib/unitxt/catalog/cards/global_mmlu/zh/college_medicine.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/zh 2026-05-27T11:53:53,523 copying build/lib/unitxt/catalog/cards/global_mmlu/zh/human_sexuality.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/zh 2026-05-27T11:53:53,525 copying build/lib/unitxt/catalog/cards/global_mmlu/zh/prehistory.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu/zh 2026-05-27T11:53:53,528 copying build/lib/unitxt/catalog/cards/billsum_document_filtered_to_10000_chars.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards 2026-05-27T11:53:53,531 copying build/lib/unitxt/catalog/cards/squad.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards 2026-05-27T11:53:53,533 copying build/lib/unitxt/catalog/cards/claim_stance_topic.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards 2026-05-27T11:53:53,537 creating build/bdist.linux-armv7l/wheel/unitxt/catalog/cards/xlsum 2026-05-27T11:53:53,538 copying build/lib/unitxt/catalog/cards/xlsum/tamil.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/xlsum 2026-05-27T11:53:53,540 copying build/lib/unitxt/catalog/cards/xlsum/kyrgyz.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/xlsum 2026-05-27T11:53:53,542 copying build/lib/unitxt/catalog/cards/xlsum/portuguese.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/xlsum 2026-05-27T11:53:53,544 copying build/lib/unitxt/catalog/cards/xlsum/chinese_simplified.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/xlsum 2026-05-27T11:53:53,547 copying build/lib/unitxt/catalog/cards/xlsum/burmese.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/xlsum 2026-05-27T11:53:53,549 copying build/lib/unitxt/catalog/cards/xlsum/russian.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/xlsum 2026-05-27T11:53:53,551 copying build/lib/unitxt/catalog/cards/xlsum/punjabi.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/xlsum 2026-05-27T11:53:53,553 copying build/lib/unitxt/catalog/cards/xlsum/tigrinya.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/xlsum 2026-05-27T11:53:53,555 copying build/lib/unitxt/catalog/cards/xlsum/telugu.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/xlsum 2026-05-27T11:53:53,557 copying build/lib/unitxt/catalog/cards/xlsum/swahili.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/xlsum 2026-05-27T11:53:53,559 copying build/lib/unitxt/catalog/cards/xlsum/sinhala.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/xlsum 2026-05-27T11:53:53,561 copying build/lib/unitxt/catalog/cards/xlsum/french.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/xlsum 2026-05-27T11:53:53,563 copying build/lib/unitxt/catalog/cards/xlsum/spanish.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/xlsum 2026-05-27T11:53:53,565 copying build/lib/unitxt/catalog/cards/xlsum/azerbaijani.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/xlsum 2026-05-27T11:53:53,567 copying build/lib/unitxt/catalog/cards/xlsum/persian.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/xlsum 2026-05-27T11:53:53,569 copying build/lib/unitxt/catalog/cards/xlsum/serbian_cyrillic.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/xlsum 2026-05-27T11:53:53,571 copying build/lib/unitxt/catalog/cards/xlsum/english.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/xlsum 2026-05-27T11:53:53,573 copying build/lib/unitxt/catalog/cards/xlsum/hausa.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/xlsum 2026-05-27T11:53:53,575 copying build/lib/unitxt/catalog/cards/xlsum/welsh.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/xlsum 2026-05-27T11:53:53,576 copying build/lib/unitxt/catalog/cards/xlsum/vietnamese.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/xlsum 2026-05-27T11:53:53,578 copying build/lib/unitxt/catalog/cards/xlsum/indonesian.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/xlsum 2026-05-27T11:53:53,580 copying build/lib/unitxt/catalog/cards/xlsum/somali.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/xlsum 2026-05-27T11:53:53,582 copying build/lib/unitxt/catalog/cards/xlsum/hindi.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/xlsum 2026-05-27T11:53:53,584 copying build/lib/unitxt/catalog/cards/xlsum/bengali.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/xlsum 2026-05-27T11:53:53,586 copying build/lib/unitxt/catalog/cards/xlsum/nepali.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/xlsum 2026-05-27T11:53:53,587 copying build/lib/unitxt/catalog/cards/xlsum/urdu.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/xlsum 2026-05-27T11:53:53,589 copying build/lib/unitxt/catalog/cards/xlsum/serbian_latin.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/xlsum 2026-05-27T11:53:53,591 copying build/lib/unitxt/catalog/cards/xlsum/scottish_gaelic.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/xlsum 2026-05-27T11:53:53,593 copying build/lib/unitxt/catalog/cards/xlsum/kirundi.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/xlsum 2026-05-27T11:53:53,595 copying build/lib/unitxt/catalog/cards/xlsum/arabic.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/xlsum 2026-05-27T11:53:53,596 copying build/lib/unitxt/catalog/cards/xlsum/marathi.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/xlsum 2026-05-27T11:53:53,598 copying build/lib/unitxt/catalog/cards/xlsum/korean.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/xlsum 2026-05-27T11:53:53,601 copying build/lib/unitxt/catalog/cards/xlsum/amharic.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/xlsum 2026-05-27T11:53:53,603 copying build/lib/unitxt/catalog/cards/xlsum/pidgin.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/xlsum 2026-05-27T11:53:53,605 copying build/lib/unitxt/catalog/cards/xlsum/turkish.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/xlsum 2026-05-27T11:53:53,607 copying build/lib/unitxt/catalog/cards/xlsum/japanese.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/xlsum 2026-05-27T11:53:53,608 copying build/lib/unitxt/catalog/cards/xlsum/gujarati.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/xlsum 2026-05-27T11:53:53,610 copying build/lib/unitxt/catalog/cards/xlsum/oromo.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/xlsum 2026-05-27T11:53:53,612 copying build/lib/unitxt/catalog/cards/xlsum/uzbek.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/xlsum 2026-05-27T11:53:53,614 copying build/lib/unitxt/catalog/cards/xlsum/ukrainian.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/xlsum 2026-05-27T11:53:53,616 copying build/lib/unitxt/catalog/cards/xlsum/igbo.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/xlsum 2026-05-27T11:53:53,617 copying build/lib/unitxt/catalog/cards/xlsum/chinese_traditional.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/xlsum 2026-05-27T11:53:53,619 copying build/lib/unitxt/catalog/cards/xlsum/thai.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/xlsum 2026-05-27T11:53:53,621 copying build/lib/unitxt/catalog/cards/xlsum/yoruba.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/xlsum 2026-05-27T11:53:53,623 copying build/lib/unitxt/catalog/cards/xlsum/pashto.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/xlsum 2026-05-27T11:53:53,625 copying build/lib/unitxt/catalog/cards/frames.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards 2026-05-27T11:53:53,628 creating build/bdist.linux-armv7l/wheel/unitxt/catalog/cards/rag_eval 2026-05-27T11:53:53,629 creating build/bdist.linux-armv7l/wheel/unitxt/catalog/cards/rag_eval/faithfulness 2026-05-27T11:53:53,631 creating build/bdist.linux-armv7l/wheel/unitxt/catalog/cards/rag_eval/faithfulness/ragbench 2026-05-27T11:53:53,632 copying build/lib/unitxt/catalog/cards/rag_eval/faithfulness/ragbench/expertqa.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/rag_eval/faithfulness/ragbench 2026-05-27T11:53:53,634 copying build/lib/unitxt/catalog/cards/rag_eval/faithfulness/ragbench/cuad.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/rag_eval/faithfulness/ragbench 2026-05-27T11:53:53,635 copying build/lib/unitxt/catalog/cards/rag_eval/faithfulness/ragbench/hotpotqa.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/rag_eval/faithfulness/ragbench 2026-05-27T11:53:53,637 copying build/lib/unitxt/catalog/cards/rag_eval/faithfulness/ragbench/pubmedqa.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/rag_eval/faithfulness/ragbench 2026-05-27T11:53:53,639 copying build/lib/unitxt/catalog/cards/rag_eval/faithfulness/ragbench/techqa.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/rag_eval/faithfulness/ragbench 2026-05-27T11:53:53,641 copying build/lib/unitxt/catalog/cards/rag_eval/faithfulness/ragbench/hagrid.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/rag_eval/faithfulness/ragbench 2026-05-27T11:53:53,642 copying build/lib/unitxt/catalog/cards/rag_eval/faithfulness/ragbench/msmarco.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/rag_eval/faithfulness/ragbench 2026-05-27T11:53:53,644 copying build/lib/unitxt/catalog/cards/rag_eval/faithfulness/ragbench/delucionqa.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/rag_eval/faithfulness/ragbench 2026-05-27T11:53:53,645 copying build/lib/unitxt/catalog/cards/rag_eval/faithfulness/ragbench/finqa.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/rag_eval/faithfulness/ragbench 2026-05-27T11:53:53,647 copying build/lib/unitxt/catalog/cards/rag_eval/faithfulness/ragbench/covidqa.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/rag_eval/faithfulness/ragbench 2026-05-27T11:53:53,649 copying build/lib/unitxt/catalog/cards/rag_eval/faithfulness/ragbench/tatqa.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/rag_eval/faithfulness/ragbench 2026-05-27T11:53:53,650 copying build/lib/unitxt/catalog/cards/rag_eval/faithfulness/ragbench/emanual.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/rag_eval/faithfulness/ragbench 2026-05-27T11:53:53,652 copying build/lib/unitxt/catalog/cards/hh_rlhf.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards 2026-05-27T11:53:53,655 creating build/bdist.linux-armv7l/wheel/unitxt/catalog/cards/head_qa 2026-05-27T11:53:53,656 copying build/lib/unitxt/catalog/cards/head_qa/gl.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/head_qa 2026-05-27T11:53:53,658 copying build/lib/unitxt/catalog/cards/head_qa/it.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/head_qa 2026-05-27T11:53:53,659 copying build/lib/unitxt/catalog/cards/head_qa/ru.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/head_qa 2026-05-27T11:53:53,661 copying build/lib/unitxt/catalog/cards/head_qa/es.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/head_qa 2026-05-27T11:53:53,663 copying build/lib/unitxt/catalog/cards/head_qa/en.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/head_qa 2026-05-27T11:53:53,665 copying build/lib/unitxt/catalog/cards/yahoo_answers_topics.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards 2026-05-27T11:53:53,667 creating build/bdist.linux-armv7l/wheel/unitxt/catalog/cards/bfcl 2026-05-27T11:53:53,668 copying build/lib/unitxt/catalog/cards/bfcl/simple_v3.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/bfcl 2026-05-27T11:53:53,671 creating build/bdist.linux-armv7l/wheel/unitxt/catalog/cards/bfcl/multi_turn 2026-05-27T11:53:53,672 copying build/lib/unitxt/catalog/cards/bfcl/multi_turn/parallel_multiple_v3.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/bfcl/multi_turn 2026-05-27T11:53:53,674 copying build/lib/unitxt/catalog/cards/bfcl/multi_turn/live_parallel_v3.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/bfcl/multi_turn 2026-05-27T11:53:53,676 copying build/lib/unitxt/catalog/cards/bfcl/multi_turn/parallel_v3.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/bfcl/multi_turn 2026-05-27T11:53:53,678 copying build/lib/unitxt/catalog/cards/bfcl/multi_turn/javascript_v3.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/bfcl/multi_turn 2026-05-27T11:53:53,680 copying build/lib/unitxt/catalog/cards/bfcl/multi_turn/live_relevance_v3.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/bfcl/multi_turn 2026-05-27T11:53:53,682 copying build/lib/unitxt/catalog/cards/bfcl/multi_turn/live_irrelevance_v3.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/bfcl/multi_turn 2026-05-27T11:53:53,684 copying build/lib/unitxt/catalog/cards/bfcl/multi_turn/live_simple_v3.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/bfcl/multi_turn 2026-05-27T11:53:53,686 copying build/lib/unitxt/catalog/cards/bfcl/multi_turn/live_multiple_v3.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/bfcl/multi_turn 2026-05-27T11:53:53,688 copying build/lib/unitxt/catalog/cards/bfcl/multi_turn/live_parallel_multiple_v3.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/bfcl/multi_turn 2026-05-27T11:53:53,690 copying build/lib/unitxt/catalog/cards/bfcl/multi_turn/simple_v3.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/bfcl/multi_turn 2026-05-27T11:53:53,692 copying build/lib/unitxt/catalog/cards/bfcl/multi_turn/java_v3.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/bfcl/multi_turn 2026-05-27T11:53:53,694 copying build/lib/unitxt/catalog/cards/bfcl/multi_turn/multiple_v3.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/bfcl/multi_turn 2026-05-27T11:53:53,696 creating build/bdist.linux-armv7l/wheel/unitxt/catalog/cards/reward_bench 2026-05-27T11:53:53,697 copying build/lib/unitxt/catalog/cards/reward_bench/reasoning.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/reward_bench 2026-05-27T11:53:53,699 copying build/lib/unitxt/catalog/cards/reward_bench/chat_hard.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/reward_bench 2026-05-27T11:53:53,700 copying build/lib/unitxt/catalog/cards/reward_bench/chat.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/reward_bench 2026-05-27T11:53:53,702 copying build/lib/unitxt/catalog/cards/reward_bench/safety.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/reward_bench 2026-05-27T11:53:53,704 creating build/bdist.linux-armv7l/wheel/unitxt/catalog/cards/go_emotions 2026-05-27T11:53:53,705 copying build/lib/unitxt/catalog/cards/go_emotions/simplified.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/go_emotions 2026-05-27T11:53:53,707 copying build/lib/unitxt/catalog/cards/xsum.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards 2026-05-27T11:53:53,709 copying build/lib/unitxt/catalog/cards/tablebench_fact_checking.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards 2026-05-27T11:53:53,712 creating build/bdist.linux-armv7l/wheel/unitxt/catalog/cards/ai2_arc 2026-05-27T11:53:53,713 copying build/lib/unitxt/catalog/cards/ai2_arc/arc_challenge.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/ai2_arc 2026-05-27T11:53:53,715 copying build/lib/unitxt/catalog/cards/ai2_arc/arc_easy.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/ai2_arc 2026-05-27T11:53:53,717 copying build/lib/unitxt/catalog/cards/unfair_tos.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards 2026-05-27T11:53:53,719 copying build/lib/unitxt/catalog/cards/tldr_document_filtered_to_10000_chars.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards 2026-05-27T11:53:53,721 copying build/lib/unitxt/catalog/cards/piqa.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards 2026-05-27T11:53:53,723 copying build/lib/unitxt/catalog/cards/law_stack_exchange.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards 2026-05-27T11:53:53,725 copying build/lib/unitxt/catalog/cards/social_iqa.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards 2026-05-27T11:53:53,727 copying build/lib/unitxt/catalog/cards/chart_qa.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards 2026-05-27T11:53:53,729 copying build/lib/unitxt/catalog/cards/cola.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards 2026-05-27T11:53:53,731 copying build/lib/unitxt/catalog/cards/wikitq.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards 2026-05-27T11:53:53,733 copying build/lib/unitxt/catalog/cards/race_high.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards 2026-05-27T11:53:53,735 creating build/bdist.linux-armv7l/wheel/unitxt/catalog/cards/coedit 2026-05-27T11:53:53,736 copying build/lib/unitxt/catalog/cards/coedit/paraphrase.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/coedit 2026-05-27T11:53:53,738 copying build/lib/unitxt/catalog/cards/coedit/selection.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/coedit 2026-05-27T11:53:53,740 copying build/lib/unitxt/catalog/cards/coedit/rewriting.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/coedit 2026-05-27T11:53:53,742 copying build/lib/unitxt/catalog/cards/coedit/preference.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/coedit 2026-05-27T11:53:53,744 copying build/lib/unitxt/catalog/cards/seed_bench.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards 2026-05-27T11:53:53,746 creating build/bdist.linux-armv7l/wheel/unitxt/catalog/cards/xwinogrande 2026-05-27T11:53:53,747 copying build/lib/unitxt/catalog/cards/xwinogrande/zh.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/xwinogrande 2026-05-27T11:53:53,749 copying build/lib/unitxt/catalog/cards/xwinogrande/ru.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/xwinogrande 2026-05-27T11:53:53,750 copying build/lib/unitxt/catalog/cards/xwinogrande/en.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/xwinogrande 2026-05-27T11:53:53,752 copying build/lib/unitxt/catalog/cards/xwinogrande/jp.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/xwinogrande 2026-05-27T11:53:53,754 copying build/lib/unitxt/catalog/cards/xwinogrande/pt.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/xwinogrande 2026-05-27T11:53:53,756 creating build/bdist.linux-armv7l/wheel/unitxt/catalog/cards/text2sql 2026-05-27T11:53:53,757 copying build/lib/unitxt/catalog/cards/text2sql/bird.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/text2sql 2026-05-27T11:53:53,759 creating build/bdist.linux-armv7l/wheel/unitxt/catalog/cards/mt_bench 2026-05-27T11:53:53,761 creating build/bdist.linux-armv7l/wheel/unitxt/catalog/cards/mt_bench/generation 2026-05-27T11:53:53,762 copying build/lib/unitxt/catalog/cards/mt_bench/generation/english_single_turn.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/mt_bench/generation 2026-05-27T11:53:53,764 copying build/lib/unitxt/catalog/cards/mt_bench/generation/japanese_single_turn.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/mt_bench/generation 2026-05-27T11:53:53,766 creating build/bdist.linux-armv7l/wheel/unitxt/catalog/cards/mt_bench/response_assessment 2026-05-27T11:53:53,768 creating build/bdist.linux-armv7l/wheel/unitxt/catalog/cards/mt_bench/response_assessment/pairwise_comparison 2026-05-27T11:53:53,769 copying build/lib/unitxt/catalog/cards/mt_bench/response_assessment/pairwise_comparison/multi_turn_with_reference_gpt4_judgement.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/mt_bench/response_assessment/pairwise_comparison 2026-05-27T11:53:53,771 copying build/lib/unitxt/catalog/cards/mt_bench/response_assessment/pairwise_comparison/single_turn_gpt4_judgement.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/mt_bench/response_assessment/pairwise_comparison 2026-05-27T11:53:53,773 copying build/lib/unitxt/catalog/cards/mt_bench/response_assessment/pairwise_comparison/multi_turn_gpt4_judgement.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/mt_bench/response_assessment/pairwise_comparison 2026-05-27T11:53:53,775 copying build/lib/unitxt/catalog/cards/mt_bench/response_assessment/pairwise_comparison/single_turn_with_reference_gpt4_judgement.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/mt_bench/response_assessment/pairwise_comparison 2026-05-27T11:53:53,777 creating build/bdist.linux-armv7l/wheel/unitxt/catalog/cards/mt_bench/response_assessment/rating 2026-05-27T11:53:53,778 copying build/lib/unitxt/catalog/cards/mt_bench/response_assessment/rating/multi_turn_with_reference_gpt4_judgement.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/mt_bench/response_assessment/rating 2026-05-27T11:53:53,781 copying build/lib/unitxt/catalog/cards/mt_bench/response_assessment/rating/single_turn_gpt4_judgement.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/mt_bench/response_assessment/rating 2026-05-27T11:53:53,783 copying build/lib/unitxt/catalog/cards/mt_bench/response_assessment/rating/multi_turn_gpt4_judgement.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/mt_bench/response_assessment/rating 2026-05-27T11:53:53,785 copying build/lib/unitxt/catalog/cards/mt_bench/response_assessment/rating/single_turn_with_reference_gpt4_judgement.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/mt_bench/response_assessment/rating 2026-05-27T11:53:53,788 copying build/lib/unitxt/catalog/cards/argument_topic.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards 2026-05-27T11:53:53,790 creating build/bdist.linux-armv7l/wheel/unitxt/catalog/cards/boolq 2026-05-27T11:53:53,791 copying build/lib/unitxt/catalog/cards/boolq/classification.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/boolq 2026-05-27T11:53:53,793 copying build/lib/unitxt/catalog/cards/boolq/multiple_choice.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/boolq 2026-05-27T11:53:53,795 creating build/bdist.linux-armv7l/wheel/unitxt/catalog/cards/arena_hard 2026-05-27T11:53:53,797 creating build/bdist.linux-armv7l/wheel/unitxt/catalog/cards/arena_hard/generation 2026-05-27T11:53:53,798 copying build/lib/unitxt/catalog/cards/arena_hard/generation/english_gpt_4_0314_reference.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/arena_hard/generation 2026-05-27T11:53:53,800 creating build/bdist.linux-armv7l/wheel/unitxt/catalog/cards/arena_hard/response_assessment 2026-05-27T11:53:53,802 creating build/bdist.linux-armv7l/wheel/unitxt/catalog/cards/arena_hard/response_assessment/pairwise_comparative_rating 2026-05-27T11:53:53,803 copying build/lib/unitxt/catalog/cards/arena_hard/response_assessment/pairwise_comparative_rating/both_games_mean_judgment_gpt4_judge.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/arena_hard/response_assessment/pairwise_comparative_rating 2026-05-27T11:53:53,805 copying build/lib/unitxt/catalog/cards/arena_hard/response_assessment/pairwise_comparative_rating/first_game_only_gpt_4_judge.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/arena_hard/response_assessment/pairwise_comparative_rating 2026-05-27T11:53:53,807 copying build/lib/unitxt/catalog/cards/arena_hard/response_assessment/pairwise_comparative_rating/both_games_gpt_4_judge.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/arena_hard/response_assessment/pairwise_comparative_rating 2026-05-27T11:53:53,809 copying build/lib/unitxt/catalog/cards/websrc.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards 2026-05-27T11:53:53,811 copying build/lib/unitxt/catalog/cards/summarize_from_human_feedback.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards 2026-05-27T11:53:53,812 copying build/lib/unitxt/catalog/cards/hellaswag.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards 2026-05-27T11:53:53,814 copying build/lib/unitxt/catalog/cards/tldr.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards 2026-05-27T11:53:53,816 copying build/lib/unitxt/catalog/cards/pop_qa.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards 2026-05-27T11:53:53,819 creating build/bdist.linux-armv7l/wheel/unitxt/catalog/cards/cohere_for_ai 2026-05-27T11:53:53,820 creating build/bdist.linux-armv7l/wheel/unitxt/catalog/cards/cohere_for_ai/dolly_machine_translated 2026-05-27T11:53:53,821 copying build/lib/unitxt/catalog/cards/cohere_for_ai/dolly_machine_translated/deu.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/cohere_for_ai/dolly_machine_translated 2026-05-27T11:53:53,823 copying build/lib/unitxt/catalog/cards/cohere_for_ai/dolly_machine_translated/por.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/cohere_for_ai/dolly_machine_translated 2026-05-27T11:53:53,825 copying build/lib/unitxt/catalog/cards/cohere_for_ai/dolly_machine_translated/fra.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/cohere_for_ai/dolly_machine_translated 2026-05-27T11:53:53,827 copying build/lib/unitxt/catalog/cards/cohere_for_ai/dolly_machine_translated/spa.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/cohere_for_ai/dolly_machine_translated 2026-05-27T11:53:53,829 copying build/lib/unitxt/catalog/cards/cohere_for_ai/dolly_machine_translated/eng.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/cohere_for_ai/dolly_machine_translated 2026-05-27T11:53:53,831 copying build/lib/unitxt/catalog/cards/cohere_for_ai/dolly_machine_translated/jpn.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/cohere_for_ai/dolly_machine_translated 2026-05-27T11:53:53,834 creating build/bdist.linux-armv7l/wheel/unitxt/catalog/cards/cohere_for_ai/dolly_human_edited 2026-05-27T11:53:53,835 copying build/lib/unitxt/catalog/cards/cohere_for_ai/dolly_human_edited/fra.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/cohere_for_ai/dolly_human_edited 2026-05-27T11:53:53,837 copying build/lib/unitxt/catalog/cards/cohere_for_ai/dolly_human_edited/spa.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/cohere_for_ai/dolly_human_edited 2026-05-27T11:53:53,839 creating build/bdist.linux-armv7l/wheel/unitxt/catalog/cards/cohere_for_ai/aya_human_annotated 2026-05-27T11:53:53,840 copying build/lib/unitxt/catalog/cards/cohere_for_ai/aya_human_annotated/tel.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/cohere_for_ai/aya_human_annotated 2026-05-27T11:53:53,842 copying build/lib/unitxt/catalog/cards/cohere_for_ai/aya_human_annotated/arb.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/cohere_for_ai/aya_human_annotated 2026-05-27T11:53:53,844 copying build/lib/unitxt/catalog/cards/cohere_for_ai/aya_human_annotated/yor.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/cohere_for_ai/aya_human_annotated 2026-05-27T11:53:53,846 copying build/lib/unitxt/catalog/cards/cohere_for_ai/aya_human_annotated/por.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/cohere_for_ai/aya_human_annotated 2026-05-27T11:53:53,848 copying build/lib/unitxt/catalog/cards/cohere_for_ai/aya_human_annotated/tur.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/cohere_for_ai/aya_human_annotated 2026-05-27T11:53:53,850 copying build/lib/unitxt/catalog/cards/cohere_for_ai/aya_human_annotated/eng.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/cohere_for_ai/aya_human_annotated 2026-05-27T11:53:53,852 copying build/lib/unitxt/catalog/cards/cohere_for_ai/aya_human_annotated/zho.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/cohere_for_ai/aya_human_annotated 2026-05-27T11:53:53,854 creating build/bdist.linux-armv7l/wheel/unitxt/catalog/cards/global_mmlu_lite_cs 2026-05-27T11:53:53,855 copying build/lib/unitxt/catalog/cards/global_mmlu_lite_cs/ja.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu_lite_cs 2026-05-27T11:53:53,858 copying build/lib/unitxt/catalog/cards/global_mmlu_lite_cs/zh.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu_lite_cs 2026-05-27T11:53:53,860 copying build/lib/unitxt/catalog/cards/global_mmlu_lite_cs/bn.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu_lite_cs 2026-05-27T11:53:53,863 copying build/lib/unitxt/catalog/cards/global_mmlu_lite_cs/ko.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu_lite_cs 2026-05-27T11:53:53,865 copying build/lib/unitxt/catalog/cards/global_mmlu_lite_cs/de.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu_lite_cs 2026-05-27T11:53:53,868 copying build/lib/unitxt/catalog/cards/global_mmlu_lite_cs/it.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu_lite_cs 2026-05-27T11:53:53,870 copying build/lib/unitxt/catalog/cards/global_mmlu_lite_cs/fr.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu_lite_cs 2026-05-27T11:53:53,872 copying build/lib/unitxt/catalog/cards/global_mmlu_lite_cs/ar.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu_lite_cs 2026-05-27T11:53:53,875 copying build/lib/unitxt/catalog/cards/global_mmlu_lite_cs/es.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu_lite_cs 2026-05-27T11:53:53,877 copying build/lib/unitxt/catalog/cards/global_mmlu_lite_cs/yo.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu_lite_cs 2026-05-27T11:53:53,879 copying build/lib/unitxt/catalog/cards/global_mmlu_lite_cs/pt.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu_lite_cs 2026-05-27T11:53:53,881 copying build/lib/unitxt/catalog/cards/global_mmlu_lite_cs/sw.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu_lite_cs 2026-05-27T11:53:53,884 copying build/lib/unitxt/catalog/cards/global_mmlu_lite_cs/hi.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu_lite_cs 2026-05-27T11:53:53,886 copying build/lib/unitxt/catalog/cards/global_mmlu_lite_cs/id.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu_lite_cs 2026-05-27T11:53:53,889 creating build/bdist.linux-armv7l/wheel/unitxt/catalog/cards/global_mmlu_lite_ca 2026-05-27T11:53:53,890 copying build/lib/unitxt/catalog/cards/global_mmlu_lite_ca/ja.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu_lite_ca 2026-05-27T11:53:53,892 copying build/lib/unitxt/catalog/cards/global_mmlu_lite_ca/zh.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu_lite_ca 2026-05-27T11:53:53,894 copying build/lib/unitxt/catalog/cards/global_mmlu_lite_ca/bn.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu_lite_ca 2026-05-27T11:53:53,896 copying build/lib/unitxt/catalog/cards/global_mmlu_lite_ca/ko.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu_lite_ca 2026-05-27T11:53:53,899 copying build/lib/unitxt/catalog/cards/global_mmlu_lite_ca/de.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu_lite_ca 2026-05-27T11:53:53,901 copying build/lib/unitxt/catalog/cards/global_mmlu_lite_ca/it.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu_lite_ca 2026-05-27T11:53:53,903 copying build/lib/unitxt/catalog/cards/global_mmlu_lite_ca/fr.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu_lite_ca 2026-05-27T11:53:53,905 copying build/lib/unitxt/catalog/cards/global_mmlu_lite_ca/ar.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu_lite_ca 2026-05-27T11:53:53,908 copying build/lib/unitxt/catalog/cards/global_mmlu_lite_ca/es.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu_lite_ca 2026-05-27T11:53:53,910 copying build/lib/unitxt/catalog/cards/global_mmlu_lite_ca/yo.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu_lite_ca 2026-05-27T11:53:53,912 copying build/lib/unitxt/catalog/cards/global_mmlu_lite_ca/pt.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu_lite_ca 2026-05-27T11:53:53,914 copying build/lib/unitxt/catalog/cards/global_mmlu_lite_ca/sw.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu_lite_ca 2026-05-27T11:53:53,917 copying build/lib/unitxt/catalog/cards/global_mmlu_lite_ca/hi.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu_lite_ca 2026-05-27T11:53:53,919 copying build/lib/unitxt/catalog/cards/global_mmlu_lite_ca/id.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/global_mmlu_lite_ca 2026-05-27T11:53:53,922 copying build/lib/unitxt/catalog/cards/coedit_gec.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards 2026-05-27T11:53:53,924 copying build/lib/unitxt/catalog/cards/20_newsgroups_short.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards 2026-05-27T11:53:53,926 creating build/bdist.linux-armv7l/wheel/unitxt/catalog/cards/tot 2026-05-27T11:53:53,927 copying build/lib/unitxt/catalog/cards/tot/arithmetic.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/tot 2026-05-27T11:53:53,929 copying build/lib/unitxt/catalog/cards/tot/semantic.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/tot 2026-05-27T11:53:53,932 creating build/bdist.linux-armv7l/wheel/unitxt/catalog/cards/amazon_mass 2026-05-27T11:53:53,933 copying build/lib/unitxt/catalog/cards/amazon_mass/th_TH.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/amazon_mass 2026-05-27T11:53:53,935 copying build/lib/unitxt/catalog/cards/amazon_mass/ro_RO.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/amazon_mass 2026-05-27T11:53:53,937 copying build/lib/unitxt/catalog/cards/amazon_mass/da_DK.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/amazon_mass 2026-05-27T11:53:53,940 copying build/lib/unitxt/catalog/cards/amazon_mass/nb_NO.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/amazon_mass 2026-05-27T11:53:53,942 copying build/lib/unitxt/catalog/cards/amazon_mass/zh_TW.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/amazon_mass 2026-05-27T11:53:53,944 copying build/lib/unitxt/catalog/cards/amazon_mass/nl_NL.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/amazon_mass 2026-05-27T11:53:53,947 copying build/lib/unitxt/catalog/cards/amazon_mass/is_IS.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/amazon_mass 2026-05-27T11:53:53,949 copying build/lib/unitxt/catalog/cards/amazon_mass/de_DE.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/amazon_mass 2026-05-27T11:53:53,951 copying build/lib/unitxt/catalog/cards/amazon_mass/hi_IN.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/amazon_mass 2026-05-27T11:53:53,953 copying build/lib/unitxt/catalog/cards/amazon_mass/es_ES.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/amazon_mass 2026-05-27T11:53:53,956 creating build/bdist.linux-armv7l/wheel/unitxt/catalog/cards/amazon_mass/all_1 2026-05-27T11:53:53,960 copying build/lib/unitxt/catalog/cards/amazon_mass/all_1/1.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/amazon_mass/all_1 2026-05-27T11:53:53,962 copying build/lib/unitxt/catalog/cards/amazon_mass/fa_IR.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/amazon_mass 2026-05-27T11:53:53,964 copying build/lib/unitxt/catalog/cards/amazon_mass/my_MM.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/amazon_mass 2026-05-27T11:53:53,967 copying build/lib/unitxt/catalog/cards/amazon_mass/ja_JP.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/amazon_mass 2026-05-27T11:53:53,969 copying build/lib/unitxt/catalog/cards/amazon_mass/he_IL.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/amazon_mass 2026-05-27T11:53:53,971 copying build/lib/unitxt/catalog/cards/amazon_mass/mn_MN.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/amazon_mass 2026-05-27T11:53:53,974 copying build/lib/unitxt/catalog/cards/amazon_mass/az_AZ.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/amazon_mass 2026-05-27T11:53:53,976 copying build/lib/unitxt/catalog/cards/amazon_mass/am_ET.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/amazon_mass 2026-05-27T11:53:53,978 copying build/lib/unitxt/catalog/cards/amazon_mass/bn_BD.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/amazon_mass 2026-05-27T11:53:53,981 copying build/lib/unitxt/catalog/cards/amazon_mass/kn_IN.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/amazon_mass 2026-05-27T11:53:53,983 copying build/lib/unitxt/catalog/cards/amazon_mass/tr_TR.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/amazon_mass 2026-05-27T11:53:53,985 copying build/lib/unitxt/catalog/cards/amazon_mass/ru_RU.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/amazon_mass 2026-05-27T11:53:53,988 copying build/lib/unitxt/catalog/cards/amazon_mass/sw_KE.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/amazon_mass 2026-05-27T11:53:53,990 copying build/lib/unitxt/catalog/cards/amazon_mass/hy_AM.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/amazon_mass 2026-05-27T11:53:53,992 copying build/lib/unitxt/catalog/cards/amazon_mass/fi_FI.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/amazon_mass 2026-05-27T11:53:53,994 copying build/lib/unitxt/catalog/cards/amazon_mass/hu_HU.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/amazon_mass 2026-05-27T11:53:53,997 copying build/lib/unitxt/catalog/cards/amazon_mass/vi_VN.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/amazon_mass 2026-05-27T11:53:53,999 copying build/lib/unitxt/catalog/cards/amazon_mass/en_US.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/amazon_mass 2026-05-27T11:53:54,001 copying build/lib/unitxt/catalog/cards/amazon_mass/cy_GB.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/amazon_mass 2026-05-27T11:53:54,003 copying build/lib/unitxt/catalog/cards/amazon_mass/lv_LV.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/amazon_mass 2026-05-27T11:53:54,005 copying build/lib/unitxt/catalog/cards/amazon_mass/el_GR.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/amazon_mass 2026-05-27T11:53:54,008 copying build/lib/unitxt/catalog/cards/amazon_mass/pl_PL.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/amazon_mass 2026-05-27T11:53:54,010 copying build/lib/unitxt/catalog/cards/amazon_mass/te_IN.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/amazon_mass 2026-05-27T11:53:54,012 copying build/lib/unitxt/catalog/cards/amazon_mass/ca_ES.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/amazon_mass 2026-05-27T11:53:54,014 copying build/lib/unitxt/catalog/cards/amazon_mass/ar_SA.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/amazon_mass 2026-05-27T11:53:54,017 copying build/lib/unitxt/catalog/cards/amazon_mass/sq_AL.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/amazon_mass 2026-05-27T11:53:54,019 copying build/lib/unitxt/catalog/cards/amazon_mass/jv_ID.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/amazon_mass 2026-05-27T11:53:54,021 copying build/lib/unitxt/catalog/cards/amazon_mass/km_KH.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/amazon_mass 2026-05-27T11:53:54,024 copying build/lib/unitxt/catalog/cards/amazon_mass/pt_PT.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/amazon_mass 2026-05-27T11:53:54,026 copying build/lib/unitxt/catalog/cards/amazon_mass/zh_CN.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/amazon_mass 2026-05-27T11:53:54,028 copying build/lib/unitxt/catalog/cards/amazon_mass/af_ZA.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/amazon_mass 2026-05-27T11:53:54,031 copying build/lib/unitxt/catalog/cards/amazon_mass/ml_IN.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/amazon_mass 2026-05-27T11:53:54,033 copying build/lib/unitxt/catalog/cards/amazon_mass/it_IT.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/amazon_mass 2026-05-27T11:53:54,035 copying build/lib/unitxt/catalog/cards/amazon_mass/ms_MY.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/amazon_mass 2026-05-27T11:53:54,038 copying build/lib/unitxt/catalog/cards/amazon_mass/all.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/amazon_mass 2026-05-27T11:53:54,040 copying build/lib/unitxt/catalog/cards/amazon_mass/sl_SL.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/amazon_mass 2026-05-27T11:53:54,042 copying build/lib/unitxt/catalog/cards/amazon_mass/id_ID.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/amazon_mass 2026-05-27T11:53:54,045 copying build/lib/unitxt/catalog/cards/amazon_mass/tl_PH.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/amazon_mass 2026-05-27T11:53:54,047 copying build/lib/unitxt/catalog/cards/amazon_mass/ta_IN.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/amazon_mass 2026-05-27T11:53:54,049 copying build/lib/unitxt/catalog/cards/amazon_mass/ka_GE.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/amazon_mass 2026-05-27T11:53:54,052 copying build/lib/unitxt/catalog/cards/amazon_mass/fr_FR.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/amazon_mass 2026-05-27T11:53:54,054 copying build/lib/unitxt/catalog/cards/amazon_mass/sv_SE.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/amazon_mass 2026-05-27T11:53:54,057 copying build/lib/unitxt/catalog/cards/amazon_mass/ur_PK.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/amazon_mass 2026-05-27T11:53:54,060 copying build/lib/unitxt/catalog/cards/amazon_mass/ko_KR.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/amazon_mass 2026-05-27T11:53:54,062 copying build/lib/unitxt/catalog/cards/turl_col_type.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards 2026-05-27T11:53:54,065 copying build/lib/unitxt/catalog/cards/fin_qa.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards 2026-05-27T11:53:54,067 copying build/lib/unitxt/catalog/cards/wsc.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards 2026-05-27T11:53:54,069 copying build/lib/unitxt/catalog/cards/dbpedia_14.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards 2026-05-27T11:53:54,071 copying build/lib/unitxt/catalog/cards/race_middle.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards 2026-05-27T11:53:54,073 creating build/bdist.linux-armv7l/wheel/unitxt/catalog/cards/gpqa 2026-05-27T11:53:54,074 copying build/lib/unitxt/catalog/cards/gpqa/extended.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/gpqa 2026-05-27T11:53:54,076 copying build/lib/unitxt/catalog/cards/gpqa/diamond.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/gpqa 2026-05-27T11:53:54,078 copying build/lib/unitxt/catalog/cards/gpqa/main.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/gpqa 2026-05-27T11:53:54,081 creating build/bdist.linux-armv7l/wheel/unitxt/catalog/cards/clinc_oos 2026-05-27T11:53:54,082 copying build/lib/unitxt/catalog/cards/clinc_oos/small.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/clinc_oos 2026-05-27T11:53:54,084 copying build/lib/unitxt/catalog/cards/clinc_oos/imbalanced.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/clinc_oos 2026-05-27T11:53:54,087 copying build/lib/unitxt/catalog/cards/clinc_oos/plus.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/clinc_oos 2026-05-27T11:53:54,089 copying build/lib/unitxt/catalog/cards/tablebench_numerical_reasoning.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards 2026-05-27T11:53:54,091 copying build/lib/unitxt/catalog/cards/ag_news.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards 2026-05-27T11:53:54,093 copying build/lib/unitxt/catalog/cards/wnli.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards 2026-05-27T11:53:54,095 copying build/lib/unitxt/catalog/cards/wiki_bio.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards 2026-05-27T11:53:54,097 copying build/lib/unitxt/catalog/cards/stsb.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards 2026-05-27T11:53:54,099 copying build/lib/unitxt/catalog/cards/bold.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards 2026-05-27T11:53:54,102 creating build/bdist.linux-armv7l/wheel/unitxt/catalog/cards/20_newsgroups 2026-05-27T11:53:54,103 copying build/lib/unitxt/catalog/cards/20_newsgroups/sklearn.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/20_newsgroups 2026-05-27T11:53:54,105 creating build/bdist.linux-armv7l/wheel/unitxt/catalog/cards/doc_vqa 2026-05-27T11:53:54,107 copying build/lib/unitxt/catalog/cards/doc_vqa/fr.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/doc_vqa 2026-05-27T11:53:54,109 copying build/lib/unitxt/catalog/cards/doc_vqa/en.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/doc_vqa 2026-05-27T11:53:54,111 copying build/lib/unitxt/catalog/cards/doc_vqa/lmms_eval.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/doc_vqa 2026-05-27T11:53:54,113 creating build/bdist.linux-armv7l/wheel/unitxt/catalog/cards/legalbench 2026-05-27T11:53:54,115 copying build/lib/unitxt/catalog/cards/legalbench/proa.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/legalbench 2026-05-27T11:53:54,117 copying build/lib/unitxt/catalog/cards/legalbench/international_citizenship_questions.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/legalbench 2026-05-27T11:53:54,118 copying build/lib/unitxt/catalog/cards/legalbench/corporate_lobbying.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/legalbench 2026-05-27T11:53:54,120 copying build/lib/unitxt/catalog/cards/legalbench/function_of_decision_section.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/legalbench 2026-05-27T11:53:54,122 copying build/lib/unitxt/catalog/cards/legalbench/abercrombie.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/legalbench 2026-05-27T11:53:54,124 copying build/lib/unitxt/catalog/cards/toxigen.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards 2026-05-27T11:53:54,127 creating build/bdist.linux-armv7l/wheel/unitxt/catalog/cards/mlsum 2026-05-27T11:53:54,128 copying build/lib/unitxt/catalog/cards/mlsum/de.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/mlsum 2026-05-27T11:53:54,129 copying build/lib/unitxt/catalog/cards/mlsum/ru.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/mlsum 2026-05-27T11:53:54,131 copying build/lib/unitxt/catalog/cards/mlsum/fr.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/mlsum 2026-05-27T11:53:54,133 copying build/lib/unitxt/catalog/cards/mlsum/es.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/mlsum 2026-05-27T11:53:54,135 copying build/lib/unitxt/catalog/cards/mlsum/tu.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/mlsum 2026-05-27T11:53:54,137 copying build/lib/unitxt/catalog/cards/atta_q.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards 2026-05-27T11:53:54,139 copying build/lib/unitxt/catalog/cards/billsum.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards 2026-05-27T11:53:54,142 creating build/bdist.linux-armv7l/wheel/unitxt/catalog/cards/multidoc2dial 2026-05-27T11:53:54,143 copying build/lib/unitxt/catalog/cards/multidoc2dial/abstractive.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/multidoc2dial 2026-05-27T11:53:54,145 copying build/lib/unitxt/catalog/cards/multidoc2dial/extractive.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/multidoc2dial 2026-05-27T11:53:54,148 copying build/lib/unitxt/catalog/cards/mbpp.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards 2026-05-27T11:53:54,151 creating build/bdist.linux-armv7l/wheel/unitxt/catalog/cards/babi 2026-05-27T11:53:54,152 copying build/lib/unitxt/catalog/cards/babi/qa.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/babi 2026-05-27T11:53:54,154 creating build/bdist.linux-armv7l/wheel/unitxt/catalog/cards/boolq_indic 2026-05-27T11:53:54,156 creating build/bdist.linux-armv7l/wheel/unitxt/catalog/cards/boolq_indic/hi 2026-05-27T11:53:54,157 copying build/lib/unitxt/catalog/cards/boolq_indic/hi/classification.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/boolq_indic/hi 2026-05-27T11:53:54,159 copying build/lib/unitxt/catalog/cards/boolq_indic/hi/multiple_choice.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/boolq_indic/hi 2026-05-27T11:53:54,161 creating build/bdist.linux-armv7l/wheel/unitxt/catalog/cards/boolq_indic/bn 2026-05-27T11:53:54,163 copying build/lib/unitxt/catalog/cards/boolq_indic/bn/classification.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/boolq_indic/bn 2026-05-27T11:53:54,165 copying build/lib/unitxt/catalog/cards/boolq_indic/bn/multiple_choice.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/boolq_indic/bn 2026-05-27T11:53:54,167 creating build/bdist.linux-armv7l/wheel/unitxt/catalog/cards/boolq_indic/ta 2026-05-27T11:53:54,168 copying build/lib/unitxt/catalog/cards/boolq_indic/ta/classification.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/boolq_indic/ta 2026-05-27T11:53:54,170 copying build/lib/unitxt/catalog/cards/boolq_indic/ta/multiple_choice.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/boolq_indic/ta 2026-05-27T11:53:54,173 creating build/bdist.linux-armv7l/wheel/unitxt/catalog/cards/boolq_indic/mr 2026-05-27T11:53:54,174 copying build/lib/unitxt/catalog/cards/boolq_indic/mr/classification.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/boolq_indic/mr 2026-05-27T11:53:54,176 copying build/lib/unitxt/catalog/cards/boolq_indic/mr/multiple_choice.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/boolq_indic/mr 2026-05-27T11:53:54,178 creating build/bdist.linux-armv7l/wheel/unitxt/catalog/cards/boolq_indic/te 2026-05-27T11:53:54,179 copying build/lib/unitxt/catalog/cards/boolq_indic/te/classification.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/boolq_indic/te 2026-05-27T11:53:54,181 copying build/lib/unitxt/catalog/cards/boolq_indic/te/multiple_choice.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/boolq_indic/te 2026-05-27T11:53:54,184 creating build/bdist.linux-armv7l/wheel/unitxt/catalog/cards/boolq_indic/ml 2026-05-27T11:53:54,185 copying build/lib/unitxt/catalog/cards/boolq_indic/ml/classification.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/boolq_indic/ml 2026-05-27T11:53:54,187 copying build/lib/unitxt/catalog/cards/boolq_indic/ml/multiple_choice.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/boolq_indic/ml 2026-05-27T11:53:54,189 creating build/bdist.linux-armv7l/wheel/unitxt/catalog/cards/boolq_indic/or 2026-05-27T11:53:54,190 copying build/lib/unitxt/catalog/cards/boolq_indic/or/classification.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/boolq_indic/or 2026-05-27T11:53:54,192 copying build/lib/unitxt/catalog/cards/boolq_indic/or/multiple_choice.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/boolq_indic/or 2026-05-27T11:53:54,195 creating build/bdist.linux-armv7l/wheel/unitxt/catalog/cards/boolq_indic/kn 2026-05-27T11:53:54,196 copying build/lib/unitxt/catalog/cards/boolq_indic/kn/classification.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/boolq_indic/kn 2026-05-27T11:53:54,198 copying build/lib/unitxt/catalog/cards/boolq_indic/kn/multiple_choice.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/boolq_indic/kn 2026-05-27T11:53:54,200 creating build/bdist.linux-armv7l/wheel/unitxt/catalog/cards/boolq_indic/gu 2026-05-27T11:53:54,201 copying build/lib/unitxt/catalog/cards/boolq_indic/gu/classification.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/boolq_indic/gu 2026-05-27T11:53:54,203 copying build/lib/unitxt/catalog/cards/boolq_indic/gu/multiple_choice.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/boolq_indic/gu 2026-05-27T11:53:54,206 creating build/bdist.linux-armv7l/wheel/unitxt/catalog/cards/boolq_indic/pa 2026-05-27T11:53:54,207 copying build/lib/unitxt/catalog/cards/boolq_indic/pa/classification.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/boolq_indic/pa 2026-05-27T11:53:54,209 copying build/lib/unitxt/catalog/cards/boolq_indic/pa/multiple_choice.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/boolq_indic/pa 2026-05-27T11:53:54,211 copying build/lib/unitxt/catalog/cards/trec.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards 2026-05-27T11:53:54,214 copying build/lib/unitxt/catalog/cards/tablebench.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards 2026-05-27T11:53:54,217 creating build/bdist.linux-armv7l/wheel/unitxt/catalog/cards/xnli 2026-05-27T11:53:54,218 copying build/lib/unitxt/catalog/cards/xnli/zh.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/xnli 2026-05-27T11:53:54,220 copying build/lib/unitxt/catalog/cards/xnli/bg.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/xnli 2026-05-27T11:53:54,222 copying build/lib/unitxt/catalog/cards/xnli/de.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/xnli 2026-05-27T11:53:54,224 copying build/lib/unitxt/catalog/cards/xnli/th.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/xnli 2026-05-27T11:53:54,227 copying build/lib/unitxt/catalog/cards/xnli/ru.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/xnli 2026-05-27T11:53:54,229 copying build/lib/unitxt/catalog/cards/xnli/fr.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/xnli 2026-05-27T11:53:54,231 copying build/lib/unitxt/catalog/cards/xnli/ar.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/xnli 2026-05-27T11:53:54,233 copying build/lib/unitxt/catalog/cards/xnli/es.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/xnli 2026-05-27T11:53:54,235 copying build/lib/unitxt/catalog/cards/xnli/en.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/xnli 2026-05-27T11:53:54,237 copying build/lib/unitxt/catalog/cards/xnli/ur.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/xnli 2026-05-27T11:53:54,239 copying build/lib/unitxt/catalog/cards/xnli/sw.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/xnli 2026-05-27T11:53:54,241 copying build/lib/unitxt/catalog/cards/xnli/hi.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/xnli 2026-05-27T11:53:54,243 copying build/lib/unitxt/catalog/cards/xnli/tr.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/xnli 2026-05-27T11:53:54,245 copying build/lib/unitxt/catalog/cards/xnli/vi.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/xnli 2026-05-27T11:53:54,246 copying build/lib/unitxt/catalog/cards/xnli/el.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards/xnli 2026-05-27T11:53:54,249 copying build/lib/unitxt/catalog/cards/xlam_function_calling_60k.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/cards 2026-05-27T11:53:54,252 creating build/bdist.linux-armv7l/wheel/unitxt/catalog/recipes 2026-05-27T11:53:54,253 creating build/bdist.linux-armv7l/wheel/unitxt/catalog/recipes/bluebench 2026-05-27T11:53:54,255 creating build/bdist.linux-armv7l/wheel/unitxt/catalog/recipes/bluebench/summarization 2026-05-27T11:53:54,256 copying build/lib/unitxt/catalog/recipes/bluebench/summarization/tldr_document_filtered_to_6000_chars.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/recipes/bluebench/summarization 2026-05-27T11:53:54,258 copying build/lib/unitxt/catalog/recipes/bluebench/summarization/billsum_document_filtered_to_6000_chars.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/recipes/bluebench/summarization 2026-05-27T11:53:54,261 creating build/bdist.linux-armv7l/wheel/unitxt/catalog/recipes/bluebench/translation 2026-05-27T11:53:54,262 copying build/lib/unitxt/catalog/recipes/bluebench/translation/mt_flores_101_eng_ara.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/recipes/bluebench/translation 2026-05-27T11:53:54,264 copying build/lib/unitxt/catalog/recipes/bluebench/translation/mt_flores_101_ara_eng.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/recipes/bluebench/translation 2026-05-27T11:53:54,266 copying build/lib/unitxt/catalog/recipes/bluebench/translation/mt_flores_101_deu_eng.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/recipes/bluebench/translation 2026-05-27T11:53:54,268 copying build/lib/unitxt/catalog/recipes/bluebench/translation/mt_flores_101_eng_deu.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/recipes/bluebench/translation 2026-05-27T11:53:54,271 copying build/lib/unitxt/catalog/recipes/bluebench/translation/mt_flores_101_kor_eng.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/recipes/bluebench/translation 2026-05-27T11:53:54,273 copying build/lib/unitxt/catalog/recipes/bluebench/translation/mt_flores_101_spa_eng.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/recipes/bluebench/translation 2026-05-27T11:53:54,275 copying build/lib/unitxt/catalog/recipes/bluebench/translation/mt_flores_101_fra_eng.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/recipes/bluebench/translation 2026-05-27T11:53:54,277 copying build/lib/unitxt/catalog/recipes/bluebench/translation/mt_flores_101_jpn_eng.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/recipes/bluebench/translation 2026-05-27T11:53:54,279 copying build/lib/unitxt/catalog/recipes/bluebench/translation/mt_flores_101_eng_por.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/recipes/bluebench/translation 2026-05-27T11:53:54,282 copying build/lib/unitxt/catalog/recipes/bluebench/translation/mt_flores_101_eng_fra.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/recipes/bluebench/translation 2026-05-27T11:53:54,284 copying build/lib/unitxt/catalog/recipes/bluebench/translation/mt_flores_101_eng_ron.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/recipes/bluebench/translation 2026-05-27T11:53:54,286 copying build/lib/unitxt/catalog/recipes/bluebench/translation/mt_flores_101_ron_eng.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/recipes/bluebench/translation 2026-05-27T11:53:54,288 copying build/lib/unitxt/catalog/recipes/bluebench/translation/mt_flores_101_por_eng.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/recipes/bluebench/translation 2026-05-27T11:53:54,290 copying build/lib/unitxt/catalog/recipes/bluebench/translation/mt_flores_101_eng_kor.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/recipes/bluebench/translation 2026-05-27T11:53:54,292 copying build/lib/unitxt/catalog/recipes/bluebench/translation/mt_flores_101_eng_spa.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/recipes/bluebench/translation 2026-05-27T11:53:54,295 creating build/bdist.linux-armv7l/wheel/unitxt/catalog/recipes/bluebench/rag_general 2026-05-27T11:53:54,296 copying build/lib/unitxt/catalog/recipes/bluebench/rag_general/rag_response_generation_clapnq.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/recipes/bluebench/rag_general 2026-05-27T11:53:54,299 creating build/bdist.linux-armv7l/wheel/unitxt/catalog/recipes/bluebench/reasoning 2026-05-27T11:53:54,301 copying build/lib/unitxt/catalog/recipes/bluebench/reasoning/openbook_qa.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/recipes/bluebench/reasoning 2026-05-27T11:53:54,303 copying build/lib/unitxt/catalog/recipes/bluebench/reasoning/hellaswag.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/recipes/bluebench/reasoning 2026-05-27T11:53:54,306 creating build/bdist.linux-armv7l/wheel/unitxt/catalog/recipes/bluebench/safety 2026-05-27T11:53:54,307 copying build/lib/unitxt/catalog/recipes/bluebench/safety/attaq_500.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/recipes/bluebench/safety 2026-05-27T11:53:54,310 creating build/bdist.linux-armv7l/wheel/unitxt/catalog/recipes/bluebench/news_classification 2026-05-27T11:53:54,312 copying build/lib/unitxt/catalog/recipes/bluebench/news_classification/20_newsgroups_short.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/recipes/bluebench/news_classification 2026-05-27T11:53:54,315 creating build/bdist.linux-armv7l/wheel/unitxt/catalog/recipes/bluebench/entity_extraction 2026-05-27T11:53:54,316 copying build/lib/unitxt/catalog/recipes/bluebench/entity_extraction/universal_ner_en_ewt.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/recipes/bluebench/entity_extraction 2026-05-27T11:53:54,319 creating build/bdist.linux-armv7l/wheel/unitxt/catalog/recipes/bluebench/legal 2026-05-27T11:53:54,321 copying build/lib/unitxt/catalog/recipes/bluebench/legal/legalbench_corporate_lobbying.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/recipes/bluebench/legal 2026-05-27T11:53:54,323 copying build/lib/unitxt/catalog/recipes/bluebench/legal/legalbench_function_of_decision_section.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/recipes/bluebench/legal 2026-05-27T11:53:54,325 copying build/lib/unitxt/catalog/recipes/bluebench/legal/legalbench_international_citizenship_questions.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/recipes/bluebench/legal 2026-05-27T11:53:54,328 copying build/lib/unitxt/catalog/recipes/bluebench/legal/legalbench_proa.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/recipes/bluebench/legal 2026-05-27T11:53:54,330 copying build/lib/unitxt/catalog/recipes/bluebench/legal/legalbench_abercrombie.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/recipes/bluebench/legal 2026-05-27T11:53:54,333 creating build/bdist.linux-armv7l/wheel/unitxt/catalog/recipes/bluebench/chatbot_abilities 2026-05-27T11:53:54,334 copying build/lib/unitxt/catalog/recipes/bluebench/chatbot_abilities/arena_hard_generation_english_gpt_4_0314_reference.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/recipes/bluebench/chatbot_abilities 2026-05-27T11:53:54,337 creating build/bdist.linux-armv7l/wheel/unitxt/catalog/recipes/bluebench/bias 2026-05-27T11:53:54,339 copying build/lib/unitxt/catalog/recipes/bluebench/bias/safety_bbq_race_x_ses.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/recipes/bluebench/bias 2026-05-27T11:53:54,341 copying build/lib/unitxt/catalog/recipes/bluebench/bias/safety_bbq_gender_identity.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/recipes/bluebench/bias 2026-05-27T11:53:54,343 copying build/lib/unitxt/catalog/recipes/bluebench/bias/safety_bbq_race_x_gender.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/recipes/bluebench/bias 2026-05-27T11:53:54,345 copying build/lib/unitxt/catalog/recipes/bluebench/bias/safety_bbq_sexual_orientation.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/recipes/bluebench/bias 2026-05-27T11:53:54,348 copying build/lib/unitxt/catalog/recipes/bluebench/bias/safety_bbq_age.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/recipes/bluebench/bias 2026-05-27T11:53:54,350 copying build/lib/unitxt/catalog/recipes/bluebench/bias/safety_bbq_ses.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/recipes/bluebench/bias 2026-05-27T11:53:54,352 copying build/lib/unitxt/catalog/recipes/bluebench/bias/safety_bbq_nationality.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/recipes/bluebench/bias 2026-05-27T11:53:54,354 copying build/lib/unitxt/catalog/recipes/bluebench/bias/safety_bbq_disability_status.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/recipes/bluebench/bias 2026-05-27T11:53:54,356 copying build/lib/unitxt/catalog/recipes/bluebench/bias/safety_bbq_physical_appearance.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/recipes/bluebench/bias 2026-05-27T11:53:54,359 copying build/lib/unitxt/catalog/recipes/bluebench/bias/safety_bbq_race_ethnicity.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/recipes/bluebench/bias 2026-05-27T11:53:54,361 copying build/lib/unitxt/catalog/recipes/bluebench/bias/safety_bbq_religion.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/recipes/bluebench/bias 2026-05-27T11:53:54,364 creating build/bdist.linux-armv7l/wheel/unitxt/catalog/recipes/bluebench/product_help 2026-05-27T11:53:54,365 copying build/lib/unitxt/catalog/recipes/bluebench/product_help/cfpb_product_watsonx.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/recipes/bluebench/product_help 2026-05-27T11:53:54,367 copying build/lib/unitxt/catalog/recipes/bluebench/product_help/cfpb_product_2023.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/recipes/bluebench/product_help 2026-05-27T11:53:54,369 creating build/bdist.linux-armv7l/wheel/unitxt/catalog/recipes/bluebench/qa_finance 2026-05-27T11:53:54,370 copying build/lib/unitxt/catalog/recipes/bluebench/qa_finance/fin_qa.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/recipes/bluebench/qa_finance 2026-05-27T11:53:54,373 creating build/bdist.linux-armv7l/wheel/unitxt/catalog/recipes/bluebench/knowledge 2026-05-27T11:53:54,374 copying build/lib/unitxt/catalog/recipes/bluebench/knowledge/mmlu_pro_law.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/recipes/bluebench/knowledge 2026-05-27T11:53:54,376 copying build/lib/unitxt/catalog/recipes/bluebench/knowledge/mmlu_pro_engineering.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/recipes/bluebench/knowledge 2026-05-27T11:53:54,378 copying build/lib/unitxt/catalog/recipes/bluebench/knowledge/mmlu_pro_economics.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/recipes/bluebench/knowledge 2026-05-27T11:53:54,380 copying build/lib/unitxt/catalog/recipes/bluebench/knowledge/mmlu_pro_computer_science.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/recipes/bluebench/knowledge 2026-05-27T11:53:54,382 copying build/lib/unitxt/catalog/recipes/bluebench/knowledge/mmlu_pro_math.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/recipes/bluebench/knowledge 2026-05-27T11:53:54,383 copying build/lib/unitxt/catalog/recipes/bluebench/knowledge/mmlu_pro_chemistry.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/recipes/bluebench/knowledge 2026-05-27T11:53:54,385 copying build/lib/unitxt/catalog/recipes/bluebench/knowledge/mmlu_pro_biology.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/recipes/bluebench/knowledge 2026-05-27T11:53:54,388 copying build/lib/unitxt/catalog/recipes/bluebench/knowledge/mmlu_pro_other.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/recipes/bluebench/knowledge 2026-05-27T11:53:54,390 copying build/lib/unitxt/catalog/recipes/bluebench/knowledge/mmlu_pro_philosophy.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/recipes/bluebench/knowledge 2026-05-27T11:53:54,392 copying build/lib/unitxt/catalog/recipes/bluebench/knowledge/mmlu_pro_business.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/recipes/bluebench/knowledge 2026-05-27T11:53:54,394 copying build/lib/unitxt/catalog/recipes/bluebench/knowledge/mmlu_pro_physics.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/recipes/bluebench/knowledge 2026-05-27T11:53:54,396 copying build/lib/unitxt/catalog/recipes/bluebench/knowledge/mmlu_pro_history.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/recipes/bluebench/knowledge 2026-05-27T11:53:54,398 copying build/lib/unitxt/catalog/recipes/bluebench/knowledge/mmlu_pro_health.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/recipes/bluebench/knowledge 2026-05-27T11:53:54,400 copying build/lib/unitxt/catalog/recipes/bluebench/knowledge/mmlu_pro_psychology.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/recipes/bluebench/knowledge 2026-05-27T11:53:54,403 creating build/bdist.linux-armv7l/wheel/unitxt/catalog/recipes/torr 2026-05-27T11:53:54,404 creating build/bdist.linux-armv7l/wheel/unitxt/catalog/recipes/torr/tab_fact 2026-05-27T11:53:54,406 creating build/bdist.linux-armv7l/wheel/unitxt/catalog/recipes/torr/tab_fact/json 2026-05-27T11:53:54,407 copying build/lib/unitxt/catalog/recipes/torr/tab_fact/json/shuffle_cols_augmentation_5_demos.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/recipes/torr/tab_fact/json 2026-05-27T11:53:54,409 copying build/lib/unitxt/catalog/recipes/torr/tab_fact/json/insert_empty_rows_augmentation_5_demos.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/recipes/torr/tab_fact/json 2026-05-27T11:53:54,411 copying build/lib/unitxt/catalog/recipes/torr/tab_fact/json/no_augmentation_5_demos.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/recipes/torr/tab_fact/json 2026-05-27T11:53:54,413 copying build/lib/unitxt/catalog/recipes/torr/tab_fact/json/transpose_augmentation_5_demos.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/recipes/torr/tab_fact/json 2026-05-27T11:53:54,415 copying build/lib/unitxt/catalog/recipes/torr/tab_fact/json/shuffle_rows_augmentation_5_demos.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/recipes/torr/tab_fact/json 2026-05-27T11:53:54,418 creating build/bdist.linux-armv7l/wheel/unitxt/catalog/recipes/torr/tab_fact/df 2026-05-27T11:53:54,419 copying build/lib/unitxt/catalog/recipes/torr/tab_fact/df/shuffle_cols_augmentation_5_demos.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/recipes/torr/tab_fact/df 2026-05-27T11:53:54,421 copying build/lib/unitxt/catalog/recipes/torr/tab_fact/df/insert_empty_rows_augmentation_5_demos.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/recipes/torr/tab_fact/df 2026-05-27T11:53:54,423 copying build/lib/unitxt/catalog/recipes/torr/tab_fact/df/no_augmentation_5_demos.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/recipes/torr/tab_fact/df 2026-05-27T11:53:54,425 copying build/lib/unitxt/catalog/recipes/torr/tab_fact/df/transpose_augmentation_5_demos.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/recipes/torr/tab_fact/df 2026-05-27T11:53:54,427 copying build/lib/unitxt/catalog/recipes/torr/tab_fact/df/shuffle_rows_augmentation_5_demos.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/recipes/torr/tab_fact/df 2026-05-27T11:53:54,429 creating build/bdist.linux-armv7l/wheel/unitxt/catalog/recipes/torr/tab_fact/markdown 2026-05-27T11:53:54,430 copying build/lib/unitxt/catalog/recipes/torr/tab_fact/markdown/shuffle_cols_augmentation_5_demos.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/recipes/torr/tab_fact/markdown 2026-05-27T11:53:54,432 copying build/lib/unitxt/catalog/recipes/torr/tab_fact/markdown/insert_empty_rows_augmentation_5_demos.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/recipes/torr/tab_fact/markdown 2026-05-27T11:53:54,434 copying build/lib/unitxt/catalog/recipes/torr/tab_fact/markdown/no_augmentation_5_demos.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/recipes/torr/tab_fact/markdown 2026-05-27T11:53:54,436 copying build/lib/unitxt/catalog/recipes/torr/tab_fact/markdown/transpose_augmentation_5_demos.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/recipes/torr/tab_fact/markdown 2026-05-27T11:53:54,437 copying build/lib/unitxt/catalog/recipes/torr/tab_fact/markdown/shuffle_rows_augmentation_5_demos.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/recipes/torr/tab_fact/markdown 2026-05-27T11:53:54,440 creating build/bdist.linux-armv7l/wheel/unitxt/catalog/recipes/torr/tab_fact/concat 2026-05-27T11:53:54,441 copying build/lib/unitxt/catalog/recipes/torr/tab_fact/concat/shuffle_cols_augmentation_5_demos.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/recipes/torr/tab_fact/concat 2026-05-27T11:53:54,443 copying build/lib/unitxt/catalog/recipes/torr/tab_fact/concat/insert_empty_rows_augmentation_5_demos.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/recipes/torr/tab_fact/concat 2026-05-27T11:53:54,445 copying build/lib/unitxt/catalog/recipes/torr/tab_fact/concat/no_augmentation_5_demos.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/recipes/torr/tab_fact/concat 2026-05-27T11:53:54,447 copying build/lib/unitxt/catalog/recipes/torr/tab_fact/concat/transpose_augmentation_5_demos.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/recipes/torr/tab_fact/concat 2026-05-27T11:53:54,449 copying build/lib/unitxt/catalog/recipes/torr/tab_fact/concat/shuffle_rows_augmentation_5_demos.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/recipes/torr/tab_fact/concat 2026-05-27T11:53:54,451 creating build/bdist.linux-armv7l/wheel/unitxt/catalog/recipes/torr/tab_fact/csv 2026-05-27T11:53:54,452 copying build/lib/unitxt/catalog/recipes/torr/tab_fact/csv/shuffle_cols_augmentation_5_demos.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/recipes/torr/tab_fact/csv 2026-05-27T11:53:54,454 copying build/lib/unitxt/catalog/recipes/torr/tab_fact/csv/insert_empty_rows_augmentation_5_demos.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/recipes/torr/tab_fact/csv 2026-05-27T11:53:54,456 copying build/lib/unitxt/catalog/recipes/torr/tab_fact/csv/no_augmentation_5_demos.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/recipes/torr/tab_fact/csv 2026-05-27T11:53:54,458 copying build/lib/unitxt/catalog/recipes/torr/tab_fact/csv/transpose_augmentation_5_demos.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/recipes/torr/tab_fact/csv 2026-05-27T11:53:54,460 copying build/lib/unitxt/catalog/recipes/torr/tab_fact/csv/shuffle_rows_augmentation_5_demos.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/recipes/torr/tab_fact/csv 2026-05-27T11:53:54,462 creating build/bdist.linux-armv7l/wheel/unitxt/catalog/recipes/torr/tab_fact/indexed_row_major 2026-05-27T11:53:54,463 copying build/lib/unitxt/catalog/recipes/torr/tab_fact/indexed_row_major/shuffle_cols_augmentation_5_demos.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/recipes/torr/tab_fact/indexed_row_major 2026-05-27T11:53:54,465 copying build/lib/unitxt/catalog/recipes/torr/tab_fact/indexed_row_major/insert_empty_rows_augmentation_5_demos.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/recipes/torr/tab_fact/indexed_row_major 2026-05-27T11:53:54,467 copying build/lib/unitxt/catalog/recipes/torr/tab_fact/indexed_row_major/no_augmentation_5_demos.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/recipes/torr/tab_fact/indexed_row_major 2026-05-27T11:53:54,469 copying build/lib/unitxt/catalog/recipes/torr/tab_fact/indexed_row_major/transpose_augmentation_5_demos.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/recipes/torr/tab_fact/indexed_row_major 2026-05-27T11:53:54,472 copying build/lib/unitxt/catalog/recipes/torr/tab_fact/indexed_row_major/shuffle_rows_augmentation_5_demos.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/recipes/torr/tab_fact/indexed_row_major 2026-05-27T11:53:54,475 creating build/bdist.linux-armv7l/wheel/unitxt/catalog/recipes/torr/tab_fact/html 2026-05-27T11:53:54,476 copying build/lib/unitxt/catalog/recipes/torr/tab_fact/html/shuffle_cols_augmentation_5_demos.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/recipes/torr/tab_fact/html 2026-05-27T11:53:54,478 copying build/lib/unitxt/catalog/recipes/torr/tab_fact/html/insert_empty_rows_augmentation_5_demos.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/recipes/torr/tab_fact/html 2026-05-27T11:53:54,480 copying build/lib/unitxt/catalog/recipes/torr/tab_fact/html/no_augmentation_5_demos.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/recipes/torr/tab_fact/html 2026-05-27T11:53:54,482 copying build/lib/unitxt/catalog/recipes/torr/tab_fact/html/transpose_augmentation_5_demos.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/recipes/torr/tab_fact/html 2026-05-27T11:53:54,484 copying build/lib/unitxt/catalog/recipes/torr/tab_fact/html/shuffle_rows_augmentation_5_demos.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/recipes/torr/tab_fact/html 2026-05-27T11:53:54,487 creating build/bdist.linux-armv7l/wheel/unitxt/catalog/recipes/torr/tablebench_fact_checking 2026-05-27T11:53:54,488 creating build/bdist.linux-armv7l/wheel/unitxt/catalog/recipes/torr/tablebench_fact_checking/json 2026-05-27T11:53:54,490 copying build/lib/unitxt/catalog/recipes/torr/tablebench_fact_checking/json/shuffle_cols_augmentation_5_demos.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/recipes/torr/tablebench_fact_checking/json 2026-05-27T11:53:54,492 copying build/lib/unitxt/catalog/recipes/torr/tablebench_fact_checking/json/insert_empty_rows_augmentation_5_demos.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/recipes/torr/tablebench_fact_checking/json 2026-05-27T11:53:54,494 copying build/lib/unitxt/catalog/recipes/torr/tablebench_fact_checking/json/no_augmentation_5_demos.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/recipes/torr/tablebench_fact_checking/json 2026-05-27T11:53:54,495 copying build/lib/unitxt/catalog/recipes/torr/tablebench_fact_checking/json/transpose_augmentation_5_demos.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/recipes/torr/tablebench_fact_checking/json 2026-05-27T11:53:54,497 copying build/lib/unitxt/catalog/recipes/torr/tablebench_fact_checking/json/shuffle_rows_augmentation_5_demos.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/recipes/torr/tablebench_fact_checking/json 2026-05-27T11:53:54,500 creating build/bdist.linux-armv7l/wheel/unitxt/catalog/recipes/torr/tablebench_fact_checking/df 2026-05-27T11:53:54,501 copying build/lib/unitxt/catalog/recipes/torr/tablebench_fact_checking/df/shuffle_cols_augmentation_5_demos.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/recipes/torr/tablebench_fact_checking/df 2026-05-27T11:53:54,503 copying build/lib/unitxt/catalog/recipes/torr/tablebench_fact_checking/df/insert_empty_rows_augmentation_5_demos.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/recipes/torr/tablebench_fact_checking/df 2026-05-27T11:53:54,505 copying build/lib/unitxt/catalog/recipes/torr/tablebench_fact_checking/df/no_augmentation_5_demos.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/recipes/torr/tablebench_fact_checking/df 2026-05-27T11:53:54,507 copying build/lib/unitxt/catalog/recipes/torr/tablebench_fact_checking/df/transpose_augmentation_5_demos.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/recipes/torr/tablebench_fact_checking/df 2026-05-27T11:53:54,509 copying build/lib/unitxt/catalog/recipes/torr/tablebench_fact_checking/df/shuffle_rows_augmentation_5_demos.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/recipes/torr/tablebench_fact_checking/df 2026-05-27T11:53:54,511 creating build/bdist.linux-armv7l/wheel/unitxt/catalog/recipes/torr/tablebench_fact_checking/markdown 2026-05-27T11:53:54,512 copying build/lib/unitxt/catalog/recipes/torr/tablebench_fact_checking/markdown/shuffle_cols_augmentation_5_demos.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/recipes/torr/tablebench_fact_checking/markdown 2026-05-27T11:53:54,514 copying build/lib/unitxt/catalog/recipes/torr/tablebench_fact_checking/markdown/insert_empty_rows_augmentation_5_demos.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/recipes/torr/tablebench_fact_checking/markdown 2026-05-27T11:53:54,516 copying build/lib/unitxt/catalog/recipes/torr/tablebench_fact_checking/markdown/no_augmentation_5_demos.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/recipes/torr/tablebench_fact_checking/markdown 2026-05-27T11:53:54,518 copying build/lib/unitxt/catalog/recipes/torr/tablebench_fact_checking/markdown/transpose_augmentation_5_demos.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/recipes/torr/tablebench_fact_checking/markdown 2026-05-27T11:53:54,520 copying build/lib/unitxt/catalog/recipes/torr/tablebench_fact_checking/markdown/shuffle_rows_augmentation_5_demos.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/recipes/torr/tablebench_fact_checking/markdown 2026-05-27T11:53:54,522 creating build/bdist.linux-armv7l/wheel/unitxt/catalog/recipes/torr/tablebench_fact_checking/concat 2026-05-27T11:53:54,523 copying build/lib/unitxt/catalog/recipes/torr/tablebench_fact_checking/concat/shuffle_cols_augmentation_5_demos.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/recipes/torr/tablebench_fact_checking/concat 2026-05-27T11:53:54,525 copying build/lib/unitxt/catalog/recipes/torr/tablebench_fact_checking/concat/insert_empty_rows_augmentation_5_demos.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/recipes/torr/tablebench_fact_checking/concat 2026-05-27T11:53:54,528 copying build/lib/unitxt/catalog/recipes/torr/tablebench_fact_checking/concat/no_augmentation_5_demos.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/recipes/torr/tablebench_fact_checking/concat 2026-05-27T11:53:54,529 copying build/lib/unitxt/catalog/recipes/torr/tablebench_fact_checking/concat/transpose_augmentation_5_demos.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/recipes/torr/tablebench_fact_checking/concat 2026-05-27T11:53:54,531 copying build/lib/unitxt/catalog/recipes/torr/tablebench_fact_checking/concat/shuffle_rows_augmentation_5_demos.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/recipes/torr/tablebench_fact_checking/concat 2026-05-27T11:53:54,534 creating build/bdist.linux-armv7l/wheel/unitxt/catalog/recipes/torr/tablebench_fact_checking/csv 2026-05-27T11:53:54,535 copying build/lib/unitxt/catalog/recipes/torr/tablebench_fact_checking/csv/shuffle_cols_augmentation_5_demos.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/recipes/torr/tablebench_fact_checking/csv 2026-05-27T11:53:54,537 copying build/lib/unitxt/catalog/recipes/torr/tablebench_fact_checking/csv/insert_empty_rows_augmentation_5_demos.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/recipes/torr/tablebench_fact_checking/csv 2026-05-27T11:53:54,539 copying build/lib/unitxt/catalog/recipes/torr/tablebench_fact_checking/csv/no_augmentation_5_demos.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/recipes/torr/tablebench_fact_checking/csv 2026-05-27T11:53:54,541 copying build/lib/unitxt/catalog/recipes/torr/tablebench_fact_checking/csv/transpose_augmentation_5_demos.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/recipes/torr/tablebench_fact_checking/csv 2026-05-27T11:53:54,543 copying build/lib/unitxt/catalog/recipes/torr/tablebench_fact_checking/csv/shuffle_rows_augmentation_5_demos.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/recipes/torr/tablebench_fact_checking/csv 2026-05-27T11:53:54,545 creating build/bdist.linux-armv7l/wheel/unitxt/catalog/recipes/torr/tablebench_fact_checking/indexed_row_major 2026-05-27T11:53:54,546 copying build/lib/unitxt/catalog/recipes/torr/tablebench_fact_checking/indexed_row_major/shuffle_cols_augmentation_5_demos.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/recipes/torr/tablebench_fact_checking/indexed_row_major 2026-05-27T11:53:54,548 copying build/lib/unitxt/catalog/recipes/torr/tablebench_fact_checking/indexed_row_major/insert_empty_rows_augmentation_5_demos.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/recipes/torr/tablebench_fact_checking/indexed_row_major 2026-05-27T11:53:54,550 copying build/lib/unitxt/catalog/recipes/torr/tablebench_fact_checking/indexed_row_major/no_augmentation_5_demos.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/recipes/torr/tablebench_fact_checking/indexed_row_major 2026-05-27T11:53:54,552 copying build/lib/unitxt/catalog/recipes/torr/tablebench_fact_checking/indexed_row_major/transpose_augmentation_5_demos.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/recipes/torr/tablebench_fact_checking/indexed_row_major 2026-05-27T11:53:54,554 copying build/lib/unitxt/catalog/recipes/torr/tablebench_fact_checking/indexed_row_major/shuffle_rows_augmentation_5_demos.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/recipes/torr/tablebench_fact_checking/indexed_row_major 2026-05-27T11:53:54,557 creating build/bdist.linux-armv7l/wheel/unitxt/catalog/recipes/torr/tablebench_fact_checking/html 2026-05-27T11:53:54,559 copying build/lib/unitxt/catalog/recipes/torr/tablebench_fact_checking/html/shuffle_cols_augmentation_5_demos.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/recipes/torr/tablebench_fact_checking/html 2026-05-27T11:53:54,561 copying build/lib/unitxt/catalog/recipes/torr/tablebench_fact_checking/html/insert_empty_rows_augmentation_5_demos.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/recipes/torr/tablebench_fact_checking/html 2026-05-27T11:53:54,563 copying build/lib/unitxt/catalog/recipes/torr/tablebench_fact_checking/html/no_augmentation_5_demos.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/recipes/torr/tablebench_fact_checking/html 2026-05-27T11:53:54,565 copying build/lib/unitxt/catalog/recipes/torr/tablebench_fact_checking/html/transpose_augmentation_5_demos.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/recipes/torr/tablebench_fact_checking/html 2026-05-27T11:53:54,567 copying build/lib/unitxt/catalog/recipes/torr/tablebench_fact_checking/html/shuffle_rows_augmentation_5_demos.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/recipes/torr/tablebench_fact_checking/html 2026-05-27T11:53:54,570 creating build/bdist.linux-armv7l/wheel/unitxt/catalog/recipes/torr/tablebench_numerical_reasoning 2026-05-27T11:53:54,571 creating build/bdist.linux-armv7l/wheel/unitxt/catalog/recipes/torr/tablebench_numerical_reasoning/json 2026-05-27T11:53:54,573 copying build/lib/unitxt/catalog/recipes/torr/tablebench_numerical_reasoning/json/shuffle_cols_augmentation_5_demos.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/recipes/torr/tablebench_numerical_reasoning/json 2026-05-27T11:53:54,575 copying build/lib/unitxt/catalog/recipes/torr/tablebench_numerical_reasoning/json/insert_empty_rows_augmentation_5_demos.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/recipes/torr/tablebench_numerical_reasoning/json 2026-05-27T11:53:54,577 copying build/lib/unitxt/catalog/recipes/torr/tablebench_numerical_reasoning/json/no_augmentation_5_demos.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/recipes/torr/tablebench_numerical_reasoning/json 2026-05-27T11:53:54,579 copying build/lib/unitxt/catalog/recipes/torr/tablebench_numerical_reasoning/json/transpose_augmentation_5_demos.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/recipes/torr/tablebench_numerical_reasoning/json 2026-05-27T11:53:54,580 copying build/lib/unitxt/catalog/recipes/torr/tablebench_numerical_reasoning/json/shuffle_rows_augmentation_5_demos.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/recipes/torr/tablebench_numerical_reasoning/json 2026-05-27T11:53:54,583 creating build/bdist.linux-armv7l/wheel/unitxt/catalog/recipes/torr/tablebench_numerical_reasoning/df 2026-05-27T11:53:54,584 copying build/lib/unitxt/catalog/recipes/torr/tablebench_numerical_reasoning/df/shuffle_cols_augmentation_5_demos.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/recipes/torr/tablebench_numerical_reasoning/df 2026-05-27T11:53:54,586 copying build/lib/unitxt/catalog/recipes/torr/tablebench_numerical_reasoning/df/insert_empty_rows_augmentation_5_demos.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/recipes/torr/tablebench_numerical_reasoning/df 2026-05-27T11:53:54,588 copying build/lib/unitxt/catalog/recipes/torr/tablebench_numerical_reasoning/df/no_augmentation_5_demos.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/recipes/torr/tablebench_numerical_reasoning/df 2026-05-27T11:53:54,590 copying build/lib/unitxt/catalog/recipes/torr/tablebench_numerical_reasoning/df/transpose_augmentation_5_demos.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/recipes/torr/tablebench_numerical_reasoning/df 2026-05-27T11:53:54,591 copying build/lib/unitxt/catalog/recipes/torr/tablebench_numerical_reasoning/df/shuffle_rows_augmentation_5_demos.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/recipes/torr/tablebench_numerical_reasoning/df 2026-05-27T11:53:54,594 creating build/bdist.linux-armv7l/wheel/unitxt/catalog/recipes/torr/tablebench_numerical_reasoning/markdown 2026-05-27T11:53:54,595 copying build/lib/unitxt/catalog/recipes/torr/tablebench_numerical_reasoning/markdown/shuffle_cols_augmentation_5_demos.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/recipes/torr/tablebench_numerical_reasoning/markdown 2026-05-27T11:53:54,597 copying build/lib/unitxt/catalog/recipes/torr/tablebench_numerical_reasoning/markdown/insert_empty_rows_augmentation_5_demos.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/recipes/torr/tablebench_numerical_reasoning/markdown 2026-05-27T11:53:54,599 copying build/lib/unitxt/catalog/recipes/torr/tablebench_numerical_reasoning/markdown/no_augmentation_5_demos.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/recipes/torr/tablebench_numerical_reasoning/markdown 2026-05-27T11:53:54,601 copying build/lib/unitxt/catalog/recipes/torr/tablebench_numerical_reasoning/markdown/transpose_augmentation_5_demos.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/recipes/torr/tablebench_numerical_reasoning/markdown 2026-05-27T11:53:54,603 copying build/lib/unitxt/catalog/recipes/torr/tablebench_numerical_reasoning/markdown/shuffle_rows_augmentation_5_demos.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/recipes/torr/tablebench_numerical_reasoning/markdown 2026-05-27T11:53:54,605 creating build/bdist.linux-armv7l/wheel/unitxt/catalog/recipes/torr/tablebench_numerical_reasoning/concat 2026-05-27T11:53:54,606 copying build/lib/unitxt/catalog/recipes/torr/tablebench_numerical_reasoning/concat/shuffle_cols_augmentation_5_demos.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/recipes/torr/tablebench_numerical_reasoning/concat 2026-05-27T11:53:54,608 copying build/lib/unitxt/catalog/recipes/torr/tablebench_numerical_reasoning/concat/insert_empty_rows_augmentation_5_demos.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/recipes/torr/tablebench_numerical_reasoning/concat 2026-05-27T11:53:54,610 copying build/lib/unitxt/catalog/recipes/torr/tablebench_numerical_reasoning/concat/no_augmentation_5_demos.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/recipes/torr/tablebench_numerical_reasoning/concat 2026-05-27T11:53:54,612 copying build/lib/unitxt/catalog/recipes/torr/tablebench_numerical_reasoning/concat/transpose_augmentation_5_demos.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/recipes/torr/tablebench_numerical_reasoning/concat 2026-05-27T11:53:54,614 copying build/lib/unitxt/catalog/recipes/torr/tablebench_numerical_reasoning/concat/shuffle_rows_augmentation_5_demos.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/recipes/torr/tablebench_numerical_reasoning/concat 2026-05-27T11:53:54,616 creating build/bdist.linux-armv7l/wheel/unitxt/catalog/recipes/torr/tablebench_numerical_reasoning/csv 2026-05-27T11:53:54,617 copying build/lib/unitxt/catalog/recipes/torr/tablebench_numerical_reasoning/csv/shuffle_cols_augmentation_5_demos.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/recipes/torr/tablebench_numerical_reasoning/csv 2026-05-27T11:53:54,619 copying build/lib/unitxt/catalog/recipes/torr/tablebench_numerical_reasoning/csv/insert_empty_rows_augmentation_5_demos.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/recipes/torr/tablebench_numerical_reasoning/csv 2026-05-27T11:53:54,621 copying build/lib/unitxt/catalog/recipes/torr/tablebench_numerical_reasoning/csv/no_augmentation_5_demos.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/recipes/torr/tablebench_numerical_reasoning/csv 2026-05-27T11:53:54,623 copying build/lib/unitxt/catalog/recipes/torr/tablebench_numerical_reasoning/csv/transpose_augmentation_5_demos.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/recipes/torr/tablebench_numerical_reasoning/csv 2026-05-27T11:53:54,625 copying build/lib/unitxt/catalog/recipes/torr/tablebench_numerical_reasoning/csv/shuffle_rows_augmentation_5_demos.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/recipes/torr/tablebench_numerical_reasoning/csv 2026-05-27T11:53:54,627 creating build/bdist.linux-armv7l/wheel/unitxt/catalog/recipes/torr/tablebench_numerical_reasoning/indexed_row_major 2026-05-27T11:53:54,628 copying build/lib/unitxt/catalog/recipes/torr/tablebench_numerical_reasoning/indexed_row_major/shuffle_cols_augmentation_5_demos.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/recipes/torr/tablebench_numerical_reasoning/indexed_row_major 2026-05-27T11:53:54,630 copying build/lib/unitxt/catalog/recipes/torr/tablebench_numerical_reasoning/indexed_row_major/insert_empty_rows_augmentation_5_demos.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/recipes/torr/tablebench_numerical_reasoning/indexed_row_major 2026-05-27T11:53:54,632 copying build/lib/unitxt/catalog/recipes/torr/tablebench_numerical_reasoning/indexed_row_major/no_augmentation_5_demos.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/recipes/torr/tablebench_numerical_reasoning/indexed_row_major 2026-05-27T11:53:54,634 copying build/lib/unitxt/catalog/recipes/torr/tablebench_numerical_reasoning/indexed_row_major/transpose_augmentation_5_demos.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/recipes/torr/tablebench_numerical_reasoning/indexed_row_major 2026-05-27T11:53:54,637 copying build/lib/unitxt/catalog/recipes/torr/tablebench_numerical_reasoning/indexed_row_major/shuffle_rows_augmentation_5_demos.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/recipes/torr/tablebench_numerical_reasoning/indexed_row_major 2026-05-27T11:53:54,640 creating build/bdist.linux-armv7l/wheel/unitxt/catalog/recipes/torr/tablebench_numerical_reasoning/html 2026-05-27T11:53:54,642 copying build/lib/unitxt/catalog/recipes/torr/tablebench_numerical_reasoning/html/shuffle_cols_augmentation_5_demos.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/recipes/torr/tablebench_numerical_reasoning/html 2026-05-27T11:53:54,644 copying build/lib/unitxt/catalog/recipes/torr/tablebench_numerical_reasoning/html/insert_empty_rows_augmentation_5_demos.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/recipes/torr/tablebench_numerical_reasoning/html 2026-05-27T11:53:54,646 copying build/lib/unitxt/catalog/recipes/torr/tablebench_numerical_reasoning/html/no_augmentation_5_demos.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/recipes/torr/tablebench_numerical_reasoning/html 2026-05-27T11:53:54,648 copying build/lib/unitxt/catalog/recipes/torr/tablebench_numerical_reasoning/html/transpose_augmentation_5_demos.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/recipes/torr/tablebench_numerical_reasoning/html 2026-05-27T11:53:54,649 copying build/lib/unitxt/catalog/recipes/torr/tablebench_numerical_reasoning/html/shuffle_rows_augmentation_5_demos.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/recipes/torr/tablebench_numerical_reasoning/html 2026-05-27T11:53:54,652 creating build/bdist.linux-armv7l/wheel/unitxt/catalog/recipes/torr/qtsumm 2026-05-27T11:53:54,653 creating build/bdist.linux-armv7l/wheel/unitxt/catalog/recipes/torr/qtsumm/json 2026-05-27T11:53:54,654 copying build/lib/unitxt/catalog/recipes/torr/qtsumm/json/shuffle_cols_augmentation_5_demos.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/recipes/torr/qtsumm/json 2026-05-27T11:53:54,656 copying build/lib/unitxt/catalog/recipes/torr/qtsumm/json/insert_empty_rows_augmentation_5_demos.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/recipes/torr/qtsumm/json 2026-05-27T11:53:54,658 copying build/lib/unitxt/catalog/recipes/torr/qtsumm/json/no_augmentation_5_demos.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/recipes/torr/qtsumm/json 2026-05-27T11:53:54,660 copying build/lib/unitxt/catalog/recipes/torr/qtsumm/json/transpose_augmentation_5_demos.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/recipes/torr/qtsumm/json 2026-05-27T11:53:54,662 copying build/lib/unitxt/catalog/recipes/torr/qtsumm/json/shuffle_rows_augmentation_5_demos.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/recipes/torr/qtsumm/json 2026-05-27T11:53:54,664 creating build/bdist.linux-armv7l/wheel/unitxt/catalog/recipes/torr/qtsumm/df 2026-05-27T11:53:54,665 copying build/lib/unitxt/catalog/recipes/torr/qtsumm/df/shuffle_cols_augmentation_5_demos.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/recipes/torr/qtsumm/df 2026-05-27T11:53:54,668 copying build/lib/unitxt/catalog/recipes/torr/qtsumm/df/insert_empty_rows_augmentation_5_demos.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/recipes/torr/qtsumm/df 2026-05-27T11:53:54,670 copying build/lib/unitxt/catalog/recipes/torr/qtsumm/df/no_augmentation_5_demos.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/recipes/torr/qtsumm/df 2026-05-27T11:53:54,671 copying build/lib/unitxt/catalog/recipes/torr/qtsumm/df/transpose_augmentation_5_demos.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/recipes/torr/qtsumm/df 2026-05-27T11:53:54,673 copying build/lib/unitxt/catalog/recipes/torr/qtsumm/df/shuffle_rows_augmentation_5_demos.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/recipes/torr/qtsumm/df 2026-05-27T11:53:54,676 creating build/bdist.linux-armv7l/wheel/unitxt/catalog/recipes/torr/qtsumm/markdown 2026-05-27T11:53:54,677 copying build/lib/unitxt/catalog/recipes/torr/qtsumm/markdown/shuffle_cols_augmentation_5_demos.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/recipes/torr/qtsumm/markdown 2026-05-27T11:53:54,679 copying build/lib/unitxt/catalog/recipes/torr/qtsumm/markdown/insert_empty_rows_augmentation_5_demos.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/recipes/torr/qtsumm/markdown 2026-05-27T11:53:54,681 copying build/lib/unitxt/catalog/recipes/torr/qtsumm/markdown/no_augmentation_5_demos.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/recipes/torr/qtsumm/markdown 2026-05-27T11:53:54,683 copying build/lib/unitxt/catalog/recipes/torr/qtsumm/markdown/transpose_augmentation_5_demos.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/recipes/torr/qtsumm/markdown 2026-05-27T11:53:54,685 copying build/lib/unitxt/catalog/recipes/torr/qtsumm/markdown/shuffle_rows_augmentation_5_demos.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/recipes/torr/qtsumm/markdown 2026-05-27T11:53:54,687 creating build/bdist.linux-armv7l/wheel/unitxt/catalog/recipes/torr/qtsumm/concat 2026-05-27T11:53:54,688 copying build/lib/unitxt/catalog/recipes/torr/qtsumm/concat/shuffle_cols_augmentation_5_demos.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/recipes/torr/qtsumm/concat 2026-05-27T11:53:54,690 copying build/lib/unitxt/catalog/recipes/torr/qtsumm/concat/insert_empty_rows_augmentation_5_demos.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/recipes/torr/qtsumm/concat 2026-05-27T11:53:54,692 copying build/lib/unitxt/catalog/recipes/torr/qtsumm/concat/no_augmentation_5_demos.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/recipes/torr/qtsumm/concat 2026-05-27T11:53:54,694 copying build/lib/unitxt/catalog/recipes/torr/qtsumm/concat/transpose_augmentation_5_demos.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/recipes/torr/qtsumm/concat 2026-05-27T11:53:54,696 copying build/lib/unitxt/catalog/recipes/torr/qtsumm/concat/shuffle_rows_augmentation_5_demos.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/recipes/torr/qtsumm/concat 2026-05-27T11:53:54,698 creating build/bdist.linux-armv7l/wheel/unitxt/catalog/recipes/torr/qtsumm/csv 2026-05-27T11:53:54,699 copying build/lib/unitxt/catalog/recipes/torr/qtsumm/csv/shuffle_cols_augmentation_5_demos.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/recipes/torr/qtsumm/csv 2026-05-27T11:53:54,701 copying build/lib/unitxt/catalog/recipes/torr/qtsumm/csv/insert_empty_rows_augmentation_5_demos.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/recipes/torr/qtsumm/csv 2026-05-27T11:53:54,703 copying build/lib/unitxt/catalog/recipes/torr/qtsumm/csv/no_augmentation_5_demos.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/recipes/torr/qtsumm/csv 2026-05-27T11:53:54,705 copying build/lib/unitxt/catalog/recipes/torr/qtsumm/csv/transpose_augmentation_5_demos.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/recipes/torr/qtsumm/csv 2026-05-27T11:53:54,707 copying build/lib/unitxt/catalog/recipes/torr/qtsumm/csv/shuffle_rows_augmentation_5_demos.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/recipes/torr/qtsumm/csv 2026-05-27T11:53:54,709 creating build/bdist.linux-armv7l/wheel/unitxt/catalog/recipes/torr/qtsumm/indexed_row_major 2026-05-27T11:53:54,710 copying build/lib/unitxt/catalog/recipes/torr/qtsumm/indexed_row_major/shuffle_cols_augmentation_5_demos.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/recipes/torr/qtsumm/indexed_row_major 2026-05-27T11:53:54,712 copying build/lib/unitxt/catalog/recipes/torr/qtsumm/indexed_row_major/insert_empty_rows_augmentation_5_demos.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/recipes/torr/qtsumm/indexed_row_major 2026-05-27T11:53:54,714 copying build/lib/unitxt/catalog/recipes/torr/qtsumm/indexed_row_major/no_augmentation_5_demos.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/recipes/torr/qtsumm/indexed_row_major 2026-05-27T11:53:54,717 copying build/lib/unitxt/catalog/recipes/torr/qtsumm/indexed_row_major/transpose_augmentation_5_demos.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/recipes/torr/qtsumm/indexed_row_major 2026-05-27T11:53:54,719 copying build/lib/unitxt/catalog/recipes/torr/qtsumm/indexed_row_major/shuffle_rows_augmentation_5_demos.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/recipes/torr/qtsumm/indexed_row_major 2026-05-27T11:53:54,722 creating build/bdist.linux-armv7l/wheel/unitxt/catalog/recipes/torr/qtsumm/html 2026-05-27T11:53:54,724 copying build/lib/unitxt/catalog/recipes/torr/qtsumm/html/shuffle_cols_augmentation_5_demos.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/recipes/torr/qtsumm/html 2026-05-27T11:53:54,726 copying build/lib/unitxt/catalog/recipes/torr/qtsumm/html/insert_empty_rows_augmentation_5_demos.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/recipes/torr/qtsumm/html 2026-05-27T11:53:54,728 copying build/lib/unitxt/catalog/recipes/torr/qtsumm/html/no_augmentation_5_demos.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/recipes/torr/qtsumm/html 2026-05-27T11:53:54,730 copying build/lib/unitxt/catalog/recipes/torr/qtsumm/html/transpose_augmentation_5_demos.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/recipes/torr/qtsumm/html 2026-05-27T11:53:54,731 copying build/lib/unitxt/catalog/recipes/torr/qtsumm/html/shuffle_rows_augmentation_5_demos.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/recipes/torr/qtsumm/html 2026-05-27T11:53:54,734 creating build/bdist.linux-armv7l/wheel/unitxt/catalog/recipes/torr/tablebench_data_analysis 2026-05-27T11:53:54,735 creating build/bdist.linux-armv7l/wheel/unitxt/catalog/recipes/torr/tablebench_data_analysis/json 2026-05-27T11:53:54,737 copying build/lib/unitxt/catalog/recipes/torr/tablebench_data_analysis/json/shuffle_cols_augmentation_5_demos.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/recipes/torr/tablebench_data_analysis/json 2026-05-27T11:53:54,739 copying build/lib/unitxt/catalog/recipes/torr/tablebench_data_analysis/json/insert_empty_rows_augmentation_5_demos.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/recipes/torr/tablebench_data_analysis/json 2026-05-27T11:53:54,740 copying build/lib/unitxt/catalog/recipes/torr/tablebench_data_analysis/json/no_augmentation_5_demos.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/recipes/torr/tablebench_data_analysis/json 2026-05-27T11:53:54,742 copying build/lib/unitxt/catalog/recipes/torr/tablebench_data_analysis/json/transpose_augmentation_5_demos.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/recipes/torr/tablebench_data_analysis/json 2026-05-27T11:53:54,744 copying build/lib/unitxt/catalog/recipes/torr/tablebench_data_analysis/json/shuffle_rows_augmentation_5_demos.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/recipes/torr/tablebench_data_analysis/json 2026-05-27T11:53:54,747 creating build/bdist.linux-armv7l/wheel/unitxt/catalog/recipes/torr/tablebench_data_analysis/df 2026-05-27T11:53:54,748 copying build/lib/unitxt/catalog/recipes/torr/tablebench_data_analysis/df/shuffle_cols_augmentation_5_demos.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/recipes/torr/tablebench_data_analysis/df 2026-05-27T11:53:54,750 copying build/lib/unitxt/catalog/recipes/torr/tablebench_data_analysis/df/insert_empty_rows_augmentation_5_demos.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/recipes/torr/tablebench_data_analysis/df 2026-05-27T11:53:54,752 copying build/lib/unitxt/catalog/recipes/torr/tablebench_data_analysis/df/no_augmentation_5_demos.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/recipes/torr/tablebench_data_analysis/df 2026-05-27T11:53:54,753 copying build/lib/unitxt/catalog/recipes/torr/tablebench_data_analysis/df/transpose_augmentation_5_demos.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/recipes/torr/tablebench_data_analysis/df 2026-05-27T11:53:54,755 copying build/lib/unitxt/catalog/recipes/torr/tablebench_data_analysis/df/shuffle_rows_augmentation_5_demos.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/recipes/torr/tablebench_data_analysis/df 2026-05-27T11:53:54,758 creating build/bdist.linux-armv7l/wheel/unitxt/catalog/recipes/torr/tablebench_data_analysis/markdown 2026-05-27T11:53:54,759 copying build/lib/unitxt/catalog/recipes/torr/tablebench_data_analysis/markdown/shuffle_cols_augmentation_5_demos.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/recipes/torr/tablebench_data_analysis/markdown 2026-05-27T11:53:54,761 copying build/lib/unitxt/catalog/recipes/torr/tablebench_data_analysis/markdown/insert_empty_rows_augmentation_5_demos.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/recipes/torr/tablebench_data_analysis/markdown 2026-05-27T11:53:54,763 copying build/lib/unitxt/catalog/recipes/torr/tablebench_data_analysis/markdown/no_augmentation_5_demos.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/recipes/torr/tablebench_data_analysis/markdown 2026-05-27T11:53:54,765 copying build/lib/unitxt/catalog/recipes/torr/tablebench_data_analysis/markdown/transpose_augmentation_5_demos.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/recipes/torr/tablebench_data_analysis/markdown 2026-05-27T11:53:54,767 copying build/lib/unitxt/catalog/recipes/torr/tablebench_data_analysis/markdown/shuffle_rows_augmentation_5_demos.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/recipes/torr/tablebench_data_analysis/markdown 2026-05-27T11:53:54,769 creating build/bdist.linux-armv7l/wheel/unitxt/catalog/recipes/torr/tablebench_data_analysis/concat 2026-05-27T11:53:54,770 copying build/lib/unitxt/catalog/recipes/torr/tablebench_data_analysis/concat/shuffle_cols_augmentation_5_demos.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/recipes/torr/tablebench_data_analysis/concat 2026-05-27T11:53:54,772 copying build/lib/unitxt/catalog/recipes/torr/tablebench_data_analysis/concat/insert_empty_rows_augmentation_5_demos.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/recipes/torr/tablebench_data_analysis/concat 2026-05-27T11:53:54,774 copying build/lib/unitxt/catalog/recipes/torr/tablebench_data_analysis/concat/no_augmentation_5_demos.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/recipes/torr/tablebench_data_analysis/concat 2026-05-27T11:53:54,776 copying build/lib/unitxt/catalog/recipes/torr/tablebench_data_analysis/concat/transpose_augmentation_5_demos.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/recipes/torr/tablebench_data_analysis/concat 2026-05-27T11:53:54,778 copying build/lib/unitxt/catalog/recipes/torr/tablebench_data_analysis/concat/shuffle_rows_augmentation_5_demos.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/recipes/torr/tablebench_data_analysis/concat 2026-05-27T11:53:54,780 creating build/bdist.linux-armv7l/wheel/unitxt/catalog/recipes/torr/tablebench_data_analysis/csv 2026-05-27T11:53:54,781 copying build/lib/unitxt/catalog/recipes/torr/tablebench_data_analysis/csv/shuffle_cols_augmentation_5_demos.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/recipes/torr/tablebench_data_analysis/csv 2026-05-27T11:53:54,783 copying build/lib/unitxt/catalog/recipes/torr/tablebench_data_analysis/csv/insert_empty_rows_augmentation_5_demos.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/recipes/torr/tablebench_data_analysis/csv 2026-05-27T11:53:54,785 copying build/lib/unitxt/catalog/recipes/torr/tablebench_data_analysis/csv/no_augmentation_5_demos.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/recipes/torr/tablebench_data_analysis/csv 2026-05-27T11:53:54,787 copying build/lib/unitxt/catalog/recipes/torr/tablebench_data_analysis/csv/transpose_augmentation_5_demos.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/recipes/torr/tablebench_data_analysis/csv 2026-05-27T11:53:54,789 copying build/lib/unitxt/catalog/recipes/torr/tablebench_data_analysis/csv/shuffle_rows_augmentation_5_demos.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/recipes/torr/tablebench_data_analysis/csv 2026-05-27T11:53:54,792 creating build/bdist.linux-armv7l/wheel/unitxt/catalog/recipes/torr/tablebench_data_analysis/indexed_row_major 2026-05-27T11:53:54,793 copying build/lib/unitxt/catalog/recipes/torr/tablebench_data_analysis/indexed_row_major/shuffle_cols_augmentation_5_demos.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/recipes/torr/tablebench_data_analysis/indexed_row_major 2026-05-27T11:53:54,795 copying build/lib/unitxt/catalog/recipes/torr/tablebench_data_analysis/indexed_row_major/insert_empty_rows_augmentation_5_demos.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/recipes/torr/tablebench_data_analysis/indexed_row_major 2026-05-27T11:53:54,797 copying build/lib/unitxt/catalog/recipes/torr/tablebench_data_analysis/indexed_row_major/no_augmentation_5_demos.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/recipes/torr/tablebench_data_analysis/indexed_row_major 2026-05-27T11:53:54,799 copying build/lib/unitxt/catalog/recipes/torr/tablebench_data_analysis/indexed_row_major/transpose_augmentation_5_demos.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/recipes/torr/tablebench_data_analysis/indexed_row_major 2026-05-27T11:53:54,802 copying build/lib/unitxt/catalog/recipes/torr/tablebench_data_analysis/indexed_row_major/shuffle_rows_augmentation_5_demos.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/recipes/torr/tablebench_data_analysis/indexed_row_major 2026-05-27T11:53:54,805 creating build/bdist.linux-armv7l/wheel/unitxt/catalog/recipes/torr/tablebench_data_analysis/html 2026-05-27T11:53:54,806 copying build/lib/unitxt/catalog/recipes/torr/tablebench_data_analysis/html/shuffle_cols_augmentation_5_demos.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/recipes/torr/tablebench_data_analysis/html 2026-05-27T11:53:54,808 copying build/lib/unitxt/catalog/recipes/torr/tablebench_data_analysis/html/insert_empty_rows_augmentation_5_demos.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/recipes/torr/tablebench_data_analysis/html 2026-05-27T11:53:54,810 copying build/lib/unitxt/catalog/recipes/torr/tablebench_data_analysis/html/no_augmentation_5_demos.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/recipes/torr/tablebench_data_analysis/html 2026-05-27T11:53:54,812 copying build/lib/unitxt/catalog/recipes/torr/tablebench_data_analysis/html/transpose_augmentation_5_demos.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/recipes/torr/tablebench_data_analysis/html 2026-05-27T11:53:54,814 copying build/lib/unitxt/catalog/recipes/torr/tablebench_data_analysis/html/shuffle_rows_augmentation_5_demos.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/recipes/torr/tablebench_data_analysis/html 2026-05-27T11:53:54,816 creating build/bdist.linux-armv7l/wheel/unitxt/catalog/recipes/torr/wikitq 2026-05-27T11:53:54,818 creating build/bdist.linux-armv7l/wheel/unitxt/catalog/recipes/torr/wikitq/json 2026-05-27T11:53:54,819 copying build/lib/unitxt/catalog/recipes/torr/wikitq/json/insert_empty_rows_augmentation_1_demos.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/recipes/torr/wikitq/json 2026-05-27T11:53:54,821 copying build/lib/unitxt/catalog/recipes/torr/wikitq/json/shuffle_rows_augmentation_1_demos.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/recipes/torr/wikitq/json 2026-05-27T11:53:54,823 copying build/lib/unitxt/catalog/recipes/torr/wikitq/json/no_augmentation_1_demos.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/recipes/torr/wikitq/json 2026-05-27T11:53:54,825 copying build/lib/unitxt/catalog/recipes/torr/wikitq/json/shuffle_cols_augmentation_1_demos.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/recipes/torr/wikitq/json 2026-05-27T11:53:54,827 copying build/lib/unitxt/catalog/recipes/torr/wikitq/json/transpose_augmentation_1_demos.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/recipes/torr/wikitq/json 2026-05-27T11:53:54,829 creating build/bdist.linux-armv7l/wheel/unitxt/catalog/recipes/torr/wikitq/df 2026-05-27T11:53:54,830 copying build/lib/unitxt/catalog/recipes/torr/wikitq/df/insert_empty_rows_augmentation_1_demos.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/recipes/torr/wikitq/df 2026-05-27T11:53:54,832 copying build/lib/unitxt/catalog/recipes/torr/wikitq/df/shuffle_rows_augmentation_1_demos.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/recipes/torr/wikitq/df 2026-05-27T11:53:54,834 copying build/lib/unitxt/catalog/recipes/torr/wikitq/df/no_augmentation_1_demos.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/recipes/torr/wikitq/df 2026-05-27T11:53:54,836 copying build/lib/unitxt/catalog/recipes/torr/wikitq/df/shuffle_cols_augmentation_1_demos.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/recipes/torr/wikitq/df 2026-05-27T11:53:54,838 copying build/lib/unitxt/catalog/recipes/torr/wikitq/df/transpose_augmentation_1_demos.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/recipes/torr/wikitq/df 2026-05-27T11:53:54,840 creating build/bdist.linux-armv7l/wheel/unitxt/catalog/recipes/torr/wikitq/markdown 2026-05-27T11:53:54,841 copying build/lib/unitxt/catalog/recipes/torr/wikitq/markdown/insert_empty_rows_augmentation_1_demos.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/recipes/torr/wikitq/markdown 2026-05-27T11:53:54,843 copying build/lib/unitxt/catalog/recipes/torr/wikitq/markdown/shuffle_rows_augmentation_1_demos.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/recipes/torr/wikitq/markdown 2026-05-27T11:53:54,845 copying build/lib/unitxt/catalog/recipes/torr/wikitq/markdown/no_augmentation_1_demos.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/recipes/torr/wikitq/markdown 2026-05-27T11:53:54,847 copying build/lib/unitxt/catalog/recipes/torr/wikitq/markdown/shuffle_cols_augmentation_1_demos.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/recipes/torr/wikitq/markdown 2026-05-27T11:53:54,848 copying build/lib/unitxt/catalog/recipes/torr/wikitq/markdown/transpose_augmentation_1_demos.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/recipes/torr/wikitq/markdown 2026-05-27T11:53:54,851 creating build/bdist.linux-armv7l/wheel/unitxt/catalog/recipes/torr/wikitq/concat 2026-05-27T11:53:54,852 copying build/lib/unitxt/catalog/recipes/torr/wikitq/concat/insert_empty_rows_augmentation_1_demos.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/recipes/torr/wikitq/concat 2026-05-27T11:53:54,854 copying build/lib/unitxt/catalog/recipes/torr/wikitq/concat/shuffle_rows_augmentation_1_demos.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/recipes/torr/wikitq/concat 2026-05-27T11:53:54,855 copying build/lib/unitxt/catalog/recipes/torr/wikitq/concat/no_augmentation_1_demos.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/recipes/torr/wikitq/concat 2026-05-27T11:53:54,858 copying build/lib/unitxt/catalog/recipes/torr/wikitq/concat/shuffle_cols_augmentation_1_demos.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/recipes/torr/wikitq/concat 2026-05-27T11:53:54,860 copying build/lib/unitxt/catalog/recipes/torr/wikitq/concat/transpose_augmentation_1_demos.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/recipes/torr/wikitq/concat 2026-05-27T11:53:54,862 creating build/bdist.linux-armv7l/wheel/unitxt/catalog/recipes/torr/wikitq/csv 2026-05-27T11:53:54,863 copying build/lib/unitxt/catalog/recipes/torr/wikitq/csv/insert_empty_rows_augmentation_1_demos.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/recipes/torr/wikitq/csv 2026-05-27T11:53:54,865 copying build/lib/unitxt/catalog/recipes/torr/wikitq/csv/shuffle_rows_augmentation_1_demos.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/recipes/torr/wikitq/csv 2026-05-27T11:53:54,867 copying build/lib/unitxt/catalog/recipes/torr/wikitq/csv/no_augmentation_1_demos.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/recipes/torr/wikitq/csv 2026-05-27T11:53:54,869 copying build/lib/unitxt/catalog/recipes/torr/wikitq/csv/shuffle_cols_augmentation_1_demos.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/recipes/torr/wikitq/csv 2026-05-27T11:53:54,871 copying build/lib/unitxt/catalog/recipes/torr/wikitq/csv/transpose_augmentation_1_demos.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/recipes/torr/wikitq/csv 2026-05-27T11:53:54,873 creating build/bdist.linux-armv7l/wheel/unitxt/catalog/recipes/torr/wikitq/indexed_row_major 2026-05-27T11:53:54,874 copying build/lib/unitxt/catalog/recipes/torr/wikitq/indexed_row_major/insert_empty_rows_augmentation_1_demos.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/recipes/torr/wikitq/indexed_row_major 2026-05-27T11:53:54,877 copying build/lib/unitxt/catalog/recipes/torr/wikitq/indexed_row_major/shuffle_rows_augmentation_1_demos.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/recipes/torr/wikitq/indexed_row_major 2026-05-27T11:53:54,879 copying build/lib/unitxt/catalog/recipes/torr/wikitq/indexed_row_major/no_augmentation_1_demos.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/recipes/torr/wikitq/indexed_row_major 2026-05-27T11:53:54,881 copying build/lib/unitxt/catalog/recipes/torr/wikitq/indexed_row_major/shuffle_cols_augmentation_1_demos.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/recipes/torr/wikitq/indexed_row_major 2026-05-27T11:53:54,883 copying build/lib/unitxt/catalog/recipes/torr/wikitq/indexed_row_major/transpose_augmentation_1_demos.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/recipes/torr/wikitq/indexed_row_major 2026-05-27T11:53:54,886 creating build/bdist.linux-armv7l/wheel/unitxt/catalog/recipes/torr/wikitq/html 2026-05-27T11:53:54,887 copying build/lib/unitxt/catalog/recipes/torr/wikitq/html/insert_empty_rows_augmentation_1_demos.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/recipes/torr/wikitq/html 2026-05-27T11:53:54,889 copying build/lib/unitxt/catalog/recipes/torr/wikitq/html/shuffle_rows_augmentation_1_demos.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/recipes/torr/wikitq/html 2026-05-27T11:53:54,891 copying build/lib/unitxt/catalog/recipes/torr/wikitq/html/no_augmentation_1_demos.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/recipes/torr/wikitq/html 2026-05-27T11:53:54,893 copying build/lib/unitxt/catalog/recipes/torr/wikitq/html/shuffle_cols_augmentation_1_demos.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/recipes/torr/wikitq/html 2026-05-27T11:53:54,895 copying build/lib/unitxt/catalog/recipes/torr/wikitq/html/transpose_augmentation_1_demos.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/recipes/torr/wikitq/html 2026-05-27T11:53:54,897 creating build/bdist.linux-armv7l/wheel/unitxt/catalog/recipes/torr/fin_qa 2026-05-27T11:53:54,899 creating build/bdist.linux-armv7l/wheel/unitxt/catalog/recipes/torr/fin_qa/json 2026-05-27T11:53:54,900 copying build/lib/unitxt/catalog/recipes/torr/fin_qa/json/shuffle_cols_augmentation_5_demos.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/recipes/torr/fin_qa/json 2026-05-27T11:53:54,902 copying build/lib/unitxt/catalog/recipes/torr/fin_qa/json/insert_empty_rows_augmentation_5_demos.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/recipes/torr/fin_qa/json 2026-05-27T11:53:54,904 copying build/lib/unitxt/catalog/recipes/torr/fin_qa/json/no_augmentation_5_demos.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/recipes/torr/fin_qa/json 2026-05-27T11:53:54,906 copying build/lib/unitxt/catalog/recipes/torr/fin_qa/json/transpose_augmentation_5_demos.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/recipes/torr/fin_qa/json 2026-05-27T11:53:54,908 copying build/lib/unitxt/catalog/recipes/torr/fin_qa/json/shuffle_rows_augmentation_5_demos.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/recipes/torr/fin_qa/json 2026-05-27T11:53:54,910 creating build/bdist.linux-armv7l/wheel/unitxt/catalog/recipes/torr/fin_qa/df 2026-05-27T11:53:54,911 copying build/lib/unitxt/catalog/recipes/torr/fin_qa/df/shuffle_cols_augmentation_5_demos.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/recipes/torr/fin_qa/df 2026-05-27T11:53:54,913 copying build/lib/unitxt/catalog/recipes/torr/fin_qa/df/insert_empty_rows_augmentation_5_demos.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/recipes/torr/fin_qa/df 2026-05-27T11:53:54,915 copying build/lib/unitxt/catalog/recipes/torr/fin_qa/df/no_augmentation_5_demos.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/recipes/torr/fin_qa/df 2026-05-27T11:53:54,917 copying build/lib/unitxt/catalog/recipes/torr/fin_qa/df/transpose_augmentation_5_demos.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/recipes/torr/fin_qa/df 2026-05-27T11:53:54,919 copying build/lib/unitxt/catalog/recipes/torr/fin_qa/df/shuffle_rows_augmentation_5_demos.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/recipes/torr/fin_qa/df 2026-05-27T11:53:54,921 creating build/bdist.linux-armv7l/wheel/unitxt/catalog/recipes/torr/fin_qa/markdown 2026-05-27T11:53:54,922 copying build/lib/unitxt/catalog/recipes/torr/fin_qa/markdown/shuffle_cols_augmentation_5_demos.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/recipes/torr/fin_qa/markdown 2026-05-27T11:53:54,924 copying build/lib/unitxt/catalog/recipes/torr/fin_qa/markdown/insert_empty_rows_augmentation_5_demos.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/recipes/torr/fin_qa/markdown 2026-05-27T11:53:54,926 copying build/lib/unitxt/catalog/recipes/torr/fin_qa/markdown/no_augmentation_5_demos.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/recipes/torr/fin_qa/markdown 2026-05-27T11:53:54,928 copying build/lib/unitxt/catalog/recipes/torr/fin_qa/markdown/transpose_augmentation_5_demos.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/recipes/torr/fin_qa/markdown 2026-05-27T11:53:54,930 copying build/lib/unitxt/catalog/recipes/torr/fin_qa/markdown/shuffle_rows_augmentation_5_demos.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/recipes/torr/fin_qa/markdown 2026-05-27T11:53:54,932 creating build/bdist.linux-armv7l/wheel/unitxt/catalog/recipes/torr/fin_qa/concat 2026-05-27T11:53:54,933 copying build/lib/unitxt/catalog/recipes/torr/fin_qa/concat/shuffle_cols_augmentation_5_demos.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/recipes/torr/fin_qa/concat 2026-05-27T11:53:54,935 copying build/lib/unitxt/catalog/recipes/torr/fin_qa/concat/insert_empty_rows_augmentation_5_demos.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/recipes/torr/fin_qa/concat 2026-05-27T11:53:54,937 copying build/lib/unitxt/catalog/recipes/torr/fin_qa/concat/no_augmentation_5_demos.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/recipes/torr/fin_qa/concat 2026-05-27T11:53:54,939 copying build/lib/unitxt/catalog/recipes/torr/fin_qa/concat/transpose_augmentation_5_demos.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/recipes/torr/fin_qa/concat 2026-05-27T11:53:54,941 copying build/lib/unitxt/catalog/recipes/torr/fin_qa/concat/shuffle_rows_augmentation_5_demos.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/recipes/torr/fin_qa/concat 2026-05-27T11:53:54,943 creating build/bdist.linux-armv7l/wheel/unitxt/catalog/recipes/torr/fin_qa/csv 2026-05-27T11:53:54,944 copying build/lib/unitxt/catalog/recipes/torr/fin_qa/csv/shuffle_cols_augmentation_5_demos.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/recipes/torr/fin_qa/csv 2026-05-27T11:53:54,946 copying build/lib/unitxt/catalog/recipes/torr/fin_qa/csv/insert_empty_rows_augmentation_5_demos.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/recipes/torr/fin_qa/csv 2026-05-27T11:53:54,948 copying build/lib/unitxt/catalog/recipes/torr/fin_qa/csv/no_augmentation_5_demos.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/recipes/torr/fin_qa/csv 2026-05-27T11:53:54,950 copying build/lib/unitxt/catalog/recipes/torr/fin_qa/csv/transpose_augmentation_5_demos.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/recipes/torr/fin_qa/csv 2026-05-27T11:53:54,952 copying build/lib/unitxt/catalog/recipes/torr/fin_qa/csv/shuffle_rows_augmentation_5_demos.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/recipes/torr/fin_qa/csv 2026-05-27T11:53:54,955 creating build/bdist.linux-armv7l/wheel/unitxt/catalog/recipes/torr/fin_qa/indexed_row_major 2026-05-27T11:53:54,956 copying build/lib/unitxt/catalog/recipes/torr/fin_qa/indexed_row_major/shuffle_cols_augmentation_5_demos.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/recipes/torr/fin_qa/indexed_row_major 2026-05-27T11:53:54,958 copying build/lib/unitxt/catalog/recipes/torr/fin_qa/indexed_row_major/insert_empty_rows_augmentation_5_demos.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/recipes/torr/fin_qa/indexed_row_major 2026-05-27T11:53:54,960 copying build/lib/unitxt/catalog/recipes/torr/fin_qa/indexed_row_major/no_augmentation_5_demos.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/recipes/torr/fin_qa/indexed_row_major 2026-05-27T11:53:54,962 copying build/lib/unitxt/catalog/recipes/torr/fin_qa/indexed_row_major/transpose_augmentation_5_demos.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/recipes/torr/fin_qa/indexed_row_major 2026-05-27T11:53:54,965 copying build/lib/unitxt/catalog/recipes/torr/fin_qa/indexed_row_major/shuffle_rows_augmentation_5_demos.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/recipes/torr/fin_qa/indexed_row_major 2026-05-27T11:53:54,968 creating build/bdist.linux-armv7l/wheel/unitxt/catalog/recipes/torr/fin_qa/html 2026-05-27T11:53:54,969 copying build/lib/unitxt/catalog/recipes/torr/fin_qa/html/shuffle_cols_augmentation_5_demos.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/recipes/torr/fin_qa/html 2026-05-27T11:53:54,971 copying build/lib/unitxt/catalog/recipes/torr/fin_qa/html/insert_empty_rows_augmentation_5_demos.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/recipes/torr/fin_qa/html 2026-05-27T11:53:54,973 copying build/lib/unitxt/catalog/recipes/torr/fin_qa/html/no_augmentation_5_demos.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/recipes/torr/fin_qa/html 2026-05-27T11:53:54,974 copying build/lib/unitxt/catalog/recipes/torr/fin_qa/html/transpose_augmentation_5_demos.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/recipes/torr/fin_qa/html 2026-05-27T11:53:54,976 copying build/lib/unitxt/catalog/recipes/torr/fin_qa/html/shuffle_rows_augmentation_5_demos.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/recipes/torr/fin_qa/html 2026-05-27T11:53:54,979 creating build/bdist.linux-armv7l/wheel/unitxt/catalog/recipes/torr/scigen 2026-05-27T11:53:54,980 creating build/bdist.linux-armv7l/wheel/unitxt/catalog/recipes/torr/scigen/json 2026-05-27T11:53:54,981 copying build/lib/unitxt/catalog/recipes/torr/scigen/json/shuffle_cols_augmentation_5_demos.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/recipes/torr/scigen/json 2026-05-27T11:53:54,983 copying build/lib/unitxt/catalog/recipes/torr/scigen/json/insert_empty_rows_augmentation_5_demos.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/recipes/torr/scigen/json 2026-05-27T11:53:54,985 copying build/lib/unitxt/catalog/recipes/torr/scigen/json/no_augmentation_5_demos.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/recipes/torr/scigen/json 2026-05-27T11:53:54,987 copying build/lib/unitxt/catalog/recipes/torr/scigen/json/transpose_augmentation_5_demos.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/recipes/torr/scigen/json 2026-05-27T11:53:54,989 copying build/lib/unitxt/catalog/recipes/torr/scigen/json/shuffle_rows_augmentation_5_demos.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/recipes/torr/scigen/json 2026-05-27T11:53:54,991 creating build/bdist.linux-armv7l/wheel/unitxt/catalog/recipes/torr/scigen/df 2026-05-27T11:53:54,993 copying build/lib/unitxt/catalog/recipes/torr/scigen/df/shuffle_cols_augmentation_5_demos.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/recipes/torr/scigen/df 2026-05-27T11:53:54,994 copying build/lib/unitxt/catalog/recipes/torr/scigen/df/insert_empty_rows_augmentation_5_demos.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/recipes/torr/scigen/df 2026-05-27T11:53:54,997 copying build/lib/unitxt/catalog/recipes/torr/scigen/df/no_augmentation_5_demos.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/recipes/torr/scigen/df 2026-05-27T11:53:54,999 copying build/lib/unitxt/catalog/recipes/torr/scigen/df/transpose_augmentation_5_demos.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/recipes/torr/scigen/df 2026-05-27T11:53:55,001 copying build/lib/unitxt/catalog/recipes/torr/scigen/df/shuffle_rows_augmentation_5_demos.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/recipes/torr/scigen/df 2026-05-27T11:53:55,003 creating build/bdist.linux-armv7l/wheel/unitxt/catalog/recipes/torr/scigen/markdown 2026-05-27T11:53:55,004 copying build/lib/unitxt/catalog/recipes/torr/scigen/markdown/shuffle_cols_augmentation_5_demos.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/recipes/torr/scigen/markdown 2026-05-27T11:53:55,006 copying build/lib/unitxt/catalog/recipes/torr/scigen/markdown/insert_empty_rows_augmentation_5_demos.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/recipes/torr/scigen/markdown 2026-05-27T11:53:55,008 copying build/lib/unitxt/catalog/recipes/torr/scigen/markdown/no_augmentation_5_demos.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/recipes/torr/scigen/markdown 2026-05-27T11:53:55,010 copying build/lib/unitxt/catalog/recipes/torr/scigen/markdown/transpose_augmentation_5_demos.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/recipes/torr/scigen/markdown 2026-05-27T11:53:55,012 copying build/lib/unitxt/catalog/recipes/torr/scigen/markdown/shuffle_rows_augmentation_5_demos.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/recipes/torr/scigen/markdown 2026-05-27T11:53:55,014 creating build/bdist.linux-armv7l/wheel/unitxt/catalog/recipes/torr/scigen/concat 2026-05-27T11:53:55,015 copying build/lib/unitxt/catalog/recipes/torr/scigen/concat/shuffle_cols_augmentation_5_demos.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/recipes/torr/scigen/concat 2026-05-27T11:53:55,017 copying build/lib/unitxt/catalog/recipes/torr/scigen/concat/insert_empty_rows_augmentation_5_demos.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/recipes/torr/scigen/concat 2026-05-27T11:53:55,019 copying build/lib/unitxt/catalog/recipes/torr/scigen/concat/no_augmentation_5_demos.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/recipes/torr/scigen/concat 2026-05-27T11:53:55,021 copying build/lib/unitxt/catalog/recipes/torr/scigen/concat/transpose_augmentation_5_demos.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/recipes/torr/scigen/concat 2026-05-27T11:53:55,023 copying build/lib/unitxt/catalog/recipes/torr/scigen/concat/shuffle_rows_augmentation_5_demos.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/recipes/torr/scigen/concat 2026-05-27T11:53:55,025 creating build/bdist.linux-armv7l/wheel/unitxt/catalog/recipes/torr/scigen/csv 2026-05-27T11:53:55,026 copying build/lib/unitxt/catalog/recipes/torr/scigen/csv/shuffle_cols_augmentation_5_demos.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/recipes/torr/scigen/csv 2026-05-27T11:53:55,028 copying build/lib/unitxt/catalog/recipes/torr/scigen/csv/insert_empty_rows_augmentation_5_demos.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/recipes/torr/scigen/csv 2026-05-27T11:53:55,030 copying build/lib/unitxt/catalog/recipes/torr/scigen/csv/no_augmentation_5_demos.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/recipes/torr/scigen/csv 2026-05-27T11:53:55,032 copying build/lib/unitxt/catalog/recipes/torr/scigen/csv/transpose_augmentation_5_demos.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/recipes/torr/scigen/csv 2026-05-27T11:53:55,034 copying build/lib/unitxt/catalog/recipes/torr/scigen/csv/shuffle_rows_augmentation_5_demos.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/recipes/torr/scigen/csv 2026-05-27T11:53:55,037 creating build/bdist.linux-armv7l/wheel/unitxt/catalog/recipes/torr/scigen/indexed_row_major 2026-05-27T11:53:55,038 copying build/lib/unitxt/catalog/recipes/torr/scigen/indexed_row_major/shuffle_cols_augmentation_5_demos.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/recipes/torr/scigen/indexed_row_major 2026-05-27T11:53:55,041 copying build/lib/unitxt/catalog/recipes/torr/scigen/indexed_row_major/insert_empty_rows_augmentation_5_demos.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/recipes/torr/scigen/indexed_row_major 2026-05-27T11:53:55,042 copying build/lib/unitxt/catalog/recipes/torr/scigen/indexed_row_major/no_augmentation_5_demos.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/recipes/torr/scigen/indexed_row_major 2026-05-27T11:53:55,045 copying build/lib/unitxt/catalog/recipes/torr/scigen/indexed_row_major/transpose_augmentation_5_demos.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/recipes/torr/scigen/indexed_row_major 2026-05-27T11:53:55,047 copying build/lib/unitxt/catalog/recipes/torr/scigen/indexed_row_major/shuffle_rows_augmentation_5_demos.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/recipes/torr/scigen/indexed_row_major 2026-05-27T11:53:55,050 creating build/bdist.linux-armv7l/wheel/unitxt/catalog/recipes/torr/scigen/html 2026-05-27T11:53:55,052 copying build/lib/unitxt/catalog/recipes/torr/scigen/html/shuffle_cols_augmentation_5_demos.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/recipes/torr/scigen/html 2026-05-27T11:53:55,054 copying build/lib/unitxt/catalog/recipes/torr/scigen/html/insert_empty_rows_augmentation_5_demos.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/recipes/torr/scigen/html 2026-05-27T11:53:55,056 copying build/lib/unitxt/catalog/recipes/torr/scigen/html/no_augmentation_5_demos.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/recipes/torr/scigen/html 2026-05-27T11:53:55,058 copying build/lib/unitxt/catalog/recipes/torr/scigen/html/transpose_augmentation_5_demos.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/recipes/torr/scigen/html 2026-05-27T11:53:55,060 copying build/lib/unitxt/catalog/recipes/torr/scigen/html/shuffle_rows_augmentation_5_demos.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/recipes/torr/scigen/html 2026-05-27T11:53:55,063 creating build/bdist.linux-armv7l/wheel/unitxt/catalog/recipes/torr/numeric_nlg 2026-05-27T11:53:55,064 creating build/bdist.linux-armv7l/wheel/unitxt/catalog/recipes/torr/numeric_nlg/json 2026-05-27T11:53:55,066 copying build/lib/unitxt/catalog/recipes/torr/numeric_nlg/json/shuffle_cols_augmentation_5_demos.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/recipes/torr/numeric_nlg/json 2026-05-27T11:53:55,068 copying build/lib/unitxt/catalog/recipes/torr/numeric_nlg/json/insert_empty_rows_augmentation_5_demos.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/recipes/torr/numeric_nlg/json 2026-05-27T11:53:55,070 copying build/lib/unitxt/catalog/recipes/torr/numeric_nlg/json/no_augmentation_5_demos.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/recipes/torr/numeric_nlg/json 2026-05-27T11:53:55,073 copying build/lib/unitxt/catalog/recipes/torr/numeric_nlg/json/transpose_augmentation_5_demos.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/recipes/torr/numeric_nlg/json 2026-05-27T11:53:55,075 copying build/lib/unitxt/catalog/recipes/torr/numeric_nlg/json/shuffle_rows_augmentation_5_demos.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/recipes/torr/numeric_nlg/json 2026-05-27T11:53:55,079 creating build/bdist.linux-armv7l/wheel/unitxt/catalog/recipes/torr/numeric_nlg/df 2026-05-27T11:53:55,080 copying build/lib/unitxt/catalog/recipes/torr/numeric_nlg/df/shuffle_cols_augmentation_5_demos.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/recipes/torr/numeric_nlg/df 2026-05-27T11:53:55,083 copying build/lib/unitxt/catalog/recipes/torr/numeric_nlg/df/insert_empty_rows_augmentation_5_demos.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/recipes/torr/numeric_nlg/df 2026-05-27T11:53:55,085 copying build/lib/unitxt/catalog/recipes/torr/numeric_nlg/df/no_augmentation_5_demos.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/recipes/torr/numeric_nlg/df 2026-05-27T11:53:55,088 copying build/lib/unitxt/catalog/recipes/torr/numeric_nlg/df/transpose_augmentation_5_demos.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/recipes/torr/numeric_nlg/df 2026-05-27T11:53:55,090 copying build/lib/unitxt/catalog/recipes/torr/numeric_nlg/df/shuffle_rows_augmentation_5_demos.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/recipes/torr/numeric_nlg/df 2026-05-27T11:53:55,093 creating build/bdist.linux-armv7l/wheel/unitxt/catalog/recipes/torr/numeric_nlg/markdown 2026-05-27T11:53:55,094 copying build/lib/unitxt/catalog/recipes/torr/numeric_nlg/markdown/shuffle_cols_augmentation_5_demos.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/recipes/torr/numeric_nlg/markdown 2026-05-27T11:53:55,097 copying build/lib/unitxt/catalog/recipes/torr/numeric_nlg/markdown/insert_empty_rows_augmentation_5_demos.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/recipes/torr/numeric_nlg/markdown 2026-05-27T11:53:55,100 copying build/lib/unitxt/catalog/recipes/torr/numeric_nlg/markdown/no_augmentation_5_demos.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/recipes/torr/numeric_nlg/markdown 2026-05-27T11:53:55,102 copying build/lib/unitxt/catalog/recipes/torr/numeric_nlg/markdown/transpose_augmentation_5_demos.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/recipes/torr/numeric_nlg/markdown 2026-05-27T11:53:55,104 copying build/lib/unitxt/catalog/recipes/torr/numeric_nlg/markdown/shuffle_rows_augmentation_5_demos.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/recipes/torr/numeric_nlg/markdown 2026-05-27T11:53:55,107 creating build/bdist.linux-armv7l/wheel/unitxt/catalog/recipes/torr/numeric_nlg/concat 2026-05-27T11:53:55,109 copying build/lib/unitxt/catalog/recipes/torr/numeric_nlg/concat/shuffle_cols_augmentation_5_demos.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/recipes/torr/numeric_nlg/concat 2026-05-27T11:53:55,111 copying build/lib/unitxt/catalog/recipes/torr/numeric_nlg/concat/insert_empty_rows_augmentation_5_demos.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/recipes/torr/numeric_nlg/concat 2026-05-27T11:53:55,114 copying build/lib/unitxt/catalog/recipes/torr/numeric_nlg/concat/no_augmentation_5_demos.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/recipes/torr/numeric_nlg/concat 2026-05-27T11:53:55,116 copying build/lib/unitxt/catalog/recipes/torr/numeric_nlg/concat/transpose_augmentation_5_demos.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/recipes/torr/numeric_nlg/concat 2026-05-27T11:53:55,119 copying build/lib/unitxt/catalog/recipes/torr/numeric_nlg/concat/shuffle_rows_augmentation_5_demos.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/recipes/torr/numeric_nlg/concat 2026-05-27T11:53:55,122 creating build/bdist.linux-armv7l/wheel/unitxt/catalog/recipes/torr/numeric_nlg/csv 2026-05-27T11:53:55,123 copying build/lib/unitxt/catalog/recipes/torr/numeric_nlg/csv/shuffle_cols_augmentation_5_demos.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/recipes/torr/numeric_nlg/csv 2026-05-27T11:53:55,126 copying build/lib/unitxt/catalog/recipes/torr/numeric_nlg/csv/insert_empty_rows_augmentation_5_demos.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/recipes/torr/numeric_nlg/csv 2026-05-27T11:53:55,129 copying build/lib/unitxt/catalog/recipes/torr/numeric_nlg/csv/no_augmentation_5_demos.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/recipes/torr/numeric_nlg/csv 2026-05-27T11:53:55,132 copying build/lib/unitxt/catalog/recipes/torr/numeric_nlg/csv/transpose_augmentation_5_demos.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/recipes/torr/numeric_nlg/csv 2026-05-27T11:53:55,135 copying build/lib/unitxt/catalog/recipes/torr/numeric_nlg/csv/shuffle_rows_augmentation_5_demos.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/recipes/torr/numeric_nlg/csv 2026-05-27T11:53:55,138 creating build/bdist.linux-armv7l/wheel/unitxt/catalog/recipes/torr/numeric_nlg/indexed_row_major 2026-05-27T11:53:55,139 copying build/lib/unitxt/catalog/recipes/torr/numeric_nlg/indexed_row_major/shuffle_cols_augmentation_5_demos.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/recipes/torr/numeric_nlg/indexed_row_major 2026-05-27T11:53:55,142 copying build/lib/unitxt/catalog/recipes/torr/numeric_nlg/indexed_row_major/insert_empty_rows_augmentation_5_demos.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/recipes/torr/numeric_nlg/indexed_row_major 2026-05-27T11:53:55,144 copying build/lib/unitxt/catalog/recipes/torr/numeric_nlg/indexed_row_major/no_augmentation_5_demos.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/recipes/torr/numeric_nlg/indexed_row_major 2026-05-27T11:53:55,146 copying build/lib/unitxt/catalog/recipes/torr/numeric_nlg/indexed_row_major/transpose_augmentation_5_demos.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/recipes/torr/numeric_nlg/indexed_row_major 2026-05-27T11:53:55,149 copying build/lib/unitxt/catalog/recipes/torr/numeric_nlg/indexed_row_major/shuffle_rows_augmentation_5_demos.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/recipes/torr/numeric_nlg/indexed_row_major 2026-05-27T11:53:55,152 creating build/bdist.linux-armv7l/wheel/unitxt/catalog/recipes/torr/numeric_nlg/html 2026-05-27T11:53:55,153 copying build/lib/unitxt/catalog/recipes/torr/numeric_nlg/html/shuffle_cols_augmentation_5_demos.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/recipes/torr/numeric_nlg/html 2026-05-27T11:53:55,156 copying build/lib/unitxt/catalog/recipes/torr/numeric_nlg/html/insert_empty_rows_augmentation_5_demos.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/recipes/torr/numeric_nlg/html 2026-05-27T11:53:55,158 copying build/lib/unitxt/catalog/recipes/torr/numeric_nlg/html/no_augmentation_5_demos.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/recipes/torr/numeric_nlg/html 2026-05-27T11:53:55,160 copying build/lib/unitxt/catalog/recipes/torr/numeric_nlg/html/transpose_augmentation_5_demos.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/recipes/torr/numeric_nlg/html 2026-05-27T11:53:55,163 copying build/lib/unitxt/catalog/recipes/torr/numeric_nlg/html/shuffle_rows_augmentation_5_demos.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/recipes/torr/numeric_nlg/html 2026-05-27T11:53:55,166 creating build/bdist.linux-armv7l/wheel/unitxt/catalog/recipes/torr/turl_col_type 2026-05-27T11:53:55,168 creating build/bdist.linux-armv7l/wheel/unitxt/catalog/recipes/torr/turl_col_type/json 2026-05-27T11:53:55,169 copying build/lib/unitxt/catalog/recipes/torr/turl_col_type/json/shuffle_cols_augmentation_5_demos.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/recipes/torr/turl_col_type/json 2026-05-27T11:53:55,172 copying build/lib/unitxt/catalog/recipes/torr/turl_col_type/json/insert_empty_rows_augmentation_5_demos.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/recipes/torr/turl_col_type/json 2026-05-27T11:53:55,174 copying build/lib/unitxt/catalog/recipes/torr/turl_col_type/json/no_augmentation_5_demos.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/recipes/torr/turl_col_type/json 2026-05-27T11:53:55,175 copying build/lib/unitxt/catalog/recipes/torr/turl_col_type/json/transpose_augmentation_5_demos.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/recipes/torr/turl_col_type/json 2026-05-27T11:53:55,177 copying build/lib/unitxt/catalog/recipes/torr/turl_col_type/json/shuffle_rows_augmentation_5_demos.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/recipes/torr/turl_col_type/json 2026-05-27T11:53:55,180 creating build/bdist.linux-armv7l/wheel/unitxt/catalog/recipes/torr/turl_col_type/df 2026-05-27T11:53:55,181 copying build/lib/unitxt/catalog/recipes/torr/turl_col_type/df/shuffle_cols_augmentation_5_demos.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/recipes/torr/turl_col_type/df 2026-05-27T11:53:55,183 copying build/lib/unitxt/catalog/recipes/torr/turl_col_type/df/insert_empty_rows_augmentation_5_demos.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/recipes/torr/turl_col_type/df 2026-05-27T11:53:55,185 copying build/lib/unitxt/catalog/recipes/torr/turl_col_type/df/no_augmentation_5_demos.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/recipes/torr/turl_col_type/df 2026-05-27T11:53:55,187 copying build/lib/unitxt/catalog/recipes/torr/turl_col_type/df/transpose_augmentation_5_demos.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/recipes/torr/turl_col_type/df 2026-05-27T11:53:55,189 copying build/lib/unitxt/catalog/recipes/torr/turl_col_type/df/shuffle_rows_augmentation_5_demos.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/recipes/torr/turl_col_type/df 2026-05-27T11:53:55,192 creating build/bdist.linux-armv7l/wheel/unitxt/catalog/recipes/torr/turl_col_type/markdown 2026-05-27T11:53:55,193 copying build/lib/unitxt/catalog/recipes/torr/turl_col_type/markdown/shuffle_cols_augmentation_5_demos.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/recipes/torr/turl_col_type/markdown 2026-05-27T11:53:55,195 copying build/lib/unitxt/catalog/recipes/torr/turl_col_type/markdown/insert_empty_rows_augmentation_5_demos.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/recipes/torr/turl_col_type/markdown 2026-05-27T11:53:55,197 copying build/lib/unitxt/catalog/recipes/torr/turl_col_type/markdown/no_augmentation_5_demos.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/recipes/torr/turl_col_type/markdown 2026-05-27T11:53:55,199 copying build/lib/unitxt/catalog/recipes/torr/turl_col_type/markdown/transpose_augmentation_5_demos.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/recipes/torr/turl_col_type/markdown 2026-05-27T11:53:55,201 copying build/lib/unitxt/catalog/recipes/torr/turl_col_type/markdown/shuffle_rows_augmentation_5_demos.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/recipes/torr/turl_col_type/markdown 2026-05-27T11:53:55,203 creating build/bdist.linux-armv7l/wheel/unitxt/catalog/recipes/torr/turl_col_type/concat 2026-05-27T11:53:55,204 copying build/lib/unitxt/catalog/recipes/torr/turl_col_type/concat/shuffle_cols_augmentation_5_demos.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/recipes/torr/turl_col_type/concat 2026-05-27T11:53:55,206 copying build/lib/unitxt/catalog/recipes/torr/turl_col_type/concat/insert_empty_rows_augmentation_5_demos.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/recipes/torr/turl_col_type/concat 2026-05-27T11:53:55,208 copying build/lib/unitxt/catalog/recipes/torr/turl_col_type/concat/no_augmentation_5_demos.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/recipes/torr/turl_col_type/concat 2026-05-27T11:53:55,210 copying build/lib/unitxt/catalog/recipes/torr/turl_col_type/concat/transpose_augmentation_5_demos.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/recipes/torr/turl_col_type/concat 2026-05-27T11:53:55,212 copying build/lib/unitxt/catalog/recipes/torr/turl_col_type/concat/shuffle_rows_augmentation_5_demos.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/recipes/torr/turl_col_type/concat 2026-05-27T11:53:55,215 creating build/bdist.linux-armv7l/wheel/unitxt/catalog/recipes/torr/turl_col_type/csv 2026-05-27T11:53:55,216 copying build/lib/unitxt/catalog/recipes/torr/turl_col_type/csv/shuffle_cols_augmentation_5_demos.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/recipes/torr/turl_col_type/csv 2026-05-27T11:53:55,219 copying build/lib/unitxt/catalog/recipes/torr/turl_col_type/csv/insert_empty_rows_augmentation_5_demos.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/recipes/torr/turl_col_type/csv 2026-05-27T11:53:55,220 copying build/lib/unitxt/catalog/recipes/torr/turl_col_type/csv/no_augmentation_5_demos.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/recipes/torr/turl_col_type/csv 2026-05-27T11:53:55,222 copying build/lib/unitxt/catalog/recipes/torr/turl_col_type/csv/transpose_augmentation_5_demos.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/recipes/torr/turl_col_type/csv 2026-05-27T11:53:55,224 copying build/lib/unitxt/catalog/recipes/torr/turl_col_type/csv/shuffle_rows_augmentation_5_demos.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/recipes/torr/turl_col_type/csv 2026-05-27T11:53:55,227 creating build/bdist.linux-armv7l/wheel/unitxt/catalog/recipes/torr/turl_col_type/indexed_row_major 2026-05-27T11:53:55,228 copying build/lib/unitxt/catalog/recipes/torr/turl_col_type/indexed_row_major/shuffle_cols_augmentation_5_demos.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/recipes/torr/turl_col_type/indexed_row_major 2026-05-27T11:53:55,230 copying build/lib/unitxt/catalog/recipes/torr/turl_col_type/indexed_row_major/insert_empty_rows_augmentation_5_demos.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/recipes/torr/turl_col_type/indexed_row_major 2026-05-27T11:53:55,232 copying build/lib/unitxt/catalog/recipes/torr/turl_col_type/indexed_row_major/no_augmentation_5_demos.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/recipes/torr/turl_col_type/indexed_row_major 2026-05-27T11:53:55,234 copying build/lib/unitxt/catalog/recipes/torr/turl_col_type/indexed_row_major/transpose_augmentation_5_demos.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/recipes/torr/turl_col_type/indexed_row_major 2026-05-27T11:53:55,236 copying build/lib/unitxt/catalog/recipes/torr/turl_col_type/indexed_row_major/shuffle_rows_augmentation_5_demos.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/recipes/torr/turl_col_type/indexed_row_major 2026-05-27T11:53:55,238 creating build/bdist.linux-armv7l/wheel/unitxt/catalog/recipes/torr/turl_col_type/html 2026-05-27T11:53:55,239 copying build/lib/unitxt/catalog/recipes/torr/turl_col_type/html/shuffle_cols_augmentation_5_demos.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/recipes/torr/turl_col_type/html 2026-05-27T11:53:55,241 copying build/lib/unitxt/catalog/recipes/torr/turl_col_type/html/insert_empty_rows_augmentation_5_demos.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/recipes/torr/turl_col_type/html 2026-05-27T11:53:55,243 copying build/lib/unitxt/catalog/recipes/torr/turl_col_type/html/no_augmentation_5_demos.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/recipes/torr/turl_col_type/html 2026-05-27T11:53:55,245 copying build/lib/unitxt/catalog/recipes/torr/turl_col_type/html/transpose_augmentation_5_demos.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/recipes/torr/turl_col_type/html 2026-05-27T11:53:55,247 copying build/lib/unitxt/catalog/recipes/torr/turl_col_type/html/shuffle_rows_augmentation_5_demos.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/recipes/torr/turl_col_type/html 2026-05-27T11:53:55,249 creating build/bdist.linux-armv7l/wheel/unitxt/catalog/serializers 2026-05-27T11:53:55,250 creating build/bdist.linux-armv7l/wheel/unitxt/catalog/serializers/table 2026-05-27T11:53:55,252 copying build/lib/unitxt/catalog/serializers/table/concat.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/serializers/table 2026-05-27T11:53:55,254 copying build/lib/unitxt/catalog/serializers/table/df.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/serializers/table 2026-05-27T11:53:55,255 copying build/lib/unitxt/catalog/serializers/table/image.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/serializers/table 2026-05-27T11:53:55,257 copying build/lib/unitxt/catalog/serializers/table/indexed_row_major.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/serializers/table 2026-05-27T11:53:55,259 copying build/lib/unitxt/catalog/serializers/table/json.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/serializers/table 2026-05-27T11:53:55,261 copying build/lib/unitxt/catalog/serializers/table/html.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/serializers/table 2026-05-27T11:53:55,262 copying build/lib/unitxt/catalog/serializers/table/markdown.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/serializers/table 2026-05-27T11:53:55,265 creating build/bdist.linux-armv7l/wheel/unitxt/catalog/serializers/text2sql 2026-05-27T11:53:55,266 copying build/lib/unitxt/catalog/serializers/text2sql/schema.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/serializers/text2sql 2026-05-27T11:53:55,269 creating build/bdist.linux-armv7l/wheel/unitxt/catalog/tasks 2026-05-27T11:53:55,270 creating build/bdist.linux-armv7l/wheel/unitxt/catalog/tasks/summarization 2026-05-27T11:53:55,272 copying build/lib/unitxt/catalog/tasks/summarization/abstractive.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/tasks/summarization 2026-05-27T11:53:55,274 creating build/bdist.linux-armv7l/wheel/unitxt/catalog/tasks/translation 2026-05-27T11:53:55,275 copying build/lib/unitxt/catalog/tasks/translation/directed.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/tasks/translation 2026-05-27T11:53:55,277 copying build/lib/unitxt/catalog/tasks/text2sql.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/tasks 2026-05-27T11:53:55,279 copying build/lib/unitxt/catalog/tasks/language_identification.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/tasks 2026-05-27T11:53:55,281 creating build/bdist.linux-armv7l/wheel/unitxt/catalog/tasks/tool_calling 2026-05-27T11:53:55,283 copying build/lib/unitxt/catalog/tasks/tool_calling/supervised.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/tasks/tool_calling 2026-05-27T11:53:55,284 copying build/lib/unitxt/catalog/tasks/tool_calling/multi_turn.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/tasks/tool_calling 2026-05-27T11:53:55,287 creating build/bdist.linux-armv7l/wheel/unitxt/catalog/tasks/generation 2026-05-27T11:53:55,288 copying build/lib/unitxt/catalog/tasks/generation/from_pair.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/tasks/generation 2026-05-27T11:53:55,291 creating build/bdist.linux-armv7l/wheel/unitxt/catalog/tasks/rag 2026-05-27T11:53:55,291 copying build/lib/unitxt/catalog/tasks/rag/response_generation.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/tasks/rag 2026-05-27T11:53:55,293 copying build/lib/unitxt/catalog/tasks/rag/corpora.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/tasks/rag 2026-05-27T11:53:55,295 copying build/lib/unitxt/catalog/tasks/rag/end_to_end.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/tasks/rag 2026-05-27T11:53:55,297 copying build/lib/unitxt/catalog/tasks/grammatical_error_correction.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/tasks 2026-05-27T11:53:55,299 creating build/bdist.linux-armv7l/wheel/unitxt/catalog/tasks/rewriting 2026-05-27T11:53:55,300 copying build/lib/unitxt/catalog/tasks/rewriting/paraphrase.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/tasks/rewriting 2026-05-27T11:53:55,303 copying build/lib/unitxt/catalog/tasks/rewriting/by_attribute.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/tasks/rewriting 2026-05-27T11:53:55,304 copying build/lib/unitxt/catalog/tasks/key_value_extraction.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/tasks 2026-05-27T11:53:55,307 creating build/bdist.linux-armv7l/wheel/unitxt/catalog/tasks/classification 2026-05-27T11:53:55,308 copying build/lib/unitxt/catalog/tasks/classification/multi_class.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/tasks/classification 2026-05-27T11:53:55,310 creating build/bdist.linux-armv7l/wheel/unitxt/catalog/tasks/classification/binary 2026-05-27T11:53:55,311 copying build/lib/unitxt/catalog/tasks/classification/binary/zero_or_one.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/tasks/classification/binary 2026-05-27T11:53:55,313 copying build/lib/unitxt/catalog/tasks/classification/binary.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/tasks/classification 2026-05-27T11:53:55,315 copying build/lib/unitxt/catalog/tasks/classification/multi_label.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/tasks/classification 2026-05-27T11:53:55,317 creating build/bdist.linux-armv7l/wheel/unitxt/catalog/tasks/classification/multi_class 2026-05-27T11:53:55,319 copying build/lib/unitxt/catalog/tasks/classification/multi_class/with_classes_descriptions.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/tasks/classification/multi_class 2026-05-27T11:53:55,321 copying build/lib/unitxt/catalog/tasks/classification/multi_class/relation.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/tasks/classification/multi_class 2026-05-27T11:53:55,322 copying build/lib/unitxt/catalog/tasks/classification/multi_class/topic_classification.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/tasks/classification/multi_class 2026-05-27T11:53:55,325 creating build/bdist.linux-armv7l/wheel/unitxt/catalog/tasks/rag_eval 2026-05-27T11:53:55,326 creating build/bdist.linux-armv7l/wheel/unitxt/catalog/tasks/rag_eval/correctness_holistic 2026-05-27T11:53:55,327 copying build/lib/unitxt/catalog/tasks/rag_eval/correctness_holistic/non_binary.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/tasks/rag_eval/correctness_holistic 2026-05-27T11:53:55,329 copying build/lib/unitxt/catalog/tasks/rag_eval/correctness_holistic/binary.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/tasks/rag_eval/correctness_holistic 2026-05-27T11:53:55,332 creating build/bdist.linux-armv7l/wheel/unitxt/catalog/tasks/rag_eval/context_relevance 2026-05-27T11:53:55,333 copying build/lib/unitxt/catalog/tasks/rag_eval/context_relevance/non_binary.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/tasks/rag_eval/context_relevance 2026-05-27T11:53:55,335 copying build/lib/unitxt/catalog/tasks/rag_eval/context_relevance/binary.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/tasks/rag_eval/context_relevance 2026-05-27T11:53:55,337 creating build/bdist.linux-armv7l/wheel/unitxt/catalog/tasks/rag_eval/answer_correctness 2026-05-27T11:53:55,338 copying build/lib/unitxt/catalog/tasks/rag_eval/answer_correctness/non_binary.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/tasks/rag_eval/answer_correctness 2026-05-27T11:53:55,340 copying build/lib/unitxt/catalog/tasks/rag_eval/answer_correctness/binary.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/tasks/rag_eval/answer_correctness 2026-05-27T11:53:55,343 creating build/bdist.linux-armv7l/wheel/unitxt/catalog/tasks/rag_eval/answer_relevance 2026-05-27T11:53:55,344 copying build/lib/unitxt/catalog/tasks/rag_eval/answer_relevance/non_binary.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/tasks/rag_eval/answer_relevance 2026-05-27T11:53:55,346 copying build/lib/unitxt/catalog/tasks/rag_eval/answer_relevance/binary.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/tasks/rag_eval/answer_relevance 2026-05-27T11:53:55,348 creating build/bdist.linux-armv7l/wheel/unitxt/catalog/tasks/rag_eval/faithfulness 2026-05-27T11:53:55,349 copying build/lib/unitxt/catalog/tasks/rag_eval/faithfulness/non_binary.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/tasks/rag_eval/faithfulness 2026-05-27T11:53:55,351 copying build/lib/unitxt/catalog/tasks/rag_eval/faithfulness/binary.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/tasks/rag_eval/faithfulness 2026-05-27T11:53:55,353 copying build/lib/unitxt/catalog/tasks/schema_linking.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/tasks 2026-05-27T11:53:55,355 creating build/bdist.linux-armv7l/wheel/unitxt/catalog/tasks/ner 2026-05-27T11:53:55,357 copying build/lib/unitxt/catalog/tasks/ner/all_entity_types.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/tasks/ner 2026-05-27T11:53:55,359 copying build/lib/unitxt/catalog/tasks/ner/single_entity_type.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/tasks/ner 2026-05-27T11:53:55,362 creating build/bdist.linux-armv7l/wheel/unitxt/catalog/tasks/response_assessment 2026-05-27T11:53:55,363 creating build/bdist.linux-armv7l/wheel/unitxt/catalog/tasks/response_assessment/pairwise_comparison 2026-05-27T11:53:55,364 copying build/lib/unitxt/catalog/tasks/response_assessment/pairwise_comparison/multi_turn_with_reference.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/tasks/response_assessment/pairwise_comparison 2026-05-27T11:53:55,366 copying build/lib/unitxt/catalog/tasks/response_assessment/pairwise_comparison/single_turn.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/tasks/response_assessment/pairwise_comparison 2026-05-27T11:53:55,368 copying build/lib/unitxt/catalog/tasks/response_assessment/pairwise_comparison/multi_turn.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/tasks/response_assessment/pairwise_comparison 2026-05-27T11:53:55,370 copying build/lib/unitxt/catalog/tasks/response_assessment/pairwise_comparison/single_turn_with_reference.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/tasks/response_assessment/pairwise_comparison 2026-05-27T11:53:55,372 creating build/bdist.linux-armv7l/wheel/unitxt/catalog/tasks/response_assessment/pairwise_comparative_rating 2026-05-27T11:53:55,373 copying build/lib/unitxt/catalog/tasks/response_assessment/pairwise_comparative_rating/single_turn.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/tasks/response_assessment/pairwise_comparative_rating 2026-05-27T11:53:55,376 creating build/bdist.linux-armv7l/wheel/unitxt/catalog/tasks/response_assessment/rating 2026-05-27T11:53:55,377 copying build/lib/unitxt/catalog/tasks/response_assessment/rating/multi_turn_with_reference.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/tasks/response_assessment/rating 2026-05-27T11:53:55,379 copying build/lib/unitxt/catalog/tasks/response_assessment/rating/single_turn.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/tasks/response_assessment/rating 2026-05-27T11:53:55,380 copying build/lib/unitxt/catalog/tasks/response_assessment/rating/multi_turn.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/tasks/response_assessment/rating 2026-05-27T11:53:55,382 copying build/lib/unitxt/catalog/tasks/response_assessment/rating/single_turn_with_reference.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/tasks/response_assessment/rating 2026-05-27T11:53:55,384 copying build/lib/unitxt/catalog/tasks/generation.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/tasks 2026-05-27T11:53:55,386 creating build/bdist.linux-armv7l/wheel/unitxt/catalog/tasks/qa 2026-05-27T11:53:55,388 creating build/bdist.linux-armv7l/wheel/unitxt/catalog/tasks/qa/extractive 2026-05-27T11:53:55,389 copying build/lib/unitxt/catalog/tasks/qa/extractive/multi_turn.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/tasks/qa/extractive 2026-05-27T11:53:55,391 creating build/bdist.linux-armv7l/wheel/unitxt/catalog/tasks/qa/with_context 2026-05-27T11:53:55,392 copying build/lib/unitxt/catalog/tasks/qa/with_context/with_type.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/tasks/qa/with_context 2026-05-27T11:53:55,394 copying build/lib/unitxt/catalog/tasks/qa/with_context/abstractive.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/tasks/qa/with_context 2026-05-27T11:53:55,396 copying build/lib/unitxt/catalog/tasks/qa/with_context/extractive.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/tasks/qa/with_context 2026-05-27T11:53:55,397 copying build/lib/unitxt/catalog/tasks/qa/with_context/with_domain.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/tasks/qa/with_context 2026-05-27T11:53:55,399 copying build/lib/unitxt/catalog/tasks/qa/open.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/tasks/qa 2026-05-27T11:53:55,401 creating build/bdist.linux-armv7l/wheel/unitxt/catalog/tasks/qa/multiple_choice 2026-05-27T11:53:55,403 creating build/bdist.linux-armv7l/wheel/unitxt/catalog/tasks/qa/multiple_choice/with_context 2026-05-27T11:53:55,404 copying build/lib/unitxt/catalog/tasks/qa/multiple_choice/with_context/with_topic.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/tasks/qa/multiple_choice/with_context 2026-05-27T11:53:55,406 copying build/lib/unitxt/catalog/tasks/qa/multiple_choice/open.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/tasks/qa/multiple_choice 2026-05-27T11:53:55,408 copying build/lib/unitxt/catalog/tasks/qa/multiple_choice/with_context.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/tasks/qa/multiple_choice 2026-05-27T11:53:55,410 copying build/lib/unitxt/catalog/tasks/qa/multiple_choice/with_topic.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/tasks/qa/multiple_choice 2026-05-27T11:53:55,411 copying build/lib/unitxt/catalog/tasks/qa/extractive.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/tasks/qa 2026-05-27T11:53:55,413 copying build/lib/unitxt/catalog/tasks/qa/with_context.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/tasks/qa 2026-05-27T11:53:55,415 creating build/bdist.linux-armv7l/wheel/unitxt/catalog/tasks/selection 2026-05-27T11:53:55,417 copying build/lib/unitxt/catalog/tasks/selection/by_attribute.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/tasks/selection 2026-05-27T11:53:55,419 creating build/bdist.linux-armv7l/wheel/unitxt/catalog/tasks/evaluation 2026-05-27T11:53:55,420 copying build/lib/unitxt/catalog/tasks/evaluation/preference.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/tasks/evaluation 2026-05-27T11:53:55,422 copying build/lib/unitxt/catalog/tasks/text2sql_logic.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/tasks 2026-05-27T11:53:55,424 creating build/bdist.linux-armv7l/wheel/unitxt/catalog/tasks/targeted_sentiment_extraction 2026-05-27T11:53:55,425 copying build/lib/unitxt/catalog/tasks/targeted_sentiment_extraction/all_sentiment_classes.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/tasks/targeted_sentiment_extraction 2026-05-27T11:53:55,427 copying build/lib/unitxt/catalog/tasks/targeted_sentiment_extraction/single_sentiment_class.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/tasks/targeted_sentiment_extraction 2026-05-27T11:53:55,429 creating build/bdist.linux-armv7l/wheel/unitxt/catalog/tasks/completion 2026-05-27T11:53:55,430 copying build/lib/unitxt/catalog/tasks/completion/abstractive.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/tasks/completion 2026-05-27T11:53:55,432 copying build/lib/unitxt/catalog/tasks/completion/extractive.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/tasks/completion 2026-05-27T11:53:55,434 copying build/lib/unitxt/catalog/tasks/completion/multiple_choice.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/tasks/completion 2026-05-27T11:53:55,436 creating build/bdist.linux-armv7l/wheel/unitxt/catalog/tasks/span_labeling 2026-05-27T11:53:55,437 copying build/lib/unitxt/catalog/tasks/span_labeling/extraction.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/tasks/span_labeling 2026-05-27T11:53:55,439 creating build/bdist.linux-armv7l/wheel/unitxt/catalog/tasks/regression 2026-05-27T11:53:55,440 copying build/lib/unitxt/catalog/tasks/regression/single_text.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/tasks/regression 2026-05-27T11:53:55,442 creating build/bdist.linux-armv7l/wheel/unitxt/catalog/tasks/regression/two_texts 2026-05-27T11:53:55,443 copying build/lib/unitxt/catalog/tasks/regression/two_texts/similarity.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/tasks/regression/two_texts 2026-05-27T11:53:55,445 copying build/lib/unitxt/catalog/tasks/regression/two_texts.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/tasks/regression 2026-05-27T11:53:55,448 creating build/bdist.linux-armv7l/wheel/unitxt/catalog/splitters 2026-05-27T11:53:55,449 copying build/lib/unitxt/catalog/splitters/small_no_test.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/splitters 2026-05-27T11:53:55,450 copying build/lib/unitxt/catalog/splitters/large_no_test.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/splitters 2026-05-27T11:53:55,452 copying build/lib/unitxt/catalog/splitters/large_no_dev.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/splitters 2026-05-27T11:53:55,454 copying build/lib/unitxt/catalog/splitters/small_no_dev.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/splitters 2026-05-27T11:53:55,456 copying build/lib/unitxt/catalog/splitters/test_only.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/splitters 2026-05-27T11:53:55,457 copying build/lib/unitxt/catalog/splitters/diverse_labels_sampler.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/splitters 2026-05-27T11:53:55,460 creating build/bdist.linux-armv7l/wheel/unitxt/catalog/processors 2026-05-27T11:53:55,462 copying build/lib/unitxt/catalog/processors/extract_arena_hard_numerical_judgment.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/processors 2026-05-27T11:53:55,464 copying build/lib/unitxt/catalog/processors/list_to_empty_entity_tuples.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/processors 2026-05-27T11:53:55,465 copying build/lib/unitxt/catalog/processors/to_string.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/processors 2026-05-27T11:53:55,467 copying build/lib/unitxt/catalog/processors/to_list_by_hyphen_space.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/processors 2026-05-27T11:53:55,469 copying build/lib/unitxt/catalog/processors/convert_to_boolean.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/processors 2026-05-27T11:53:55,471 copying build/lib/unitxt/catalog/processors/capitalize.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/processors 2026-05-27T11:53:55,473 copying build/lib/unitxt/catalog/processors/infer_logprobs_to_yes_no_probs.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/processors 2026-05-27T11:53:55,474 copying build/lib/unitxt/catalog/processors/load_json_predictions.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/processors 2026-05-27T11:53:55,476 copying build/lib/unitxt/catalog/processors/toxic_or_not_toxic.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/processors 2026-05-27T11:53:55,478 copying build/lib/unitxt/catalog/processors/upper_case.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/processors 2026-05-27T11:53:55,480 copying build/lib/unitxt/catalog/processors/cast_to_float_return_zero_if_failed.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/processors 2026-05-27T11:53:55,481 copying build/lib/unitxt/catalog/processors/to_yes_or_none.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/processors 2026-05-27T11:53:55,483 copying build/lib/unitxt/catalog/processors/cast_to_float_return_0_5_if_failed.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/processors 2026-05-27T11:53:55,485 copying build/lib/unitxt/catalog/processors/to_string_stripped.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/processors 2026-05-27T11:53:55,487 copying build/lib/unitxt/catalog/processors/dict_of_lists_to_value_key_pairs.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/processors 2026-05-27T11:53:55,488 copying build/lib/unitxt/catalog/processors/infer_last_token_logprobs_to_yes_no_probs.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/processors 2026-05-27T11:53:55,490 copying build/lib/unitxt/catalog/processors/hate_speech_or_not_hate_speech.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/processors 2026-05-27T11:53:55,492 copying build/lib/unitxt/catalog/processors/to_list_by_hyphen_space_from_references.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/processors 2026-05-27T11:53:55,494 copying build/lib/unitxt/catalog/processors/yes_no_to_int.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/processors 2026-05-27T11:53:55,495 copying build/lib/unitxt/catalog/processors/to_list_by_comma_space.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/processors 2026-05-27T11:53:55,497 copying build/lib/unitxt/catalog/processors/substring.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/processors 2026-05-27T11:53:55,499 copying build/lib/unitxt/catalog/processors/take_first_word.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/processors 2026-05-27T11:53:55,501 copying build/lib/unitxt/catalog/processors/remove_articles.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/processors 2026-05-27T11:53:55,502 copying build/lib/unitxt/catalog/processors/match_closest_option.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/processors 2026-05-27T11:53:55,504 copying build/lib/unitxt/catalog/processors/extract_mt_bench_rating_judgment.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/processors 2026-05-27T11:53:55,506 copying build/lib/unitxt/catalog/processors/to_list_by_comma.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/processors 2026-05-27T11:53:55,508 copying build/lib/unitxt/catalog/processors/predictions_yes_1_else_0.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/processors 2026-05-27T11:53:55,510 copying build/lib/unitxt/catalog/processors/fix_whitespace.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/processors 2026-05-27T11:53:55,512 copying build/lib/unitxt/catalog/processors/str_to_float_format.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/processors 2026-05-27T11:53:55,514 copying build/lib/unitxt/catalog/processors/load_json.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/processors 2026-05-27T11:53:55,515 copying build/lib/unitxt/catalog/processors/regex_parser_from_prediction.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/processors 2026-05-27T11:53:55,517 copying build/lib/unitxt/catalog/processors/take_first_non_empty_line.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/processors 2026-05-27T11:53:55,519 copying build/lib/unitxt/catalog/processors/load_json_from_predictions.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/processors 2026-05-27T11:53:55,521 copying build/lib/unitxt/catalog/processors/extract_harm_rating_judgment.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/processors 2026-05-27T11:53:55,522 copying build/lib/unitxt/catalog/processors/cast_to_float_return_nan_if_failed.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/processors 2026-05-27T11:53:55,524 copying build/lib/unitxt/catalog/processors/take_last_non_empty_line.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/processors 2026-05-27T11:53:55,526 copying build/lib/unitxt/catalog/processors/extract_mt_bench_label_judgment.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/processors 2026-05-27T11:53:55,527 copying build/lib/unitxt/catalog/processors/scale_0_10_to_0_1.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/processors 2026-05-27T11:53:55,529 copying build/lib/unitxt/catalog/processors/to_span_label_pairs.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/processors 2026-05-27T11:53:55,531 copying build/lib/unitxt/catalog/processors/lower_case_till_punc.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/processors 2026-05-27T11:53:55,532 copying build/lib/unitxt/catalog/processors/literal_eval.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/processors 2026-05-27T11:53:55,535 creating build/bdist.linux-armv7l/wheel/unitxt/catalog/processors/text2sql 2026-05-27T11:53:55,536 copying build/lib/unitxt/catalog/processors/text2sql/get_sql.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/processors/text2sql 2026-05-27T11:53:55,537 copying build/lib/unitxt/catalog/processors/remove_none_from_list.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/processors 2026-05-27T11:53:55,539 copying build/lib/unitxt/catalog/processors/to_span_label_pairs_surface_only.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/processors 2026-05-27T11:53:55,541 copying build/lib/unitxt/catalog/processors/lower_case.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/processors 2026-05-27T11:53:55,542 copying build/lib/unitxt/catalog/processors/to_list_by_comma_from_references.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/processors 2026-05-27T11:53:55,544 copying build/lib/unitxt/catalog/processors/get_string_after_colon.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/processors 2026-05-27T11:53:55,546 copying build/lib/unitxt/catalog/processors/extract_verbal_judgement_bad_good.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/processors 2026-05-27T11:53:55,548 copying build/lib/unitxt/catalog/processors/remove_punctuations.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/processors 2026-05-27T11:53:55,549 copying build/lib/unitxt/catalog/processors/load_json_or_empty_tool_call.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/processors 2026-05-27T11:53:55,551 copying build/lib/unitxt/catalog/processors/extract_verbal_judgement.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/processors 2026-05-27T11:53:55,553 copying build/lib/unitxt/catalog/processors/safe_unsafe.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/processors 2026-05-27T11:53:55,555 copying build/lib/unitxt/catalog/processors/stance_to_pro_con.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/processors 2026-05-27T11:53:55,556 copying build/lib/unitxt/catalog/processors/multi_tool_call.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/processors 2026-05-27T11:53:55,558 copying build/lib/unitxt/catalog/processors/extract_from_double_brackets.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/processors 2026-05-27T11:53:55,560 copying build/lib/unitxt/catalog/processors/first_character.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/processors 2026-05-27T11:53:55,563 creating build/bdist.linux-armv7l/wheel/unitxt/catalog/metrics 2026-05-27T11:53:55,565 creating build/bdist.linux-armv7l/wheel/unitxt/catalog/metrics/perplexity_nli 2026-05-27T11:53:55,566 copying build/lib/unitxt/catalog/metrics/perplexity_nli/t5_nli_mixture.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/metrics/perplexity_nli 2026-05-27T11:53:55,567 copying build/lib/unitxt/catalog/metrics/tool_calling.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/metrics 2026-05-27T11:53:55,570 creating build/bdist.linux-armv7l/wheel/unitxt/catalog/metrics/sentence_bert 2026-05-27T11:53:55,571 copying build/lib/unitxt/catalog/metrics/sentence_bert/mpnet_base_v2.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/metrics/sentence_bert 2026-05-27T11:53:55,573 copying build/lib/unitxt/catalog/metrics/sentence_bert/minilm_l12_v2.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/metrics/sentence_bert 2026-05-27T11:53:55,574 copying build/lib/unitxt/catalog/metrics/sentence_bert/bge_large_en_1_5.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/metrics/sentence_bert 2026-05-27T11:53:55,576 copying build/lib/unitxt/catalog/metrics/normalized_sacrebleu.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/metrics 2026-05-27T11:53:55,579 creating build/bdist.linux-armv7l/wheel/unitxt/catalog/metrics/perplexity_chat 2026-05-27T11:53:55,580 copying build/lib/unitxt/catalog/metrics/perplexity_chat/flan_t5_small.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/metrics/perplexity_chat 2026-05-27T11:53:55,581 copying build/lib/unitxt/catalog/metrics/accuracy.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/metrics 2026-05-27T11:53:55,583 copying build/lib/unitxt/catalog/metrics/mean_squared_error.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/metrics 2026-05-27T11:53:55,585 copying build/lib/unitxt/catalog/metrics/ndcg.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/metrics 2026-05-27T11:53:55,587 copying build/lib/unitxt/catalog/metrics/rouge.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/metrics 2026-05-27T11:53:55,588 copying build/lib/unitxt/catalog/metrics/exact_match_mm.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/metrics 2026-05-27T11:53:55,590 creating build/bdist.linux-armv7l/wheel/unitxt/catalog/metrics/tool_calling 2026-05-27T11:53:55,592 creating build/bdist.linux-armv7l/wheel/unitxt/catalog/metrics/tool_calling/correctness 2026-05-27T11:53:55,593 copying build/lib/unitxt/catalog/metrics/tool_calling/correctness/llama_3_3_70b_instruct_judge.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/metrics/tool_calling/correctness 2026-05-27T11:53:55,595 copying build/lib/unitxt/catalog/metrics/tool_calling/reflection.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/metrics/tool_calling 2026-05-27T11:53:55,597 creating build/bdist.linux-armv7l/wheel/unitxt/catalog/metrics/tool_calling/key_value 2026-05-27T11:53:55,598 copying build/lib/unitxt/catalog/metrics/tool_calling/key_value/accuracy.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/metrics/tool_calling/key_value 2026-05-27T11:53:55,600 copying build/lib/unitxt/catalog/metrics/tool_calling/key_value/token_overlap.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/metrics/tool_calling/key_value 2026-05-27T11:53:55,603 creating build/bdist.linux-armv7l/wheel/unitxt/catalog/metrics/tool_calling/multi_turn 2026-05-27T11:53:55,604 creating build/bdist.linux-armv7l/wheel/unitxt/catalog/metrics/tool_calling/multi_turn/correctness 2026-05-27T11:53:55,605 copying build/lib/unitxt/catalog/metrics/tool_calling/multi_turn/correctness/llama_3_3_70b_instruct_judge.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/metrics/tool_calling/multi_turn/correctness 2026-05-27T11:53:55,607 copying build/lib/unitxt/catalog/metrics/tool_calling/multi_turn/validity.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/metrics/tool_calling/multi_turn 2026-05-27T11:53:55,610 creating build/bdist.linux-armv7l/wheel/unitxt/catalog/metrics/tool_calling/reflection 2026-05-27T11:53:55,611 copying build/lib/unitxt/catalog/metrics/tool_calling/reflection/syntactic.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/metrics/tool_calling/reflection 2026-05-27T11:53:55,613 copying build/lib/unitxt/catalog/metrics/accuracy_binary.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/metrics 2026-05-27T11:53:55,614 copying build/lib/unitxt/catalog/metrics/matthews_correlation.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/metrics 2026-05-27T11:53:55,616 copying build/lib/unitxt/catalog/metrics/pearson.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/metrics 2026-05-27T11:53:55,617 copying build/lib/unitxt/catalog/metrics/weighted_win_rate_correlation.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/metrics 2026-05-27T11:53:55,619 copying build/lib/unitxt/catalog/metrics/token_overlap_with_context.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/metrics 2026-05-27T11:53:55,621 copying build/lib/unitxt/catalog/metrics/jaccard_index_words.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/metrics 2026-05-27T11:53:55,622 copying build/lib/unitxt/catalog/metrics/jaccard_index.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/metrics 2026-05-27T11:53:55,624 copying build/lib/unitxt/catalog/metrics/kpa.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/metrics 2026-05-27T11:53:55,626 copying build/lib/unitxt/catalog/metrics/f1_micro.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/metrics 2026-05-27T11:53:55,627 copying build/lib/unitxt/catalog/metrics/root_mean_squared_error.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/metrics 2026-05-27T11:53:55,629 copying build/lib/unitxt/catalog/metrics/token_overlap.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/metrics 2026-05-27T11:53:55,631 copying build/lib/unitxt/catalog/metrics/map.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/metrics 2026-05-27T11:53:55,633 copying build/lib/unitxt/catalog/metrics/max_accuracy_binary.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/metrics 2026-05-27T11:53:55,634 copying build/lib/unitxt/catalog/metrics/f1_strings.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/metrics 2026-05-27T11:53:55,636 copying build/lib/unitxt/catalog/metrics/precision_macro_multi_label.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/metrics 2026-05-27T11:53:55,639 creating build/bdist.linux-armv7l/wheel/unitxt/catalog/metrics/rag 2026-05-27T11:53:55,640 creating build/bdist.linux-armv7l/wheel/unitxt/catalog/metrics/rag/correctness_holistic 2026-05-27T11:53:55,641 copying build/lib/unitxt/catalog/metrics/rag/correctness_holistic/llama_3_3_70b_instruct_wml_q_c_a_numeric.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/metrics/rag/correctness_holistic 2026-05-27T11:53:55,643 copying build/lib/unitxt/catalog/metrics/rag/correctness_holistic/generic_inference_engine_q_c_a_numeric.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/metrics/rag/correctness_holistic 2026-05-27T11:53:55,645 copying build/lib/unitxt/catalog/metrics/rag/correctness_holistic/llama_3_3_70b_instruct_wml_q_c_a.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/metrics/rag/correctness_holistic 2026-05-27T11:53:55,646 copying build/lib/unitxt/catalog/metrics/rag/correctness_holistic/generic_inference_engine_q_c_a.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/metrics/rag/correctness_holistic 2026-05-27T11:53:55,648 copying build/lib/unitxt/catalog/metrics/rag/correctness_holistic/llama_3_3_70b_instruct_wml_q_c_a_logprobs.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/metrics/rag/correctness_holistic 2026-05-27T11:53:55,650 copying build/lib/unitxt/catalog/metrics/rag/granite_guardian_answer_relevance.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/metrics/rag 2026-05-27T11:53:55,652 copying build/lib/unitxt/catalog/metrics/rag/answer_reward.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/metrics/rag 2026-05-27T11:53:55,653 copying build/lib/unitxt/catalog/metrics/rag/answer_correctness.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/metrics/rag 2026-05-27T11:53:55,656 creating build/bdist.linux-armv7l/wheel/unitxt/catalog/metrics/rag/correctness 2026-05-27T11:53:55,657 copying build/lib/unitxt/catalog/metrics/rag/correctness/llama_index_by_mock.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/metrics/rag/correctness 2026-05-27T11:53:55,658 copying build/lib/unitxt/catalog/metrics/rag/correctness/llama_index_by_gpt_3_5_turbo.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/metrics/rag/correctness 2026-05-27T11:53:55,661 creating build/bdist.linux-armv7l/wheel/unitxt/catalog/metrics/rag/end_to_end 2026-05-27T11:53:55,661 copying build/lib/unitxt/catalog/metrics/rag/end_to_end/answer_reward.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/metrics/rag/end_to_end 2026-05-27T11:53:55,663 copying build/lib/unitxt/catalog/metrics/rag/end_to_end/answer_faithfulness.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/metrics/rag/end_to_end 2026-05-27T11:53:55,665 copying build/lib/unitxt/catalog/metrics/rag/end_to_end/answer_correctness.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/metrics/rag/end_to_end 2026-05-27T11:53:55,667 creating build/bdist.linux-armv7l/wheel/unitxt/catalog/metrics/rag/end_to_end/context_relevance 2026-05-27T11:53:55,668 copying build/lib/unitxt/catalog/metrics/rag/end_to_end/context_relevance/llama_4_maverick_watsonx_judge.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/metrics/rag/end_to_end/context_relevance 2026-05-27T11:53:55,670 copying build/lib/unitxt/catalog/metrics/rag/end_to_end/context_relevance/mistral_large_instruct_rits_judge.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/metrics/rag/end_to_end/context_relevance 2026-05-27T11:53:55,672 copying build/lib/unitxt/catalog/metrics/rag/end_to_end/context_relevance/llama_3_3_70b_instruct_rits_judge.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/metrics/rag/end_to_end/context_relevance 2026-05-27T11:53:55,673 copying build/lib/unitxt/catalog/metrics/rag/end_to_end/context_relevance/generic_inference_engine_judge.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/metrics/rag/end_to_end/context_relevance 2026-05-27T11:53:55,675 copying build/lib/unitxt/catalog/metrics/rag/end_to_end/context_relevance/gpt_oss_120b_rits_judge.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/metrics/rag/end_to_end/context_relevance 2026-05-27T11:53:55,677 copying build/lib/unitxt/catalog/metrics/rag/end_to_end/context_relevance/token_precision.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/metrics/rag/end_to_end/context_relevance 2026-05-27T11:53:55,679 copying build/lib/unitxt/catalog/metrics/rag/end_to_end/context_relevance/mistral_large_instruct_watsonx_judge.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/metrics/rag/end_to_end/context_relevance 2026-05-27T11:53:55,680 copying build/lib/unitxt/catalog/metrics/rag/end_to_end/context_relevance/mistral_small_3_1_24b_instruct_2503_wml_judge.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/metrics/rag/end_to_end/context_relevance 2026-05-27T11:53:55,682 copying build/lib/unitxt/catalog/metrics/rag/end_to_end/context_relevance/sentence_bert_mini_lm.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/metrics/rag/end_to_end/context_relevance 2026-05-27T11:53:55,684 copying build/lib/unitxt/catalog/metrics/rag/end_to_end/context_relevance/llama_3_3_70b_instruct_watsonx_judge.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/metrics/rag/end_to_end/context_relevance 2026-05-27T11:53:55,686 copying build/lib/unitxt/catalog/metrics/rag/end_to_end/context_relevance/gpt_oss_120b_watsonx_judge.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/metrics/rag/end_to_end/context_relevance 2026-05-27T11:53:55,688 copying build/lib/unitxt/catalog/metrics/rag/end_to_end/context_relevance/perplexity_flan_t5_small.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/metrics/rag/end_to_end/context_relevance 2026-05-27T11:53:55,690 copying build/lib/unitxt/catalog/metrics/rag/end_to_end/context_relevance/gpt_4o_azure_judge.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/metrics/rag/end_to_end/context_relevance 2026-05-27T11:53:55,692 copying build/lib/unitxt/catalog/metrics/rag/end_to_end/context_relevance/sentence_bert_bge.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/metrics/rag/end_to_end/context_relevance 2026-05-27T11:53:55,693 copying build/lib/unitxt/catalog/metrics/rag/end_to_end/context_relevance/llama_4_maverick_rits_judge.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/metrics/rag/end_to_end/context_relevance 2026-05-27T11:53:55,696 creating build/bdist.linux-armv7l/wheel/unitxt/catalog/metrics/rag/end_to_end/answer_correctness 2026-05-27T11:53:55,697 copying build/lib/unitxt/catalog/metrics/rag/end_to_end/answer_correctness/bert_score_recall.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/metrics/rag/end_to_end/answer_correctness 2026-05-27T11:53:55,698 copying build/lib/unitxt/catalog/metrics/rag/end_to_end/answer_correctness/llama_4_maverick_watsonx_judge.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/metrics/rag/end_to_end/answer_correctness 2026-05-27T11:53:55,700 copying build/lib/unitxt/catalog/metrics/rag/end_to_end/answer_correctness/mistral_large_instruct_rits_judge.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/metrics/rag/end_to_end/answer_correctness 2026-05-27T11:53:55,702 copying build/lib/unitxt/catalog/metrics/rag/end_to_end/answer_correctness/llama_3_3_70b_instruct_rits_judge.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/metrics/rag/end_to_end/answer_correctness 2026-05-27T11:53:55,704 copying build/lib/unitxt/catalog/metrics/rag/end_to_end/answer_correctness/generic_inference_engine_judge.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/metrics/rag/end_to_end/answer_correctness 2026-05-27T11:53:55,705 copying build/lib/unitxt/catalog/metrics/rag/end_to_end/answer_correctness/gpt_oss_120b_rits_judge.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/metrics/rag/end_to_end/answer_correctness 2026-05-27T11:53:55,707 copying build/lib/unitxt/catalog/metrics/rag/end_to_end/answer_correctness/mistral_large_instruct_watsonx_judge.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/metrics/rag/end_to_end/answer_correctness 2026-05-27T11:53:55,709 copying build/lib/unitxt/catalog/metrics/rag/end_to_end/answer_correctness/mistral_small_3_1_24b_instruct_2503_wml_judge.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/metrics/rag/end_to_end/answer_correctness 2026-05-27T11:53:55,711 copying build/lib/unitxt/catalog/metrics/rag/end_to_end/answer_correctness/sentence_bert_mini_lm.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/metrics/rag/end_to_end/answer_correctness 2026-05-27T11:53:55,713 copying build/lib/unitxt/catalog/metrics/rag/end_to_end/answer_correctness/token_recall.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/metrics/rag/end_to_end/answer_correctness 2026-05-27T11:53:55,714 copying build/lib/unitxt/catalog/metrics/rag/end_to_end/answer_correctness/llama_3_3_70b_instruct_watsonx_judge.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/metrics/rag/end_to_end/answer_correctness 2026-05-27T11:53:55,716 copying build/lib/unitxt/catalog/metrics/rag/end_to_end/answer_correctness/bert_score_recall_ml.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/metrics/rag/end_to_end/answer_correctness 2026-05-27T11:53:55,718 copying build/lib/unitxt/catalog/metrics/rag/end_to_end/answer_correctness/gpt_oss_120b_watsonx_judge.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/metrics/rag/end_to_end/answer_correctness 2026-05-27T11:53:55,720 copying build/lib/unitxt/catalog/metrics/rag/end_to_end/answer_correctness/gpt_4o_azure_judge.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/metrics/rag/end_to_end/answer_correctness 2026-05-27T11:53:55,722 copying build/lib/unitxt/catalog/metrics/rag/end_to_end/answer_correctness/sentence_bert_bge.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/metrics/rag/end_to_end/answer_correctness 2026-05-27T11:53:55,723 copying build/lib/unitxt/catalog/metrics/rag/end_to_end/answer_correctness/llama_4_maverick_rits_judge.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/metrics/rag/end_to_end/answer_correctness 2026-05-27T11:53:55,726 creating build/bdist.linux-armv7l/wheel/unitxt/catalog/metrics/rag/end_to_end/answer_relevance 2026-05-27T11:53:55,727 copying build/lib/unitxt/catalog/metrics/rag/end_to_end/answer_relevance/llama_4_maverick_watsonx_judge.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/metrics/rag/end_to_end/answer_relevance 2026-05-27T11:53:55,729 copying build/lib/unitxt/catalog/metrics/rag/end_to_end/answer_relevance/mistral_large_instruct_rits_judge.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/metrics/rag/end_to_end/answer_relevance 2026-05-27T11:53:55,730 copying build/lib/unitxt/catalog/metrics/rag/end_to_end/answer_relevance/answer_reward.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/metrics/rag/end_to_end/answer_relevance 2026-05-27T11:53:55,732 copying build/lib/unitxt/catalog/metrics/rag/end_to_end/answer_relevance/llama_3_3_70b_instruct_rits_judge.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/metrics/rag/end_to_end/answer_relevance 2026-05-27T11:53:55,734 copying build/lib/unitxt/catalog/metrics/rag/end_to_end/answer_relevance/generic_inference_engine_judge.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/metrics/rag/end_to_end/answer_relevance 2026-05-27T11:53:55,736 copying build/lib/unitxt/catalog/metrics/rag/end_to_end/answer_relevance/gpt_oss_120b_rits_judge.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/metrics/rag/end_to_end/answer_relevance 2026-05-27T11:53:55,737 copying build/lib/unitxt/catalog/metrics/rag/end_to_end/answer_relevance/mistral_large_instruct_watsonx_judge.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/metrics/rag/end_to_end/answer_relevance 2026-05-27T11:53:55,739 copying build/lib/unitxt/catalog/metrics/rag/end_to_end/answer_relevance/mistral_small_3_1_24b_instruct_2503_wml_judge.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/metrics/rag/end_to_end/answer_relevance 2026-05-27T11:53:55,741 copying build/lib/unitxt/catalog/metrics/rag/end_to_end/answer_relevance/token_recall.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/metrics/rag/end_to_end/answer_relevance 2026-05-27T11:53:55,743 copying build/lib/unitxt/catalog/metrics/rag/end_to_end/answer_relevance/llama_3_3_70b_instruct_watsonx_judge.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/metrics/rag/end_to_end/answer_relevance 2026-05-27T11:53:55,744 copying build/lib/unitxt/catalog/metrics/rag/end_to_end/answer_relevance/gpt_oss_120b_watsonx_judge.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/metrics/rag/end_to_end/answer_relevance 2026-05-27T11:53:55,746 copying build/lib/unitxt/catalog/metrics/rag/end_to_end/answer_relevance/gpt_4o_azure_judge.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/metrics/rag/end_to_end/answer_relevance 2026-05-27T11:53:55,748 copying build/lib/unitxt/catalog/metrics/rag/end_to_end/answer_relevance/llama_4_maverick_rits_judge.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/metrics/rag/end_to_end/answer_relevance 2026-05-27T11:53:55,750 creating build/bdist.linux-armv7l/wheel/unitxt/catalog/metrics/rag/end_to_end/faithfulness 2026-05-27T11:53:55,751 copying build/lib/unitxt/catalog/metrics/rag/end_to_end/faithfulness/llama_4_maverick_watsonx_judge.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/metrics/rag/end_to_end/faithfulness 2026-05-27T11:53:55,753 copying build/lib/unitxt/catalog/metrics/rag/end_to_end/faithfulness/bert_score_k_precision.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/metrics/rag/end_to_end/faithfulness 2026-05-27T11:53:55,755 copying build/lib/unitxt/catalog/metrics/rag/end_to_end/faithfulness/mistral_large_instruct_rits_judge.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/metrics/rag/end_to_end/faithfulness 2026-05-27T11:53:55,757 copying build/lib/unitxt/catalog/metrics/rag/end_to_end/faithfulness/token_k_precision.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/metrics/rag/end_to_end/faithfulness 2026-05-27T11:53:55,759 copying build/lib/unitxt/catalog/metrics/rag/end_to_end/faithfulness/llama_3_3_70b_instruct_rits_judge.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/metrics/rag/end_to_end/faithfulness 2026-05-27T11:53:55,760 copying build/lib/unitxt/catalog/metrics/rag/end_to_end/faithfulness/generic_inference_engine_judge.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/metrics/rag/end_to_end/faithfulness 2026-05-27T11:53:55,762 copying build/lib/unitxt/catalog/metrics/rag/end_to_end/faithfulness/gpt_oss_120b_rits_judge.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/metrics/rag/end_to_end/faithfulness 2026-05-27T11:53:55,764 copying build/lib/unitxt/catalog/metrics/rag/end_to_end/faithfulness/mistral_large_instruct_watsonx_judge.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/metrics/rag/end_to_end/faithfulness 2026-05-27T11:53:55,766 copying build/lib/unitxt/catalog/metrics/rag/end_to_end/faithfulness/mistral_small_3_1_24b_instruct_2503_wml_judge.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/metrics/rag/end_to_end/faithfulness 2026-05-27T11:53:55,768 copying build/lib/unitxt/catalog/metrics/rag/end_to_end/faithfulness/sentence_bert_mini_lm.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/metrics/rag/end_to_end/faithfulness 2026-05-27T11:53:55,769 copying build/lib/unitxt/catalog/metrics/rag/end_to_end/faithfulness/llama_3_3_70b_instruct_watsonx_judge.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/metrics/rag/end_to_end/faithfulness 2026-05-27T11:53:55,771 copying build/lib/unitxt/catalog/metrics/rag/end_to_end/faithfulness/gpt_oss_120b_watsonx_judge.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/metrics/rag/end_to_end/faithfulness 2026-05-27T11:53:55,773 copying build/lib/unitxt/catalog/metrics/rag/end_to_end/faithfulness/bert_score_k_precision_ml.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/metrics/rag/end_to_end/faithfulness 2026-05-27T11:53:55,774 copying build/lib/unitxt/catalog/metrics/rag/end_to_end/faithfulness/vectara_hhem_2_1.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/metrics/rag/end_to_end/faithfulness 2026-05-27T11:53:55,776 copying build/lib/unitxt/catalog/metrics/rag/end_to_end/faithfulness/gpt_4o_azure_judge.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/metrics/rag/end_to_end/faithfulness 2026-05-27T11:53:55,778 copying build/lib/unitxt/catalog/metrics/rag/end_to_end/faithfulness/sentence_bert_bge.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/metrics/rag/end_to_end/faithfulness 2026-05-27T11:53:55,780 copying build/lib/unitxt/catalog/metrics/rag/end_to_end/faithfulness/llama_4_maverick_rits_judge.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/metrics/rag/end_to_end/faithfulness 2026-05-27T11:53:55,782 creating build/bdist.linux-armv7l/wheel/unitxt/catalog/metrics/rag/end_to_end/context_correctness 2026-05-27T11:53:55,783 copying build/lib/unitxt/catalog/metrics/rag/end_to_end/context_correctness/map.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/metrics/rag/end_to_end/context_correctness 2026-05-27T11:53:55,785 copying build/lib/unitxt/catalog/metrics/rag/end_to_end/context_correctness/retrieval_at_k.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/metrics/rag/end_to_end/context_correctness 2026-05-27T11:53:55,786 copying build/lib/unitxt/catalog/metrics/rag/end_to_end/context_correctness/mrr.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/metrics/rag/end_to_end/context_correctness 2026-05-27T11:53:55,788 copying build/lib/unitxt/catalog/metrics/rag/end_to_end/context_relevance.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/metrics/rag/end_to_end 2026-05-27T11:53:55,790 creating build/bdist.linux-armv7l/wheel/unitxt/catalog/metrics/rag/end_to_end/recommended 2026-05-27T11:53:55,792 creating build/bdist.linux-armv7l/wheel/unitxt/catalog/metrics/rag/end_to_end/recommended/cpu_only 2026-05-27T11:53:55,793 copying build/lib/unitxt/catalog/metrics/rag/end_to_end/recommended/cpu_only/all.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/metrics/rag/end_to_end/recommended/cpu_only 2026-05-27T11:53:55,795 creating build/bdist.linux-armv7l/wheel/unitxt/catalog/metrics/rag/end_to_end/recommended/llmaj_azure 2026-05-27T11:53:55,796 copying build/lib/unitxt/catalog/metrics/rag/end_to_end/recommended/llmaj_azure/all.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/metrics/rag/end_to_end/recommended/llmaj_azure 2026-05-27T11:53:55,799 creating build/bdist.linux-armv7l/wheel/unitxt/catalog/metrics/rag/end_to_end/recommended/llmaj_watsonx 2026-05-27T11:53:55,800 copying build/lib/unitxt/catalog/metrics/rag/end_to_end/recommended/llmaj_watsonx/all.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/metrics/rag/end_to_end/recommended/llmaj_watsonx 2026-05-27T11:53:55,802 creating build/bdist.linux-armv7l/wheel/unitxt/catalog/metrics/rag/end_to_end/recommended/small_llm 2026-05-27T11:53:55,803 copying build/lib/unitxt/catalog/metrics/rag/end_to_end/recommended/small_llm/all.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/metrics/rag/end_to_end/recommended/small_llm 2026-05-27T11:53:55,805 creating build/bdist.linux-armv7l/wheel/unitxt/catalog/metrics/rag/end_to_end/recommended/llmaj_rits 2026-05-27T11:53:55,806 copying build/lib/unitxt/catalog/metrics/rag/end_to_end/recommended/llmaj_rits/all.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/metrics/rag/end_to_end/recommended/llmaj_rits 2026-05-27T11:53:55,808 copying build/lib/unitxt/catalog/metrics/rag/end_to_end/context_correctness.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/metrics/rag/end_to_end 2026-05-27T11:53:55,810 creating build/bdist.linux-armv7l/wheel/unitxt/catalog/metrics/rag/context_relevance 2026-05-27T11:53:55,811 copying build/lib/unitxt/catalog/metrics/rag/context_relevance/generic_inference_engine_q_c_ares.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/metrics/rag/context_relevance 2026-05-27T11:53:55,813 copying build/lib/unitxt/catalog/metrics/rag/context_relevance/llama_3_3_70b_instruct_wml_q_c_ares_logprobs.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/metrics/rag/context_relevance 2026-05-27T11:53:55,815 copying build/lib/unitxt/catalog/metrics/rag/context_relevance/token_precision.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/metrics/rag/context_relevance 2026-05-27T11:53:55,817 copying build/lib/unitxt/catalog/metrics/rag/context_relevance/generic_inference_engine_q_c_ares_numeric.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/metrics/rag/context_relevance 2026-05-27T11:53:55,818 copying build/lib/unitxt/catalog/metrics/rag/context_relevance/sentence_bert_mini_lm.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/metrics/rag/context_relevance 2026-05-27T11:53:55,820 copying build/lib/unitxt/catalog/metrics/rag/context_relevance/llama_3_3_70b_instruct_wml_q_c_ares.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/metrics/rag/context_relevance 2026-05-27T11:53:55,822 copying build/lib/unitxt/catalog/metrics/rag/context_relevance/perplexity_flan_t5_small.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/metrics/rag/context_relevance 2026-05-27T11:53:55,824 copying build/lib/unitxt/catalog/metrics/rag/context_relevance/llama_3_3_70b_instruct_wml_q_c_ares_numeric.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/metrics/rag/context_relevance 2026-05-27T11:53:55,825 copying build/lib/unitxt/catalog/metrics/rag/context_relevance/sentence_bert_bge.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/metrics/rag/context_relevance 2026-05-27T11:53:55,828 creating build/bdist.linux-armv7l/wheel/unitxt/catalog/metrics/rag/answer_correctness 2026-05-27T11:53:55,829 copying build/lib/unitxt/catalog/metrics/rag/answer_correctness/bert_score_recall.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/metrics/rag/answer_correctness 2026-05-27T11:53:55,831 copying build/lib/unitxt/catalog/metrics/rag/answer_correctness/llama_3_3_70b_instruct_wml_q_a_gt_loose_logprobs.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/metrics/rag/answer_correctness 2026-05-27T11:53:55,832 copying build/lib/unitxt/catalog/metrics/rag/answer_correctness/generic_inference_engine_q_a_gt_loose_numeric.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/metrics/rag/answer_correctness 2026-05-27T11:53:55,834 copying build/lib/unitxt/catalog/metrics/rag/answer_correctness/generic_inference_engine_q_a_gt_loose.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/metrics/rag/answer_correctness 2026-05-27T11:53:55,836 copying build/lib/unitxt/catalog/metrics/rag/answer_correctness/llama_3_3_70b_instruct_wml_q_a_gt_loose_numeric.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/metrics/rag/answer_correctness 2026-05-27T11:53:55,838 copying build/lib/unitxt/catalog/metrics/rag/answer_correctness/sentence_bert_mini_lm.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/metrics/rag/answer_correctness 2026-05-27T11:53:55,840 copying build/lib/unitxt/catalog/metrics/rag/answer_correctness/token_recall.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/metrics/rag/answer_correctness 2026-05-27T11:53:55,841 copying build/lib/unitxt/catalog/metrics/rag/answer_correctness/llama_3_3_70b_instruct_wml_q_a_gt_loose.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/metrics/rag/answer_correctness 2026-05-27T11:53:55,843 copying build/lib/unitxt/catalog/metrics/rag/answer_correctness/bert_score_recall_ml.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/metrics/rag/answer_correctness 2026-05-27T11:53:55,845 copying build/lib/unitxt/catalog/metrics/rag/answer_correctness/sentence_bert_bge.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/metrics/rag/answer_correctness 2026-05-27T11:53:55,847 creating build/bdist.linux-armv7l/wheel/unitxt/catalog/metrics/rag/answer_relevance 2026-05-27T11:53:55,848 copying build/lib/unitxt/catalog/metrics/rag/answer_relevance/generic_inference_engine_q_a.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/metrics/rag/answer_relevance 2026-05-27T11:53:55,850 copying build/lib/unitxt/catalog/metrics/rag/answer_relevance/generic_inference_engine_q_a_numeric.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/metrics/rag/answer_relevance 2026-05-27T11:53:55,852 copying build/lib/unitxt/catalog/metrics/rag/answer_relevance/llama_3_3_70b_instruct_wml_q_a.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/metrics/rag/answer_relevance 2026-05-27T11:53:55,853 copying build/lib/unitxt/catalog/metrics/rag/answer_relevance/token_recall.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/metrics/rag/answer_relevance 2026-05-27T11:53:55,855 copying build/lib/unitxt/catalog/metrics/rag/answer_relevance/llama_3_3_70b_instruct_wml_q_a_logprobs.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/metrics/rag/answer_relevance 2026-05-27T11:53:55,857 copying build/lib/unitxt/catalog/metrics/rag/answer_relevance/llama_3_3_70b_instruct_wml_q_a_numeric.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/metrics/rag/answer_relevance 2026-05-27T11:53:55,859 copying build/lib/unitxt/catalog/metrics/rag/faithfulness.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/metrics/rag 2026-05-27T11:53:55,861 copying build/lib/unitxt/catalog/metrics/rag/answer_inference.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/metrics/rag 2026-05-27T11:53:55,863 creating build/bdist.linux-armv7l/wheel/unitxt/catalog/metrics/rag/external_rag 2026-05-27T11:53:55,864 copying build/lib/unitxt/catalog/metrics/rag/external_rag/answer_reward.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/metrics/rag/external_rag 2026-05-27T11:53:55,866 copying build/lib/unitxt/catalog/metrics/rag/external_rag/answer_correctness.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/metrics/rag/external_rag 2026-05-27T11:53:55,869 creating build/bdist.linux-armv7l/wheel/unitxt/catalog/metrics/rag/external_rag/context_relevance 2026-05-27T11:53:55,870 copying build/lib/unitxt/catalog/metrics/rag/external_rag/context_relevance/llama_4_maverick_watsonx_judge.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/metrics/rag/external_rag/context_relevance 2026-05-27T11:53:55,871 copying build/lib/unitxt/catalog/metrics/rag/external_rag/context_relevance/mistral_large_instruct_rits_judge.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/metrics/rag/external_rag/context_relevance 2026-05-27T11:53:55,873 copying build/lib/unitxt/catalog/metrics/rag/external_rag/context_relevance/llama_3_3_70b_instruct_rits_judge.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/metrics/rag/external_rag/context_relevance 2026-05-27T11:53:55,875 copying build/lib/unitxt/catalog/metrics/rag/external_rag/context_relevance/generic_inference_engine_judge.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/metrics/rag/external_rag/context_relevance 2026-05-27T11:53:55,877 copying build/lib/unitxt/catalog/metrics/rag/external_rag/context_relevance/gpt_oss_120b_rits_judge.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/metrics/rag/external_rag/context_relevance 2026-05-27T11:53:55,878 copying build/lib/unitxt/catalog/metrics/rag/external_rag/context_relevance/token_precision.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/metrics/rag/external_rag/context_relevance 2026-05-27T11:53:55,880 copying build/lib/unitxt/catalog/metrics/rag/external_rag/context_relevance/mistral_large_instruct_watsonx_judge.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/metrics/rag/external_rag/context_relevance 2026-05-27T11:53:55,882 copying build/lib/unitxt/catalog/metrics/rag/external_rag/context_relevance/mistral_small_3_1_24b_instruct_2503_wml_judge.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/metrics/rag/external_rag/context_relevance 2026-05-27T11:53:55,884 copying build/lib/unitxt/catalog/metrics/rag/external_rag/context_relevance/sentence_bert_mini_lm.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/metrics/rag/external_rag/context_relevance 2026-05-27T11:53:55,885 copying build/lib/unitxt/catalog/metrics/rag/external_rag/context_relevance/llama_3_3_70b_instruct_watsonx_judge.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/metrics/rag/external_rag/context_relevance 2026-05-27T11:53:55,887 copying build/lib/unitxt/catalog/metrics/rag/external_rag/context_relevance/gpt_oss_120b_watsonx_judge.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/metrics/rag/external_rag/context_relevance 2026-05-27T11:53:55,889 copying build/lib/unitxt/catalog/metrics/rag/external_rag/context_relevance/perplexity_flan_t5_small.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/metrics/rag/external_rag/context_relevance 2026-05-27T11:53:55,891 copying build/lib/unitxt/catalog/metrics/rag/external_rag/context_relevance/gpt_4o_azure_judge.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/metrics/rag/external_rag/context_relevance 2026-05-27T11:53:55,893 copying build/lib/unitxt/catalog/metrics/rag/external_rag/context_relevance/sentence_bert_bge.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/metrics/rag/external_rag/context_relevance 2026-05-27T11:53:55,894 copying build/lib/unitxt/catalog/metrics/rag/external_rag/context_relevance/llama_4_maverick_rits_judge.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/metrics/rag/external_rag/context_relevance 2026-05-27T11:53:55,897 creating build/bdist.linux-armv7l/wheel/unitxt/catalog/metrics/rag/external_rag/answer_correctness 2026-05-27T11:53:55,898 copying build/lib/unitxt/catalog/metrics/rag/external_rag/answer_correctness/bert_score_recall.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/metrics/rag/external_rag/answer_correctness 2026-05-27T11:53:55,900 copying build/lib/unitxt/catalog/metrics/rag/external_rag/answer_correctness/llama_4_maverick_watsonx_judge.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/metrics/rag/external_rag/answer_correctness 2026-05-27T11:53:55,902 copying build/lib/unitxt/catalog/metrics/rag/external_rag/answer_correctness/mistral_large_instruct_rits_judge.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/metrics/rag/external_rag/answer_correctness 2026-05-27T11:53:55,904 copying build/lib/unitxt/catalog/metrics/rag/external_rag/answer_correctness/llama_3_3_70b_instruct_rits_judge.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/metrics/rag/external_rag/answer_correctness 2026-05-27T11:53:55,906 copying build/lib/unitxt/catalog/metrics/rag/external_rag/answer_correctness/generic_inference_engine_judge.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/metrics/rag/external_rag/answer_correctness 2026-05-27T11:53:55,907 copying build/lib/unitxt/catalog/metrics/rag/external_rag/answer_correctness/gpt_oss_120b_rits_judge.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/metrics/rag/external_rag/answer_correctness 2026-05-27T11:53:55,909 copying build/lib/unitxt/catalog/metrics/rag/external_rag/answer_correctness/mistral_large_instruct_watsonx_judge.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/metrics/rag/external_rag/answer_correctness 2026-05-27T11:53:55,911 copying build/lib/unitxt/catalog/metrics/rag/external_rag/answer_correctness/mistral_small_3_1_24b_instruct_2503_wml_judge.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/metrics/rag/external_rag/answer_correctness 2026-05-27T11:53:55,912 copying build/lib/unitxt/catalog/metrics/rag/external_rag/answer_correctness/sentence_bert_mini_lm.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/metrics/rag/external_rag/answer_correctness 2026-05-27T11:53:55,914 copying build/lib/unitxt/catalog/metrics/rag/external_rag/answer_correctness/token_recall.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/metrics/rag/external_rag/answer_correctness 2026-05-27T11:53:55,916 copying build/lib/unitxt/catalog/metrics/rag/external_rag/answer_correctness/llama_3_3_70b_instruct_watsonx_judge.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/metrics/rag/external_rag/answer_correctness 2026-05-27T11:53:55,918 copying build/lib/unitxt/catalog/metrics/rag/external_rag/answer_correctness/bert_score_recall_ml.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/metrics/rag/external_rag/answer_correctness 2026-05-27T11:53:55,919 copying build/lib/unitxt/catalog/metrics/rag/external_rag/answer_correctness/gpt_oss_120b_watsonx_judge.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/metrics/rag/external_rag/answer_correctness 2026-05-27T11:53:55,921 copying build/lib/unitxt/catalog/metrics/rag/external_rag/answer_correctness/gpt_4o_azure_judge.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/metrics/rag/external_rag/answer_correctness 2026-05-27T11:53:55,923 copying build/lib/unitxt/catalog/metrics/rag/external_rag/answer_correctness/sentence_bert_bge.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/metrics/rag/external_rag/answer_correctness 2026-05-27T11:53:55,925 copying build/lib/unitxt/catalog/metrics/rag/external_rag/answer_correctness/llama_4_maverick_rits_judge.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/metrics/rag/external_rag/answer_correctness 2026-05-27T11:53:55,927 creating build/bdist.linux-armv7l/wheel/unitxt/catalog/metrics/rag/external_rag/answer_relevance 2026-05-27T11:53:55,928 copying build/lib/unitxt/catalog/metrics/rag/external_rag/answer_relevance/llama_4_maverick_watsonx_judge.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/metrics/rag/external_rag/answer_relevance 2026-05-27T11:53:55,930 copying build/lib/unitxt/catalog/metrics/rag/external_rag/answer_relevance/mistral_large_instruct_rits_judge.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/metrics/rag/external_rag/answer_relevance 2026-05-27T11:53:55,932 copying build/lib/unitxt/catalog/metrics/rag/external_rag/answer_relevance/answer_reward.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/metrics/rag/external_rag/answer_relevance 2026-05-27T11:53:55,934 copying build/lib/unitxt/catalog/metrics/rag/external_rag/answer_relevance/llama_3_3_70b_instruct_rits_judge.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/metrics/rag/external_rag/answer_relevance 2026-05-27T11:53:55,935 copying build/lib/unitxt/catalog/metrics/rag/external_rag/answer_relevance/generic_inference_engine_judge.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/metrics/rag/external_rag/answer_relevance 2026-05-27T11:53:55,937 copying build/lib/unitxt/catalog/metrics/rag/external_rag/answer_relevance/gpt_oss_120b_rits_judge.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/metrics/rag/external_rag/answer_relevance 2026-05-27T11:53:55,939 copying build/lib/unitxt/catalog/metrics/rag/external_rag/answer_relevance/mistral_large_instruct_watsonx_judge.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/metrics/rag/external_rag/answer_relevance 2026-05-27T11:53:55,940 copying build/lib/unitxt/catalog/metrics/rag/external_rag/answer_relevance/mistral_small_3_1_24b_instruct_2503_wml_judge.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/metrics/rag/external_rag/answer_relevance 2026-05-27T11:53:55,942 copying build/lib/unitxt/catalog/metrics/rag/external_rag/answer_relevance/token_recall.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/metrics/rag/external_rag/answer_relevance 2026-05-27T11:53:55,944 copying build/lib/unitxt/catalog/metrics/rag/external_rag/answer_relevance/llama_3_3_70b_instruct_watsonx_judge.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/metrics/rag/external_rag/answer_relevance 2026-05-27T11:53:55,946 copying build/lib/unitxt/catalog/metrics/rag/external_rag/answer_relevance/gpt_oss_120b_watsonx_judge.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/metrics/rag/external_rag/answer_relevance 2026-05-27T11:53:55,947 copying build/lib/unitxt/catalog/metrics/rag/external_rag/answer_relevance/gpt_4o_azure_judge.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/metrics/rag/external_rag/answer_relevance 2026-05-27T11:53:55,949 copying build/lib/unitxt/catalog/metrics/rag/external_rag/answer_relevance/llama_4_maverick_rits_judge.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/metrics/rag/external_rag/answer_relevance 2026-05-27T11:53:55,951 copying build/lib/unitxt/catalog/metrics/rag/external_rag/faithfulness.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/metrics/rag/external_rag 2026-05-27T11:53:55,953 creating build/bdist.linux-armv7l/wheel/unitxt/catalog/metrics/rag/external_rag/faithfulness 2026-05-27T11:53:55,955 copying build/lib/unitxt/catalog/metrics/rag/external_rag/faithfulness/llama_4_maverick_watsonx_judge.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/metrics/rag/external_rag/faithfulness 2026-05-27T11:53:55,956 copying build/lib/unitxt/catalog/metrics/rag/external_rag/faithfulness/bert_score_k_precision.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/metrics/rag/external_rag/faithfulness 2026-05-27T11:53:55,958 copying build/lib/unitxt/catalog/metrics/rag/external_rag/faithfulness/mistral_large_instruct_rits_judge.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/metrics/rag/external_rag/faithfulness 2026-05-27T11:53:55,960 copying build/lib/unitxt/catalog/metrics/rag/external_rag/faithfulness/token_k_precision.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/metrics/rag/external_rag/faithfulness 2026-05-27T11:53:55,962 copying build/lib/unitxt/catalog/metrics/rag/external_rag/faithfulness/llama_3_3_70b_instruct_rits_judge.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/metrics/rag/external_rag/faithfulness 2026-05-27T11:53:55,963 copying build/lib/unitxt/catalog/metrics/rag/external_rag/faithfulness/generic_inference_engine_judge.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/metrics/rag/external_rag/faithfulness 2026-05-27T11:53:55,965 copying build/lib/unitxt/catalog/metrics/rag/external_rag/faithfulness/gpt_oss_120b_rits_judge.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/metrics/rag/external_rag/faithfulness 2026-05-27T11:53:55,967 copying build/lib/unitxt/catalog/metrics/rag/external_rag/faithfulness/mistral_large_instruct_watsonx_judge.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/metrics/rag/external_rag/faithfulness 2026-05-27T11:53:55,969 copying build/lib/unitxt/catalog/metrics/rag/external_rag/faithfulness/mistral_small_3_1_24b_instruct_2503_wml_judge.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/metrics/rag/external_rag/faithfulness 2026-05-27T11:53:55,971 copying build/lib/unitxt/catalog/metrics/rag/external_rag/faithfulness/sentence_bert_mini_lm.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/metrics/rag/external_rag/faithfulness 2026-05-27T11:53:55,972 copying build/lib/unitxt/catalog/metrics/rag/external_rag/faithfulness/llama_3_3_70b_instruct_watsonx_judge.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/metrics/rag/external_rag/faithfulness 2026-05-27T11:53:55,974 copying build/lib/unitxt/catalog/metrics/rag/external_rag/faithfulness/gpt_oss_120b_watsonx_judge.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/metrics/rag/external_rag/faithfulness 2026-05-27T11:53:55,976 copying build/lib/unitxt/catalog/metrics/rag/external_rag/faithfulness/bert_score_k_precision_ml.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/metrics/rag/external_rag/faithfulness 2026-05-27T11:53:55,978 copying build/lib/unitxt/catalog/metrics/rag/external_rag/faithfulness/vectara_hhem_2_1.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/metrics/rag/external_rag/faithfulness 2026-05-27T11:53:55,979 copying build/lib/unitxt/catalog/metrics/rag/external_rag/faithfulness/gpt_4o_azure_judge.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/metrics/rag/external_rag/faithfulness 2026-05-27T11:53:55,981 copying build/lib/unitxt/catalog/metrics/rag/external_rag/faithfulness/sentence_bert_bge.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/metrics/rag/external_rag/faithfulness 2026-05-27T11:53:55,983 copying build/lib/unitxt/catalog/metrics/rag/external_rag/faithfulness/llama_4_maverick_rits_judge.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/metrics/rag/external_rag/faithfulness 2026-05-27T11:53:55,985 creating build/bdist.linux-armv7l/wheel/unitxt/catalog/metrics/rag/external_rag/context_correctness 2026-05-27T11:53:55,986 copying build/lib/unitxt/catalog/metrics/rag/external_rag/context_correctness/map.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/metrics/rag/external_rag/context_correctness 2026-05-27T11:53:55,988 copying build/lib/unitxt/catalog/metrics/rag/external_rag/context_correctness/retrieval_at_k.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/metrics/rag/external_rag/context_correctness 2026-05-27T11:53:55,990 copying build/lib/unitxt/catalog/metrics/rag/external_rag/context_correctness/mrr.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/metrics/rag/external_rag/context_correctness 2026-05-27T11:53:55,992 copying build/lib/unitxt/catalog/metrics/rag/external_rag/context_relevance.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/metrics/rag/external_rag 2026-05-27T11:53:55,994 creating build/bdist.linux-armv7l/wheel/unitxt/catalog/metrics/rag/external_rag/recommended 2026-05-27T11:53:55,995 creating build/bdist.linux-armv7l/wheel/unitxt/catalog/metrics/rag/external_rag/recommended/cpu_only 2026-05-27T11:53:55,997 copying build/lib/unitxt/catalog/metrics/rag/external_rag/recommended/cpu_only/all.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/metrics/rag/external_rag/recommended/cpu_only 2026-05-27T11:53:55,999 creating build/bdist.linux-armv7l/wheel/unitxt/catalog/metrics/rag/external_rag/recommended/llmaj_azure 2026-05-27T11:53:56,000 copying build/lib/unitxt/catalog/metrics/rag/external_rag/recommended/llmaj_azure/all.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/metrics/rag/external_rag/recommended/llmaj_azure 2026-05-27T11:53:56,002 creating build/bdist.linux-armv7l/wheel/unitxt/catalog/metrics/rag/external_rag/recommended/llmaj_watsonx 2026-05-27T11:53:56,003 copying build/lib/unitxt/catalog/metrics/rag/external_rag/recommended/llmaj_watsonx/all.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/metrics/rag/external_rag/recommended/llmaj_watsonx 2026-05-27T11:53:56,006 creating build/bdist.linux-armv7l/wheel/unitxt/catalog/metrics/rag/external_rag/recommended/small_llm 2026-05-27T11:53:56,008 copying build/lib/unitxt/catalog/metrics/rag/external_rag/recommended/small_llm/all.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/metrics/rag/external_rag/recommended/small_llm 2026-05-27T11:53:56,011 creating build/bdist.linux-armv7l/wheel/unitxt/catalog/metrics/rag/external_rag/recommended/llmaj_rits 2026-05-27T11:53:56,012 copying build/lib/unitxt/catalog/metrics/rag/external_rag/recommended/llmaj_rits/all.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/metrics/rag/external_rag/recommended/llmaj_rits 2026-05-27T11:53:56,014 copying build/lib/unitxt/catalog/metrics/rag/external_rag/context_correctness.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/metrics/rag/external_rag 2026-05-27T11:53:56,016 creating build/bdist.linux-armv7l/wheel/unitxt/catalog/metrics/rag/response_generation 2026-05-27T11:53:56,018 creating build/bdist.linux-armv7l/wheel/unitxt/catalog/metrics/rag/response_generation/adherence_with_format 2026-05-27T11:53:56,019 copying build/lib/unitxt/catalog/metrics/rag/response_generation/adherence_with_format/llama_3_3_70b_instruct_judge.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/metrics/rag/response_generation/adherence_with_format 2026-05-27T11:53:56,022 creating build/bdist.linux-armv7l/wheel/unitxt/catalog/metrics/rag/response_generation/correctness 2026-05-27T11:53:56,023 copying build/lib/unitxt/catalog/metrics/rag/response_generation/correctness/token_overlap.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/metrics/rag/response_generation/correctness 2026-05-27T11:53:56,025 creating build/bdist.linux-armv7l/wheel/unitxt/catalog/metrics/rag/response_generation/correctness/bert_score 2026-05-27T11:53:56,026 copying build/lib/unitxt/catalog/metrics/rag/response_generation/correctness/bert_score/deberta_v3_base_mnli_xnli_ml.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/metrics/rag/response_generation/correctness/bert_score 2026-05-27T11:53:56,028 copying build/lib/unitxt/catalog/metrics/rag/response_generation/correctness/bert_score/deberta_large_mnli.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/metrics/rag/response_generation/correctness/bert_score 2026-05-27T11:53:56,030 creating build/bdist.linux-armv7l/wheel/unitxt/catalog/metrics/rag/response_generation/answer_completeness 2026-05-27T11:53:56,031 copying build/lib/unitxt/catalog/metrics/rag/response_generation/answer_completeness/llama_3_3_70b_instruct_judge.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/metrics/rag/response_generation/answer_completeness 2026-05-27T11:53:56,033 creating build/bdist.linux-armv7l/wheel/unitxt/catalog/metrics/rag/response_generation/answer_correctness 2026-05-27T11:53:56,034 copying build/lib/unitxt/catalog/metrics/rag/response_generation/answer_correctness/bert_score_recall.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/metrics/rag/response_generation/answer_correctness 2026-05-27T11:53:56,037 copying build/lib/unitxt/catalog/metrics/rag/response_generation/answer_correctness/llama_4_maverick_watsonx_judge.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/metrics/rag/response_generation/answer_correctness 2026-05-27T11:53:56,038 copying build/lib/unitxt/catalog/metrics/rag/response_generation/answer_correctness/mistral_large_instruct_rits_judge.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/metrics/rag/response_generation/answer_correctness 2026-05-27T11:53:56,040 copying build/lib/unitxt/catalog/metrics/rag/response_generation/answer_correctness/llama_3_3_70b_instruct_rits_judge.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/metrics/rag/response_generation/answer_correctness 2026-05-27T11:53:56,042 copying build/lib/unitxt/catalog/metrics/rag/response_generation/answer_correctness/generic_inference_engine_judge.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/metrics/rag/response_generation/answer_correctness 2026-05-27T11:53:56,044 copying build/lib/unitxt/catalog/metrics/rag/response_generation/answer_correctness/gpt_oss_120b_rits_judge.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/metrics/rag/response_generation/answer_correctness 2026-05-27T11:53:56,046 copying build/lib/unitxt/catalog/metrics/rag/response_generation/answer_correctness/mistral_large_instruct_watsonx_judge.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/metrics/rag/response_generation/answer_correctness 2026-05-27T11:53:56,047 copying build/lib/unitxt/catalog/metrics/rag/response_generation/answer_correctness/mistral_small_3_1_24b_instruct_2503_wml_judge.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/metrics/rag/response_generation/answer_correctness 2026-05-27T11:53:56,049 copying build/lib/unitxt/catalog/metrics/rag/response_generation/answer_correctness/sentence_bert_mini_lm.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/metrics/rag/response_generation/answer_correctness 2026-05-27T11:53:56,050 copying build/lib/unitxt/catalog/metrics/rag/response_generation/answer_correctness/token_recall.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/metrics/rag/response_generation/answer_correctness 2026-05-27T11:53:56,052 copying build/lib/unitxt/catalog/metrics/rag/response_generation/answer_correctness/llama_3_3_70b_instruct_watsonx_judge.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/metrics/rag/response_generation/answer_correctness 2026-05-27T11:53:56,054 copying build/lib/unitxt/catalog/metrics/rag/response_generation/answer_correctness/bert_score_recall_ml.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/metrics/rag/response_generation/answer_correctness 2026-05-27T11:53:56,056 copying build/lib/unitxt/catalog/metrics/rag/response_generation/answer_correctness/gpt_oss_120b_watsonx_judge.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/metrics/rag/response_generation/answer_correctness 2026-05-27T11:53:56,057 copying build/lib/unitxt/catalog/metrics/rag/response_generation/answer_correctness/gpt_4o_azure_judge.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/metrics/rag/response_generation/answer_correctness 2026-05-27T11:53:56,059 copying build/lib/unitxt/catalog/metrics/rag/response_generation/answer_correctness/sentence_bert_bge.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/metrics/rag/response_generation/answer_correctness 2026-05-27T11:53:56,061 copying build/lib/unitxt/catalog/metrics/rag/response_generation/answer_correctness/llama_4_maverick_rits_judge.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/metrics/rag/response_generation/answer_correctness 2026-05-27T11:53:56,063 creating build/bdist.linux-armv7l/wheel/unitxt/catalog/metrics/rag/response_generation/answer_relevance 2026-05-27T11:53:56,064 copying build/lib/unitxt/catalog/metrics/rag/response_generation/answer_relevance/llama_4_maverick_watsonx_judge.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/metrics/rag/response_generation/answer_relevance 2026-05-27T11:53:56,066 copying build/lib/unitxt/catalog/metrics/rag/response_generation/answer_relevance/mistral_large_instruct_rits_judge.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/metrics/rag/response_generation/answer_relevance 2026-05-27T11:53:56,068 copying build/lib/unitxt/catalog/metrics/rag/response_generation/answer_relevance/answer_reward.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/metrics/rag/response_generation/answer_relevance 2026-05-27T11:53:56,070 copying build/lib/unitxt/catalog/metrics/rag/response_generation/answer_relevance/llama_3_3_70b_instruct_rits_judge.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/metrics/rag/response_generation/answer_relevance 2026-05-27T11:53:56,072 copying build/lib/unitxt/catalog/metrics/rag/response_generation/answer_relevance/generic_inference_engine_judge.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/metrics/rag/response_generation/answer_relevance 2026-05-27T11:53:56,074 copying build/lib/unitxt/catalog/metrics/rag/response_generation/answer_relevance/gpt_oss_120b_rits_judge.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/metrics/rag/response_generation/answer_relevance 2026-05-27T11:53:56,075 copying build/lib/unitxt/catalog/metrics/rag/response_generation/answer_relevance/mistral_large_instruct_watsonx_judge.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/metrics/rag/response_generation/answer_relevance 2026-05-27T11:53:56,077 copying build/lib/unitxt/catalog/metrics/rag/response_generation/answer_relevance/mistral_small_3_1_24b_instruct_2503_wml_judge.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/metrics/rag/response_generation/answer_relevance 2026-05-27T11:53:56,079 copying build/lib/unitxt/catalog/metrics/rag/response_generation/answer_relevance/token_recall.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/metrics/rag/response_generation/answer_relevance 2026-05-27T11:53:56,081 copying build/lib/unitxt/catalog/metrics/rag/response_generation/answer_relevance/llama_3_3_70b_instruct_watsonx_judge.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/metrics/rag/response_generation/answer_relevance 2026-05-27T11:53:56,082 copying build/lib/unitxt/catalog/metrics/rag/response_generation/answer_relevance/gpt_oss_120b_watsonx_judge.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/metrics/rag/response_generation/answer_relevance 2026-05-27T11:53:56,084 copying build/lib/unitxt/catalog/metrics/rag/response_generation/answer_relevance/gpt_4o_azure_judge.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/metrics/rag/response_generation/answer_relevance 2026-05-27T11:53:56,086 copying build/lib/unitxt/catalog/metrics/rag/response_generation/answer_relevance/llama_4_maverick_rits_judge.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/metrics/rag/response_generation/answer_relevance 2026-05-27T11:53:56,088 creating build/bdist.linux-armv7l/wheel/unitxt/catalog/metrics/rag/response_generation/faithfullness 2026-05-27T11:53:56,089 copying build/lib/unitxt/catalog/metrics/rag/response_generation/faithfullness/token_overlap.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/metrics/rag/response_generation/faithfullness 2026-05-27T11:53:56,092 creating build/bdist.linux-armv7l/wheel/unitxt/catalog/metrics/rag/response_generation/faithfulness 2026-05-27T11:53:56,093 copying build/lib/unitxt/catalog/metrics/rag/response_generation/faithfulness/llama_4_maverick_watsonx_judge.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/metrics/rag/response_generation/faithfulness 2026-05-27T11:53:56,095 copying build/lib/unitxt/catalog/metrics/rag/response_generation/faithfulness/bert_score_k_precision.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/metrics/rag/response_generation/faithfulness 2026-05-27T11:53:56,097 copying build/lib/unitxt/catalog/metrics/rag/response_generation/faithfulness/mistral_large_instruct_rits_judge.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/metrics/rag/response_generation/faithfulness 2026-05-27T11:53:56,098 copying build/lib/unitxt/catalog/metrics/rag/response_generation/faithfulness/token_k_precision.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/metrics/rag/response_generation/faithfulness 2026-05-27T11:53:56,100 copying build/lib/unitxt/catalog/metrics/rag/response_generation/faithfulness/llama_3_3_70b_instruct_rits_judge.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/metrics/rag/response_generation/faithfulness 2026-05-27T11:53:56,102 copying build/lib/unitxt/catalog/metrics/rag/response_generation/faithfulness/generic_inference_engine_judge.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/metrics/rag/response_generation/faithfulness 2026-05-27T11:53:56,104 copying build/lib/unitxt/catalog/metrics/rag/response_generation/faithfulness/gpt_oss_120b_rits_judge.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/metrics/rag/response_generation/faithfulness 2026-05-27T11:53:56,106 copying build/lib/unitxt/catalog/metrics/rag/response_generation/faithfulness/mistral_large_instruct_watsonx_judge.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/metrics/rag/response_generation/faithfulness 2026-05-27T11:53:56,107 copying build/lib/unitxt/catalog/metrics/rag/response_generation/faithfulness/mistral_small_3_1_24b_instruct_2503_wml_judge.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/metrics/rag/response_generation/faithfulness 2026-05-27T11:53:56,109 copying build/lib/unitxt/catalog/metrics/rag/response_generation/faithfulness/sentence_bert_mini_lm.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/metrics/rag/response_generation/faithfulness 2026-05-27T11:53:56,111 copying build/lib/unitxt/catalog/metrics/rag/response_generation/faithfulness/llama_3_3_70b_instruct_watsonx_judge.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/metrics/rag/response_generation/faithfulness 2026-05-27T11:53:56,112 copying build/lib/unitxt/catalog/metrics/rag/response_generation/faithfulness/gpt_oss_120b_watsonx_judge.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/metrics/rag/response_generation/faithfulness 2026-05-27T11:53:56,114 copying build/lib/unitxt/catalog/metrics/rag/response_generation/faithfulness/bert_score_k_precision_ml.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/metrics/rag/response_generation/faithfulness 2026-05-27T11:53:56,116 copying build/lib/unitxt/catalog/metrics/rag/response_generation/faithfulness/vectara_hhem_2_1.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/metrics/rag/response_generation/faithfulness 2026-05-27T11:53:56,117 copying build/lib/unitxt/catalog/metrics/rag/response_generation/faithfulness/gpt_4o_azure_judge.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/metrics/rag/response_generation/faithfulness 2026-05-27T11:53:56,119 copying build/lib/unitxt/catalog/metrics/rag/response_generation/faithfulness/sentence_bert_bge.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/metrics/rag/response_generation/faithfulness 2026-05-27T11:53:56,121 copying build/lib/unitxt/catalog/metrics/rag/response_generation/faithfulness/llama_4_maverick_rits_judge.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/metrics/rag/response_generation/faithfulness 2026-05-27T11:53:56,123 creating build/bdist.linux-armv7l/wheel/unitxt/catalog/metrics/rag/response_generation/recommended 2026-05-27T11:53:56,125 creating build/bdist.linux-armv7l/wheel/unitxt/catalog/metrics/rag/response_generation/recommended/cpu_only 2026-05-27T11:53:56,126 copying build/lib/unitxt/catalog/metrics/rag/response_generation/recommended/cpu_only/all.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/metrics/rag/response_generation/recommended/cpu_only 2026-05-27T11:53:56,128 creating build/bdist.linux-armv7l/wheel/unitxt/catalog/metrics/rag/response_generation/recommended/llmaj_azure 2026-05-27T11:53:56,130 copying build/lib/unitxt/catalog/metrics/rag/response_generation/recommended/llmaj_azure/all.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/metrics/rag/response_generation/recommended/llmaj_azure 2026-05-27T11:53:56,132 creating build/bdist.linux-armv7l/wheel/unitxt/catalog/metrics/rag/response_generation/recommended/llmaj_watsonx 2026-05-27T11:53:56,133 copying build/lib/unitxt/catalog/metrics/rag/response_generation/recommended/llmaj_watsonx/all.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/metrics/rag/response_generation/recommended/llmaj_watsonx 2026-05-27T11:53:56,135 creating build/bdist.linux-armv7l/wheel/unitxt/catalog/metrics/rag/response_generation/recommended/small_llm 2026-05-27T11:53:56,136 copying build/lib/unitxt/catalog/metrics/rag/response_generation/recommended/small_llm/all.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/metrics/rag/response_generation/recommended/small_llm 2026-05-27T11:53:56,139 creating build/bdist.linux-armv7l/wheel/unitxt/catalog/metrics/rag/response_generation/recommended/llmaj_rits 2026-05-27T11:53:56,140 copying build/lib/unitxt/catalog/metrics/rag/response_generation/recommended/llmaj_rits/all.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/metrics/rag/response_generation/recommended/llmaj_rits 2026-05-27T11:53:56,143 creating build/bdist.linux-armv7l/wheel/unitxt/catalog/metrics/rag/faithfulness 2026-05-27T11:53:56,143 copying build/lib/unitxt/catalog/metrics/rag/faithfulness/llama_3_3_70b_instruct_wml_c_a.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/metrics/rag/faithfulness 2026-05-27T11:53:56,145 copying build/lib/unitxt/catalog/metrics/rag/faithfulness/bert_score_k_precision.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/metrics/rag/faithfulness 2026-05-27T11:53:56,147 copying build/lib/unitxt/catalog/metrics/rag/faithfulness/token_k_precision.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/metrics/rag/faithfulness 2026-05-27T11:53:56,148 copying build/lib/unitxt/catalog/metrics/rag/faithfulness/llama_index_by_mock.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/metrics/rag/faithfulness 2026-05-27T11:53:56,150 copying build/lib/unitxt/catalog/metrics/rag/faithfulness/generic_inference_engine_c_a.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/metrics/rag/faithfulness 2026-05-27T11:53:56,152 copying build/lib/unitxt/catalog/metrics/rag/faithfulness/llama_3_3_70b_instruct_wml_q_c_a.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/metrics/rag/faithfulness 2026-05-27T11:53:56,153 copying build/lib/unitxt/catalog/metrics/rag/faithfulness/llama_index_by_gpt_3_5_turbo.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/metrics/rag/faithfulness 2026-05-27T11:53:56,155 copying build/lib/unitxt/catalog/metrics/rag/faithfulness/generic_inference_engine_q_c_a.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/metrics/rag/faithfulness 2026-05-27T11:53:56,157 copying build/lib/unitxt/catalog/metrics/rag/faithfulness/generic_inference_engine_c_a_verbal.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/metrics/rag/faithfulness 2026-05-27T11:53:56,159 copying build/lib/unitxt/catalog/metrics/rag/faithfulness/sentence_bert_mini_lm.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/metrics/rag/faithfulness 2026-05-27T11:53:56,161 copying build/lib/unitxt/catalog/metrics/rag/faithfulness/llama_3_3_70b_instruct_wml_c_a_verbal.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/metrics/rag/faithfulness 2026-05-27T11:53:56,162 copying build/lib/unitxt/catalog/metrics/rag/faithfulness/generic_inference_engine_q_c_a_verbal.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/metrics/rag/faithfulness 2026-05-27T11:53:56,164 copying build/lib/unitxt/catalog/metrics/rag/faithfulness/llama_3_3_70b_instruct_wml_q_c_a_verbal.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/metrics/rag/faithfulness 2026-05-27T11:53:56,166 copying build/lib/unitxt/catalog/metrics/rag/faithfulness/bert_score_k_precision_ml.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/metrics/rag/faithfulness 2026-05-27T11:53:56,168 copying build/lib/unitxt/catalog/metrics/rag/faithfulness/llama_3_3_70b_instruct_wml_q_c_a_logprobs.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/metrics/rag/faithfulness 2026-05-27T11:53:56,169 copying build/lib/unitxt/catalog/metrics/rag/faithfulness/vectara_hhem_2_1.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/metrics/rag/faithfulness 2026-05-27T11:53:56,171 copying build/lib/unitxt/catalog/metrics/rag/faithfulness/sentence_bert_bge.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/metrics/rag/faithfulness 2026-05-27T11:53:56,173 copying build/lib/unitxt/catalog/metrics/rag/faithfulness/llama_3_3_70b_instruct_wml_c_a_logprobs.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/metrics/rag/faithfulness 2026-05-27T11:53:56,175 copying build/lib/unitxt/catalog/metrics/rag/granite_guardian_groundedness.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/metrics/rag 2026-05-27T11:53:56,177 copying build/lib/unitxt/catalog/metrics/rag/context_perplexity.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/metrics/rag 2026-05-27T11:53:56,179 creating build/bdist.linux-armv7l/wheel/unitxt/catalog/metrics/rag/context_correctness 2026-05-27T11:53:56,180 copying build/lib/unitxt/catalog/metrics/rag/context_correctness/map.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/metrics/rag/context_correctness 2026-05-27T11:53:56,182 copying build/lib/unitxt/catalog/metrics/rag/context_correctness/retrieval_at_k.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/metrics/rag/context_correctness 2026-05-27T11:53:56,183 copying build/lib/unitxt/catalog/metrics/rag/context_correctness/mrr.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/metrics/rag/context_correctness 2026-05-27T11:53:56,185 copying build/lib/unitxt/catalog/metrics/rag/context_relevance.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/metrics/rag 2026-05-27T11:53:56,187 copying build/lib/unitxt/catalog/metrics/rag/granite_guardian_context_relevance.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/metrics/rag 2026-05-27T11:53:56,189 copying build/lib/unitxt/catalog/metrics/rag/context_correctness.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/metrics/rag 2026-05-27T11:53:56,191 copying build/lib/unitxt/catalog/metrics/ner.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/metrics 2026-05-27T11:53:56,192 copying build/lib/unitxt/catalog/metrics/regard_metric.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/metrics 2026-05-27T11:53:56,194 copying build/lib/unitxt/catalog/metrics/meteor_hf.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/metrics 2026-05-27T11:53:56,196 copying build/lib/unitxt/catalog/metrics/spearman.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/metrics 2026-05-27T11:53:56,197 copying build/lib/unitxt/catalog/metrics/roc_auc.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/metrics 2026-05-27T11:53:56,199 copying build/lib/unitxt/catalog/metrics/unsorted_list_exact_match.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/metrics 2026-05-27T11:53:56,201 creating build/bdist.linux-armv7l/wheel/unitxt/catalog/metrics/granite_guardian 2026-05-27T11:53:56,203 creating build/bdist.linux-armv7l/wheel/unitxt/catalog/metrics/granite_guardian/assistant_risk 2026-05-27T11:53:56,204 copying build/lib/unitxt/catalog/metrics/granite_guardian/assistant_risk/social_bias.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/metrics/granite_guardian/assistant_risk 2026-05-27T11:53:56,206 copying build/lib/unitxt/catalog/metrics/granite_guardian/assistant_risk/unethical_behavior.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/metrics/granite_guardian/assistant_risk 2026-05-27T11:53:56,208 copying build/lib/unitxt/catalog/metrics/granite_guardian/assistant_risk/harm.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/metrics/granite_guardian/assistant_risk 2026-05-27T11:53:56,210 copying build/lib/unitxt/catalog/metrics/granite_guardian/assistant_risk/violence.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/metrics/granite_guardian/assistant_risk 2026-05-27T11:53:56,212 copying build/lib/unitxt/catalog/metrics/granite_guardian/assistant_risk/profanity.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/metrics/granite_guardian/assistant_risk 2026-05-27T11:53:56,214 creating build/bdist.linux-armv7l/wheel/unitxt/catalog/metrics/granite_guardian/rag_risk 2026-05-27T11:53:56,215 copying build/lib/unitxt/catalog/metrics/granite_guardian/rag_risk/answer_relevance.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/metrics/granite_guardian/rag_risk 2026-05-27T11:53:56,217 copying build/lib/unitxt/catalog/metrics/granite_guardian/rag_risk/groundedness.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/metrics/granite_guardian/rag_risk 2026-05-27T11:53:56,219 copying build/lib/unitxt/catalog/metrics/granite_guardian/rag_risk/context_relevance.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/metrics/granite_guardian/rag_risk 2026-05-27T11:53:56,221 creating build/bdist.linux-armv7l/wheel/unitxt/catalog/metrics/granite_guardian/agentic_risk 2026-05-27T11:53:56,222 copying build/lib/unitxt/catalog/metrics/granite_guardian/agentic_risk/function_call.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/metrics/granite_guardian/agentic_risk 2026-05-27T11:53:56,224 creating build/bdist.linux-armv7l/wheel/unitxt/catalog/metrics/granite_guardian/user_risk 2026-05-27T11:53:56,225 copying build/lib/unitxt/catalog/metrics/granite_guardian/user_risk/social_bias.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/metrics/granite_guardian/user_risk 2026-05-27T11:53:56,228 copying build/lib/unitxt/catalog/metrics/granite_guardian/user_risk/unethical_behavior.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/metrics/granite_guardian/user_risk 2026-05-27T11:53:56,230 copying build/lib/unitxt/catalog/metrics/granite_guardian/user_risk/harm.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/metrics/granite_guardian/user_risk 2026-05-27T11:53:56,231 copying build/lib/unitxt/catalog/metrics/granite_guardian/user_risk/jailbreak.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/metrics/granite_guardian/user_risk 2026-05-27T11:53:56,233 copying build/lib/unitxt/catalog/metrics/granite_guardian/user_risk/violence.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/metrics/granite_guardian/user_risk 2026-05-27T11:53:56,235 copying build/lib/unitxt/catalog/metrics/granite_guardian/user_risk/profanity.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/metrics/granite_guardian/user_risk 2026-05-27T11:53:56,237 copying build/lib/unitxt/catalog/metrics/anls.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/metrics 2026-05-27T11:53:56,239 copying build/lib/unitxt/catalog/metrics/prediction_length.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/metrics 2026-05-27T11:53:56,241 copying build/lib/unitxt/catalog/metrics/retrieval_at_k.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/metrics 2026-05-27T11:53:56,242 copying build/lib/unitxt/catalog/metrics/fin_qa_metric.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/metrics 2026-05-27T11:53:56,244 copying build/lib/unitxt/catalog/metrics/recall_micro_multi_label.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/metrics 2026-05-27T11:53:56,246 copying build/lib/unitxt/catalog/metrics/string_containment.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/metrics 2026-05-27T11:53:56,247 copying build/lib/unitxt/catalog/metrics/precision_binary.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/metrics 2026-05-27T11:53:56,249 copying build/lib/unitxt/catalog/metrics/f1_macro_multi_label.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/metrics 2026-05-27T11:53:56,251 copying build/lib/unitxt/catalog/metrics/squad.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/metrics 2026-05-27T11:53:56,253 copying build/lib/unitxt/catalog/metrics/meteor.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/metrics 2026-05-27T11:53:56,255 creating build/bdist.linux-armv7l/wheel/unitxt/catalog/metrics/perplexity 2026-05-27T11:53:56,256 copying build/lib/unitxt/catalog/metrics/perplexity/flan_t5_small.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/metrics/perplexity 2026-05-27T11:53:56,258 copying build/lib/unitxt/catalog/metrics/f1_macro.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/metrics 2026-05-27T11:53:56,260 copying build/lib/unitxt/catalog/metrics/rouge_with_confidence_intervals.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/metrics 2026-05-27T11:53:56,262 creating build/bdist.linux-armv7l/wheel/unitxt/catalog/metrics/reward 2026-05-27T11:53:56,263 copying build/lib/unitxt/catalog/metrics/reward/deberta_v3_large_v2.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/metrics/reward 2026-05-27T11:53:56,265 copying build/lib/unitxt/catalog/metrics/string_containment_ratio.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/metrics 2026-05-27T11:53:56,267 copying build/lib/unitxt/catalog/metrics/is_code_mixed.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/metrics 2026-05-27T11:53:56,269 creating build/bdist.linux-armv7l/wheel/unitxt/catalog/metrics/perplexity_a 2026-05-27T11:53:56,270 copying build/lib/unitxt/catalog/metrics/perplexity_a/flan_t5_small.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/metrics/perplexity_a 2026-05-27T11:53:56,272 copying build/lib/unitxt/catalog/metrics/fuzzyner.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/metrics 2026-05-27T11:53:56,275 creating build/bdist.linux-armv7l/wheel/unitxt/catalog/metrics/robustness 2026-05-27T11:53:56,276 copying build/lib/unitxt/catalog/metrics/robustness/group_mean_string_containment.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/metrics/robustness 2026-05-27T11:53:56,278 copying build/lib/unitxt/catalog/metrics/robustness/fixed_group_norm_hedges_g_paraphrase_accuracy.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/metrics/robustness 2026-05-27T11:53:56,280 copying build/lib/unitxt/catalog/metrics/robustness/fixed_group_mean_string_containment.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/metrics/robustness 2026-05-27T11:53:56,282 copying build/lib/unitxt/catalog/metrics/robustness/fixed_group_absval_norm_cohens_h_paraphrase_string_containment.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/metrics/robustness 2026-05-27T11:53:56,283 copying build/lib/unitxt/catalog/metrics/robustness/fixed_group_absval_norm_hedges_g_paraphrase_accuracy.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/metrics/robustness 2026-05-27T11:53:56,285 copying build/lib/unitxt/catalog/metrics/robustness/fixed_group_pdr_paraphrase_string_containment.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/metrics/robustness 2026-05-27T11:53:56,287 copying build/lib/unitxt/catalog/metrics/robustness/fixed_group_norm_hedges_g_paraphrase_string_containment.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/metrics/robustness 2026-05-27T11:53:56,289 copying build/lib/unitxt/catalog/metrics/robustness/group_mean_token_overlap.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/metrics/robustness 2026-05-27T11:53:56,290 copying build/lib/unitxt/catalog/metrics/robustness/fixed_group_absval_norm_cohens_h_paraphrase_accuracy.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/metrics/robustness 2026-05-27T11:53:56,292 copying build/lib/unitxt/catalog/metrics/robustness/fixed_group_pdr_paraphrase_accuracy.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/metrics/robustness 2026-05-27T11:53:56,294 copying build/lib/unitxt/catalog/metrics/robustness/fixed_group_mean_baseline_accuracy.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/metrics/robustness 2026-05-27T11:53:56,295 copying build/lib/unitxt/catalog/metrics/robustness/fixed_group_absval_norm_hedges_g_paraphrase_string_containment.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/metrics/robustness 2026-05-27T11:53:56,297 copying build/lib/unitxt/catalog/metrics/robustness/fixed_group_mean_accuracy.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/metrics/robustness 2026-05-27T11:53:56,299 copying build/lib/unitxt/catalog/metrics/robustness/fixed_group_mean_paraphrase_string_containment.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/metrics/robustness 2026-05-27T11:53:56,301 copying build/lib/unitxt/catalog/metrics/robustness/group_mean_accuracy.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/metrics/robustness 2026-05-27T11:53:56,303 copying build/lib/unitxt/catalog/metrics/robustness/fixed_group_norm_cohens_h_paraphrase_accuracy.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/metrics/robustness 2026-05-27T11:53:56,304 copying build/lib/unitxt/catalog/metrics/robustness/fixed_group_norm_cohens_h_paraphrase_string_containment.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/metrics/robustness 2026-05-27T11:53:56,306 copying build/lib/unitxt/catalog/metrics/robustness/fixed_group_mean_baseline_string_containment.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/metrics/robustness 2026-05-27T11:53:56,308 copying build/lib/unitxt/catalog/metrics/robustness/fixed_group_mean_paraphrase_accuracy.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/metrics/robustness 2026-05-27T11:53:56,310 copying build/lib/unitxt/catalog/metrics/safety_metric.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/metrics 2026-05-27T11:53:56,313 creating build/bdist.linux-armv7l/wheel/unitxt/catalog/metrics/bert_score 2026-05-27T11:53:56,314 copying build/lib/unitxt/catalog/metrics/bert_score/distilbert_base_uncased.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/metrics/bert_score 2026-05-27T11:53:56,316 copying build/lib/unitxt/catalog/metrics/bert_score/deberta_v3_base_mnli_xnli_ml.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/metrics/bert_score 2026-05-27T11:53:56,317 copying build/lib/unitxt/catalog/metrics/bert_score/bert_base_uncased.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/metrics/bert_score 2026-05-27T11:53:56,319 copying build/lib/unitxt/catalog/metrics/bert_score/deberta_base_mnli.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/metrics/bert_score 2026-05-27T11:53:56,321 copying build/lib/unitxt/catalog/metrics/bert_score/deberta_xlarge_mnli.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/metrics/bert_score 2026-05-27T11:53:56,323 copying build/lib/unitxt/catalog/metrics/bert_score/deberta_large_mnli.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/metrics/bert_score 2026-05-27T11:53:56,325 copying build/lib/unitxt/catalog/metrics/sacrebleu.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/metrics 2026-05-27T11:53:56,327 copying build/lib/unitxt/catalog/metrics/mrr.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/metrics 2026-05-27T11:53:56,329 creating build/bdist.linux-armv7l/wheel/unitxt/catalog/metrics/text2sql 2026-05-27T11:53:56,330 copying build/lib/unitxt/catalog/metrics/text2sql/non_execution_accuracy.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/metrics/text2sql 2026-05-27T11:53:56,332 copying build/lib/unitxt/catalog/metrics/text2sql/execution_accuracy.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/metrics/text2sql 2026-05-27T11:53:56,334 copying build/lib/unitxt/catalog/metrics/text2sql/execution_logic_accuracy.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/metrics/text2sql 2026-05-27T11:53:56,335 copying build/lib/unitxt/catalog/metrics/f1_micro_multi_label.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/metrics 2026-05-27T11:53:56,337 copying build/lib/unitxt/catalog/metrics/f1_binary.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/metrics 2026-05-27T11:53:56,339 copying build/lib/unitxt/catalog/metrics/bleu.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/metrics 2026-05-27T11:53:56,341 copying build/lib/unitxt/catalog/metrics/char_edit_distance.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/metrics 2026-05-27T11:53:56,342 copying build/lib/unitxt/catalog/metrics/wer.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/metrics 2026-05-27T11:53:56,344 creating build/bdist.linux-armv7l/wheel/unitxt/catalog/metrics/qa 2026-05-27T11:53:56,346 creating build/bdist.linux-armv7l/wheel/unitxt/catalog/metrics/qa/open 2026-05-27T11:53:56,347 copying build/lib/unitxt/catalog/metrics/qa/open/recommended_llm_as_judge.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/metrics/qa/open 2026-05-27T11:53:56,349 copying build/lib/unitxt/catalog/metrics/qa/open/recommended_no_gpu.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/metrics/qa/open 2026-05-27T11:53:56,351 copying build/lib/unitxt/catalog/metrics/qa/open/recommended_local_gpu.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/metrics/qa/open 2026-05-27T11:53:56,352 copying build/lib/unitxt/catalog/metrics/rerank_recall.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/metrics 2026-05-27T11:53:56,354 copying build/lib/unitxt/catalog/metrics/precision_micro_multi_label.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/metrics 2026-05-27T11:53:56,357 creating build/bdist.linux-armv7l/wheel/unitxt/catalog/metrics/key_value_extraction 2026-05-27T11:53:56,358 copying build/lib/unitxt/catalog/metrics/key_value_extraction/accuracy.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/metrics/key_value_extraction 2026-05-27T11:53:56,360 copying build/lib/unitxt/catalog/metrics/key_value_extraction/token_overlap.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/metrics/key_value_extraction 2026-05-27T11:53:56,362 creating build/bdist.linux-armv7l/wheel/unitxt/catalog/metrics/multi_turn 2026-05-27T11:53:56,363 copying build/lib/unitxt/catalog/metrics/multi_turn/accuracy.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/metrics/multi_turn 2026-05-27T11:53:56,365 copying build/lib/unitxt/catalog/metrics/multi_turn/sequential_success_accuracy.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/metrics/multi_turn 2026-05-27T11:53:56,366 copying build/lib/unitxt/catalog/metrics/f1_weighted.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/metrics 2026-05-27T11:53:56,368 copying build/lib/unitxt/catalog/metrics/max_f1_binary.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/metrics 2026-05-27T11:53:56,370 copying build/lib/unitxt/catalog/metrics/relaxed_correctness.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/metrics 2026-05-27T11:53:56,372 creating build/bdist.linux-armv7l/wheel/unitxt/catalog/metrics/llm_as_judge 2026-05-27T11:53:56,374 creating build/bdist.linux-armv7l/wheel/unitxt/catalog/metrics/llm_as_judge/binary 2026-05-27T11:53:56,375 copying build/lib/unitxt/catalog/metrics/llm_as_judge/binary/generic_inference_engine_faithfulness_c_a.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/metrics/llm_as_judge/binary 2026-05-27T11:53:56,377 copying build/lib/unitxt/catalog/metrics/llm_as_judge/binary/llama_3_3_70b_instruct_wml_answer_correctness_q_a_gt_loose_logprobs.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/metrics/llm_as_judge/binary 2026-05-27T11:53:56,379 copying build/lib/unitxt/catalog/metrics/llm_as_judge/binary/llama_3_3_70b_instruct_wml_faithfulness_c_a.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/metrics/llm_as_judge/binary 2026-05-27T11:53:56,380 copying build/lib/unitxt/catalog/metrics/llm_as_judge/binary/generic_inference_engine_answer_correctness_q_a_gt_loose.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/metrics/llm_as_judge/binary 2026-05-27T11:53:56,382 copying build/lib/unitxt/catalog/metrics/llm_as_judge/binary/generic_inference_engine_correctness_holistic_q_c_a.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/metrics/llm_as_judge/binary 2026-05-27T11:53:56,384 copying build/lib/unitxt/catalog/metrics/llm_as_judge/binary/llama_3_3_70b_instruct_wml_context_relevance_q_c_ares_logprobs.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/metrics/llm_as_judge/binary 2026-05-27T11:53:56,385 copying build/lib/unitxt/catalog/metrics/llm_as_judge/binary/generic_inference_engine_faithfulness_q_c_a.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/metrics/llm_as_judge/binary 2026-05-27T11:53:56,387 copying build/lib/unitxt/catalog/metrics/llm_as_judge/binary/llama_3_3_70b_instruct_wml_context_relevance_q_c_ares.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/metrics/llm_as_judge/binary 2026-05-27T11:53:56,389 copying build/lib/unitxt/catalog/metrics/llm_as_judge/binary/llama_3_3_70b_instruct_wml_faithfulness_q_c_a_logprobs.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/metrics/llm_as_judge/binary 2026-05-27T11:53:56,391 copying build/lib/unitxt/catalog/metrics/llm_as_judge/binary/generic_inference_engine_context_relevance_q_c_ares.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/metrics/llm_as_judge/binary 2026-05-27T11:53:56,392 copying build/lib/unitxt/catalog/metrics/llm_as_judge/binary/llama_3_3_70b_instruct_wml_correctness_holistic_q_c_a_logprobs.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/metrics/llm_as_judge/binary 2026-05-27T11:53:56,394 copying build/lib/unitxt/catalog/metrics/llm_as_judge/binary/llama_3_3_70b_instruct_wml_faithfulness_q_c_a.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/metrics/llm_as_judge/binary 2026-05-27T11:53:56,396 copying build/lib/unitxt/catalog/metrics/llm_as_judge/binary/llama_3_3_70b_instruct_wml_answer_relevance_q_a_logprobs.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/metrics/llm_as_judge/binary 2026-05-27T11:53:56,397 copying build/lib/unitxt/catalog/metrics/llm_as_judge/binary/generic_inference_engine_answer_relevance_q_a.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/metrics/llm_as_judge/binary 2026-05-27T11:53:56,399 copying build/lib/unitxt/catalog/metrics/llm_as_judge/binary/llama_3_3_70b_instruct_wml_answer_correctness_q_a_gt_loose.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/metrics/llm_as_judge/binary 2026-05-27T11:53:56,401 copying build/lib/unitxt/catalog/metrics/llm_as_judge/binary/llama_3_3_70b_instruct_wml_answer_relevance_q_a.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/metrics/llm_as_judge/binary 2026-05-27T11:53:56,402 copying build/lib/unitxt/catalog/metrics/llm_as_judge/binary/llama_3_3_70b_instruct_wml_correctness_holistic_q_c_a.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/metrics/llm_as_judge/binary 2026-05-27T11:53:56,404 copying build/lib/unitxt/catalog/metrics/llm_as_judge/binary/llama_3_3_70b_instruct_wml_faithfulness_c_a_logprobs.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/metrics/llm_as_judge/binary 2026-05-27T11:53:56,406 creating build/bdist.linux-armv7l/wheel/unitxt/catalog/metrics/llm_as_judge/pairwise 2026-05-27T11:53:56,408 creating build/bdist.linux-armv7l/wheel/unitxt/catalog/metrics/llm_as_judge/pairwise/replicate 2026-05-27T11:53:56,409 copying build/lib/unitxt/catalog/metrics/llm_as_judge/pairwise/replicate/llama4_scout.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/metrics/llm_as_judge/pairwise/replicate 2026-05-27T11:53:56,411 copying build/lib/unitxt/catalog/metrics/llm_as_judge/pairwise/replicate/gpt_4_1.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/metrics/llm_as_judge/pairwise/replicate 2026-05-27T11:53:56,413 copying build/lib/unitxt/catalog/metrics/llm_as_judge/pairwise/replicate/llama4_maverick.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/metrics/llm_as_judge/pairwise/replicate 2026-05-27T11:53:56,415 creating build/bdist.linux-armv7l/wheel/unitxt/catalog/metrics/llm_as_judge/pairwise/openai 2026-05-27T11:53:56,416 copying build/lib/unitxt/catalog/metrics/llm_as_judge/pairwise/openai/gpt_4o.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/metrics/llm_as_judge/pairwise/openai 2026-05-27T11:53:56,418 copying build/lib/unitxt/catalog/metrics/llm_as_judge/pairwise/openai/gpt_4_1.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/metrics/llm_as_judge/pairwise/openai 2026-05-27T11:53:56,420 copying build/lib/unitxt/catalog/metrics/llm_as_judge/pairwise/openai/o1_preview.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/metrics/llm_as_judge/pairwise/openai 2026-05-27T11:53:56,421 copying build/lib/unitxt/catalog/metrics/llm_as_judge/pairwise/openai/gpt_4_1_nano.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/metrics/llm_as_judge/pairwise/openai 2026-05-27T11:53:56,423 copying build/lib/unitxt/catalog/metrics/llm_as_judge/pairwise/openai/gpt_4_1_mini.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/metrics/llm_as_judge/pairwise/openai 2026-05-27T11:53:56,425 copying build/lib/unitxt/catalog/metrics/llm_as_judge/pairwise/openai/o1_mini.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/metrics/llm_as_judge/pairwise/openai 2026-05-27T11:53:56,427 creating build/bdist.linux-armv7l/wheel/unitxt/catalog/metrics/llm_as_judge/pairwise/ollama 2026-05-27T11:53:56,428 copying build/lib/unitxt/catalog/metrics/llm_as_judge/pairwise/ollama/llama3_3_70b.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/metrics/llm_as_judge/pairwise/ollama 2026-05-27T11:53:56,430 copying build/lib/unitxt/catalog/metrics/llm_as_judge/pairwise/ollama/llama3_1_405b.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/metrics/llm_as_judge/pairwise/ollama 2026-05-27T11:53:56,432 copying build/lib/unitxt/catalog/metrics/llm_as_judge/pairwise/ollama/llama3_1_8b.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/metrics/llm_as_judge/pairwise/ollama 2026-05-27T11:53:56,434 copying build/lib/unitxt/catalog/metrics/llm_as_judge/pairwise/ollama/granite3_3_8b.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/metrics/llm_as_judge/pairwise/ollama 2026-05-27T11:53:56,435 copying build/lib/unitxt/catalog/metrics/llm_as_judge/pairwise/ollama/llama3_1_70b.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/metrics/llm_as_judge/pairwise/ollama 2026-05-27T11:53:56,437 creating build/bdist.linux-armv7l/wheel/unitxt/catalog/metrics/llm_as_judge/pairwise/vertex_ai 2026-05-27T11:53:56,439 copying build/lib/unitxt/catalog/metrics/llm_as_judge/pairwise/vertex_ai/gemini_2_5_flash.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/metrics/llm_as_judge/pairwise/vertex_ai 2026-05-27T11:53:56,440 copying build/lib/unitxt/catalog/metrics/llm_as_judge/pairwise/vertex_ai/gemmini_2_5_pro.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/metrics/llm_as_judge/pairwise/vertex_ai 2026-05-27T11:53:56,443 creating build/bdist.linux-armv7l/wheel/unitxt/catalog/metrics/llm_as_judge/pairwise/azure_openai 2026-05-27T11:53:56,444 copying build/lib/unitxt/catalog/metrics/llm_as_judge/pairwise/azure_openai/llama3_3_70b.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/metrics/llm_as_judge/pairwise/azure_openai 2026-05-27T11:53:56,445 copying build/lib/unitxt/catalog/metrics/llm_as_judge/pairwise/azure_openai/gpt_4o.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/metrics/llm_as_judge/pairwise/azure_openai 2026-05-27T11:53:56,447 copying build/lib/unitxt/catalog/metrics/llm_as_judge/pairwise/azure_openai/llama4_scout.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/metrics/llm_as_judge/pairwise/azure_openai 2026-05-27T11:53:56,449 copying build/lib/unitxt/catalog/metrics/llm_as_judge/pairwise/azure_openai/gpt_4_1.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/metrics/llm_as_judge/pairwise/azure_openai 2026-05-27T11:53:56,451 copying build/lib/unitxt/catalog/metrics/llm_as_judge/pairwise/azure_openai/o1_preview.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/metrics/llm_as_judge/pairwise/azure_openai 2026-05-27T11:53:56,452 copying build/lib/unitxt/catalog/metrics/llm_as_judge/pairwise/azure_openai/gpt_4_1_nano.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/metrics/llm_as_judge/pairwise/azure_openai 2026-05-27T11:53:56,454 copying build/lib/unitxt/catalog/metrics/llm_as_judge/pairwise/azure_openai/gpt_4_1_mini.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/metrics/llm_as_judge/pairwise/azure_openai 2026-05-27T11:53:56,456 copying build/lib/unitxt/catalog/metrics/llm_as_judge/pairwise/azure_openai/o1_mini.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/metrics/llm_as_judge/pairwise/azure_openai 2026-05-27T11:53:56,458 copying build/lib/unitxt/catalog/metrics/llm_as_judge/pairwise/azure_openai/llama4_maverick.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/metrics/llm_as_judge/pairwise/azure_openai 2026-05-27T11:53:56,460 creating build/bdist.linux-armv7l/wheel/unitxt/catalog/metrics/llm_as_judge/pairwise/aws 2026-05-27T11:53:56,461 copying build/lib/unitxt/catalog/metrics/llm_as_judge/pairwise/aws/llama3_3_70b.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/metrics/llm_as_judge/pairwise/aws 2026-05-27T11:53:56,463 copying build/lib/unitxt/catalog/metrics/llm_as_judge/pairwise/aws/llama3_1_405b.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/metrics/llm_as_judge/pairwise/aws 2026-05-27T11:53:56,464 copying build/lib/unitxt/catalog/metrics/llm_as_judge/pairwise/aws/llama4_scout.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/metrics/llm_as_judge/pairwise/aws 2026-05-27T11:53:56,466 copying build/lib/unitxt/catalog/metrics/llm_as_judge/pairwise/aws/deepseek_v3.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/metrics/llm_as_judge/pairwise/aws 2026-05-27T11:53:56,468 copying build/lib/unitxt/catalog/metrics/llm_as_judge/pairwise/aws/mixtral_large.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/metrics/llm_as_judge/pairwise/aws 2026-05-27T11:53:56,470 copying build/lib/unitxt/catalog/metrics/llm_as_judge/pairwise/aws/llama4_maverick.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/metrics/llm_as_judge/pairwise/aws 2026-05-27T11:53:56,472 creating build/bdist.linux-armv7l/wheel/unitxt/catalog/metrics/llm_as_judge/pairwise/watsonx 2026-05-27T11:53:56,473 copying build/lib/unitxt/catalog/metrics/llm_as_judge/pairwise/watsonx/llama3_3_70b.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/metrics/llm_as_judge/pairwise/watsonx 2026-05-27T11:53:56,475 copying build/lib/unitxt/catalog/metrics/llm_as_judge/pairwise/watsonx/llama3_1_405b.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/metrics/llm_as_judge/pairwise/watsonx 2026-05-27T11:53:56,477 copying build/lib/unitxt/catalog/metrics/llm_as_judge/pairwise/watsonx/granite3_2_8b.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/metrics/llm_as_judge/pairwise/watsonx 2026-05-27T11:53:56,478 copying build/lib/unitxt/catalog/metrics/llm_as_judge/pairwise/watsonx/granite3_0_8b.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/metrics/llm_as_judge/pairwise/watsonx 2026-05-27T11:53:56,480 copying build/lib/unitxt/catalog/metrics/llm_as_judge/pairwise/watsonx/llama3_1_8b.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/metrics/llm_as_judge/pairwise/watsonx 2026-05-27T11:53:56,481 copying build/lib/unitxt/catalog/metrics/llm_as_judge/pairwise/watsonx/granite3_3_8b.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/metrics/llm_as_judge/pairwise/watsonx 2026-05-27T11:53:56,483 copying build/lib/unitxt/catalog/metrics/llm_as_judge/pairwise/watsonx/mixtral_large.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/metrics/llm_as_judge/pairwise/watsonx 2026-05-27T11:53:56,485 copying build/lib/unitxt/catalog/metrics/llm_as_judge/pairwise/watsonx/llama3_1_70b.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/metrics/llm_as_judge/pairwise/watsonx 2026-05-27T11:53:56,487 copying build/lib/unitxt/catalog/metrics/llm_as_judge/pairwise/watsonx/mixtral8_7b.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/metrics/llm_as_judge/pairwise/watsonx 2026-05-27T11:53:56,489 creating build/bdist.linux-armv7l/wheel/unitxt/catalog/metrics/llm_as_judge/pairwise/together_ai 2026-05-27T11:53:56,490 copying build/lib/unitxt/catalog/metrics/llm_as_judge/pairwise/together_ai/llama3_3_70b.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/metrics/llm_as_judge/pairwise/together_ai 2026-05-27T11:53:56,492 copying build/lib/unitxt/catalog/metrics/llm_as_judge/pairwise/together_ai/llama3_1_405b.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/metrics/llm_as_judge/pairwise/together_ai 2026-05-27T11:53:56,493 copying build/lib/unitxt/catalog/metrics/llm_as_judge/pairwise/together_ai/llama4_scout.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/metrics/llm_as_judge/pairwise/together_ai 2026-05-27T11:53:56,495 copying build/lib/unitxt/catalog/metrics/llm_as_judge/pairwise/together_ai/deepseek_v3.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/metrics/llm_as_judge/pairwise/together_ai 2026-05-27T11:53:56,497 copying build/lib/unitxt/catalog/metrics/llm_as_judge/pairwise/together_ai/llama3_1_8b.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/metrics/llm_as_judge/pairwise/together_ai 2026-05-27T11:53:56,499 copying build/lib/unitxt/catalog/metrics/llm_as_judge/pairwise/together_ai/llama3_1_70b.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/metrics/llm_as_judge/pairwise/together_ai 2026-05-27T11:53:56,501 copying build/lib/unitxt/catalog/metrics/llm_as_judge/pairwise/together_ai/llama4_maverick.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/metrics/llm_as_judge/pairwise/together_ai 2026-05-27T11:53:56,503 creating build/bdist.linux-armv7l/wheel/unitxt/catalog/metrics/llm_as_judge/pairwise/rits 2026-05-27T11:53:56,504 copying build/lib/unitxt/catalog/metrics/llm_as_judge/pairwise/rits/llama3_3_70b.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/metrics/llm_as_judge/pairwise/rits 2026-05-27T11:53:56,506 copying build/lib/unitxt/catalog/metrics/llm_as_judge/pairwise/rits/llama3_1_405b.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/metrics/llm_as_judge/pairwise/rits 2026-05-27T11:53:56,508 copying build/lib/unitxt/catalog/metrics/llm_as_judge/pairwise/rits/granite3_2_8b.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/metrics/llm_as_judge/pairwise/rits 2026-05-27T11:53:56,510 copying build/lib/unitxt/catalog/metrics/llm_as_judge/pairwise/rits/llama4_scout.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/metrics/llm_as_judge/pairwise/rits 2026-05-27T11:53:56,511 copying build/lib/unitxt/catalog/metrics/llm_as_judge/pairwise/rits/deepseek_v3.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/metrics/llm_as_judge/pairwise/rits 2026-05-27T11:53:56,513 copying build/lib/unitxt/catalog/metrics/llm_as_judge/pairwise/rits/granite3_0_8b.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/metrics/llm_as_judge/pairwise/rits 2026-05-27T11:53:56,515 copying build/lib/unitxt/catalog/metrics/llm_as_judge/pairwise/rits/granite3_1_8b.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/metrics/llm_as_judge/pairwise/rits 2026-05-27T11:53:56,516 copying build/lib/unitxt/catalog/metrics/llm_as_judge/pairwise/rits/llama3_1_8b.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/metrics/llm_as_judge/pairwise/rits 2026-05-27T11:53:56,518 copying build/lib/unitxt/catalog/metrics/llm_as_judge/pairwise/rits/granite3_3_8b.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/metrics/llm_as_judge/pairwise/rits 2026-05-27T11:53:56,520 copying build/lib/unitxt/catalog/metrics/llm_as_judge/pairwise/rits/mixtral_large.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/metrics/llm_as_judge/pairwise/rits 2026-05-27T11:53:56,522 copying build/lib/unitxt/catalog/metrics/llm_as_judge/pairwise/rits/llama4_maverick.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/metrics/llm_as_judge/pairwise/rits 2026-05-27T11:53:56,524 copying build/lib/unitxt/catalog/metrics/llm_as_judge/pairwise/rits/mixtral8_7b.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/metrics/llm_as_judge/pairwise/rits 2026-05-27T11:53:56,526 creating build/bdist.linux-armv7l/wheel/unitxt/catalog/metrics/llm_as_judge/pairwise/criteria 2026-05-27T11:53:56,527 copying build/lib/unitxt/catalog/metrics/llm_as_judge/pairwise/criteria/inclusivity.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/metrics/llm_as_judge/pairwise/criteria 2026-05-27T11:53:56,529 copying build/lib/unitxt/catalog/metrics/llm_as_judge/pairwise/criteria/summarization_preference.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/metrics/llm_as_judge/pairwise/criteria 2026-05-27T11:53:56,531 copying build/lib/unitxt/catalog/metrics/llm_as_judge/pairwise/criteria/email_inclusivity.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/metrics/llm_as_judge/pairwise/criteria 2026-05-27T11:53:56,532 copying build/lib/unitxt/catalog/metrics/llm_as_judge/pairwise/criteria/reference_document_faithfulness.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/metrics/llm_as_judge/pairwise/criteria 2026-05-27T11:53:56,534 copying build/lib/unitxt/catalog/metrics/llm_as_judge/pairwise/criteria/funny_joke.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/metrics/llm_as_judge/pairwise/criteria 2026-05-27T11:53:56,536 copying build/lib/unitxt/catalog/metrics/llm_as_judge/pairwise/criteria/factually_consistent.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/metrics/llm_as_judge/pairwise/criteria 2026-05-27T11:53:56,538 copying build/lib/unitxt/catalog/metrics/llm_as_judge/pairwise/criteria/temperature_in_celsius_and_fahrenheit.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/metrics/llm_as_judge/pairwise/criteria 2026-05-27T11:53:56,540 creating build/bdist.linux-armv7l/wheel/unitxt/catalog/metrics/llm_as_judge/safety 2026-05-27T11:53:56,541 copying build/lib/unitxt/catalog/metrics/llm_as_judge/safety/llamaguard.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/metrics/llm_as_judge/safety 2026-05-27T11:53:56,543 copying build/lib/unitxt/catalog/metrics/llm_as_judge/safety/llama_3_3_70b_instruct_ibm_watsonx_template_harm_rating.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/metrics/llm_as_judge/safety 2026-05-27T11:53:56,545 creating build/bdist.linux-armv7l/wheel/unitxt/catalog/metrics/llm_as_judge/pairwise_comparative_rating 2026-05-27T11:53:56,546 copying build/lib/unitxt/catalog/metrics/llm_as_judge/pairwise_comparative_rating/llama_3_70b_instruct_generic_engine_template_arena_hard_with_shuffling.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/metrics/llm_as_judge/pairwise_comparative_rating 2026-05-27T11:53:56,548 creating build/bdist.linux-armv7l/wheel/unitxt/catalog/metrics/llm_as_judge/pairwise_comparative_rating/llama_3_3_70b_instruct 2026-05-27T11:53:56,549 copying build/lib/unitxt/catalog/metrics/llm_as_judge/pairwise_comparative_rating/llama_3_3_70b_instruct/template_arena_hard.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/metrics/llm_as_judge/pairwise_comparative_rating/llama_3_3_70b_instruct 2026-05-27T11:53:56,552 creating build/bdist.linux-armv7l/wheel/unitxt/catalog/metrics/llm_as_judge/pairwise_comparative_rating/llama_3_8b_instruct 2026-05-27T11:53:56,553 copying build/lib/unitxt/catalog/metrics/llm_as_judge/pairwise_comparative_rating/llama_3_8b_instruct/template_arena_hard.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/metrics/llm_as_judge/pairwise_comparative_rating/llama_3_8b_instruct 2026-05-27T11:53:56,555 creating build/bdist.linux-armv7l/wheel/unitxt/catalog/metrics/llm_as_judge/pairwise_comparative_rating/llama_3_70b_instruct 2026-05-27T11:53:56,556 copying build/lib/unitxt/catalog/metrics/llm_as_judge/pairwise_comparative_rating/llama_3_70b_instruct/template_arena_hard.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/metrics/llm_as_judge/pairwise_comparative_rating/llama_3_70b_instruct 2026-05-27T11:53:56,558 copying build/lib/unitxt/catalog/metrics/llm_as_judge/pairwise_comparative_rating/llama_3_8b_instruct_generic_engine_template_arena_hard.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/metrics/llm_as_judge/pairwise_comparative_rating 2026-05-27T11:53:56,560 copying build/lib/unitxt/catalog/metrics/llm_as_judge/pairwise_comparative_rating/llama_3_8b_instruct_generic_engine_template_arena_hard_with_shuffling.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/metrics/llm_as_judge/pairwise_comparative_rating 2026-05-27T11:53:56,561 copying build/lib/unitxt/catalog/metrics/llm_as_judge/pairwise_comparative_rating/llama_3_70b_instruct_ibm_wml_template_arena_hard_with_shuffling.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/metrics/llm_as_judge/pairwise_comparative_rating 2026-05-27T11:53:56,563 copying build/lib/unitxt/catalog/metrics/llm_as_judge/pairwise_comparative_rating/llama_3_70b_instruct_ibm_wml_template_arena_hard.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/metrics/llm_as_judge/pairwise_comparative_rating 2026-05-27T11:53:56,565 copying build/lib/unitxt/catalog/metrics/llm_as_judge/pairwise_comparative_rating/llama_3_70b_instruct_generic_engine_template_arena_hard.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/metrics/llm_as_judge/pairwise_comparative_rating 2026-05-27T11:53:56,567 creating build/bdist.linux-armv7l/wheel/unitxt/catalog/metrics/llm_as_judge/rating 2026-05-27T11:53:56,568 copying build/lib/unitxt/catalog/metrics/llm_as_judge/rating/llama_3_1_70b_instruct_cross_provider_template_table2text_single_turn_with_reference.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/metrics/llm_as_judge/rating 2026-05-27T11:53:56,570 creating build/bdist.linux-armv7l/wheel/unitxt/catalog/metrics/llm_as_judge/rating/llama_3_8b_instruct 2026-05-27T11:53:56,571 copying build/lib/unitxt/catalog/metrics/llm_as_judge/rating/llama_3_8b_instruct/mt_bench_single_turn.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/metrics/llm_as_judge/rating/llama_3_8b_instruct 2026-05-27T11:53:56,573 copying build/lib/unitxt/catalog/metrics/llm_as_judge/rating/llama_3_70b_instruct_template_table2text_single_turn_with_reference.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/metrics/llm_as_judge/rating 2026-05-27T11:53:56,575 creating build/bdist.linux-armv7l/wheel/unitxt/catalog/metrics/llm_as_judge/rating/llama_3_70b_instruct 2026-05-27T11:53:56,577 copying build/lib/unitxt/catalog/metrics/llm_as_judge/rating/llama_3_70b_instruct/generic_single_turn_with_reference.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/metrics/llm_as_judge/rating/llama_3_70b_instruct 2026-05-27T11:53:56,578 copying build/lib/unitxt/catalog/metrics/llm_as_judge/rating/llama_3_70b_instruct/generic_single_turn.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/metrics/llm_as_judge/rating/llama_3_70b_instruct 2026-05-27T11:53:56,580 copying build/lib/unitxt/catalog/metrics/llm_as_judge/rating/llama_3_70b_instruct/mt_bench_single_turn.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/metrics/llm_as_judge/rating/llama_3_70b_instruct 2026-05-27T11:53:56,582 copying build/lib/unitxt/catalog/metrics/llm_as_judge/rating/mistral_7b_instruct_v0_2_huggingface_template_mt_bench_single_turn.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/metrics/llm_as_judge/rating 2026-05-27T11:53:56,584 creating build/bdist.linux-armv7l/wheel/unitxt/catalog/metrics/llm_as_judge/direct 2026-05-27T11:53:56,586 creating build/bdist.linux-armv7l/wheel/unitxt/catalog/metrics/llm_as_judge/direct/replicate 2026-05-27T11:53:56,588 copying build/lib/unitxt/catalog/metrics/llm_as_judge/direct/replicate/llama4_scout.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/metrics/llm_as_judge/direct/replicate 2026-05-27T11:53:56,590 copying build/lib/unitxt/catalog/metrics/llm_as_judge/direct/replicate/gpt_4_1.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/metrics/llm_as_judge/direct/replicate 2026-05-27T11:53:56,592 copying build/lib/unitxt/catalog/metrics/llm_as_judge/direct/replicate/llama4_maverick.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/metrics/llm_as_judge/direct/replicate 2026-05-27T11:53:56,595 creating build/bdist.linux-armv7l/wheel/unitxt/catalog/metrics/llm_as_judge/direct/openai 2026-05-27T11:53:56,596 copying build/lib/unitxt/catalog/metrics/llm_as_judge/direct/openai/gpt_4o.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/metrics/llm_as_judge/direct/openai 2026-05-27T11:53:56,599 copying build/lib/unitxt/catalog/metrics/llm_as_judge/direct/openai/gpt_4_1.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/metrics/llm_as_judge/direct/openai 2026-05-27T11:53:56,601 copying build/lib/unitxt/catalog/metrics/llm_as_judge/direct/openai/o1_preview.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/metrics/llm_as_judge/direct/openai 2026-05-27T11:53:56,603 copying build/lib/unitxt/catalog/metrics/llm_as_judge/direct/openai/gpt_4_1_nano.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/metrics/llm_as_judge/direct/openai 2026-05-27T11:53:56,605 copying build/lib/unitxt/catalog/metrics/llm_as_judge/direct/openai/gpt_4_1_mini.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/metrics/llm_as_judge/direct/openai 2026-05-27T11:53:56,607 copying build/lib/unitxt/catalog/metrics/llm_as_judge/direct/openai/o1_mini.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/metrics/llm_as_judge/direct/openai 2026-05-27T11:53:56,610 creating build/bdist.linux-armv7l/wheel/unitxt/catalog/metrics/llm_as_judge/direct/ollama 2026-05-27T11:53:56,611 copying build/lib/unitxt/catalog/metrics/llm_as_judge/direct/ollama/llama3_3_70b.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/metrics/llm_as_judge/direct/ollama 2026-05-27T11:53:56,614 copying build/lib/unitxt/catalog/metrics/llm_as_judge/direct/ollama/llama3_1_405b.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/metrics/llm_as_judge/direct/ollama 2026-05-27T11:53:56,616 copying build/lib/unitxt/catalog/metrics/llm_as_judge/direct/ollama/llama3_1_8b.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/metrics/llm_as_judge/direct/ollama 2026-05-27T11:53:56,619 copying build/lib/unitxt/catalog/metrics/llm_as_judge/direct/ollama/granite3_3_8b.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/metrics/llm_as_judge/direct/ollama 2026-05-27T11:53:56,621 copying build/lib/unitxt/catalog/metrics/llm_as_judge/direct/ollama/llama3_1_70b.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/metrics/llm_as_judge/direct/ollama 2026-05-27T11:53:56,624 creating build/bdist.linux-armv7l/wheel/unitxt/catalog/metrics/llm_as_judge/direct/vertex_ai 2026-05-27T11:53:56,625 copying build/lib/unitxt/catalog/metrics/llm_as_judge/direct/vertex_ai/gemini_2_5_flash.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/metrics/llm_as_judge/direct/vertex_ai 2026-05-27T11:53:56,627 copying build/lib/unitxt/catalog/metrics/llm_as_judge/direct/vertex_ai/gemmini_2_5_pro.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/metrics/llm_as_judge/direct/vertex_ai 2026-05-27T11:53:56,630 creating build/bdist.linux-armv7l/wheel/unitxt/catalog/metrics/llm_as_judge/direct/azure_openai 2026-05-27T11:53:56,631 copying build/lib/unitxt/catalog/metrics/llm_as_judge/direct/azure_openai/llama3_3_70b.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/metrics/llm_as_judge/direct/azure_openai 2026-05-27T11:53:56,634 copying build/lib/unitxt/catalog/metrics/llm_as_judge/direct/azure_openai/gpt_4o.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/metrics/llm_as_judge/direct/azure_openai 2026-05-27T11:53:56,636 copying build/lib/unitxt/catalog/metrics/llm_as_judge/direct/azure_openai/llama4_scout.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/metrics/llm_as_judge/direct/azure_openai 2026-05-27T11:53:56,638 copying build/lib/unitxt/catalog/metrics/llm_as_judge/direct/azure_openai/gpt_4_1.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/metrics/llm_as_judge/direct/azure_openai 2026-05-27T11:53:56,640 copying build/lib/unitxt/catalog/metrics/llm_as_judge/direct/azure_openai/o1_preview.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/metrics/llm_as_judge/direct/azure_openai 2026-05-27T11:53:56,642 copying build/lib/unitxt/catalog/metrics/llm_as_judge/direct/azure_openai/gpt_4_1_nano.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/metrics/llm_as_judge/direct/azure_openai 2026-05-27T11:53:56,645 copying build/lib/unitxt/catalog/metrics/llm_as_judge/direct/azure_openai/gpt_4_1_mini.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/metrics/llm_as_judge/direct/azure_openai 2026-05-27T11:53:56,647 copying build/lib/unitxt/catalog/metrics/llm_as_judge/direct/azure_openai/o1_mini.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/metrics/llm_as_judge/direct/azure_openai 2026-05-27T11:53:56,649 copying build/lib/unitxt/catalog/metrics/llm_as_judge/direct/azure_openai/llama4_maverick.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/metrics/llm_as_judge/direct/azure_openai 2026-05-27T11:53:56,652 creating build/bdist.linux-armv7l/wheel/unitxt/catalog/metrics/llm_as_judge/direct/aws 2026-05-27T11:53:56,653 copying build/lib/unitxt/catalog/metrics/llm_as_judge/direct/aws/llama3_3_70b.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/metrics/llm_as_judge/direct/aws 2026-05-27T11:53:56,656 copying build/lib/unitxt/catalog/metrics/llm_as_judge/direct/aws/llama3_1_405b.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/metrics/llm_as_judge/direct/aws 2026-05-27T11:53:56,658 copying build/lib/unitxt/catalog/metrics/llm_as_judge/direct/aws/llama4_scout.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/metrics/llm_as_judge/direct/aws 2026-05-27T11:53:56,660 copying build/lib/unitxt/catalog/metrics/llm_as_judge/direct/aws/deepseek_v3.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/metrics/llm_as_judge/direct/aws 2026-05-27T11:53:56,662 copying build/lib/unitxt/catalog/metrics/llm_as_judge/direct/aws/mixtral_large.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/metrics/llm_as_judge/direct/aws 2026-05-27T11:53:56,665 copying build/lib/unitxt/catalog/metrics/llm_as_judge/direct/aws/llama4_maverick.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/metrics/llm_as_judge/direct/aws 2026-05-27T11:53:56,668 creating build/bdist.linux-armv7l/wheel/unitxt/catalog/metrics/llm_as_judge/direct/watsonx 2026-05-27T11:53:56,669 copying build/lib/unitxt/catalog/metrics/llm_as_judge/direct/watsonx/llama3_3_70b.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/metrics/llm_as_judge/direct/watsonx 2026-05-27T11:53:56,671 copying build/lib/unitxt/catalog/metrics/llm_as_judge/direct/watsonx/llama3_1_405b.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/metrics/llm_as_judge/direct/watsonx 2026-05-27T11:53:56,673 copying build/lib/unitxt/catalog/metrics/llm_as_judge/direct/watsonx/granite3_2_8b.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/metrics/llm_as_judge/direct/watsonx 2026-05-27T11:53:56,675 copying build/lib/unitxt/catalog/metrics/llm_as_judge/direct/watsonx/granite3_0_8b.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/metrics/llm_as_judge/direct/watsonx 2026-05-27T11:53:56,678 copying build/lib/unitxt/catalog/metrics/llm_as_judge/direct/watsonx/llama3_1_8b.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/metrics/llm_as_judge/direct/watsonx 2026-05-27T11:53:56,680 copying build/lib/unitxt/catalog/metrics/llm_as_judge/direct/watsonx/granite3_3_8b.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/metrics/llm_as_judge/direct/watsonx 2026-05-27T11:53:56,682 copying build/lib/unitxt/catalog/metrics/llm_as_judge/direct/watsonx/mixtral_large.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/metrics/llm_as_judge/direct/watsonx 2026-05-27T11:53:56,683 copying build/lib/unitxt/catalog/metrics/llm_as_judge/direct/watsonx/llama3_1_70b.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/metrics/llm_as_judge/direct/watsonx 2026-05-27T11:53:56,685 copying build/lib/unitxt/catalog/metrics/llm_as_judge/direct/watsonx/mixtral8_7b.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/metrics/llm_as_judge/direct/watsonx 2026-05-27T11:53:56,687 creating build/bdist.linux-armv7l/wheel/unitxt/catalog/metrics/llm_as_judge/direct/together_ai 2026-05-27T11:53:56,688 copying build/lib/unitxt/catalog/metrics/llm_as_judge/direct/together_ai/llama3_3_70b.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/metrics/llm_as_judge/direct/together_ai 2026-05-27T11:53:56,690 copying build/lib/unitxt/catalog/metrics/llm_as_judge/direct/together_ai/llama3_1_405b.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/metrics/llm_as_judge/direct/together_ai 2026-05-27T11:53:56,692 copying build/lib/unitxt/catalog/metrics/llm_as_judge/direct/together_ai/llama4_scout.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/metrics/llm_as_judge/direct/together_ai 2026-05-27T11:53:56,694 copying build/lib/unitxt/catalog/metrics/llm_as_judge/direct/together_ai/deepseek_v3.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/metrics/llm_as_judge/direct/together_ai 2026-05-27T11:53:56,696 copying build/lib/unitxt/catalog/metrics/llm_as_judge/direct/together_ai/llama3_1_8b.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/metrics/llm_as_judge/direct/together_ai 2026-05-27T11:53:56,697 copying build/lib/unitxt/catalog/metrics/llm_as_judge/direct/together_ai/llama3_1_70b.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/metrics/llm_as_judge/direct/together_ai 2026-05-27T11:53:56,699 copying build/lib/unitxt/catalog/metrics/llm_as_judge/direct/together_ai/llama4_maverick.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/metrics/llm_as_judge/direct/together_ai 2026-05-27T11:53:56,701 creating build/bdist.linux-armv7l/wheel/unitxt/catalog/metrics/llm_as_judge/direct/rits 2026-05-27T11:53:56,702 copying build/lib/unitxt/catalog/metrics/llm_as_judge/direct/rits/llama3_3_70b.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/metrics/llm_as_judge/direct/rits 2026-05-27T11:53:56,704 copying build/lib/unitxt/catalog/metrics/llm_as_judge/direct/rits/llama3_1_405b.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/metrics/llm_as_judge/direct/rits 2026-05-27T11:53:56,706 copying build/lib/unitxt/catalog/metrics/llm_as_judge/direct/rits/granite3_2_8b.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/metrics/llm_as_judge/direct/rits 2026-05-27T11:53:56,708 copying build/lib/unitxt/catalog/metrics/llm_as_judge/direct/rits/llama4_scout.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/metrics/llm_as_judge/direct/rits 2026-05-27T11:53:56,709 copying build/lib/unitxt/catalog/metrics/llm_as_judge/direct/rits/deepseek_v3.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/metrics/llm_as_judge/direct/rits 2026-05-27T11:53:56,711 copying build/lib/unitxt/catalog/metrics/llm_as_judge/direct/rits/granite3_0_8b.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/metrics/llm_as_judge/direct/rits 2026-05-27T11:53:56,713 copying build/lib/unitxt/catalog/metrics/llm_as_judge/direct/rits/granite3_1_8b.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/metrics/llm_as_judge/direct/rits 2026-05-27T11:53:56,714 copying build/lib/unitxt/catalog/metrics/llm_as_judge/direct/rits/llama3_1_8b.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/metrics/llm_as_judge/direct/rits 2026-05-27T11:53:56,716 copying build/lib/unitxt/catalog/metrics/llm_as_judge/direct/rits/granite3_3_8b.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/metrics/llm_as_judge/direct/rits 2026-05-27T11:53:56,718 copying build/lib/unitxt/catalog/metrics/llm_as_judge/direct/rits/mixtral_large.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/metrics/llm_as_judge/direct/rits 2026-05-27T11:53:56,720 copying build/lib/unitxt/catalog/metrics/llm_as_judge/direct/rits/llama4_maverick.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/metrics/llm_as_judge/direct/rits 2026-05-27T11:53:56,722 copying build/lib/unitxt/catalog/metrics/llm_as_judge/direct/rits/mixtral8_7b.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/metrics/llm_as_judge/direct/rits 2026-05-27T11:53:56,725 creating build/bdist.linux-armv7l/wheel/unitxt/catalog/metrics/llm_as_judge/direct/criteria 2026-05-27T11:53:56,726 copying build/lib/unitxt/catalog/metrics/llm_as_judge/direct/criteria/fluency.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/metrics/llm_as_judge/direct/criteria 2026-05-27T11:53:56,728 copying build/lib/unitxt/catalog/metrics/llm_as_judge/direct/criteria/logical_validity_of_reasoning.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/metrics/llm_as_judge/direct/criteria 2026-05-27T11:53:56,729 copying build/lib/unitxt/catalog/metrics/llm_as_judge/direct/criteria/adherence_with_format.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/metrics/llm_as_judge/direct/criteria 2026-05-27T11:53:56,731 copying build/lib/unitxt/catalog/metrics/llm_as_judge/direct/criteria/insensitivity.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/metrics/llm_as_judge/direct/criteria 2026-05-27T11:53:56,733 copying build/lib/unitxt/catalog/metrics/llm_as_judge/direct/criteria/objectivity.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/metrics/llm_as_judge/direct/criteria 2026-05-27T11:53:56,735 copying build/lib/unitxt/catalog/metrics/llm_as_judge/direct/criteria/harmfulness.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/metrics/llm_as_judge/direct/criteria 2026-05-27T11:53:56,737 copying build/lib/unitxt/catalog/metrics/llm_as_judge/direct/criteria/correctness_based_on_ground_truth.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/metrics/llm_as_judge/direct/criteria 2026-05-27T11:53:56,738 copying build/lib/unitxt/catalog/metrics/llm_as_judge/direct/criteria/assistant_message_unethical_behavior.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/metrics/llm_as_judge/direct/criteria 2026-05-27T11:53:56,740 copying build/lib/unitxt/catalog/metrics/llm_as_judge/direct/criteria/coherence.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/metrics/llm_as_judge/direct/criteria 2026-05-27T11:53:56,742 copying build/lib/unitxt/catalog/metrics/llm_as_judge/direct/criteria/step_by_step_reasoning_non_factual.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/metrics/llm_as_judge/direct/criteria 2026-05-27T11:53:56,744 copying build/lib/unitxt/catalog/metrics/llm_as_judge/direct/criteria/step_by_step_reasoning_non_coherent.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/metrics/llm_as_judge/direct/criteria 2026-05-27T11:53:56,746 copying build/lib/unitxt/catalog/metrics/llm_as_judge/direct/criteria/step_by_step_reasoning_contradiction.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/metrics/llm_as_judge/direct/criteria 2026-05-27T11:53:56,747 copying build/lib/unitxt/catalog/metrics/llm_as_judge/direct/criteria/summarization_fluency.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/metrics/llm_as_judge/direct/criteria 2026-05-27T11:53:56,749 copying build/lib/unitxt/catalog/metrics/llm_as_judge/direct/criteria/summarization_informativeness.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/metrics/llm_as_judge/direct/criteria 2026-05-27T11:53:56,751 copying build/lib/unitxt/catalog/metrics/llm_as_judge/direct/criteria/context_context_relevance.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/metrics/llm_as_judge/direct/criteria 2026-05-27T11:53:56,753 copying build/lib/unitxt/catalog/metrics/llm_as_judge/direct/criteria/user_message_jailbreak.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/metrics/llm_as_judge/direct/criteria 2026-05-27T11:53:56,754 copying build/lib/unitxt/catalog/metrics/llm_as_judge/direct/criteria/summarization_preference.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/metrics/llm_as_judge/direct/criteria 2026-05-27T11:53:56,756 copying build/lib/unitxt/catalog/metrics/llm_as_judge/direct/criteria/step_by_step_reasoning_repetition.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/metrics/llm_as_judge/direct/criteria 2026-05-27T11:53:56,758 copying build/lib/unitxt/catalog/metrics/llm_as_judge/direct/criteria/assistant_message_violence.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/metrics/llm_as_judge/direct/criteria 2026-05-27T11:53:56,760 copying build/lib/unitxt/catalog/metrics/llm_as_judge/direct/criteria/answer_relevance.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/metrics/llm_as_judge/direct/criteria 2026-05-27T11:53:56,762 copying build/lib/unitxt/catalog/metrics/llm_as_judge/direct/criteria/step_by_step_reasoning_hallucination.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/metrics/llm_as_judge/direct/criteria 2026-05-27T11:53:56,763 copying build/lib/unitxt/catalog/metrics/llm_as_judge/direct/criteria/relevance.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/metrics/llm_as_judge/direct/criteria 2026-05-27T11:53:56,765 copying build/lib/unitxt/catalog/metrics/llm_as_judge/direct/criteria/email_structure.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/metrics/llm_as_judge/direct/criteria 2026-05-27T11:53:56,767 copying build/lib/unitxt/catalog/metrics/llm_as_judge/direct/criteria/question_answer_quality.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/metrics/llm_as_judge/direct/criteria 2026-05-27T11:53:56,769 copying build/lib/unitxt/catalog/metrics/llm_as_judge/direct/criteria/summarization_relevance.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/metrics/llm_as_judge/direct/criteria 2026-05-27T11:53:56,771 copying build/lib/unitxt/catalog/metrics/llm_as_judge/direct/criteria/assistant_message_compliance.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/metrics/llm_as_judge/direct/criteria 2026-05-27T11:53:56,773 copying build/lib/unitxt/catalog/metrics/llm_as_judge/direct/criteria/user_message_general_harm.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/metrics/llm_as_judge/direct/criteria 2026-05-27T11:53:56,774 copying build/lib/unitxt/catalog/metrics/llm_as_judge/direct/criteria/step_by_step_reasoning_commonsense.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/metrics/llm_as_judge/direct/criteria 2026-05-27T11:53:56,776 copying build/lib/unitxt/catalog/metrics/llm_as_judge/direct/criteria/answer_completeness.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/metrics/llm_as_judge/direct/criteria 2026-05-27T11:53:56,778 copying build/lib/unitxt/catalog/metrics/llm_as_judge/direct/criteria/assistant_message_general_harm.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/metrics/llm_as_judge/direct/criteria 2026-05-27T11:53:56,780 copying build/lib/unitxt/catalog/metrics/llm_as_judge/direct/criteria/consistency.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/metrics/llm_as_judge/direct/criteria 2026-05-27T11:53:56,782 copying build/lib/unitxt/catalog/metrics/llm_as_judge/direct/criteria/assistant_message_groundedness.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/metrics/llm_as_judge/direct/criteria 2026-05-27T11:53:56,783 copying build/lib/unitxt/catalog/metrics/llm_as_judge/direct/criteria/translation_quality.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/metrics/llm_as_judge/direct/criteria 2026-05-27T11:53:56,785 copying build/lib/unitxt/catalog/metrics/llm_as_judge/direct/criteria/reference_document_faithfulness.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/metrics/llm_as_judge/direct/criteria 2026-05-27T11:53:56,787 copying build/lib/unitxt/catalog/metrics/llm_as_judge/direct/criteria/conciseness.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/metrics/llm_as_judge/direct/criteria 2026-05-27T11:53:56,789 copying build/lib/unitxt/catalog/metrics/llm_as_judge/direct/criteria/step_by_step_reasoning_arithmetic.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/metrics/llm_as_judge/direct/criteria 2026-05-27T11:53:56,790 copying build/lib/unitxt/catalog/metrics/llm_as_judge/direct/criteria/grammar_and_punctuation.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/metrics/llm_as_judge/direct/criteria 2026-05-27T11:53:56,792 copying build/lib/unitxt/catalog/metrics/llm_as_judge/direct/criteria/step_by_step_reasoning_missing_steps.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/metrics/llm_as_judge/direct/criteria 2026-05-27T11:53:56,794 copying build/lib/unitxt/catalog/metrics/llm_as_judge/direct/criteria/summarization_coherence.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/metrics/llm_as_judge/direct/criteria 2026-05-27T11:53:56,796 copying build/lib/unitxt/catalog/metrics/llm_as_judge/direct/criteria/assistant_message_answer_relevance.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/metrics/llm_as_judge/direct/criteria 2026-05-27T11:53:56,798 copying build/lib/unitxt/catalog/metrics/llm_as_judge/direct/criteria/professional_tone.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/metrics/llm_as_judge/direct/criteria 2026-05-27T11:53:56,800 copying build/lib/unitxt/catalog/metrics/llm_as_judge/direct/criteria/examples_and_details.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/metrics/llm_as_judge/direct/criteria 2026-05-27T11:53:56,802 copying build/lib/unitxt/catalog/metrics/llm_as_judge/direct/criteria/step_by_step_reasoning_redundancy.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/metrics/llm_as_judge/direct/criteria 2026-05-27T11:53:56,803 copying build/lib/unitxt/catalog/metrics/llm_as_judge/direct/criteria/user_message_unethical_behavior.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/metrics/llm_as_judge/direct/criteria 2026-05-27T11:53:56,805 copying build/lib/unitxt/catalog/metrics/llm_as_judge/direct/criteria/user_message_profanity.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/metrics/llm_as_judge/direct/criteria 2026-05-27T11:53:56,807 copying build/lib/unitxt/catalog/metrics/llm_as_judge/direct/criteria/temperature_in_celsius_and_fahrenheit.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/metrics/llm_as_judge/direct/criteria 2026-05-27T11:53:56,809 copying build/lib/unitxt/catalog/metrics/llm_as_judge/direct/criteria/assistant_message_profanity.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/metrics/llm_as_judge/direct/criteria 2026-05-27T11:53:56,811 copying build/lib/unitxt/catalog/metrics/llm_as_judge/direct/criteria/information_outside_reference.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/metrics/llm_as_judge/direct/criteria 2026-05-27T11:53:56,813 copying build/lib/unitxt/catalog/metrics/llm_as_judge/direct/criteria/toxicity.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/metrics/llm_as_judge/direct/criteria 2026-05-27T11:53:56,814 copying build/lib/unitxt/catalog/metrics/llm_as_judge/direct/criteria/naturalness.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/metrics/llm_as_judge/direct/criteria 2026-05-27T11:53:56,816 copying build/lib/unitxt/catalog/metrics/llm_as_judge/direct/criteria/manipulative_email.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/metrics/llm_as_judge/direct/criteria 2026-05-27T11:53:56,818 copying build/lib/unitxt/catalog/metrics/llm_as_judge/direct/criteria/assistant_message_social_bias.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/metrics/llm_as_judge/direct/criteria 2026-05-27T11:53:56,820 copying build/lib/unitxt/catalog/metrics/llm_as_judge/direct/criteria/user_message_violence.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/metrics/llm_as_judge/direct/criteria 2026-05-27T11:53:56,821 copying build/lib/unitxt/catalog/metrics/llm_as_judge/direct/criteria/step_by_step_reasoning_bad_grammar.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/metrics/llm_as_judge/direct/criteria 2026-05-27T11:53:56,823 copying build/lib/unitxt/catalog/metrics/llm_as_judge/direct/criteria/engagement.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/metrics/llm_as_judge/direct/criteria 2026-05-27T11:53:56,825 copying build/lib/unitxt/catalog/metrics/llm_as_judge/direct/criteria/truthfulness.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/metrics/llm_as_judge/direct/criteria 2026-05-27T11:53:56,827 copying build/lib/unitxt/catalog/metrics/llm_as_judge/direct/criteria/step_by_step_reasoning_bad_final_answer.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/metrics/llm_as_judge/direct/criteria 2026-05-27T11:53:56,829 copying build/lib/unitxt/catalog/metrics/llm_as_judge/direct/criteria/information_from_reference.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/metrics/llm_as_judge/direct/criteria 2026-05-27T11:53:56,831 copying build/lib/unitxt/catalog/metrics/llm_as_judge/direct/criteria/step_by_step_reasoning_overall_quality.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/metrics/llm_as_judge/direct/criteria 2026-05-27T11:53:56,833 copying build/lib/unitxt/catalog/metrics/llm_as_judge/direct/criteria/empathy.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/metrics/llm_as_judge/direct/criteria 2026-05-27T11:53:56,835 copying build/lib/unitxt/catalog/metrics/llm_as_judge/direct/criteria/user_message_social_bias.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/metrics/llm_as_judge/direct/criteria 2026-05-27T11:53:56,837 copying build/lib/unitxt/catalog/metrics/llm_as_judge/direct/criteria/conversational.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/metrics/llm_as_judge/direct/criteria 2026-05-27T11:53:56,839 copying build/lib/unitxt/catalog/metrics/llm_as_judge/direct/criteria/tool_calling_correctness.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/metrics/llm_as_judge/direct/criteria 2026-05-27T11:53:56,840 copying build/lib/unitxt/catalog/metrics/llm_as_judge/direct/criteria/irrelevant_information.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/metrics/llm_as_judge/direct/criteria 2026-05-27T11:53:56,842 copying build/lib/unitxt/catalog/metrics/llm_as_judge/direct/criteria/step_by_step_reasoning_coherency.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/metrics/llm_as_judge/direct/criteria 2026-05-27T11:53:56,844 copying build/lib/unitxt/catalog/metrics/llm_as_judge/direct/criteria/email_effectiveness.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/metrics/llm_as_judge/direct/criteria 2026-05-27T11:53:56,846 copying build/lib/unitxt/catalog/metrics/recall_binary.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/metrics 2026-05-27T11:53:56,848 copying build/lib/unitxt/catalog/metrics/char_edit_dist_accuracy.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/metrics 2026-05-27T11:53:56,850 copying build/lib/unitxt/catalog/metrics/kendalltau_b.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/metrics 2026-05-27T11:53:56,851 copying build/lib/unitxt/catalog/metrics/metric_based_ner.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/metrics 2026-05-27T11:53:56,853 copying build/lib/unitxt/catalog/metrics/vectara_groundedness_hhem_2_1.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/metrics 2026-05-27T11:53:56,855 copying build/lib/unitxt/catalog/metrics/recall_macro_multi_label.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/metrics 2026-05-27T11:53:56,856 copying build/lib/unitxt/catalog/metrics/websrc_squad_f1.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/metrics 2026-05-27T11:53:56,859 creating build/bdist.linux-armv7l/wheel/unitxt/catalog/metrics/perplexity_q 2026-05-27T11:53:56,860 copying build/lib/unitxt/catalog/metrics/perplexity_q/flan_t5_small.json -> build/bdist.linux-armv7l/wheel/./unitxt/catalog/metrics/perplexity_q 2026-05-27T11:53:56,863 copying build/lib/unitxt/operators.py -> build/bdist.linux-armv7l/wheel/./unitxt 2026-05-27T11:53:56,866 copying build/lib/unitxt/card.py -> build/bdist.linux-armv7l/wheel/./unitxt 2026-05-27T11:53:56,868 copying build/lib/unitxt/types.py -> build/bdist.linux-armv7l/wheel/./unitxt 2026-05-27T11:53:56,870 copying build/lib/unitxt/metric_utils.py -> build/bdist.linux-armv7l/wheel/./unitxt 2026-05-27T11:53:56,873 copying build/lib/unitxt/loaders.py -> build/bdist.linux-armv7l/wheel/./unitxt 2026-05-27T11:53:56,876 copying build/lib/unitxt/settings_utils.py -> build/bdist.linux-armv7l/wheel/./unitxt 2026-05-27T11:53:56,879 copying build/lib/unitxt/fusion.py -> build/bdist.linux-armv7l/wheel/./unitxt 2026-05-27T11:53:56,881 copying build/lib/unitxt/version.py -> build/bdist.linux-armv7l/wheel/./unitxt 2026-05-27T11:53:56,883 copying build/lib/unitxt/augmentors.py -> build/bdist.linux-armv7l/wheel/./unitxt 2026-05-27T11:53:56,885 copying build/lib/unitxt/logging_utils.py -> build/bdist.linux-armv7l/wheel/./unitxt 2026-05-27T11:53:56,887 copying build/lib/unitxt/llm_as_judge_from_template.py -> build/bdist.linux-armv7l/wheel/./unitxt 2026-05-27T11:53:56,890 copying build/lib/unitxt/llm_as_judge_utils.py -> build/bdist.linux-armv7l/wheel/./unitxt 2026-05-27T11:53:56,892 copying build/lib/unitxt/dict_utils.py -> build/bdist.linux-armv7l/wheel/./unitxt 2026-05-27T11:53:56,895 creating build/bdist.linux-armv7l/wheel/unitxt/ui 2026-05-27T11:53:56,896 copying build/lib/unitxt/ui/run.py -> build/bdist.linux-armv7l/wheel/./unitxt/ui 2026-05-27T11:53:56,899 copying build/lib/unitxt/ui/ui_tester.py -> build/bdist.linux-armv7l/wheel/./unitxt/ui 2026-05-27T11:53:56,901 copying build/lib/unitxt/ui/settings.py -> build/bdist.linux-armv7l/wheel/./unitxt/ui 2026-05-27T11:53:56,902 copying build/lib/unitxt/ui/banner.png -> build/bdist.linux-armv7l/wheel/./unitxt/ui 2026-05-27T11:53:56,907 copying build/lib/unitxt/ui/gradio_utils.py -> build/bdist.linux-armv7l/wheel/./unitxt/ui 2026-05-27T11:53:56,909 copying build/lib/unitxt/ui/ui_utils.py -> build/bdist.linux-armv7l/wheel/./unitxt/ui 2026-05-27T11:53:56,911 copying build/lib/unitxt/ui/__init__.py -> build/bdist.linux-armv7l/wheel/./unitxt/ui 2026-05-27T11:53:56,912 copying build/lib/unitxt/ui/load_catalog_data.py -> build/bdist.linux-armv7l/wheel/./unitxt/ui 2026-05-27T11:53:56,915 copying build/lib/unitxt/collections.py -> build/bdist.linux-armv7l/wheel/./unitxt 2026-05-27T11:53:56,917 copying build/lib/unitxt/dataset.py -> build/bdist.linux-armv7l/wheel/./unitxt 2026-05-27T11:53:56,919 copying build/lib/unitxt/image_operators.py -> build/bdist.linux-armv7l/wheel/./unitxt 2026-05-27T11:53:56,922 copying build/lib/unitxt/standard.py -> build/bdist.linux-armv7l/wheel/./unitxt 2026-05-27T11:53:56,924 copying build/lib/unitxt/instructions.py -> build/bdist.linux-armv7l/wheel/./unitxt 2026-05-27T11:53:56,926 copying build/lib/unitxt/llm_as_judge_chat_templates.py -> build/bdist.linux-armv7l/wheel/./unitxt 2026-05-27T11:53:56,928 copying build/lib/unitxt/split_utils.py -> build/bdist.linux-armv7l/wheel/./unitxt 2026-05-27T11:53:56,930 copying build/lib/unitxt/text2sql_utils.py -> build/bdist.linux-armv7l/wheel/./unitxt 2026-05-27T11:53:56,933 copying build/lib/unitxt/llm_as_judge_constants.py -> build/bdist.linux-armv7l/wheel/./unitxt 2026-05-27T11:53:56,936 copying build/lib/unitxt/stream.py -> build/bdist.linux-armv7l/wheel/./unitxt 2026-05-27T11:53:56,938 copying build/lib/unitxt/text_utils.py -> build/bdist.linux-armv7l/wheel/./unitxt 2026-05-27T11:53:56,941 copying build/lib/unitxt/blocks.py -> build/bdist.linux-armv7l/wheel/./unitxt 2026-05-27T11:53:56,943 copying build/lib/unitxt/normalizers.py -> build/bdist.linux-armv7l/wheel/./unitxt 2026-05-27T11:53:56,945 creating build/bdist.linux-armv7l/wheel/unitxt/assistant 2026-05-27T11:53:56,946 copying build/lib/unitxt/assistant/app.py -> build/bdist.linux-armv7l/wheel/./unitxt/assistant 2026-05-27T11:53:56,948 copying build/lib/unitxt/assistant/metadata.parquet -> build/bdist.linux-armv7l/wheel/./unitxt/assistant 2026-05-27T11:53:56,978 copying build/lib/unitxt/assistant/embeddings.npz -> build/bdist.linux-armv7l/wheel/./unitxt/assistant 2026-05-27T11:53:57,347 creating build/bdist.linux-armv7l/wheel/unitxt/assistant/assessment 2026-05-27T11:53:57,349 copying build/lib/unitxt/assistant/assessment/my_pretty_table.py -> build/bdist.linux-armv7l/wheel/./unitxt/assistant/assessment 2026-05-27T11:53:57,351 copying build/lib/unitxt/assistant/assessment/assistant_inference_engine.py -> build/bdist.linux-armv7l/wheel/./unitxt/assistant/assessment 2026-05-27T11:53:57,353 copying build/lib/unitxt/assistant/assessment/__init__.py -> build/bdist.linux-armv7l/wheel/./unitxt/assistant/assessment 2026-05-27T11:53:57,355 copying build/lib/unitxt/assistant/index.py -> build/bdist.linux-armv7l/wheel/./unitxt/assistant 2026-05-27T11:53:57,358 copying build/lib/unitxt/assistant/__init__.py -> build/bdist.linux-armv7l/wheel/./unitxt/assistant 2026-05-27T11:53:57,360 copying build/lib/unitxt/struct_data_operators.py -> build/bdist.linux-armv7l/wheel/./unitxt 2026-05-27T11:53:57,364 copying build/lib/unitxt/register.py -> build/bdist.linux-armv7l/wheel/./unitxt 2026-05-27T11:53:57,367 copying build/lib/unitxt/base_metric.py -> build/bdist.linux-armv7l/wheel/./unitxt 2026-05-27T11:53:57,370 copying build/lib/unitxt/string_operators.py -> build/bdist.linux-armv7l/wheel/./unitxt 2026-05-27T11:53:57,372 copying build/lib/unitxt/__init__.py -> build/bdist.linux-armv7l/wheel/./unitxt 2026-05-27T11:53:57,374 copying build/lib/unitxt/metric.py -> build/bdist.linux-armv7l/wheel/./unitxt 2026-05-27T11:53:57,377 copying build/lib/unitxt/type_utils.py -> build/bdist.linux-armv7l/wheel/./unitxt 2026-05-27T11:53:57,380 copying build/lib/unitxt/recipe.py -> build/bdist.linux-armv7l/wheel/./unitxt 2026-05-27T11:53:57,382 copying build/lib/unitxt/eval_utils.py -> build/bdist.linux-armv7l/wheel/./unitxt 2026-05-27T11:53:57,385 copying build/lib/unitxt/task.py -> build/bdist.linux-armv7l/wheel/./unitxt 2026-05-27T11:53:57,388 copying build/lib/unitxt/stream_operators.py -> build/bdist.linux-armv7l/wheel/./unitxt 2026-05-27T11:53:57,390 copying build/lib/unitxt/random_utils.py -> build/bdist.linux-armv7l/wheel/./unitxt 2026-05-27T11:53:57,393 copying build/lib/unitxt/metrics.py -> build/bdist.linux-armv7l/wheel/./unitxt 2026-05-27T11:53:57,400 running install_egg_info 2026-05-27T11:53:57,409 Copying src/unitxt.egg-info to build/bdist.linux-armv7l/wheel/./unitxt-1.26.10-py3.11.egg-info 2026-05-27T11:53:57,428 running install_scripts 2026-05-27T11:53:57,443 creating build/bdist.linux-armv7l/wheel/unitxt-1.26.10.dist-info/WHEEL 2026-05-27T11:53:57,446 creating '/tmp/pip-wheel-_kdcodhj/.tmp-4qilyefx/unitxt-1.26.10-py3-none-any.whl' and adding 'build/bdist.linux-armv7l/wheel' to it 2026-05-27T11:53:57,450 adding 'unitxt/__init__.py' 2026-05-27T11:53:57,452 adding 'unitxt/api.py' 2026-05-27T11:53:57,455 adding 'unitxt/artifact.py' 2026-05-27T11:53:57,458 adding 'unitxt/augmentors.py' 2026-05-27T11:53:57,459 adding 'unitxt/base_metric.py' 2026-05-27T11:53:57,461 adding 'unitxt/benchmark.py' 2026-05-27T11:53:57,462 adding 'unitxt/blocks.py' 2026-05-27T11:53:57,464 adding 'unitxt/card.py' 2026-05-27T11:53:57,465 adding 'unitxt/catalog.py' 2026-05-27T11:53:57,467 adding 'unitxt/collections.py' 2026-05-27T11:53:57,468 adding 'unitxt/collections_operators.py' 2026-05-27T11:53:57,471 adding 'unitxt/dataclass.py' 2026-05-27T11:53:57,473 adding 'unitxt/dataset.py' 2026-05-27T11:53:57,474 adding 'unitxt/dataset_utils.py' 2026-05-27T11:53:57,475 adding 'unitxt/deprecation_utils.py' 2026-05-27T11:53:57,477 adding 'unitxt/dialog_operators.py' 2026-05-27T11:53:57,481 adding 'unitxt/dict_utils.py' 2026-05-27T11:53:57,483 adding 'unitxt/error_utils.py' 2026-05-27T11:53:57,484 adding 'unitxt/eval_utils.py' 2026-05-27T11:53:57,488 adding 'unitxt/evaluate_cli.py' 2026-05-27T11:53:57,490 adding 'unitxt/file_utils.py' 2026-05-27T11:53:57,493 adding 'unitxt/formats.py' 2026-05-27T11:53:57,494 adding 'unitxt/fusion.py' 2026-05-27T11:53:57,495 adding 'unitxt/generator_utils.py' 2026-05-27T11:53:57,497 adding 'unitxt/hf_utils.py' 2026-05-27T11:53:57,499 adding 'unitxt/image_operators.py' 2026-05-27T11:53:57,514 adding 'unitxt/inference.py' 2026-05-27T11:53:57,516 adding 'unitxt/instructions.py' 2026-05-27T11:53:57,522 adding 'unitxt/llm_as_judge.py' 2026-05-27T11:53:57,524 adding 'unitxt/llm_as_judge_chat_templates.py' 2026-05-27T11:53:57,529 adding 'unitxt/llm_as_judge_constants.py' 2026-05-27T11:53:57,532 adding 'unitxt/llm_as_judge_from_template.py' 2026-05-27T11:53:57,533 adding 'unitxt/llm_as_judge_operators.py' 2026-05-27T11:53:57,535 adding 'unitxt/llm_as_judge_utils.py' 2026-05-27T11:53:57,541 adding 'unitxt/loaders.py' 2026-05-27T11:53:57,543 adding 'unitxt/logging_utils.py' 2026-05-27T11:53:57,544 adding 'unitxt/metric.py' 2026-05-27T11:53:57,548 adding 'unitxt/metric_utils.py' 2026-05-27T11:53:57,580 adding 'unitxt/metrics.py' 2026-05-27T11:53:57,583 adding 'unitxt/normalizers.py' 2026-05-27T11:53:57,586 adding 'unitxt/operator.py' 2026-05-27T11:53:57,600 adding 'unitxt/operators.py' 2026-05-27T11:53:57,602 adding 'unitxt/parsing_utils.py' 2026-05-27T11:53:57,605 adding 'unitxt/processors.py' 2026-05-27T11:53:57,606 adding 'unitxt/random_utils.py' 2026-05-27T11:53:57,608 adding 'unitxt/recipe.py' 2026-05-27T11:53:57,609 adding 'unitxt/register.py' 2026-05-27T11:53:57,611 adding 'unitxt/schema.py' 2026-05-27T11:53:57,612 adding 'unitxt/serializers.py' 2026-05-27T11:53:57,614 adding 'unitxt/settings_utils.py' 2026-05-27T11:53:57,616 adding 'unitxt/span_lableing_operators.py' 2026-05-27T11:53:57,618 adding 'unitxt/split_utils.py' 2026-05-27T11:53:57,620 adding 'unitxt/splitters.py' 2026-05-27T11:53:57,624 adding 'unitxt/standard.py' 2026-05-27T11:53:57,626 adding 'unitxt/stream.py' 2026-05-27T11:53:57,628 adding 'unitxt/stream_operators.py' 2026-05-27T11:53:57,630 adding 'unitxt/string_operators.py' 2026-05-27T11:53:57,634 adding 'unitxt/struct_data_operators.py' 2026-05-27T11:53:57,635 adding 'unitxt/system_prompts.py' 2026-05-27T11:53:57,638 adding 'unitxt/task.py' 2026-05-27T11:53:57,642 adding 'unitxt/templates.py' 2026-05-27T11:53:57,648 adding 'unitxt/text2sql_utils.py' 2026-05-27T11:53:57,650 adding 'unitxt/text_utils.py' 2026-05-27T11:53:57,655 adding 'unitxt/type_utils.py' 2026-05-27T11:53:57,657 adding 'unitxt/types.py' 2026-05-27T11:53:57,659 adding 'unitxt/utils.py' 2026-05-27T11:53:57,661 adding 'unitxt/validate.py' 2026-05-27T11:53:57,662 adding 'unitxt/version.py' 2026-05-27T11:53:57,664 adding 'unitxt/assistant/__init__.py' 2026-05-27T11:53:57,666 adding 'unitxt/assistant/app.py' 2026-05-27T11:54:00,429 adding 'unitxt/assistant/embeddings.npz' 2026-05-27T11:54:00,591 adding 'unitxt/assistant/index.py' 2026-05-27T11:54:00,792 adding 'unitxt/assistant/metadata.parquet' 2026-05-27T11:54:00,806 adding 'unitxt/assistant/assessment/__init__.py' 2026-05-27T11:54:00,807 adding 'unitxt/assistant/assessment/assistant_inference_engine.py' 2026-05-27T11:54:00,808 adding 'unitxt/assistant/assessment/my_pretty_table.py' 2026-05-27T11:54:00,811 adding 'unitxt/catalog/augmentors/augment_whitespace_prefix_and_suffix_task_input.json' 2026-05-27T11:54:00,812 adding 'unitxt/catalog/augmentors/augment_whitespace_task_input.json' 2026-05-27T11:54:00,813 adding 'unitxt/catalog/augmentors/no_augmentation.json' 2026-05-27T11:54:00,815 adding 'unitxt/catalog/augmentors/image/grey_scale.json' 2026-05-27T11:54:00,816 adding 'unitxt/catalog/augmentors/image/grid_lines.json' 2026-05-27T11:54:00,817 adding 'unitxt/catalog/augmentors/image/oldify.json' 2026-05-27T11:54:00,818 adding 'unitxt/catalog/augmentors/image/white_noise.json' 2026-05-27T11:54:00,820 adding 'unitxt/catalog/augmentors/table/duplicate_columns.json' 2026-05-27T11:54:00,821 adding 'unitxt/catalog/augmentors/table/duplicate_rows.json' 2026-05-27T11:54:00,822 adding 'unitxt/catalog/augmentors/table/insert_empty_rows.json' 2026-05-27T11:54:00,823 adding 'unitxt/catalog/augmentors/table/mask_cols_names.json' 2026-05-27T11:54:00,824 adding 'unitxt/catalog/augmentors/table/shuffle_cols.json' 2026-05-27T11:54:00,825 adding 'unitxt/catalog/augmentors/table/shuffle_cols_names.json' 2026-05-27T11:54:00,826 adding 'unitxt/catalog/augmentors/table/shuffle_rows.json' 2026-05-27T11:54:00,828 adding 'unitxt/catalog/augmentors/table/transpose.json' 2026-05-27T11:54:00,829 adding 'unitxt/catalog/augmentors/table/truncate_rows.json' 2026-05-27T11:54:00,830 adding 'unitxt/catalog/augmentors/text/white_space.json' 2026-05-27T11:54:00,832 adding 'unitxt/catalog/augmentors/text/whitespace_prefix_suffix.json' 2026-05-27T11:54:00,834 adding 'unitxt/catalog/benchmarks/bluebench.json' 2026-05-27T11:54:00,835 adding 'unitxt/catalog/benchmarks/glue.json' 2026-05-27T11:54:00,836 adding 'unitxt/catalog/benchmarks/llama_vision.json' 2026-05-27T11:54:00,837 adding 'unitxt/catalog/benchmarks/tool_calling.json' 2026-05-27T11:54:00,840 adding 'unitxt/catalog/benchmarks/torr.json' 2026-05-27T11:54:00,842 adding 'unitxt/catalog/benchmarks/vision_default.json' 2026-05-27T11:54:00,843 adding 'unitxt/catalog/benchmarks/vision_full.json' 2026-05-27T11:54:00,848 adding 'unitxt/catalog/cards/20_newsgroups.json' 2026-05-27T11:54:00,849 adding 'unitxt/catalog/cards/20_newsgroups_short.json' 2026-05-27T11:54:00,850 adding 'unitxt/catalog/cards/ag_news.json' 2026-05-27T11:54:00,852 adding 'unitxt/catalog/cards/ai2d.json' 2026-05-27T11:54:00,853 adding 'unitxt/catalog/cards/almost_evil.json' 2026-05-27T11:54:00,855 adding 'unitxt/catalog/cards/argument_topic.json' 2026-05-27T11:54:00,857 adding 'unitxt/catalog/cards/atis.json' 2026-05-27T11:54:00,858 adding 'unitxt/catalog/cards/atta_q.json' 2026-05-27T11:54:00,859 adding 'unitxt/catalog/cards/attaq.json' 2026-05-27T11:54:00,871 adding 'unitxt/catalog/cards/attaq_500.json' 2026-05-27T11:54:00,874 adding 'unitxt/catalog/cards/banking77.json' 2026-05-27T11:54:00,875 adding 'unitxt/catalog/cards/billsum.json' 2026-05-27T11:54:00,877 adding 'unitxt/catalog/cards/billsum_document_filtered_to_10000_chars.json' 2026-05-27T11:54:00,878 adding 'unitxt/catalog/cards/billsum_document_filtered_to_6000_chars.json' 2026-05-27T11:54:00,879 adding 'unitxt/catalog/cards/bold.json' 2026-05-27T11:54:00,881 adding 'unitxt/catalog/cards/chart_qa.json' 2026-05-27T11:54:00,882 adding 'unitxt/catalog/cards/chart_qa_lmms_eval.json' 2026-05-27T11:54:00,884 adding 'unitxt/catalog/cards/claim_stance_topic.json' 2026-05-27T11:54:00,885 adding 'unitxt/catalog/cards/cnn_dailymail.json' 2026-05-27T11:54:00,886 adding 'unitxt/catalog/cards/coedit_error_detection.json' 2026-05-27T11:54:00,888 adding 'unitxt/catalog/cards/coedit_gec.json' 2026-05-27T11:54:00,889 adding 'unitxt/catalog/cards/cola.json' 2026-05-27T11:54:00,890 adding 'unitxt/catalog/cards/copa.json' 2026-05-27T11:54:00,891 adding 'unitxt/catalog/cards/dart.json' 2026-05-27T11:54:00,893 adding 'unitxt/catalog/cards/dbpedia_14.json' 2026-05-27T11:54:00,894 adding 'unitxt/catalog/cards/ethos_binary.json' 2026-05-27T11:54:00,895 adding 'unitxt/catalog/cards/fin_qa.json' 2026-05-27T11:54:00,897 adding 'unitxt/catalog/cards/financial_tweets.json' 2026-05-27T11:54:00,898 adding 'unitxt/catalog/cards/frames.json' 2026-05-27T11:54:00,899 adding 'unitxt/catalog/cards/hellaswag.json' 2026-05-27T11:54:00,901 adding 'unitxt/catalog/cards/hh_rlhf.json' 2026-05-27T11:54:00,902 adding 'unitxt/catalog/cards/human_eval.json' 2026-05-27T11:54:00,903 adding 'unitxt/catalog/cards/info_vqa.json' 2026-05-27T11:54:00,904 adding 'unitxt/catalog/cards/info_vqa_lmms_eval.json' 2026-05-27T11:54:00,906 adding 'unitxt/catalog/cards/language_identification.json' 2026-05-27T11:54:00,907 adding 'unitxt/catalog/cards/law_stack_exchange.json' 2026-05-27T11:54:00,909 adding 'unitxt/catalog/cards/ledgar.json' 2026-05-27T11:54:00,910 adding 'unitxt/catalog/cards/long_bench_v2.json' 2026-05-27T11:54:00,912 adding 'unitxt/catalog/cards/mbpp.json' 2026-05-27T11:54:00,913 adding 'unitxt/catalog/cards/medical_abstracts.json' 2026-05-27T11:54:00,914 adding 'unitxt/catalog/cards/mnli.json' 2026-05-27T11:54:00,916 adding 'unitxt/catalog/cards/mrpc.json' 2026-05-27T11:54:00,917 adding 'unitxt/catalog/cards/news_category_classification_headline.json' 2026-05-27T11:54:00,918 adding 'unitxt/catalog/cards/numeric_nlg.json' 2026-05-27T11:54:00,919 adding 'unitxt/catalog/cards/open_australian_legal_qa.json' 2026-05-27T11:54:00,921 adding 'unitxt/catalog/cards/openbook_qa.json' 2026-05-27T11:54:00,922 adding 'unitxt/catalog/cards/piqa.json' 2026-05-27T11:54:00,923 adding 'unitxt/catalog/cards/pop_qa.json' 2026-05-27T11:54:00,925 adding 'unitxt/catalog/cards/pop_qa_robust.json' 2026-05-27T11:54:00,926 adding 'unitxt/catalog/cards/qnli.json' 2026-05-27T11:54:00,927 adding 'unitxt/catalog/cards/qqp.json' 2026-05-27T11:54:00,929 adding 'unitxt/catalog/cards/qtsumm.json' 2026-05-27T11:54:00,930 adding 'unitxt/catalog/cards/quality.json' 2026-05-27T11:54:00,931 adding 'unitxt/catalog/cards/race_all.json' 2026-05-27T11:54:00,933 adding 'unitxt/catalog/cards/race_high.json' 2026-05-27T11:54:00,934 adding 'unitxt/catalog/cards/race_middle.json' 2026-05-27T11:54:00,935 adding 'unitxt/catalog/cards/rte.json' 2026-05-27T11:54:00,937 adding 'unitxt/catalog/cards/scigen.json' 2026-05-27T11:54:00,938 adding 'unitxt/catalog/cards/sciq.json' 2026-05-27T11:54:00,939 adding 'unitxt/catalog/cards/seed_bench.json' 2026-05-27T11:54:00,941 adding 'unitxt/catalog/cards/simple_qa.json' 2026-05-27T11:54:00,942 adding 'unitxt/catalog/cards/social_iqa.json' 2026-05-27T11:54:00,944 adding 'unitxt/catalog/cards/squad.json' 2026-05-27T11:54:00,945 adding 'unitxt/catalog/cards/sst2.json' 2026-05-27T11:54:00,946 adding 'unitxt/catalog/cards/stsb.json' 2026-05-27T11:54:00,948 adding 'unitxt/catalog/cards/summarize_from_human_feedback.json' 2026-05-27T11:54:00,949 adding 'unitxt/catalog/cards/tab_fact.json' 2026-05-27T11:54:00,951 adding 'unitxt/catalog/cards/tablebench.json' 2026-05-27T11:54:00,952 adding 'unitxt/catalog/cards/tablebench_data_analysis.json' 2026-05-27T11:54:00,954 adding 'unitxt/catalog/cards/tablebench_fact_checking.json' 2026-05-27T11:54:00,955 adding 'unitxt/catalog/cards/tablebench_numerical_reasoning.json' 2026-05-27T11:54:00,957 adding 'unitxt/catalog/cards/tablerow_classify.json' 2026-05-27T11:54:00,958 adding 'unitxt/catalog/cards/tldr.json' 2026-05-27T11:54:00,960 adding 'unitxt/catalog/cards/tldr_document_filtered_to_10000_chars.json' 2026-05-27T11:54:00,961 adding 'unitxt/catalog/cards/tldr_document_filtered_to_6000_chars.json' 2026-05-27T11:54:00,962 adding 'unitxt/catalog/cards/toxigen.json' 2026-05-27T11:54:00,964 adding 'unitxt/catalog/cards/trec.json' 2026-05-27T11:54:00,966 adding 'unitxt/catalog/cards/turl_col_type.json' 2026-05-27T11:54:00,967 adding 'unitxt/catalog/cards/unfair_tos.json' 2026-05-27T11:54:00,969 adding 'unitxt/catalog/cards/websrc.json' 2026-05-27T11:54:00,970 adding 'unitxt/catalog/cards/wiki_bio.json' 2026-05-27T11:54:00,971 adding 'unitxt/catalog/cards/wikitq.json' 2026-05-27T11:54:00,973 adding 'unitxt/catalog/cards/wnli.json' 2026-05-27T11:54:00,974 adding 'unitxt/catalog/cards/wsc.json' 2026-05-27T11:54:00,975 adding 'unitxt/catalog/cards/xlam_function_calling_60k.json' 2026-05-27T11:54:00,977 adding 'unitxt/catalog/cards/xsum.json' 2026-05-27T11:54:00,978 adding 'unitxt/catalog/cards/yahoo_answers_topics.json' 2026-05-27T11:54:00,980 adding 'unitxt/catalog/cards/20_newsgroups/sklearn.json' 2026-05-27T11:54:00,982 adding 'unitxt/catalog/cards/CFPB/product/2023.json' 2026-05-27T11:54:00,983 adding 'unitxt/catalog/cards/CFPB/product/watsonx.json' 2026-05-27T11:54:00,985 adding 'unitxt/catalog/cards/ai2_arc/arc_challenge.json' 2026-05-27T11:54:00,987 adding 'unitxt/catalog/cards/ai2_arc/arc_easy.json' 2026-05-27T11:54:00,989 adding 'unitxt/catalog/cards/almost_evil/de.json' 2026-05-27T11:54:00,990 adding 'unitxt/catalog/cards/almost_evil/en.json' 2026-05-27T11:54:00,991 adding 'unitxt/catalog/cards/almost_evil/es.json' 2026-05-27T11:54:00,993 adding 'unitxt/catalog/cards/almost_evil/fr.json' 2026-05-27T11:54:00,994 adding 'unitxt/catalog/cards/almost_evil/it.json' 2026-05-27T11:54:00,995 adding 'unitxt/catalog/cards/almost_evil/nl.json' 2026-05-27T11:54:00,997 adding 'unitxt/catalog/cards/almost_evil/pt.json' 2026-05-27T11:54:00,998 adding 'unitxt/catalog/cards/almost_evil/ru.json' 2026-05-27T11:54:01,001 adding 'unitxt/catalog/cards/amazon_mass/af_ZA.json' 2026-05-27T11:54:01,003 adding 'unitxt/catalog/cards/amazon_mass/all.json' 2026-05-27T11:54:01,004 adding 'unitxt/catalog/cards/amazon_mass/am_ET.json' 2026-05-27T11:54:01,006 adding 'unitxt/catalog/cards/amazon_mass/ar_SA.json' 2026-05-27T11:54:01,008 adding 'unitxt/catalog/cards/amazon_mass/az_AZ.json' 2026-05-27T11:54:01,009 adding 'unitxt/catalog/cards/amazon_mass/bn_BD.json' 2026-05-27T11:54:01,011 adding 'unitxt/catalog/cards/amazon_mass/ca_ES.json' 2026-05-27T11:54:01,013 adding 'unitxt/catalog/cards/amazon_mass/cy_GB.json' 2026-05-27T11:54:01,014 adding 'unitxt/catalog/cards/amazon_mass/da_DK.json' 2026-05-27T11:54:01,016 adding 'unitxt/catalog/cards/amazon_mass/de_DE.json' 2026-05-27T11:54:01,018 adding 'unitxt/catalog/cards/amazon_mass/el_GR.json' 2026-05-27T11:54:01,019 adding 'unitxt/catalog/cards/amazon_mass/en_US.json' 2026-05-27T11:54:01,021 adding 'unitxt/catalog/cards/amazon_mass/es_ES.json' 2026-05-27T11:54:01,023 adding 'unitxt/catalog/cards/amazon_mass/fa_IR.json' 2026-05-27T11:54:01,024 adding 'unitxt/catalog/cards/amazon_mass/fi_FI.json' 2026-05-27T11:54:01,026 adding 'unitxt/catalog/cards/amazon_mass/fr_FR.json' 2026-05-27T11:54:01,028 adding 'unitxt/catalog/cards/amazon_mass/he_IL.json' 2026-05-27T11:54:01,029 adding 'unitxt/catalog/cards/amazon_mass/hi_IN.json' 2026-05-27T11:54:01,031 adding 'unitxt/catalog/cards/amazon_mass/hu_HU.json' 2026-05-27T11:54:01,033 adding 'unitxt/catalog/cards/amazon_mass/hy_AM.json' 2026-05-27T11:54:01,035 adding 'unitxt/catalog/cards/amazon_mass/id_ID.json' 2026-05-27T11:54:01,037 adding 'unitxt/catalog/cards/amazon_mass/is_IS.json' 2026-05-27T11:54:01,039 adding 'unitxt/catalog/cards/amazon_mass/it_IT.json' 2026-05-27T11:54:01,041 adding 'unitxt/catalog/cards/amazon_mass/ja_JP.json' 2026-05-27T11:54:01,042 adding 'unitxt/catalog/cards/amazon_mass/jv_ID.json' 2026-05-27T11:54:01,044 adding 'unitxt/catalog/cards/amazon_mass/ka_GE.json' 2026-05-27T11:54:01,046 adding 'unitxt/catalog/cards/amazon_mass/km_KH.json' 2026-05-27T11:54:01,048 adding 'unitxt/catalog/cards/amazon_mass/kn_IN.json' 2026-05-27T11:54:01,050 adding 'unitxt/catalog/cards/amazon_mass/ko_KR.json' 2026-05-27T11:54:01,052 adding 'unitxt/catalog/cards/amazon_mass/lv_LV.json' 2026-05-27T11:54:01,053 adding 'unitxt/catalog/cards/amazon_mass/ml_IN.json' 2026-05-27T11:54:01,055 adding 'unitxt/catalog/cards/amazon_mass/mn_MN.json' 2026-05-27T11:54:01,056 adding 'unitxt/catalog/cards/amazon_mass/ms_MY.json' 2026-05-27T11:54:01,058 adding 'unitxt/catalog/cards/amazon_mass/my_MM.json' 2026-05-27T11:54:01,060 adding 'unitxt/catalog/cards/amazon_mass/nb_NO.json' 2026-05-27T11:54:01,061 adding 'unitxt/catalog/cards/amazon_mass/nl_NL.json' 2026-05-27T11:54:01,063 adding 'unitxt/catalog/cards/amazon_mass/pl_PL.json' 2026-05-27T11:54:01,065 adding 'unitxt/catalog/cards/amazon_mass/pt_PT.json' 2026-05-27T11:54:01,067 adding 'unitxt/catalog/cards/amazon_mass/ro_RO.json' 2026-05-27T11:54:01,068 adding 'unitxt/catalog/cards/amazon_mass/ru_RU.json' 2026-05-27T11:54:01,070 adding 'unitxt/catalog/cards/amazon_mass/sl_SL.json' 2026-05-27T11:54:01,072 adding 'unitxt/catalog/cards/amazon_mass/sq_AL.json' 2026-05-27T11:54:01,073 adding 'unitxt/catalog/cards/amazon_mass/sv_SE.json' 2026-05-27T11:54:01,075 adding 'unitxt/catalog/cards/amazon_mass/sw_KE.json' 2026-05-27T11:54:01,077 adding 'unitxt/catalog/cards/amazon_mass/ta_IN.json' 2026-05-27T11:54:01,078 adding 'unitxt/catalog/cards/amazon_mass/te_IN.json' 2026-05-27T11:54:01,080 adding 'unitxt/catalog/cards/amazon_mass/th_TH.json' 2026-05-27T11:54:01,082 adding 'unitxt/catalog/cards/amazon_mass/tl_PH.json' 2026-05-27T11:54:01,083 adding 'unitxt/catalog/cards/amazon_mass/tr_TR.json' 2026-05-27T11:54:01,085 adding 'unitxt/catalog/cards/amazon_mass/ur_PK.json' 2026-05-27T11:54:01,087 adding 'unitxt/catalog/cards/amazon_mass/vi_VN.json' 2026-05-27T11:54:01,088 adding 'unitxt/catalog/cards/amazon_mass/zh_CN.json' 2026-05-27T11:54:01,090 adding 'unitxt/catalog/cards/amazon_mass/zh_TW.json' 2026-05-27T11:54:01,092 adding 'unitxt/catalog/cards/amazon_mass/all_1/1.json' 2026-05-27T11:54:01,094 adding 'unitxt/catalog/cards/arena_hard/generation/english_gpt_4_0314_reference.json' 2026-05-27T11:54:01,097 adding 'unitxt/catalog/cards/arena_hard/response_assessment/pairwise_comparative_rating/both_games_gpt_4_judge.json' 2026-05-27T11:54:01,098 adding 'unitxt/catalog/cards/arena_hard/response_assessment/pairwise_comparative_rating/both_games_mean_judgment_gpt4_judge.json' 2026-05-27T11:54:01,099 adding 'unitxt/catalog/cards/arena_hard/response_assessment/pairwise_comparative_rating/first_game_only_gpt_4_judge.json' 2026-05-27T11:54:01,101 adding 'unitxt/catalog/cards/babi/qa.json' 2026-05-27T11:54:01,105 adding 'unitxt/catalog/cards/belebele/acm_arab.json' 2026-05-27T11:54:01,107 adding 'unitxt/catalog/cards/belebele/afr_latn.json' 2026-05-27T11:54:01,108 adding 'unitxt/catalog/cards/belebele/als_latn.json' 2026-05-27T11:54:01,109 adding 'unitxt/catalog/cards/belebele/amh_ethi.json' 2026-05-27T11:54:01,111 adding 'unitxt/catalog/cards/belebele/apc_arab.json' 2026-05-27T11:54:01,112 adding 'unitxt/catalog/cards/belebele/arb_arab.json' 2026-05-27T11:54:01,114 adding 'unitxt/catalog/cards/belebele/arb_latn.json' 2026-05-27T11:54:01,115 adding 'unitxt/catalog/cards/belebele/ars_arab.json' 2026-05-27T11:54:01,117 adding 'unitxt/catalog/cards/belebele/ary_arab.json' 2026-05-27T11:54:01,118 adding 'unitxt/catalog/cards/belebele/arz_arab.json' 2026-05-27T11:54:01,120 adding 'unitxt/catalog/cards/belebele/asm_beng.json' 2026-05-27T11:54:01,122 adding 'unitxt/catalog/cards/belebele/azj_latn.json' 2026-05-27T11:54:01,124 adding 'unitxt/catalog/cards/belebele/bam_latn.json' 2026-05-27T11:54:01,125 adding 'unitxt/catalog/cards/belebele/ben_beng.json' 2026-05-27T11:54:01,127 adding 'unitxt/catalog/cards/belebele/ben_latn.json' 2026-05-27T11:54:01,128 adding 'unitxt/catalog/cards/belebele/bod_tibt.json' 2026-05-27T11:54:01,130 adding 'unitxt/catalog/cards/belebele/bul_cyrl.json' 2026-05-27T11:54:01,131 adding 'unitxt/catalog/cards/belebele/cat_latn.json' 2026-05-27T11:54:01,133 adding 'unitxt/catalog/cards/belebele/ceb_latn.json' 2026-05-27T11:54:01,134 adding 'unitxt/catalog/cards/belebele/ces_latn.json' 2026-05-27T11:54:01,136 adding 'unitxt/catalog/cards/belebele/ckb_arab.json' 2026-05-27T11:54:01,137 adding 'unitxt/catalog/cards/belebele/dan_latn.json' 2026-05-27T11:54:01,138 adding 'unitxt/catalog/cards/belebele/deu_latn.json' 2026-05-27T11:54:01,139 adding 'unitxt/catalog/cards/belebele/ell_grek.json' 2026-05-27T11:54:01,141 adding 'unitxt/catalog/cards/belebele/eng_latn.json' 2026-05-27T11:54:01,142 adding 'unitxt/catalog/cards/belebele/est_latn.json' 2026-05-27T11:54:01,143 adding 'unitxt/catalog/cards/belebele/eus_latn.json' 2026-05-27T11:54:01,145 adding 'unitxt/catalog/cards/belebele/fin_latn.json' 2026-05-27T11:54:01,146 adding 'unitxt/catalog/cards/belebele/fra_latn.json' 2026-05-27T11:54:01,147 adding 'unitxt/catalog/cards/belebele/fuv_latn.json' 2026-05-27T11:54:01,149 adding 'unitxt/catalog/cards/belebele/gaz_latn.json' 2026-05-27T11:54:01,150 adding 'unitxt/catalog/cards/belebele/grn_latn.json' 2026-05-27T11:54:01,151 adding 'unitxt/catalog/cards/belebele/guj_gujr.json' 2026-05-27T11:54:01,153 adding 'unitxt/catalog/cards/belebele/hat_latn.json' 2026-05-27T11:54:01,154 adding 'unitxt/catalog/cards/belebele/hau_latn.json' 2026-05-27T11:54:01,156 adding 'unitxt/catalog/cards/belebele/heb_hebr.json' 2026-05-27T11:54:01,157 adding 'unitxt/catalog/cards/belebele/hin_deva.json' 2026-05-27T11:54:01,158 adding 'unitxt/catalog/cards/belebele/hin_latn.json' 2026-05-27T11:54:01,160 adding 'unitxt/catalog/cards/belebele/hrv_latn.json' 2026-05-27T11:54:01,161 adding 'unitxt/catalog/cards/belebele/hun_latn.json' 2026-05-27T11:54:01,162 adding 'unitxt/catalog/cards/belebele/hye_armn.json' 2026-05-27T11:54:01,164 adding 'unitxt/catalog/cards/belebele/ibo_latn.json' 2026-05-27T11:54:01,165 adding 'unitxt/catalog/cards/belebele/ilo_latn.json' 2026-05-27T11:54:01,167 adding 'unitxt/catalog/cards/belebele/ind_latn.json' 2026-05-27T11:54:01,168 adding 'unitxt/catalog/cards/belebele/isl_latn.json' 2026-05-27T11:54:01,169 adding 'unitxt/catalog/cards/belebele/ita_latn.json' 2026-05-27T11:54:01,171 adding 'unitxt/catalog/cards/belebele/jav_latn.json' 2026-05-27T11:54:01,172 adding 'unitxt/catalog/cards/belebele/jpn_jpan.json' 2026-05-27T11:54:01,174 adding 'unitxt/catalog/cards/belebele/kac_latn.json' 2026-05-27T11:54:01,175 adding 'unitxt/catalog/cards/belebele/kan_knda.json' 2026-05-27T11:54:01,176 adding 'unitxt/catalog/cards/belebele/kat_geor.json' 2026-05-27T11:54:01,178 adding 'unitxt/catalog/cards/belebele/kaz_cyrl.json' 2026-05-27T11:54:01,179 adding 'unitxt/catalog/cards/belebele/kea_latn.json' 2026-05-27T11:54:01,180 adding 'unitxt/catalog/cards/belebele/khk_cyrl.json' 2026-05-27T11:54:01,182 adding 'unitxt/catalog/cards/belebele/khm_khmr.json' 2026-05-27T11:54:01,183 adding 'unitxt/catalog/cards/belebele/kin_latn.json' 2026-05-27T11:54:01,184 adding 'unitxt/catalog/cards/belebele/kir_cyrl.json' 2026-05-27T11:54:01,186 adding 'unitxt/catalog/cards/belebele/kor_hang.json' 2026-05-27T11:54:01,187 adding 'unitxt/catalog/cards/belebele/lao_laoo.json' 2026-05-27T11:54:01,189 adding 'unitxt/catalog/cards/belebele/lin_latn.json' 2026-05-27T11:54:01,190 adding 'unitxt/catalog/cards/belebele/lit_latn.json' 2026-05-27T11:54:01,192 adding 'unitxt/catalog/cards/belebele/lug_latn.json' 2026-05-27T11:54:01,194 adding 'unitxt/catalog/cards/belebele/luo_latn.json' 2026-05-27T11:54:01,195 adding 'unitxt/catalog/cards/belebele/lvs_latn.json' 2026-05-27T11:54:01,197 adding 'unitxt/catalog/cards/belebele/mal_mlym.json' 2026-05-27T11:54:01,198 adding 'unitxt/catalog/cards/belebele/mar_deva.json' 2026-05-27T11:54:01,200 adding 'unitxt/catalog/cards/belebele/mkd_cyrl.json' 2026-05-27T11:54:01,201 adding 'unitxt/catalog/cards/belebele/mlt_latn.json' 2026-05-27T11:54:01,203 adding 'unitxt/catalog/cards/belebele/mri_latn.json' 2026-05-27T11:54:01,205 adding 'unitxt/catalog/cards/belebele/mya_mymr.json' 2026-05-27T11:54:01,206 adding 'unitxt/catalog/cards/belebele/nld_latn.json' 2026-05-27T11:54:01,207 adding 'unitxt/catalog/cards/belebele/nob_latn.json' 2026-05-27T11:54:01,209 adding 'unitxt/catalog/cards/belebele/npi_deva.json' 2026-05-27T11:54:01,210 adding 'unitxt/catalog/cards/belebele/npi_latn.json' 2026-05-27T11:54:01,211 adding 'unitxt/catalog/cards/belebele/nso_latn.json' 2026-05-27T11:54:01,212 adding 'unitxt/catalog/cards/belebele/nya_latn.json' 2026-05-27T11:54:01,214 adding 'unitxt/catalog/cards/belebele/ory_orya.json' 2026-05-27T11:54:01,215 adding 'unitxt/catalog/cards/belebele/pan_guru.json' 2026-05-27T11:54:01,216 adding 'unitxt/catalog/cards/belebele/pbt_arab.json' 2026-05-27T11:54:01,218 adding 'unitxt/catalog/cards/belebele/pes_arab.json' 2026-05-27T11:54:01,219 adding 'unitxt/catalog/cards/belebele/plt_latn.json' 2026-05-27T11:54:01,221 adding 'unitxt/catalog/cards/belebele/pol_latn.json' 2026-05-27T11:54:01,222 adding 'unitxt/catalog/cards/belebele/por_latn.json' 2026-05-27T11:54:01,223 adding 'unitxt/catalog/cards/belebele/ron_latn.json' 2026-05-27T11:54:01,225 adding 'unitxt/catalog/cards/belebele/rus_cyrl.json' 2026-05-27T11:54:01,226 adding 'unitxt/catalog/cards/belebele/shn_mymr.json' 2026-05-27T11:54:01,228 adding 'unitxt/catalog/cards/belebele/sin_latn.json' 2026-05-27T11:54:01,229 adding 'unitxt/catalog/cards/belebele/sin_sinh.json' 2026-05-27T11:54:01,230 adding 'unitxt/catalog/cards/belebele/slk_latn.json' 2026-05-27T11:54:01,232 adding 'unitxt/catalog/cards/belebele/slv_latn.json' 2026-05-27T11:54:01,233 adding 'unitxt/catalog/cards/belebele/sna_latn.json' 2026-05-27T11:54:01,234 adding 'unitxt/catalog/cards/belebele/snd_arab.json' 2026-05-27T11:54:01,236 adding 'unitxt/catalog/cards/belebele/som_latn.json' 2026-05-27T11:54:01,237 adding 'unitxt/catalog/cards/belebele/sot_latn.json' 2026-05-27T11:54:01,238 adding 'unitxt/catalog/cards/belebele/spa_latn.json' 2026-05-27T11:54:01,240 adding 'unitxt/catalog/cards/belebele/srp_cyrl.json' 2026-05-27T11:54:01,241 adding 'unitxt/catalog/cards/belebele/ssw_latn.json' 2026-05-27T11:54:01,242 adding 'unitxt/catalog/cards/belebele/sun_latn.json' 2026-05-27T11:54:01,244 adding 'unitxt/catalog/cards/belebele/swe_latn.json' 2026-05-27T11:54:01,245 adding 'unitxt/catalog/cards/belebele/swh_latn.json' 2026-05-27T11:54:01,247 adding 'unitxt/catalog/cards/belebele/tam_taml.json' 2026-05-27T11:54:01,248 adding 'unitxt/catalog/cards/belebele/tel_telu.json' 2026-05-27T11:54:01,249 adding 'unitxt/catalog/cards/belebele/tgk_cyrl.json' 2026-05-27T11:54:01,251 adding 'unitxt/catalog/cards/belebele/tgl_latn.json' 2026-05-27T11:54:01,252 adding 'unitxt/catalog/cards/belebele/tha_thai.json' 2026-05-27T11:54:01,253 adding 'unitxt/catalog/cards/belebele/tir_ethi.json' 2026-05-27T11:54:01,255 adding 'unitxt/catalog/cards/belebele/tsn_latn.json' 2026-05-27T11:54:01,256 adding 'unitxt/catalog/cards/belebele/tso_latn.json' 2026-05-27T11:54:01,257 adding 'unitxt/catalog/cards/belebele/tur_latn.json' 2026-05-27T11:54:01,259 adding 'unitxt/catalog/cards/belebele/ukr_cyrl.json' 2026-05-27T11:54:01,260 adding 'unitxt/catalog/cards/belebele/urd_arab.json' 2026-05-27T11:54:01,261 adding 'unitxt/catalog/cards/belebele/urd_latn.json' 2026-05-27T11:54:01,263 adding 'unitxt/catalog/cards/belebele/uzn_latn.json' 2026-05-27T11:54:01,264 adding 'unitxt/catalog/cards/belebele/vie_latn.json' 2026-05-27T11:54:01,265 adding 'unitxt/catalog/cards/belebele/war_latn.json' 2026-05-27T11:54:01,267 adding 'unitxt/catalog/cards/belebele/wol_latn.json' 2026-05-27T11:54:01,268 adding 'unitxt/catalog/cards/belebele/xho_latn.json' 2026-05-27T11:54:01,270 adding 'unitxt/catalog/cards/belebele/yor_latn.json' 2026-05-27T11:54:01,271 adding 'unitxt/catalog/cards/belebele/zho_hans.json' 2026-05-27T11:54:01,272 adding 'unitxt/catalog/cards/belebele/zho_hant.json' 2026-05-27T11:54:01,274 adding 'unitxt/catalog/cards/belebele/zsm_latn.json' 2026-05-27T11:54:01,275 adding 'unitxt/catalog/cards/belebele/zul_latn.json' 2026-05-27T11:54:01,277 adding 'unitxt/catalog/cards/bfcl/simple_v3.json' 2026-05-27T11:54:01,279 adding 'unitxt/catalog/cards/bfcl/multi_turn/java_v3.json' 2026-05-27T11:54:01,280 adding 'unitxt/catalog/cards/bfcl/multi_turn/javascript_v3.json' 2026-05-27T11:54:01,281 adding 'unitxt/catalog/cards/bfcl/multi_turn/live_irrelevance_v3.json' 2026-05-27T11:54:01,283 adding 'unitxt/catalog/cards/bfcl/multi_turn/live_multiple_v3.json' 2026-05-27T11:54:01,284 adding 'unitxt/catalog/cards/bfcl/multi_turn/live_parallel_multiple_v3.json' 2026-05-27T11:54:01,285 adding 'unitxt/catalog/cards/bfcl/multi_turn/live_parallel_v3.json' 2026-05-27T11:54:01,287 adding 'unitxt/catalog/cards/bfcl/multi_turn/live_relevance_v3.json' 2026-05-27T11:54:01,288 adding 'unitxt/catalog/cards/bfcl/multi_turn/live_simple_v3.json' 2026-05-27T11:54:01,289 adding 'unitxt/catalog/cards/bfcl/multi_turn/multiple_v3.json' 2026-05-27T11:54:01,291 adding 'unitxt/catalog/cards/bfcl/multi_turn/parallel_multiple_v3.json' 2026-05-27T11:54:01,292 adding 'unitxt/catalog/cards/bfcl/multi_turn/parallel_v3.json' 2026-05-27T11:54:01,294 adding 'unitxt/catalog/cards/bfcl/multi_turn/simple_v3.json' 2026-05-27T11:54:01,296 adding 'unitxt/catalog/cards/biggen_bench/results/human_eval.json' 2026-05-27T11:54:01,298 adding 'unitxt/catalog/cards/boolq/classification.json' 2026-05-27T11:54:01,299 adding 'unitxt/catalog/cards/boolq/multiple_choice.json' 2026-05-27T11:54:01,301 adding 'unitxt/catalog/cards/boolq_indic/bn/classification.json' 2026-05-27T11:54:01,302 adding 'unitxt/catalog/cards/boolq_indic/bn/multiple_choice.json' 2026-05-27T11:54:01,304 adding 'unitxt/catalog/cards/boolq_indic/gu/classification.json' 2026-05-27T11:54:01,305 adding 'unitxt/catalog/cards/boolq_indic/gu/multiple_choice.json' 2026-05-27T11:54:01,307 adding 'unitxt/catalog/cards/boolq_indic/hi/classification.json' 2026-05-27T11:54:01,308 adding 'unitxt/catalog/cards/boolq_indic/hi/multiple_choice.json' 2026-05-27T11:54:01,310 adding 'unitxt/catalog/cards/boolq_indic/kn/classification.json' 2026-05-27T11:54:01,311 adding 'unitxt/catalog/cards/boolq_indic/kn/multiple_choice.json' 2026-05-27T11:54:01,313 adding 'unitxt/catalog/cards/boolq_indic/ml/classification.json' 2026-05-27T11:54:01,314 adding 'unitxt/catalog/cards/boolq_indic/ml/multiple_choice.json' 2026-05-27T11:54:01,316 adding 'unitxt/catalog/cards/boolq_indic/mr/classification.json' 2026-05-27T11:54:01,317 adding 'unitxt/catalog/cards/boolq_indic/mr/multiple_choice.json' 2026-05-27T11:54:01,319 adding 'unitxt/catalog/cards/boolq_indic/or/classification.json' 2026-05-27T11:54:01,321 adding 'unitxt/catalog/cards/boolq_indic/or/multiple_choice.json' 2026-05-27T11:54:01,322 adding 'unitxt/catalog/cards/boolq_indic/pa/classification.json' 2026-05-27T11:54:01,324 adding 'unitxt/catalog/cards/boolq_indic/pa/multiple_choice.json' 2026-05-27T11:54:01,325 adding 'unitxt/catalog/cards/boolq_indic/ta/classification.json' 2026-05-27T11:54:01,327 adding 'unitxt/catalog/cards/boolq_indic/ta/multiple_choice.json' 2026-05-27T11:54:01,328 adding 'unitxt/catalog/cards/boolq_indic/te/classification.json' 2026-05-27T11:54:01,330 adding 'unitxt/catalog/cards/boolq_indic/te/multiple_choice.json' 2026-05-27T11:54:01,332 adding 'unitxt/catalog/cards/clinc_oos/imbalanced.json' 2026-05-27T11:54:01,334 adding 'unitxt/catalog/cards/clinc_oos/plus.json' 2026-05-27T11:54:01,336 adding 'unitxt/catalog/cards/clinc_oos/small.json' 2026-05-27T11:54:01,338 adding 'unitxt/catalog/cards/coedit/paraphrase.json' 2026-05-27T11:54:01,340 adding 'unitxt/catalog/cards/coedit/preference.json' 2026-05-27T11:54:01,341 adding 'unitxt/catalog/cards/coedit/rewriting.json' 2026-05-27T11:54:01,342 adding 'unitxt/catalog/cards/coedit/selection.json' 2026-05-27T11:54:01,345 adding 'unitxt/catalog/cards/cohere_for_ai/aya_human_annotated/arb.json' 2026-05-27T11:54:01,346 adding 'unitxt/catalog/cards/cohere_for_ai/aya_human_annotated/eng.json' 2026-05-27T11:54:01,348 adding 'unitxt/catalog/cards/cohere_for_ai/aya_human_annotated/por.json' 2026-05-27T11:54:01,349 adding 'unitxt/catalog/cards/cohere_for_ai/aya_human_annotated/tel.json' 2026-05-27T11:54:01,350 adding 'unitxt/catalog/cards/cohere_for_ai/aya_human_annotated/tur.json' 2026-05-27T11:54:01,352 adding 'unitxt/catalog/cards/cohere_for_ai/aya_human_annotated/yor.json' 2026-05-27T11:54:01,353 adding 'unitxt/catalog/cards/cohere_for_ai/aya_human_annotated/zho.json' 2026-05-27T11:54:01,355 adding 'unitxt/catalog/cards/cohere_for_ai/dolly_human_edited/fra.json' 2026-05-27T11:54:01,356 adding 'unitxt/catalog/cards/cohere_for_ai/dolly_human_edited/spa.json' 2026-05-27T11:54:01,358 adding 'unitxt/catalog/cards/cohere_for_ai/dolly_machine_translated/deu.json' 2026-05-27T11:54:01,360 adding 'unitxt/catalog/cards/cohere_for_ai/dolly_machine_translated/eng.json' 2026-05-27T11:54:01,361 adding 'unitxt/catalog/cards/cohere_for_ai/dolly_machine_translated/fra.json' 2026-05-27T11:54:01,362 adding 'unitxt/catalog/cards/cohere_for_ai/dolly_machine_translated/jpn.json' 2026-05-27T11:54:01,364 adding 'unitxt/catalog/cards/cohere_for_ai/dolly_machine_translated/por.json' 2026-05-27T11:54:01,365 adding 'unitxt/catalog/cards/cohere_for_ai/dolly_machine_translated/spa.json' 2026-05-27T11:54:01,367 adding 'unitxt/catalog/cards/coqa/completion.json' 2026-05-27T11:54:01,368 adding 'unitxt/catalog/cards/coqa/multi_turn.json' 2026-05-27T11:54:01,370 adding 'unitxt/catalog/cards/coqa/qa.json' 2026-05-27T11:54:01,371 adding 'unitxt/catalog/cards/doc_vqa/en.json' 2026-05-27T11:54:01,373 adding 'unitxt/catalog/cards/doc_vqa/fr.json' 2026-05-27T11:54:01,374 adding 'unitxt/catalog/cards/doc_vqa/lmms_eval.json' 2026-05-27T11:54:01,376 adding 'unitxt/catalog/cards/dynamic_cards_for_llm_judges/pairwise_comparative_rating/single_turn.json' 2026-05-27T11:54:01,377 adding 'unitxt/catalog/cards/dynamic_cards_for_llm_judges/rating/single_turn.json' 2026-05-27T11:54:01,378 adding 'unitxt/catalog/cards/dynamic_cards_for_llm_judges/rating/single_turn_with_reference.json' 2026-05-27T11:54:01,380 adding 'unitxt/catalog/cards/ffqa_filtered/16k.json' 2026-05-27T11:54:01,381 adding 'unitxt/catalog/cards/ffqa_filtered/2k.json' 2026-05-27T11:54:01,383 adding 'unitxt/catalog/cards/ffqa_filtered/4k.json' 2026-05-27T11:54:01,384 adding 'unitxt/catalog/cards/ffqa_filtered/8k.json' 2026-05-27T11:54:01,388 adding 'unitxt/catalog/cards/global_mmlu/am/abstract_algebra.json' 2026-05-27T11:54:01,389 adding 'unitxt/catalog/cards/global_mmlu/am/anatomy.json' 2026-05-27T11:54:01,390 adding 'unitxt/catalog/cards/global_mmlu/am/astronomy.json' 2026-05-27T11:54:01,392 adding 'unitxt/catalog/cards/global_mmlu/am/business_ethics.json' 2026-05-27T11:54:01,393 adding 'unitxt/catalog/cards/global_mmlu/am/clinical_knowledge.json' 2026-05-27T11:54:01,395 adding 'unitxt/catalog/cards/global_mmlu/am/college_biology.json' 2026-05-27T11:54:01,396 adding 'unitxt/catalog/cards/global_mmlu/am/college_chemistry.json' 2026-05-27T11:54:01,397 adding 'unitxt/catalog/cards/global_mmlu/am/college_computer_science.json' 2026-05-27T11:54:01,399 adding 'unitxt/catalog/cards/global_mmlu/am/college_mathematics.json' 2026-05-27T11:54:01,400 adding 'unitxt/catalog/cards/global_mmlu/am/college_medicine.json' 2026-05-27T11:54:01,402 adding 'unitxt/catalog/cards/global_mmlu/am/college_physics.json' 2026-05-27T11:54:01,403 adding 'unitxt/catalog/cards/global_mmlu/am/computer_security.json' 2026-05-27T11:54:01,405 adding 'unitxt/catalog/cards/global_mmlu/am/conceptual_physics.json' 2026-05-27T11:54:01,406 adding 'unitxt/catalog/cards/global_mmlu/am/econometrics.json' 2026-05-27T11:54:01,408 adding 'unitxt/catalog/cards/global_mmlu/am/electrical_engineering.json' 2026-05-27T11:54:01,409 adding 'unitxt/catalog/cards/global_mmlu/am/elementary_mathematics.json' 2026-05-27T11:54:01,411 adding 'unitxt/catalog/cards/global_mmlu/am/formal_logic.json' 2026-05-27T11:54:01,412 adding 'unitxt/catalog/cards/global_mmlu/am/global_facts.json' 2026-05-27T11:54:01,413 adding 'unitxt/catalog/cards/global_mmlu/am/high_school_biology.json' 2026-05-27T11:54:01,415 adding 'unitxt/catalog/cards/global_mmlu/am/high_school_chemistry.json' 2026-05-27T11:54:01,416 adding 'unitxt/catalog/cards/global_mmlu/am/high_school_computer_science.json' 2026-05-27T11:54:01,417 adding 'unitxt/catalog/cards/global_mmlu/am/high_school_european_history.json' 2026-05-27T11:54:01,419 adding 'unitxt/catalog/cards/global_mmlu/am/high_school_geography.json' 2026-05-27T11:54:01,420 adding 'unitxt/catalog/cards/global_mmlu/am/high_school_government_and_politics.json' 2026-05-27T11:54:01,422 adding 'unitxt/catalog/cards/global_mmlu/am/high_school_macroeconomics.json' 2026-05-27T11:54:01,423 adding 'unitxt/catalog/cards/global_mmlu/am/high_school_mathematics.json' 2026-05-27T11:54:01,424 adding 'unitxt/catalog/cards/global_mmlu/am/high_school_microeconomics.json' 2026-05-27T11:54:01,426 adding 'unitxt/catalog/cards/global_mmlu/am/high_school_physics.json' 2026-05-27T11:54:01,427 adding 'unitxt/catalog/cards/global_mmlu/am/high_school_psychology.json' 2026-05-27T11:54:01,428 adding 'unitxt/catalog/cards/global_mmlu/am/high_school_statistics.json' 2026-05-27T11:54:01,430 adding 'unitxt/catalog/cards/global_mmlu/am/high_school_us_history.json' 2026-05-27T11:54:01,431 adding 'unitxt/catalog/cards/global_mmlu/am/high_school_world_history.json' 2026-05-27T11:54:01,433 adding 'unitxt/catalog/cards/global_mmlu/am/human_aging.json' 2026-05-27T11:54:01,434 adding 'unitxt/catalog/cards/global_mmlu/am/human_sexuality.json' 2026-05-27T11:54:01,436 adding 'unitxt/catalog/cards/global_mmlu/am/international_law.json' 2026-05-27T11:54:01,437 adding 'unitxt/catalog/cards/global_mmlu/am/jurisprudence.json' 2026-05-27T11:54:01,438 adding 'unitxt/catalog/cards/global_mmlu/am/logical_fallacies.json' 2026-05-27T11:54:01,440 adding 'unitxt/catalog/cards/global_mmlu/am/machine_learning.json' 2026-05-27T11:54:01,441 adding 'unitxt/catalog/cards/global_mmlu/am/management.json' 2026-05-27T11:54:01,442 adding 'unitxt/catalog/cards/global_mmlu/am/marketing.json' 2026-05-27T11:54:01,444 adding 'unitxt/catalog/cards/global_mmlu/am/medical_genetics.json' 2026-05-27T11:54:01,445 adding 'unitxt/catalog/cards/global_mmlu/am/miscellaneous.json' 2026-05-27T11:54:01,446 adding 'unitxt/catalog/cards/global_mmlu/am/moral_disputes.json' 2026-05-27T11:54:01,448 adding 'unitxt/catalog/cards/global_mmlu/am/moral_scenarios.json' 2026-05-27T11:54:01,449 adding 'unitxt/catalog/cards/global_mmlu/am/nutrition.json' 2026-05-27T11:54:01,450 adding 'unitxt/catalog/cards/global_mmlu/am/philosophy.json' 2026-05-27T11:54:01,452 adding 'unitxt/catalog/cards/global_mmlu/am/prehistory.json' 2026-05-27T11:54:01,453 adding 'unitxt/catalog/cards/global_mmlu/am/professional_accounting.json' 2026-05-27T11:54:01,455 adding 'unitxt/catalog/cards/global_mmlu/am/professional_law.json' 2026-05-27T11:54:01,456 adding 'unitxt/catalog/cards/global_mmlu/am/professional_medicine.json' 2026-05-27T11:54:01,458 adding 'unitxt/catalog/cards/global_mmlu/am/professional_psychology.json' 2026-05-27T11:54:01,459 adding 'unitxt/catalog/cards/global_mmlu/am/public_relations.json' 2026-05-27T11:54:01,461 adding 'unitxt/catalog/cards/global_mmlu/am/security_studies.json' 2026-05-27T11:54:01,462 adding 'unitxt/catalog/cards/global_mmlu/am/sociology.json' 2026-05-27T11:54:01,464 adding 'unitxt/catalog/cards/global_mmlu/am/us_foreign_policy.json' 2026-05-27T11:54:01,465 adding 'unitxt/catalog/cards/global_mmlu/am/virology.json' 2026-05-27T11:54:01,467 adding 'unitxt/catalog/cards/global_mmlu/am/world_religions.json' 2026-05-27T11:54:01,470 adding 'unitxt/catalog/cards/global_mmlu/ar/abstract_algebra.json' 2026-05-27T11:54:01,471 adding 'unitxt/catalog/cards/global_mmlu/ar/anatomy.json' 2026-05-27T11:54:01,472 adding 'unitxt/catalog/cards/global_mmlu/ar/astronomy.json' 2026-05-27T11:54:01,474 adding 'unitxt/catalog/cards/global_mmlu/ar/business_ethics.json' 2026-05-27T11:54:01,475 adding 'unitxt/catalog/cards/global_mmlu/ar/clinical_knowledge.json' 2026-05-27T11:54:01,477 adding 'unitxt/catalog/cards/global_mmlu/ar/college_biology.json' 2026-05-27T11:54:01,478 adding 'unitxt/catalog/cards/global_mmlu/ar/college_chemistry.json' 2026-05-27T11:54:01,479 adding 'unitxt/catalog/cards/global_mmlu/ar/college_computer_science.json' 2026-05-27T11:54:01,480 adding 'unitxt/catalog/cards/global_mmlu/ar/college_mathematics.json' 2026-05-27T11:54:01,482 adding 'unitxt/catalog/cards/global_mmlu/ar/college_medicine.json' 2026-05-27T11:54:01,483 adding 'unitxt/catalog/cards/global_mmlu/ar/college_physics.json' 2026-05-27T11:54:01,484 adding 'unitxt/catalog/cards/global_mmlu/ar/computer_security.json' 2026-05-27T11:54:01,486 adding 'unitxt/catalog/cards/global_mmlu/ar/conceptual_physics.json' 2026-05-27T11:54:01,487 adding 'unitxt/catalog/cards/global_mmlu/ar/econometrics.json' 2026-05-27T11:54:01,488 adding 'unitxt/catalog/cards/global_mmlu/ar/electrical_engineering.json' 2026-05-27T11:54:01,490 adding 'unitxt/catalog/cards/global_mmlu/ar/elementary_mathematics.json' 2026-05-27T11:54:01,491 adding 'unitxt/catalog/cards/global_mmlu/ar/formal_logic.json' 2026-05-27T11:54:01,492 adding 'unitxt/catalog/cards/global_mmlu/ar/global_facts.json' 2026-05-27T11:54:01,494 adding 'unitxt/catalog/cards/global_mmlu/ar/high_school_biology.json' 2026-05-27T11:54:01,495 adding 'unitxt/catalog/cards/global_mmlu/ar/high_school_chemistry.json' 2026-05-27T11:54:01,497 adding 'unitxt/catalog/cards/global_mmlu/ar/high_school_computer_science.json' 2026-05-27T11:54:01,498 adding 'unitxt/catalog/cards/global_mmlu/ar/high_school_european_history.json' 2026-05-27T11:54:01,499 adding 'unitxt/catalog/cards/global_mmlu/ar/high_school_geography.json' 2026-05-27T11:54:01,501 adding 'unitxt/catalog/cards/global_mmlu/ar/high_school_government_and_politics.json' 2026-05-27T11:54:01,502 adding 'unitxt/catalog/cards/global_mmlu/ar/high_school_macroeconomics.json' 2026-05-27T11:54:01,503 adding 'unitxt/catalog/cards/global_mmlu/ar/high_school_mathematics.json' 2026-05-27T11:54:01,505 adding 'unitxt/catalog/cards/global_mmlu/ar/high_school_microeconomics.json' 2026-05-27T11:54:01,506 adding 'unitxt/catalog/cards/global_mmlu/ar/high_school_physics.json' 2026-05-27T11:54:01,508 adding 'unitxt/catalog/cards/global_mmlu/ar/high_school_psychology.json' 2026-05-27T11:54:01,509 adding 'unitxt/catalog/cards/global_mmlu/ar/high_school_statistics.json' 2026-05-27T11:54:01,510 adding 'unitxt/catalog/cards/global_mmlu/ar/high_school_us_history.json' 2026-05-27T11:54:01,512 adding 'unitxt/catalog/cards/global_mmlu/ar/high_school_world_history.json' 2026-05-27T11:54:01,513 adding 'unitxt/catalog/cards/global_mmlu/ar/human_aging.json' 2026-05-27T11:54:01,514 adding 'unitxt/catalog/cards/global_mmlu/ar/human_sexuality.json' 2026-05-27T11:54:01,516 adding 'unitxt/catalog/cards/global_mmlu/ar/international_law.json' 2026-05-27T11:54:01,517 adding 'unitxt/catalog/cards/global_mmlu/ar/jurisprudence.json' 2026-05-27T11:54:01,519 adding 'unitxt/catalog/cards/global_mmlu/ar/logical_fallacies.json' 2026-05-27T11:54:01,520 adding 'unitxt/catalog/cards/global_mmlu/ar/machine_learning.json' 2026-05-27T11:54:01,522 adding 'unitxt/catalog/cards/global_mmlu/ar/management.json' 2026-05-27T11:54:01,523 adding 'unitxt/catalog/cards/global_mmlu/ar/marketing.json' 2026-05-27T11:54:01,524 adding 'unitxt/catalog/cards/global_mmlu/ar/medical_genetics.json' 2026-05-27T11:54:01,526 adding 'unitxt/catalog/cards/global_mmlu/ar/miscellaneous.json' 2026-05-27T11:54:01,527 adding 'unitxt/catalog/cards/global_mmlu/ar/moral_disputes.json' 2026-05-27T11:54:01,528 adding 'unitxt/catalog/cards/global_mmlu/ar/moral_scenarios.json' 2026-05-27T11:54:01,530 adding 'unitxt/catalog/cards/global_mmlu/ar/nutrition.json' 2026-05-27T11:54:01,531 adding 'unitxt/catalog/cards/global_mmlu/ar/philosophy.json' 2026-05-27T11:54:01,533 adding 'unitxt/catalog/cards/global_mmlu/ar/prehistory.json' 2026-05-27T11:54:01,534 adding 'unitxt/catalog/cards/global_mmlu/ar/professional_accounting.json' 2026-05-27T11:54:01,536 adding 'unitxt/catalog/cards/global_mmlu/ar/professional_law.json' 2026-05-27T11:54:01,537 adding 'unitxt/catalog/cards/global_mmlu/ar/professional_medicine.json' 2026-05-27T11:54:01,538 adding 'unitxt/catalog/cards/global_mmlu/ar/professional_psychology.json' 2026-05-27T11:54:01,540 adding 'unitxt/catalog/cards/global_mmlu/ar/public_relations.json' 2026-05-27T11:54:01,541 adding 'unitxt/catalog/cards/global_mmlu/ar/security_studies.json' 2026-05-27T11:54:01,542 adding 'unitxt/catalog/cards/global_mmlu/ar/sociology.json' 2026-05-27T11:54:01,543 adding 'unitxt/catalog/cards/global_mmlu/ar/us_foreign_policy.json' 2026-05-27T11:54:01,545 adding 'unitxt/catalog/cards/global_mmlu/ar/virology.json' 2026-05-27T11:54:01,546 adding 'unitxt/catalog/cards/global_mmlu/ar/world_religions.json' 2026-05-27T11:54:01,549 adding 'unitxt/catalog/cards/global_mmlu/bn/abstract_algebra.json' 2026-05-27T11:54:01,550 adding 'unitxt/catalog/cards/global_mmlu/bn/anatomy.json' 2026-05-27T11:54:01,551 adding 'unitxt/catalog/cards/global_mmlu/bn/astronomy.json' 2026-05-27T11:54:01,552 adding 'unitxt/catalog/cards/global_mmlu/bn/business_ethics.json' 2026-05-27T11:54:01,554 adding 'unitxt/catalog/cards/global_mmlu/bn/clinical_knowledge.json' 2026-05-27T11:54:01,555 adding 'unitxt/catalog/cards/global_mmlu/bn/college_biology.json' 2026-05-27T11:54:01,556 adding 'unitxt/catalog/cards/global_mmlu/bn/college_chemistry.json' 2026-05-27T11:54:01,558 adding 'unitxt/catalog/cards/global_mmlu/bn/college_computer_science.json' 2026-05-27T11:54:01,559 adding 'unitxt/catalog/cards/global_mmlu/bn/college_mathematics.json' 2026-05-27T11:54:01,560 adding 'unitxt/catalog/cards/global_mmlu/bn/college_medicine.json' 2026-05-27T11:54:01,562 adding 'unitxt/catalog/cards/global_mmlu/bn/college_physics.json' 2026-05-27T11:54:01,563 adding 'unitxt/catalog/cards/global_mmlu/bn/computer_security.json' 2026-05-27T11:54:01,564 adding 'unitxt/catalog/cards/global_mmlu/bn/conceptual_physics.json' 2026-05-27T11:54:01,566 adding 'unitxt/catalog/cards/global_mmlu/bn/econometrics.json' 2026-05-27T11:54:01,567 adding 'unitxt/catalog/cards/global_mmlu/bn/electrical_engineering.json' 2026-05-27T11:54:01,568 adding 'unitxt/catalog/cards/global_mmlu/bn/elementary_mathematics.json' 2026-05-27T11:54:01,570 adding 'unitxt/catalog/cards/global_mmlu/bn/formal_logic.json' 2026-05-27T11:54:01,571 adding 'unitxt/catalog/cards/global_mmlu/bn/global_facts.json' 2026-05-27T11:54:01,572 adding 'unitxt/catalog/cards/global_mmlu/bn/high_school_biology.json' 2026-05-27T11:54:01,574 adding 'unitxt/catalog/cards/global_mmlu/bn/high_school_chemistry.json' 2026-05-27T11:54:01,575 adding 'unitxt/catalog/cards/global_mmlu/bn/high_school_computer_science.json' 2026-05-27T11:54:01,576 adding 'unitxt/catalog/cards/global_mmlu/bn/high_school_european_history.json' 2026-05-27T11:54:01,578 adding 'unitxt/catalog/cards/global_mmlu/bn/high_school_geography.json' 2026-05-27T11:54:01,579 adding 'unitxt/catalog/cards/global_mmlu/bn/high_school_government_and_politics.json' 2026-05-27T11:54:01,580 adding 'unitxt/catalog/cards/global_mmlu/bn/high_school_macroeconomics.json' 2026-05-27T11:54:01,582 adding 'unitxt/catalog/cards/global_mmlu/bn/high_school_mathematics.json' 2026-05-27T11:54:01,583 adding 'unitxt/catalog/cards/global_mmlu/bn/high_school_microeconomics.json' 2026-05-27T11:54:01,584 adding 'unitxt/catalog/cards/global_mmlu/bn/high_school_physics.json' 2026-05-27T11:54:01,586 adding 'unitxt/catalog/cards/global_mmlu/bn/high_school_psychology.json' 2026-05-27T11:54:01,587 adding 'unitxt/catalog/cards/global_mmlu/bn/high_school_statistics.json' 2026-05-27T11:54:01,588 adding 'unitxt/catalog/cards/global_mmlu/bn/high_school_us_history.json' 2026-05-27T11:54:01,590 adding 'unitxt/catalog/cards/global_mmlu/bn/high_school_world_history.json' 2026-05-27T11:54:01,591 adding 'unitxt/catalog/cards/global_mmlu/bn/human_aging.json' 2026-05-27T11:54:01,592 adding 'unitxt/catalog/cards/global_mmlu/bn/human_sexuality.json' 2026-05-27T11:54:01,594 adding 'unitxt/catalog/cards/global_mmlu/bn/international_law.json' 2026-05-27T11:54:01,595 adding 'unitxt/catalog/cards/global_mmlu/bn/jurisprudence.json' 2026-05-27T11:54:01,596 adding 'unitxt/catalog/cards/global_mmlu/bn/logical_fallacies.json' 2026-05-27T11:54:01,598 adding 'unitxt/catalog/cards/global_mmlu/bn/machine_learning.json' 2026-05-27T11:54:01,599 adding 'unitxt/catalog/cards/global_mmlu/bn/management.json' 2026-05-27T11:54:01,600 adding 'unitxt/catalog/cards/global_mmlu/bn/marketing.json' 2026-05-27T11:54:01,601 adding 'unitxt/catalog/cards/global_mmlu/bn/medical_genetics.json' 2026-05-27T11:54:01,602 adding 'unitxt/catalog/cards/global_mmlu/bn/miscellaneous.json' 2026-05-27T11:54:01,604 adding 'unitxt/catalog/cards/global_mmlu/bn/moral_disputes.json' 2026-05-27T11:54:01,605 adding 'unitxt/catalog/cards/global_mmlu/bn/moral_scenarios.json' 2026-05-27T11:54:01,606 adding 'unitxt/catalog/cards/global_mmlu/bn/nutrition.json' 2026-05-27T11:54:01,608 adding 'unitxt/catalog/cards/global_mmlu/bn/philosophy.json' 2026-05-27T11:54:01,609 adding 'unitxt/catalog/cards/global_mmlu/bn/prehistory.json' 2026-05-27T11:54:01,610 adding 'unitxt/catalog/cards/global_mmlu/bn/professional_accounting.json' 2026-05-27T11:54:01,612 adding 'unitxt/catalog/cards/global_mmlu/bn/professional_law.json' 2026-05-27T11:54:01,613 adding 'unitxt/catalog/cards/global_mmlu/bn/professional_medicine.json' 2026-05-27T11:54:01,614 adding 'unitxt/catalog/cards/global_mmlu/bn/professional_psychology.json' 2026-05-27T11:54:01,615 adding 'unitxt/catalog/cards/global_mmlu/bn/public_relations.json' 2026-05-27T11:54:01,617 adding 'unitxt/catalog/cards/global_mmlu/bn/security_studies.json' 2026-05-27T11:54:01,618 adding 'unitxt/catalog/cards/global_mmlu/bn/sociology.json' 2026-05-27T11:54:01,619 adding 'unitxt/catalog/cards/global_mmlu/bn/us_foreign_policy.json' 2026-05-27T11:54:01,621 adding 'unitxt/catalog/cards/global_mmlu/bn/virology.json' 2026-05-27T11:54:01,622 adding 'unitxt/catalog/cards/global_mmlu/bn/world_religions.json' 2026-05-27T11:54:01,625 adding 'unitxt/catalog/cards/global_mmlu/cs/abstract_algebra.json' 2026-05-27T11:54:01,626 adding 'unitxt/catalog/cards/global_mmlu/cs/anatomy.json' 2026-05-27T11:54:01,628 adding 'unitxt/catalog/cards/global_mmlu/cs/astronomy.json' 2026-05-27T11:54:01,629 adding 'unitxt/catalog/cards/global_mmlu/cs/business_ethics.json' 2026-05-27T11:54:01,630 adding 'unitxt/catalog/cards/global_mmlu/cs/clinical_knowledge.json' 2026-05-27T11:54:01,632 adding 'unitxt/catalog/cards/global_mmlu/cs/college_biology.json' 2026-05-27T11:54:01,633 adding 'unitxt/catalog/cards/global_mmlu/cs/college_chemistry.json' 2026-05-27T11:54:01,634 adding 'unitxt/catalog/cards/global_mmlu/cs/college_computer_science.json' 2026-05-27T11:54:01,636 adding 'unitxt/catalog/cards/global_mmlu/cs/college_mathematics.json' 2026-05-27T11:54:01,637 adding 'unitxt/catalog/cards/global_mmlu/cs/college_medicine.json' 2026-05-27T11:54:01,638 adding 'unitxt/catalog/cards/global_mmlu/cs/college_physics.json' 2026-05-27T11:54:01,640 adding 'unitxt/catalog/cards/global_mmlu/cs/computer_security.json' 2026-05-27T11:54:01,641 adding 'unitxt/catalog/cards/global_mmlu/cs/conceptual_physics.json' 2026-05-27T11:54:01,642 adding 'unitxt/catalog/cards/global_mmlu/cs/econometrics.json' 2026-05-27T11:54:01,644 adding 'unitxt/catalog/cards/global_mmlu/cs/electrical_engineering.json' 2026-05-27T11:54:01,645 adding 'unitxt/catalog/cards/global_mmlu/cs/elementary_mathematics.json' 2026-05-27T11:54:01,646 adding 'unitxt/catalog/cards/global_mmlu/cs/formal_logic.json' 2026-05-27T11:54:01,648 adding 'unitxt/catalog/cards/global_mmlu/cs/global_facts.json' 2026-05-27T11:54:01,649 adding 'unitxt/catalog/cards/global_mmlu/cs/high_school_biology.json' 2026-05-27T11:54:01,651 adding 'unitxt/catalog/cards/global_mmlu/cs/high_school_chemistry.json' 2026-05-27T11:54:01,652 adding 'unitxt/catalog/cards/global_mmlu/cs/high_school_computer_science.json' 2026-05-27T11:54:01,653 adding 'unitxt/catalog/cards/global_mmlu/cs/high_school_european_history.json' 2026-05-27T11:54:01,655 adding 'unitxt/catalog/cards/global_mmlu/cs/high_school_geography.json' 2026-05-27T11:54:01,656 adding 'unitxt/catalog/cards/global_mmlu/cs/high_school_government_and_politics.json' 2026-05-27T11:54:01,657 adding 'unitxt/catalog/cards/global_mmlu/cs/high_school_macroeconomics.json' 2026-05-27T11:54:01,658 adding 'unitxt/catalog/cards/global_mmlu/cs/high_school_mathematics.json' 2026-05-27T11:54:01,660 adding 'unitxt/catalog/cards/global_mmlu/cs/high_school_microeconomics.json' 2026-05-27T11:54:01,661 adding 'unitxt/catalog/cards/global_mmlu/cs/high_school_physics.json' 2026-05-27T11:54:01,662 adding 'unitxt/catalog/cards/global_mmlu/cs/high_school_psychology.json' 2026-05-27T11:54:01,663 adding 'unitxt/catalog/cards/global_mmlu/cs/high_school_statistics.json' 2026-05-27T11:54:01,664 adding 'unitxt/catalog/cards/global_mmlu/cs/high_school_us_history.json' 2026-05-27T11:54:01,666 adding 'unitxt/catalog/cards/global_mmlu/cs/high_school_world_history.json' 2026-05-27T11:54:01,667 adding 'unitxt/catalog/cards/global_mmlu/cs/human_aging.json' 2026-05-27T11:54:01,669 adding 'unitxt/catalog/cards/global_mmlu/cs/human_sexuality.json' 2026-05-27T11:54:01,670 adding 'unitxt/catalog/cards/global_mmlu/cs/international_law.json' 2026-05-27T11:54:01,671 adding 'unitxt/catalog/cards/global_mmlu/cs/jurisprudence.json' 2026-05-27T11:54:01,672 adding 'unitxt/catalog/cards/global_mmlu/cs/logical_fallacies.json' 2026-05-27T11:54:01,674 adding 'unitxt/catalog/cards/global_mmlu/cs/machine_learning.json' 2026-05-27T11:54:01,675 adding 'unitxt/catalog/cards/global_mmlu/cs/management.json' 2026-05-27T11:54:01,676 adding 'unitxt/catalog/cards/global_mmlu/cs/marketing.json' 2026-05-27T11:54:01,678 adding 'unitxt/catalog/cards/global_mmlu/cs/medical_genetics.json' 2026-05-27T11:54:01,679 adding 'unitxt/catalog/cards/global_mmlu/cs/miscellaneous.json' 2026-05-27T11:54:01,680 adding 'unitxt/catalog/cards/global_mmlu/cs/moral_disputes.json' 2026-05-27T11:54:01,682 adding 'unitxt/catalog/cards/global_mmlu/cs/moral_scenarios.json' 2026-05-27T11:54:01,683 adding 'unitxt/catalog/cards/global_mmlu/cs/nutrition.json' 2026-05-27T11:54:01,684 adding 'unitxt/catalog/cards/global_mmlu/cs/philosophy.json' 2026-05-27T11:54:01,685 adding 'unitxt/catalog/cards/global_mmlu/cs/prehistory.json' 2026-05-27T11:54:01,687 adding 'unitxt/catalog/cards/global_mmlu/cs/professional_accounting.json' 2026-05-27T11:54:01,688 adding 'unitxt/catalog/cards/global_mmlu/cs/professional_law.json' 2026-05-27T11:54:01,689 adding 'unitxt/catalog/cards/global_mmlu/cs/professional_medicine.json' 2026-05-27T11:54:01,691 adding 'unitxt/catalog/cards/global_mmlu/cs/professional_psychology.json' 2026-05-27T11:54:01,692 adding 'unitxt/catalog/cards/global_mmlu/cs/public_relations.json' 2026-05-27T11:54:01,693 adding 'unitxt/catalog/cards/global_mmlu/cs/security_studies.json' 2026-05-27T11:54:01,695 adding 'unitxt/catalog/cards/global_mmlu/cs/sociology.json' 2026-05-27T11:54:01,696 adding 'unitxt/catalog/cards/global_mmlu/cs/us_foreign_policy.json' 2026-05-27T11:54:01,697 adding 'unitxt/catalog/cards/global_mmlu/cs/virology.json' 2026-05-27T11:54:01,699 adding 'unitxt/catalog/cards/global_mmlu/cs/world_religions.json' 2026-05-27T11:54:01,702 adding 'unitxt/catalog/cards/global_mmlu/de/abstract_algebra.json' 2026-05-27T11:54:01,703 adding 'unitxt/catalog/cards/global_mmlu/de/anatomy.json' 2026-05-27T11:54:01,704 adding 'unitxt/catalog/cards/global_mmlu/de/astronomy.json' 2026-05-27T11:54:01,706 adding 'unitxt/catalog/cards/global_mmlu/de/business_ethics.json' 2026-05-27T11:54:01,707 adding 'unitxt/catalog/cards/global_mmlu/de/clinical_knowledge.json' 2026-05-27T11:54:01,708 adding 'unitxt/catalog/cards/global_mmlu/de/college_biology.json' 2026-05-27T11:54:01,710 adding 'unitxt/catalog/cards/global_mmlu/de/college_chemistry.json' 2026-05-27T11:54:01,711 adding 'unitxt/catalog/cards/global_mmlu/de/college_computer_science.json' 2026-05-27T11:54:01,713 adding 'unitxt/catalog/cards/global_mmlu/de/college_mathematics.json' 2026-05-27T11:54:01,714 adding 'unitxt/catalog/cards/global_mmlu/de/college_medicine.json' 2026-05-27T11:54:01,715 adding 'unitxt/catalog/cards/global_mmlu/de/college_physics.json' 2026-05-27T11:54:01,716 adding 'unitxt/catalog/cards/global_mmlu/de/computer_security.json' 2026-05-27T11:54:01,717 adding 'unitxt/catalog/cards/global_mmlu/de/conceptual_physics.json' 2026-05-27T11:54:01,719 adding 'unitxt/catalog/cards/global_mmlu/de/econometrics.json' 2026-05-27T11:54:01,720 adding 'unitxt/catalog/cards/global_mmlu/de/electrical_engineering.json' 2026-05-27T11:54:01,721 adding 'unitxt/catalog/cards/global_mmlu/de/elementary_mathematics.json' 2026-05-27T11:54:01,723 adding 'unitxt/catalog/cards/global_mmlu/de/formal_logic.json' 2026-05-27T11:54:01,724 adding 'unitxt/catalog/cards/global_mmlu/de/global_facts.json' 2026-05-27T11:54:01,725 adding 'unitxt/catalog/cards/global_mmlu/de/high_school_biology.json' 2026-05-27T11:54:01,726 adding 'unitxt/catalog/cards/global_mmlu/de/high_school_chemistry.json' 2026-05-27T11:54:01,728 adding 'unitxt/catalog/cards/global_mmlu/de/high_school_computer_science.json' 2026-05-27T11:54:01,729 adding 'unitxt/catalog/cards/global_mmlu/de/high_school_european_history.json' 2026-05-27T11:54:01,730 adding 'unitxt/catalog/cards/global_mmlu/de/high_school_geography.json' 2026-05-27T11:54:01,731 adding 'unitxt/catalog/cards/global_mmlu/de/high_school_government_and_politics.json' 2026-05-27T11:54:01,733 adding 'unitxt/catalog/cards/global_mmlu/de/high_school_macroeconomics.json' 2026-05-27T11:54:01,734 adding 'unitxt/catalog/cards/global_mmlu/de/high_school_mathematics.json' 2026-05-27T11:54:01,735 adding 'unitxt/catalog/cards/global_mmlu/de/high_school_microeconomics.json' 2026-05-27T11:54:01,737 adding 'unitxt/catalog/cards/global_mmlu/de/high_school_physics.json' 2026-05-27T11:54:01,738 adding 'unitxt/catalog/cards/global_mmlu/de/high_school_psychology.json' 2026-05-27T11:54:01,739 adding 'unitxt/catalog/cards/global_mmlu/de/high_school_statistics.json' 2026-05-27T11:54:01,741 adding 'unitxt/catalog/cards/global_mmlu/de/high_school_us_history.json' 2026-05-27T11:54:01,742 adding 'unitxt/catalog/cards/global_mmlu/de/high_school_world_history.json' 2026-05-27T11:54:01,743 adding 'unitxt/catalog/cards/global_mmlu/de/human_aging.json' 2026-05-27T11:54:01,744 adding 'unitxt/catalog/cards/global_mmlu/de/human_sexuality.json' 2026-05-27T11:54:01,746 adding 'unitxt/catalog/cards/global_mmlu/de/international_law.json' 2026-05-27T11:54:01,747 adding 'unitxt/catalog/cards/global_mmlu/de/jurisprudence.json' 2026-05-27T11:54:01,749 adding 'unitxt/catalog/cards/global_mmlu/de/logical_fallacies.json' 2026-05-27T11:54:01,750 adding 'unitxt/catalog/cards/global_mmlu/de/machine_learning.json' 2026-05-27T11:54:01,751 adding 'unitxt/catalog/cards/global_mmlu/de/management.json' 2026-05-27T11:54:01,752 adding 'unitxt/catalog/cards/global_mmlu/de/marketing.json' 2026-05-27T11:54:01,754 adding 'unitxt/catalog/cards/global_mmlu/de/medical_genetics.json' 2026-05-27T11:54:01,755 adding 'unitxt/catalog/cards/global_mmlu/de/miscellaneous.json' 2026-05-27T11:54:01,757 adding 'unitxt/catalog/cards/global_mmlu/de/moral_disputes.json' 2026-05-27T11:54:01,758 adding 'unitxt/catalog/cards/global_mmlu/de/moral_scenarios.json' 2026-05-27T11:54:01,759 adding 'unitxt/catalog/cards/global_mmlu/de/nutrition.json' 2026-05-27T11:54:01,761 adding 'unitxt/catalog/cards/global_mmlu/de/philosophy.json' 2026-05-27T11:54:01,762 adding 'unitxt/catalog/cards/global_mmlu/de/prehistory.json' 2026-05-27T11:54:01,763 adding 'unitxt/catalog/cards/global_mmlu/de/professional_accounting.json' 2026-05-27T11:54:01,765 adding 'unitxt/catalog/cards/global_mmlu/de/professional_law.json' 2026-05-27T11:54:01,766 adding 'unitxt/catalog/cards/global_mmlu/de/professional_medicine.json' 2026-05-27T11:54:01,767 adding 'unitxt/catalog/cards/global_mmlu/de/professional_psychology.json' 2026-05-27T11:54:01,769 adding 'unitxt/catalog/cards/global_mmlu/de/public_relations.json' 2026-05-27T11:54:01,770 adding 'unitxt/catalog/cards/global_mmlu/de/security_studies.json' 2026-05-27T11:54:01,772 adding 'unitxt/catalog/cards/global_mmlu/de/sociology.json' 2026-05-27T11:54:01,773 adding 'unitxt/catalog/cards/global_mmlu/de/us_foreign_policy.json' 2026-05-27T11:54:01,774 adding 'unitxt/catalog/cards/global_mmlu/de/virology.json' 2026-05-27T11:54:01,775 adding 'unitxt/catalog/cards/global_mmlu/de/world_religions.json' 2026-05-27T11:54:01,778 adding 'unitxt/catalog/cards/global_mmlu/el/abstract_algebra.json' 2026-05-27T11:54:01,779 adding 'unitxt/catalog/cards/global_mmlu/el/anatomy.json' 2026-05-27T11:54:01,781 adding 'unitxt/catalog/cards/global_mmlu/el/astronomy.json' 2026-05-27T11:54:01,782 adding 'unitxt/catalog/cards/global_mmlu/el/business_ethics.json' 2026-05-27T11:54:01,783 adding 'unitxt/catalog/cards/global_mmlu/el/clinical_knowledge.json' 2026-05-27T11:54:01,784 adding 'unitxt/catalog/cards/global_mmlu/el/college_biology.json' 2026-05-27T11:54:01,786 adding 'unitxt/catalog/cards/global_mmlu/el/college_chemistry.json' 2026-05-27T11:54:01,787 adding 'unitxt/catalog/cards/global_mmlu/el/college_computer_science.json' 2026-05-27T11:54:01,788 adding 'unitxt/catalog/cards/global_mmlu/el/college_mathematics.json' 2026-05-27T11:54:01,790 adding 'unitxt/catalog/cards/global_mmlu/el/college_medicine.json' 2026-05-27T11:54:01,791 adding 'unitxt/catalog/cards/global_mmlu/el/college_physics.json' 2026-05-27T11:54:01,792 adding 'unitxt/catalog/cards/global_mmlu/el/computer_security.json' 2026-05-27T11:54:01,793 adding 'unitxt/catalog/cards/global_mmlu/el/conceptual_physics.json' 2026-05-27T11:54:01,795 adding 'unitxt/catalog/cards/global_mmlu/el/econometrics.json' 2026-05-27T11:54:01,796 adding 'unitxt/catalog/cards/global_mmlu/el/electrical_engineering.json' 2026-05-27T11:54:01,797 adding 'unitxt/catalog/cards/global_mmlu/el/elementary_mathematics.json' 2026-05-27T11:54:01,799 adding 'unitxt/catalog/cards/global_mmlu/el/formal_logic.json' 2026-05-27T11:54:01,800 adding 'unitxt/catalog/cards/global_mmlu/el/global_facts.json' 2026-05-27T11:54:01,801 adding 'unitxt/catalog/cards/global_mmlu/el/high_school_biology.json' 2026-05-27T11:54:01,803 adding 'unitxt/catalog/cards/global_mmlu/el/high_school_chemistry.json' 2026-05-27T11:54:01,804 adding 'unitxt/catalog/cards/global_mmlu/el/high_school_computer_science.json' 2026-05-27T11:54:01,805 adding 'unitxt/catalog/cards/global_mmlu/el/high_school_european_history.json' 2026-05-27T11:54:01,807 adding 'unitxt/catalog/cards/global_mmlu/el/high_school_geography.json' 2026-05-27T11:54:01,808 adding 'unitxt/catalog/cards/global_mmlu/el/high_school_government_and_politics.json' 2026-05-27T11:54:01,810 adding 'unitxt/catalog/cards/global_mmlu/el/high_school_macroeconomics.json' 2026-05-27T11:54:01,811 adding 'unitxt/catalog/cards/global_mmlu/el/high_school_mathematics.json' 2026-05-27T11:54:01,812 adding 'unitxt/catalog/cards/global_mmlu/el/high_school_microeconomics.json' 2026-05-27T11:54:01,814 adding 'unitxt/catalog/cards/global_mmlu/el/high_school_physics.json' 2026-05-27T11:54:01,815 adding 'unitxt/catalog/cards/global_mmlu/el/high_school_psychology.json' 2026-05-27T11:54:01,816 adding 'unitxt/catalog/cards/global_mmlu/el/high_school_statistics.json' 2026-05-27T11:54:01,818 adding 'unitxt/catalog/cards/global_mmlu/el/high_school_us_history.json' 2026-05-27T11:54:01,819 adding 'unitxt/catalog/cards/global_mmlu/el/high_school_world_history.json' 2026-05-27T11:54:01,820 adding 'unitxt/catalog/cards/global_mmlu/el/human_aging.json' 2026-05-27T11:54:01,822 adding 'unitxt/catalog/cards/global_mmlu/el/human_sexuality.json' 2026-05-27T11:54:01,823 adding 'unitxt/catalog/cards/global_mmlu/el/international_law.json' 2026-05-27T11:54:01,824 adding 'unitxt/catalog/cards/global_mmlu/el/jurisprudence.json' 2026-05-27T11:54:01,826 adding 'unitxt/catalog/cards/global_mmlu/el/logical_fallacies.json' 2026-05-27T11:54:01,827 adding 'unitxt/catalog/cards/global_mmlu/el/machine_learning.json' 2026-05-27T11:54:01,828 adding 'unitxt/catalog/cards/global_mmlu/el/management.json' 2026-05-27T11:54:01,830 adding 'unitxt/catalog/cards/global_mmlu/el/marketing.json' 2026-05-27T11:54:01,831 adding 'unitxt/catalog/cards/global_mmlu/el/medical_genetics.json' 2026-05-27T11:54:01,832 adding 'unitxt/catalog/cards/global_mmlu/el/miscellaneous.json' 2026-05-27T11:54:01,833 adding 'unitxt/catalog/cards/global_mmlu/el/moral_disputes.json' 2026-05-27T11:54:01,834 adding 'unitxt/catalog/cards/global_mmlu/el/moral_scenarios.json' 2026-05-27T11:54:01,836 adding 'unitxt/catalog/cards/global_mmlu/el/nutrition.json' 2026-05-27T11:54:01,837 adding 'unitxt/catalog/cards/global_mmlu/el/philosophy.json' 2026-05-27T11:54:01,838 adding 'unitxt/catalog/cards/global_mmlu/el/prehistory.json' 2026-05-27T11:54:01,840 adding 'unitxt/catalog/cards/global_mmlu/el/professional_accounting.json' 2026-05-27T11:54:01,841 adding 'unitxt/catalog/cards/global_mmlu/el/professional_law.json' 2026-05-27T11:54:01,842 adding 'unitxt/catalog/cards/global_mmlu/el/professional_medicine.json' 2026-05-27T11:54:01,843 adding 'unitxt/catalog/cards/global_mmlu/el/professional_psychology.json' 2026-05-27T11:54:01,845 adding 'unitxt/catalog/cards/global_mmlu/el/public_relations.json' 2026-05-27T11:54:01,846 adding 'unitxt/catalog/cards/global_mmlu/el/security_studies.json' 2026-05-27T11:54:01,847 adding 'unitxt/catalog/cards/global_mmlu/el/sociology.json' 2026-05-27T11:54:01,848 adding 'unitxt/catalog/cards/global_mmlu/el/us_foreign_policy.json' 2026-05-27T11:54:01,850 adding 'unitxt/catalog/cards/global_mmlu/el/virology.json' 2026-05-27T11:54:01,851 adding 'unitxt/catalog/cards/global_mmlu/el/world_religions.json' 2026-05-27T11:54:01,854 adding 'unitxt/catalog/cards/global_mmlu/en/abstract_algebra.json' 2026-05-27T11:54:01,855 adding 'unitxt/catalog/cards/global_mmlu/en/anatomy.json' 2026-05-27T11:54:01,856 adding 'unitxt/catalog/cards/global_mmlu/en/astronomy.json' 2026-05-27T11:54:01,858 adding 'unitxt/catalog/cards/global_mmlu/en/business_ethics.json' 2026-05-27T11:54:01,859 adding 'unitxt/catalog/cards/global_mmlu/en/clinical_knowledge.json' 2026-05-27T11:54:01,860 adding 'unitxt/catalog/cards/global_mmlu/en/college_biology.json' 2026-05-27T11:54:01,862 adding 'unitxt/catalog/cards/global_mmlu/en/college_chemistry.json' 2026-05-27T11:54:01,863 adding 'unitxt/catalog/cards/global_mmlu/en/college_computer_science.json' 2026-05-27T11:54:01,864 adding 'unitxt/catalog/cards/global_mmlu/en/college_mathematics.json' 2026-05-27T11:54:01,866 adding 'unitxt/catalog/cards/global_mmlu/en/college_medicine.json' 2026-05-27T11:54:01,867 adding 'unitxt/catalog/cards/global_mmlu/en/college_physics.json' 2026-05-27T11:54:01,868 adding 'unitxt/catalog/cards/global_mmlu/en/computer_security.json' 2026-05-27T11:54:01,870 adding 'unitxt/catalog/cards/global_mmlu/en/conceptual_physics.json' 2026-05-27T11:54:01,871 adding 'unitxt/catalog/cards/global_mmlu/en/econometrics.json' 2026-05-27T11:54:01,872 adding 'unitxt/catalog/cards/global_mmlu/en/electrical_engineering.json' 2026-05-27T11:54:01,874 adding 'unitxt/catalog/cards/global_mmlu/en/elementary_mathematics.json' 2026-05-27T11:54:01,875 adding 'unitxt/catalog/cards/global_mmlu/en/formal_logic.json' 2026-05-27T11:54:01,876 adding 'unitxt/catalog/cards/global_mmlu/en/global_facts.json' 2026-05-27T11:54:01,878 adding 'unitxt/catalog/cards/global_mmlu/en/high_school_biology.json' 2026-05-27T11:54:01,879 adding 'unitxt/catalog/cards/global_mmlu/en/high_school_chemistry.json' 2026-05-27T11:54:01,880 adding 'unitxt/catalog/cards/global_mmlu/en/high_school_computer_science.json' 2026-05-27T11:54:01,882 adding 'unitxt/catalog/cards/global_mmlu/en/high_school_european_history.json' 2026-05-27T11:54:01,883 adding 'unitxt/catalog/cards/global_mmlu/en/high_school_geography.json' 2026-05-27T11:54:01,884 adding 'unitxt/catalog/cards/global_mmlu/en/high_school_government_and_politics.json' 2026-05-27T11:54:01,886 adding 'unitxt/catalog/cards/global_mmlu/en/high_school_macroeconomics.json' 2026-05-27T11:54:01,887 adding 'unitxt/catalog/cards/global_mmlu/en/high_school_mathematics.json' 2026-05-27T11:54:01,888 adding 'unitxt/catalog/cards/global_mmlu/en/high_school_microeconomics.json' 2026-05-27T11:54:01,889 adding 'unitxt/catalog/cards/global_mmlu/en/high_school_physics.json' 2026-05-27T11:54:01,890 adding 'unitxt/catalog/cards/global_mmlu/en/high_school_psychology.json' 2026-05-27T11:54:01,892 adding 'unitxt/catalog/cards/global_mmlu/en/high_school_statistics.json' 2026-05-27T11:54:01,893 adding 'unitxt/catalog/cards/global_mmlu/en/high_school_us_history.json' 2026-05-27T11:54:01,894 adding 'unitxt/catalog/cards/global_mmlu/en/high_school_world_history.json' 2026-05-27T11:54:01,895 adding 'unitxt/catalog/cards/global_mmlu/en/human_aging.json' 2026-05-27T11:54:01,897 adding 'unitxt/catalog/cards/global_mmlu/en/human_sexuality.json' 2026-05-27T11:54:01,898 adding 'unitxt/catalog/cards/global_mmlu/en/international_law.json' 2026-05-27T11:54:01,899 adding 'unitxt/catalog/cards/global_mmlu/en/jurisprudence.json' 2026-05-27T11:54:01,901 adding 'unitxt/catalog/cards/global_mmlu/en/logical_fallacies.json' 2026-05-27T11:54:01,902 adding 'unitxt/catalog/cards/global_mmlu/en/machine_learning.json' 2026-05-27T11:54:01,903 adding 'unitxt/catalog/cards/global_mmlu/en/management.json' 2026-05-27T11:54:01,904 adding 'unitxt/catalog/cards/global_mmlu/en/marketing.json' 2026-05-27T11:54:01,906 adding 'unitxt/catalog/cards/global_mmlu/en/medical_genetics.json' 2026-05-27T11:54:01,907 adding 'unitxt/catalog/cards/global_mmlu/en/miscellaneous.json' 2026-05-27T11:54:01,908 adding 'unitxt/catalog/cards/global_mmlu/en/moral_disputes.json' 2026-05-27T11:54:01,910 adding 'unitxt/catalog/cards/global_mmlu/en/moral_scenarios.json' 2026-05-27T11:54:01,911 adding 'unitxt/catalog/cards/global_mmlu/en/nutrition.json' 2026-05-27T11:54:01,912 adding 'unitxt/catalog/cards/global_mmlu/en/philosophy.json' 2026-05-27T11:54:01,914 adding 'unitxt/catalog/cards/global_mmlu/en/prehistory.json' 2026-05-27T11:54:01,915 adding 'unitxt/catalog/cards/global_mmlu/en/professional_accounting.json' 2026-05-27T11:54:01,916 adding 'unitxt/catalog/cards/global_mmlu/en/professional_law.json' 2026-05-27T11:54:01,918 adding 'unitxt/catalog/cards/global_mmlu/en/professional_medicine.json' 2026-05-27T11:54:01,919 adding 'unitxt/catalog/cards/global_mmlu/en/professional_psychology.json' 2026-05-27T11:54:01,920 adding 'unitxt/catalog/cards/global_mmlu/en/public_relations.json' 2026-05-27T11:54:01,922 adding 'unitxt/catalog/cards/global_mmlu/en/security_studies.json' 2026-05-27T11:54:01,923 adding 'unitxt/catalog/cards/global_mmlu/en/sociology.json' 2026-05-27T11:54:01,924 adding 'unitxt/catalog/cards/global_mmlu/en/us_foreign_policy.json' 2026-05-27T11:54:01,926 adding 'unitxt/catalog/cards/global_mmlu/en/virology.json' 2026-05-27T11:54:01,927 adding 'unitxt/catalog/cards/global_mmlu/en/world_religions.json' 2026-05-27T11:54:01,930 adding 'unitxt/catalog/cards/global_mmlu/es/abstract_algebra.json' 2026-05-27T11:54:01,931 adding 'unitxt/catalog/cards/global_mmlu/es/anatomy.json' 2026-05-27T11:54:01,933 adding 'unitxt/catalog/cards/global_mmlu/es/astronomy.json' 2026-05-27T11:54:01,934 adding 'unitxt/catalog/cards/global_mmlu/es/business_ethics.json' 2026-05-27T11:54:01,935 adding 'unitxt/catalog/cards/global_mmlu/es/clinical_knowledge.json' 2026-05-27T11:54:01,937 adding 'unitxt/catalog/cards/global_mmlu/es/college_biology.json' 2026-05-27T11:54:01,938 adding 'unitxt/catalog/cards/global_mmlu/es/college_chemistry.json' 2026-05-27T11:54:01,939 adding 'unitxt/catalog/cards/global_mmlu/es/college_computer_science.json' 2026-05-27T11:54:01,941 adding 'unitxt/catalog/cards/global_mmlu/es/college_mathematics.json' 2026-05-27T11:54:01,942 adding 'unitxt/catalog/cards/global_mmlu/es/college_medicine.json' 2026-05-27T11:54:01,943 adding 'unitxt/catalog/cards/global_mmlu/es/college_physics.json' 2026-05-27T11:54:01,945 adding 'unitxt/catalog/cards/global_mmlu/es/computer_security.json' 2026-05-27T11:54:01,946 adding 'unitxt/catalog/cards/global_mmlu/es/conceptual_physics.json' 2026-05-27T11:54:01,947 adding 'unitxt/catalog/cards/global_mmlu/es/econometrics.json' 2026-05-27T11:54:01,949 adding 'unitxt/catalog/cards/global_mmlu/es/electrical_engineering.json' 2026-05-27T11:54:01,950 adding 'unitxt/catalog/cards/global_mmlu/es/elementary_mathematics.json' 2026-05-27T11:54:01,951 adding 'unitxt/catalog/cards/global_mmlu/es/formal_logic.json' 2026-05-27T11:54:01,952 adding 'unitxt/catalog/cards/global_mmlu/es/global_facts.json' 2026-05-27T11:54:01,954 adding 'unitxt/catalog/cards/global_mmlu/es/high_school_biology.json' 2026-05-27T11:54:01,955 adding 'unitxt/catalog/cards/global_mmlu/es/high_school_chemistry.json' 2026-05-27T11:54:01,956 adding 'unitxt/catalog/cards/global_mmlu/es/high_school_computer_science.json' 2026-05-27T11:54:01,957 adding 'unitxt/catalog/cards/global_mmlu/es/high_school_european_history.json' 2026-05-27T11:54:01,959 adding 'unitxt/catalog/cards/global_mmlu/es/high_school_geography.json' 2026-05-27T11:54:01,960 adding 'unitxt/catalog/cards/global_mmlu/es/high_school_government_and_politics.json' 2026-05-27T11:54:01,961 adding 'unitxt/catalog/cards/global_mmlu/es/high_school_macroeconomics.json' 2026-05-27T11:54:01,963 adding 'unitxt/catalog/cards/global_mmlu/es/high_school_mathematics.json' 2026-05-27T11:54:01,964 adding 'unitxt/catalog/cards/global_mmlu/es/high_school_microeconomics.json' 2026-05-27T11:54:01,965 adding 'unitxt/catalog/cards/global_mmlu/es/high_school_physics.json' 2026-05-27T11:54:01,967 adding 'unitxt/catalog/cards/global_mmlu/es/high_school_psychology.json' 2026-05-27T11:54:01,968 adding 'unitxt/catalog/cards/global_mmlu/es/high_school_statistics.json' 2026-05-27T11:54:01,969 adding 'unitxt/catalog/cards/global_mmlu/es/high_school_us_history.json' 2026-05-27T11:54:01,970 adding 'unitxt/catalog/cards/global_mmlu/es/high_school_world_history.json' 2026-05-27T11:54:01,972 adding 'unitxt/catalog/cards/global_mmlu/es/human_aging.json' 2026-05-27T11:54:01,973 adding 'unitxt/catalog/cards/global_mmlu/es/human_sexuality.json' 2026-05-27T11:54:01,974 adding 'unitxt/catalog/cards/global_mmlu/es/international_law.json' 2026-05-27T11:54:01,976 adding 'unitxt/catalog/cards/global_mmlu/es/jurisprudence.json' 2026-05-27T11:54:01,977 adding 'unitxt/catalog/cards/global_mmlu/es/logical_fallacies.json' 2026-05-27T11:54:01,979 adding 'unitxt/catalog/cards/global_mmlu/es/machine_learning.json' 2026-05-27T11:54:01,980 adding 'unitxt/catalog/cards/global_mmlu/es/management.json' 2026-05-27T11:54:01,981 adding 'unitxt/catalog/cards/global_mmlu/es/marketing.json' 2026-05-27T11:54:01,982 adding 'unitxt/catalog/cards/global_mmlu/es/medical_genetics.json' 2026-05-27T11:54:01,984 adding 'unitxt/catalog/cards/global_mmlu/es/miscellaneous.json' 2026-05-27T11:54:01,985 adding 'unitxt/catalog/cards/global_mmlu/es/moral_disputes.json' 2026-05-27T11:54:01,987 adding 'unitxt/catalog/cards/global_mmlu/es/moral_scenarios.json' 2026-05-27T11:54:01,988 adding 'unitxt/catalog/cards/global_mmlu/es/nutrition.json' 2026-05-27T11:54:01,989 adding 'unitxt/catalog/cards/global_mmlu/es/philosophy.json' 2026-05-27T11:54:01,990 adding 'unitxt/catalog/cards/global_mmlu/es/prehistory.json' 2026-05-27T11:54:01,992 adding 'unitxt/catalog/cards/global_mmlu/es/professional_accounting.json' 2026-05-27T11:54:01,993 adding 'unitxt/catalog/cards/global_mmlu/es/professional_law.json' 2026-05-27T11:54:01,994 adding 'unitxt/catalog/cards/global_mmlu/es/professional_medicine.json' 2026-05-27T11:54:01,996 adding 'unitxt/catalog/cards/global_mmlu/es/professional_psychology.json' 2026-05-27T11:54:01,997 adding 'unitxt/catalog/cards/global_mmlu/es/public_relations.json' 2026-05-27T11:54:01,999 adding 'unitxt/catalog/cards/global_mmlu/es/security_studies.json' 2026-05-27T11:54:02,000 adding 'unitxt/catalog/cards/global_mmlu/es/sociology.json' 2026-05-27T11:54:02,001 adding 'unitxt/catalog/cards/global_mmlu/es/us_foreign_policy.json' 2026-05-27T11:54:02,002 adding 'unitxt/catalog/cards/global_mmlu/es/virology.json' 2026-05-27T11:54:02,004 adding 'unitxt/catalog/cards/global_mmlu/es/world_religions.json' 2026-05-27T11:54:02,006 adding 'unitxt/catalog/cards/global_mmlu/fa/abstract_algebra.json' 2026-05-27T11:54:02,007 adding 'unitxt/catalog/cards/global_mmlu/fa/anatomy.json' 2026-05-27T11:54:02,009 adding 'unitxt/catalog/cards/global_mmlu/fa/astronomy.json' 2026-05-27T11:54:02,010 adding 'unitxt/catalog/cards/global_mmlu/fa/business_ethics.json' 2026-05-27T11:54:02,011 adding 'unitxt/catalog/cards/global_mmlu/fa/clinical_knowledge.json' 2026-05-27T11:54:02,012 adding 'unitxt/catalog/cards/global_mmlu/fa/college_biology.json' 2026-05-27T11:54:02,014 adding 'unitxt/catalog/cards/global_mmlu/fa/college_chemistry.json' 2026-05-27T11:54:02,015 adding 'unitxt/catalog/cards/global_mmlu/fa/college_computer_science.json' 2026-05-27T11:54:02,016 adding 'unitxt/catalog/cards/global_mmlu/fa/college_mathematics.json' 2026-05-27T11:54:02,017 adding 'unitxt/catalog/cards/global_mmlu/fa/college_medicine.json' 2026-05-27T11:54:02,019 adding 'unitxt/catalog/cards/global_mmlu/fa/college_physics.json' 2026-05-27T11:54:02,020 adding 'unitxt/catalog/cards/global_mmlu/fa/computer_security.json' 2026-05-27T11:54:02,021 adding 'unitxt/catalog/cards/global_mmlu/fa/conceptual_physics.json' 2026-05-27T11:54:02,023 adding 'unitxt/catalog/cards/global_mmlu/fa/econometrics.json' 2026-05-27T11:54:02,024 adding 'unitxt/catalog/cards/global_mmlu/fa/electrical_engineering.json' 2026-05-27T11:54:02,025 adding 'unitxt/catalog/cards/global_mmlu/fa/elementary_mathematics.json' 2026-05-27T11:54:02,027 adding 'unitxt/catalog/cards/global_mmlu/fa/formal_logic.json' 2026-05-27T11:54:02,028 adding 'unitxt/catalog/cards/global_mmlu/fa/global_facts.json' 2026-05-27T11:54:02,029 adding 'unitxt/catalog/cards/global_mmlu/fa/high_school_biology.json' 2026-05-27T11:54:02,031 adding 'unitxt/catalog/cards/global_mmlu/fa/high_school_chemistry.json' 2026-05-27T11:54:02,032 adding 'unitxt/catalog/cards/global_mmlu/fa/high_school_computer_science.json' 2026-05-27T11:54:02,033 adding 'unitxt/catalog/cards/global_mmlu/fa/high_school_european_history.json' 2026-05-27T11:54:02,035 adding 'unitxt/catalog/cards/global_mmlu/fa/high_school_geography.json' 2026-05-27T11:54:02,036 adding 'unitxt/catalog/cards/global_mmlu/fa/high_school_government_and_politics.json' 2026-05-27T11:54:02,037 adding 'unitxt/catalog/cards/global_mmlu/fa/high_school_macroeconomics.json' 2026-05-27T11:54:02,039 adding 'unitxt/catalog/cards/global_mmlu/fa/high_school_mathematics.json' 2026-05-27T11:54:02,040 adding 'unitxt/catalog/cards/global_mmlu/fa/high_school_microeconomics.json' 2026-05-27T11:54:02,041 adding 'unitxt/catalog/cards/global_mmlu/fa/high_school_physics.json' 2026-05-27T11:54:02,043 adding 'unitxt/catalog/cards/global_mmlu/fa/high_school_psychology.json' 2026-05-27T11:54:02,044 adding 'unitxt/catalog/cards/global_mmlu/fa/high_school_statistics.json' 2026-05-27T11:54:02,045 adding 'unitxt/catalog/cards/global_mmlu/fa/high_school_us_history.json' 2026-05-27T11:54:02,047 adding 'unitxt/catalog/cards/global_mmlu/fa/high_school_world_history.json' 2026-05-27T11:54:02,048 adding 'unitxt/catalog/cards/global_mmlu/fa/human_aging.json' 2026-05-27T11:54:02,049 adding 'unitxt/catalog/cards/global_mmlu/fa/human_sexuality.json' 2026-05-27T11:54:02,051 adding 'unitxt/catalog/cards/global_mmlu/fa/international_law.json' 2026-05-27T11:54:02,052 adding 'unitxt/catalog/cards/global_mmlu/fa/jurisprudence.json' 2026-05-27T11:54:02,053 adding 'unitxt/catalog/cards/global_mmlu/fa/logical_fallacies.json' 2026-05-27T11:54:02,055 adding 'unitxt/catalog/cards/global_mmlu/fa/machine_learning.json' 2026-05-27T11:54:02,056 adding 'unitxt/catalog/cards/global_mmlu/fa/management.json' 2026-05-27T11:54:02,057 adding 'unitxt/catalog/cards/global_mmlu/fa/marketing.json' 2026-05-27T11:54:02,059 adding 'unitxt/catalog/cards/global_mmlu/fa/medical_genetics.json' 2026-05-27T11:54:02,060 adding 'unitxt/catalog/cards/global_mmlu/fa/miscellaneous.json' 2026-05-27T11:54:02,061 adding 'unitxt/catalog/cards/global_mmlu/fa/moral_disputes.json' 2026-05-27T11:54:02,062 adding 'unitxt/catalog/cards/global_mmlu/fa/moral_scenarios.json' 2026-05-27T11:54:02,063 adding 'unitxt/catalog/cards/global_mmlu/fa/nutrition.json' 2026-05-27T11:54:02,065 adding 'unitxt/catalog/cards/global_mmlu/fa/philosophy.json' 2026-05-27T11:54:02,066 adding 'unitxt/catalog/cards/global_mmlu/fa/prehistory.json' 2026-05-27T11:54:02,067 adding 'unitxt/catalog/cards/global_mmlu/fa/professional_accounting.json' 2026-05-27T11:54:02,069 adding 'unitxt/catalog/cards/global_mmlu/fa/professional_law.json' 2026-05-27T11:54:02,070 adding 'unitxt/catalog/cards/global_mmlu/fa/professional_medicine.json' 2026-05-27T11:54:02,071 adding 'unitxt/catalog/cards/global_mmlu/fa/professional_psychology.json' 2026-05-27T11:54:02,072 adding 'unitxt/catalog/cards/global_mmlu/fa/public_relations.json' 2026-05-27T11:54:02,074 adding 'unitxt/catalog/cards/global_mmlu/fa/security_studies.json' 2026-05-27T11:54:02,075 adding 'unitxt/catalog/cards/global_mmlu/fa/sociology.json' 2026-05-27T11:54:02,076 adding 'unitxt/catalog/cards/global_mmlu/fa/us_foreign_policy.json' 2026-05-27T11:54:02,078 adding 'unitxt/catalog/cards/global_mmlu/fa/virology.json' 2026-05-27T11:54:02,079 adding 'unitxt/catalog/cards/global_mmlu/fa/world_religions.json' 2026-05-27T11:54:02,082 adding 'unitxt/catalog/cards/global_mmlu/fil/abstract_algebra.json' 2026-05-27T11:54:02,083 adding 'unitxt/catalog/cards/global_mmlu/fil/anatomy.json' 2026-05-27T11:54:02,084 adding 'unitxt/catalog/cards/global_mmlu/fil/astronomy.json' 2026-05-27T11:54:02,085 adding 'unitxt/catalog/cards/global_mmlu/fil/business_ethics.json' 2026-05-27T11:54:02,087 adding 'unitxt/catalog/cards/global_mmlu/fil/clinical_knowledge.json' 2026-05-27T11:54:02,088 adding 'unitxt/catalog/cards/global_mmlu/fil/college_biology.json' 2026-05-27T11:54:02,089 adding 'unitxt/catalog/cards/global_mmlu/fil/college_chemistry.json' 2026-05-27T11:54:02,091 adding 'unitxt/catalog/cards/global_mmlu/fil/college_computer_science.json' 2026-05-27T11:54:02,092 adding 'unitxt/catalog/cards/global_mmlu/fil/college_mathematics.json' 2026-05-27T11:54:02,093 adding 'unitxt/catalog/cards/global_mmlu/fil/college_medicine.json' 2026-05-27T11:54:02,095 adding 'unitxt/catalog/cards/global_mmlu/fil/college_physics.json' 2026-05-27T11:54:02,096 adding 'unitxt/catalog/cards/global_mmlu/fil/computer_security.json' 2026-05-27T11:54:02,097 adding 'unitxt/catalog/cards/global_mmlu/fil/conceptual_physics.json' 2026-05-27T11:54:02,099 adding 'unitxt/catalog/cards/global_mmlu/fil/econometrics.json' 2026-05-27T11:54:02,100 adding 'unitxt/catalog/cards/global_mmlu/fil/electrical_engineering.json' 2026-05-27T11:54:02,101 adding 'unitxt/catalog/cards/global_mmlu/fil/elementary_mathematics.json' 2026-05-27T11:54:02,103 adding 'unitxt/catalog/cards/global_mmlu/fil/formal_logic.json' 2026-05-27T11:54:02,104 adding 'unitxt/catalog/cards/global_mmlu/fil/global_facts.json' 2026-05-27T11:54:02,105 adding 'unitxt/catalog/cards/global_mmlu/fil/high_school_biology.json' 2026-05-27T11:54:02,107 adding 'unitxt/catalog/cards/global_mmlu/fil/high_school_chemistry.json' 2026-05-27T11:54:02,108 adding 'unitxt/catalog/cards/global_mmlu/fil/high_school_computer_science.json' 2026-05-27T11:54:02,109 adding 'unitxt/catalog/cards/global_mmlu/fil/high_school_european_history.json' 2026-05-27T11:54:02,111 adding 'unitxt/catalog/cards/global_mmlu/fil/high_school_geography.json' 2026-05-27T11:54:02,112 adding 'unitxt/catalog/cards/global_mmlu/fil/high_school_government_and_politics.json' 2026-05-27T11:54:02,113 adding 'unitxt/catalog/cards/global_mmlu/fil/high_school_macroeconomics.json' 2026-05-27T11:54:02,115 adding 'unitxt/catalog/cards/global_mmlu/fil/high_school_mathematics.json' 2026-05-27T11:54:02,116 adding 'unitxt/catalog/cards/global_mmlu/fil/high_school_microeconomics.json' 2026-05-27T11:54:02,117 adding 'unitxt/catalog/cards/global_mmlu/fil/high_school_physics.json' 2026-05-27T11:54:02,119 adding 'unitxt/catalog/cards/global_mmlu/fil/high_school_psychology.json' 2026-05-27T11:54:02,120 adding 'unitxt/catalog/cards/global_mmlu/fil/high_school_statistics.json' 2026-05-27T11:54:02,121 adding 'unitxt/catalog/cards/global_mmlu/fil/high_school_us_history.json' 2026-05-27T11:54:02,122 adding 'unitxt/catalog/cards/global_mmlu/fil/high_school_world_history.json' 2026-05-27T11:54:02,123 adding 'unitxt/catalog/cards/global_mmlu/fil/human_aging.json' 2026-05-27T11:54:02,125 adding 'unitxt/catalog/cards/global_mmlu/fil/human_sexuality.json' 2026-05-27T11:54:02,126 adding 'unitxt/catalog/cards/global_mmlu/fil/international_law.json' 2026-05-27T11:54:02,127 adding 'unitxt/catalog/cards/global_mmlu/fil/jurisprudence.json' 2026-05-27T11:54:02,128 adding 'unitxt/catalog/cards/global_mmlu/fil/logical_fallacies.json' 2026-05-27T11:54:02,130 adding 'unitxt/catalog/cards/global_mmlu/fil/machine_learning.json' 2026-05-27T11:54:02,131 adding 'unitxt/catalog/cards/global_mmlu/fil/management.json' 2026-05-27T11:54:02,132 adding 'unitxt/catalog/cards/global_mmlu/fil/marketing.json' 2026-05-27T11:54:02,134 adding 'unitxt/catalog/cards/global_mmlu/fil/medical_genetics.json' 2026-05-27T11:54:02,135 adding 'unitxt/catalog/cards/global_mmlu/fil/miscellaneous.json' 2026-05-27T11:54:02,136 adding 'unitxt/catalog/cards/global_mmlu/fil/moral_disputes.json' 2026-05-27T11:54:02,138 adding 'unitxt/catalog/cards/global_mmlu/fil/moral_scenarios.json' 2026-05-27T11:54:02,139 adding 'unitxt/catalog/cards/global_mmlu/fil/nutrition.json' 2026-05-27T11:54:02,140 adding 'unitxt/catalog/cards/global_mmlu/fil/philosophy.json' 2026-05-27T11:54:02,141 adding 'unitxt/catalog/cards/global_mmlu/fil/prehistory.json' 2026-05-27T11:54:02,143 adding 'unitxt/catalog/cards/global_mmlu/fil/professional_accounting.json' 2026-05-27T11:54:02,144 adding 'unitxt/catalog/cards/global_mmlu/fil/professional_law.json' 2026-05-27T11:54:02,145 adding 'unitxt/catalog/cards/global_mmlu/fil/professional_medicine.json' 2026-05-27T11:54:02,147 adding 'unitxt/catalog/cards/global_mmlu/fil/professional_psychology.json' 2026-05-27T11:54:02,148 adding 'unitxt/catalog/cards/global_mmlu/fil/public_relations.json' 2026-05-27T11:54:02,149 adding 'unitxt/catalog/cards/global_mmlu/fil/security_studies.json' 2026-05-27T11:54:02,151 adding 'unitxt/catalog/cards/global_mmlu/fil/sociology.json' 2026-05-27T11:54:02,152 adding 'unitxt/catalog/cards/global_mmlu/fil/us_foreign_policy.json' 2026-05-27T11:54:02,153 adding 'unitxt/catalog/cards/global_mmlu/fil/virology.json' 2026-05-27T11:54:02,155 adding 'unitxt/catalog/cards/global_mmlu/fil/world_religions.json' 2026-05-27T11:54:02,158 adding 'unitxt/catalog/cards/global_mmlu/fr/abstract_algebra.json' 2026-05-27T11:54:02,159 adding 'unitxt/catalog/cards/global_mmlu/fr/anatomy.json' 2026-05-27T11:54:02,160 adding 'unitxt/catalog/cards/global_mmlu/fr/astronomy.json' 2026-05-27T11:54:02,162 adding 'unitxt/catalog/cards/global_mmlu/fr/business_ethics.json' 2026-05-27T11:54:02,163 adding 'unitxt/catalog/cards/global_mmlu/fr/clinical_knowledge.json' 2026-05-27T11:54:02,164 adding 'unitxt/catalog/cards/global_mmlu/fr/college_biology.json' 2026-05-27T11:54:02,166 adding 'unitxt/catalog/cards/global_mmlu/fr/college_chemistry.json' 2026-05-27T11:54:02,167 adding 'unitxt/catalog/cards/global_mmlu/fr/college_computer_science.json' 2026-05-27T11:54:02,168 adding 'unitxt/catalog/cards/global_mmlu/fr/college_mathematics.json' 2026-05-27T11:54:02,170 adding 'unitxt/catalog/cards/global_mmlu/fr/college_medicine.json' 2026-05-27T11:54:02,171 adding 'unitxt/catalog/cards/global_mmlu/fr/college_physics.json' 2026-05-27T11:54:02,172 adding 'unitxt/catalog/cards/global_mmlu/fr/computer_security.json' 2026-05-27T11:54:02,174 adding 'unitxt/catalog/cards/global_mmlu/fr/conceptual_physics.json' 2026-05-27T11:54:02,175 adding 'unitxt/catalog/cards/global_mmlu/fr/econometrics.json' 2026-05-27T11:54:02,176 adding 'unitxt/catalog/cards/global_mmlu/fr/electrical_engineering.json' 2026-05-27T11:54:02,177 adding 'unitxt/catalog/cards/global_mmlu/fr/elementary_mathematics.json' 2026-05-27T11:54:02,179 adding 'unitxt/catalog/cards/global_mmlu/fr/formal_logic.json' 2026-05-27T11:54:02,180 adding 'unitxt/catalog/cards/global_mmlu/fr/global_facts.json' 2026-05-27T11:54:02,181 adding 'unitxt/catalog/cards/global_mmlu/fr/high_school_biology.json' 2026-05-27T11:54:02,182 adding 'unitxt/catalog/cards/global_mmlu/fr/high_school_chemistry.json' 2026-05-27T11:54:02,184 adding 'unitxt/catalog/cards/global_mmlu/fr/high_school_computer_science.json' 2026-05-27T11:54:02,185 adding 'unitxt/catalog/cards/global_mmlu/fr/high_school_european_history.json' 2026-05-27T11:54:02,186 adding 'unitxt/catalog/cards/global_mmlu/fr/high_school_geography.json' 2026-05-27T11:54:02,187 adding 'unitxt/catalog/cards/global_mmlu/fr/high_school_government_and_politics.json' 2026-05-27T11:54:02,189 adding 'unitxt/catalog/cards/global_mmlu/fr/high_school_macroeconomics.json' 2026-05-27T11:54:02,190 adding 'unitxt/catalog/cards/global_mmlu/fr/high_school_mathematics.json' 2026-05-27T11:54:02,192 adding 'unitxt/catalog/cards/global_mmlu/fr/high_school_microeconomics.json' 2026-05-27T11:54:02,193 adding 'unitxt/catalog/cards/global_mmlu/fr/high_school_physics.json' 2026-05-27T11:54:02,194 adding 'unitxt/catalog/cards/global_mmlu/fr/high_school_psychology.json' 2026-05-27T11:54:02,195 adding 'unitxt/catalog/cards/global_mmlu/fr/high_school_statistics.json' 2026-05-27T11:54:02,197 adding 'unitxt/catalog/cards/global_mmlu/fr/high_school_us_history.json' 2026-05-27T11:54:02,198 adding 'unitxt/catalog/cards/global_mmlu/fr/high_school_world_history.json' 2026-05-27T11:54:02,199 adding 'unitxt/catalog/cards/global_mmlu/fr/human_aging.json' 2026-05-27T11:54:02,201 adding 'unitxt/catalog/cards/global_mmlu/fr/human_sexuality.json' 2026-05-27T11:54:02,202 adding 'unitxt/catalog/cards/global_mmlu/fr/international_law.json' 2026-05-27T11:54:02,203 adding 'unitxt/catalog/cards/global_mmlu/fr/jurisprudence.json' 2026-05-27T11:54:02,204 adding 'unitxt/catalog/cards/global_mmlu/fr/logical_fallacies.json' 2026-05-27T11:54:02,206 adding 'unitxt/catalog/cards/global_mmlu/fr/machine_learning.json' 2026-05-27T11:54:02,207 adding 'unitxt/catalog/cards/global_mmlu/fr/management.json' 2026-05-27T11:54:02,209 adding 'unitxt/catalog/cards/global_mmlu/fr/marketing.json' 2026-05-27T11:54:02,210 adding 'unitxt/catalog/cards/global_mmlu/fr/medical_genetics.json' 2026-05-27T11:54:02,211 adding 'unitxt/catalog/cards/global_mmlu/fr/miscellaneous.json' 2026-05-27T11:54:02,212 adding 'unitxt/catalog/cards/global_mmlu/fr/moral_disputes.json' 2026-05-27T11:54:02,214 adding 'unitxt/catalog/cards/global_mmlu/fr/moral_scenarios.json' 2026-05-27T11:54:02,215 adding 'unitxt/catalog/cards/global_mmlu/fr/nutrition.json' 2026-05-27T11:54:02,216 adding 'unitxt/catalog/cards/global_mmlu/fr/philosophy.json' 2026-05-27T11:54:02,218 adding 'unitxt/catalog/cards/global_mmlu/fr/prehistory.json' 2026-05-27T11:54:02,219 adding 'unitxt/catalog/cards/global_mmlu/fr/professional_accounting.json' 2026-05-27T11:54:02,220 adding 'unitxt/catalog/cards/global_mmlu/fr/professional_law.json' 2026-05-27T11:54:02,222 adding 'unitxt/catalog/cards/global_mmlu/fr/professional_medicine.json' 2026-05-27T11:54:02,223 adding 'unitxt/catalog/cards/global_mmlu/fr/professional_psychology.json' 2026-05-27T11:54:02,224 adding 'unitxt/catalog/cards/global_mmlu/fr/public_relations.json' 2026-05-27T11:54:02,226 adding 'unitxt/catalog/cards/global_mmlu/fr/security_studies.json' 2026-05-27T11:54:02,227 adding 'unitxt/catalog/cards/global_mmlu/fr/sociology.json' 2026-05-27T11:54:02,229 adding 'unitxt/catalog/cards/global_mmlu/fr/us_foreign_policy.json' 2026-05-27T11:54:02,230 adding 'unitxt/catalog/cards/global_mmlu/fr/virology.json' 2026-05-27T11:54:02,231 adding 'unitxt/catalog/cards/global_mmlu/fr/world_religions.json' 2026-05-27T11:54:02,234 adding 'unitxt/catalog/cards/global_mmlu/ha/abstract_algebra.json' 2026-05-27T11:54:02,235 adding 'unitxt/catalog/cards/global_mmlu/ha/anatomy.json' 2026-05-27T11:54:02,236 adding 'unitxt/catalog/cards/global_mmlu/ha/astronomy.json' 2026-05-27T11:54:02,237 adding 'unitxt/catalog/cards/global_mmlu/ha/business_ethics.json' 2026-05-27T11:54:02,239 adding 'unitxt/catalog/cards/global_mmlu/ha/clinical_knowledge.json' 2026-05-27T11:54:02,240 adding 'unitxt/catalog/cards/global_mmlu/ha/college_biology.json' 2026-05-27T11:54:02,241 adding 'unitxt/catalog/cards/global_mmlu/ha/college_chemistry.json' 2026-05-27T11:54:02,242 adding 'unitxt/catalog/cards/global_mmlu/ha/college_computer_science.json' 2026-05-27T11:54:02,244 adding 'unitxt/catalog/cards/global_mmlu/ha/college_mathematics.json' 2026-05-27T11:54:02,245 adding 'unitxt/catalog/cards/global_mmlu/ha/college_medicine.json' 2026-05-27T11:54:02,246 adding 'unitxt/catalog/cards/global_mmlu/ha/college_physics.json' 2026-05-27T11:54:02,247 adding 'unitxt/catalog/cards/global_mmlu/ha/computer_security.json' 2026-05-27T11:54:02,249 adding 'unitxt/catalog/cards/global_mmlu/ha/conceptual_physics.json' 2026-05-27T11:54:02,250 adding 'unitxt/catalog/cards/global_mmlu/ha/econometrics.json' 2026-05-27T11:54:02,251 adding 'unitxt/catalog/cards/global_mmlu/ha/electrical_engineering.json' 2026-05-27T11:54:02,253 adding 'unitxt/catalog/cards/global_mmlu/ha/elementary_mathematics.json' 2026-05-27T11:54:02,254 adding 'unitxt/catalog/cards/global_mmlu/ha/formal_logic.json' 2026-05-27T11:54:02,255 adding 'unitxt/catalog/cards/global_mmlu/ha/global_facts.json' 2026-05-27T11:54:02,256 adding 'unitxt/catalog/cards/global_mmlu/ha/high_school_biology.json' 2026-05-27T11:54:02,258 adding 'unitxt/catalog/cards/global_mmlu/ha/high_school_chemistry.json' 2026-05-27T11:54:02,259 adding 'unitxt/catalog/cards/global_mmlu/ha/high_school_computer_science.json' 2026-05-27T11:54:02,260 adding 'unitxt/catalog/cards/global_mmlu/ha/high_school_european_history.json' 2026-05-27T11:54:02,262 adding 'unitxt/catalog/cards/global_mmlu/ha/high_school_geography.json' 2026-05-27T11:54:02,263 adding 'unitxt/catalog/cards/global_mmlu/ha/high_school_government_and_politics.json' 2026-05-27T11:54:02,264 adding 'unitxt/catalog/cards/global_mmlu/ha/high_school_macroeconomics.json' 2026-05-27T11:54:02,266 adding 'unitxt/catalog/cards/global_mmlu/ha/high_school_mathematics.json' 2026-05-27T11:54:02,267 adding 'unitxt/catalog/cards/global_mmlu/ha/high_school_microeconomics.json' 2026-05-27T11:54:02,269 adding 'unitxt/catalog/cards/global_mmlu/ha/high_school_physics.json' 2026-05-27T11:54:02,270 adding 'unitxt/catalog/cards/global_mmlu/ha/high_school_psychology.json' 2026-05-27T11:54:02,271 adding 'unitxt/catalog/cards/global_mmlu/ha/high_school_statistics.json' 2026-05-27T11:54:02,273 adding 'unitxt/catalog/cards/global_mmlu/ha/high_school_us_history.json' 2026-05-27T11:54:02,274 adding 'unitxt/catalog/cards/global_mmlu/ha/high_school_world_history.json' 2026-05-27T11:54:02,275 adding 'unitxt/catalog/cards/global_mmlu/ha/human_aging.json' 2026-05-27T11:54:02,277 adding 'unitxt/catalog/cards/global_mmlu/ha/human_sexuality.json' 2026-05-27T11:54:02,278 adding 'unitxt/catalog/cards/global_mmlu/ha/international_law.json' 2026-05-27T11:54:02,279 adding 'unitxt/catalog/cards/global_mmlu/ha/jurisprudence.json' 2026-05-27T11:54:02,281 adding 'unitxt/catalog/cards/global_mmlu/ha/logical_fallacies.json' 2026-05-27T11:54:02,282 adding 'unitxt/catalog/cards/global_mmlu/ha/machine_learning.json' 2026-05-27T11:54:02,283 adding 'unitxt/catalog/cards/global_mmlu/ha/management.json' 2026-05-27T11:54:02,285 adding 'unitxt/catalog/cards/global_mmlu/ha/marketing.json' 2026-05-27T11:54:02,286 adding 'unitxt/catalog/cards/global_mmlu/ha/medical_genetics.json' 2026-05-27T11:54:02,287 adding 'unitxt/catalog/cards/global_mmlu/ha/miscellaneous.json' 2026-05-27T11:54:02,289 adding 'unitxt/catalog/cards/global_mmlu/ha/moral_disputes.json' 2026-05-27T11:54:02,290 adding 'unitxt/catalog/cards/global_mmlu/ha/moral_scenarios.json' 2026-05-27T11:54:02,292 adding 'unitxt/catalog/cards/global_mmlu/ha/nutrition.json' 2026-05-27T11:54:02,293 adding 'unitxt/catalog/cards/global_mmlu/ha/philosophy.json' 2026-05-27T11:54:02,294 adding 'unitxt/catalog/cards/global_mmlu/ha/prehistory.json' 2026-05-27T11:54:02,296 adding 'unitxt/catalog/cards/global_mmlu/ha/professional_accounting.json' 2026-05-27T11:54:02,297 adding 'unitxt/catalog/cards/global_mmlu/ha/professional_law.json' 2026-05-27T11:54:02,298 adding 'unitxt/catalog/cards/global_mmlu/ha/professional_medicine.json' 2026-05-27T11:54:02,300 adding 'unitxt/catalog/cards/global_mmlu/ha/professional_psychology.json' 2026-05-27T11:54:02,301 adding 'unitxt/catalog/cards/global_mmlu/ha/public_relations.json' 2026-05-27T11:54:02,302 adding 'unitxt/catalog/cards/global_mmlu/ha/security_studies.json' 2026-05-27T11:54:02,303 adding 'unitxt/catalog/cards/global_mmlu/ha/sociology.json' 2026-05-27T11:54:02,305 adding 'unitxt/catalog/cards/global_mmlu/ha/us_foreign_policy.json' 2026-05-27T11:54:02,306 adding 'unitxt/catalog/cards/global_mmlu/ha/virology.json' 2026-05-27T11:54:02,308 adding 'unitxt/catalog/cards/global_mmlu/ha/world_religions.json' 2026-05-27T11:54:02,310 adding 'unitxt/catalog/cards/global_mmlu/he/abstract_algebra.json' 2026-05-27T11:54:02,311 adding 'unitxt/catalog/cards/global_mmlu/he/anatomy.json' 2026-05-27T11:54:02,313 adding 'unitxt/catalog/cards/global_mmlu/he/astronomy.json' 2026-05-27T11:54:02,314 adding 'unitxt/catalog/cards/global_mmlu/he/business_ethics.json' 2026-05-27T11:54:02,315 adding 'unitxt/catalog/cards/global_mmlu/he/clinical_knowledge.json' 2026-05-27T11:54:02,316 adding 'unitxt/catalog/cards/global_mmlu/he/college_biology.json' 2026-05-27T11:54:02,318 adding 'unitxt/catalog/cards/global_mmlu/he/college_chemistry.json' 2026-05-27T11:54:02,319 adding 'unitxt/catalog/cards/global_mmlu/he/college_computer_science.json' 2026-05-27T11:54:02,321 adding 'unitxt/catalog/cards/global_mmlu/he/college_mathematics.json' 2026-05-27T11:54:02,322 adding 'unitxt/catalog/cards/global_mmlu/he/college_medicine.json' 2026-05-27T11:54:02,323 adding 'unitxt/catalog/cards/global_mmlu/he/college_physics.json' 2026-05-27T11:54:02,325 adding 'unitxt/catalog/cards/global_mmlu/he/computer_security.json' 2026-05-27T11:54:02,326 adding 'unitxt/catalog/cards/global_mmlu/he/conceptual_physics.json' 2026-05-27T11:54:02,327 adding 'unitxt/catalog/cards/global_mmlu/he/econometrics.json' 2026-05-27T11:54:02,329 adding 'unitxt/catalog/cards/global_mmlu/he/electrical_engineering.json' 2026-05-27T11:54:02,330 adding 'unitxt/catalog/cards/global_mmlu/he/elementary_mathematics.json' 2026-05-27T11:54:02,331 adding 'unitxt/catalog/cards/global_mmlu/he/formal_logic.json' 2026-05-27T11:54:02,333 adding 'unitxt/catalog/cards/global_mmlu/he/global_facts.json' 2026-05-27T11:54:02,334 adding 'unitxt/catalog/cards/global_mmlu/he/high_school_biology.json' 2026-05-27T11:54:02,336 adding 'unitxt/catalog/cards/global_mmlu/he/high_school_chemistry.json' 2026-05-27T11:54:02,337 adding 'unitxt/catalog/cards/global_mmlu/he/high_school_computer_science.json' 2026-05-27T11:54:02,338 adding 'unitxt/catalog/cards/global_mmlu/he/high_school_european_history.json' 2026-05-27T11:54:02,340 adding 'unitxt/catalog/cards/global_mmlu/he/high_school_geography.json' 2026-05-27T11:54:02,341 adding 'unitxt/catalog/cards/global_mmlu/he/high_school_government_and_politics.json' 2026-05-27T11:54:02,342 adding 'unitxt/catalog/cards/global_mmlu/he/high_school_macroeconomics.json' 2026-05-27T11:54:02,344 adding 'unitxt/catalog/cards/global_mmlu/he/high_school_mathematics.json' 2026-05-27T11:54:02,345 adding 'unitxt/catalog/cards/global_mmlu/he/high_school_microeconomics.json' 2026-05-27T11:54:02,346 adding 'unitxt/catalog/cards/global_mmlu/he/high_school_physics.json' 2026-05-27T11:54:02,348 adding 'unitxt/catalog/cards/global_mmlu/he/high_school_psychology.json' 2026-05-27T11:54:02,349 adding 'unitxt/catalog/cards/global_mmlu/he/high_school_statistics.json' 2026-05-27T11:54:02,350 adding 'unitxt/catalog/cards/global_mmlu/he/high_school_us_history.json' 2026-05-27T11:54:02,352 adding 'unitxt/catalog/cards/global_mmlu/he/high_school_world_history.json' 2026-05-27T11:54:02,353 adding 'unitxt/catalog/cards/global_mmlu/he/human_aging.json' 2026-05-27T11:54:02,354 adding 'unitxt/catalog/cards/global_mmlu/he/human_sexuality.json' 2026-05-27T11:54:02,355 adding 'unitxt/catalog/cards/global_mmlu/he/international_law.json' 2026-05-27T11:54:02,357 adding 'unitxt/catalog/cards/global_mmlu/he/jurisprudence.json' 2026-05-27T11:54:02,358 adding 'unitxt/catalog/cards/global_mmlu/he/logical_fallacies.json' 2026-05-27T11:54:02,359 adding 'unitxt/catalog/cards/global_mmlu/he/machine_learning.json' 2026-05-27T11:54:02,360 adding 'unitxt/catalog/cards/global_mmlu/he/management.json' 2026-05-27T11:54:02,362 adding 'unitxt/catalog/cards/global_mmlu/he/marketing.json' 2026-05-27T11:54:02,363 adding 'unitxt/catalog/cards/global_mmlu/he/medical_genetics.json' 2026-05-27T11:54:02,364 adding 'unitxt/catalog/cards/global_mmlu/he/miscellaneous.json' 2026-05-27T11:54:02,366 adding 'unitxt/catalog/cards/global_mmlu/he/moral_disputes.json' 2026-05-27T11:54:02,367 adding 'unitxt/catalog/cards/global_mmlu/he/moral_scenarios.json' 2026-05-27T11:54:02,368 adding 'unitxt/catalog/cards/global_mmlu/he/nutrition.json' 2026-05-27T11:54:02,369 adding 'unitxt/catalog/cards/global_mmlu/he/philosophy.json' 2026-05-27T11:54:02,371 adding 'unitxt/catalog/cards/global_mmlu/he/prehistory.json' 2026-05-27T11:54:02,372 adding 'unitxt/catalog/cards/global_mmlu/he/professional_accounting.json' 2026-05-27T11:54:02,373 adding 'unitxt/catalog/cards/global_mmlu/he/professional_law.json' 2026-05-27T11:54:02,375 adding 'unitxt/catalog/cards/global_mmlu/he/professional_medicine.json' 2026-05-27T11:54:02,376 adding 'unitxt/catalog/cards/global_mmlu/he/professional_psychology.json' 2026-05-27T11:54:02,377 adding 'unitxt/catalog/cards/global_mmlu/he/public_relations.json' 2026-05-27T11:54:02,379 adding 'unitxt/catalog/cards/global_mmlu/he/security_studies.json' 2026-05-27T11:54:02,380 adding 'unitxt/catalog/cards/global_mmlu/he/sociology.json' 2026-05-27T11:54:02,381 adding 'unitxt/catalog/cards/global_mmlu/he/us_foreign_policy.json' 2026-05-27T11:54:02,383 adding 'unitxt/catalog/cards/global_mmlu/he/virology.json' 2026-05-27T11:54:02,384 adding 'unitxt/catalog/cards/global_mmlu/he/world_religions.json' 2026-05-27T11:54:02,387 adding 'unitxt/catalog/cards/global_mmlu/hi/abstract_algebra.json' 2026-05-27T11:54:02,388 adding 'unitxt/catalog/cards/global_mmlu/hi/anatomy.json' 2026-05-27T11:54:02,389 adding 'unitxt/catalog/cards/global_mmlu/hi/astronomy.json' 2026-05-27T11:54:02,391 adding 'unitxt/catalog/cards/global_mmlu/hi/business_ethics.json' 2026-05-27T11:54:02,392 adding 'unitxt/catalog/cards/global_mmlu/hi/clinical_knowledge.json' 2026-05-27T11:54:02,393 adding 'unitxt/catalog/cards/global_mmlu/hi/college_biology.json' 2026-05-27T11:54:02,395 adding 'unitxt/catalog/cards/global_mmlu/hi/college_chemistry.json' 2026-05-27T11:54:02,396 adding 'unitxt/catalog/cards/global_mmlu/hi/college_computer_science.json' 2026-05-27T11:54:02,398 adding 'unitxt/catalog/cards/global_mmlu/hi/college_mathematics.json' 2026-05-27T11:54:02,399 adding 'unitxt/catalog/cards/global_mmlu/hi/college_medicine.json' 2026-05-27T11:54:02,400 adding 'unitxt/catalog/cards/global_mmlu/hi/college_physics.json' 2026-05-27T11:54:02,402 adding 'unitxt/catalog/cards/global_mmlu/hi/computer_security.json' 2026-05-27T11:54:02,403 adding 'unitxt/catalog/cards/global_mmlu/hi/conceptual_physics.json' 2026-05-27T11:54:02,404 adding 'unitxt/catalog/cards/global_mmlu/hi/econometrics.json' 2026-05-27T11:54:02,406 adding 'unitxt/catalog/cards/global_mmlu/hi/electrical_engineering.json' 2026-05-27T11:54:02,407 adding 'unitxt/catalog/cards/global_mmlu/hi/elementary_mathematics.json' 2026-05-27T11:54:02,409 adding 'unitxt/catalog/cards/global_mmlu/hi/formal_logic.json' 2026-05-27T11:54:02,410 adding 'unitxt/catalog/cards/global_mmlu/hi/global_facts.json' 2026-05-27T11:54:02,411 adding 'unitxt/catalog/cards/global_mmlu/hi/high_school_biology.json' 2026-05-27T11:54:02,412 adding 'unitxt/catalog/cards/global_mmlu/hi/high_school_chemistry.json' 2026-05-27T11:54:02,414 adding 'unitxt/catalog/cards/global_mmlu/hi/high_school_computer_science.json' 2026-05-27T11:54:02,415 adding 'unitxt/catalog/cards/global_mmlu/hi/high_school_european_history.json' 2026-05-27T11:54:02,416 adding 'unitxt/catalog/cards/global_mmlu/hi/high_school_geography.json' 2026-05-27T11:54:02,418 adding 'unitxt/catalog/cards/global_mmlu/hi/high_school_government_and_politics.json' 2026-05-27T11:54:02,419 adding 'unitxt/catalog/cards/global_mmlu/hi/high_school_macroeconomics.json' 2026-05-27T11:54:02,420 adding 'unitxt/catalog/cards/global_mmlu/hi/high_school_mathematics.json' 2026-05-27T11:54:02,422 adding 'unitxt/catalog/cards/global_mmlu/hi/high_school_microeconomics.json' 2026-05-27T11:54:02,423 adding 'unitxt/catalog/cards/global_mmlu/hi/high_school_physics.json' 2026-05-27T11:54:02,424 adding 'unitxt/catalog/cards/global_mmlu/hi/high_school_psychology.json' 2026-05-27T11:54:02,426 adding 'unitxt/catalog/cards/global_mmlu/hi/high_school_statistics.json' 2026-05-27T11:54:02,427 adding 'unitxt/catalog/cards/global_mmlu/hi/high_school_us_history.json' 2026-05-27T11:54:02,428 adding 'unitxt/catalog/cards/global_mmlu/hi/high_school_world_history.json' 2026-05-27T11:54:02,430 adding 'unitxt/catalog/cards/global_mmlu/hi/human_aging.json' 2026-05-27T11:54:02,431 adding 'unitxt/catalog/cards/global_mmlu/hi/human_sexuality.json' 2026-05-27T11:54:02,432 adding 'unitxt/catalog/cards/global_mmlu/hi/international_law.json' 2026-05-27T11:54:02,434 adding 'unitxt/catalog/cards/global_mmlu/hi/jurisprudence.json' 2026-05-27T11:54:02,435 adding 'unitxt/catalog/cards/global_mmlu/hi/logical_fallacies.json' 2026-05-27T11:54:02,436 adding 'unitxt/catalog/cards/global_mmlu/hi/machine_learning.json' 2026-05-27T11:54:02,438 adding 'unitxt/catalog/cards/global_mmlu/hi/management.json' 2026-05-27T11:54:02,439 adding 'unitxt/catalog/cards/global_mmlu/hi/marketing.json' 2026-05-27T11:54:02,440 adding 'unitxt/catalog/cards/global_mmlu/hi/medical_genetics.json' 2026-05-27T11:54:02,442 adding 'unitxt/catalog/cards/global_mmlu/hi/miscellaneous.json' 2026-05-27T11:54:02,443 adding 'unitxt/catalog/cards/global_mmlu/hi/moral_disputes.json' 2026-05-27T11:54:02,444 adding 'unitxt/catalog/cards/global_mmlu/hi/moral_scenarios.json' 2026-05-27T11:54:02,446 adding 'unitxt/catalog/cards/global_mmlu/hi/nutrition.json' 2026-05-27T11:54:02,447 adding 'unitxt/catalog/cards/global_mmlu/hi/philosophy.json' 2026-05-27T11:54:02,448 adding 'unitxt/catalog/cards/global_mmlu/hi/prehistory.json' 2026-05-27T11:54:02,450 adding 'unitxt/catalog/cards/global_mmlu/hi/professional_accounting.json' 2026-05-27T11:54:02,451 adding 'unitxt/catalog/cards/global_mmlu/hi/professional_law.json' 2026-05-27T11:54:02,452 adding 'unitxt/catalog/cards/global_mmlu/hi/professional_medicine.json' 2026-05-27T11:54:02,454 adding 'unitxt/catalog/cards/global_mmlu/hi/professional_psychology.json' 2026-05-27T11:54:02,455 adding 'unitxt/catalog/cards/global_mmlu/hi/public_relations.json' 2026-05-27T11:54:02,457 adding 'unitxt/catalog/cards/global_mmlu/hi/security_studies.json' 2026-05-27T11:54:02,458 adding 'unitxt/catalog/cards/global_mmlu/hi/sociology.json' 2026-05-27T11:54:02,459 adding 'unitxt/catalog/cards/global_mmlu/hi/us_foreign_policy.json' 2026-05-27T11:54:02,461 adding 'unitxt/catalog/cards/global_mmlu/hi/virology.json' 2026-05-27T11:54:02,462 adding 'unitxt/catalog/cards/global_mmlu/hi/world_religions.json' 2026-05-27T11:54:02,465 adding 'unitxt/catalog/cards/global_mmlu/id/abstract_algebra.json' 2026-05-27T11:54:02,466 adding 'unitxt/catalog/cards/global_mmlu/id/anatomy.json' 2026-05-27T11:54:02,467 adding 'unitxt/catalog/cards/global_mmlu/id/astronomy.json' 2026-05-27T11:54:02,469 adding 'unitxt/catalog/cards/global_mmlu/id/business_ethics.json' 2026-05-27T11:54:02,470 adding 'unitxt/catalog/cards/global_mmlu/id/clinical_knowledge.json' 2026-05-27T11:54:02,471 adding 'unitxt/catalog/cards/global_mmlu/id/college_biology.json' 2026-05-27T11:54:02,473 adding 'unitxt/catalog/cards/global_mmlu/id/college_chemistry.json' 2026-05-27T11:54:02,474 adding 'unitxt/catalog/cards/global_mmlu/id/college_computer_science.json' 2026-05-27T11:54:02,475 adding 'unitxt/catalog/cards/global_mmlu/id/college_mathematics.json' 2026-05-27T11:54:02,476 adding 'unitxt/catalog/cards/global_mmlu/id/college_medicine.json' 2026-05-27T11:54:02,478 adding 'unitxt/catalog/cards/global_mmlu/id/college_physics.json' 2026-05-27T11:54:02,479 adding 'unitxt/catalog/cards/global_mmlu/id/computer_security.json' 2026-05-27T11:54:02,480 adding 'unitxt/catalog/cards/global_mmlu/id/conceptual_physics.json' 2026-05-27T11:54:02,482 adding 'unitxt/catalog/cards/global_mmlu/id/econometrics.json' 2026-05-27T11:54:02,483 adding 'unitxt/catalog/cards/global_mmlu/id/electrical_engineering.json' 2026-05-27T11:54:02,484 adding 'unitxt/catalog/cards/global_mmlu/id/elementary_mathematics.json' 2026-05-27T11:54:02,486 adding 'unitxt/catalog/cards/global_mmlu/id/formal_logic.json' 2026-05-27T11:54:02,487 adding 'unitxt/catalog/cards/global_mmlu/id/global_facts.json' 2026-05-27T11:54:02,488 adding 'unitxt/catalog/cards/global_mmlu/id/high_school_biology.json' 2026-05-27T11:54:02,490 adding 'unitxt/catalog/cards/global_mmlu/id/high_school_chemistry.json' 2026-05-27T11:54:02,491 adding 'unitxt/catalog/cards/global_mmlu/id/high_school_computer_science.json' 2026-05-27T11:54:02,492 adding 'unitxt/catalog/cards/global_mmlu/id/high_school_european_history.json' 2026-05-27T11:54:02,494 adding 'unitxt/catalog/cards/global_mmlu/id/high_school_geography.json' 2026-05-27T11:54:02,495 adding 'unitxt/catalog/cards/global_mmlu/id/high_school_government_and_politics.json' 2026-05-27T11:54:02,496 adding 'unitxt/catalog/cards/global_mmlu/id/high_school_macroeconomics.json' 2026-05-27T11:54:02,498 adding 'unitxt/catalog/cards/global_mmlu/id/high_school_mathematics.json' 2026-05-27T11:54:02,499 adding 'unitxt/catalog/cards/global_mmlu/id/high_school_microeconomics.json' 2026-05-27T11:54:02,500 adding 'unitxt/catalog/cards/global_mmlu/id/high_school_physics.json' 2026-05-27T11:54:02,502 adding 'unitxt/catalog/cards/global_mmlu/id/high_school_psychology.json' 2026-05-27T11:54:02,503 adding 'unitxt/catalog/cards/global_mmlu/id/high_school_statistics.json' 2026-05-27T11:54:02,504 adding 'unitxt/catalog/cards/global_mmlu/id/high_school_us_history.json' 2026-05-27T11:54:02,506 adding 'unitxt/catalog/cards/global_mmlu/id/high_school_world_history.json' 2026-05-27T11:54:02,507 adding 'unitxt/catalog/cards/global_mmlu/id/human_aging.json' 2026-05-27T11:54:02,509 adding 'unitxt/catalog/cards/global_mmlu/id/human_sexuality.json' 2026-05-27T11:54:02,510 adding 'unitxt/catalog/cards/global_mmlu/id/international_law.json' 2026-05-27T11:54:02,511 adding 'unitxt/catalog/cards/global_mmlu/id/jurisprudence.json' 2026-05-27T11:54:02,513 adding 'unitxt/catalog/cards/global_mmlu/id/logical_fallacies.json' 2026-05-27T11:54:02,514 adding 'unitxt/catalog/cards/global_mmlu/id/machine_learning.json' 2026-05-27T11:54:02,515 adding 'unitxt/catalog/cards/global_mmlu/id/management.json' 2026-05-27T11:54:02,517 adding 'unitxt/catalog/cards/global_mmlu/id/marketing.json' 2026-05-27T11:54:02,518 adding 'unitxt/catalog/cards/global_mmlu/id/medical_genetics.json' 2026-05-27T11:54:02,519 adding 'unitxt/catalog/cards/global_mmlu/id/miscellaneous.json' 2026-05-27T11:54:02,521 adding 'unitxt/catalog/cards/global_mmlu/id/moral_disputes.json' 2026-05-27T11:54:02,522 adding 'unitxt/catalog/cards/global_mmlu/id/moral_scenarios.json' 2026-05-27T11:54:02,523 adding 'unitxt/catalog/cards/global_mmlu/id/nutrition.json' 2026-05-27T11:54:02,525 adding 'unitxt/catalog/cards/global_mmlu/id/philosophy.json' 2026-05-27T11:54:02,526 adding 'unitxt/catalog/cards/global_mmlu/id/prehistory.json' 2026-05-27T11:54:02,528 adding 'unitxt/catalog/cards/global_mmlu/id/professional_accounting.json' 2026-05-27T11:54:02,529 adding 'unitxt/catalog/cards/global_mmlu/id/professional_law.json' 2026-05-27T11:54:02,530 adding 'unitxt/catalog/cards/global_mmlu/id/professional_medicine.json' 2026-05-27T11:54:02,531 adding 'unitxt/catalog/cards/global_mmlu/id/professional_psychology.json' 2026-05-27T11:54:02,533 adding 'unitxt/catalog/cards/global_mmlu/id/public_relations.json' 2026-05-27T11:54:02,534 adding 'unitxt/catalog/cards/global_mmlu/id/security_studies.json' 2026-05-27T11:54:02,535 adding 'unitxt/catalog/cards/global_mmlu/id/sociology.json' 2026-05-27T11:54:02,536 adding 'unitxt/catalog/cards/global_mmlu/id/us_foreign_policy.json' 2026-05-27T11:54:02,538 adding 'unitxt/catalog/cards/global_mmlu/id/virology.json' 2026-05-27T11:54:02,539 adding 'unitxt/catalog/cards/global_mmlu/id/world_religions.json' 2026-05-27T11:54:02,542 adding 'unitxt/catalog/cards/global_mmlu/ig/abstract_algebra.json' 2026-05-27T11:54:02,543 adding 'unitxt/catalog/cards/global_mmlu/ig/anatomy.json' 2026-05-27T11:54:02,544 adding 'unitxt/catalog/cards/global_mmlu/ig/astronomy.json' 2026-05-27T11:54:02,546 adding 'unitxt/catalog/cards/global_mmlu/ig/business_ethics.json' 2026-05-27T11:54:02,547 adding 'unitxt/catalog/cards/global_mmlu/ig/clinical_knowledge.json' 2026-05-27T11:54:02,548 adding 'unitxt/catalog/cards/global_mmlu/ig/college_biology.json' 2026-05-27T11:54:02,549 adding 'unitxt/catalog/cards/global_mmlu/ig/college_chemistry.json' 2026-05-27T11:54:02,551 adding 'unitxt/catalog/cards/global_mmlu/ig/college_computer_science.json' 2026-05-27T11:54:02,552 adding 'unitxt/catalog/cards/global_mmlu/ig/college_mathematics.json' 2026-05-27T11:54:02,553 adding 'unitxt/catalog/cards/global_mmlu/ig/college_medicine.json' 2026-05-27T11:54:02,555 adding 'unitxt/catalog/cards/global_mmlu/ig/college_physics.json' 2026-05-27T11:54:02,556 adding 'unitxt/catalog/cards/global_mmlu/ig/computer_security.json' 2026-05-27T11:54:02,558 adding 'unitxt/catalog/cards/global_mmlu/ig/conceptual_physics.json' 2026-05-27T11:54:02,559 adding 'unitxt/catalog/cards/global_mmlu/ig/econometrics.json' 2026-05-27T11:54:02,560 adding 'unitxt/catalog/cards/global_mmlu/ig/electrical_engineering.json' 2026-05-27T11:54:02,562 adding 'unitxt/catalog/cards/global_mmlu/ig/elementary_mathematics.json' 2026-05-27T11:54:02,563 adding 'unitxt/catalog/cards/global_mmlu/ig/formal_logic.json' 2026-05-27T11:54:02,564 adding 'unitxt/catalog/cards/global_mmlu/ig/global_facts.json' 2026-05-27T11:54:02,565 adding 'unitxt/catalog/cards/global_mmlu/ig/high_school_biology.json' 2026-05-27T11:54:02,567 adding 'unitxt/catalog/cards/global_mmlu/ig/high_school_chemistry.json' 2026-05-27T11:54:02,568 adding 'unitxt/catalog/cards/global_mmlu/ig/high_school_computer_science.json' 2026-05-27T11:54:02,570 adding 'unitxt/catalog/cards/global_mmlu/ig/high_school_european_history.json' 2026-05-27T11:54:02,571 adding 'unitxt/catalog/cards/global_mmlu/ig/high_school_geography.json' 2026-05-27T11:54:02,572 adding 'unitxt/catalog/cards/global_mmlu/ig/high_school_government_and_politics.json' 2026-05-27T11:54:02,574 adding 'unitxt/catalog/cards/global_mmlu/ig/high_school_macroeconomics.json' 2026-05-27T11:54:02,575 adding 'unitxt/catalog/cards/global_mmlu/ig/high_school_mathematics.json' 2026-05-27T11:54:02,577 adding 'unitxt/catalog/cards/global_mmlu/ig/high_school_microeconomics.json' 2026-05-27T11:54:02,578 adding 'unitxt/catalog/cards/global_mmlu/ig/high_school_physics.json' 2026-05-27T11:54:02,579 adding 'unitxt/catalog/cards/global_mmlu/ig/high_school_psychology.json' 2026-05-27T11:54:02,581 adding 'unitxt/catalog/cards/global_mmlu/ig/high_school_statistics.json' 2026-05-27T11:54:02,582 adding 'unitxt/catalog/cards/global_mmlu/ig/high_school_us_history.json' 2026-05-27T11:54:02,583 adding 'unitxt/catalog/cards/global_mmlu/ig/high_school_world_history.json' 2026-05-27T11:54:02,585 adding 'unitxt/catalog/cards/global_mmlu/ig/human_aging.json' 2026-05-27T11:54:02,586 adding 'unitxt/catalog/cards/global_mmlu/ig/human_sexuality.json' 2026-05-27T11:54:02,587 adding 'unitxt/catalog/cards/global_mmlu/ig/international_law.json' 2026-05-27T11:54:02,588 adding 'unitxt/catalog/cards/global_mmlu/ig/jurisprudence.json' 2026-05-27T11:54:02,590 adding 'unitxt/catalog/cards/global_mmlu/ig/logical_fallacies.json' 2026-05-27T11:54:02,591 adding 'unitxt/catalog/cards/global_mmlu/ig/machine_learning.json' 2026-05-27T11:54:02,592 adding 'unitxt/catalog/cards/global_mmlu/ig/management.json' 2026-05-27T11:54:02,594 adding 'unitxt/catalog/cards/global_mmlu/ig/marketing.json' 2026-05-27T11:54:02,595 adding 'unitxt/catalog/cards/global_mmlu/ig/medical_genetics.json' 2026-05-27T11:54:02,596 adding 'unitxt/catalog/cards/global_mmlu/ig/miscellaneous.json' 2026-05-27T11:54:02,598 adding 'unitxt/catalog/cards/global_mmlu/ig/moral_disputes.json' 2026-05-27T11:54:02,599 adding 'unitxt/catalog/cards/global_mmlu/ig/moral_scenarios.json' 2026-05-27T11:54:02,600 adding 'unitxt/catalog/cards/global_mmlu/ig/nutrition.json' 2026-05-27T11:54:02,602 adding 'unitxt/catalog/cards/global_mmlu/ig/philosophy.json' 2026-05-27T11:54:02,603 adding 'unitxt/catalog/cards/global_mmlu/ig/prehistory.json' 2026-05-27T11:54:02,604 adding 'unitxt/catalog/cards/global_mmlu/ig/professional_accounting.json' 2026-05-27T11:54:02,605 adding 'unitxt/catalog/cards/global_mmlu/ig/professional_law.json' 2026-05-27T11:54:02,607 adding 'unitxt/catalog/cards/global_mmlu/ig/professional_medicine.json' 2026-05-27T11:54:02,608 adding 'unitxt/catalog/cards/global_mmlu/ig/professional_psychology.json' 2026-05-27T11:54:02,609 adding 'unitxt/catalog/cards/global_mmlu/ig/public_relations.json' 2026-05-27T11:54:02,611 adding 'unitxt/catalog/cards/global_mmlu/ig/security_studies.json' 2026-05-27T11:54:02,612 adding 'unitxt/catalog/cards/global_mmlu/ig/sociology.json' 2026-05-27T11:54:02,613 adding 'unitxt/catalog/cards/global_mmlu/ig/us_foreign_policy.json' 2026-05-27T11:54:02,615 adding 'unitxt/catalog/cards/global_mmlu/ig/virology.json' 2026-05-27T11:54:02,616 adding 'unitxt/catalog/cards/global_mmlu/ig/world_religions.json' 2026-05-27T11:54:02,619 adding 'unitxt/catalog/cards/global_mmlu/it/abstract_algebra.json' 2026-05-27T11:54:02,620 adding 'unitxt/catalog/cards/global_mmlu/it/anatomy.json' 2026-05-27T11:54:02,622 adding 'unitxt/catalog/cards/global_mmlu/it/astronomy.json' 2026-05-27T11:54:02,623 adding 'unitxt/catalog/cards/global_mmlu/it/business_ethics.json' 2026-05-27T11:54:02,624 adding 'unitxt/catalog/cards/global_mmlu/it/clinical_knowledge.json' 2026-05-27T11:54:02,626 adding 'unitxt/catalog/cards/global_mmlu/it/college_biology.json' 2026-05-27T11:54:02,627 adding 'unitxt/catalog/cards/global_mmlu/it/college_chemistry.json' 2026-05-27T11:54:02,629 adding 'unitxt/catalog/cards/global_mmlu/it/college_computer_science.json' 2026-05-27T11:54:02,630 adding 'unitxt/catalog/cards/global_mmlu/it/college_mathematics.json' 2026-05-27T11:54:02,631 adding 'unitxt/catalog/cards/global_mmlu/it/college_medicine.json' 2026-05-27T11:54:02,633 adding 'unitxt/catalog/cards/global_mmlu/it/college_physics.json' 2026-05-27T11:54:02,634 adding 'unitxt/catalog/cards/global_mmlu/it/computer_security.json' 2026-05-27T11:54:02,636 adding 'unitxt/catalog/cards/global_mmlu/it/conceptual_physics.json' 2026-05-27T11:54:02,637 adding 'unitxt/catalog/cards/global_mmlu/it/econometrics.json' 2026-05-27T11:54:02,638 adding 'unitxt/catalog/cards/global_mmlu/it/electrical_engineering.json' 2026-05-27T11:54:02,640 adding 'unitxt/catalog/cards/global_mmlu/it/elementary_mathematics.json' 2026-05-27T11:54:02,641 adding 'unitxt/catalog/cards/global_mmlu/it/formal_logic.json' 2026-05-27T11:54:02,642 adding 'unitxt/catalog/cards/global_mmlu/it/global_facts.json' 2026-05-27T11:54:02,644 adding 'unitxt/catalog/cards/global_mmlu/it/high_school_biology.json' 2026-05-27T11:54:02,645 adding 'unitxt/catalog/cards/global_mmlu/it/high_school_chemistry.json' 2026-05-27T11:54:02,646 adding 'unitxt/catalog/cards/global_mmlu/it/high_school_computer_science.json' 2026-05-27T11:54:02,648 adding 'unitxt/catalog/cards/global_mmlu/it/high_school_european_history.json' 2026-05-27T11:54:02,649 adding 'unitxt/catalog/cards/global_mmlu/it/high_school_geography.json' 2026-05-27T11:54:02,650 adding 'unitxt/catalog/cards/global_mmlu/it/high_school_government_and_politics.json' 2026-05-27T11:54:02,651 adding 'unitxt/catalog/cards/global_mmlu/it/high_school_macroeconomics.json' 2026-05-27T11:54:02,653 adding 'unitxt/catalog/cards/global_mmlu/it/high_school_mathematics.json' 2026-05-27T11:54:02,654 adding 'unitxt/catalog/cards/global_mmlu/it/high_school_microeconomics.json' 2026-05-27T11:54:02,655 adding 'unitxt/catalog/cards/global_mmlu/it/high_school_physics.json' 2026-05-27T11:54:02,657 adding 'unitxt/catalog/cards/global_mmlu/it/high_school_psychology.json' 2026-05-27T11:54:02,658 adding 'unitxt/catalog/cards/global_mmlu/it/high_school_statistics.json' 2026-05-27T11:54:02,659 adding 'unitxt/catalog/cards/global_mmlu/it/high_school_us_history.json' 2026-05-27T11:54:02,661 adding 'unitxt/catalog/cards/global_mmlu/it/high_school_world_history.json' 2026-05-27T11:54:02,662 adding 'unitxt/catalog/cards/global_mmlu/it/human_aging.json' 2026-05-27T11:54:02,663 adding 'unitxt/catalog/cards/global_mmlu/it/human_sexuality.json' 2026-05-27T11:54:02,665 adding 'unitxt/catalog/cards/global_mmlu/it/international_law.json' 2026-05-27T11:54:02,666 adding 'unitxt/catalog/cards/global_mmlu/it/jurisprudence.json' 2026-05-27T11:54:02,668 adding 'unitxt/catalog/cards/global_mmlu/it/logical_fallacies.json' 2026-05-27T11:54:02,669 adding 'unitxt/catalog/cards/global_mmlu/it/machine_learning.json' 2026-05-27T11:54:02,670 adding 'unitxt/catalog/cards/global_mmlu/it/management.json' 2026-05-27T11:54:02,672 adding 'unitxt/catalog/cards/global_mmlu/it/marketing.json' 2026-05-27T11:54:02,673 adding 'unitxt/catalog/cards/global_mmlu/it/medical_genetics.json' 2026-05-27T11:54:02,674 adding 'unitxt/catalog/cards/global_mmlu/it/miscellaneous.json' 2026-05-27T11:54:02,676 adding 'unitxt/catalog/cards/global_mmlu/it/moral_disputes.json' 2026-05-27T11:54:02,677 adding 'unitxt/catalog/cards/global_mmlu/it/moral_scenarios.json' 2026-05-27T11:54:02,678 adding 'unitxt/catalog/cards/global_mmlu/it/nutrition.json' 2026-05-27T11:54:02,680 adding 'unitxt/catalog/cards/global_mmlu/it/philosophy.json' 2026-05-27T11:54:02,681 adding 'unitxt/catalog/cards/global_mmlu/it/prehistory.json' 2026-05-27T11:54:02,682 adding 'unitxt/catalog/cards/global_mmlu/it/professional_accounting.json' 2026-05-27T11:54:02,684 adding 'unitxt/catalog/cards/global_mmlu/it/professional_law.json' 2026-05-27T11:54:02,685 adding 'unitxt/catalog/cards/global_mmlu/it/professional_medicine.json' 2026-05-27T11:54:02,687 adding 'unitxt/catalog/cards/global_mmlu/it/professional_psychology.json' 2026-05-27T11:54:02,688 adding 'unitxt/catalog/cards/global_mmlu/it/public_relations.json' 2026-05-27T11:54:02,689 adding 'unitxt/catalog/cards/global_mmlu/it/security_studies.json' 2026-05-27T11:54:02,691 adding 'unitxt/catalog/cards/global_mmlu/it/sociology.json' 2026-05-27T11:54:02,692 adding 'unitxt/catalog/cards/global_mmlu/it/us_foreign_policy.json' 2026-05-27T11:54:02,694 adding 'unitxt/catalog/cards/global_mmlu/it/virology.json' 2026-05-27T11:54:02,695 adding 'unitxt/catalog/cards/global_mmlu/it/world_religions.json' 2026-05-27T11:54:02,698 adding 'unitxt/catalog/cards/global_mmlu/ja/abstract_algebra.json' 2026-05-27T11:54:02,699 adding 'unitxt/catalog/cards/global_mmlu/ja/anatomy.json' 2026-05-27T11:54:02,701 adding 'unitxt/catalog/cards/global_mmlu/ja/astronomy.json' 2026-05-27T11:54:02,702 adding 'unitxt/catalog/cards/global_mmlu/ja/business_ethics.json' 2026-05-27T11:54:02,703 adding 'unitxt/catalog/cards/global_mmlu/ja/clinical_knowledge.json' 2026-05-27T11:54:02,705 adding 'unitxt/catalog/cards/global_mmlu/ja/college_biology.json' 2026-05-27T11:54:02,706 adding 'unitxt/catalog/cards/global_mmlu/ja/college_chemistry.json' 2026-05-27T11:54:02,707 adding 'unitxt/catalog/cards/global_mmlu/ja/college_computer_science.json' 2026-05-27T11:54:02,709 adding 'unitxt/catalog/cards/global_mmlu/ja/college_mathematics.json' 2026-05-27T11:54:02,710 adding 'unitxt/catalog/cards/global_mmlu/ja/college_medicine.json' 2026-05-27T11:54:02,711 adding 'unitxt/catalog/cards/global_mmlu/ja/college_physics.json' 2026-05-27T11:54:02,713 adding 'unitxt/catalog/cards/global_mmlu/ja/computer_security.json' 2026-05-27T11:54:02,714 adding 'unitxt/catalog/cards/global_mmlu/ja/conceptual_physics.json' 2026-05-27T11:54:02,715 adding 'unitxt/catalog/cards/global_mmlu/ja/econometrics.json' 2026-05-27T11:54:02,717 adding 'unitxt/catalog/cards/global_mmlu/ja/electrical_engineering.json' 2026-05-27T11:54:02,718 adding 'unitxt/catalog/cards/global_mmlu/ja/elementary_mathematics.json' 2026-05-27T11:54:02,719 adding 'unitxt/catalog/cards/global_mmlu/ja/formal_logic.json' 2026-05-27T11:54:02,721 adding 'unitxt/catalog/cards/global_mmlu/ja/global_facts.json' 2026-05-27T11:54:02,722 adding 'unitxt/catalog/cards/global_mmlu/ja/high_school_biology.json' 2026-05-27T11:54:02,723 adding 'unitxt/catalog/cards/global_mmlu/ja/high_school_chemistry.json' 2026-05-27T11:54:02,725 adding 'unitxt/catalog/cards/global_mmlu/ja/high_school_computer_science.json' 2026-05-27T11:54:02,726 adding 'unitxt/catalog/cards/global_mmlu/ja/high_school_european_history.json' 2026-05-27T11:54:02,727 adding 'unitxt/catalog/cards/global_mmlu/ja/high_school_geography.json' 2026-05-27T11:54:02,729 adding 'unitxt/catalog/cards/global_mmlu/ja/high_school_government_and_politics.json' 2026-05-27T11:54:02,730 adding 'unitxt/catalog/cards/global_mmlu/ja/high_school_macroeconomics.json' 2026-05-27T11:54:02,731 adding 'unitxt/catalog/cards/global_mmlu/ja/high_school_mathematics.json' 2026-05-27T11:54:02,733 adding 'unitxt/catalog/cards/global_mmlu/ja/high_school_microeconomics.json' 2026-05-27T11:54:02,734 adding 'unitxt/catalog/cards/global_mmlu/ja/high_school_physics.json' 2026-05-27T11:54:02,735 adding 'unitxt/catalog/cards/global_mmlu/ja/high_school_psychology.json' 2026-05-27T11:54:02,737 adding 'unitxt/catalog/cards/global_mmlu/ja/high_school_statistics.json' 2026-05-27T11:54:02,738 adding 'unitxt/catalog/cards/global_mmlu/ja/high_school_us_history.json' 2026-05-27T11:54:02,740 adding 'unitxt/catalog/cards/global_mmlu/ja/high_school_world_history.json' 2026-05-27T11:54:02,741 adding 'unitxt/catalog/cards/global_mmlu/ja/human_aging.json' 2026-05-27T11:54:02,742 adding 'unitxt/catalog/cards/global_mmlu/ja/human_sexuality.json' 2026-05-27T11:54:02,744 adding 'unitxt/catalog/cards/global_mmlu/ja/international_law.json' 2026-05-27T11:54:02,745 adding 'unitxt/catalog/cards/global_mmlu/ja/jurisprudence.json' 2026-05-27T11:54:02,746 adding 'unitxt/catalog/cards/global_mmlu/ja/logical_fallacies.json' 2026-05-27T11:54:02,748 adding 'unitxt/catalog/cards/global_mmlu/ja/machine_learning.json' 2026-05-27T11:54:02,749 adding 'unitxt/catalog/cards/global_mmlu/ja/management.json' 2026-05-27T11:54:02,751 adding 'unitxt/catalog/cards/global_mmlu/ja/marketing.json' 2026-05-27T11:54:02,752 adding 'unitxt/catalog/cards/global_mmlu/ja/medical_genetics.json' 2026-05-27T11:54:02,753 adding 'unitxt/catalog/cards/global_mmlu/ja/miscellaneous.json' 2026-05-27T11:54:02,755 adding 'unitxt/catalog/cards/global_mmlu/ja/moral_disputes.json' 2026-05-27T11:54:02,756 adding 'unitxt/catalog/cards/global_mmlu/ja/moral_scenarios.json' 2026-05-27T11:54:02,758 adding 'unitxt/catalog/cards/global_mmlu/ja/nutrition.json' 2026-05-27T11:54:02,759 adding 'unitxt/catalog/cards/global_mmlu/ja/philosophy.json' 2026-05-27T11:54:02,760 adding 'unitxt/catalog/cards/global_mmlu/ja/prehistory.json' 2026-05-27T11:54:02,762 adding 'unitxt/catalog/cards/global_mmlu/ja/professional_accounting.json' 2026-05-27T11:54:02,763 adding 'unitxt/catalog/cards/global_mmlu/ja/professional_law.json' 2026-05-27T11:54:02,764 adding 'unitxt/catalog/cards/global_mmlu/ja/professional_medicine.json' 2026-05-27T11:54:02,766 adding 'unitxt/catalog/cards/global_mmlu/ja/professional_psychology.json' 2026-05-27T11:54:02,767 adding 'unitxt/catalog/cards/global_mmlu/ja/public_relations.json' 2026-05-27T11:54:02,768 adding 'unitxt/catalog/cards/global_mmlu/ja/security_studies.json' 2026-05-27T11:54:02,769 adding 'unitxt/catalog/cards/global_mmlu/ja/sociology.json' 2026-05-27T11:54:02,771 adding 'unitxt/catalog/cards/global_mmlu/ja/us_foreign_policy.json' 2026-05-27T11:54:02,772 adding 'unitxt/catalog/cards/global_mmlu/ja/virology.json' 2026-05-27T11:54:02,773 adding 'unitxt/catalog/cards/global_mmlu/ja/world_religions.json' 2026-05-27T11:54:02,776 adding 'unitxt/catalog/cards/global_mmlu/ko/abstract_algebra.json' 2026-05-27T11:54:02,777 adding 'unitxt/catalog/cards/global_mmlu/ko/anatomy.json' 2026-05-27T11:54:02,778 adding 'unitxt/catalog/cards/global_mmlu/ko/astronomy.json' 2026-05-27T11:54:02,780 adding 'unitxt/catalog/cards/global_mmlu/ko/business_ethics.json' 2026-05-27T11:54:02,781 adding 'unitxt/catalog/cards/global_mmlu/ko/clinical_knowledge.json' 2026-05-27T11:54:02,783 adding 'unitxt/catalog/cards/global_mmlu/ko/college_biology.json' 2026-05-27T11:54:02,784 adding 'unitxt/catalog/cards/global_mmlu/ko/college_chemistry.json' 2026-05-27T11:54:02,785 adding 'unitxt/catalog/cards/global_mmlu/ko/college_computer_science.json' 2026-05-27T11:54:02,787 adding 'unitxt/catalog/cards/global_mmlu/ko/college_mathematics.json' 2026-05-27T11:54:02,788 adding 'unitxt/catalog/cards/global_mmlu/ko/college_medicine.json' 2026-05-27T11:54:02,789 adding 'unitxt/catalog/cards/global_mmlu/ko/college_physics.json' 2026-05-27T11:54:02,791 adding 'unitxt/catalog/cards/global_mmlu/ko/computer_security.json' 2026-05-27T11:54:02,792 adding 'unitxt/catalog/cards/global_mmlu/ko/conceptual_physics.json' 2026-05-27T11:54:02,793 adding 'unitxt/catalog/cards/global_mmlu/ko/econometrics.json' 2026-05-27T11:54:02,795 adding 'unitxt/catalog/cards/global_mmlu/ko/electrical_engineering.json' 2026-05-27T11:54:02,796 adding 'unitxt/catalog/cards/global_mmlu/ko/elementary_mathematics.json' 2026-05-27T11:54:02,797 adding 'unitxt/catalog/cards/global_mmlu/ko/formal_logic.json' 2026-05-27T11:54:02,799 adding 'unitxt/catalog/cards/global_mmlu/ko/global_facts.json' 2026-05-27T11:54:02,800 adding 'unitxt/catalog/cards/global_mmlu/ko/high_school_biology.json' 2026-05-27T11:54:02,801 adding 'unitxt/catalog/cards/global_mmlu/ko/high_school_chemistry.json' 2026-05-27T11:54:02,803 adding 'unitxt/catalog/cards/global_mmlu/ko/high_school_computer_science.json' 2026-05-27T11:54:02,804 adding 'unitxt/catalog/cards/global_mmlu/ko/high_school_european_history.json' 2026-05-27T11:54:02,805 adding 'unitxt/catalog/cards/global_mmlu/ko/high_school_geography.json' 2026-05-27T11:54:02,807 adding 'unitxt/catalog/cards/global_mmlu/ko/high_school_government_and_politics.json' 2026-05-27T11:54:02,808 adding 'unitxt/catalog/cards/global_mmlu/ko/high_school_macroeconomics.json' 2026-05-27T11:54:02,810 adding 'unitxt/catalog/cards/global_mmlu/ko/high_school_mathematics.json' 2026-05-27T11:54:02,811 adding 'unitxt/catalog/cards/global_mmlu/ko/high_school_microeconomics.json' 2026-05-27T11:54:02,812 adding 'unitxt/catalog/cards/global_mmlu/ko/high_school_physics.json' 2026-05-27T11:54:02,814 adding 'unitxt/catalog/cards/global_mmlu/ko/high_school_psychology.json' 2026-05-27T11:54:02,815 adding 'unitxt/catalog/cards/global_mmlu/ko/high_school_statistics.json' 2026-05-27T11:54:02,816 adding 'unitxt/catalog/cards/global_mmlu/ko/high_school_us_history.json' 2026-05-27T11:54:02,818 adding 'unitxt/catalog/cards/global_mmlu/ko/high_school_world_history.json' 2026-05-27T11:54:02,819 adding 'unitxt/catalog/cards/global_mmlu/ko/human_aging.json' 2026-05-27T11:54:02,820 adding 'unitxt/catalog/cards/global_mmlu/ko/human_sexuality.json' 2026-05-27T11:54:02,822 adding 'unitxt/catalog/cards/global_mmlu/ko/international_law.json' 2026-05-27T11:54:02,823 adding 'unitxt/catalog/cards/global_mmlu/ko/jurisprudence.json' 2026-05-27T11:54:02,825 adding 'unitxt/catalog/cards/global_mmlu/ko/logical_fallacies.json' 2026-05-27T11:54:02,826 adding 'unitxt/catalog/cards/global_mmlu/ko/machine_learning.json' 2026-05-27T11:54:02,827 adding 'unitxt/catalog/cards/global_mmlu/ko/management.json' 2026-05-27T11:54:02,828 adding 'unitxt/catalog/cards/global_mmlu/ko/marketing.json' 2026-05-27T11:54:02,829 adding 'unitxt/catalog/cards/global_mmlu/ko/medical_genetics.json' 2026-05-27T11:54:02,831 adding 'unitxt/catalog/cards/global_mmlu/ko/miscellaneous.json' 2026-05-27T11:54:02,832 adding 'unitxt/catalog/cards/global_mmlu/ko/moral_disputes.json' 2026-05-27T11:54:02,833 adding 'unitxt/catalog/cards/global_mmlu/ko/moral_scenarios.json' 2026-05-27T11:54:02,834 adding 'unitxt/catalog/cards/global_mmlu/ko/nutrition.json' 2026-05-27T11:54:02,836 adding 'unitxt/catalog/cards/global_mmlu/ko/philosophy.json' 2026-05-27T11:54:02,837 adding 'unitxt/catalog/cards/global_mmlu/ko/prehistory.json' 2026-05-27T11:54:02,839 adding 'unitxt/catalog/cards/global_mmlu/ko/professional_accounting.json' 2026-05-27T11:54:02,840 adding 'unitxt/catalog/cards/global_mmlu/ko/professional_law.json' 2026-05-27T11:54:02,841 adding 'unitxt/catalog/cards/global_mmlu/ko/professional_medicine.json' 2026-05-27T11:54:02,843 adding 'unitxt/catalog/cards/global_mmlu/ko/professional_psychology.json' 2026-05-27T11:54:02,844 adding 'unitxt/catalog/cards/global_mmlu/ko/public_relations.json' 2026-05-27T11:54:02,845 adding 'unitxt/catalog/cards/global_mmlu/ko/security_studies.json' 2026-05-27T11:54:02,847 adding 'unitxt/catalog/cards/global_mmlu/ko/sociology.json' 2026-05-27T11:54:02,848 adding 'unitxt/catalog/cards/global_mmlu/ko/us_foreign_policy.json' 2026-05-27T11:54:02,850 adding 'unitxt/catalog/cards/global_mmlu/ko/virology.json' 2026-05-27T11:54:02,851 adding 'unitxt/catalog/cards/global_mmlu/ko/world_religions.json' 2026-05-27T11:54:02,854 adding 'unitxt/catalog/cards/global_mmlu/ky/abstract_algebra.json' 2026-05-27T11:54:02,855 adding 'unitxt/catalog/cards/global_mmlu/ky/anatomy.json' 2026-05-27T11:54:02,856 adding 'unitxt/catalog/cards/global_mmlu/ky/astronomy.json' 2026-05-27T11:54:02,858 adding 'unitxt/catalog/cards/global_mmlu/ky/business_ethics.json' 2026-05-27T11:54:02,859 adding 'unitxt/catalog/cards/global_mmlu/ky/clinical_knowledge.json' 2026-05-27T11:54:02,860 adding 'unitxt/catalog/cards/global_mmlu/ky/college_biology.json' 2026-05-27T11:54:02,862 adding 'unitxt/catalog/cards/global_mmlu/ky/college_chemistry.json' 2026-05-27T11:54:02,863 adding 'unitxt/catalog/cards/global_mmlu/ky/college_computer_science.json' 2026-05-27T11:54:02,864 adding 'unitxt/catalog/cards/global_mmlu/ky/college_mathematics.json' 2026-05-27T11:54:02,866 adding 'unitxt/catalog/cards/global_mmlu/ky/college_medicine.json' 2026-05-27T11:54:02,867 adding 'unitxt/catalog/cards/global_mmlu/ky/college_physics.json' 2026-05-27T11:54:02,869 adding 'unitxt/catalog/cards/global_mmlu/ky/computer_security.json' 2026-05-27T11:54:02,870 adding 'unitxt/catalog/cards/global_mmlu/ky/conceptual_physics.json' 2026-05-27T11:54:02,871 adding 'unitxt/catalog/cards/global_mmlu/ky/econometrics.json' 2026-05-27T11:54:02,873 adding 'unitxt/catalog/cards/global_mmlu/ky/electrical_engineering.json' 2026-05-27T11:54:02,874 adding 'unitxt/catalog/cards/global_mmlu/ky/elementary_mathematics.json' 2026-05-27T11:54:02,875 adding 'unitxt/catalog/cards/global_mmlu/ky/formal_logic.json' 2026-05-27T11:54:02,877 adding 'unitxt/catalog/cards/global_mmlu/ky/global_facts.json' 2026-05-27T11:54:02,878 adding 'unitxt/catalog/cards/global_mmlu/ky/high_school_biology.json' 2026-05-27T11:54:02,879 adding 'unitxt/catalog/cards/global_mmlu/ky/high_school_chemistry.json' 2026-05-27T11:54:02,881 adding 'unitxt/catalog/cards/global_mmlu/ky/high_school_computer_science.json' 2026-05-27T11:54:02,882 adding 'unitxt/catalog/cards/global_mmlu/ky/high_school_european_history.json' 2026-05-27T11:54:02,884 adding 'unitxt/catalog/cards/global_mmlu/ky/high_school_geography.json' 2026-05-27T11:54:02,885 adding 'unitxt/catalog/cards/global_mmlu/ky/high_school_government_and_politics.json' 2026-05-27T11:54:02,887 adding 'unitxt/catalog/cards/global_mmlu/ky/high_school_macroeconomics.json' 2026-05-27T11:54:02,888 adding 'unitxt/catalog/cards/global_mmlu/ky/high_school_mathematics.json' 2026-05-27T11:54:02,889 adding 'unitxt/catalog/cards/global_mmlu/ky/high_school_microeconomics.json' 2026-05-27T11:54:02,891 adding 'unitxt/catalog/cards/global_mmlu/ky/high_school_physics.json' 2026-05-27T11:54:02,892 adding 'unitxt/catalog/cards/global_mmlu/ky/high_school_psychology.json' 2026-05-27T11:54:02,893 adding 'unitxt/catalog/cards/global_mmlu/ky/high_school_statistics.json' 2026-05-27T11:54:02,894 adding 'unitxt/catalog/cards/global_mmlu/ky/high_school_us_history.json' 2026-05-27T11:54:02,896 adding 'unitxt/catalog/cards/global_mmlu/ky/high_school_world_history.json' 2026-05-27T11:54:02,897 adding 'unitxt/catalog/cards/global_mmlu/ky/human_aging.json' 2026-05-27T11:54:02,899 adding 'unitxt/catalog/cards/global_mmlu/ky/human_sexuality.json' 2026-05-27T11:54:02,900 adding 'unitxt/catalog/cards/global_mmlu/ky/international_law.json' 2026-05-27T11:54:02,901 adding 'unitxt/catalog/cards/global_mmlu/ky/jurisprudence.json' 2026-05-27T11:54:02,902 adding 'unitxt/catalog/cards/global_mmlu/ky/logical_fallacies.json' 2026-05-27T11:54:02,904 adding 'unitxt/catalog/cards/global_mmlu/ky/machine_learning.json' 2026-05-27T11:54:02,905 adding 'unitxt/catalog/cards/global_mmlu/ky/management.json' 2026-05-27T11:54:02,906 adding 'unitxt/catalog/cards/global_mmlu/ky/marketing.json' 2026-05-27T11:54:02,907 adding 'unitxt/catalog/cards/global_mmlu/ky/medical_genetics.json' 2026-05-27T11:54:02,909 adding 'unitxt/catalog/cards/global_mmlu/ky/miscellaneous.json' 2026-05-27T11:54:02,910 adding 'unitxt/catalog/cards/global_mmlu/ky/moral_disputes.json' 2026-05-27T11:54:02,911 adding 'unitxt/catalog/cards/global_mmlu/ky/moral_scenarios.json' 2026-05-27T11:54:02,913 adding 'unitxt/catalog/cards/global_mmlu/ky/nutrition.json' 2026-05-27T11:54:02,914 adding 'unitxt/catalog/cards/global_mmlu/ky/philosophy.json' 2026-05-27T11:54:02,915 adding 'unitxt/catalog/cards/global_mmlu/ky/prehistory.json' 2026-05-27T11:54:02,917 adding 'unitxt/catalog/cards/global_mmlu/ky/professional_accounting.json' 2026-05-27T11:54:02,918 adding 'unitxt/catalog/cards/global_mmlu/ky/professional_law.json' 2026-05-27T11:54:02,919 adding 'unitxt/catalog/cards/global_mmlu/ky/professional_medicine.json' 2026-05-27T11:54:02,921 adding 'unitxt/catalog/cards/global_mmlu/ky/professional_psychology.json' 2026-05-27T11:54:02,922 adding 'unitxt/catalog/cards/global_mmlu/ky/public_relations.json' 2026-05-27T11:54:02,923 adding 'unitxt/catalog/cards/global_mmlu/ky/security_studies.json' 2026-05-27T11:54:02,925 adding 'unitxt/catalog/cards/global_mmlu/ky/sociology.json' 2026-05-27T11:54:02,926 adding 'unitxt/catalog/cards/global_mmlu/ky/us_foreign_policy.json' 2026-05-27T11:54:02,927 adding 'unitxt/catalog/cards/global_mmlu/ky/virology.json' 2026-05-27T11:54:02,929 adding 'unitxt/catalog/cards/global_mmlu/ky/world_religions.json' 2026-05-27T11:54:02,931 adding 'unitxt/catalog/cards/global_mmlu/lt/abstract_algebra.json' 2026-05-27T11:54:02,933 adding 'unitxt/catalog/cards/global_mmlu/lt/anatomy.json' 2026-05-27T11:54:02,934 adding 'unitxt/catalog/cards/global_mmlu/lt/astronomy.json' 2026-05-27T11:54:02,935 adding 'unitxt/catalog/cards/global_mmlu/lt/business_ethics.json' 2026-05-27T11:54:02,937 adding 'unitxt/catalog/cards/global_mmlu/lt/clinical_knowledge.json' 2026-05-27T11:54:02,938 adding 'unitxt/catalog/cards/global_mmlu/lt/college_biology.json' 2026-05-27T11:54:02,939 adding 'unitxt/catalog/cards/global_mmlu/lt/college_chemistry.json' 2026-05-27T11:54:02,941 adding 'unitxt/catalog/cards/global_mmlu/lt/college_computer_science.json' 2026-05-27T11:54:02,942 adding 'unitxt/catalog/cards/global_mmlu/lt/college_mathematics.json' 2026-05-27T11:54:02,944 adding 'unitxt/catalog/cards/global_mmlu/lt/college_medicine.json' 2026-05-27T11:54:02,945 adding 'unitxt/catalog/cards/global_mmlu/lt/college_physics.json' 2026-05-27T11:54:02,946 adding 'unitxt/catalog/cards/global_mmlu/lt/computer_security.json' 2026-05-27T11:54:02,947 adding 'unitxt/catalog/cards/global_mmlu/lt/conceptual_physics.json' 2026-05-27T11:54:02,948 adding 'unitxt/catalog/cards/global_mmlu/lt/econometrics.json' 2026-05-27T11:54:02,950 adding 'unitxt/catalog/cards/global_mmlu/lt/electrical_engineering.json' 2026-05-27T11:54:02,951 adding 'unitxt/catalog/cards/global_mmlu/lt/elementary_mathematics.json' 2026-05-27T11:54:02,952 adding 'unitxt/catalog/cards/global_mmlu/lt/formal_logic.json' 2026-05-27T11:54:02,953 adding 'unitxt/catalog/cards/global_mmlu/lt/global_facts.json' 2026-05-27T11:54:02,955 adding 'unitxt/catalog/cards/global_mmlu/lt/high_school_biology.json' 2026-05-27T11:54:02,956 adding 'unitxt/catalog/cards/global_mmlu/lt/high_school_chemistry.json' 2026-05-27T11:54:02,957 adding 'unitxt/catalog/cards/global_mmlu/lt/high_school_computer_science.json' 2026-05-27T11:54:02,959 adding 'unitxt/catalog/cards/global_mmlu/lt/high_school_european_history.json' 2026-05-27T11:54:02,960 adding 'unitxt/catalog/cards/global_mmlu/lt/high_school_geography.json' 2026-05-27T11:54:02,961 adding 'unitxt/catalog/cards/global_mmlu/lt/high_school_government_and_politics.json' 2026-05-27T11:54:02,963 adding 'unitxt/catalog/cards/global_mmlu/lt/high_school_macroeconomics.json' 2026-05-27T11:54:02,964 adding 'unitxt/catalog/cards/global_mmlu/lt/high_school_mathematics.json' 2026-05-27T11:54:02,965 adding 'unitxt/catalog/cards/global_mmlu/lt/high_school_microeconomics.json' 2026-05-27T11:54:02,967 adding 'unitxt/catalog/cards/global_mmlu/lt/high_school_physics.json' 2026-05-27T11:54:02,968 adding 'unitxt/catalog/cards/global_mmlu/lt/high_school_psychology.json' 2026-05-27T11:54:02,969 adding 'unitxt/catalog/cards/global_mmlu/lt/high_school_statistics.json' 2026-05-27T11:54:02,971 adding 'unitxt/catalog/cards/global_mmlu/lt/high_school_us_history.json' 2026-05-27T11:54:02,972 adding 'unitxt/catalog/cards/global_mmlu/lt/high_school_world_history.json' 2026-05-27T11:54:02,973 adding 'unitxt/catalog/cards/global_mmlu/lt/human_aging.json' 2026-05-27T11:54:02,975 adding 'unitxt/catalog/cards/global_mmlu/lt/human_sexuality.json' 2026-05-27T11:54:02,976 adding 'unitxt/catalog/cards/global_mmlu/lt/international_law.json' 2026-05-27T11:54:02,977 adding 'unitxt/catalog/cards/global_mmlu/lt/jurisprudence.json' 2026-05-27T11:54:02,979 adding 'unitxt/catalog/cards/global_mmlu/lt/logical_fallacies.json' 2026-05-27T11:54:02,980 adding 'unitxt/catalog/cards/global_mmlu/lt/machine_learning.json' 2026-05-27T11:54:02,981 adding 'unitxt/catalog/cards/global_mmlu/lt/management.json' 2026-05-27T11:54:02,983 adding 'unitxt/catalog/cards/global_mmlu/lt/marketing.json' 2026-05-27T11:54:02,984 adding 'unitxt/catalog/cards/global_mmlu/lt/medical_genetics.json' 2026-05-27T11:54:02,985 adding 'unitxt/catalog/cards/global_mmlu/lt/miscellaneous.json' 2026-05-27T11:54:02,987 adding 'unitxt/catalog/cards/global_mmlu/lt/moral_disputes.json' 2026-05-27T11:54:02,988 adding 'unitxt/catalog/cards/global_mmlu/lt/moral_scenarios.json' 2026-05-27T11:54:02,990 adding 'unitxt/catalog/cards/global_mmlu/lt/nutrition.json' 2026-05-27T11:54:02,991 adding 'unitxt/catalog/cards/global_mmlu/lt/philosophy.json' 2026-05-27T11:54:02,992 adding 'unitxt/catalog/cards/global_mmlu/lt/prehistory.json' 2026-05-27T11:54:02,994 adding 'unitxt/catalog/cards/global_mmlu/lt/professional_accounting.json' 2026-05-27T11:54:02,995 adding 'unitxt/catalog/cards/global_mmlu/lt/professional_law.json' 2026-05-27T11:54:02,996 adding 'unitxt/catalog/cards/global_mmlu/lt/professional_medicine.json' 2026-05-27T11:54:02,998 adding 'unitxt/catalog/cards/global_mmlu/lt/professional_psychology.json' 2026-05-27T11:54:02,999 adding 'unitxt/catalog/cards/global_mmlu/lt/public_relations.json' 2026-05-27T11:54:03,000 adding 'unitxt/catalog/cards/global_mmlu/lt/security_studies.json' 2026-05-27T11:54:03,002 adding 'unitxt/catalog/cards/global_mmlu/lt/sociology.json' 2026-05-27T11:54:03,003 adding 'unitxt/catalog/cards/global_mmlu/lt/us_foreign_policy.json' 2026-05-27T11:54:03,004 adding 'unitxt/catalog/cards/global_mmlu/lt/virology.json' 2026-05-27T11:54:03,005 adding 'unitxt/catalog/cards/global_mmlu/lt/world_religions.json' 2026-05-27T11:54:03,008 adding 'unitxt/catalog/cards/global_mmlu/mg/abstract_algebra.json' 2026-05-27T11:54:03,009 adding 'unitxt/catalog/cards/global_mmlu/mg/anatomy.json' 2026-05-27T11:54:03,010 adding 'unitxt/catalog/cards/global_mmlu/mg/astronomy.json' 2026-05-27T11:54:03,012 adding 'unitxt/catalog/cards/global_mmlu/mg/business_ethics.json' 2026-05-27T11:54:03,013 adding 'unitxt/catalog/cards/global_mmlu/mg/clinical_knowledge.json' 2026-05-27T11:54:03,014 adding 'unitxt/catalog/cards/global_mmlu/mg/college_biology.json' 2026-05-27T11:54:03,015 adding 'unitxt/catalog/cards/global_mmlu/mg/college_chemistry.json' 2026-05-27T11:54:03,017 adding 'unitxt/catalog/cards/global_mmlu/mg/college_computer_science.json' 2026-05-27T11:54:03,018 adding 'unitxt/catalog/cards/global_mmlu/mg/college_mathematics.json' 2026-05-27T11:54:03,019 adding 'unitxt/catalog/cards/global_mmlu/mg/college_medicine.json' 2026-05-27T11:54:03,021 adding 'unitxt/catalog/cards/global_mmlu/mg/college_physics.json' 2026-05-27T11:54:03,022 adding 'unitxt/catalog/cards/global_mmlu/mg/computer_security.json' 2026-05-27T11:54:03,023 adding 'unitxt/catalog/cards/global_mmlu/mg/conceptual_physics.json' 2026-05-27T11:54:03,025 adding 'unitxt/catalog/cards/global_mmlu/mg/econometrics.json' 2026-05-27T11:54:03,026 adding 'unitxt/catalog/cards/global_mmlu/mg/electrical_engineering.json' 2026-05-27T11:54:03,027 adding 'unitxt/catalog/cards/global_mmlu/mg/elementary_mathematics.json' 2026-05-27T11:54:03,029 adding 'unitxt/catalog/cards/global_mmlu/mg/formal_logic.json' 2026-05-27T11:54:03,030 adding 'unitxt/catalog/cards/global_mmlu/mg/global_facts.json' 2026-05-27T11:54:03,031 adding 'unitxt/catalog/cards/global_mmlu/mg/high_school_biology.json' 2026-05-27T11:54:03,033 adding 'unitxt/catalog/cards/global_mmlu/mg/high_school_chemistry.json' 2026-05-27T11:54:03,034 adding 'unitxt/catalog/cards/global_mmlu/mg/high_school_computer_science.json' 2026-05-27T11:54:03,035 adding 'unitxt/catalog/cards/global_mmlu/mg/high_school_european_history.json' 2026-05-27T11:54:03,037 adding 'unitxt/catalog/cards/global_mmlu/mg/high_school_geography.json' 2026-05-27T11:54:03,038 adding 'unitxt/catalog/cards/global_mmlu/mg/high_school_government_and_politics.json' 2026-05-27T11:54:03,039 adding 'unitxt/catalog/cards/global_mmlu/mg/high_school_macroeconomics.json' 2026-05-27T11:54:03,041 adding 'unitxt/catalog/cards/global_mmlu/mg/high_school_mathematics.json' 2026-05-27T11:54:03,042 adding 'unitxt/catalog/cards/global_mmlu/mg/high_school_microeconomics.json' 2026-05-27T11:54:03,043 adding 'unitxt/catalog/cards/global_mmlu/mg/high_school_physics.json' 2026-05-27T11:54:03,045 adding 'unitxt/catalog/cards/global_mmlu/mg/high_school_psychology.json' 2026-05-27T11:54:03,046 adding 'unitxt/catalog/cards/global_mmlu/mg/high_school_statistics.json' 2026-05-27T11:54:03,047 adding 'unitxt/catalog/cards/global_mmlu/mg/high_school_us_history.json' 2026-05-27T11:54:03,049 adding 'unitxt/catalog/cards/global_mmlu/mg/high_school_world_history.json' 2026-05-27T11:54:03,050 adding 'unitxt/catalog/cards/global_mmlu/mg/human_aging.json' 2026-05-27T11:54:03,051 adding 'unitxt/catalog/cards/global_mmlu/mg/human_sexuality.json' 2026-05-27T11:54:03,053 adding 'unitxt/catalog/cards/global_mmlu/mg/international_law.json' 2026-05-27T11:54:03,054 adding 'unitxt/catalog/cards/global_mmlu/mg/jurisprudence.json' 2026-05-27T11:54:03,055 adding 'unitxt/catalog/cards/global_mmlu/mg/logical_fallacies.json' 2026-05-27T11:54:03,057 adding 'unitxt/catalog/cards/global_mmlu/mg/machine_learning.json' 2026-05-27T11:54:03,058 adding 'unitxt/catalog/cards/global_mmlu/mg/management.json' 2026-05-27T11:54:03,059 adding 'unitxt/catalog/cards/global_mmlu/mg/marketing.json' 2026-05-27T11:54:03,061 adding 'unitxt/catalog/cards/global_mmlu/mg/medical_genetics.json' 2026-05-27T11:54:03,062 adding 'unitxt/catalog/cards/global_mmlu/mg/miscellaneous.json' 2026-05-27T11:54:03,063 adding 'unitxt/catalog/cards/global_mmlu/mg/moral_disputes.json' 2026-05-27T11:54:03,064 adding 'unitxt/catalog/cards/global_mmlu/mg/moral_scenarios.json' 2026-05-27T11:54:03,065 adding 'unitxt/catalog/cards/global_mmlu/mg/nutrition.json' 2026-05-27T11:54:03,067 adding 'unitxt/catalog/cards/global_mmlu/mg/philosophy.json' 2026-05-27T11:54:03,068 adding 'unitxt/catalog/cards/global_mmlu/mg/prehistory.json' 2026-05-27T11:54:03,069 adding 'unitxt/catalog/cards/global_mmlu/mg/professional_accounting.json' 2026-05-27T11:54:03,071 adding 'unitxt/catalog/cards/global_mmlu/mg/professional_law.json' 2026-05-27T11:54:03,072 adding 'unitxt/catalog/cards/global_mmlu/mg/professional_medicine.json' 2026-05-27T11:54:03,073 adding 'unitxt/catalog/cards/global_mmlu/mg/professional_psychology.json' 2026-05-27T11:54:03,075 adding 'unitxt/catalog/cards/global_mmlu/mg/public_relations.json' 2026-05-27T11:54:03,076 adding 'unitxt/catalog/cards/global_mmlu/mg/security_studies.json' 2026-05-27T11:54:03,077 adding 'unitxt/catalog/cards/global_mmlu/mg/sociology.json' 2026-05-27T11:54:03,078 adding 'unitxt/catalog/cards/global_mmlu/mg/us_foreign_policy.json' 2026-05-27T11:54:03,080 adding 'unitxt/catalog/cards/global_mmlu/mg/virology.json' 2026-05-27T11:54:03,081 adding 'unitxt/catalog/cards/global_mmlu/mg/world_religions.json' 2026-05-27T11:54:03,084 adding 'unitxt/catalog/cards/global_mmlu/ms/abstract_algebra.json' 2026-05-27T11:54:03,085 adding 'unitxt/catalog/cards/global_mmlu/ms/anatomy.json' 2026-05-27T11:54:03,086 adding 'unitxt/catalog/cards/global_mmlu/ms/astronomy.json' 2026-05-27T11:54:03,088 adding 'unitxt/catalog/cards/global_mmlu/ms/business_ethics.json' 2026-05-27T11:54:03,089 adding 'unitxt/catalog/cards/global_mmlu/ms/clinical_knowledge.json' 2026-05-27T11:54:03,090 adding 'unitxt/catalog/cards/global_mmlu/ms/college_biology.json' 2026-05-27T11:54:03,092 adding 'unitxt/catalog/cards/global_mmlu/ms/college_chemistry.json' 2026-05-27T11:54:03,093 adding 'unitxt/catalog/cards/global_mmlu/ms/college_computer_science.json' 2026-05-27T11:54:03,094 adding 'unitxt/catalog/cards/global_mmlu/ms/college_mathematics.json' 2026-05-27T11:54:03,096 adding 'unitxt/catalog/cards/global_mmlu/ms/college_medicine.json' 2026-05-27T11:54:03,097 adding 'unitxt/catalog/cards/global_mmlu/ms/college_physics.json' 2026-05-27T11:54:03,098 adding 'unitxt/catalog/cards/global_mmlu/ms/computer_security.json' 2026-05-27T11:54:03,100 adding 'unitxt/catalog/cards/global_mmlu/ms/conceptual_physics.json' 2026-05-27T11:54:03,101 adding 'unitxt/catalog/cards/global_mmlu/ms/econometrics.json' 2026-05-27T11:54:03,102 adding 'unitxt/catalog/cards/global_mmlu/ms/electrical_engineering.json' 2026-05-27T11:54:03,104 adding 'unitxt/catalog/cards/global_mmlu/ms/elementary_mathematics.json' 2026-05-27T11:54:03,105 adding 'unitxt/catalog/cards/global_mmlu/ms/formal_logic.json' 2026-05-27T11:54:03,107 adding 'unitxt/catalog/cards/global_mmlu/ms/global_facts.json' 2026-05-27T11:54:03,108 adding 'unitxt/catalog/cards/global_mmlu/ms/high_school_biology.json' 2026-05-27T11:54:03,109 adding 'unitxt/catalog/cards/global_mmlu/ms/high_school_chemistry.json' 2026-05-27T11:54:03,111 adding 'unitxt/catalog/cards/global_mmlu/ms/high_school_computer_science.json' 2026-05-27T11:54:03,112 adding 'unitxt/catalog/cards/global_mmlu/ms/high_school_european_history.json' 2026-05-27T11:54:03,113 adding 'unitxt/catalog/cards/global_mmlu/ms/high_school_geography.json' 2026-05-27T11:54:03,115 adding 'unitxt/catalog/cards/global_mmlu/ms/high_school_government_and_politics.json' 2026-05-27T11:54:03,116 adding 'unitxt/catalog/cards/global_mmlu/ms/high_school_macroeconomics.json' 2026-05-27T11:54:03,118 adding 'unitxt/catalog/cards/global_mmlu/ms/high_school_mathematics.json' 2026-05-27T11:54:03,119 adding 'unitxt/catalog/cards/global_mmlu/ms/high_school_microeconomics.json' 2026-05-27T11:54:03,120 adding 'unitxt/catalog/cards/global_mmlu/ms/high_school_physics.json' 2026-05-27T11:54:03,121 adding 'unitxt/catalog/cards/global_mmlu/ms/high_school_psychology.json' 2026-05-27T11:54:03,123 adding 'unitxt/catalog/cards/global_mmlu/ms/high_school_statistics.json' 2026-05-27T11:54:03,124 adding 'unitxt/catalog/cards/global_mmlu/ms/high_school_us_history.json' 2026-05-27T11:54:03,125 adding 'unitxt/catalog/cards/global_mmlu/ms/high_school_world_history.json' 2026-05-27T11:54:03,127 adding 'unitxt/catalog/cards/global_mmlu/ms/human_aging.json' 2026-05-27T11:54:03,128 adding 'unitxt/catalog/cards/global_mmlu/ms/human_sexuality.json' 2026-05-27T11:54:03,129 adding 'unitxt/catalog/cards/global_mmlu/ms/international_law.json' 2026-05-27T11:54:03,131 adding 'unitxt/catalog/cards/global_mmlu/ms/jurisprudence.json' 2026-05-27T11:54:03,132 adding 'unitxt/catalog/cards/global_mmlu/ms/logical_fallacies.json' 2026-05-27T11:54:03,133 adding 'unitxt/catalog/cards/global_mmlu/ms/machine_learning.json' 2026-05-27T11:54:03,135 adding 'unitxt/catalog/cards/global_mmlu/ms/management.json' 2026-05-27T11:54:03,136 adding 'unitxt/catalog/cards/global_mmlu/ms/marketing.json' 2026-05-27T11:54:03,137 adding 'unitxt/catalog/cards/global_mmlu/ms/medical_genetics.json' 2026-05-27T11:54:03,138 adding 'unitxt/catalog/cards/global_mmlu/ms/miscellaneous.json' 2026-05-27T11:54:03,140 adding 'unitxt/catalog/cards/global_mmlu/ms/moral_disputes.json' 2026-05-27T11:54:03,141 adding 'unitxt/catalog/cards/global_mmlu/ms/moral_scenarios.json' 2026-05-27T11:54:03,142 adding 'unitxt/catalog/cards/global_mmlu/ms/nutrition.json' 2026-05-27T11:54:03,144 adding 'unitxt/catalog/cards/global_mmlu/ms/philosophy.json' 2026-05-27T11:54:03,145 adding 'unitxt/catalog/cards/global_mmlu/ms/prehistory.json' 2026-05-27T11:54:03,146 adding 'unitxt/catalog/cards/global_mmlu/ms/professional_accounting.json' 2026-05-27T11:54:03,148 adding 'unitxt/catalog/cards/global_mmlu/ms/professional_law.json' 2026-05-27T11:54:03,149 adding 'unitxt/catalog/cards/global_mmlu/ms/professional_medicine.json' 2026-05-27T11:54:03,150 adding 'unitxt/catalog/cards/global_mmlu/ms/professional_psychology.json' 2026-05-27T11:54:03,152 adding 'unitxt/catalog/cards/global_mmlu/ms/public_relations.json' 2026-05-27T11:54:03,153 adding 'unitxt/catalog/cards/global_mmlu/ms/security_studies.json' 2026-05-27T11:54:03,154 adding 'unitxt/catalog/cards/global_mmlu/ms/sociology.json' 2026-05-27T11:54:03,156 adding 'unitxt/catalog/cards/global_mmlu/ms/us_foreign_policy.json' 2026-05-27T11:54:03,157 adding 'unitxt/catalog/cards/global_mmlu/ms/virology.json' 2026-05-27T11:54:03,159 adding 'unitxt/catalog/cards/global_mmlu/ms/world_religions.json' 2026-05-27T11:54:03,161 adding 'unitxt/catalog/cards/global_mmlu/ne/abstract_algebra.json' 2026-05-27T11:54:03,163 adding 'unitxt/catalog/cards/global_mmlu/ne/anatomy.json' 2026-05-27T11:54:03,164 adding 'unitxt/catalog/cards/global_mmlu/ne/astronomy.json' 2026-05-27T11:54:03,166 adding 'unitxt/catalog/cards/global_mmlu/ne/business_ethics.json' 2026-05-27T11:54:03,167 adding 'unitxt/catalog/cards/global_mmlu/ne/clinical_knowledge.json' 2026-05-27T11:54:03,169 adding 'unitxt/catalog/cards/global_mmlu/ne/college_biology.json' 2026-05-27T11:54:03,170 adding 'unitxt/catalog/cards/global_mmlu/ne/college_chemistry.json' 2026-05-27T11:54:03,171 adding 'unitxt/catalog/cards/global_mmlu/ne/college_computer_science.json' 2026-05-27T11:54:03,173 adding 'unitxt/catalog/cards/global_mmlu/ne/college_mathematics.json' 2026-05-27T11:54:03,174 adding 'unitxt/catalog/cards/global_mmlu/ne/college_medicine.json' 2026-05-27T11:54:03,175 adding 'unitxt/catalog/cards/global_mmlu/ne/college_physics.json' 2026-05-27T11:54:03,177 adding 'unitxt/catalog/cards/global_mmlu/ne/computer_security.json' 2026-05-27T11:54:03,178 adding 'unitxt/catalog/cards/global_mmlu/ne/conceptual_physics.json' 2026-05-27T11:54:03,179 adding 'unitxt/catalog/cards/global_mmlu/ne/econometrics.json' 2026-05-27T11:54:03,181 adding 'unitxt/catalog/cards/global_mmlu/ne/electrical_engineering.json' 2026-05-27T11:54:03,182 adding 'unitxt/catalog/cards/global_mmlu/ne/elementary_mathematics.json' 2026-05-27T11:54:03,183 adding 'unitxt/catalog/cards/global_mmlu/ne/formal_logic.json' 2026-05-27T11:54:03,184 adding 'unitxt/catalog/cards/global_mmlu/ne/global_facts.json' 2026-05-27T11:54:03,186 adding 'unitxt/catalog/cards/global_mmlu/ne/high_school_biology.json' 2026-05-27T11:54:03,187 adding 'unitxt/catalog/cards/global_mmlu/ne/high_school_chemistry.json' 2026-05-27T11:54:03,188 adding 'unitxt/catalog/cards/global_mmlu/ne/high_school_computer_science.json' 2026-05-27T11:54:03,190 adding 'unitxt/catalog/cards/global_mmlu/ne/high_school_european_history.json' 2026-05-27T11:54:03,191 adding 'unitxt/catalog/cards/global_mmlu/ne/high_school_geography.json' 2026-05-27T11:54:03,192 adding 'unitxt/catalog/cards/global_mmlu/ne/high_school_government_and_politics.json' 2026-05-27T11:54:03,194 adding 'unitxt/catalog/cards/global_mmlu/ne/high_school_macroeconomics.json' 2026-05-27T11:54:03,195 adding 'unitxt/catalog/cards/global_mmlu/ne/high_school_mathematics.json' 2026-05-27T11:54:03,196 adding 'unitxt/catalog/cards/global_mmlu/ne/high_school_microeconomics.json' 2026-05-27T11:54:03,198 adding 'unitxt/catalog/cards/global_mmlu/ne/high_school_physics.json' 2026-05-27T11:54:03,199 adding 'unitxt/catalog/cards/global_mmlu/ne/high_school_psychology.json' 2026-05-27T11:54:03,200 adding 'unitxt/catalog/cards/global_mmlu/ne/high_school_statistics.json' 2026-05-27T11:54:03,202 adding 'unitxt/catalog/cards/global_mmlu/ne/high_school_us_history.json' 2026-05-27T11:54:03,203 adding 'unitxt/catalog/cards/global_mmlu/ne/high_school_world_history.json' 2026-05-27T11:54:03,204 adding 'unitxt/catalog/cards/global_mmlu/ne/human_aging.json' 2026-05-27T11:54:03,206 adding 'unitxt/catalog/cards/global_mmlu/ne/human_sexuality.json' 2026-05-27T11:54:03,208 adding 'unitxt/catalog/cards/global_mmlu/ne/international_law.json' 2026-05-27T11:54:03,209 adding 'unitxt/catalog/cards/global_mmlu/ne/jurisprudence.json' 2026-05-27T11:54:03,210 adding 'unitxt/catalog/cards/global_mmlu/ne/logical_fallacies.json' 2026-05-27T11:54:03,212 adding 'unitxt/catalog/cards/global_mmlu/ne/machine_learning.json' 2026-05-27T11:54:03,213 adding 'unitxt/catalog/cards/global_mmlu/ne/management.json' 2026-05-27T11:54:03,214 adding 'unitxt/catalog/cards/global_mmlu/ne/marketing.json' 2026-05-27T11:54:03,216 adding 'unitxt/catalog/cards/global_mmlu/ne/medical_genetics.json' 2026-05-27T11:54:03,217 adding 'unitxt/catalog/cards/global_mmlu/ne/miscellaneous.json' 2026-05-27T11:54:03,219 adding 'unitxt/catalog/cards/global_mmlu/ne/moral_disputes.json' 2026-05-27T11:54:03,220 adding 'unitxt/catalog/cards/global_mmlu/ne/moral_scenarios.json' 2026-05-27T11:54:03,221 adding 'unitxt/catalog/cards/global_mmlu/ne/nutrition.json' 2026-05-27T11:54:03,223 adding 'unitxt/catalog/cards/global_mmlu/ne/philosophy.json' 2026-05-27T11:54:03,224 adding 'unitxt/catalog/cards/global_mmlu/ne/prehistory.json' 2026-05-27T11:54:03,225 adding 'unitxt/catalog/cards/global_mmlu/ne/professional_accounting.json' 2026-05-27T11:54:03,227 adding 'unitxt/catalog/cards/global_mmlu/ne/professional_law.json' 2026-05-27T11:54:03,228 adding 'unitxt/catalog/cards/global_mmlu/ne/professional_medicine.json' 2026-05-27T11:54:03,230 adding 'unitxt/catalog/cards/global_mmlu/ne/professional_psychology.json' 2026-05-27T11:54:03,231 adding 'unitxt/catalog/cards/global_mmlu/ne/public_relations.json' 2026-05-27T11:54:03,232 adding 'unitxt/catalog/cards/global_mmlu/ne/security_studies.json' 2026-05-27T11:54:03,234 adding 'unitxt/catalog/cards/global_mmlu/ne/sociology.json' 2026-05-27T11:54:03,235 adding 'unitxt/catalog/cards/global_mmlu/ne/us_foreign_policy.json' 2026-05-27T11:54:03,237 adding 'unitxt/catalog/cards/global_mmlu/ne/virology.json' 2026-05-27T11:54:03,238 adding 'unitxt/catalog/cards/global_mmlu/ne/world_religions.json' 2026-05-27T11:54:03,241 adding 'unitxt/catalog/cards/global_mmlu/nl/abstract_algebra.json' 2026-05-27T11:54:03,242 adding 'unitxt/catalog/cards/global_mmlu/nl/anatomy.json' 2026-05-27T11:54:03,243 adding 'unitxt/catalog/cards/global_mmlu/nl/astronomy.json' 2026-05-27T11:54:03,244 adding 'unitxt/catalog/cards/global_mmlu/nl/business_ethics.json' 2026-05-27T11:54:03,246 adding 'unitxt/catalog/cards/global_mmlu/nl/clinical_knowledge.json' 2026-05-27T11:54:03,247 adding 'unitxt/catalog/cards/global_mmlu/nl/college_biology.json' 2026-05-27T11:54:03,248 adding 'unitxt/catalog/cards/global_mmlu/nl/college_chemistry.json' 2026-05-27T11:54:03,250 adding 'unitxt/catalog/cards/global_mmlu/nl/college_computer_science.json' 2026-05-27T11:54:03,251 adding 'unitxt/catalog/cards/global_mmlu/nl/college_mathematics.json' 2026-05-27T11:54:03,252 adding 'unitxt/catalog/cards/global_mmlu/nl/college_medicine.json' 2026-05-27T11:54:03,254 adding 'unitxt/catalog/cards/global_mmlu/nl/college_physics.json' 2026-05-27T11:54:03,255 adding 'unitxt/catalog/cards/global_mmlu/nl/computer_security.json' 2026-05-27T11:54:03,256 adding 'unitxt/catalog/cards/global_mmlu/nl/conceptual_physics.json' 2026-05-27T11:54:03,258 adding 'unitxt/catalog/cards/global_mmlu/nl/econometrics.json' 2026-05-27T11:54:03,259 adding 'unitxt/catalog/cards/global_mmlu/nl/electrical_engineering.json' 2026-05-27T11:54:03,260 adding 'unitxt/catalog/cards/global_mmlu/nl/elementary_mathematics.json' 2026-05-27T11:54:03,262 adding 'unitxt/catalog/cards/global_mmlu/nl/formal_logic.json' 2026-05-27T11:54:03,263 adding 'unitxt/catalog/cards/global_mmlu/nl/global_facts.json' 2026-05-27T11:54:03,264 adding 'unitxt/catalog/cards/global_mmlu/nl/high_school_biology.json' 2026-05-27T11:54:03,266 adding 'unitxt/catalog/cards/global_mmlu/nl/high_school_chemistry.json' 2026-05-27T11:54:03,267 adding 'unitxt/catalog/cards/global_mmlu/nl/high_school_computer_science.json' 2026-05-27T11:54:03,268 adding 'unitxt/catalog/cards/global_mmlu/nl/high_school_european_history.json' 2026-05-27T11:54:03,270 adding 'unitxt/catalog/cards/global_mmlu/nl/high_school_geography.json' 2026-05-27T11:54:03,271 adding 'unitxt/catalog/cards/global_mmlu/nl/high_school_government_and_politics.json' 2026-05-27T11:54:03,273 adding 'unitxt/catalog/cards/global_mmlu/nl/high_school_macroeconomics.json' 2026-05-27T11:54:03,274 adding 'unitxt/catalog/cards/global_mmlu/nl/high_school_mathematics.json' 2026-05-27T11:54:03,275 adding 'unitxt/catalog/cards/global_mmlu/nl/high_school_microeconomics.json' 2026-05-27T11:54:03,277 adding 'unitxt/catalog/cards/global_mmlu/nl/high_school_physics.json' 2026-05-27T11:54:03,278 adding 'unitxt/catalog/cards/global_mmlu/nl/high_school_psychology.json' 2026-05-27T11:54:03,279 adding 'unitxt/catalog/cards/global_mmlu/nl/high_school_statistics.json' 2026-05-27T11:54:03,281 adding 'unitxt/catalog/cards/global_mmlu/nl/high_school_us_history.json' 2026-05-27T11:54:03,282 adding 'unitxt/catalog/cards/global_mmlu/nl/high_school_world_history.json' 2026-05-27T11:54:03,283 adding 'unitxt/catalog/cards/global_mmlu/nl/human_aging.json' 2026-05-27T11:54:03,285 adding 'unitxt/catalog/cards/global_mmlu/nl/human_sexuality.json' 2026-05-27T11:54:03,286 adding 'unitxt/catalog/cards/global_mmlu/nl/international_law.json' 2026-05-27T11:54:03,287 adding 'unitxt/catalog/cards/global_mmlu/nl/jurisprudence.json' 2026-05-27T11:54:03,289 adding 'unitxt/catalog/cards/global_mmlu/nl/logical_fallacies.json' 2026-05-27T11:54:03,290 adding 'unitxt/catalog/cards/global_mmlu/nl/machine_learning.json' 2026-05-27T11:54:03,292 adding 'unitxt/catalog/cards/global_mmlu/nl/management.json' 2026-05-27T11:54:03,293 adding 'unitxt/catalog/cards/global_mmlu/nl/marketing.json' 2026-05-27T11:54:03,294 adding 'unitxt/catalog/cards/global_mmlu/nl/medical_genetics.json' 2026-05-27T11:54:03,296 adding 'unitxt/catalog/cards/global_mmlu/nl/miscellaneous.json' 2026-05-27T11:54:03,297 adding 'unitxt/catalog/cards/global_mmlu/nl/moral_disputes.json' 2026-05-27T11:54:03,298 adding 'unitxt/catalog/cards/global_mmlu/nl/moral_scenarios.json' 2026-05-27T11:54:03,300 adding 'unitxt/catalog/cards/global_mmlu/nl/nutrition.json' 2026-05-27T11:54:03,301 adding 'unitxt/catalog/cards/global_mmlu/nl/philosophy.json' 2026-05-27T11:54:03,302 adding 'unitxt/catalog/cards/global_mmlu/nl/prehistory.json' 2026-05-27T11:54:03,303 adding 'unitxt/catalog/cards/global_mmlu/nl/professional_accounting.json' 2026-05-27T11:54:03,305 adding 'unitxt/catalog/cards/global_mmlu/nl/professional_law.json' 2026-05-27T11:54:03,306 adding 'unitxt/catalog/cards/global_mmlu/nl/professional_medicine.json' 2026-05-27T11:54:03,307 adding 'unitxt/catalog/cards/global_mmlu/nl/professional_psychology.json' 2026-05-27T11:54:03,309 adding 'unitxt/catalog/cards/global_mmlu/nl/public_relations.json' 2026-05-27T11:54:03,310 adding 'unitxt/catalog/cards/global_mmlu/nl/security_studies.json' 2026-05-27T11:54:03,311 adding 'unitxt/catalog/cards/global_mmlu/nl/sociology.json' 2026-05-27T11:54:03,313 adding 'unitxt/catalog/cards/global_mmlu/nl/us_foreign_policy.json' 2026-05-27T11:54:03,314 adding 'unitxt/catalog/cards/global_mmlu/nl/virology.json' 2026-05-27T11:54:03,315 adding 'unitxt/catalog/cards/global_mmlu/nl/world_religions.json' 2026-05-27T11:54:03,318 adding 'unitxt/catalog/cards/global_mmlu/ny/abstract_algebra.json' 2026-05-27T11:54:03,320 adding 'unitxt/catalog/cards/global_mmlu/ny/anatomy.json' 2026-05-27T11:54:03,321 adding 'unitxt/catalog/cards/global_mmlu/ny/astronomy.json' 2026-05-27T11:54:03,322 adding 'unitxt/catalog/cards/global_mmlu/ny/business_ethics.json' 2026-05-27T11:54:03,324 adding 'unitxt/catalog/cards/global_mmlu/ny/clinical_knowledge.json' 2026-05-27T11:54:03,325 adding 'unitxt/catalog/cards/global_mmlu/ny/college_biology.json' 2026-05-27T11:54:03,326 adding 'unitxt/catalog/cards/global_mmlu/ny/college_chemistry.json' 2026-05-27T11:54:03,328 adding 'unitxt/catalog/cards/global_mmlu/ny/college_computer_science.json' 2026-05-27T11:54:03,329 adding 'unitxt/catalog/cards/global_mmlu/ny/college_mathematics.json' 2026-05-27T11:54:03,331 adding 'unitxt/catalog/cards/global_mmlu/ny/college_medicine.json' 2026-05-27T11:54:03,332 adding 'unitxt/catalog/cards/global_mmlu/ny/college_physics.json' 2026-05-27T11:54:03,333 adding 'unitxt/catalog/cards/global_mmlu/ny/computer_security.json' 2026-05-27T11:54:03,335 adding 'unitxt/catalog/cards/global_mmlu/ny/conceptual_physics.json' 2026-05-27T11:54:03,336 adding 'unitxt/catalog/cards/global_mmlu/ny/econometrics.json' 2026-05-27T11:54:03,337 adding 'unitxt/catalog/cards/global_mmlu/ny/electrical_engineering.json' 2026-05-27T11:54:03,339 adding 'unitxt/catalog/cards/global_mmlu/ny/elementary_mathematics.json' 2026-05-27T11:54:03,340 adding 'unitxt/catalog/cards/global_mmlu/ny/formal_logic.json' 2026-05-27T11:54:03,342 adding 'unitxt/catalog/cards/global_mmlu/ny/global_facts.json' 2026-05-27T11:54:03,343 adding 'unitxt/catalog/cards/global_mmlu/ny/high_school_biology.json' 2026-05-27T11:54:03,344 adding 'unitxt/catalog/cards/global_mmlu/ny/high_school_chemistry.json' 2026-05-27T11:54:03,346 adding 'unitxt/catalog/cards/global_mmlu/ny/high_school_computer_science.json' 2026-05-27T11:54:03,347 adding 'unitxt/catalog/cards/global_mmlu/ny/high_school_european_history.json' 2026-05-27T11:54:03,349 adding 'unitxt/catalog/cards/global_mmlu/ny/high_school_geography.json' 2026-05-27T11:54:03,350 adding 'unitxt/catalog/cards/global_mmlu/ny/high_school_government_and_politics.json' 2026-05-27T11:54:03,351 adding 'unitxt/catalog/cards/global_mmlu/ny/high_school_macroeconomics.json' 2026-05-27T11:54:03,353 adding 'unitxt/catalog/cards/global_mmlu/ny/high_school_mathematics.json' 2026-05-27T11:54:03,354 adding 'unitxt/catalog/cards/global_mmlu/ny/high_school_microeconomics.json' 2026-05-27T11:54:03,355 adding 'unitxt/catalog/cards/global_mmlu/ny/high_school_physics.json' 2026-05-27T11:54:03,357 adding 'unitxt/catalog/cards/global_mmlu/ny/high_school_psychology.json' 2026-05-27T11:54:03,358 adding 'unitxt/catalog/cards/global_mmlu/ny/high_school_statistics.json' 2026-05-27T11:54:03,359 adding 'unitxt/catalog/cards/global_mmlu/ny/high_school_us_history.json' 2026-05-27T11:54:03,361 adding 'unitxt/catalog/cards/global_mmlu/ny/high_school_world_history.json' 2026-05-27T11:54:03,362 adding 'unitxt/catalog/cards/global_mmlu/ny/human_aging.json' 2026-05-27T11:54:03,363 adding 'unitxt/catalog/cards/global_mmlu/ny/human_sexuality.json' 2026-05-27T11:54:03,364 adding 'unitxt/catalog/cards/global_mmlu/ny/international_law.json' 2026-05-27T11:54:03,366 adding 'unitxt/catalog/cards/global_mmlu/ny/jurisprudence.json' 2026-05-27T11:54:03,367 adding 'unitxt/catalog/cards/global_mmlu/ny/logical_fallacies.json' 2026-05-27T11:54:03,368 adding 'unitxt/catalog/cards/global_mmlu/ny/machine_learning.json' 2026-05-27T11:54:03,370 adding 'unitxt/catalog/cards/global_mmlu/ny/management.json' 2026-05-27T11:54:03,371 adding 'unitxt/catalog/cards/global_mmlu/ny/marketing.json' 2026-05-27T11:54:03,373 adding 'unitxt/catalog/cards/global_mmlu/ny/medical_genetics.json' 2026-05-27T11:54:03,374 adding 'unitxt/catalog/cards/global_mmlu/ny/miscellaneous.json' 2026-05-27T11:54:03,375 adding 'unitxt/catalog/cards/global_mmlu/ny/moral_disputes.json' 2026-05-27T11:54:03,377 adding 'unitxt/catalog/cards/global_mmlu/ny/moral_scenarios.json' 2026-05-27T11:54:03,378 adding 'unitxt/catalog/cards/global_mmlu/ny/nutrition.json' 2026-05-27T11:54:03,379 adding 'unitxt/catalog/cards/global_mmlu/ny/philosophy.json' 2026-05-27T11:54:03,381 adding 'unitxt/catalog/cards/global_mmlu/ny/prehistory.json' 2026-05-27T11:54:03,382 adding 'unitxt/catalog/cards/global_mmlu/ny/professional_accounting.json' 2026-05-27T11:54:03,383 adding 'unitxt/catalog/cards/global_mmlu/ny/professional_law.json' 2026-05-27T11:54:03,385 adding 'unitxt/catalog/cards/global_mmlu/ny/professional_medicine.json' 2026-05-27T11:54:03,386 adding 'unitxt/catalog/cards/global_mmlu/ny/professional_psychology.json' 2026-05-27T11:54:03,387 adding 'unitxt/catalog/cards/global_mmlu/ny/public_relations.json' 2026-05-27T11:54:03,389 adding 'unitxt/catalog/cards/global_mmlu/ny/security_studies.json' 2026-05-27T11:54:03,390 adding 'unitxt/catalog/cards/global_mmlu/ny/sociology.json' 2026-05-27T11:54:03,391 adding 'unitxt/catalog/cards/global_mmlu/ny/us_foreign_policy.json' 2026-05-27T11:54:03,393 adding 'unitxt/catalog/cards/global_mmlu/ny/virology.json' 2026-05-27T11:54:03,394 adding 'unitxt/catalog/cards/global_mmlu/ny/world_religions.json' 2026-05-27T11:54:03,397 adding 'unitxt/catalog/cards/global_mmlu/pl/abstract_algebra.json' 2026-05-27T11:54:03,398 adding 'unitxt/catalog/cards/global_mmlu/pl/anatomy.json' 2026-05-27T11:54:03,400 adding 'unitxt/catalog/cards/global_mmlu/pl/astronomy.json' 2026-05-27T11:54:03,401 adding 'unitxt/catalog/cards/global_mmlu/pl/business_ethics.json' 2026-05-27T11:54:03,402 adding 'unitxt/catalog/cards/global_mmlu/pl/clinical_knowledge.json' 2026-05-27T11:54:03,404 adding 'unitxt/catalog/cards/global_mmlu/pl/college_biology.json' 2026-05-27T11:54:03,405 adding 'unitxt/catalog/cards/global_mmlu/pl/college_chemistry.json' 2026-05-27T11:54:03,407 adding 'unitxt/catalog/cards/global_mmlu/pl/college_computer_science.json' 2026-05-27T11:54:03,408 adding 'unitxt/catalog/cards/global_mmlu/pl/college_mathematics.json' 2026-05-27T11:54:03,409 adding 'unitxt/catalog/cards/global_mmlu/pl/college_medicine.json' 2026-05-27T11:54:03,411 adding 'unitxt/catalog/cards/global_mmlu/pl/college_physics.json' 2026-05-27T11:54:03,412 adding 'unitxt/catalog/cards/global_mmlu/pl/computer_security.json' 2026-05-27T11:54:03,413 adding 'unitxt/catalog/cards/global_mmlu/pl/conceptual_physics.json' 2026-05-27T11:54:03,415 adding 'unitxt/catalog/cards/global_mmlu/pl/econometrics.json' 2026-05-27T11:54:03,416 adding 'unitxt/catalog/cards/global_mmlu/pl/electrical_engineering.json' 2026-05-27T11:54:03,417 adding 'unitxt/catalog/cards/global_mmlu/pl/elementary_mathematics.json' 2026-05-27T11:54:03,419 adding 'unitxt/catalog/cards/global_mmlu/pl/formal_logic.json' 2026-05-27T11:54:03,420 adding 'unitxt/catalog/cards/global_mmlu/pl/global_facts.json' 2026-05-27T11:54:03,421 adding 'unitxt/catalog/cards/global_mmlu/pl/high_school_biology.json' 2026-05-27T11:54:03,422 adding 'unitxt/catalog/cards/global_mmlu/pl/high_school_chemistry.json' 2026-05-27T11:54:03,424 adding 'unitxt/catalog/cards/global_mmlu/pl/high_school_computer_science.json' 2026-05-27T11:54:03,425 adding 'unitxt/catalog/cards/global_mmlu/pl/high_school_european_history.json' 2026-05-27T11:54:03,426 adding 'unitxt/catalog/cards/global_mmlu/pl/high_school_geography.json' 2026-05-27T11:54:03,428 adding 'unitxt/catalog/cards/global_mmlu/pl/high_school_government_and_politics.json' 2026-05-27T11:54:03,429 adding 'unitxt/catalog/cards/global_mmlu/pl/high_school_macroeconomics.json' 2026-05-27T11:54:03,430 adding 'unitxt/catalog/cards/global_mmlu/pl/high_school_mathematics.json' 2026-05-27T11:54:03,432 adding 'unitxt/catalog/cards/global_mmlu/pl/high_school_microeconomics.json' 2026-05-27T11:54:03,433 adding 'unitxt/catalog/cards/global_mmlu/pl/high_school_physics.json' 2026-05-27T11:54:03,434 adding 'unitxt/catalog/cards/global_mmlu/pl/high_school_psychology.json' 2026-05-27T11:54:03,436 adding 'unitxt/catalog/cards/global_mmlu/pl/high_school_statistics.json' 2026-05-27T11:54:03,437 adding 'unitxt/catalog/cards/global_mmlu/pl/high_school_us_history.json' 2026-05-27T11:54:03,438 adding 'unitxt/catalog/cards/global_mmlu/pl/high_school_world_history.json' 2026-05-27T11:54:03,439 adding 'unitxt/catalog/cards/global_mmlu/pl/human_aging.json' 2026-05-27T11:54:03,441 adding 'unitxt/catalog/cards/global_mmlu/pl/human_sexuality.json' 2026-05-27T11:54:03,442 adding 'unitxt/catalog/cards/global_mmlu/pl/international_law.json' 2026-05-27T11:54:03,444 adding 'unitxt/catalog/cards/global_mmlu/pl/jurisprudence.json' 2026-05-27T11:54:03,445 adding 'unitxt/catalog/cards/global_mmlu/pl/logical_fallacies.json' 2026-05-27T11:54:03,447 adding 'unitxt/catalog/cards/global_mmlu/pl/machine_learning.json' 2026-05-27T11:54:03,448 adding 'unitxt/catalog/cards/global_mmlu/pl/management.json' 2026-05-27T11:54:03,449 adding 'unitxt/catalog/cards/global_mmlu/pl/marketing.json' 2026-05-27T11:54:03,451 adding 'unitxt/catalog/cards/global_mmlu/pl/medical_genetics.json' 2026-05-27T11:54:03,452 adding 'unitxt/catalog/cards/global_mmlu/pl/miscellaneous.json' 2026-05-27T11:54:03,454 adding 'unitxt/catalog/cards/global_mmlu/pl/moral_disputes.json' 2026-05-27T11:54:03,455 adding 'unitxt/catalog/cards/global_mmlu/pl/moral_scenarios.json' 2026-05-27T11:54:03,456 adding 'unitxt/catalog/cards/global_mmlu/pl/nutrition.json' 2026-05-27T11:54:03,458 adding 'unitxt/catalog/cards/global_mmlu/pl/philosophy.json' 2026-05-27T11:54:03,459 adding 'unitxt/catalog/cards/global_mmlu/pl/prehistory.json' 2026-05-27T11:54:03,461 adding 'unitxt/catalog/cards/global_mmlu/pl/professional_accounting.json' 2026-05-27T11:54:03,462 adding 'unitxt/catalog/cards/global_mmlu/pl/professional_law.json' 2026-05-27T11:54:03,463 adding 'unitxt/catalog/cards/global_mmlu/pl/professional_medicine.json' 2026-05-27T11:54:03,465 adding 'unitxt/catalog/cards/global_mmlu/pl/professional_psychology.json' 2026-05-27T11:54:03,466 adding 'unitxt/catalog/cards/global_mmlu/pl/public_relations.json' 2026-05-27T11:54:03,468 adding 'unitxt/catalog/cards/global_mmlu/pl/security_studies.json' 2026-05-27T11:54:03,469 adding 'unitxt/catalog/cards/global_mmlu/pl/sociology.json' 2026-05-27T11:54:03,470 adding 'unitxt/catalog/cards/global_mmlu/pl/us_foreign_policy.json' 2026-05-27T11:54:03,472 adding 'unitxt/catalog/cards/global_mmlu/pl/virology.json' 2026-05-27T11:54:03,473 adding 'unitxt/catalog/cards/global_mmlu/pl/world_religions.json' 2026-05-27T11:54:03,476 adding 'unitxt/catalog/cards/global_mmlu/pt/abstract_algebra.json' 2026-05-27T11:54:03,478 adding 'unitxt/catalog/cards/global_mmlu/pt/anatomy.json' 2026-05-27T11:54:03,479 adding 'unitxt/catalog/cards/global_mmlu/pt/astronomy.json' 2026-05-27T11:54:03,480 adding 'unitxt/catalog/cards/global_mmlu/pt/business_ethics.json' 2026-05-27T11:54:03,481 adding 'unitxt/catalog/cards/global_mmlu/pt/clinical_knowledge.json' 2026-05-27T11:54:03,483 adding 'unitxt/catalog/cards/global_mmlu/pt/college_biology.json' 2026-05-27T11:54:03,484 adding 'unitxt/catalog/cards/global_mmlu/pt/college_chemistry.json' 2026-05-27T11:54:03,485 adding 'unitxt/catalog/cards/global_mmlu/pt/college_computer_science.json' 2026-05-27T11:54:03,487 adding 'unitxt/catalog/cards/global_mmlu/pt/college_mathematics.json' 2026-05-27T11:54:03,488 adding 'unitxt/catalog/cards/global_mmlu/pt/college_medicine.json' 2026-05-27T11:54:03,489 adding 'unitxt/catalog/cards/global_mmlu/pt/college_physics.json' 2026-05-27T11:54:03,491 adding 'unitxt/catalog/cards/global_mmlu/pt/computer_security.json' 2026-05-27T11:54:03,492 adding 'unitxt/catalog/cards/global_mmlu/pt/conceptual_physics.json' 2026-05-27T11:54:03,493 adding 'unitxt/catalog/cards/global_mmlu/pt/econometrics.json' 2026-05-27T11:54:03,495 adding 'unitxt/catalog/cards/global_mmlu/pt/electrical_engineering.json' 2026-05-27T11:54:03,496 adding 'unitxt/catalog/cards/global_mmlu/pt/elementary_mathematics.json' 2026-05-27T11:54:03,497 adding 'unitxt/catalog/cards/global_mmlu/pt/formal_logic.json' 2026-05-27T11:54:03,499 adding 'unitxt/catalog/cards/global_mmlu/pt/global_facts.json' 2026-05-27T11:54:03,500 adding 'unitxt/catalog/cards/global_mmlu/pt/high_school_biology.json' 2026-05-27T11:54:03,501 adding 'unitxt/catalog/cards/global_mmlu/pt/high_school_chemistry.json' 2026-05-27T11:54:03,502 adding 'unitxt/catalog/cards/global_mmlu/pt/high_school_computer_science.json' 2026-05-27T11:54:03,504 adding 'unitxt/catalog/cards/global_mmlu/pt/high_school_european_history.json' 2026-05-27T11:54:03,505 adding 'unitxt/catalog/cards/global_mmlu/pt/high_school_geography.json' 2026-05-27T11:54:03,507 adding 'unitxt/catalog/cards/global_mmlu/pt/high_school_government_and_politics.json' 2026-05-27T11:54:03,508 adding 'unitxt/catalog/cards/global_mmlu/pt/high_school_macroeconomics.json' 2026-05-27T11:54:03,509 adding 'unitxt/catalog/cards/global_mmlu/pt/high_school_mathematics.json' 2026-05-27T11:54:03,511 adding 'unitxt/catalog/cards/global_mmlu/pt/high_school_microeconomics.json' 2026-05-27T11:54:03,512 adding 'unitxt/catalog/cards/global_mmlu/pt/high_school_physics.json' 2026-05-27T11:54:03,513 adding 'unitxt/catalog/cards/global_mmlu/pt/high_school_psychology.json' 2026-05-27T11:54:03,515 adding 'unitxt/catalog/cards/global_mmlu/pt/high_school_statistics.json' 2026-05-27T11:54:03,516 adding 'unitxt/catalog/cards/global_mmlu/pt/high_school_us_history.json' 2026-05-27T11:54:03,518 adding 'unitxt/catalog/cards/global_mmlu/pt/high_school_world_history.json' 2026-05-27T11:54:03,519 adding 'unitxt/catalog/cards/global_mmlu/pt/human_aging.json' 2026-05-27T11:54:03,520 adding 'unitxt/catalog/cards/global_mmlu/pt/human_sexuality.json' 2026-05-27T11:54:03,522 adding 'unitxt/catalog/cards/global_mmlu/pt/international_law.json' 2026-05-27T11:54:03,523 adding 'unitxt/catalog/cards/global_mmlu/pt/jurisprudence.json' 2026-05-27T11:54:03,524 adding 'unitxt/catalog/cards/global_mmlu/pt/logical_fallacies.json' 2026-05-27T11:54:03,526 adding 'unitxt/catalog/cards/global_mmlu/pt/machine_learning.json' 2026-05-27T11:54:03,527 adding 'unitxt/catalog/cards/global_mmlu/pt/management.json' 2026-05-27T11:54:03,529 adding 'unitxt/catalog/cards/global_mmlu/pt/marketing.json' 2026-05-27T11:54:03,530 adding 'unitxt/catalog/cards/global_mmlu/pt/medical_genetics.json' 2026-05-27T11:54:03,532 adding 'unitxt/catalog/cards/global_mmlu/pt/miscellaneous.json' 2026-05-27T11:54:03,533 adding 'unitxt/catalog/cards/global_mmlu/pt/moral_disputes.json' 2026-05-27T11:54:03,535 adding 'unitxt/catalog/cards/global_mmlu/pt/moral_scenarios.json' 2026-05-27T11:54:03,536 adding 'unitxt/catalog/cards/global_mmlu/pt/nutrition.json' 2026-05-27T11:54:03,537 adding 'unitxt/catalog/cards/global_mmlu/pt/philosophy.json' 2026-05-27T11:54:03,539 adding 'unitxt/catalog/cards/global_mmlu/pt/prehistory.json' 2026-05-27T11:54:03,540 adding 'unitxt/catalog/cards/global_mmlu/pt/professional_accounting.json' 2026-05-27T11:54:03,541 adding 'unitxt/catalog/cards/global_mmlu/pt/professional_law.json' 2026-05-27T11:54:03,542 adding 'unitxt/catalog/cards/global_mmlu/pt/professional_medicine.json' 2026-05-27T11:54:03,544 adding 'unitxt/catalog/cards/global_mmlu/pt/professional_psychology.json' 2026-05-27T11:54:03,545 adding 'unitxt/catalog/cards/global_mmlu/pt/public_relations.json' 2026-05-27T11:54:03,547 adding 'unitxt/catalog/cards/global_mmlu/pt/security_studies.json' 2026-05-27T11:54:03,548 adding 'unitxt/catalog/cards/global_mmlu/pt/sociology.json' 2026-05-27T11:54:03,549 adding 'unitxt/catalog/cards/global_mmlu/pt/us_foreign_policy.json' 2026-05-27T11:54:03,551 adding 'unitxt/catalog/cards/global_mmlu/pt/virology.json' 2026-05-27T11:54:03,552 adding 'unitxt/catalog/cards/global_mmlu/pt/world_religions.json' 2026-05-27T11:54:03,555 adding 'unitxt/catalog/cards/global_mmlu/ro/abstract_algebra.json' 2026-05-27T11:54:03,556 adding 'unitxt/catalog/cards/global_mmlu/ro/anatomy.json' 2026-05-27T11:54:03,557 adding 'unitxt/catalog/cards/global_mmlu/ro/astronomy.json' 2026-05-27T11:54:03,559 adding 'unitxt/catalog/cards/global_mmlu/ro/business_ethics.json' 2026-05-27T11:54:03,560 adding 'unitxt/catalog/cards/global_mmlu/ro/clinical_knowledge.json' 2026-05-27T11:54:03,561 adding 'unitxt/catalog/cards/global_mmlu/ro/college_biology.json' 2026-05-27T11:54:03,563 adding 'unitxt/catalog/cards/global_mmlu/ro/college_chemistry.json' 2026-05-27T11:54:03,564 adding 'unitxt/catalog/cards/global_mmlu/ro/college_computer_science.json' 2026-05-27T11:54:03,565 adding 'unitxt/catalog/cards/global_mmlu/ro/college_mathematics.json' 2026-05-27T11:54:03,567 adding 'unitxt/catalog/cards/global_mmlu/ro/college_medicine.json' 2026-05-27T11:54:03,568 adding 'unitxt/catalog/cards/global_mmlu/ro/college_physics.json' 2026-05-27T11:54:03,569 adding 'unitxt/catalog/cards/global_mmlu/ro/computer_security.json' 2026-05-27T11:54:03,571 adding 'unitxt/catalog/cards/global_mmlu/ro/conceptual_physics.json' 2026-05-27T11:54:03,572 adding 'unitxt/catalog/cards/global_mmlu/ro/econometrics.json' 2026-05-27T11:54:03,573 adding 'unitxt/catalog/cards/global_mmlu/ro/electrical_engineering.json' 2026-05-27T11:54:03,575 adding 'unitxt/catalog/cards/global_mmlu/ro/elementary_mathematics.json' 2026-05-27T11:54:03,576 adding 'unitxt/catalog/cards/global_mmlu/ro/formal_logic.json' 2026-05-27T11:54:03,578 adding 'unitxt/catalog/cards/global_mmlu/ro/global_facts.json' 2026-05-27T11:54:03,579 adding 'unitxt/catalog/cards/global_mmlu/ro/high_school_biology.json' 2026-05-27T11:54:03,580 adding 'unitxt/catalog/cards/global_mmlu/ro/high_school_chemistry.json' 2026-05-27T11:54:03,582 adding 'unitxt/catalog/cards/global_mmlu/ro/high_school_computer_science.json' 2026-05-27T11:54:03,583 adding 'unitxt/catalog/cards/global_mmlu/ro/high_school_european_history.json' 2026-05-27T11:54:03,584 adding 'unitxt/catalog/cards/global_mmlu/ro/high_school_geography.json' 2026-05-27T11:54:03,586 adding 'unitxt/catalog/cards/global_mmlu/ro/high_school_government_and_politics.json' 2026-05-27T11:54:03,587 adding 'unitxt/catalog/cards/global_mmlu/ro/high_school_macroeconomics.json' 2026-05-27T11:54:03,589 adding 'unitxt/catalog/cards/global_mmlu/ro/high_school_mathematics.json' 2026-05-27T11:54:03,590 adding 'unitxt/catalog/cards/global_mmlu/ro/high_school_microeconomics.json' 2026-05-27T11:54:03,591 adding 'unitxt/catalog/cards/global_mmlu/ro/high_school_physics.json' 2026-05-27T11:54:03,593 adding 'unitxt/catalog/cards/global_mmlu/ro/high_school_psychology.json' 2026-05-27T11:54:03,594 adding 'unitxt/catalog/cards/global_mmlu/ro/high_school_statistics.json' 2026-05-27T11:54:03,596 adding 'unitxt/catalog/cards/global_mmlu/ro/high_school_us_history.json' 2026-05-27T11:54:03,597 adding 'unitxt/catalog/cards/global_mmlu/ro/high_school_world_history.json' 2026-05-27T11:54:03,598 adding 'unitxt/catalog/cards/global_mmlu/ro/human_aging.json' 2026-05-27T11:54:03,599 adding 'unitxt/catalog/cards/global_mmlu/ro/human_sexuality.json' 2026-05-27T11:54:03,601 adding 'unitxt/catalog/cards/global_mmlu/ro/international_law.json' 2026-05-27T11:54:03,602 adding 'unitxt/catalog/cards/global_mmlu/ro/jurisprudence.json' 2026-05-27T11:54:03,603 adding 'unitxt/catalog/cards/global_mmlu/ro/logical_fallacies.json' 2026-05-27T11:54:03,605 adding 'unitxt/catalog/cards/global_mmlu/ro/machine_learning.json' 2026-05-27T11:54:03,606 adding 'unitxt/catalog/cards/global_mmlu/ro/management.json' 2026-05-27T11:54:03,607 adding 'unitxt/catalog/cards/global_mmlu/ro/marketing.json' 2026-05-27T11:54:03,609 adding 'unitxt/catalog/cards/global_mmlu/ro/medical_genetics.json' 2026-05-27T11:54:03,610 adding 'unitxt/catalog/cards/global_mmlu/ro/miscellaneous.json' 2026-05-27T11:54:03,627 adding 'unitxt/catalog/cards/global_mmlu/ro/moral_disputes.json' 2026-05-27T11:54:03,629 adding 'unitxt/catalog/cards/global_mmlu/ro/moral_scenarios.json' 2026-05-27T11:54:03,630 adding 'unitxt/catalog/cards/global_mmlu/ro/nutrition.json' 2026-05-27T11:54:03,631 adding 'unitxt/catalog/cards/global_mmlu/ro/philosophy.json' 2026-05-27T11:54:03,633 adding 'unitxt/catalog/cards/global_mmlu/ro/prehistory.json' 2026-05-27T11:54:03,634 adding 'unitxt/catalog/cards/global_mmlu/ro/professional_accounting.json' 2026-05-27T11:54:03,635 adding 'unitxt/catalog/cards/global_mmlu/ro/professional_law.json' 2026-05-27T11:54:03,637 adding 'unitxt/catalog/cards/global_mmlu/ro/professional_medicine.json' 2026-05-27T11:54:03,638 adding 'unitxt/catalog/cards/global_mmlu/ro/professional_psychology.json' 2026-05-27T11:54:03,639 adding 'unitxt/catalog/cards/global_mmlu/ro/public_relations.json' 2026-05-27T11:54:03,641 adding 'unitxt/catalog/cards/global_mmlu/ro/security_studies.json' 2026-05-27T11:54:03,642 adding 'unitxt/catalog/cards/global_mmlu/ro/sociology.json' 2026-05-27T11:54:03,643 adding 'unitxt/catalog/cards/global_mmlu/ro/us_foreign_policy.json' 2026-05-27T11:54:03,645 adding 'unitxt/catalog/cards/global_mmlu/ro/virology.json' 2026-05-27T11:54:03,646 adding 'unitxt/catalog/cards/global_mmlu/ro/world_religions.json' 2026-05-27T11:54:03,649 adding 'unitxt/catalog/cards/global_mmlu/ru/abstract_algebra.json' 2026-05-27T11:54:03,650 adding 'unitxt/catalog/cards/global_mmlu/ru/anatomy.json' 2026-05-27T11:54:03,651 adding 'unitxt/catalog/cards/global_mmlu/ru/astronomy.json' 2026-05-27T11:54:03,653 adding 'unitxt/catalog/cards/global_mmlu/ru/business_ethics.json' 2026-05-27T11:54:03,654 adding 'unitxt/catalog/cards/global_mmlu/ru/clinical_knowledge.json' 2026-05-27T11:54:03,655 adding 'unitxt/catalog/cards/global_mmlu/ru/college_biology.json' 2026-05-27T11:54:03,657 adding 'unitxt/catalog/cards/global_mmlu/ru/college_chemistry.json' 2026-05-27T11:54:03,658 adding 'unitxt/catalog/cards/global_mmlu/ru/college_computer_science.json' 2026-05-27T11:54:03,660 adding 'unitxt/catalog/cards/global_mmlu/ru/college_mathematics.json' 2026-05-27T11:54:03,661 adding 'unitxt/catalog/cards/global_mmlu/ru/college_medicine.json' 2026-05-27T11:54:03,662 adding 'unitxt/catalog/cards/global_mmlu/ru/college_physics.json' 2026-05-27T11:54:03,664 adding 'unitxt/catalog/cards/global_mmlu/ru/computer_security.json' 2026-05-27T11:54:03,665 adding 'unitxt/catalog/cards/global_mmlu/ru/conceptual_physics.json' 2026-05-27T11:54:03,666 adding 'unitxt/catalog/cards/global_mmlu/ru/econometrics.json' 2026-05-27T11:54:03,668 adding 'unitxt/catalog/cards/global_mmlu/ru/electrical_engineering.json' 2026-05-27T11:54:03,669 adding 'unitxt/catalog/cards/global_mmlu/ru/elementary_mathematics.json' 2026-05-27T11:54:03,670 adding 'unitxt/catalog/cards/global_mmlu/ru/formal_logic.json' 2026-05-27T11:54:03,672 adding 'unitxt/catalog/cards/global_mmlu/ru/global_facts.json' 2026-05-27T11:54:03,673 adding 'unitxt/catalog/cards/global_mmlu/ru/high_school_biology.json' 2026-05-27T11:54:03,674 adding 'unitxt/catalog/cards/global_mmlu/ru/high_school_chemistry.json' 2026-05-27T11:54:03,676 adding 'unitxt/catalog/cards/global_mmlu/ru/high_school_computer_science.json' 2026-05-27T11:54:03,677 adding 'unitxt/catalog/cards/global_mmlu/ru/high_school_european_history.json' 2026-05-27T11:54:03,678 adding 'unitxt/catalog/cards/global_mmlu/ru/high_school_geography.json' 2026-05-27T11:54:03,679 adding 'unitxt/catalog/cards/global_mmlu/ru/high_school_government_and_politics.json' 2026-05-27T11:54:03,681 adding 'unitxt/catalog/cards/global_mmlu/ru/high_school_macroeconomics.json' 2026-05-27T11:54:03,682 adding 'unitxt/catalog/cards/global_mmlu/ru/high_school_mathematics.json' 2026-05-27T11:54:03,683 adding 'unitxt/catalog/cards/global_mmlu/ru/high_school_microeconomics.json' 2026-05-27T11:54:03,685 adding 'unitxt/catalog/cards/global_mmlu/ru/high_school_physics.json' 2026-05-27T11:54:03,686 adding 'unitxt/catalog/cards/global_mmlu/ru/high_school_psychology.json' 2026-05-27T11:54:03,687 adding 'unitxt/catalog/cards/global_mmlu/ru/high_school_statistics.json' 2026-05-27T11:54:03,689 adding 'unitxt/catalog/cards/global_mmlu/ru/high_school_us_history.json' 2026-05-27T11:54:03,690 adding 'unitxt/catalog/cards/global_mmlu/ru/high_school_world_history.json' 2026-05-27T11:54:03,691 adding 'unitxt/catalog/cards/global_mmlu/ru/human_aging.json' 2026-05-27T11:54:03,693 adding 'unitxt/catalog/cards/global_mmlu/ru/human_sexuality.json' 2026-05-27T11:54:03,694 adding 'unitxt/catalog/cards/global_mmlu/ru/international_law.json' 2026-05-27T11:54:03,695 adding 'unitxt/catalog/cards/global_mmlu/ru/jurisprudence.json' 2026-05-27T11:54:03,697 adding 'unitxt/catalog/cards/global_mmlu/ru/logical_fallacies.json' 2026-05-27T11:54:03,698 adding 'unitxt/catalog/cards/global_mmlu/ru/machine_learning.json' 2026-05-27T11:54:03,699 adding 'unitxt/catalog/cards/global_mmlu/ru/management.json' 2026-05-27T11:54:03,701 adding 'unitxt/catalog/cards/global_mmlu/ru/marketing.json' 2026-05-27T11:54:03,702 adding 'unitxt/catalog/cards/global_mmlu/ru/medical_genetics.json' 2026-05-27T11:54:03,703 adding 'unitxt/catalog/cards/global_mmlu/ru/miscellaneous.json' 2026-05-27T11:54:03,705 adding 'unitxt/catalog/cards/global_mmlu/ru/moral_disputes.json' 2026-05-27T11:54:03,706 adding 'unitxt/catalog/cards/global_mmlu/ru/moral_scenarios.json' 2026-05-27T11:54:03,707 adding 'unitxt/catalog/cards/global_mmlu/ru/nutrition.json' 2026-05-27T11:54:03,709 adding 'unitxt/catalog/cards/global_mmlu/ru/philosophy.json' 2026-05-27T11:54:03,710 adding 'unitxt/catalog/cards/global_mmlu/ru/prehistory.json' 2026-05-27T11:54:03,711 adding 'unitxt/catalog/cards/global_mmlu/ru/professional_accounting.json' 2026-05-27T11:54:03,713 adding 'unitxt/catalog/cards/global_mmlu/ru/professional_law.json' 2026-05-27T11:54:03,714 adding 'unitxt/catalog/cards/global_mmlu/ru/professional_medicine.json' 2026-05-27T11:54:03,715 adding 'unitxt/catalog/cards/global_mmlu/ru/professional_psychology.json' 2026-05-27T11:54:03,717 adding 'unitxt/catalog/cards/global_mmlu/ru/public_relations.json' 2026-05-27T11:54:03,718 adding 'unitxt/catalog/cards/global_mmlu/ru/security_studies.json' 2026-05-27T11:54:03,719 adding 'unitxt/catalog/cards/global_mmlu/ru/sociology.json' 2026-05-27T11:54:03,721 adding 'unitxt/catalog/cards/global_mmlu/ru/us_foreign_policy.json' 2026-05-27T11:54:03,722 adding 'unitxt/catalog/cards/global_mmlu/ru/virology.json' 2026-05-27T11:54:03,723 adding 'unitxt/catalog/cards/global_mmlu/ru/world_religions.json' 2026-05-27T11:54:03,726 adding 'unitxt/catalog/cards/global_mmlu/si/abstract_algebra.json' 2026-05-27T11:54:03,728 adding 'unitxt/catalog/cards/global_mmlu/si/anatomy.json' 2026-05-27T11:54:03,729 adding 'unitxt/catalog/cards/global_mmlu/si/astronomy.json' 2026-05-27T11:54:03,730 adding 'unitxt/catalog/cards/global_mmlu/si/business_ethics.json' 2026-05-27T11:54:03,732 adding 'unitxt/catalog/cards/global_mmlu/si/clinical_knowledge.json' 2026-05-27T11:54:03,733 adding 'unitxt/catalog/cards/global_mmlu/si/college_biology.json' 2026-05-27T11:54:03,734 adding 'unitxt/catalog/cards/global_mmlu/si/college_chemistry.json' 2026-05-27T11:54:03,735 adding 'unitxt/catalog/cards/global_mmlu/si/college_computer_science.json' 2026-05-27T11:54:03,736 adding 'unitxt/catalog/cards/global_mmlu/si/college_mathematics.json' 2026-05-27T11:54:03,738 adding 'unitxt/catalog/cards/global_mmlu/si/college_medicine.json' 2026-05-27T11:54:03,739 adding 'unitxt/catalog/cards/global_mmlu/si/college_physics.json' 2026-05-27T11:54:03,740 adding 'unitxt/catalog/cards/global_mmlu/si/computer_security.json' 2026-05-27T11:54:03,742 adding 'unitxt/catalog/cards/global_mmlu/si/conceptual_physics.json' 2026-05-27T11:54:03,743 adding 'unitxt/catalog/cards/global_mmlu/si/econometrics.json' 2026-05-27T11:54:03,745 adding 'unitxt/catalog/cards/global_mmlu/si/electrical_engineering.json' 2026-05-27T11:54:03,746 adding 'unitxt/catalog/cards/global_mmlu/si/elementary_mathematics.json' 2026-05-27T11:54:03,747 adding 'unitxt/catalog/cards/global_mmlu/si/formal_logic.json' 2026-05-27T11:54:03,749 adding 'unitxt/catalog/cards/global_mmlu/si/global_facts.json' 2026-05-27T11:54:03,750 adding 'unitxt/catalog/cards/global_mmlu/si/high_school_biology.json' 2026-05-27T11:54:03,751 adding 'unitxt/catalog/cards/global_mmlu/si/high_school_chemistry.json' 2026-05-27T11:54:03,753 adding 'unitxt/catalog/cards/global_mmlu/si/high_school_computer_science.json' 2026-05-27T11:54:03,754 adding 'unitxt/catalog/cards/global_mmlu/si/high_school_european_history.json' 2026-05-27T11:54:03,755 adding 'unitxt/catalog/cards/global_mmlu/si/high_school_geography.json' 2026-05-27T11:54:03,757 adding 'unitxt/catalog/cards/global_mmlu/si/high_school_government_and_politics.json' 2026-05-27T11:54:03,758 adding 'unitxt/catalog/cards/global_mmlu/si/high_school_macroeconomics.json' 2026-05-27T11:54:03,760 adding 'unitxt/catalog/cards/global_mmlu/si/high_school_mathematics.json' 2026-05-27T11:54:03,761 adding 'unitxt/catalog/cards/global_mmlu/si/high_school_microeconomics.json' 2026-05-27T11:54:03,762 adding 'unitxt/catalog/cards/global_mmlu/si/high_school_physics.json' 2026-05-27T11:54:03,764 adding 'unitxt/catalog/cards/global_mmlu/si/high_school_psychology.json' 2026-05-27T11:54:03,765 adding 'unitxt/catalog/cards/global_mmlu/si/high_school_statistics.json' 2026-05-27T11:54:03,766 adding 'unitxt/catalog/cards/global_mmlu/si/high_school_us_history.json' 2026-05-27T11:54:03,768 adding 'unitxt/catalog/cards/global_mmlu/si/high_school_world_history.json' 2026-05-27T11:54:03,769 adding 'unitxt/catalog/cards/global_mmlu/si/human_aging.json' 2026-05-27T11:54:03,770 adding 'unitxt/catalog/cards/global_mmlu/si/human_sexuality.json' 2026-05-27T11:54:03,772 adding 'unitxt/catalog/cards/global_mmlu/si/international_law.json' 2026-05-27T11:54:03,773 adding 'unitxt/catalog/cards/global_mmlu/si/jurisprudence.json' 2026-05-27T11:54:03,774 adding 'unitxt/catalog/cards/global_mmlu/si/logical_fallacies.json' 2026-05-27T11:54:03,776 adding 'unitxt/catalog/cards/global_mmlu/si/machine_learning.json' 2026-05-27T11:54:03,777 adding 'unitxt/catalog/cards/global_mmlu/si/management.json' 2026-05-27T11:54:03,779 adding 'unitxt/catalog/cards/global_mmlu/si/marketing.json' 2026-05-27T11:54:03,780 adding 'unitxt/catalog/cards/global_mmlu/si/medical_genetics.json' 2026-05-27T11:54:03,781 adding 'unitxt/catalog/cards/global_mmlu/si/miscellaneous.json' 2026-05-27T11:54:03,783 adding 'unitxt/catalog/cards/global_mmlu/si/moral_disputes.json' 2026-05-27T11:54:03,784 adding 'unitxt/catalog/cards/global_mmlu/si/moral_scenarios.json' 2026-05-27T11:54:03,785 adding 'unitxt/catalog/cards/global_mmlu/si/nutrition.json' 2026-05-27T11:54:03,787 adding 'unitxt/catalog/cards/global_mmlu/si/philosophy.json' 2026-05-27T11:54:03,788 adding 'unitxt/catalog/cards/global_mmlu/si/prehistory.json' 2026-05-27T11:54:03,789 adding 'unitxt/catalog/cards/global_mmlu/si/professional_accounting.json' 2026-05-27T11:54:03,791 adding 'unitxt/catalog/cards/global_mmlu/si/professional_law.json' 2026-05-27T11:54:03,792 adding 'unitxt/catalog/cards/global_mmlu/si/professional_medicine.json' 2026-05-27T11:54:03,793 adding 'unitxt/catalog/cards/global_mmlu/si/professional_psychology.json' 2026-05-27T11:54:03,794 adding 'unitxt/catalog/cards/global_mmlu/si/public_relations.json' 2026-05-27T11:54:03,796 adding 'unitxt/catalog/cards/global_mmlu/si/security_studies.json' 2026-05-27T11:54:03,797 adding 'unitxt/catalog/cards/global_mmlu/si/sociology.json' 2026-05-27T11:54:03,798 adding 'unitxt/catalog/cards/global_mmlu/si/us_foreign_policy.json' 2026-05-27T11:54:03,799 adding 'unitxt/catalog/cards/global_mmlu/si/virology.json' 2026-05-27T11:54:03,801 adding 'unitxt/catalog/cards/global_mmlu/si/world_religions.json' 2026-05-27T11:54:03,803 adding 'unitxt/catalog/cards/global_mmlu/sn/abstract_algebra.json' 2026-05-27T11:54:03,805 adding 'unitxt/catalog/cards/global_mmlu/sn/anatomy.json' 2026-05-27T11:54:03,806 adding 'unitxt/catalog/cards/global_mmlu/sn/astronomy.json' 2026-05-27T11:54:03,807 adding 'unitxt/catalog/cards/global_mmlu/sn/business_ethics.json' 2026-05-27T11:54:03,809 adding 'unitxt/catalog/cards/global_mmlu/sn/clinical_knowledge.json' 2026-05-27T11:54:03,810 adding 'unitxt/catalog/cards/global_mmlu/sn/college_biology.json' 2026-05-27T11:54:03,811 adding 'unitxt/catalog/cards/global_mmlu/sn/college_chemistry.json' 2026-05-27T11:54:03,812 adding 'unitxt/catalog/cards/global_mmlu/sn/college_computer_science.json' 2026-05-27T11:54:03,814 adding 'unitxt/catalog/cards/global_mmlu/sn/college_mathematics.json' 2026-05-27T11:54:03,815 adding 'unitxt/catalog/cards/global_mmlu/sn/college_medicine.json' 2026-05-27T11:54:03,817 adding 'unitxt/catalog/cards/global_mmlu/sn/college_physics.json' 2026-05-27T11:54:03,818 adding 'unitxt/catalog/cards/global_mmlu/sn/computer_security.json' 2026-05-27T11:54:03,819 adding 'unitxt/catalog/cards/global_mmlu/sn/conceptual_physics.json' 2026-05-27T11:54:03,821 adding 'unitxt/catalog/cards/global_mmlu/sn/econometrics.json' 2026-05-27T11:54:03,822 adding 'unitxt/catalog/cards/global_mmlu/sn/electrical_engineering.json' 2026-05-27T11:54:03,823 adding 'unitxt/catalog/cards/global_mmlu/sn/elementary_mathematics.json' 2026-05-27T11:54:03,824 adding 'unitxt/catalog/cards/global_mmlu/sn/formal_logic.json' 2026-05-27T11:54:03,826 adding 'unitxt/catalog/cards/global_mmlu/sn/global_facts.json' 2026-05-27T11:54:03,827 adding 'unitxt/catalog/cards/global_mmlu/sn/high_school_biology.json' 2026-05-27T11:54:03,829 adding 'unitxt/catalog/cards/global_mmlu/sn/high_school_chemistry.json' 2026-05-27T11:54:03,830 adding 'unitxt/catalog/cards/global_mmlu/sn/high_school_computer_science.json' 2026-05-27T11:54:03,831 adding 'unitxt/catalog/cards/global_mmlu/sn/high_school_european_history.json' 2026-05-27T11:54:03,833 adding 'unitxt/catalog/cards/global_mmlu/sn/high_school_geography.json' 2026-05-27T11:54:03,834 adding 'unitxt/catalog/cards/global_mmlu/sn/high_school_government_and_politics.json' 2026-05-27T11:54:03,835 adding 'unitxt/catalog/cards/global_mmlu/sn/high_school_macroeconomics.json' 2026-05-27T11:54:03,837 adding 'unitxt/catalog/cards/global_mmlu/sn/high_school_mathematics.json' 2026-05-27T11:54:03,838 adding 'unitxt/catalog/cards/global_mmlu/sn/high_school_microeconomics.json' 2026-05-27T11:54:03,840 adding 'unitxt/catalog/cards/global_mmlu/sn/high_school_physics.json' 2026-05-27T11:54:03,841 adding 'unitxt/catalog/cards/global_mmlu/sn/high_school_psychology.json' 2026-05-27T11:54:03,843 adding 'unitxt/catalog/cards/global_mmlu/sn/high_school_statistics.json' 2026-05-27T11:54:03,844 adding 'unitxt/catalog/cards/global_mmlu/sn/high_school_us_history.json' 2026-05-27T11:54:03,845 adding 'unitxt/catalog/cards/global_mmlu/sn/high_school_world_history.json' 2026-05-27T11:54:03,847 adding 'unitxt/catalog/cards/global_mmlu/sn/human_aging.json' 2026-05-27T11:54:03,848 adding 'unitxt/catalog/cards/global_mmlu/sn/human_sexuality.json' 2026-05-27T11:54:03,849 adding 'unitxt/catalog/cards/global_mmlu/sn/international_law.json' 2026-05-27T11:54:03,851 adding 'unitxt/catalog/cards/global_mmlu/sn/jurisprudence.json' 2026-05-27T11:54:03,852 adding 'unitxt/catalog/cards/global_mmlu/sn/logical_fallacies.json' 2026-05-27T11:54:03,853 adding 'unitxt/catalog/cards/global_mmlu/sn/machine_learning.json' 2026-05-27T11:54:03,854 adding 'unitxt/catalog/cards/global_mmlu/sn/management.json' 2026-05-27T11:54:03,856 adding 'unitxt/catalog/cards/global_mmlu/sn/marketing.json' 2026-05-27T11:54:03,857 adding 'unitxt/catalog/cards/global_mmlu/sn/medical_genetics.json' 2026-05-27T11:54:03,858 adding 'unitxt/catalog/cards/global_mmlu/sn/miscellaneous.json' 2026-05-27T11:54:03,860 adding 'unitxt/catalog/cards/global_mmlu/sn/moral_disputes.json' 2026-05-27T11:54:03,861 adding 'unitxt/catalog/cards/global_mmlu/sn/moral_scenarios.json' 2026-05-27T11:54:03,862 adding 'unitxt/catalog/cards/global_mmlu/sn/nutrition.json' 2026-05-27T11:54:03,864 adding 'unitxt/catalog/cards/global_mmlu/sn/philosophy.json' 2026-05-27T11:54:03,865 adding 'unitxt/catalog/cards/global_mmlu/sn/prehistory.json' 2026-05-27T11:54:03,866 adding 'unitxt/catalog/cards/global_mmlu/sn/professional_accounting.json' 2026-05-27T11:54:03,868 adding 'unitxt/catalog/cards/global_mmlu/sn/professional_law.json' 2026-05-27T11:54:03,869 adding 'unitxt/catalog/cards/global_mmlu/sn/professional_medicine.json' 2026-05-27T11:54:03,870 adding 'unitxt/catalog/cards/global_mmlu/sn/professional_psychology.json' 2026-05-27T11:54:03,871 adding 'unitxt/catalog/cards/global_mmlu/sn/public_relations.json' 2026-05-27T11:54:03,873 adding 'unitxt/catalog/cards/global_mmlu/sn/security_studies.json' 2026-05-27T11:54:03,874 adding 'unitxt/catalog/cards/global_mmlu/sn/sociology.json' 2026-05-27T11:54:03,875 adding 'unitxt/catalog/cards/global_mmlu/sn/us_foreign_policy.json' 2026-05-27T11:54:03,877 adding 'unitxt/catalog/cards/global_mmlu/sn/virology.json' 2026-05-27T11:54:03,878 adding 'unitxt/catalog/cards/global_mmlu/sn/world_religions.json' 2026-05-27T11:54:03,881 adding 'unitxt/catalog/cards/global_mmlu/so/abstract_algebra.json' 2026-05-27T11:54:03,882 adding 'unitxt/catalog/cards/global_mmlu/so/anatomy.json' 2026-05-27T11:54:03,884 adding 'unitxt/catalog/cards/global_mmlu/so/astronomy.json' 2026-05-27T11:54:03,885 adding 'unitxt/catalog/cards/global_mmlu/so/business_ethics.json' 2026-05-27T11:54:03,886 adding 'unitxt/catalog/cards/global_mmlu/so/clinical_knowledge.json' 2026-05-27T11:54:03,888 adding 'unitxt/catalog/cards/global_mmlu/so/college_biology.json' 2026-05-27T11:54:03,889 adding 'unitxt/catalog/cards/global_mmlu/so/college_chemistry.json' 2026-05-27T11:54:03,890 adding 'unitxt/catalog/cards/global_mmlu/so/college_computer_science.json' 2026-05-27T11:54:03,892 adding 'unitxt/catalog/cards/global_mmlu/so/college_mathematics.json' 2026-05-27T11:54:03,893 adding 'unitxt/catalog/cards/global_mmlu/so/college_medicine.json' 2026-05-27T11:54:03,894 adding 'unitxt/catalog/cards/global_mmlu/so/college_physics.json' 2026-05-27T11:54:03,896 adding 'unitxt/catalog/cards/global_mmlu/so/computer_security.json' 2026-05-27T11:54:03,897 adding 'unitxt/catalog/cards/global_mmlu/so/conceptual_physics.json' 2026-05-27T11:54:03,899 adding 'unitxt/catalog/cards/global_mmlu/so/econometrics.json' 2026-05-27T11:54:03,900 adding 'unitxt/catalog/cards/global_mmlu/so/electrical_engineering.json' 2026-05-27T11:54:03,901 adding 'unitxt/catalog/cards/global_mmlu/so/elementary_mathematics.json' 2026-05-27T11:54:03,903 adding 'unitxt/catalog/cards/global_mmlu/so/formal_logic.json' 2026-05-27T11:54:03,904 adding 'unitxt/catalog/cards/global_mmlu/so/global_facts.json' 2026-05-27T11:54:03,905 adding 'unitxt/catalog/cards/global_mmlu/so/high_school_biology.json' 2026-05-27T11:54:03,907 adding 'unitxt/catalog/cards/global_mmlu/so/high_school_chemistry.json' 2026-05-27T11:54:03,908 adding 'unitxt/catalog/cards/global_mmlu/so/high_school_computer_science.json' 2026-05-27T11:54:03,909 adding 'unitxt/catalog/cards/global_mmlu/so/high_school_european_history.json' 2026-05-27T11:54:03,910 adding 'unitxt/catalog/cards/global_mmlu/so/high_school_geography.json' 2026-05-27T11:54:03,912 adding 'unitxt/catalog/cards/global_mmlu/so/high_school_government_and_politics.json' 2026-05-27T11:54:03,913 adding 'unitxt/catalog/cards/global_mmlu/so/high_school_macroeconomics.json' 2026-05-27T11:54:03,914 adding 'unitxt/catalog/cards/global_mmlu/so/high_school_mathematics.json' 2026-05-27T11:54:03,915 adding 'unitxt/catalog/cards/global_mmlu/so/high_school_microeconomics.json' 2026-05-27T11:54:03,917 adding 'unitxt/catalog/cards/global_mmlu/so/high_school_physics.json' 2026-05-27T11:54:03,918 adding 'unitxt/catalog/cards/global_mmlu/so/high_school_psychology.json' 2026-05-27T11:54:03,919 adding 'unitxt/catalog/cards/global_mmlu/so/high_school_statistics.json' 2026-05-27T11:54:03,921 adding 'unitxt/catalog/cards/global_mmlu/so/high_school_us_history.json' 2026-05-27T11:54:03,922 adding 'unitxt/catalog/cards/global_mmlu/so/high_school_world_history.json' 2026-05-27T11:54:03,924 adding 'unitxt/catalog/cards/global_mmlu/so/human_aging.json' 2026-05-27T11:54:03,925 adding 'unitxt/catalog/cards/global_mmlu/so/human_sexuality.json' 2026-05-27T11:54:03,926 adding 'unitxt/catalog/cards/global_mmlu/so/international_law.json' 2026-05-27T11:54:03,928 adding 'unitxt/catalog/cards/global_mmlu/so/jurisprudence.json' 2026-05-27T11:54:03,929 adding 'unitxt/catalog/cards/global_mmlu/so/logical_fallacies.json' 2026-05-27T11:54:03,930 adding 'unitxt/catalog/cards/global_mmlu/so/machine_learning.json' 2026-05-27T11:54:03,932 adding 'unitxt/catalog/cards/global_mmlu/so/management.json' 2026-05-27T11:54:03,933 adding 'unitxt/catalog/cards/global_mmlu/so/marketing.json' 2026-05-27T11:54:03,934 adding 'unitxt/catalog/cards/global_mmlu/so/medical_genetics.json' 2026-05-27T11:54:03,936 adding 'unitxt/catalog/cards/global_mmlu/so/miscellaneous.json' 2026-05-27T11:54:03,937 adding 'unitxt/catalog/cards/global_mmlu/so/moral_disputes.json' 2026-05-27T11:54:03,938 adding 'unitxt/catalog/cards/global_mmlu/so/moral_scenarios.json' 2026-05-27T11:54:03,940 adding 'unitxt/catalog/cards/global_mmlu/so/nutrition.json' 2026-05-27T11:54:03,941 adding 'unitxt/catalog/cards/global_mmlu/so/philosophy.json' 2026-05-27T11:54:03,943 adding 'unitxt/catalog/cards/global_mmlu/so/prehistory.json' 2026-05-27T11:54:03,944 adding 'unitxt/catalog/cards/global_mmlu/so/professional_accounting.json' 2026-05-27T11:54:03,945 adding 'unitxt/catalog/cards/global_mmlu/so/professional_law.json' 2026-05-27T11:54:03,947 adding 'unitxt/catalog/cards/global_mmlu/so/professional_medicine.json' 2026-05-27T11:54:03,948 adding 'unitxt/catalog/cards/global_mmlu/so/professional_psychology.json' 2026-05-27T11:54:03,950 adding 'unitxt/catalog/cards/global_mmlu/so/public_relations.json' 2026-05-27T11:54:03,951 adding 'unitxt/catalog/cards/global_mmlu/so/security_studies.json' 2026-05-27T11:54:03,952 adding 'unitxt/catalog/cards/global_mmlu/so/sociology.json' 2026-05-27T11:54:03,954 adding 'unitxt/catalog/cards/global_mmlu/so/us_foreign_policy.json' 2026-05-27T11:54:03,955 adding 'unitxt/catalog/cards/global_mmlu/so/virology.json' 2026-05-27T11:54:03,957 adding 'unitxt/catalog/cards/global_mmlu/so/world_religions.json' 2026-05-27T11:54:03,959 adding 'unitxt/catalog/cards/global_mmlu/sr/abstract_algebra.json' 2026-05-27T11:54:03,961 adding 'unitxt/catalog/cards/global_mmlu/sr/anatomy.json' 2026-05-27T11:54:03,962 adding 'unitxt/catalog/cards/global_mmlu/sr/astronomy.json' 2026-05-27T11:54:03,964 adding 'unitxt/catalog/cards/global_mmlu/sr/business_ethics.json' 2026-05-27T11:54:03,965 adding 'unitxt/catalog/cards/global_mmlu/sr/clinical_knowledge.json' 2026-05-27T11:54:03,967 adding 'unitxt/catalog/cards/global_mmlu/sr/college_biology.json' 2026-05-27T11:54:03,968 adding 'unitxt/catalog/cards/global_mmlu/sr/college_chemistry.json' 2026-05-27T11:54:03,970 adding 'unitxt/catalog/cards/global_mmlu/sr/college_computer_science.json' 2026-05-27T11:54:03,971 adding 'unitxt/catalog/cards/global_mmlu/sr/college_mathematics.json' 2026-05-27T11:54:03,972 adding 'unitxt/catalog/cards/global_mmlu/sr/college_medicine.json' 2026-05-27T11:54:03,973 adding 'unitxt/catalog/cards/global_mmlu/sr/college_physics.json' 2026-05-27T11:54:03,974 adding 'unitxt/catalog/cards/global_mmlu/sr/computer_security.json' 2026-05-27T11:54:03,976 adding 'unitxt/catalog/cards/global_mmlu/sr/conceptual_physics.json' 2026-05-27T11:54:03,977 adding 'unitxt/catalog/cards/global_mmlu/sr/econometrics.json' 2026-05-27T11:54:03,978 adding 'unitxt/catalog/cards/global_mmlu/sr/electrical_engineering.json' 2026-05-27T11:54:03,980 adding 'unitxt/catalog/cards/global_mmlu/sr/elementary_mathematics.json' 2026-05-27T11:54:03,981 adding 'unitxt/catalog/cards/global_mmlu/sr/formal_logic.json' 2026-05-27T11:54:03,982 adding 'unitxt/catalog/cards/global_mmlu/sr/global_facts.json' 2026-05-27T11:54:03,983 adding 'unitxt/catalog/cards/global_mmlu/sr/high_school_biology.json' 2026-05-27T11:54:03,985 adding 'unitxt/catalog/cards/global_mmlu/sr/high_school_chemistry.json' 2026-05-27T11:54:03,986 adding 'unitxt/catalog/cards/global_mmlu/sr/high_school_computer_science.json' 2026-05-27T11:54:03,988 adding 'unitxt/catalog/cards/global_mmlu/sr/high_school_european_history.json' 2026-05-27T11:54:03,989 adding 'unitxt/catalog/cards/global_mmlu/sr/high_school_geography.json' 2026-05-27T11:54:03,990 adding 'unitxt/catalog/cards/global_mmlu/sr/high_school_government_and_politics.json' 2026-05-27T11:54:03,991 adding 'unitxt/catalog/cards/global_mmlu/sr/high_school_macroeconomics.json' 2026-05-27T11:54:03,993 adding 'unitxt/catalog/cards/global_mmlu/sr/high_school_mathematics.json' 2026-05-27T11:54:03,994 adding 'unitxt/catalog/cards/global_mmlu/sr/high_school_microeconomics.json' 2026-05-27T11:54:03,995 adding 'unitxt/catalog/cards/global_mmlu/sr/high_school_physics.json' 2026-05-27T11:54:03,997 adding 'unitxt/catalog/cards/global_mmlu/sr/high_school_psychology.json' 2026-05-27T11:54:03,998 adding 'unitxt/catalog/cards/global_mmlu/sr/high_school_statistics.json' 2026-05-27T11:54:03,999 adding 'unitxt/catalog/cards/global_mmlu/sr/high_school_us_history.json' 2026-05-27T11:54:04,001 adding 'unitxt/catalog/cards/global_mmlu/sr/high_school_world_history.json' 2026-05-27T11:54:04,002 adding 'unitxt/catalog/cards/global_mmlu/sr/human_aging.json' 2026-05-27T11:54:04,003 adding 'unitxt/catalog/cards/global_mmlu/sr/human_sexuality.json' 2026-05-27T11:54:04,005 adding 'unitxt/catalog/cards/global_mmlu/sr/international_law.json' 2026-05-27T11:54:04,006 adding 'unitxt/catalog/cards/global_mmlu/sr/jurisprudence.json' 2026-05-27T11:54:04,007 adding 'unitxt/catalog/cards/global_mmlu/sr/logical_fallacies.json' 2026-05-27T11:54:04,009 adding 'unitxt/catalog/cards/global_mmlu/sr/machine_learning.json' 2026-05-27T11:54:04,010 adding 'unitxt/catalog/cards/global_mmlu/sr/management.json' 2026-05-27T11:54:04,011 adding 'unitxt/catalog/cards/global_mmlu/sr/marketing.json' 2026-05-27T11:54:04,013 adding 'unitxt/catalog/cards/global_mmlu/sr/medical_genetics.json' 2026-05-27T11:54:04,014 adding 'unitxt/catalog/cards/global_mmlu/sr/miscellaneous.json' 2026-05-27T11:54:04,015 adding 'unitxt/catalog/cards/global_mmlu/sr/moral_disputes.json' 2026-05-27T11:54:04,017 adding 'unitxt/catalog/cards/global_mmlu/sr/moral_scenarios.json' 2026-05-27T11:54:04,018 adding 'unitxt/catalog/cards/global_mmlu/sr/nutrition.json' 2026-05-27T11:54:04,020 adding 'unitxt/catalog/cards/global_mmlu/sr/philosophy.json' 2026-05-27T11:54:04,021 adding 'unitxt/catalog/cards/global_mmlu/sr/prehistory.json' 2026-05-27T11:54:04,022 adding 'unitxt/catalog/cards/global_mmlu/sr/professional_accounting.json' 2026-05-27T11:54:04,024 adding 'unitxt/catalog/cards/global_mmlu/sr/professional_law.json' 2026-05-27T11:54:04,025 adding 'unitxt/catalog/cards/global_mmlu/sr/professional_medicine.json' 2026-05-27T11:54:04,027 adding 'unitxt/catalog/cards/global_mmlu/sr/professional_psychology.json' 2026-05-27T11:54:04,028 adding 'unitxt/catalog/cards/global_mmlu/sr/public_relations.json' 2026-05-27T11:54:04,029 adding 'unitxt/catalog/cards/global_mmlu/sr/security_studies.json' 2026-05-27T11:54:04,030 adding 'unitxt/catalog/cards/global_mmlu/sr/sociology.json' 2026-05-27T11:54:04,031 adding 'unitxt/catalog/cards/global_mmlu/sr/us_foreign_policy.json' 2026-05-27T11:54:04,033 adding 'unitxt/catalog/cards/global_mmlu/sr/virology.json' 2026-05-27T11:54:04,034 adding 'unitxt/catalog/cards/global_mmlu/sr/world_religions.json' 2026-05-27T11:54:04,036 adding 'unitxt/catalog/cards/global_mmlu/sv/abstract_algebra.json' 2026-05-27T11:54:04,038 adding 'unitxt/catalog/cards/global_mmlu/sv/anatomy.json' 2026-05-27T11:54:04,039 adding 'unitxt/catalog/cards/global_mmlu/sv/astronomy.json' 2026-05-27T11:54:04,040 adding 'unitxt/catalog/cards/global_mmlu/sv/business_ethics.json' 2026-05-27T11:54:04,042 adding 'unitxt/catalog/cards/global_mmlu/sv/clinical_knowledge.json' 2026-05-27T11:54:04,043 adding 'unitxt/catalog/cards/global_mmlu/sv/college_biology.json' 2026-05-27T11:54:04,044 adding 'unitxt/catalog/cards/global_mmlu/sv/college_chemistry.json' 2026-05-27T11:54:04,046 adding 'unitxt/catalog/cards/global_mmlu/sv/college_computer_science.json' 2026-05-27T11:54:04,047 adding 'unitxt/catalog/cards/global_mmlu/sv/college_mathematics.json' 2026-05-27T11:54:04,049 adding 'unitxt/catalog/cards/global_mmlu/sv/college_medicine.json' 2026-05-27T11:54:04,050 adding 'unitxt/catalog/cards/global_mmlu/sv/college_physics.json' 2026-05-27T11:54:04,051 adding 'unitxt/catalog/cards/global_mmlu/sv/computer_security.json' 2026-05-27T11:54:04,052 adding 'unitxt/catalog/cards/global_mmlu/sv/conceptual_physics.json' 2026-05-27T11:54:04,054 adding 'unitxt/catalog/cards/global_mmlu/sv/econometrics.json' 2026-05-27T11:54:04,055 adding 'unitxt/catalog/cards/global_mmlu/sv/electrical_engineering.json' 2026-05-27T11:54:04,056 adding 'unitxt/catalog/cards/global_mmlu/sv/elementary_mathematics.json' 2026-05-27T11:54:04,058 adding 'unitxt/catalog/cards/global_mmlu/sv/formal_logic.json' 2026-05-27T11:54:04,059 adding 'unitxt/catalog/cards/global_mmlu/sv/global_facts.json' 2026-05-27T11:54:04,060 adding 'unitxt/catalog/cards/global_mmlu/sv/high_school_biology.json' 2026-05-27T11:54:04,062 adding 'unitxt/catalog/cards/global_mmlu/sv/high_school_chemistry.json' 2026-05-27T11:54:04,063 adding 'unitxt/catalog/cards/global_mmlu/sv/high_school_computer_science.json' 2026-05-27T11:54:04,064 adding 'unitxt/catalog/cards/global_mmlu/sv/high_school_european_history.json' 2026-05-27T11:54:04,066 adding 'unitxt/catalog/cards/global_mmlu/sv/high_school_geography.json' 2026-05-27T11:54:04,067 adding 'unitxt/catalog/cards/global_mmlu/sv/high_school_government_and_politics.json' 2026-05-27T11:54:04,068 adding 'unitxt/catalog/cards/global_mmlu/sv/high_school_macroeconomics.json' 2026-05-27T11:54:04,070 adding 'unitxt/catalog/cards/global_mmlu/sv/high_school_mathematics.json' 2026-05-27T11:54:04,071 adding 'unitxt/catalog/cards/global_mmlu/sv/high_school_microeconomics.json' 2026-05-27T11:54:04,072 adding 'unitxt/catalog/cards/global_mmlu/sv/high_school_physics.json' 2026-05-27T11:54:04,074 adding 'unitxt/catalog/cards/global_mmlu/sv/high_school_psychology.json' 2026-05-27T11:54:04,075 adding 'unitxt/catalog/cards/global_mmlu/sv/high_school_statistics.json' 2026-05-27T11:54:04,076 adding 'unitxt/catalog/cards/global_mmlu/sv/high_school_us_history.json' 2026-05-27T11:54:04,078 adding 'unitxt/catalog/cards/global_mmlu/sv/high_school_world_history.json' 2026-05-27T11:54:04,079 adding 'unitxt/catalog/cards/global_mmlu/sv/human_aging.json' 2026-05-27T11:54:04,081 adding 'unitxt/catalog/cards/global_mmlu/sv/human_sexuality.json' 2026-05-27T11:54:04,082 adding 'unitxt/catalog/cards/global_mmlu/sv/international_law.json' 2026-05-27T11:54:04,083 adding 'unitxt/catalog/cards/global_mmlu/sv/jurisprudence.json' 2026-05-27T11:54:04,085 adding 'unitxt/catalog/cards/global_mmlu/sv/logical_fallacies.json' 2026-05-27T11:54:04,086 adding 'unitxt/catalog/cards/global_mmlu/sv/machine_learning.json' 2026-05-27T11:54:04,087 adding 'unitxt/catalog/cards/global_mmlu/sv/management.json' 2026-05-27T11:54:04,088 adding 'unitxt/catalog/cards/global_mmlu/sv/marketing.json' 2026-05-27T11:54:04,090 adding 'unitxt/catalog/cards/global_mmlu/sv/medical_genetics.json' 2026-05-27T11:54:04,091 adding 'unitxt/catalog/cards/global_mmlu/sv/miscellaneous.json' 2026-05-27T11:54:04,092 adding 'unitxt/catalog/cards/global_mmlu/sv/moral_disputes.json' 2026-05-27T11:54:04,093 adding 'unitxt/catalog/cards/global_mmlu/sv/moral_scenarios.json' 2026-05-27T11:54:04,095 adding 'unitxt/catalog/cards/global_mmlu/sv/nutrition.json' 2026-05-27T11:54:04,096 adding 'unitxt/catalog/cards/global_mmlu/sv/philosophy.json' 2026-05-27T11:54:04,097 adding 'unitxt/catalog/cards/global_mmlu/sv/prehistory.json' 2026-05-27T11:54:04,099 adding 'unitxt/catalog/cards/global_mmlu/sv/professional_accounting.json' 2026-05-27T11:54:04,100 adding 'unitxt/catalog/cards/global_mmlu/sv/professional_law.json' 2026-05-27T11:54:04,101 adding 'unitxt/catalog/cards/global_mmlu/sv/professional_medicine.json' 2026-05-27T11:54:04,103 adding 'unitxt/catalog/cards/global_mmlu/sv/professional_psychology.json' 2026-05-27T11:54:04,104 adding 'unitxt/catalog/cards/global_mmlu/sv/public_relations.json' 2026-05-27T11:54:04,105 adding 'unitxt/catalog/cards/global_mmlu/sv/security_studies.json' 2026-05-27T11:54:04,107 adding 'unitxt/catalog/cards/global_mmlu/sv/sociology.json' 2026-05-27T11:54:04,108 adding 'unitxt/catalog/cards/global_mmlu/sv/us_foreign_policy.json' 2026-05-27T11:54:04,109 adding 'unitxt/catalog/cards/global_mmlu/sv/virology.json' 2026-05-27T11:54:04,111 adding 'unitxt/catalog/cards/global_mmlu/sv/world_religions.json' 2026-05-27T11:54:04,113 adding 'unitxt/catalog/cards/global_mmlu/sw/abstract_algebra.json' 2026-05-27T11:54:04,115 adding 'unitxt/catalog/cards/global_mmlu/sw/anatomy.json' 2026-05-27T11:54:04,116 adding 'unitxt/catalog/cards/global_mmlu/sw/astronomy.json' 2026-05-27T11:54:04,117 adding 'unitxt/catalog/cards/global_mmlu/sw/business_ethics.json' 2026-05-27T11:54:04,119 adding 'unitxt/catalog/cards/global_mmlu/sw/clinical_knowledge.json' 2026-05-27T11:54:04,120 adding 'unitxt/catalog/cards/global_mmlu/sw/college_biology.json' 2026-05-27T11:54:04,121 adding 'unitxt/catalog/cards/global_mmlu/sw/college_chemistry.json' 2026-05-27T11:54:04,123 adding 'unitxt/catalog/cards/global_mmlu/sw/college_computer_science.json' 2026-05-27T11:54:04,124 adding 'unitxt/catalog/cards/global_mmlu/sw/college_mathematics.json' 2026-05-27T11:54:04,125 adding 'unitxt/catalog/cards/global_mmlu/sw/college_medicine.json' 2026-05-27T11:54:04,127 adding 'unitxt/catalog/cards/global_mmlu/sw/college_physics.json' 2026-05-27T11:54:04,128 adding 'unitxt/catalog/cards/global_mmlu/sw/computer_security.json' 2026-05-27T11:54:04,129 adding 'unitxt/catalog/cards/global_mmlu/sw/conceptual_physics.json' 2026-05-27T11:54:04,131 adding 'unitxt/catalog/cards/global_mmlu/sw/econometrics.json' 2026-05-27T11:54:04,132 adding 'unitxt/catalog/cards/global_mmlu/sw/electrical_engineering.json' 2026-05-27T11:54:04,133 adding 'unitxt/catalog/cards/global_mmlu/sw/elementary_mathematics.json' 2026-05-27T11:54:04,135 adding 'unitxt/catalog/cards/global_mmlu/sw/formal_logic.json' 2026-05-27T11:54:04,136 adding 'unitxt/catalog/cards/global_mmlu/sw/global_facts.json' 2026-05-27T11:54:04,138 adding 'unitxt/catalog/cards/global_mmlu/sw/high_school_biology.json' 2026-05-27T11:54:04,139 adding 'unitxt/catalog/cards/global_mmlu/sw/high_school_chemistry.json' 2026-05-27T11:54:04,140 adding 'unitxt/catalog/cards/global_mmlu/sw/high_school_computer_science.json' 2026-05-27T11:54:04,142 adding 'unitxt/catalog/cards/global_mmlu/sw/high_school_european_history.json' 2026-05-27T11:54:04,143 adding 'unitxt/catalog/cards/global_mmlu/sw/high_school_geography.json' 2026-05-27T11:54:04,145 adding 'unitxt/catalog/cards/global_mmlu/sw/high_school_government_and_politics.json' 2026-05-27T11:54:04,146 adding 'unitxt/catalog/cards/global_mmlu/sw/high_school_macroeconomics.json' 2026-05-27T11:54:04,147 adding 'unitxt/catalog/cards/global_mmlu/sw/high_school_mathematics.json' 2026-05-27T11:54:04,149 adding 'unitxt/catalog/cards/global_mmlu/sw/high_school_microeconomics.json' 2026-05-27T11:54:04,150 adding 'unitxt/catalog/cards/global_mmlu/sw/high_school_physics.json' 2026-05-27T11:54:04,151 adding 'unitxt/catalog/cards/global_mmlu/sw/high_school_psychology.json' 2026-05-27T11:54:04,152 adding 'unitxt/catalog/cards/global_mmlu/sw/high_school_statistics.json' 2026-05-27T11:54:04,154 adding 'unitxt/catalog/cards/global_mmlu/sw/high_school_us_history.json' 2026-05-27T11:54:04,155 adding 'unitxt/catalog/cards/global_mmlu/sw/high_school_world_history.json' 2026-05-27T11:54:04,156 adding 'unitxt/catalog/cards/global_mmlu/sw/human_aging.json' 2026-05-27T11:54:04,158 adding 'unitxt/catalog/cards/global_mmlu/sw/human_sexuality.json' 2026-05-27T11:54:04,159 adding 'unitxt/catalog/cards/global_mmlu/sw/international_law.json' 2026-05-27T11:54:04,160 adding 'unitxt/catalog/cards/global_mmlu/sw/jurisprudence.json' 2026-05-27T11:54:04,162 adding 'unitxt/catalog/cards/global_mmlu/sw/logical_fallacies.json' 2026-05-27T11:54:04,163 adding 'unitxt/catalog/cards/global_mmlu/sw/machine_learning.json' 2026-05-27T11:54:04,164 adding 'unitxt/catalog/cards/global_mmlu/sw/management.json' 2026-05-27T11:54:04,165 adding 'unitxt/catalog/cards/global_mmlu/sw/marketing.json' 2026-05-27T11:54:04,167 adding 'unitxt/catalog/cards/global_mmlu/sw/medical_genetics.json' 2026-05-27T11:54:04,168 adding 'unitxt/catalog/cards/global_mmlu/sw/miscellaneous.json' 2026-05-27T11:54:04,169 adding 'unitxt/catalog/cards/global_mmlu/sw/moral_disputes.json' 2026-05-27T11:54:04,171 adding 'unitxt/catalog/cards/global_mmlu/sw/moral_scenarios.json' 2026-05-27T11:54:04,172 adding 'unitxt/catalog/cards/global_mmlu/sw/nutrition.json' 2026-05-27T11:54:04,173 adding 'unitxt/catalog/cards/global_mmlu/sw/philosophy.json' 2026-05-27T11:54:04,175 adding 'unitxt/catalog/cards/global_mmlu/sw/prehistory.json' 2026-05-27T11:54:04,176 adding 'unitxt/catalog/cards/global_mmlu/sw/professional_accounting.json' 2026-05-27T11:54:04,178 adding 'unitxt/catalog/cards/global_mmlu/sw/professional_law.json' 2026-05-27T11:54:04,179 adding 'unitxt/catalog/cards/global_mmlu/sw/professional_medicine.json' 2026-05-27T11:54:04,180 adding 'unitxt/catalog/cards/global_mmlu/sw/professional_psychology.json' 2026-05-27T11:54:04,182 adding 'unitxt/catalog/cards/global_mmlu/sw/public_relations.json' 2026-05-27T11:54:04,183 adding 'unitxt/catalog/cards/global_mmlu/sw/security_studies.json' 2026-05-27T11:54:04,184 adding 'unitxt/catalog/cards/global_mmlu/sw/sociology.json' 2026-05-27T11:54:04,186 adding 'unitxt/catalog/cards/global_mmlu/sw/us_foreign_policy.json' 2026-05-27T11:54:04,187 adding 'unitxt/catalog/cards/global_mmlu/sw/virology.json' 2026-05-27T11:54:04,188 adding 'unitxt/catalog/cards/global_mmlu/sw/world_religions.json' 2026-05-27T11:54:04,191 adding 'unitxt/catalog/cards/global_mmlu/te/abstract_algebra.json' 2026-05-27T11:54:04,193 adding 'unitxt/catalog/cards/global_mmlu/te/anatomy.json' 2026-05-27T11:54:04,194 adding 'unitxt/catalog/cards/global_mmlu/te/astronomy.json' 2026-05-27T11:54:04,195 adding 'unitxt/catalog/cards/global_mmlu/te/business_ethics.json' 2026-05-27T11:54:04,197 adding 'unitxt/catalog/cards/global_mmlu/te/clinical_knowledge.json' 2026-05-27T11:54:04,198 adding 'unitxt/catalog/cards/global_mmlu/te/college_biology.json' 2026-05-27T11:54:04,199 adding 'unitxt/catalog/cards/global_mmlu/te/college_chemistry.json' 2026-05-27T11:54:04,201 adding 'unitxt/catalog/cards/global_mmlu/te/college_computer_science.json' 2026-05-27T11:54:04,202 adding 'unitxt/catalog/cards/global_mmlu/te/college_mathematics.json' 2026-05-27T11:54:04,204 adding 'unitxt/catalog/cards/global_mmlu/te/college_medicine.json' 2026-05-27T11:54:04,205 adding 'unitxt/catalog/cards/global_mmlu/te/college_physics.json' 2026-05-27T11:54:04,206 adding 'unitxt/catalog/cards/global_mmlu/te/computer_security.json' 2026-05-27T11:54:04,207 adding 'unitxt/catalog/cards/global_mmlu/te/conceptual_physics.json' 2026-05-27T11:54:04,209 adding 'unitxt/catalog/cards/global_mmlu/te/econometrics.json' 2026-05-27T11:54:04,210 adding 'unitxt/catalog/cards/global_mmlu/te/electrical_engineering.json' 2026-05-27T11:54:04,211 adding 'unitxt/catalog/cards/global_mmlu/te/elementary_mathematics.json' 2026-05-27T11:54:04,212 adding 'unitxt/catalog/cards/global_mmlu/te/formal_logic.json' 2026-05-27T11:54:04,213 adding 'unitxt/catalog/cards/global_mmlu/te/global_facts.json' 2026-05-27T11:54:04,215 adding 'unitxt/catalog/cards/global_mmlu/te/high_school_biology.json' 2026-05-27T11:54:04,216 adding 'unitxt/catalog/cards/global_mmlu/te/high_school_chemistry.json' 2026-05-27T11:54:04,217 adding 'unitxt/catalog/cards/global_mmlu/te/high_school_computer_science.json' 2026-05-27T11:54:04,219 adding 'unitxt/catalog/cards/global_mmlu/te/high_school_european_history.json' 2026-05-27T11:54:04,220 adding 'unitxt/catalog/cards/global_mmlu/te/high_school_geography.json' 2026-05-27T11:54:04,221 adding 'unitxt/catalog/cards/global_mmlu/te/high_school_government_and_politics.json' 2026-05-27T11:54:04,223 adding 'unitxt/catalog/cards/global_mmlu/te/high_school_macroeconomics.json' 2026-05-27T11:54:04,224 adding 'unitxt/catalog/cards/global_mmlu/te/high_school_mathematics.json' 2026-05-27T11:54:04,225 adding 'unitxt/catalog/cards/global_mmlu/te/high_school_microeconomics.json' 2026-05-27T11:54:04,227 adding 'unitxt/catalog/cards/global_mmlu/te/high_school_physics.json' 2026-05-27T11:54:04,228 adding 'unitxt/catalog/cards/global_mmlu/te/high_school_psychology.json' 2026-05-27T11:54:04,229 adding 'unitxt/catalog/cards/global_mmlu/te/high_school_statistics.json' 2026-05-27T11:54:04,231 adding 'unitxt/catalog/cards/global_mmlu/te/high_school_us_history.json' 2026-05-27T11:54:04,232 adding 'unitxt/catalog/cards/global_mmlu/te/high_school_world_history.json' 2026-05-27T11:54:04,233 adding 'unitxt/catalog/cards/global_mmlu/te/human_aging.json' 2026-05-27T11:54:04,235 adding 'unitxt/catalog/cards/global_mmlu/te/human_sexuality.json' 2026-05-27T11:54:04,236 adding 'unitxt/catalog/cards/global_mmlu/te/international_law.json' 2026-05-27T11:54:04,237 adding 'unitxt/catalog/cards/global_mmlu/te/jurisprudence.json' 2026-05-27T11:54:04,239 adding 'unitxt/catalog/cards/global_mmlu/te/logical_fallacies.json' 2026-05-27T11:54:04,240 adding 'unitxt/catalog/cards/global_mmlu/te/machine_learning.json' 2026-05-27T11:54:04,241 adding 'unitxt/catalog/cards/global_mmlu/te/management.json' 2026-05-27T11:54:04,243 adding 'unitxt/catalog/cards/global_mmlu/te/marketing.json' 2026-05-27T11:54:04,244 adding 'unitxt/catalog/cards/global_mmlu/te/medical_genetics.json' 2026-05-27T11:54:04,245 adding 'unitxt/catalog/cards/global_mmlu/te/miscellaneous.json' 2026-05-27T11:54:04,247 adding 'unitxt/catalog/cards/global_mmlu/te/moral_disputes.json' 2026-05-27T11:54:04,248 adding 'unitxt/catalog/cards/global_mmlu/te/moral_scenarios.json' 2026-05-27T11:54:04,249 adding 'unitxt/catalog/cards/global_mmlu/te/nutrition.json' 2026-05-27T11:54:04,251 adding 'unitxt/catalog/cards/global_mmlu/te/philosophy.json' 2026-05-27T11:54:04,252 adding 'unitxt/catalog/cards/global_mmlu/te/prehistory.json' 2026-05-27T11:54:04,253 adding 'unitxt/catalog/cards/global_mmlu/te/professional_accounting.json' 2026-05-27T11:54:04,255 adding 'unitxt/catalog/cards/global_mmlu/te/professional_law.json' 2026-05-27T11:54:04,256 adding 'unitxt/catalog/cards/global_mmlu/te/professional_medicine.json' 2026-05-27T11:54:04,258 adding 'unitxt/catalog/cards/global_mmlu/te/professional_psychology.json' 2026-05-27T11:54:04,259 adding 'unitxt/catalog/cards/global_mmlu/te/public_relations.json' 2026-05-27T11:54:04,261 adding 'unitxt/catalog/cards/global_mmlu/te/security_studies.json' 2026-05-27T11:54:04,262 adding 'unitxt/catalog/cards/global_mmlu/te/sociology.json' 2026-05-27T11:54:04,263 adding 'unitxt/catalog/cards/global_mmlu/te/us_foreign_policy.json' 2026-05-27T11:54:04,264 adding 'unitxt/catalog/cards/global_mmlu/te/virology.json' 2026-05-27T11:54:04,266 adding 'unitxt/catalog/cards/global_mmlu/te/world_religions.json' 2026-05-27T11:54:04,268 adding 'unitxt/catalog/cards/global_mmlu/tr/abstract_algebra.json' 2026-05-27T11:54:04,270 adding 'unitxt/catalog/cards/global_mmlu/tr/anatomy.json' 2026-05-27T11:54:04,271 adding 'unitxt/catalog/cards/global_mmlu/tr/astronomy.json' 2026-05-27T11:54:04,272 adding 'unitxt/catalog/cards/global_mmlu/tr/business_ethics.json' 2026-05-27T11:54:04,273 adding 'unitxt/catalog/cards/global_mmlu/tr/clinical_knowledge.json' 2026-05-27T11:54:04,275 adding 'unitxt/catalog/cards/global_mmlu/tr/college_biology.json' 2026-05-27T11:54:04,276 adding 'unitxt/catalog/cards/global_mmlu/tr/college_chemistry.json' 2026-05-27T11:54:04,277 adding 'unitxt/catalog/cards/global_mmlu/tr/college_computer_science.json' 2026-05-27T11:54:04,279 adding 'unitxt/catalog/cards/global_mmlu/tr/college_mathematics.json' 2026-05-27T11:54:04,280 adding 'unitxt/catalog/cards/global_mmlu/tr/college_medicine.json' 2026-05-27T11:54:04,281 adding 'unitxt/catalog/cards/global_mmlu/tr/college_physics.json' 2026-05-27T11:54:04,283 adding 'unitxt/catalog/cards/global_mmlu/tr/computer_security.json' 2026-05-27T11:54:04,284 adding 'unitxt/catalog/cards/global_mmlu/tr/conceptual_physics.json' 2026-05-27T11:54:04,285 adding 'unitxt/catalog/cards/global_mmlu/tr/econometrics.json' 2026-05-27T11:54:04,287 adding 'unitxt/catalog/cards/global_mmlu/tr/electrical_engineering.json' 2026-05-27T11:54:04,288 adding 'unitxt/catalog/cards/global_mmlu/tr/elementary_mathematics.json' 2026-05-27T11:54:04,289 adding 'unitxt/catalog/cards/global_mmlu/tr/formal_logic.json' 2026-05-27T11:54:04,291 adding 'unitxt/catalog/cards/global_mmlu/tr/global_facts.json' 2026-05-27T11:54:04,292 adding 'unitxt/catalog/cards/global_mmlu/tr/high_school_biology.json' 2026-05-27T11:54:04,293 adding 'unitxt/catalog/cards/global_mmlu/tr/high_school_chemistry.json' 2026-05-27T11:54:04,295 adding 'unitxt/catalog/cards/global_mmlu/tr/high_school_computer_science.json' 2026-05-27T11:54:04,296 adding 'unitxt/catalog/cards/global_mmlu/tr/high_school_european_history.json' 2026-05-27T11:54:04,297 adding 'unitxt/catalog/cards/global_mmlu/tr/high_school_geography.json' 2026-05-27T11:54:04,299 adding 'unitxt/catalog/cards/global_mmlu/tr/high_school_government_and_politics.json' 2026-05-27T11:54:04,300 adding 'unitxt/catalog/cards/global_mmlu/tr/high_school_macroeconomics.json' 2026-05-27T11:54:04,301 adding 'unitxt/catalog/cards/global_mmlu/tr/high_school_mathematics.json' 2026-05-27T11:54:04,303 adding 'unitxt/catalog/cards/global_mmlu/tr/high_school_microeconomics.json' 2026-05-27T11:54:04,304 adding 'unitxt/catalog/cards/global_mmlu/tr/high_school_physics.json' 2026-05-27T11:54:04,305 adding 'unitxt/catalog/cards/global_mmlu/tr/high_school_psychology.json' 2026-05-27T11:54:04,307 adding 'unitxt/catalog/cards/global_mmlu/tr/high_school_statistics.json' 2026-05-27T11:54:04,308 adding 'unitxt/catalog/cards/global_mmlu/tr/high_school_us_history.json' 2026-05-27T11:54:04,309 adding 'unitxt/catalog/cards/global_mmlu/tr/high_school_world_history.json' 2026-05-27T11:54:04,311 adding 'unitxt/catalog/cards/global_mmlu/tr/human_aging.json' 2026-05-27T11:54:04,312 adding 'unitxt/catalog/cards/global_mmlu/tr/human_sexuality.json' 2026-05-27T11:54:04,314 adding 'unitxt/catalog/cards/global_mmlu/tr/international_law.json' 2026-05-27T11:54:04,315 adding 'unitxt/catalog/cards/global_mmlu/tr/jurisprudence.json' 2026-05-27T11:54:04,316 adding 'unitxt/catalog/cards/global_mmlu/tr/logical_fallacies.json' 2026-05-27T11:54:04,318 adding 'unitxt/catalog/cards/global_mmlu/tr/machine_learning.json' 2026-05-27T11:54:04,319 adding 'unitxt/catalog/cards/global_mmlu/tr/management.json' 2026-05-27T11:54:04,320 adding 'unitxt/catalog/cards/global_mmlu/tr/marketing.json' 2026-05-27T11:54:04,322 adding 'unitxt/catalog/cards/global_mmlu/tr/medical_genetics.json' 2026-05-27T11:54:04,323 adding 'unitxt/catalog/cards/global_mmlu/tr/miscellaneous.json' 2026-05-27T11:54:04,325 adding 'unitxt/catalog/cards/global_mmlu/tr/moral_disputes.json' 2026-05-27T11:54:04,326 adding 'unitxt/catalog/cards/global_mmlu/tr/moral_scenarios.json' 2026-05-27T11:54:04,327 adding 'unitxt/catalog/cards/global_mmlu/tr/nutrition.json' 2026-05-27T11:54:04,328 adding 'unitxt/catalog/cards/global_mmlu/tr/philosophy.json' 2026-05-27T11:54:04,329 adding 'unitxt/catalog/cards/global_mmlu/tr/prehistory.json' 2026-05-27T11:54:04,331 adding 'unitxt/catalog/cards/global_mmlu/tr/professional_accounting.json' 2026-05-27T11:54:04,332 adding 'unitxt/catalog/cards/global_mmlu/tr/professional_law.json' 2026-05-27T11:54:04,333 adding 'unitxt/catalog/cards/global_mmlu/tr/professional_medicine.json' 2026-05-27T11:54:04,335 adding 'unitxt/catalog/cards/global_mmlu/tr/professional_psychology.json' 2026-05-27T11:54:04,336 adding 'unitxt/catalog/cards/global_mmlu/tr/public_relations.json' 2026-05-27T11:54:04,338 adding 'unitxt/catalog/cards/global_mmlu/tr/security_studies.json' 2026-05-27T11:54:04,339 adding 'unitxt/catalog/cards/global_mmlu/tr/sociology.json' 2026-05-27T11:54:04,340 adding 'unitxt/catalog/cards/global_mmlu/tr/us_foreign_policy.json' 2026-05-27T11:54:04,341 adding 'unitxt/catalog/cards/global_mmlu/tr/virology.json' 2026-05-27T11:54:04,343 adding 'unitxt/catalog/cards/global_mmlu/tr/world_religions.json' 2026-05-27T11:54:04,345 adding 'unitxt/catalog/cards/global_mmlu/uk/abstract_algebra.json' 2026-05-27T11:54:04,347 adding 'unitxt/catalog/cards/global_mmlu/uk/anatomy.json' 2026-05-27T11:54:04,348 adding 'unitxt/catalog/cards/global_mmlu/uk/astronomy.json' 2026-05-27T11:54:04,349 adding 'unitxt/catalog/cards/global_mmlu/uk/business_ethics.json' 2026-05-27T11:54:04,351 adding 'unitxt/catalog/cards/global_mmlu/uk/clinical_knowledge.json' 2026-05-27T11:54:04,352 adding 'unitxt/catalog/cards/global_mmlu/uk/college_biology.json' 2026-05-27T11:54:04,353 adding 'unitxt/catalog/cards/global_mmlu/uk/college_chemistry.json' 2026-05-27T11:54:04,355 adding 'unitxt/catalog/cards/global_mmlu/uk/college_computer_science.json' 2026-05-27T11:54:04,356 adding 'unitxt/catalog/cards/global_mmlu/uk/college_mathematics.json' 2026-05-27T11:54:04,357 adding 'unitxt/catalog/cards/global_mmlu/uk/college_medicine.json' 2026-05-27T11:54:04,359 adding 'unitxt/catalog/cards/global_mmlu/uk/college_physics.json' 2026-05-27T11:54:04,360 adding 'unitxt/catalog/cards/global_mmlu/uk/computer_security.json' 2026-05-27T11:54:04,362 adding 'unitxt/catalog/cards/global_mmlu/uk/conceptual_physics.json' 2026-05-27T11:54:04,363 adding 'unitxt/catalog/cards/global_mmlu/uk/econometrics.json' 2026-05-27T11:54:04,364 adding 'unitxt/catalog/cards/global_mmlu/uk/electrical_engineering.json' 2026-05-27T11:54:04,366 adding 'unitxt/catalog/cards/global_mmlu/uk/elementary_mathematics.json' 2026-05-27T11:54:04,367 adding 'unitxt/catalog/cards/global_mmlu/uk/formal_logic.json' 2026-05-27T11:54:04,368 adding 'unitxt/catalog/cards/global_mmlu/uk/global_facts.json' 2026-05-27T11:54:04,370 adding 'unitxt/catalog/cards/global_mmlu/uk/high_school_biology.json' 2026-05-27T11:54:04,371 adding 'unitxt/catalog/cards/global_mmlu/uk/high_school_chemistry.json' 2026-05-27T11:54:04,372 adding 'unitxt/catalog/cards/global_mmlu/uk/high_school_computer_science.json' 2026-05-27T11:54:04,374 adding 'unitxt/catalog/cards/global_mmlu/uk/high_school_european_history.json' 2026-05-27T11:54:04,375 adding 'unitxt/catalog/cards/global_mmlu/uk/high_school_geography.json' 2026-05-27T11:54:04,376 adding 'unitxt/catalog/cards/global_mmlu/uk/high_school_government_and_politics.json' 2026-05-27T11:54:04,378 adding 'unitxt/catalog/cards/global_mmlu/uk/high_school_macroeconomics.json' 2026-05-27T11:54:04,379 adding 'unitxt/catalog/cards/global_mmlu/uk/high_school_mathematics.json' 2026-05-27T11:54:04,380 adding 'unitxt/catalog/cards/global_mmlu/uk/high_school_microeconomics.json' 2026-05-27T11:54:04,382 adding 'unitxt/catalog/cards/global_mmlu/uk/high_school_physics.json' 2026-05-27T11:54:04,383 adding 'unitxt/catalog/cards/global_mmlu/uk/high_school_psychology.json' 2026-05-27T11:54:04,384 adding 'unitxt/catalog/cards/global_mmlu/uk/high_school_statistics.json' 2026-05-27T11:54:04,386 adding 'unitxt/catalog/cards/global_mmlu/uk/high_school_us_history.json' 2026-05-27T11:54:04,387 adding 'unitxt/catalog/cards/global_mmlu/uk/high_school_world_history.json' 2026-05-27T11:54:04,388 adding 'unitxt/catalog/cards/global_mmlu/uk/human_aging.json' 2026-05-27T11:54:04,389 adding 'unitxt/catalog/cards/global_mmlu/uk/human_sexuality.json' 2026-05-27T11:54:04,391 adding 'unitxt/catalog/cards/global_mmlu/uk/international_law.json' 2026-05-27T11:54:04,392 adding 'unitxt/catalog/cards/global_mmlu/uk/jurisprudence.json' 2026-05-27T11:54:04,393 adding 'unitxt/catalog/cards/global_mmlu/uk/logical_fallacies.json' 2026-05-27T11:54:04,395 adding 'unitxt/catalog/cards/global_mmlu/uk/machine_learning.json' 2026-05-27T11:54:04,396 adding 'unitxt/catalog/cards/global_mmlu/uk/management.json' 2026-05-27T11:54:04,397 adding 'unitxt/catalog/cards/global_mmlu/uk/marketing.json' 2026-05-27T11:54:04,399 adding 'unitxt/catalog/cards/global_mmlu/uk/medical_genetics.json' 2026-05-27T11:54:04,400 adding 'unitxt/catalog/cards/global_mmlu/uk/miscellaneous.json' 2026-05-27T11:54:04,401 adding 'unitxt/catalog/cards/global_mmlu/uk/moral_disputes.json' 2026-05-27T11:54:04,403 adding 'unitxt/catalog/cards/global_mmlu/uk/moral_scenarios.json' 2026-05-27T11:54:04,404 adding 'unitxt/catalog/cards/global_mmlu/uk/nutrition.json' 2026-05-27T11:54:04,405 adding 'unitxt/catalog/cards/global_mmlu/uk/philosophy.json' 2026-05-27T11:54:04,407 adding 'unitxt/catalog/cards/global_mmlu/uk/prehistory.json' 2026-05-27T11:54:04,408 adding 'unitxt/catalog/cards/global_mmlu/uk/professional_accounting.json' 2026-05-27T11:54:04,409 adding 'unitxt/catalog/cards/global_mmlu/uk/professional_law.json' 2026-05-27T11:54:04,411 adding 'unitxt/catalog/cards/global_mmlu/uk/professional_medicine.json' 2026-05-27T11:54:04,412 adding 'unitxt/catalog/cards/global_mmlu/uk/professional_psychology.json' 2026-05-27T11:54:04,413 adding 'unitxt/catalog/cards/global_mmlu/uk/public_relations.json' 2026-05-27T11:54:04,415 adding 'unitxt/catalog/cards/global_mmlu/uk/security_studies.json' 2026-05-27T11:54:04,416 adding 'unitxt/catalog/cards/global_mmlu/uk/sociology.json' 2026-05-27T11:54:04,417 adding 'unitxt/catalog/cards/global_mmlu/uk/us_foreign_policy.json' 2026-05-27T11:54:04,419 adding 'unitxt/catalog/cards/global_mmlu/uk/virology.json' 2026-05-27T11:54:04,420 adding 'unitxt/catalog/cards/global_mmlu/uk/world_religions.json' 2026-05-27T11:54:04,423 adding 'unitxt/catalog/cards/global_mmlu/vi/abstract_algebra.json' 2026-05-27T11:54:04,424 adding 'unitxt/catalog/cards/global_mmlu/vi/anatomy.json' 2026-05-27T11:54:04,425 adding 'unitxt/catalog/cards/global_mmlu/vi/astronomy.json' 2026-05-27T11:54:04,427 adding 'unitxt/catalog/cards/global_mmlu/vi/business_ethics.json' 2026-05-27T11:54:04,428 adding 'unitxt/catalog/cards/global_mmlu/vi/clinical_knowledge.json' 2026-05-27T11:54:04,430 adding 'unitxt/catalog/cards/global_mmlu/vi/college_biology.json' 2026-05-27T11:54:04,431 adding 'unitxt/catalog/cards/global_mmlu/vi/college_chemistry.json' 2026-05-27T11:54:04,432 adding 'unitxt/catalog/cards/global_mmlu/vi/college_computer_science.json' 2026-05-27T11:54:04,434 adding 'unitxt/catalog/cards/global_mmlu/vi/college_mathematics.json' 2026-05-27T11:54:04,435 adding 'unitxt/catalog/cards/global_mmlu/vi/college_medicine.json' 2026-05-27T11:54:04,437 adding 'unitxt/catalog/cards/global_mmlu/vi/college_physics.json' 2026-05-27T11:54:04,438 adding 'unitxt/catalog/cards/global_mmlu/vi/computer_security.json' 2026-05-27T11:54:04,439 adding 'unitxt/catalog/cards/global_mmlu/vi/conceptual_physics.json' 2026-05-27T11:54:04,441 adding 'unitxt/catalog/cards/global_mmlu/vi/econometrics.json' 2026-05-27T11:54:04,442 adding 'unitxt/catalog/cards/global_mmlu/vi/electrical_engineering.json' 2026-05-27T11:54:04,443 adding 'unitxt/catalog/cards/global_mmlu/vi/elementary_mathematics.json' 2026-05-27T11:54:04,444 adding 'unitxt/catalog/cards/global_mmlu/vi/formal_logic.json' 2026-05-27T11:54:04,446 adding 'unitxt/catalog/cards/global_mmlu/vi/global_facts.json' 2026-05-27T11:54:04,447 adding 'unitxt/catalog/cards/global_mmlu/vi/high_school_biology.json' 2026-05-27T11:54:04,448 adding 'unitxt/catalog/cards/global_mmlu/vi/high_school_chemistry.json' 2026-05-27T11:54:04,450 adding 'unitxt/catalog/cards/global_mmlu/vi/high_school_computer_science.json' 2026-05-27T11:54:04,451 adding 'unitxt/catalog/cards/global_mmlu/vi/high_school_european_history.json' 2026-05-27T11:54:04,452 adding 'unitxt/catalog/cards/global_mmlu/vi/high_school_geography.json' 2026-05-27T11:54:04,454 adding 'unitxt/catalog/cards/global_mmlu/vi/high_school_government_and_politics.json' 2026-05-27T11:54:04,455 adding 'unitxt/catalog/cards/global_mmlu/vi/high_school_macroeconomics.json' 2026-05-27T11:54:04,456 adding 'unitxt/catalog/cards/global_mmlu/vi/high_school_mathematics.json' 2026-05-27T11:54:04,458 adding 'unitxt/catalog/cards/global_mmlu/vi/high_school_microeconomics.json' 2026-05-27T11:54:04,459 adding 'unitxt/catalog/cards/global_mmlu/vi/high_school_physics.json' 2026-05-27T11:54:04,460 adding 'unitxt/catalog/cards/global_mmlu/vi/high_school_psychology.json' 2026-05-27T11:54:04,462 adding 'unitxt/catalog/cards/global_mmlu/vi/high_school_statistics.json' 2026-05-27T11:54:04,463 adding 'unitxt/catalog/cards/global_mmlu/vi/high_school_us_history.json' 2026-05-27T11:54:04,464 adding 'unitxt/catalog/cards/global_mmlu/vi/high_school_world_history.json' 2026-05-27T11:54:04,465 adding 'unitxt/catalog/cards/global_mmlu/vi/human_aging.json' 2026-05-27T11:54:04,467 adding 'unitxt/catalog/cards/global_mmlu/vi/human_sexuality.json' 2026-05-27T11:54:04,468 adding 'unitxt/catalog/cards/global_mmlu/vi/international_law.json' 2026-05-27T11:54:04,469 adding 'unitxt/catalog/cards/global_mmlu/vi/jurisprudence.json' 2026-05-27T11:54:04,471 adding 'unitxt/catalog/cards/global_mmlu/vi/logical_fallacies.json' 2026-05-27T11:54:04,472 adding 'unitxt/catalog/cards/global_mmlu/vi/machine_learning.json' 2026-05-27T11:54:04,473 adding 'unitxt/catalog/cards/global_mmlu/vi/management.json' 2026-05-27T11:54:04,475 adding 'unitxt/catalog/cards/global_mmlu/vi/marketing.json' 2026-05-27T11:54:04,476 adding 'unitxt/catalog/cards/global_mmlu/vi/medical_genetics.json' 2026-05-27T11:54:04,478 adding 'unitxt/catalog/cards/global_mmlu/vi/miscellaneous.json' 2026-05-27T11:54:04,479 adding 'unitxt/catalog/cards/global_mmlu/vi/moral_disputes.json' 2026-05-27T11:54:04,480 adding 'unitxt/catalog/cards/global_mmlu/vi/moral_scenarios.json' 2026-05-27T11:54:04,482 adding 'unitxt/catalog/cards/global_mmlu/vi/nutrition.json' 2026-05-27T11:54:04,483 adding 'unitxt/catalog/cards/global_mmlu/vi/philosophy.json' 2026-05-27T11:54:04,484 adding 'unitxt/catalog/cards/global_mmlu/vi/prehistory.json' 2026-05-27T11:54:04,486 adding 'unitxt/catalog/cards/global_mmlu/vi/professional_accounting.json' 2026-05-27T11:54:04,487 adding 'unitxt/catalog/cards/global_mmlu/vi/professional_law.json' 2026-05-27T11:54:04,488 adding 'unitxt/catalog/cards/global_mmlu/vi/professional_medicine.json' 2026-05-27T11:54:04,490 adding 'unitxt/catalog/cards/global_mmlu/vi/professional_psychology.json' 2026-05-27T11:54:04,491 adding 'unitxt/catalog/cards/global_mmlu/vi/public_relations.json' 2026-05-27T11:54:04,492 adding 'unitxt/catalog/cards/global_mmlu/vi/security_studies.json' 2026-05-27T11:54:04,494 adding 'unitxt/catalog/cards/global_mmlu/vi/sociology.json' 2026-05-27T11:54:04,495 adding 'unitxt/catalog/cards/global_mmlu/vi/us_foreign_policy.json' 2026-05-27T11:54:04,498 adding 'unitxt/catalog/cards/global_mmlu/vi/virology.json' 2026-05-27T11:54:04,499 adding 'unitxt/catalog/cards/global_mmlu/vi/world_religions.json' 2026-05-27T11:54:04,501 adding 'unitxt/catalog/cards/global_mmlu/yo/abstract_algebra.json' 2026-05-27T11:54:04,503 adding 'unitxt/catalog/cards/global_mmlu/yo/anatomy.json' 2026-05-27T11:54:04,504 adding 'unitxt/catalog/cards/global_mmlu/yo/astronomy.json' 2026-05-27T11:54:04,505 adding 'unitxt/catalog/cards/global_mmlu/yo/business_ethics.json' 2026-05-27T11:54:04,506 adding 'unitxt/catalog/cards/global_mmlu/yo/clinical_knowledge.json' 2026-05-27T11:54:04,508 adding 'unitxt/catalog/cards/global_mmlu/yo/college_biology.json' 2026-05-27T11:54:04,509 adding 'unitxt/catalog/cards/global_mmlu/yo/college_chemistry.json' 2026-05-27T11:54:04,510 adding 'unitxt/catalog/cards/global_mmlu/yo/college_computer_science.json' 2026-05-27T11:54:04,512 adding 'unitxt/catalog/cards/global_mmlu/yo/college_mathematics.json' 2026-05-27T11:54:04,513 adding 'unitxt/catalog/cards/global_mmlu/yo/college_medicine.json' 2026-05-27T11:54:04,514 adding 'unitxt/catalog/cards/global_mmlu/yo/college_physics.json' 2026-05-27T11:54:04,516 adding 'unitxt/catalog/cards/global_mmlu/yo/computer_security.json' 2026-05-27T11:54:04,517 adding 'unitxt/catalog/cards/global_mmlu/yo/conceptual_physics.json' 2026-05-27T11:54:04,518 adding 'unitxt/catalog/cards/global_mmlu/yo/econometrics.json' 2026-05-27T11:54:04,520 adding 'unitxt/catalog/cards/global_mmlu/yo/electrical_engineering.json' 2026-05-27T11:54:04,521 adding 'unitxt/catalog/cards/global_mmlu/yo/elementary_mathematics.json' 2026-05-27T11:54:04,522 adding 'unitxt/catalog/cards/global_mmlu/yo/formal_logic.json' 2026-05-27T11:54:04,524 adding 'unitxt/catalog/cards/global_mmlu/yo/global_facts.json' 2026-05-27T11:54:04,525 adding 'unitxt/catalog/cards/global_mmlu/yo/high_school_biology.json' 2026-05-27T11:54:04,526 adding 'unitxt/catalog/cards/global_mmlu/yo/high_school_chemistry.json' 2026-05-27T11:54:04,528 adding 'unitxt/catalog/cards/global_mmlu/yo/high_school_computer_science.json' 2026-05-27T11:54:04,529 adding 'unitxt/catalog/cards/global_mmlu/yo/high_school_european_history.json' 2026-05-27T11:54:04,530 adding 'unitxt/catalog/cards/global_mmlu/yo/high_school_geography.json' 2026-05-27T11:54:04,532 adding 'unitxt/catalog/cards/global_mmlu/yo/high_school_government_and_politics.json' 2026-05-27T11:54:04,533 adding 'unitxt/catalog/cards/global_mmlu/yo/high_school_macroeconomics.json' 2026-05-27T11:54:04,534 adding 'unitxt/catalog/cards/global_mmlu/yo/high_school_mathematics.json' 2026-05-27T11:54:04,536 adding 'unitxt/catalog/cards/global_mmlu/yo/high_school_microeconomics.json' 2026-05-27T11:54:04,537 adding 'unitxt/catalog/cards/global_mmlu/yo/high_school_physics.json' 2026-05-27T11:54:04,539 adding 'unitxt/catalog/cards/global_mmlu/yo/high_school_psychology.json' 2026-05-27T11:54:04,540 adding 'unitxt/catalog/cards/global_mmlu/yo/high_school_statistics.json' 2026-05-27T11:54:04,541 adding 'unitxt/catalog/cards/global_mmlu/yo/high_school_us_history.json' 2026-05-27T11:54:04,543 adding 'unitxt/catalog/cards/global_mmlu/yo/high_school_world_history.json' 2026-05-27T11:54:04,544 adding 'unitxt/catalog/cards/global_mmlu/yo/human_aging.json' 2026-05-27T11:54:04,545 adding 'unitxt/catalog/cards/global_mmlu/yo/human_sexuality.json' 2026-05-27T11:54:04,547 adding 'unitxt/catalog/cards/global_mmlu/yo/international_law.json' 2026-05-27T11:54:04,548 adding 'unitxt/catalog/cards/global_mmlu/yo/jurisprudence.json' 2026-05-27T11:54:04,550 adding 'unitxt/catalog/cards/global_mmlu/yo/logical_fallacies.json' 2026-05-27T11:54:04,551 adding 'unitxt/catalog/cards/global_mmlu/yo/machine_learning.json' 2026-05-27T11:54:04,552 adding 'unitxt/catalog/cards/global_mmlu/yo/management.json' 2026-05-27T11:54:04,554 adding 'unitxt/catalog/cards/global_mmlu/yo/marketing.json' 2026-05-27T11:54:04,555 adding 'unitxt/catalog/cards/global_mmlu/yo/medical_genetics.json' 2026-05-27T11:54:04,557 adding 'unitxt/catalog/cards/global_mmlu/yo/miscellaneous.json' 2026-05-27T11:54:04,558 adding 'unitxt/catalog/cards/global_mmlu/yo/moral_disputes.json' 2026-05-27T11:54:04,559 adding 'unitxt/catalog/cards/global_mmlu/yo/moral_scenarios.json' 2026-05-27T11:54:04,561 adding 'unitxt/catalog/cards/global_mmlu/yo/nutrition.json' 2026-05-27T11:54:04,562 adding 'unitxt/catalog/cards/global_mmlu/yo/philosophy.json' 2026-05-27T11:54:04,564 adding 'unitxt/catalog/cards/global_mmlu/yo/prehistory.json' 2026-05-27T11:54:04,565 adding 'unitxt/catalog/cards/global_mmlu/yo/professional_accounting.json' 2026-05-27T11:54:04,567 adding 'unitxt/catalog/cards/global_mmlu/yo/professional_law.json' 2026-05-27T11:54:04,568 adding 'unitxt/catalog/cards/global_mmlu/yo/professional_medicine.json' 2026-05-27T11:54:04,570 adding 'unitxt/catalog/cards/global_mmlu/yo/professional_psychology.json' 2026-05-27T11:54:04,571 adding 'unitxt/catalog/cards/global_mmlu/yo/public_relations.json' 2026-05-27T11:54:04,572 adding 'unitxt/catalog/cards/global_mmlu/yo/security_studies.json' 2026-05-27T11:54:04,574 adding 'unitxt/catalog/cards/global_mmlu/yo/sociology.json' 2026-05-27T11:54:04,575 adding 'unitxt/catalog/cards/global_mmlu/yo/us_foreign_policy.json' 2026-05-27T11:54:04,577 adding 'unitxt/catalog/cards/global_mmlu/yo/virology.json' 2026-05-27T11:54:04,578 adding 'unitxt/catalog/cards/global_mmlu/yo/world_religions.json' 2026-05-27T11:54:04,581 adding 'unitxt/catalog/cards/global_mmlu/zh/abstract_algebra.json' 2026-05-27T11:54:04,582 adding 'unitxt/catalog/cards/global_mmlu/zh/anatomy.json' 2026-05-27T11:54:04,583 adding 'unitxt/catalog/cards/global_mmlu/zh/astronomy.json' 2026-05-27T11:54:04,585 adding 'unitxt/catalog/cards/global_mmlu/zh/business_ethics.json' 2026-05-27T11:54:04,586 adding 'unitxt/catalog/cards/global_mmlu/zh/clinical_knowledge.json' 2026-05-27T11:54:04,588 adding 'unitxt/catalog/cards/global_mmlu/zh/college_biology.json' 2026-05-27T11:54:04,589 adding 'unitxt/catalog/cards/global_mmlu/zh/college_chemistry.json' 2026-05-27T11:54:04,590 adding 'unitxt/catalog/cards/global_mmlu/zh/college_computer_science.json' 2026-05-27T11:54:04,592 adding 'unitxt/catalog/cards/global_mmlu/zh/college_mathematics.json' 2026-05-27T11:54:04,593 adding 'unitxt/catalog/cards/global_mmlu/zh/college_medicine.json' 2026-05-27T11:54:04,594 adding 'unitxt/catalog/cards/global_mmlu/zh/college_physics.json' 2026-05-27T11:54:04,596 adding 'unitxt/catalog/cards/global_mmlu/zh/computer_security.json' 2026-05-27T11:54:04,597 adding 'unitxt/catalog/cards/global_mmlu/zh/conceptual_physics.json' 2026-05-27T11:54:04,599 adding 'unitxt/catalog/cards/global_mmlu/zh/econometrics.json' 2026-05-27T11:54:04,600 adding 'unitxt/catalog/cards/global_mmlu/zh/electrical_engineering.json' 2026-05-27T11:54:04,601 adding 'unitxt/catalog/cards/global_mmlu/zh/elementary_mathematics.json' 2026-05-27T11:54:04,603 adding 'unitxt/catalog/cards/global_mmlu/zh/formal_logic.json' 2026-05-27T11:54:04,604 adding 'unitxt/catalog/cards/global_mmlu/zh/global_facts.json' 2026-05-27T11:54:04,605 adding 'unitxt/catalog/cards/global_mmlu/zh/high_school_biology.json' 2026-05-27T11:54:04,607 adding 'unitxt/catalog/cards/global_mmlu/zh/high_school_chemistry.json' 2026-05-27T11:54:04,608 adding 'unitxt/catalog/cards/global_mmlu/zh/high_school_computer_science.json' 2026-05-27T11:54:04,609 adding 'unitxt/catalog/cards/global_mmlu/zh/high_school_european_history.json' 2026-05-27T11:54:04,611 adding 'unitxt/catalog/cards/global_mmlu/zh/high_school_geography.json' 2026-05-27T11:54:04,612 adding 'unitxt/catalog/cards/global_mmlu/zh/high_school_government_and_politics.json' 2026-05-27T11:54:04,614 adding 'unitxt/catalog/cards/global_mmlu/zh/high_school_macroeconomics.json' 2026-05-27T11:54:04,615 adding 'unitxt/catalog/cards/global_mmlu/zh/high_school_mathematics.json' 2026-05-27T11:54:04,617 adding 'unitxt/catalog/cards/global_mmlu/zh/high_school_microeconomics.json' 2026-05-27T11:54:04,618 adding 'unitxt/catalog/cards/global_mmlu/zh/high_school_physics.json' 2026-05-27T11:54:04,619 adding 'unitxt/catalog/cards/global_mmlu/zh/high_school_psychology.json' 2026-05-27T11:54:04,621 adding 'unitxt/catalog/cards/global_mmlu/zh/high_school_statistics.json' 2026-05-27T11:54:04,622 adding 'unitxt/catalog/cards/global_mmlu/zh/high_school_us_history.json' 2026-05-27T11:54:04,623 adding 'unitxt/catalog/cards/global_mmlu/zh/high_school_world_history.json' 2026-05-27T11:54:04,624 adding 'unitxt/catalog/cards/global_mmlu/zh/human_aging.json' 2026-05-27T11:54:04,626 adding 'unitxt/catalog/cards/global_mmlu/zh/human_sexuality.json' 2026-05-27T11:54:04,627 adding 'unitxt/catalog/cards/global_mmlu/zh/international_law.json' 2026-05-27T11:54:04,629 adding 'unitxt/catalog/cards/global_mmlu/zh/jurisprudence.json' 2026-05-27T11:54:04,630 adding 'unitxt/catalog/cards/global_mmlu/zh/logical_fallacies.json' 2026-05-27T11:54:04,631 adding 'unitxt/catalog/cards/global_mmlu/zh/machine_learning.json' 2026-05-27T11:54:04,632 adding 'unitxt/catalog/cards/global_mmlu/zh/management.json' 2026-05-27T11:54:04,634 adding 'unitxt/catalog/cards/global_mmlu/zh/marketing.json' 2026-05-27T11:54:04,635 adding 'unitxt/catalog/cards/global_mmlu/zh/medical_genetics.json' 2026-05-27T11:54:04,637 adding 'unitxt/catalog/cards/global_mmlu/zh/miscellaneous.json' 2026-05-27T11:54:04,638 adding 'unitxt/catalog/cards/global_mmlu/zh/moral_disputes.json' 2026-05-27T11:54:04,639 adding 'unitxt/catalog/cards/global_mmlu/zh/moral_scenarios.json' 2026-05-27T11:54:04,640 adding 'unitxt/catalog/cards/global_mmlu/zh/nutrition.json' 2026-05-27T11:54:04,642 adding 'unitxt/catalog/cards/global_mmlu/zh/philosophy.json' 2026-05-27T11:54:04,643 adding 'unitxt/catalog/cards/global_mmlu/zh/prehistory.json' 2026-05-27T11:54:04,644 adding 'unitxt/catalog/cards/global_mmlu/zh/professional_accounting.json' 2026-05-27T11:54:04,646 adding 'unitxt/catalog/cards/global_mmlu/zh/professional_law.json' 2026-05-27T11:54:04,647 adding 'unitxt/catalog/cards/global_mmlu/zh/professional_medicine.json' 2026-05-27T11:54:04,648 adding 'unitxt/catalog/cards/global_mmlu/zh/professional_psychology.json' 2026-05-27T11:54:04,650 adding 'unitxt/catalog/cards/global_mmlu/zh/public_relations.json' 2026-05-27T11:54:04,651 adding 'unitxt/catalog/cards/global_mmlu/zh/security_studies.json' 2026-05-27T11:54:04,652 adding 'unitxt/catalog/cards/global_mmlu/zh/sociology.json' 2026-05-27T11:54:04,654 adding 'unitxt/catalog/cards/global_mmlu/zh/us_foreign_policy.json' 2026-05-27T11:54:04,655 adding 'unitxt/catalog/cards/global_mmlu/zh/virology.json' 2026-05-27T11:54:04,656 adding 'unitxt/catalog/cards/global_mmlu/zh/world_religions.json' 2026-05-27T11:54:04,659 adding 'unitxt/catalog/cards/global_mmlu_lite_ca/ar.json' 2026-05-27T11:54:04,660 adding 'unitxt/catalog/cards/global_mmlu_lite_ca/bn.json' 2026-05-27T11:54:04,662 adding 'unitxt/catalog/cards/global_mmlu_lite_ca/de.json' 2026-05-27T11:54:04,663 adding 'unitxt/catalog/cards/global_mmlu_lite_ca/es.json' 2026-05-27T11:54:04,665 adding 'unitxt/catalog/cards/global_mmlu_lite_ca/fr.json' 2026-05-27T11:54:04,667 adding 'unitxt/catalog/cards/global_mmlu_lite_ca/hi.json' 2026-05-27T11:54:04,668 adding 'unitxt/catalog/cards/global_mmlu_lite_ca/id.json' 2026-05-27T11:54:04,670 adding 'unitxt/catalog/cards/global_mmlu_lite_ca/it.json' 2026-05-27T11:54:04,671 adding 'unitxt/catalog/cards/global_mmlu_lite_ca/ja.json' 2026-05-27T11:54:04,673 adding 'unitxt/catalog/cards/global_mmlu_lite_ca/ko.json' 2026-05-27T11:54:04,675 adding 'unitxt/catalog/cards/global_mmlu_lite_ca/pt.json' 2026-05-27T11:54:04,676 adding 'unitxt/catalog/cards/global_mmlu_lite_ca/sw.json' 2026-05-27T11:54:04,678 adding 'unitxt/catalog/cards/global_mmlu_lite_ca/yo.json' 2026-05-27T11:54:04,679 adding 'unitxt/catalog/cards/global_mmlu_lite_ca/zh.json' 2026-05-27T11:54:04,682 adding 'unitxt/catalog/cards/global_mmlu_lite_cs/ar.json' 2026-05-27T11:54:04,683 adding 'unitxt/catalog/cards/global_mmlu_lite_cs/bn.json' 2026-05-27T11:54:04,685 adding 'unitxt/catalog/cards/global_mmlu_lite_cs/de.json' 2026-05-27T11:54:04,687 adding 'unitxt/catalog/cards/global_mmlu_lite_cs/es.json' 2026-05-27T11:54:04,688 adding 'unitxt/catalog/cards/global_mmlu_lite_cs/fr.json' 2026-05-27T11:54:04,690 adding 'unitxt/catalog/cards/global_mmlu_lite_cs/hi.json' 2026-05-27T11:54:04,691 adding 'unitxt/catalog/cards/global_mmlu_lite_cs/id.json' 2026-05-27T11:54:04,692 adding 'unitxt/catalog/cards/global_mmlu_lite_cs/it.json' 2026-05-27T11:54:04,694 adding 'unitxt/catalog/cards/global_mmlu_lite_cs/ja.json' 2026-05-27T11:54:04,695 adding 'unitxt/catalog/cards/global_mmlu_lite_cs/ko.json' 2026-05-27T11:54:04,697 adding 'unitxt/catalog/cards/global_mmlu_lite_cs/pt.json' 2026-05-27T11:54:04,699 adding 'unitxt/catalog/cards/global_mmlu_lite_cs/sw.json' 2026-05-27T11:54:04,700 adding 'unitxt/catalog/cards/global_mmlu_lite_cs/yo.json' 2026-05-27T11:54:04,702 adding 'unitxt/catalog/cards/global_mmlu_lite_cs/zh.json' 2026-05-27T11:54:04,704 adding 'unitxt/catalog/cards/go_emotions/simplified.json' 2026-05-27T11:54:04,705 adding 'unitxt/catalog/cards/gpqa/diamond.json' 2026-05-27T11:54:04,707 adding 'unitxt/catalog/cards/gpqa/extended.json' 2026-05-27T11:54:04,708 adding 'unitxt/catalog/cards/gpqa/main.json' 2026-05-27T11:54:04,710 adding 'unitxt/catalog/cards/head_qa/en.json' 2026-05-27T11:54:04,712 adding 'unitxt/catalog/cards/head_qa/es.json' 2026-05-27T11:54:04,713 adding 'unitxt/catalog/cards/head_qa/gl.json' 2026-05-27T11:54:04,714 adding 'unitxt/catalog/cards/head_qa/it.json' 2026-05-27T11:54:04,715 adding 'unitxt/catalog/cards/head_qa/ru.json' 2026-05-27T11:54:04,718 adding 'unitxt/catalog/cards/judge_bench/cola/grammaticality.json' 2026-05-27T11:54:04,720 adding 'unitxt/catalog/cards/judge_bench/dices/safety.json' 2026-05-27T11:54:04,722 adding 'unitxt/catalog/cards/judge_bench/inferential_strategies/sound_reasoning.json' 2026-05-27T11:54:04,724 adding 'unitxt/catalog/cards/judge_bench/newswoom/coherence.json' 2026-05-27T11:54:04,725 adding 'unitxt/catalog/cards/judge_bench/newswoom/fluency.json' 2026-05-27T11:54:04,726 adding 'unitxt/catalog/cards/judge_bench/newswoom/informativeness.json' 2026-05-27T11:54:04,728 adding 'unitxt/catalog/cards/judge_bench/newswoom/relevance.json' 2026-05-27T11:54:04,731 adding 'unitxt/catalog/cards/judge_bench/roscoe/overall/cosmos/coherence.json' 2026-05-27T11:54:04,732 adding 'unitxt/catalog/cards/judge_bench/roscoe/overall/cosmos/contradiction.json' 2026-05-27T11:54:04,734 adding 'unitxt/catalog/cards/judge_bench/roscoe/overall/cosmos/missing_steps.json' 2026-05-27T11:54:04,735 adding 'unitxt/catalog/cards/judge_bench/roscoe/overall/cosmos/overall_quality.json' 2026-05-27T11:54:04,737 adding 'unitxt/catalog/cards/judge_bench/roscoe/overall/drop/coherence.json' 2026-05-27T11:54:04,738 adding 'unitxt/catalog/cards/judge_bench/roscoe/overall/drop/contradiction.json' 2026-05-27T11:54:04,740 adding 'unitxt/catalog/cards/judge_bench/roscoe/overall/drop/missing_steps.json' 2026-05-27T11:54:04,741 adding 'unitxt/catalog/cards/judge_bench/roscoe/overall/drop/overall_quality.json' 2026-05-27T11:54:04,743 adding 'unitxt/catalog/cards/judge_bench/roscoe/overall/esnli/coherence.json' 2026-05-27T11:54:04,745 adding 'unitxt/catalog/cards/judge_bench/roscoe/overall/esnli/contradiction.json' 2026-05-27T11:54:04,746 adding 'unitxt/catalog/cards/judge_bench/roscoe/overall/esnli/missing_steps.json' 2026-05-27T11:54:04,747 adding 'unitxt/catalog/cards/judge_bench/roscoe/overall/esnli/overall_quality.json' 2026-05-27T11:54:04,750 adding 'unitxt/catalog/cards/judge_bench/roscoe/stepwise/cosmos/arithmetic.json' 2026-05-27T11:54:04,751 adding 'unitxt/catalog/cards/judge_bench/roscoe/stepwise/cosmos/coherency_and_logic.json' 2026-05-27T11:54:04,753 adding 'unitxt/catalog/cards/judge_bench/roscoe/stepwise/cosmos/commonsense.json' 2026-05-27T11:54:04,754 adding 'unitxt/catalog/cards/judge_bench/roscoe/stepwise/cosmos/factuality.json' 2026-05-27T11:54:04,756 adding 'unitxt/catalog/cards/judge_bench/roscoe/stepwise/cosmos/final_answer.json' 2026-05-27T11:54:04,757 adding 'unitxt/catalog/cards/judge_bench/roscoe/stepwise/cosmos/grammar.json' 2026-05-27T11:54:04,758 adding 'unitxt/catalog/cards/judge_bench/roscoe/stepwise/cosmos/hallucination.json' 2026-05-27T11:54:04,760 adding 'unitxt/catalog/cards/judge_bench/roscoe/stepwise/cosmos/redundancy.json' 2026-05-27T11:54:04,761 adding 'unitxt/catalog/cards/judge_bench/roscoe/stepwise/cosmos/repetition.json' 2026-05-27T11:54:04,763 adding 'unitxt/catalog/cards/judge_bench/roscoe/stepwise/drop/arithmetic.json' 2026-05-27T11:54:04,764 adding 'unitxt/catalog/cards/judge_bench/roscoe/stepwise/drop/coherency_and_logic.json' 2026-05-27T11:54:04,766 adding 'unitxt/catalog/cards/judge_bench/roscoe/stepwise/drop/commonsense.json' 2026-05-27T11:54:04,767 adding 'unitxt/catalog/cards/judge_bench/roscoe/stepwise/drop/factuality.json' 2026-05-27T11:54:04,768 adding 'unitxt/catalog/cards/judge_bench/roscoe/stepwise/drop/final_answer.json' 2026-05-27T11:54:04,770 adding 'unitxt/catalog/cards/judge_bench/roscoe/stepwise/drop/grammar.json' 2026-05-27T11:54:04,771 adding 'unitxt/catalog/cards/judge_bench/roscoe/stepwise/drop/hallucination.json' 2026-05-27T11:54:04,772 adding 'unitxt/catalog/cards/judge_bench/roscoe/stepwise/drop/redundancy.json' 2026-05-27T11:54:04,774 adding 'unitxt/catalog/cards/judge_bench/roscoe/stepwise/drop/repetition.json' 2026-05-27T11:54:04,776 adding 'unitxt/catalog/cards/judge_bench/roscoe/stepwise/esnli/arithmetic.json' 2026-05-27T11:54:04,777 adding 'unitxt/catalog/cards/judge_bench/roscoe/stepwise/esnli/coherency_and_logic.json' 2026-05-27T11:54:04,778 adding 'unitxt/catalog/cards/judge_bench/roscoe/stepwise/esnli/commonsense.json' 2026-05-27T11:54:04,780 adding 'unitxt/catalog/cards/judge_bench/roscoe/stepwise/esnli/factuality.json' 2026-05-27T11:54:04,781 adding 'unitxt/catalog/cards/judge_bench/roscoe/stepwise/esnli/final_answer.json' 2026-05-27T11:54:04,783 adding 'unitxt/catalog/cards/judge_bench/roscoe/stepwise/esnli/grammar.json' 2026-05-27T11:54:04,784 adding 'unitxt/catalog/cards/judge_bench/roscoe/stepwise/esnli/hallucination.json' 2026-05-27T11:54:04,785 adding 'unitxt/catalog/cards/judge_bench/roscoe/stepwise/esnli/redundancy.json' 2026-05-27T11:54:04,787 adding 'unitxt/catalog/cards/judge_bench/roscoe/stepwise/esnli/repetition.json' 2026-05-27T11:54:04,789 adding 'unitxt/catalog/cards/judge_bench/toxic_chat/jailbreaking.json' 2026-05-27T11:54:04,790 adding 'unitxt/catalog/cards/judge_bench/toxic_chat/toxicity.json' 2026-05-27T11:54:04,792 adding 'unitxt/catalog/cards/judge_bench/wmt_human/chinese_to_english/quality.json' 2026-05-27T11:54:04,794 adding 'unitxt/catalog/cards/judge_bench/wmt_human/english_to_german/quality.json' 2026-05-27T11:54:04,796 adding 'unitxt/catalog/cards/legalbench/abercrombie.json' 2026-05-27T11:54:04,797 adding 'unitxt/catalog/cards/legalbench/corporate_lobbying.json' 2026-05-27T11:54:04,799 adding 'unitxt/catalog/cards/legalbench/function_of_decision_section.json' 2026-05-27T11:54:04,800 adding 'unitxt/catalog/cards/legalbench/international_citizenship_questions.json' 2026-05-27T11:54:04,801 adding 'unitxt/catalog/cards/legalbench/proa.json' 2026-05-27T11:54:04,804 adding 'unitxt/catalog/cards/milu/Bengali/Arts_and_Humanities.json' 2026-05-27T11:54:04,805 adding 'unitxt/catalog/cards/milu/Bengali/Business_Studies.json' 2026-05-27T11:54:04,806 adding 'unitxt/catalog/cards/milu/Bengali/Engineering_and_Tech.json' 2026-05-27T11:54:04,808 adding 'unitxt/catalog/cards/milu/Bengali/Environmental_Sciences.json' 2026-05-27T11:54:04,809 adding 'unitxt/catalog/cards/milu/Bengali/Health_and_Medicine.json' 2026-05-27T11:54:04,810 adding 'unitxt/catalog/cards/milu/Bengali/Law_and_Governance.json' 2026-05-27T11:54:04,812 adding 'unitxt/catalog/cards/milu/Bengali/Science.json' 2026-05-27T11:54:04,813 adding 'unitxt/catalog/cards/milu/Bengali/Social_Sciences.json' 2026-05-27T11:54:04,815 adding 'unitxt/catalog/cards/milu/English/Arts_and_Humanities.json' 2026-05-27T11:54:04,817 adding 'unitxt/catalog/cards/milu/English/Business_Studies.json' 2026-05-27T11:54:04,818 adding 'unitxt/catalog/cards/milu/English/Engineering_and_Tech.json' 2026-05-27T11:54:04,819 adding 'unitxt/catalog/cards/milu/English/Environmental_Sciences.json' 2026-05-27T11:54:04,820 adding 'unitxt/catalog/cards/milu/English/Health_and_Medicine.json' 2026-05-27T11:54:04,822 adding 'unitxt/catalog/cards/milu/English/Law_and_Governance.json' 2026-05-27T11:54:04,823 adding 'unitxt/catalog/cards/milu/English/Science.json' 2026-05-27T11:54:04,824 adding 'unitxt/catalog/cards/milu/English/Social_Sciences.json' 2026-05-27T11:54:04,826 adding 'unitxt/catalog/cards/milu/Gujarati/Arts_and_Humanities.json' 2026-05-27T11:54:04,827 adding 'unitxt/catalog/cards/milu/Gujarati/Business_Studies.json' 2026-05-27T11:54:04,829 adding 'unitxt/catalog/cards/milu/Gujarati/Engineering_and_Tech.json' 2026-05-27T11:54:04,830 adding 'unitxt/catalog/cards/milu/Gujarati/Environmental_Sciences.json' 2026-05-27T11:54:04,831 adding 'unitxt/catalog/cards/milu/Gujarati/Health_and_Medicine.json' 2026-05-27T11:54:04,833 adding 'unitxt/catalog/cards/milu/Gujarati/Law_and_Governance.json' 2026-05-27T11:54:04,834 adding 'unitxt/catalog/cards/milu/Gujarati/Science.json' 2026-05-27T11:54:04,836 adding 'unitxt/catalog/cards/milu/Gujarati/Social_Sciences.json' 2026-05-27T11:54:04,838 adding 'unitxt/catalog/cards/milu/Hindi/Arts_and_Humanities.json' 2026-05-27T11:54:04,839 adding 'unitxt/catalog/cards/milu/Hindi/Business_Studies.json' 2026-05-27T11:54:04,840 adding 'unitxt/catalog/cards/milu/Hindi/Engineering_and_Tech.json' 2026-05-27T11:54:04,842 adding 'unitxt/catalog/cards/milu/Hindi/Environmental_Sciences.json' 2026-05-27T11:54:04,843 adding 'unitxt/catalog/cards/milu/Hindi/Health_and_Medicine.json' 2026-05-27T11:54:04,844 adding 'unitxt/catalog/cards/milu/Hindi/Law_and_Governance.json' 2026-05-27T11:54:04,846 adding 'unitxt/catalog/cards/milu/Hindi/Science.json' 2026-05-27T11:54:04,847 adding 'unitxt/catalog/cards/milu/Hindi/Social_Sciences.json' 2026-05-27T11:54:04,849 adding 'unitxt/catalog/cards/milu/Kannada/Arts_and_Humanities.json' 2026-05-27T11:54:04,851 adding 'unitxt/catalog/cards/milu/Kannada/Business_Studies.json' 2026-05-27T11:54:04,852 adding 'unitxt/catalog/cards/milu/Kannada/Engineering_and_Tech.json' 2026-05-27T11:54:04,853 adding 'unitxt/catalog/cards/milu/Kannada/Environmental_Sciences.json' 2026-05-27T11:54:04,855 adding 'unitxt/catalog/cards/milu/Kannada/Health_and_Medicine.json' 2026-05-27T11:54:04,856 adding 'unitxt/catalog/cards/milu/Kannada/Law_and_Governance.json' 2026-05-27T11:54:04,858 adding 'unitxt/catalog/cards/milu/Kannada/Science.json' 2026-05-27T11:54:04,859 adding 'unitxt/catalog/cards/milu/Kannada/Social_Sciences.json' 2026-05-27T11:54:04,861 adding 'unitxt/catalog/cards/milu/Malayalam/Arts_and_Humanities.json' 2026-05-27T11:54:04,862 adding 'unitxt/catalog/cards/milu/Malayalam/Business_Studies.json' 2026-05-27T11:54:04,864 adding 'unitxt/catalog/cards/milu/Malayalam/Engineering_and_Tech.json' 2026-05-27T11:54:04,865 adding 'unitxt/catalog/cards/milu/Malayalam/Environmental_Sciences.json' 2026-05-27T11:54:04,867 adding 'unitxt/catalog/cards/milu/Malayalam/Health_and_Medicine.json' 2026-05-27T11:54:04,868 adding 'unitxt/catalog/cards/milu/Malayalam/Law_and_Governance.json' 2026-05-27T11:54:04,869 adding 'unitxt/catalog/cards/milu/Malayalam/Science.json' 2026-05-27T11:54:04,871 adding 'unitxt/catalog/cards/milu/Malayalam/Social_Sciences.json' 2026-05-27T11:54:04,873 adding 'unitxt/catalog/cards/milu/Marathi/Arts_and_Humanities.json' 2026-05-27T11:54:04,874 adding 'unitxt/catalog/cards/milu/Marathi/Business_Studies.json' 2026-05-27T11:54:04,875 adding 'unitxt/catalog/cards/milu/Marathi/Engineering_and_Tech.json' 2026-05-27T11:54:04,877 adding 'unitxt/catalog/cards/milu/Marathi/Environmental_Sciences.json' 2026-05-27T11:54:04,878 adding 'unitxt/catalog/cards/milu/Marathi/Health_and_Medicine.json' 2026-05-27T11:54:04,879 adding 'unitxt/catalog/cards/milu/Marathi/Law_and_Governance.json' 2026-05-27T11:54:04,881 adding 'unitxt/catalog/cards/milu/Marathi/Science.json' 2026-05-27T11:54:04,882 adding 'unitxt/catalog/cards/milu/Marathi/Social_Sciences.json' 2026-05-27T11:54:04,884 adding 'unitxt/catalog/cards/milu/Odia/Arts_and_Humanities.json' 2026-05-27T11:54:04,886 adding 'unitxt/catalog/cards/milu/Odia/Business_Studies.json' 2026-05-27T11:54:04,887 adding 'unitxt/catalog/cards/milu/Odia/Engineering_and_Tech.json' 2026-05-27T11:54:04,888 adding 'unitxt/catalog/cards/milu/Odia/Environmental_Sciences.json' 2026-05-27T11:54:04,890 adding 'unitxt/catalog/cards/milu/Odia/Health_and_Medicine.json' 2026-05-27T11:54:04,891 adding 'unitxt/catalog/cards/milu/Odia/Law_and_Governance.json' 2026-05-27T11:54:04,892 adding 'unitxt/catalog/cards/milu/Odia/Science.json' 2026-05-27T11:54:04,893 adding 'unitxt/catalog/cards/milu/Odia/Social_Sciences.json' 2026-05-27T11:54:04,895 adding 'unitxt/catalog/cards/milu/Punjabi/Arts_and_Humanities.json' 2026-05-27T11:54:04,897 adding 'unitxt/catalog/cards/milu/Punjabi/Business_Studies.json' 2026-05-27T11:54:04,898 adding 'unitxt/catalog/cards/milu/Punjabi/Engineering_and_Tech.json' 2026-05-27T11:54:04,900 adding 'unitxt/catalog/cards/milu/Punjabi/Environmental_Sciences.json' 2026-05-27T11:54:04,901 adding 'unitxt/catalog/cards/milu/Punjabi/Health_and_Medicine.json' 2026-05-27T11:54:04,902 adding 'unitxt/catalog/cards/milu/Punjabi/Law_and_Governance.json' 2026-05-27T11:54:04,904 adding 'unitxt/catalog/cards/milu/Punjabi/Science.json' 2026-05-27T11:54:04,905 adding 'unitxt/catalog/cards/milu/Punjabi/Social_Sciences.json' 2026-05-27T11:54:04,907 adding 'unitxt/catalog/cards/milu/Tamil/Arts_and_Humanities.json' 2026-05-27T11:54:04,909 adding 'unitxt/catalog/cards/milu/Tamil/Business_Studies.json' 2026-05-27T11:54:04,910 adding 'unitxt/catalog/cards/milu/Tamil/Engineering_and_Tech.json' 2026-05-27T11:54:04,912 adding 'unitxt/catalog/cards/milu/Tamil/Environmental_Sciences.json' 2026-05-27T11:54:04,913 adding 'unitxt/catalog/cards/milu/Tamil/Health_and_Medicine.json' 2026-05-27T11:54:04,914 adding 'unitxt/catalog/cards/milu/Tamil/Law_and_Governance.json' 2026-05-27T11:54:04,916 adding 'unitxt/catalog/cards/milu/Tamil/Science.json' 2026-05-27T11:54:04,917 adding 'unitxt/catalog/cards/milu/Tamil/Social_Sciences.json' 2026-05-27T11:54:04,919 adding 'unitxt/catalog/cards/milu/Telugu/Arts_and_Humanities.json' 2026-05-27T11:54:04,921 adding 'unitxt/catalog/cards/milu/Telugu/Business_Studies.json' 2026-05-27T11:54:04,922 adding 'unitxt/catalog/cards/milu/Telugu/Engineering_and_Tech.json' 2026-05-27T11:54:04,924 adding 'unitxt/catalog/cards/milu/Telugu/Environmental_Sciences.json' 2026-05-27T11:54:04,925 adding 'unitxt/catalog/cards/milu/Telugu/Health_and_Medicine.json' 2026-05-27T11:54:04,927 adding 'unitxt/catalog/cards/milu/Telugu/Law_and_Governance.json' 2026-05-27T11:54:04,928 adding 'unitxt/catalog/cards/milu/Telugu/Science.json' 2026-05-27T11:54:04,929 adding 'unitxt/catalog/cards/milu/Telugu/Social_Sciences.json' 2026-05-27T11:54:04,931 adding 'unitxt/catalog/cards/mlsum/de.json' 2026-05-27T11:54:04,933 adding 'unitxt/catalog/cards/mlsum/es.json' 2026-05-27T11:54:04,934 adding 'unitxt/catalog/cards/mlsum/fr.json' 2026-05-27T11:54:04,936 adding 'unitxt/catalog/cards/mlsum/ru.json' 2026-05-27T11:54:04,937 adding 'unitxt/catalog/cards/mlsum/tu.json' 2026-05-27T11:54:04,940 adding 'unitxt/catalog/cards/mmlu/abstract_algebra.json' 2026-05-27T11:54:04,941 adding 'unitxt/catalog/cards/mmlu/anatomy.json' 2026-05-27T11:54:04,942 adding 'unitxt/catalog/cards/mmlu/astronomy.json' 2026-05-27T11:54:04,944 adding 'unitxt/catalog/cards/mmlu/business_ethics.json' 2026-05-27T11:54:04,945 adding 'unitxt/catalog/cards/mmlu/clinical_knowledge.json' 2026-05-27T11:54:04,946 adding 'unitxt/catalog/cards/mmlu/college_biology.json' 2026-05-27T11:54:04,948 adding 'unitxt/catalog/cards/mmlu/college_chemistry.json' 2026-05-27T11:54:04,949 adding 'unitxt/catalog/cards/mmlu/college_computer_science.json' 2026-05-27T11:54:04,950 adding 'unitxt/catalog/cards/mmlu/college_mathematics.json' 2026-05-27T11:54:04,952 adding 'unitxt/catalog/cards/mmlu/college_medicine.json' 2026-05-27T11:54:04,953 adding 'unitxt/catalog/cards/mmlu/college_physics.json' 2026-05-27T11:54:04,954 adding 'unitxt/catalog/cards/mmlu/computer_security.json' 2026-05-27T11:54:04,956 adding 'unitxt/catalog/cards/mmlu/conceptual_physics.json' 2026-05-27T11:54:04,957 adding 'unitxt/catalog/cards/mmlu/econometrics.json' 2026-05-27T11:54:04,958 adding 'unitxt/catalog/cards/mmlu/electrical_engineering.json' 2026-05-27T11:54:04,959 adding 'unitxt/catalog/cards/mmlu/elementary_mathematics.json' 2026-05-27T11:54:04,961 adding 'unitxt/catalog/cards/mmlu/formal_logic.json' 2026-05-27T11:54:04,962 adding 'unitxt/catalog/cards/mmlu/global_facts.json' 2026-05-27T11:54:04,963 adding 'unitxt/catalog/cards/mmlu/high_school_biology.json' 2026-05-27T11:54:04,964 adding 'unitxt/catalog/cards/mmlu/high_school_chemistry.json' 2026-05-27T11:54:04,966 adding 'unitxt/catalog/cards/mmlu/high_school_computer_science.json' 2026-05-27T11:54:04,967 adding 'unitxt/catalog/cards/mmlu/high_school_european_history.json' 2026-05-27T11:54:04,969 adding 'unitxt/catalog/cards/mmlu/high_school_geography.json' 2026-05-27T11:54:04,970 adding 'unitxt/catalog/cards/mmlu/high_school_government_and_politics.json' 2026-05-27T11:54:04,971 adding 'unitxt/catalog/cards/mmlu/high_school_macroeconomics.json' 2026-05-27T11:54:04,972 adding 'unitxt/catalog/cards/mmlu/high_school_mathematics.json' 2026-05-27T11:54:04,974 adding 'unitxt/catalog/cards/mmlu/high_school_microeconomics.json' 2026-05-27T11:54:04,975 adding 'unitxt/catalog/cards/mmlu/high_school_physics.json' 2026-05-27T11:54:04,976 adding 'unitxt/catalog/cards/mmlu/high_school_psychology.json' 2026-05-27T11:54:04,977 adding 'unitxt/catalog/cards/mmlu/high_school_statistics.json' 2026-05-27T11:54:04,979 adding 'unitxt/catalog/cards/mmlu/high_school_us_history.json' 2026-05-27T11:54:04,980 adding 'unitxt/catalog/cards/mmlu/high_school_world_history.json' 2026-05-27T11:54:04,981 adding 'unitxt/catalog/cards/mmlu/human_aging.json' 2026-05-27T11:54:04,983 adding 'unitxt/catalog/cards/mmlu/human_sexuality.json' 2026-05-27T11:54:04,984 adding 'unitxt/catalog/cards/mmlu/international_law.json' 2026-05-27T11:54:04,985 adding 'unitxt/catalog/cards/mmlu/jurisprudence.json' 2026-05-27T11:54:04,987 adding 'unitxt/catalog/cards/mmlu/logical_fallacies.json' 2026-05-27T11:54:04,988 adding 'unitxt/catalog/cards/mmlu/machine_learning.json' 2026-05-27T11:54:04,989 adding 'unitxt/catalog/cards/mmlu/management.json' 2026-05-27T11:54:04,991 adding 'unitxt/catalog/cards/mmlu/marketing.json' 2026-05-27T11:54:04,992 adding 'unitxt/catalog/cards/mmlu/medical_genetics.json' 2026-05-27T11:54:04,993 adding 'unitxt/catalog/cards/mmlu/miscellaneous.json' 2026-05-27T11:54:04,995 adding 'unitxt/catalog/cards/mmlu/moral_disputes.json' 2026-05-27T11:54:04,996 adding 'unitxt/catalog/cards/mmlu/moral_scenarios.json' 2026-05-27T11:54:04,998 adding 'unitxt/catalog/cards/mmlu/nutrition.json' 2026-05-27T11:54:04,999 adding 'unitxt/catalog/cards/mmlu/philosophy.json' 2026-05-27T11:54:05,000 adding 'unitxt/catalog/cards/mmlu/prehistory.json' 2026-05-27T11:54:05,002 adding 'unitxt/catalog/cards/mmlu/professional_accounting.json' 2026-05-27T11:54:05,003 adding 'unitxt/catalog/cards/mmlu/professional_law.json' 2026-05-27T11:54:05,004 adding 'unitxt/catalog/cards/mmlu/professional_medicine.json' 2026-05-27T11:54:05,006 adding 'unitxt/catalog/cards/mmlu/professional_psychology.json' 2026-05-27T11:54:05,007 adding 'unitxt/catalog/cards/mmlu/public_relations.json' 2026-05-27T11:54:05,008 adding 'unitxt/catalog/cards/mmlu/security_studies.json' 2026-05-27T11:54:05,010 adding 'unitxt/catalog/cards/mmlu/sociology.json' 2026-05-27T11:54:05,011 adding 'unitxt/catalog/cards/mmlu/us_foreign_policy.json' 2026-05-27T11:54:05,013 adding 'unitxt/catalog/cards/mmlu/virology.json' 2026-05-27T11:54:05,014 adding 'unitxt/catalog/cards/mmlu/world_religions.json' 2026-05-27T11:54:05,016 adding 'unitxt/catalog/cards/mmlu_pro/biology.json' 2026-05-27T11:54:05,017 adding 'unitxt/catalog/cards/mmlu_pro/business.json' 2026-05-27T11:54:05,018 adding 'unitxt/catalog/cards/mmlu_pro/chemistry.json' 2026-05-27T11:54:05,020 adding 'unitxt/catalog/cards/mmlu_pro/computer_science.json' 2026-05-27T11:54:05,021 adding 'unitxt/catalog/cards/mmlu_pro/economics.json' 2026-05-27T11:54:05,022 adding 'unitxt/catalog/cards/mmlu_pro/engineering.json' 2026-05-27T11:54:05,023 adding 'unitxt/catalog/cards/mmlu_pro/health.json' 2026-05-27T11:54:05,025 adding 'unitxt/catalog/cards/mmlu_pro/history.json' 2026-05-27T11:54:05,026 adding 'unitxt/catalog/cards/mmlu_pro/law.json' 2026-05-27T11:54:05,027 adding 'unitxt/catalog/cards/mmlu_pro/math.json' 2026-05-27T11:54:05,028 adding 'unitxt/catalog/cards/mmlu_pro/other.json' 2026-05-27T11:54:05,030 adding 'unitxt/catalog/cards/mmlu_pro/philosophy.json' 2026-05-27T11:54:05,031 adding 'unitxt/catalog/cards/mmlu_pro/physics.json' 2026-05-27T11:54:05,032 adding 'unitxt/catalog/cards/mmlu_pro/psychology.json' 2026-05-27T11:54:05,035 adding 'unitxt/catalog/cards/mmmu/accounting.json' 2026-05-27T11:54:05,036 adding 'unitxt/catalog/cards/mmmu/agriculture.json' 2026-05-27T11:54:05,037 adding 'unitxt/catalog/cards/mmmu/architecture_and_engineering.json' 2026-05-27T11:54:05,039 adding 'unitxt/catalog/cards/mmmu/art.json' 2026-05-27T11:54:05,040 adding 'unitxt/catalog/cards/mmmu/art_theory.json' 2026-05-27T11:54:05,041 adding 'unitxt/catalog/cards/mmmu/basic_medical_science.json' 2026-05-27T11:54:05,043 adding 'unitxt/catalog/cards/mmmu/biology.json' 2026-05-27T11:54:05,044 adding 'unitxt/catalog/cards/mmmu/chemistry.json' 2026-05-27T11:54:05,045 adding 'unitxt/catalog/cards/mmmu/clinical_medicine.json' 2026-05-27T11:54:05,047 adding 'unitxt/catalog/cards/mmmu/computer_science.json' 2026-05-27T11:54:05,048 adding 'unitxt/catalog/cards/mmmu/design.json' 2026-05-27T11:54:05,050 adding 'unitxt/catalog/cards/mmmu/diagnostics_and_laboratory_medicine.json' 2026-05-27T11:54:05,051 adding 'unitxt/catalog/cards/mmmu/economics.json' 2026-05-27T11:54:05,052 adding 'unitxt/catalog/cards/mmmu/electronics.json' 2026-05-27T11:54:05,054 adding 'unitxt/catalog/cards/mmmu/energy_and_power.json' 2026-05-27T11:54:05,055 adding 'unitxt/catalog/cards/mmmu/finance.json' 2026-05-27T11:54:05,057 adding 'unitxt/catalog/cards/mmmu/geography.json' 2026-05-27T11:54:05,058 adding 'unitxt/catalog/cards/mmmu/history.json' 2026-05-27T11:54:05,059 adding 'unitxt/catalog/cards/mmmu/literature.json' 2026-05-27T11:54:05,061 adding 'unitxt/catalog/cards/mmmu/manage.json' 2026-05-27T11:54:05,062 adding 'unitxt/catalog/cards/mmmu/marketing.json' 2026-05-27T11:54:05,063 adding 'unitxt/catalog/cards/mmmu/materials.json' 2026-05-27T11:54:05,065 adding 'unitxt/catalog/cards/mmmu/math.json' 2026-05-27T11:54:05,066 adding 'unitxt/catalog/cards/mmmu/mechanical_engineering.json' 2026-05-27T11:54:05,068 adding 'unitxt/catalog/cards/mmmu/music.json' 2026-05-27T11:54:05,069 adding 'unitxt/catalog/cards/mmmu/pharmacy.json' 2026-05-27T11:54:05,070 adding 'unitxt/catalog/cards/mmmu/physics.json' 2026-05-27T11:54:05,072 adding 'unitxt/catalog/cards/mmmu/psychology.json' 2026-05-27T11:54:05,073 adding 'unitxt/catalog/cards/mmmu/public_health.json' 2026-05-27T11:54:05,075 adding 'unitxt/catalog/cards/mmmu/sociology.json' 2026-05-27T11:54:05,077 adding 'unitxt/catalog/cards/mt/flores_101/ara_eng.json' 2026-05-27T11:54:05,078 adding 'unitxt/catalog/cards/mt/flores_101/deu_eng.json' 2026-05-27T11:54:05,080 adding 'unitxt/catalog/cards/mt/flores_101/eng_ara.json' 2026-05-27T11:54:05,081 adding 'unitxt/catalog/cards/mt/flores_101/eng_deu.json' 2026-05-27T11:54:05,082 adding 'unitxt/catalog/cards/mt/flores_101/eng_fra.json' 2026-05-27T11:54:05,084 adding 'unitxt/catalog/cards/mt/flores_101/eng_jpn.json' 2026-05-27T11:54:05,085 adding 'unitxt/catalog/cards/mt/flores_101/eng_kor.json' 2026-05-27T11:54:05,086 adding 'unitxt/catalog/cards/mt/flores_101/eng_por.json' 2026-05-27T11:54:05,087 adding 'unitxt/catalog/cards/mt/flores_101/eng_ron.json' 2026-05-27T11:54:05,088 adding 'unitxt/catalog/cards/mt/flores_101/eng_spa.json' 2026-05-27T11:54:05,090 adding 'unitxt/catalog/cards/mt/flores_101/fra_eng.json' 2026-05-27T11:54:05,091 adding 'unitxt/catalog/cards/mt/flores_101/jpn_eng.json' 2026-05-27T11:54:05,092 adding 'unitxt/catalog/cards/mt/flores_101/kor_eng.json' 2026-05-27T11:54:05,093 adding 'unitxt/catalog/cards/mt/flores_101/por_eng.json' 2026-05-27T11:54:05,094 adding 'unitxt/catalog/cards/mt/flores_101/ron_eng.json' 2026-05-27T11:54:05,095 adding 'unitxt/catalog/cards/mt/flores_101/spa_eng.json' 2026-05-27T11:54:05,098 adding 'unitxt/catalog/cards/mt_bench/generation/english_single_turn.json' 2026-05-27T11:54:05,099 adding 'unitxt/catalog/cards/mt_bench/generation/japanese_single_turn.json' 2026-05-27T11:54:05,101 adding 'unitxt/catalog/cards/mt_bench/response_assessment/pairwise_comparison/multi_turn_gpt4_judgement.json' 2026-05-27T11:54:05,102 adding 'unitxt/catalog/cards/mt_bench/response_assessment/pairwise_comparison/multi_turn_with_reference_gpt4_judgement.json' 2026-05-27T11:54:05,104 adding 'unitxt/catalog/cards/mt_bench/response_assessment/pairwise_comparison/single_turn_gpt4_judgement.json' 2026-05-27T11:54:05,105 adding 'unitxt/catalog/cards/mt_bench/response_assessment/pairwise_comparison/single_turn_with_reference_gpt4_judgement.json' 2026-05-27T11:54:05,107 adding 'unitxt/catalog/cards/mt_bench/response_assessment/rating/multi_turn_gpt4_judgement.json' 2026-05-27T11:54:05,108 adding 'unitxt/catalog/cards/mt_bench/response_assessment/rating/multi_turn_with_reference_gpt4_judgement.json' 2026-05-27T11:54:05,109 adding 'unitxt/catalog/cards/mt_bench/response_assessment/rating/single_turn_gpt4_judgement.json' 2026-05-27T11:54:05,111 adding 'unitxt/catalog/cards/mt_bench/response_assessment/rating/single_turn_with_reference_gpt4_judgement.json' 2026-05-27T11:54:05,112 adding 'unitxt/catalog/cards/multidoc2dial/abstractive.json' 2026-05-27T11:54:05,114 adding 'unitxt/catalog/cards/multidoc2dial/extractive.json' 2026-05-27T11:54:05,116 adding 'unitxt/catalog/cards/rag/mtrag.json' 2026-05-27T11:54:05,118 adding 'unitxt/catalog/cards/rag/benchmark/bioasq/en.json' 2026-05-27T11:54:05,120 adding 'unitxt/catalog/cards/rag/benchmark/clap_nq/en.json' 2026-05-27T11:54:05,122 adding 'unitxt/catalog/cards/rag/benchmark/hotpotqa/en.json' 2026-05-27T11:54:05,123 adding 'unitxt/catalog/cards/rag/benchmark/miniwiki/en.json' 2026-05-27T11:54:05,125 adding 'unitxt/catalog/cards/rag/benchmark/real_mm_rag_fin_report/en.json' 2026-05-27T11:54:05,127 adding 'unitxt/catalog/cards/rag/benchmark/real_mm_rag_fin_slides/en.json' 2026-05-27T11:54:05,129 adding 'unitxt/catalog/cards/rag/benchmark/real_mm_rag_tech_report/en.json' 2026-05-27T11:54:05,131 adding 'unitxt/catalog/cards/rag/benchmark/real_mm_rag_tech_slides/en.json' 2026-05-27T11:54:05,133 adding 'unitxt/catalog/cards/rag/benchmark/watsonxqa/en.json' 2026-05-27T11:54:05,135 adding 'unitxt/catalog/cards/rag/documents/bioasq/en.json' 2026-05-27T11:54:05,137 adding 'unitxt/catalog/cards/rag/documents/clap_nq/en.json' 2026-05-27T11:54:05,139 adding 'unitxt/catalog/cards/rag/documents/hotpotqa/en.json' 2026-05-27T11:54:05,141 adding 'unitxt/catalog/cards/rag/documents/miniwiki/en.json' 2026-05-27T11:54:05,143 adding 'unitxt/catalog/cards/rag/documents/real_mm_rag_fin_report/en.json' 2026-05-27T11:54:05,145 adding 'unitxt/catalog/cards/rag/documents/real_mm_rag_fin_slides/en.json' 2026-05-27T11:54:05,147 adding 'unitxt/catalog/cards/rag/documents/real_mm_rag_tech_report/en.json' 2026-05-27T11:54:05,148 adding 'unitxt/catalog/cards/rag/documents/real_mm_rag_tech_slides/en.json' 2026-05-27T11:54:05,150 adding 'unitxt/catalog/cards/rag/documents/watsonxqa/en.json' 2026-05-27T11:54:05,153 adding 'unitxt/catalog/cards/rag/mtrag/documents/clapnq.json' 2026-05-27T11:54:05,154 adding 'unitxt/catalog/cards/rag/mtrag/documents/cloud.json' 2026-05-27T11:54:05,155 adding 'unitxt/catalog/cards/rag/mtrag/documents/fiqa.json' 2026-05-27T11:54:05,156 adding 'unitxt/catalog/cards/rag/mtrag/documents/govt.json' 2026-05-27T11:54:05,158 adding 'unitxt/catalog/cards/rag/response_generation/clapnq.json' 2026-05-27T11:54:05,160 adding 'unitxt/catalog/cards/rag/response_generation/chat_rag_bench/train/user_assistant_format/doc2dial.json' 2026-05-27T11:54:05,162 adding 'unitxt/catalog/cards/rag/response_generation/chat_rag_bench/train/user_assistant_format/doqa_cooking.json' 2026-05-27T11:54:05,163 adding 'unitxt/catalog/cards/rag/response_generation/chat_rag_bench/train/user_assistant_format/doqa_movies.json' 2026-05-27T11:54:05,164 adding 'unitxt/catalog/cards/rag/response_generation/chat_rag_bench/train/user_assistant_format/doqa_travel.json' 2026-05-27T11:54:05,165 adding 'unitxt/catalog/cards/rag/response_generation/chat_rag_bench/train/user_assistant_format/hybridial.json' 2026-05-27T11:54:05,167 adding 'unitxt/catalog/cards/rag/response_generation/chat_rag_bench/user_assistant_format/doc2dial.json' 2026-05-27T11:54:05,168 adding 'unitxt/catalog/cards/rag/response_generation/chat_rag_bench/user_assistant_format/doqa_cooking.json' 2026-05-27T11:54:05,169 adding 'unitxt/catalog/cards/rag/response_generation/chat_rag_bench/user_assistant_format/doqa_movies.json' 2026-05-27T11:54:05,171 adding 'unitxt/catalog/cards/rag/response_generation/chat_rag_bench/user_assistant_format/doqa_travel.json' 2026-05-27T11:54:05,172 adding 'unitxt/catalog/cards/rag/response_generation/chat_rag_bench/user_assistant_format/hybridial.json' 2026-05-27T11:54:05,174 adding 'unitxt/catalog/cards/rag/response_generation/ragbench/covidqa.json' 2026-05-27T11:54:05,175 adding 'unitxt/catalog/cards/rag/response_generation/ragbench/cuad.json' 2026-05-27T11:54:05,176 adding 'unitxt/catalog/cards/rag/response_generation/ragbench/delucionqa.json' 2026-05-27T11:54:05,177 adding 'unitxt/catalog/cards/rag/response_generation/ragbench/emanual.json' 2026-05-27T11:54:05,179 adding 'unitxt/catalog/cards/rag/response_generation/ragbench/expertqa.json' 2026-05-27T11:54:05,180 adding 'unitxt/catalog/cards/rag/response_generation/ragbench/finqa.json' 2026-05-27T11:54:05,181 adding 'unitxt/catalog/cards/rag/response_generation/ragbench/hagrid.json' 2026-05-27T11:54:05,182 adding 'unitxt/catalog/cards/rag/response_generation/ragbench/hotpotqa.json' 2026-05-27T11:54:05,183 adding 'unitxt/catalog/cards/rag/response_generation/ragbench/msmarco.json' 2026-05-27T11:54:05,185 adding 'unitxt/catalog/cards/rag/response_generation/ragbench/pubmedqa.json' 2026-05-27T11:54:05,186 adding 'unitxt/catalog/cards/rag/response_generation/ragbench/tatqa.json' 2026-05-27T11:54:05,187 adding 'unitxt/catalog/cards/rag/response_generation/ragbench/techqa.json' 2026-05-27T11:54:05,189 adding 'unitxt/catalog/cards/rag/response_generation/train/clapnq.json' 2026-05-27T11:54:05,190 adding 'unitxt/catalog/cards/rag/response_generation/train/open_australian_legal_qa.json' 2026-05-27T11:54:05,193 adding 'unitxt/catalog/cards/rag_eval/faithfulness/ragbench/covidqa.json' 2026-05-27T11:54:05,194 adding 'unitxt/catalog/cards/rag_eval/faithfulness/ragbench/cuad.json' 2026-05-27T11:54:05,196 adding 'unitxt/catalog/cards/rag_eval/faithfulness/ragbench/delucionqa.json' 2026-05-27T11:54:05,197 adding 'unitxt/catalog/cards/rag_eval/faithfulness/ragbench/emanual.json' 2026-05-27T11:54:05,198 adding 'unitxt/catalog/cards/rag_eval/faithfulness/ragbench/expertqa.json' 2026-05-27T11:54:05,199 adding 'unitxt/catalog/cards/rag_eval/faithfulness/ragbench/finqa.json' 2026-05-27T11:54:05,201 adding 'unitxt/catalog/cards/rag_eval/faithfulness/ragbench/hagrid.json' 2026-05-27T11:54:05,202 adding 'unitxt/catalog/cards/rag_eval/faithfulness/ragbench/hotpotqa.json' 2026-05-27T11:54:05,203 adding 'unitxt/catalog/cards/rag_eval/faithfulness/ragbench/msmarco.json' 2026-05-27T11:54:05,205 adding 'unitxt/catalog/cards/rag_eval/faithfulness/ragbench/pubmedqa.json' 2026-05-27T11:54:05,206 adding 'unitxt/catalog/cards/rag_eval/faithfulness/ragbench/tatqa.json' 2026-05-27T11:54:05,207 adding 'unitxt/catalog/cards/rag_eval/faithfulness/ragbench/techqa.json' 2026-05-27T11:54:05,209 adding 'unitxt/catalog/cards/ragbench/covidqa.json' 2026-05-27T11:54:05,210 adding 'unitxt/catalog/cards/ragbench/cuad.json' 2026-05-27T11:54:05,211 adding 'unitxt/catalog/cards/ragbench/delucionqa.json' 2026-05-27T11:54:05,212 adding 'unitxt/catalog/cards/ragbench/emanual.json' 2026-05-27T11:54:05,213 adding 'unitxt/catalog/cards/ragbench/expertqa.json' 2026-05-27T11:54:05,214 adding 'unitxt/catalog/cards/ragbench/finqa.json' 2026-05-27T11:54:05,215 adding 'unitxt/catalog/cards/ragbench/hagrid.json' 2026-05-27T11:54:05,217 adding 'unitxt/catalog/cards/ragbench/hotpotqa.json' 2026-05-27T11:54:05,218 adding 'unitxt/catalog/cards/ragbench/msmarco.json' 2026-05-27T11:54:05,219 adding 'unitxt/catalog/cards/ragbench/pubmedqa.json' 2026-05-27T11:54:05,220 adding 'unitxt/catalog/cards/ragbench/tatqa.json' 2026-05-27T11:54:05,221 adding 'unitxt/catalog/cards/ragbench/techqa.json' 2026-05-27T11:54:05,223 adding 'unitxt/catalog/cards/reuters21578/ModApte.json' 2026-05-27T11:54:05,225 adding 'unitxt/catalog/cards/reuters21578/ModHayes.json' 2026-05-27T11:54:05,226 adding 'unitxt/catalog/cards/reuters21578/ModLewis.json' 2026-05-27T11:54:05,228 adding 'unitxt/catalog/cards/reward_bench/chat.json' 2026-05-27T11:54:05,229 adding 'unitxt/catalog/cards/reward_bench/chat_hard.json' 2026-05-27T11:54:05,230 adding 'unitxt/catalog/cards/reward_bench/reasoning.json' 2026-05-27T11:54:05,231 adding 'unitxt/catalog/cards/reward_bench/safety.json' 2026-05-27T11:54:05,233 adding 'unitxt/catalog/cards/safety/airbench2024.json' 2026-05-27T11:54:05,235 adding 'unitxt/catalog/cards/safety/mlcommons_ailuminate.json' 2026-05-27T11:54:05,236 adding 'unitxt/catalog/cards/safety/provoq.json' 2026-05-27T11:54:05,237 adding 'unitxt/catalog/cards/safety/simple_safety_tests.json' 2026-05-27T11:54:05,241 adding 'unitxt/catalog/cards/safety/truthful_qa.json' 2026-05-27T11:54:05,243 adding 'unitxt/catalog/cards/safety/xstest.json' 2026-05-27T11:54:05,245 adding 'unitxt/catalog/cards/safety/bbq/Age.json' 2026-05-27T11:54:05,246 adding 'unitxt/catalog/cards/safety/bbq/Disability_status.json' 2026-05-27T11:54:05,248 adding 'unitxt/catalog/cards/safety/bbq/Gender_identity.json' 2026-05-27T11:54:05,249 adding 'unitxt/catalog/cards/safety/bbq/Nationality.json' 2026-05-27T11:54:05,250 adding 'unitxt/catalog/cards/safety/bbq/Physical_appearance.json' 2026-05-27T11:54:05,251 adding 'unitxt/catalog/cards/safety/bbq/Race_ethnicity.json' 2026-05-27T11:54:05,253 adding 'unitxt/catalog/cards/safety/bbq/Race_x_SES.json' 2026-05-27T11:54:05,254 adding 'unitxt/catalog/cards/safety/bbq/Race_x_gender.json' 2026-05-27T11:54:05,255 adding 'unitxt/catalog/cards/safety/bbq/Religion.json' 2026-05-27T11:54:05,257 adding 'unitxt/catalog/cards/safety/bbq/SES.json' 2026-05-27T11:54:05,258 adding 'unitxt/catalog/cards/safety/bbq/Sexual_orientation.json' 2026-05-27T11:54:05,260 adding 'unitxt/catalog/cards/safety/discrim_eval/explicit.json' 2026-05-27T11:54:05,261 adding 'unitxt/catalog/cards/safety/discrim_eval/implicit.json' 2026-05-27T11:54:05,263 adding 'unitxt/catalog/cards/tablebench_data_analysis/legacy.json' 2026-05-27T11:54:05,265 adding 'unitxt/catalog/cards/tablebench_fact_checking/legacy.json' 2026-05-27T11:54:05,267 adding 'unitxt/catalog/cards/tablebench_numerical_reasoning/legacy.json' 2026-05-27T11:54:05,269 adding 'unitxt/catalog/cards/text2sql/bird.json' 2026-05-27T11:54:05,271 adding 'unitxt/catalog/cards/tot/arithmetic.json' 2026-05-27T11:54:05,272 adding 'unitxt/catalog/cards/tot/semantic.json' 2026-05-27T11:54:05,275 adding 'unitxt/catalog/cards/universal_ner/ceb/gja.json' 2026-05-27T11:54:05,277 adding 'unitxt/catalog/cards/universal_ner/da/ddt.json' 2026-05-27T11:54:05,279 adding 'unitxt/catalog/cards/universal_ner/de/pud.json' 2026-05-27T11:54:05,281 adding 'unitxt/catalog/cards/universal_ner/en/ewt.json' 2026-05-27T11:54:05,282 adding 'unitxt/catalog/cards/universal_ner/en/pud.json' 2026-05-27T11:54:05,284 adding 'unitxt/catalog/cards/universal_ner/hr/set.json' 2026-05-27T11:54:05,286 adding 'unitxt/catalog/cards/universal_ner/pt/bosque.json' 2026-05-27T11:54:05,287 adding 'unitxt/catalog/cards/universal_ner/pt/pud.json' 2026-05-27T11:54:05,289 adding 'unitxt/catalog/cards/universal_ner/ru/pud.json' 2026-05-27T11:54:05,290 adding 'unitxt/catalog/cards/universal_ner/sk/snk.json' 2026-05-27T11:54:05,292 adding 'unitxt/catalog/cards/universal_ner/sr/set.json' 2026-05-27T11:54:05,294 adding 'unitxt/catalog/cards/universal_ner/sv/pud.json' 2026-05-27T11:54:05,296 adding 'unitxt/catalog/cards/universal_ner/sv/talbanken.json' 2026-05-27T11:54:05,298 adding 'unitxt/catalog/cards/universal_ner/tl/trg.json' 2026-05-27T11:54:05,299 adding 'unitxt/catalog/cards/universal_ner/tl/ugnayan.json' 2026-05-27T11:54:05,301 adding 'unitxt/catalog/cards/universal_ner/zh/gsd.json' 2026-05-27T11:54:05,302 adding 'unitxt/catalog/cards/universal_ner/zh/gsdsimp.json' 2026-05-27T11:54:05,304 adding 'unitxt/catalog/cards/universal_ner/zh/pud.json' 2026-05-27T11:54:05,305 adding 'unitxt/catalog/cards/winogrande/debiased.json' 2026-05-27T11:54:05,306 adding 'unitxt/catalog/cards/winogrande/l.json' 2026-05-27T11:54:05,308 adding 'unitxt/catalog/cards/winogrande/m.json' 2026-05-27T11:54:05,309 adding 'unitxt/catalog/cards/winogrande/s.json' 2026-05-27T11:54:05,310 adding 'unitxt/catalog/cards/winogrande/xl.json' 2026-05-27T11:54:05,311 adding 'unitxt/catalog/cards/winogrande/xs.json' 2026-05-27T11:54:05,313 adding 'unitxt/catalog/cards/wmt/en_de.json' 2026-05-27T11:54:05,314 adding 'unitxt/catalog/cards/wmt/en_fr.json' 2026-05-27T11:54:05,315 adding 'unitxt/catalog/cards/wmt/en_ro.json' 2026-05-27T11:54:05,317 adding 'unitxt/catalog/cards/wnli/truthfulness.json' 2026-05-27T11:54:05,320 adding 'unitxt/catalog/cards/xlsum/amharic.json' 2026-05-27T11:54:05,321 adding 'unitxt/catalog/cards/xlsum/arabic.json' 2026-05-27T11:54:05,322 adding 'unitxt/catalog/cards/xlsum/azerbaijani.json' 2026-05-27T11:54:05,324 adding 'unitxt/catalog/cards/xlsum/bengali.json' 2026-05-27T11:54:05,325 adding 'unitxt/catalog/cards/xlsum/burmese.json' 2026-05-27T11:54:05,326 adding 'unitxt/catalog/cards/xlsum/chinese_simplified.json' 2026-05-27T11:54:05,328 adding 'unitxt/catalog/cards/xlsum/chinese_traditional.json' 2026-05-27T11:54:05,329 adding 'unitxt/catalog/cards/xlsum/english.json' 2026-05-27T11:54:05,330 adding 'unitxt/catalog/cards/xlsum/french.json' 2026-05-27T11:54:05,331 adding 'unitxt/catalog/cards/xlsum/gujarati.json' 2026-05-27T11:54:05,333 adding 'unitxt/catalog/cards/xlsum/hausa.json' 2026-05-27T11:54:05,334 adding 'unitxt/catalog/cards/xlsum/hindi.json' 2026-05-27T11:54:05,335 adding 'unitxt/catalog/cards/xlsum/igbo.json' 2026-05-27T11:54:05,337 adding 'unitxt/catalog/cards/xlsum/indonesian.json' 2026-05-27T11:54:05,338 adding 'unitxt/catalog/cards/xlsum/japanese.json' 2026-05-27T11:54:05,339 adding 'unitxt/catalog/cards/xlsum/kirundi.json' 2026-05-27T11:54:05,341 adding 'unitxt/catalog/cards/xlsum/korean.json' 2026-05-27T11:54:05,342 adding 'unitxt/catalog/cards/xlsum/kyrgyz.json' 2026-05-27T11:54:05,343 adding 'unitxt/catalog/cards/xlsum/marathi.json' 2026-05-27T11:54:05,345 adding 'unitxt/catalog/cards/xlsum/nepali.json' 2026-05-27T11:54:05,346 adding 'unitxt/catalog/cards/xlsum/oromo.json' 2026-05-27T11:54:05,347 adding 'unitxt/catalog/cards/xlsum/pashto.json' 2026-05-27T11:54:05,349 adding 'unitxt/catalog/cards/xlsum/persian.json' 2026-05-27T11:54:05,350 adding 'unitxt/catalog/cards/xlsum/pidgin.json' 2026-05-27T11:54:05,351 adding 'unitxt/catalog/cards/xlsum/portuguese.json' 2026-05-27T11:54:05,353 adding 'unitxt/catalog/cards/xlsum/punjabi.json' 2026-05-27T11:54:05,354 adding 'unitxt/catalog/cards/xlsum/russian.json' 2026-05-27T11:54:05,355 adding 'unitxt/catalog/cards/xlsum/scottish_gaelic.json' 2026-05-27T11:54:05,357 adding 'unitxt/catalog/cards/xlsum/serbian_cyrillic.json' 2026-05-27T11:54:05,358 adding 'unitxt/catalog/cards/xlsum/serbian_latin.json' 2026-05-27T11:54:05,359 adding 'unitxt/catalog/cards/xlsum/sinhala.json' 2026-05-27T11:54:05,360 adding 'unitxt/catalog/cards/xlsum/somali.json' 2026-05-27T11:54:05,361 adding 'unitxt/catalog/cards/xlsum/spanish.json' 2026-05-27T11:54:05,362 adding 'unitxt/catalog/cards/xlsum/swahili.json' 2026-05-27T11:54:05,364 adding 'unitxt/catalog/cards/xlsum/tamil.json' 2026-05-27T11:54:05,365 adding 'unitxt/catalog/cards/xlsum/telugu.json' 2026-05-27T11:54:05,366 adding 'unitxt/catalog/cards/xlsum/thai.json' 2026-05-27T11:54:05,367 adding 'unitxt/catalog/cards/xlsum/tigrinya.json' 2026-05-27T11:54:05,369 adding 'unitxt/catalog/cards/xlsum/turkish.json' 2026-05-27T11:54:05,370 adding 'unitxt/catalog/cards/xlsum/ukrainian.json' 2026-05-27T11:54:05,371 adding 'unitxt/catalog/cards/xlsum/urdu.json' 2026-05-27T11:54:05,372 adding 'unitxt/catalog/cards/xlsum/uzbek.json' 2026-05-27T11:54:05,374 adding 'unitxt/catalog/cards/xlsum/vietnamese.json' 2026-05-27T11:54:05,375 adding 'unitxt/catalog/cards/xlsum/welsh.json' 2026-05-27T11:54:05,376 adding 'unitxt/catalog/cards/xlsum/yoruba.json' 2026-05-27T11:54:05,378 adding 'unitxt/catalog/cards/xnli/ar.json' 2026-05-27T11:54:05,379 adding 'unitxt/catalog/cards/xnli/bg.json' 2026-05-27T11:54:05,380 adding 'unitxt/catalog/cards/xnli/de.json' 2026-05-27T11:54:05,382 adding 'unitxt/catalog/cards/xnli/el.json' 2026-05-27T11:54:05,383 adding 'unitxt/catalog/cards/xnli/en.json' 2026-05-27T11:54:05,384 adding 'unitxt/catalog/cards/xnli/es.json' 2026-05-27T11:54:05,385 adding 'unitxt/catalog/cards/xnli/fr.json' 2026-05-27T11:54:05,387 adding 'unitxt/catalog/cards/xnli/hi.json' 2026-05-27T11:54:05,388 adding 'unitxt/catalog/cards/xnli/ru.json' 2026-05-27T11:54:05,389 adding 'unitxt/catalog/cards/xnli/sw.json' 2026-05-27T11:54:05,390 adding 'unitxt/catalog/cards/xnli/th.json' 2026-05-27T11:54:05,392 adding 'unitxt/catalog/cards/xnli/tr.json' 2026-05-27T11:54:05,393 adding 'unitxt/catalog/cards/xnli/ur.json' 2026-05-27T11:54:05,394 adding 'unitxt/catalog/cards/xnli/vi.json' 2026-05-27T11:54:05,395 adding 'unitxt/catalog/cards/xnli/zh.json' 2026-05-27T11:54:05,397 adding 'unitxt/catalog/cards/xwinogrande/en.json' 2026-05-27T11:54:05,399 adding 'unitxt/catalog/cards/xwinogrande/jp.json' 2026-05-27T11:54:05,400 adding 'unitxt/catalog/cards/xwinogrande/pt.json' 2026-05-27T11:54:05,401 adding 'unitxt/catalog/cards/xwinogrande/ru.json' 2026-05-27T11:54:05,402 adding 'unitxt/catalog/cards/xwinogrande/zh.json' 2026-05-27T11:54:05,405 adding 'unitxt/catalog/engines/classification/gpt_4_turbo_2024_04_09_azure_openai.json' 2026-05-27T11:54:05,406 adding 'unitxt/catalog/engines/classification/gpt_4_turbo_open_ai.json' 2026-05-27T11:54:05,407 adding 'unitxt/catalog/engines/classification/gpt_4o_2024_08_06_azure_openai.json' 2026-05-27T11:54:05,409 adding 'unitxt/catalog/engines/classification/gpt_4o_open_ai.json' 2026-05-27T11:54:05,410 adding 'unitxt/catalog/engines/classification/gpt_oss_120b_rits.json' 2026-05-27T11:54:05,411 adding 'unitxt/catalog/engines/classification/gpt_oss_120b_watsonx.json' 2026-05-27T11:54:05,412 adding 'unitxt/catalog/engines/classification/llama3_3_ollama.json' 2026-05-27T11:54:05,413 adding 'unitxt/catalog/engines/classification/llama3_8b_ollama.json' 2026-05-27T11:54:05,414 adding 'unitxt/catalog/engines/classification/llama_3_1_405b_instruct_fp8_rits.json' 2026-05-27T11:54:05,416 adding 'unitxt/catalog/engines/classification/llama_3_1_70b_instruct_rits.json' 2026-05-27T11:54:05,417 adding 'unitxt/catalog/engines/classification/llama_3_1_70b_instruct_watsonx.json' 2026-05-27T11:54:05,418 adding 'unitxt/catalog/engines/classification/llama_3_1_70b_instruct_wml.json' 2026-05-27T11:54:05,419 adding 'unitxt/catalog/engines/classification/llama_3_3_70b_instruct_rits.json' 2026-05-27T11:54:05,420 adding 'unitxt/catalog/engines/classification/llama_3_3_70b_instruct_watsonx.json' 2026-05-27T11:54:05,422 adding 'unitxt/catalog/engines/classification/llama_3_3_70b_instruct_wml.json' 2026-05-27T11:54:05,423 adding 'unitxt/catalog/engines/classification/llama_3_405b_instruct_wml.json' 2026-05-27T11:54:05,424 adding 'unitxt/catalog/engines/classification/llama_4_maverick_17b_128e_instruct_fp8_rits.json' 2026-05-27T11:54:05,425 adding 'unitxt/catalog/engines/classification/llama_4_maverick_17b_128e_instruct_fp8_watsonx.json' 2026-05-27T11:54:05,426 adding 'unitxt/catalog/engines/classification/mistral_large_instruct_2407_rits.json' 2026-05-27T11:54:05,427 adding 'unitxt/catalog/engines/classification/mistral_large_watsonx.json' 2026-05-27T11:54:05,428 adding 'unitxt/catalog/engines/classification/mistral_small_3_1_24b_instruct_2503_wml.json' 2026-05-27T11:54:05,429 adding 'unitxt/catalog/engines/classification/mixtral_8x7b_instruct_v01_wml.json' 2026-05-27T11:54:05,431 adding 'unitxt/catalog/engines/cross_provider/llama_3_70b_instruct.json' 2026-05-27T11:54:05,432 adding 'unitxt/catalog/engines/cross_provider/llama_3_8b_instruct.json' 2026-05-27T11:54:05,433 adding 'unitxt/catalog/engines/ibm_wml/llama_3_3_70b_instruct.json' 2026-05-27T11:54:05,435 adding 'unitxt/catalog/engines/model/llama_3_8b_instruct.json' 2026-05-27T11:54:05,437 adding 'unitxt/catalog/engines/model/flan/t5_small/hf.json' 2026-05-27T11:54:05,438 adding 'unitxt/catalog/engines/ollama/llama2.json' 2026-05-27T11:54:05,440 adding 'unitxt/catalog/engines/openai/gpt_4o.json' 2026-05-27T11:54:05,441 adding 'unitxt/catalog/engines/rits/llama_3_1_405b_instruct_fp8.json' 2026-05-27T11:54:05,443 adding 'unitxt/catalog/engines/rits/llama_3_1_70b_instruct.json' 2026-05-27T11:54:05,444 adding 'unitxt/catalog/engines/rits/llama_3/1_8b_instruct.json' 2026-05-27T11:54:05,446 adding 'unitxt/catalog/formats/chat_api.json' 2026-05-27T11:54:05,447 adding 'unitxt/catalog/formats/chat_api_with_tokenizer_chat_template.json' 2026-05-27T11:54:05,448 adding 'unitxt/catalog/formats/deepseek_coder.json' 2026-05-27T11:54:05,449 adding 'unitxt/catalog/formats/empty.json' 2026-05-27T11:54:05,450 adding 'unitxt/catalog/formats/empty_input_output_separator.json' 2026-05-27T11:54:05,452 adding 'unitxt/catalog/formats/human_assistant.json' 2026-05-27T11:54:05,453 adding 'unitxt/catalog/formats/llama.json' 2026-05-27T11:54:05,454 adding 'unitxt/catalog/formats/llama2.json' 2026-05-27T11:54:05,455 adding 'unitxt/catalog/formats/llama3_instruct.json' 2026-05-27T11:54:05,456 adding 'unitxt/catalog/formats/llama3_instruct_all_demos_in_one_turn.json' 2026-05-27T11:54:05,458 adding 'unitxt/catalog/formats/llamaguard2.json' 2026-05-27T11:54:05,459 adding 'unitxt/catalog/formats/textual_assistant.json' 2026-05-27T11:54:05,460 adding 'unitxt/catalog/formats/user_agent.json' 2026-05-27T11:54:05,461 adding 'unitxt/catalog/formats/user_assistant.json' 2026-05-27T11:54:05,463 adding 'unitxt/catalog/formats/models/alpaca_instruct.json' 2026-05-27T11:54:05,464 adding 'unitxt/catalog/formats/models/granite_3_1_documents.json' 2026-05-27T11:54:05,465 adding 'unitxt/catalog/formats/models/llava.json' 2026-05-27T11:54:05,466 adding 'unitxt/catalog/formats/models/llava_interleave.json' 2026-05-27T11:54:05,468 adding 'unitxt/catalog/formats/models/phi_3.json' 2026-05-27T11:54:05,469 adding 'unitxt/catalog/formats/models/starling.json' 2026-05-27T11:54:05,471 adding 'unitxt/catalog/formats/models/flan/exq_exa.json' 2026-05-27T11:54:05,472 adding 'unitxt/catalog/formats/models/flan/few_shot.json' 2026-05-27T11:54:05,473 adding 'unitxt/catalog/formats/models/labradorite/few_shot.json' 2026-05-27T11:54:05,475 adding 'unitxt/catalog/formats/models/labradorite/zero_shot.json' 2026-05-27T11:54:05,476 adding 'unitxt/catalog/formats/models/mistral/instruction.json' 2026-05-27T11:54:05,478 adding 'unitxt/catalog/formats/models/mistral/instruction/with_system_prompt.json' 2026-05-27T11:54:05,481 adding 'unitxt/catalog/metrics/accuracy.json' 2026-05-27T11:54:05,482 adding 'unitxt/catalog/metrics/accuracy_binary.json' 2026-05-27T11:54:05,483 adding 'unitxt/catalog/metrics/anls.json' 2026-05-27T11:54:05,484 adding 'unitxt/catalog/metrics/bleu.json' 2026-05-27T11:54:05,485 adding 'unitxt/catalog/metrics/char_edit_dist_accuracy.json' 2026-05-27T11:54:05,486 adding 'unitxt/catalog/metrics/char_edit_distance.json' 2026-05-27T11:54:05,487 adding 'unitxt/catalog/metrics/exact_match_mm.json' 2026-05-27T11:54:05,488 adding 'unitxt/catalog/metrics/f1_binary.json' 2026-05-27T11:54:05,489 adding 'unitxt/catalog/metrics/f1_macro.json' 2026-05-27T11:54:05,490 adding 'unitxt/catalog/metrics/f1_macro_multi_label.json' 2026-05-27T11:54:05,491 adding 'unitxt/catalog/metrics/f1_micro.json' 2026-05-27T11:54:05,492 adding 'unitxt/catalog/metrics/f1_micro_multi_label.json' 2026-05-27T11:54:05,493 adding 'unitxt/catalog/metrics/f1_strings.json' 2026-05-27T11:54:05,494 adding 'unitxt/catalog/metrics/f1_weighted.json' 2026-05-27T11:54:05,496 adding 'unitxt/catalog/metrics/fin_qa_metric.json' 2026-05-27T11:54:05,497 adding 'unitxt/catalog/metrics/fuzzyner.json' 2026-05-27T11:54:05,498 adding 'unitxt/catalog/metrics/is_code_mixed.json' 2026-05-27T11:54:05,499 adding 'unitxt/catalog/metrics/jaccard_index.json' 2026-05-27T11:54:05,500 adding 'unitxt/catalog/metrics/jaccard_index_words.json' 2026-05-27T11:54:05,501 adding 'unitxt/catalog/metrics/kendalltau_b.json' 2026-05-27T11:54:05,502 adding 'unitxt/catalog/metrics/kpa.json' 2026-05-27T11:54:05,504 adding 'unitxt/catalog/metrics/map.json' 2026-05-27T11:54:05,505 adding 'unitxt/catalog/metrics/matthews_correlation.json' 2026-05-27T11:54:05,506 adding 'unitxt/catalog/metrics/max_accuracy_binary.json' 2026-05-27T11:54:05,507 adding 'unitxt/catalog/metrics/max_f1_binary.json' 2026-05-27T11:54:05,509 adding 'unitxt/catalog/metrics/mean_squared_error.json' 2026-05-27T11:54:05,510 adding 'unitxt/catalog/metrics/meteor.json' 2026-05-27T11:54:05,511 adding 'unitxt/catalog/metrics/meteor_hf.json' 2026-05-27T11:54:05,513 adding 'unitxt/catalog/metrics/metric_based_ner.json' 2026-05-27T11:54:05,514 adding 'unitxt/catalog/metrics/mrr.json' 2026-05-27T11:54:05,515 adding 'unitxt/catalog/metrics/ndcg.json' 2026-05-27T11:54:05,516 adding 'unitxt/catalog/metrics/ner.json' 2026-05-27T11:54:05,518 adding 'unitxt/catalog/metrics/normalized_sacrebleu.json' 2026-05-27T11:54:05,519 adding 'unitxt/catalog/metrics/pearson.json' 2026-05-27T11:54:05,520 adding 'unitxt/catalog/metrics/precision_binary.json' 2026-05-27T11:54:05,521 adding 'unitxt/catalog/metrics/precision_macro_multi_label.json' 2026-05-27T11:54:05,522 adding 'unitxt/catalog/metrics/precision_micro_multi_label.json' 2026-05-27T11:54:05,524 adding 'unitxt/catalog/metrics/prediction_length.json' 2026-05-27T11:54:05,525 adding 'unitxt/catalog/metrics/recall_binary.json' 2026-05-27T11:54:05,526 adding 'unitxt/catalog/metrics/recall_macro_multi_label.json' 2026-05-27T11:54:05,527 adding 'unitxt/catalog/metrics/recall_micro_multi_label.json' 2026-05-27T11:54:05,528 adding 'unitxt/catalog/metrics/regard_metric.json' 2026-05-27T11:54:05,529 adding 'unitxt/catalog/metrics/relaxed_correctness.json' 2026-05-27T11:54:05,530 adding 'unitxt/catalog/metrics/rerank_recall.json' 2026-05-27T11:54:05,532 adding 'unitxt/catalog/metrics/retrieval_at_k.json' 2026-05-27T11:54:05,533 adding 'unitxt/catalog/metrics/roc_auc.json' 2026-05-27T11:54:05,534 adding 'unitxt/catalog/metrics/root_mean_squared_error.json' 2026-05-27T11:54:05,535 adding 'unitxt/catalog/metrics/rouge.json' 2026-05-27T11:54:05,536 adding 'unitxt/catalog/metrics/rouge_with_confidence_intervals.json' 2026-05-27T11:54:05,538 adding 'unitxt/catalog/metrics/sacrebleu.json' 2026-05-27T11:54:05,539 adding 'unitxt/catalog/metrics/safety_metric.json' 2026-05-27T11:54:05,540 adding 'unitxt/catalog/metrics/spearman.json' 2026-05-27T11:54:05,541 adding 'unitxt/catalog/metrics/squad.json' 2026-05-27T11:54:05,542 adding 'unitxt/catalog/metrics/string_containment.json' 2026-05-27T11:54:05,544 adding 'unitxt/catalog/metrics/string_containment_ratio.json' 2026-05-27T11:54:05,545 adding 'unitxt/catalog/metrics/token_overlap.json' 2026-05-27T11:54:05,546 adding 'unitxt/catalog/metrics/token_overlap_with_context.json' 2026-05-27T11:54:05,547 adding 'unitxt/catalog/metrics/tool_calling.json' 2026-05-27T11:54:05,548 adding 'unitxt/catalog/metrics/unsorted_list_exact_match.json' 2026-05-27T11:54:05,549 adding 'unitxt/catalog/metrics/vectara_groundedness_hhem_2_1.json' 2026-05-27T11:54:05,551 adding 'unitxt/catalog/metrics/websrc_squad_f1.json' 2026-05-27T11:54:05,552 adding 'unitxt/catalog/metrics/weighted_win_rate_correlation.json' 2026-05-27T11:54:05,553 adding 'unitxt/catalog/metrics/wer.json' 2026-05-27T11:54:05,554 adding 'unitxt/catalog/metrics/bert_score/bert_base_uncased.json' 2026-05-27T11:54:05,555 adding 'unitxt/catalog/metrics/bert_score/deberta_base_mnli.json' 2026-05-27T11:54:05,556 adding 'unitxt/catalog/metrics/bert_score/deberta_large_mnli.json' 2026-05-27T11:54:05,558 adding 'unitxt/catalog/metrics/bert_score/deberta_v3_base_mnli_xnli_ml.json' 2026-05-27T11:54:05,559 adding 'unitxt/catalog/metrics/bert_score/deberta_xlarge_mnli.json' 2026-05-27T11:54:05,560 adding 'unitxt/catalog/metrics/bert_score/distilbert_base_uncased.json' 2026-05-27T11:54:05,562 adding 'unitxt/catalog/metrics/granite_guardian/agentic_risk/function_call.json' 2026-05-27T11:54:05,563 adding 'unitxt/catalog/metrics/granite_guardian/assistant_risk/harm.json' 2026-05-27T11:54:05,564 adding 'unitxt/catalog/metrics/granite_guardian/assistant_risk/profanity.json' 2026-05-27T11:54:05,565 adding 'unitxt/catalog/metrics/granite_guardian/assistant_risk/social_bias.json' 2026-05-27T11:54:05,566 adding 'unitxt/catalog/metrics/granite_guardian/assistant_risk/unethical_behavior.json' 2026-05-27T11:54:05,568 adding 'unitxt/catalog/metrics/granite_guardian/assistant_risk/violence.json' 2026-05-27T11:54:05,569 adding 'unitxt/catalog/metrics/granite_guardian/rag_risk/answer_relevance.json' 2026-05-27T11:54:05,570 adding 'unitxt/catalog/metrics/granite_guardian/rag_risk/context_relevance.json' 2026-05-27T11:54:05,571 adding 'unitxt/catalog/metrics/granite_guardian/rag_risk/groundedness.json' 2026-05-27T11:54:05,573 adding 'unitxt/catalog/metrics/granite_guardian/user_risk/harm.json' 2026-05-27T11:54:05,574 adding 'unitxt/catalog/metrics/granite_guardian/user_risk/jailbreak.json' 2026-05-27T11:54:05,575 adding 'unitxt/catalog/metrics/granite_guardian/user_risk/profanity.json' 2026-05-27T11:54:05,576 adding 'unitxt/catalog/metrics/granite_guardian/user_risk/social_bias.json' 2026-05-27T11:54:05,577 adding 'unitxt/catalog/metrics/granite_guardian/user_risk/unethical_behavior.json' 2026-05-27T11:54:05,579 adding 'unitxt/catalog/metrics/granite_guardian/user_risk/violence.json' 2026-05-27T11:54:05,580 adding 'unitxt/catalog/metrics/key_value_extraction/accuracy.json' 2026-05-27T11:54:05,581 adding 'unitxt/catalog/metrics/key_value_extraction/token_overlap.json' 2026-05-27T11:54:05,584 adding 'unitxt/catalog/metrics/llm_as_judge/binary/generic_inference_engine_answer_correctness_q_a_gt_loose.json' 2026-05-27T11:54:05,585 adding 'unitxt/catalog/metrics/llm_as_judge/binary/generic_inference_engine_answer_relevance_q_a.json' 2026-05-27T11:54:05,586 adding 'unitxt/catalog/metrics/llm_as_judge/binary/generic_inference_engine_context_relevance_q_c_ares.json' 2026-05-27T11:54:05,588 adding 'unitxt/catalog/metrics/llm_as_judge/binary/generic_inference_engine_correctness_holistic_q_c_a.json' 2026-05-27T11:54:05,589 adding 'unitxt/catalog/metrics/llm_as_judge/binary/generic_inference_engine_faithfulness_c_a.json' 2026-05-27T11:54:05,590 adding 'unitxt/catalog/metrics/llm_as_judge/binary/generic_inference_engine_faithfulness_q_c_a.json' 2026-05-27T11:54:05,591 adding 'unitxt/catalog/metrics/llm_as_judge/binary/llama_3_3_70b_instruct_wml_answer_correctness_q_a_gt_loose.json' 2026-05-27T11:54:05,592 adding 'unitxt/catalog/metrics/llm_as_judge/binary/llama_3_3_70b_instruct_wml_answer_correctness_q_a_gt_loose_logprobs.json' 2026-05-27T11:54:05,594 adding 'unitxt/catalog/metrics/llm_as_judge/binary/llama_3_3_70b_instruct_wml_answer_relevance_q_a.json' 2026-05-27T11:54:05,595 adding 'unitxt/catalog/metrics/llm_as_judge/binary/llama_3_3_70b_instruct_wml_answer_relevance_q_a_logprobs.json' 2026-05-27T11:54:05,596 adding 'unitxt/catalog/metrics/llm_as_judge/binary/llama_3_3_70b_instruct_wml_context_relevance_q_c_ares.json' 2026-05-27T11:54:05,597 adding 'unitxt/catalog/metrics/llm_as_judge/binary/llama_3_3_70b_instruct_wml_context_relevance_q_c_ares_logprobs.json' 2026-05-27T11:54:05,598 adding 'unitxt/catalog/metrics/llm_as_judge/binary/llama_3_3_70b_instruct_wml_correctness_holistic_q_c_a.json' 2026-05-27T11:54:05,600 adding 'unitxt/catalog/metrics/llm_as_judge/binary/llama_3_3_70b_instruct_wml_correctness_holistic_q_c_a_logprobs.json' 2026-05-27T11:54:05,601 adding 'unitxt/catalog/metrics/llm_as_judge/binary/llama_3_3_70b_instruct_wml_faithfulness_c_a.json' 2026-05-27T11:54:05,602 adding 'unitxt/catalog/metrics/llm_as_judge/binary/llama_3_3_70b_instruct_wml_faithfulness_c_a_logprobs.json' 2026-05-27T11:54:05,603 adding 'unitxt/catalog/metrics/llm_as_judge/binary/llama_3_3_70b_instruct_wml_faithfulness_q_c_a.json' 2026-05-27T11:54:05,604 adding 'unitxt/catalog/metrics/llm_as_judge/binary/llama_3_3_70b_instruct_wml_faithfulness_q_c_a_logprobs.json' 2026-05-27T11:54:05,606 adding 'unitxt/catalog/metrics/llm_as_judge/direct/aws/deepseek_v3.json' 2026-05-27T11:54:05,608 adding 'unitxt/catalog/metrics/llm_as_judge/direct/aws/llama3_1_405b.json' 2026-05-27T11:54:05,609 adding 'unitxt/catalog/metrics/llm_as_judge/direct/aws/llama3_3_70b.json' 2026-05-27T11:54:05,610 adding 'unitxt/catalog/metrics/llm_as_judge/direct/aws/llama4_maverick.json' 2026-05-27T11:54:05,611 adding 'unitxt/catalog/metrics/llm_as_judge/direct/aws/llama4_scout.json' 2026-05-27T11:54:05,612 adding 'unitxt/catalog/metrics/llm_as_judge/direct/aws/mixtral_large.json' 2026-05-27T11:54:05,614 adding 'unitxt/catalog/metrics/llm_as_judge/direct/azure_openai/gpt_4_1.json' 2026-05-27T11:54:05,615 adding 'unitxt/catalog/metrics/llm_as_judge/direct/azure_openai/gpt_4_1_mini.json' 2026-05-27T11:54:05,617 adding 'unitxt/catalog/metrics/llm_as_judge/direct/azure_openai/gpt_4_1_nano.json' 2026-05-27T11:54:05,618 adding 'unitxt/catalog/metrics/llm_as_judge/direct/azure_openai/gpt_4o.json' 2026-05-27T11:54:05,619 adding 'unitxt/catalog/metrics/llm_as_judge/direct/azure_openai/llama3_3_70b.json' 2026-05-27T11:54:05,620 adding 'unitxt/catalog/metrics/llm_as_judge/direct/azure_openai/llama4_maverick.json' 2026-05-27T11:54:05,622 adding 'unitxt/catalog/metrics/llm_as_judge/direct/azure_openai/llama4_scout.json' 2026-05-27T11:54:05,623 adding 'unitxt/catalog/metrics/llm_as_judge/direct/azure_openai/o1_mini.json' 2026-05-27T11:54:05,624 adding 'unitxt/catalog/metrics/llm_as_judge/direct/azure_openai/o1_preview.json' 2026-05-27T11:54:05,627 adding 'unitxt/catalog/metrics/llm_as_judge/direct/criteria/adherence_with_format.json' 2026-05-27T11:54:05,628 adding 'unitxt/catalog/metrics/llm_as_judge/direct/criteria/answer_completeness.json' 2026-05-27T11:54:05,630 adding 'unitxt/catalog/metrics/llm_as_judge/direct/criteria/answer_relevance.json' 2026-05-27T11:54:05,631 adding 'unitxt/catalog/metrics/llm_as_judge/direct/criteria/assistant_message_answer_relevance.json' 2026-05-27T11:54:05,632 adding 'unitxt/catalog/metrics/llm_as_judge/direct/criteria/assistant_message_compliance.json' 2026-05-27T11:54:05,633 adding 'unitxt/catalog/metrics/llm_as_judge/direct/criteria/assistant_message_general_harm.json' 2026-05-27T11:54:05,635 adding 'unitxt/catalog/metrics/llm_as_judge/direct/criteria/assistant_message_groundedness.json' 2026-05-27T11:54:05,636 adding 'unitxt/catalog/metrics/llm_as_judge/direct/criteria/assistant_message_profanity.json' 2026-05-27T11:54:05,637 adding 'unitxt/catalog/metrics/llm_as_judge/direct/criteria/assistant_message_social_bias.json' 2026-05-27T11:54:05,639 adding 'unitxt/catalog/metrics/llm_as_judge/direct/criteria/assistant_message_unethical_behavior.json' 2026-05-27T11:54:05,640 adding 'unitxt/catalog/metrics/llm_as_judge/direct/criteria/assistant_message_violence.json' 2026-05-27T11:54:05,641 adding 'unitxt/catalog/metrics/llm_as_judge/direct/criteria/coherence.json' 2026-05-27T11:54:05,642 adding 'unitxt/catalog/metrics/llm_as_judge/direct/criteria/conciseness.json' 2026-05-27T11:54:05,643 adding 'unitxt/catalog/metrics/llm_as_judge/direct/criteria/consistency.json' 2026-05-27T11:54:05,644 adding 'unitxt/catalog/metrics/llm_as_judge/direct/criteria/context_context_relevance.json' 2026-05-27T11:54:05,645 adding 'unitxt/catalog/metrics/llm_as_judge/direct/criteria/conversational.json' 2026-05-27T11:54:05,647 adding 'unitxt/catalog/metrics/llm_as_judge/direct/criteria/correctness_based_on_ground_truth.json' 2026-05-27T11:54:05,648 adding 'unitxt/catalog/metrics/llm_as_judge/direct/criteria/email_effectiveness.json' 2026-05-27T11:54:05,649 adding 'unitxt/catalog/metrics/llm_as_judge/direct/criteria/email_structure.json' 2026-05-27T11:54:05,650 adding 'unitxt/catalog/metrics/llm_as_judge/direct/criteria/empathy.json' 2026-05-27T11:54:05,651 adding 'unitxt/catalog/metrics/llm_as_judge/direct/criteria/engagement.json' 2026-05-27T11:54:05,653 adding 'unitxt/catalog/metrics/llm_as_judge/direct/criteria/examples_and_details.json' 2026-05-27T11:54:05,654 adding 'unitxt/catalog/metrics/llm_as_judge/direct/criteria/fluency.json' 2026-05-27T11:54:05,655 adding 'unitxt/catalog/metrics/llm_as_judge/direct/criteria/grammar_and_punctuation.json' 2026-05-27T11:54:05,656 adding 'unitxt/catalog/metrics/llm_as_judge/direct/criteria/harmfulness.json' 2026-05-27T11:54:05,657 adding 'unitxt/catalog/metrics/llm_as_judge/direct/criteria/information_from_reference.json' 2026-05-27T11:54:05,658 adding 'unitxt/catalog/metrics/llm_as_judge/direct/criteria/information_outside_reference.json' 2026-05-27T11:54:05,660 adding 'unitxt/catalog/metrics/llm_as_judge/direct/criteria/insensitivity.json' 2026-05-27T11:54:05,661 adding 'unitxt/catalog/metrics/llm_as_judge/direct/criteria/irrelevant_information.json' 2026-05-27T11:54:05,662 adding 'unitxt/catalog/metrics/llm_as_judge/direct/criteria/logical_validity_of_reasoning.json' 2026-05-27T11:54:05,663 adding 'unitxt/catalog/metrics/llm_as_judge/direct/criteria/manipulative_email.json' 2026-05-27T11:54:05,665 adding 'unitxt/catalog/metrics/llm_as_judge/direct/criteria/naturalness.json' 2026-05-27T11:54:05,666 adding 'unitxt/catalog/metrics/llm_as_judge/direct/criteria/objectivity.json' 2026-05-27T11:54:05,667 adding 'unitxt/catalog/metrics/llm_as_judge/direct/criteria/professional_tone.json' 2026-05-27T11:54:05,668 adding 'unitxt/catalog/metrics/llm_as_judge/direct/criteria/question_answer_quality.json' 2026-05-27T11:54:05,670 adding 'unitxt/catalog/metrics/llm_as_judge/direct/criteria/reference_document_faithfulness.json' 2026-05-27T11:54:05,671 adding 'unitxt/catalog/metrics/llm_as_judge/direct/criteria/relevance.json' 2026-05-27T11:54:05,672 adding 'unitxt/catalog/metrics/llm_as_judge/direct/criteria/step_by_step_reasoning_arithmetic.json' 2026-05-27T11:54:05,673 adding 'unitxt/catalog/metrics/llm_as_judge/direct/criteria/step_by_step_reasoning_bad_final_answer.json' 2026-05-27T11:54:05,674 adding 'unitxt/catalog/metrics/llm_as_judge/direct/criteria/step_by_step_reasoning_bad_grammar.json' 2026-05-27T11:54:05,676 adding 'unitxt/catalog/metrics/llm_as_judge/direct/criteria/step_by_step_reasoning_coherency.json' 2026-05-27T11:54:05,677 adding 'unitxt/catalog/metrics/llm_as_judge/direct/criteria/step_by_step_reasoning_commonsense.json' 2026-05-27T11:54:05,678 adding 'unitxt/catalog/metrics/llm_as_judge/direct/criteria/step_by_step_reasoning_contradiction.json' 2026-05-27T11:54:05,679 adding 'unitxt/catalog/metrics/llm_as_judge/direct/criteria/step_by_step_reasoning_hallucination.json' 2026-05-27T11:54:05,681 adding 'unitxt/catalog/metrics/llm_as_judge/direct/criteria/step_by_step_reasoning_missing_steps.json' 2026-05-27T11:54:05,682 adding 'unitxt/catalog/metrics/llm_as_judge/direct/criteria/step_by_step_reasoning_non_coherent.json' 2026-05-27T11:54:05,683 adding 'unitxt/catalog/metrics/llm_as_judge/direct/criteria/step_by_step_reasoning_non_factual.json' 2026-05-27T11:54:05,684 adding 'unitxt/catalog/metrics/llm_as_judge/direct/criteria/step_by_step_reasoning_overall_quality.json' 2026-05-27T11:54:05,685 adding 'unitxt/catalog/metrics/llm_as_judge/direct/criteria/step_by_step_reasoning_redundancy.json' 2026-05-27T11:54:05,686 adding 'unitxt/catalog/metrics/llm_as_judge/direct/criteria/step_by_step_reasoning_repetition.json' 2026-05-27T11:54:05,687 adding 'unitxt/catalog/metrics/llm_as_judge/direct/criteria/summarization_coherence.json' 2026-05-27T11:54:05,689 adding 'unitxt/catalog/metrics/llm_as_judge/direct/criteria/summarization_fluency.json' 2026-05-27T11:54:05,690 adding 'unitxt/catalog/metrics/llm_as_judge/direct/criteria/summarization_informativeness.json' 2026-05-27T11:54:05,691 adding 'unitxt/catalog/metrics/llm_as_judge/direct/criteria/summarization_preference.json' 2026-05-27T11:54:05,692 adding 'unitxt/catalog/metrics/llm_as_judge/direct/criteria/summarization_relevance.json' 2026-05-27T11:54:05,694 adding 'unitxt/catalog/metrics/llm_as_judge/direct/criteria/temperature_in_celsius_and_fahrenheit.json' 2026-05-27T11:54:05,695 adding 'unitxt/catalog/metrics/llm_as_judge/direct/criteria/tool_calling_correctness.json' 2026-05-27T11:54:05,696 adding 'unitxt/catalog/metrics/llm_as_judge/direct/criteria/toxicity.json' 2026-05-27T11:54:05,697 adding 'unitxt/catalog/metrics/llm_as_judge/direct/criteria/translation_quality.json' 2026-05-27T11:54:05,699 adding 'unitxt/catalog/metrics/llm_as_judge/direct/criteria/truthfulness.json' 2026-05-27T11:54:05,700 adding 'unitxt/catalog/metrics/llm_as_judge/direct/criteria/user_message_general_harm.json' 2026-05-27T11:54:05,701 adding 'unitxt/catalog/metrics/llm_as_judge/direct/criteria/user_message_jailbreak.json' 2026-05-27T11:54:05,702 adding 'unitxt/catalog/metrics/llm_as_judge/direct/criteria/user_message_profanity.json' 2026-05-27T11:54:05,704 adding 'unitxt/catalog/metrics/llm_as_judge/direct/criteria/user_message_social_bias.json' 2026-05-27T11:54:05,705 adding 'unitxt/catalog/metrics/llm_as_judge/direct/criteria/user_message_unethical_behavior.json' 2026-05-27T11:54:05,706 adding 'unitxt/catalog/metrics/llm_as_judge/direct/criteria/user_message_violence.json' 2026-05-27T11:54:05,708 adding 'unitxt/catalog/metrics/llm_as_judge/direct/ollama/granite3_3_8b.json' 2026-05-27T11:54:05,709 adding 'unitxt/catalog/metrics/llm_as_judge/direct/ollama/llama3_1_405b.json' 2026-05-27T11:54:05,710 adding 'unitxt/catalog/metrics/llm_as_judge/direct/ollama/llama3_1_70b.json' 2026-05-27T11:54:05,712 adding 'unitxt/catalog/metrics/llm_as_judge/direct/ollama/llama3_1_8b.json' 2026-05-27T11:54:05,713 adding 'unitxt/catalog/metrics/llm_as_judge/direct/ollama/llama3_3_70b.json' 2026-05-27T11:54:05,715 adding 'unitxt/catalog/metrics/llm_as_judge/direct/openai/gpt_4_1.json' 2026-05-27T11:54:05,716 adding 'unitxt/catalog/metrics/llm_as_judge/direct/openai/gpt_4_1_mini.json' 2026-05-27T11:54:05,717 adding 'unitxt/catalog/metrics/llm_as_judge/direct/openai/gpt_4_1_nano.json' 2026-05-27T11:54:05,718 adding 'unitxt/catalog/metrics/llm_as_judge/direct/openai/gpt_4o.json' 2026-05-27T11:54:05,720 adding 'unitxt/catalog/metrics/llm_as_judge/direct/openai/o1_mini.json' 2026-05-27T11:54:05,721 adding 'unitxt/catalog/metrics/llm_as_judge/direct/openai/o1_preview.json' 2026-05-27T11:54:05,723 adding 'unitxt/catalog/metrics/llm_as_judge/direct/replicate/gpt_4_1.json' 2026-05-27T11:54:05,724 adding 'unitxt/catalog/metrics/llm_as_judge/direct/replicate/llama4_maverick.json' 2026-05-27T11:54:05,726 adding 'unitxt/catalog/metrics/llm_as_judge/direct/replicate/llama4_scout.json' 2026-05-27T11:54:05,727 adding 'unitxt/catalog/metrics/llm_as_judge/direct/rits/deepseek_v3.json' 2026-05-27T11:54:05,729 adding 'unitxt/catalog/metrics/llm_as_judge/direct/rits/granite3_0_8b.json' 2026-05-27T11:54:05,730 adding 'unitxt/catalog/metrics/llm_as_judge/direct/rits/granite3_1_8b.json' 2026-05-27T11:54:05,731 adding 'unitxt/catalog/metrics/llm_as_judge/direct/rits/granite3_2_8b.json' 2026-05-27T11:54:05,732 adding 'unitxt/catalog/metrics/llm_as_judge/direct/rits/granite3_3_8b.json' 2026-05-27T11:54:05,733 adding 'unitxt/catalog/metrics/llm_as_judge/direct/rits/llama3_1_405b.json' 2026-05-27T11:54:05,734 adding 'unitxt/catalog/metrics/llm_as_judge/direct/rits/llama3_1_8b.json' 2026-05-27T11:54:05,735 adding 'unitxt/catalog/metrics/llm_as_judge/direct/rits/llama3_3_70b.json' 2026-05-27T11:54:05,737 adding 'unitxt/catalog/metrics/llm_as_judge/direct/rits/llama4_maverick.json' 2026-05-27T11:54:05,738 adding 'unitxt/catalog/metrics/llm_as_judge/direct/rits/llama4_scout.json' 2026-05-27T11:54:05,739 adding 'unitxt/catalog/metrics/llm_as_judge/direct/rits/mixtral8_7b.json' 2026-05-27T11:54:05,740 adding 'unitxt/catalog/metrics/llm_as_judge/direct/rits/mixtral_large.json' 2026-05-27T11:54:05,742 adding 'unitxt/catalog/metrics/llm_as_judge/direct/together_ai/deepseek_v3.json' 2026-05-27T11:54:05,743 adding 'unitxt/catalog/metrics/llm_as_judge/direct/together_ai/llama3_1_405b.json' 2026-05-27T11:54:05,744 adding 'unitxt/catalog/metrics/llm_as_judge/direct/together_ai/llama3_1_70b.json' 2026-05-27T11:54:05,745 adding 'unitxt/catalog/metrics/llm_as_judge/direct/together_ai/llama3_1_8b.json' 2026-05-27T11:54:05,747 adding 'unitxt/catalog/metrics/llm_as_judge/direct/together_ai/llama3_3_70b.json' 2026-05-27T11:54:05,748 adding 'unitxt/catalog/metrics/llm_as_judge/direct/together_ai/llama4_maverick.json' 2026-05-27T11:54:05,749 adding 'unitxt/catalog/metrics/llm_as_judge/direct/together_ai/llama4_scout.json' 2026-05-27T11:54:05,751 adding 'unitxt/catalog/metrics/llm_as_judge/direct/vertex_ai/gemini_2_5_flash.json' 2026-05-27T11:54:05,752 adding 'unitxt/catalog/metrics/llm_as_judge/direct/vertex_ai/gemmini_2_5_pro.json' 2026-05-27T11:54:05,754 adding 'unitxt/catalog/metrics/llm_as_judge/direct/watsonx/granite3_0_8b.json' 2026-05-27T11:54:05,755 adding 'unitxt/catalog/metrics/llm_as_judge/direct/watsonx/granite3_2_8b.json' 2026-05-27T11:54:05,756 adding 'unitxt/catalog/metrics/llm_as_judge/direct/watsonx/granite3_3_8b.json' 2026-05-27T11:54:05,757 adding 'unitxt/catalog/metrics/llm_as_judge/direct/watsonx/llama3_1_405b.json' 2026-05-27T11:54:05,759 adding 'unitxt/catalog/metrics/llm_as_judge/direct/watsonx/llama3_1_70b.json' 2026-05-27T11:54:05,760 adding 'unitxt/catalog/metrics/llm_as_judge/direct/watsonx/llama3_1_8b.json' 2026-05-27T11:54:05,761 adding 'unitxt/catalog/metrics/llm_as_judge/direct/watsonx/llama3_3_70b.json' 2026-05-27T11:54:05,762 adding 'unitxt/catalog/metrics/llm_as_judge/direct/watsonx/mixtral8_7b.json' 2026-05-27T11:54:05,763 adding 'unitxt/catalog/metrics/llm_as_judge/direct/watsonx/mixtral_large.json' 2026-05-27T11:54:05,766 adding 'unitxt/catalog/metrics/llm_as_judge/pairwise/aws/deepseek_v3.json' 2026-05-27T11:54:05,767 adding 'unitxt/catalog/metrics/llm_as_judge/pairwise/aws/llama3_1_405b.json' 2026-05-27T11:54:05,768 adding 'unitxt/catalog/metrics/llm_as_judge/pairwise/aws/llama3_3_70b.json' 2026-05-27T11:54:05,769 adding 'unitxt/catalog/metrics/llm_as_judge/pairwise/aws/llama4_maverick.json' 2026-05-27T11:54:05,771 adding 'unitxt/catalog/metrics/llm_as_judge/pairwise/aws/llama4_scout.json' 2026-05-27T11:54:05,772 adding 'unitxt/catalog/metrics/llm_as_judge/pairwise/aws/mixtral_large.json' 2026-05-27T11:54:05,774 adding 'unitxt/catalog/metrics/llm_as_judge/pairwise/azure_openai/gpt_4_1.json' 2026-05-27T11:54:05,775 adding 'unitxt/catalog/metrics/llm_as_judge/pairwise/azure_openai/gpt_4_1_mini.json' 2026-05-27T11:54:05,776 adding 'unitxt/catalog/metrics/llm_as_judge/pairwise/azure_openai/gpt_4_1_nano.json' 2026-05-27T11:54:05,778 adding 'unitxt/catalog/metrics/llm_as_judge/pairwise/azure_openai/gpt_4o.json' 2026-05-27T11:54:05,779 adding 'unitxt/catalog/metrics/llm_as_judge/pairwise/azure_openai/llama3_3_70b.json' 2026-05-27T11:54:05,780 adding 'unitxt/catalog/metrics/llm_as_judge/pairwise/azure_openai/llama4_maverick.json' 2026-05-27T11:54:05,781 adding 'unitxt/catalog/metrics/llm_as_judge/pairwise/azure_openai/llama4_scout.json' 2026-05-27T11:54:05,782 adding 'unitxt/catalog/metrics/llm_as_judge/pairwise/azure_openai/o1_mini.json' 2026-05-27T11:54:05,783 adding 'unitxt/catalog/metrics/llm_as_judge/pairwise/azure_openai/o1_preview.json' 2026-05-27T11:54:05,785 adding 'unitxt/catalog/metrics/llm_as_judge/pairwise/criteria/email_inclusivity.json' 2026-05-27T11:54:05,786 adding 'unitxt/catalog/metrics/llm_as_judge/pairwise/criteria/factually_consistent.json' 2026-05-27T11:54:05,787 adding 'unitxt/catalog/metrics/llm_as_judge/pairwise/criteria/funny_joke.json' 2026-05-27T11:54:05,789 adding 'unitxt/catalog/metrics/llm_as_judge/pairwise/criteria/inclusivity.json' 2026-05-27T11:54:05,790 adding 'unitxt/catalog/metrics/llm_as_judge/pairwise/criteria/reference_document_faithfulness.json' 2026-05-27T11:54:05,791 adding 'unitxt/catalog/metrics/llm_as_judge/pairwise/criteria/summarization_preference.json' 2026-05-27T11:54:05,792 adding 'unitxt/catalog/metrics/llm_as_judge/pairwise/criteria/temperature_in_celsius_and_fahrenheit.json' 2026-05-27T11:54:05,794 adding 'unitxt/catalog/metrics/llm_as_judge/pairwise/ollama/granite3_3_8b.json' 2026-05-27T11:54:05,795 adding 'unitxt/catalog/metrics/llm_as_judge/pairwise/ollama/llama3_1_405b.json' 2026-05-27T11:54:05,796 adding 'unitxt/catalog/metrics/llm_as_judge/pairwise/ollama/llama3_1_70b.json' 2026-05-27T11:54:05,798 adding 'unitxt/catalog/metrics/llm_as_judge/pairwise/ollama/llama3_1_8b.json' 2026-05-27T11:54:05,799 adding 'unitxt/catalog/metrics/llm_as_judge/pairwise/ollama/llama3_3_70b.json' 2026-05-27T11:54:05,800 adding 'unitxt/catalog/metrics/llm_as_judge/pairwise/openai/gpt_4_1.json' 2026-05-27T11:54:05,802 adding 'unitxt/catalog/metrics/llm_as_judge/pairwise/openai/gpt_4_1_mini.json' 2026-05-27T11:54:05,803 adding 'unitxt/catalog/metrics/llm_as_judge/pairwise/openai/gpt_4_1_nano.json' 2026-05-27T11:54:05,804 adding 'unitxt/catalog/metrics/llm_as_judge/pairwise/openai/gpt_4o.json' 2026-05-27T11:54:05,805 adding 'unitxt/catalog/metrics/llm_as_judge/pairwise/openai/o1_mini.json' 2026-05-27T11:54:05,806 adding 'unitxt/catalog/metrics/llm_as_judge/pairwise/openai/o1_preview.json' 2026-05-27T11:54:05,808 adding 'unitxt/catalog/metrics/llm_as_judge/pairwise/replicate/gpt_4_1.json' 2026-05-27T11:54:05,809 adding 'unitxt/catalog/metrics/llm_as_judge/pairwise/replicate/llama4_maverick.json' 2026-05-27T11:54:05,811 adding 'unitxt/catalog/metrics/llm_as_judge/pairwise/replicate/llama4_scout.json' 2026-05-27T11:54:05,812 adding 'unitxt/catalog/metrics/llm_as_judge/pairwise/rits/deepseek_v3.json' 2026-05-27T11:54:05,814 adding 'unitxt/catalog/metrics/llm_as_judge/pairwise/rits/granite3_0_8b.json' 2026-05-27T11:54:05,815 adding 'unitxt/catalog/metrics/llm_as_judge/pairwise/rits/granite3_1_8b.json' 2026-05-27T11:54:05,816 adding 'unitxt/catalog/metrics/llm_as_judge/pairwise/rits/granite3_2_8b.json' 2026-05-27T11:54:05,817 adding 'unitxt/catalog/metrics/llm_as_judge/pairwise/rits/granite3_3_8b.json' 2026-05-27T11:54:05,819 adding 'unitxt/catalog/metrics/llm_as_judge/pairwise/rits/llama3_1_405b.json' 2026-05-27T11:54:05,820 adding 'unitxt/catalog/metrics/llm_as_judge/pairwise/rits/llama3_1_8b.json' 2026-05-27T11:54:05,821 adding 'unitxt/catalog/metrics/llm_as_judge/pairwise/rits/llama3_3_70b.json' 2026-05-27T11:54:05,822 adding 'unitxt/catalog/metrics/llm_as_judge/pairwise/rits/llama4_maverick.json' 2026-05-27T11:54:05,823 adding 'unitxt/catalog/metrics/llm_as_judge/pairwise/rits/llama4_scout.json' 2026-05-27T11:54:05,825 adding 'unitxt/catalog/metrics/llm_as_judge/pairwise/rits/mixtral8_7b.json' 2026-05-27T11:54:05,826 adding 'unitxt/catalog/metrics/llm_as_judge/pairwise/rits/mixtral_large.json' 2026-05-27T11:54:05,828 adding 'unitxt/catalog/metrics/llm_as_judge/pairwise/together_ai/deepseek_v3.json' 2026-05-27T11:54:05,829 adding 'unitxt/catalog/metrics/llm_as_judge/pairwise/together_ai/llama3_1_405b.json' 2026-05-27T11:54:05,830 adding 'unitxt/catalog/metrics/llm_as_judge/pairwise/together_ai/llama3_1_70b.json' 2026-05-27T11:54:05,832 adding 'unitxt/catalog/metrics/llm_as_judge/pairwise/together_ai/llama3_1_8b.json' 2026-05-27T11:54:05,833 adding 'unitxt/catalog/metrics/llm_as_judge/pairwise/together_ai/llama3_3_70b.json' 2026-05-27T11:54:05,834 adding 'unitxt/catalog/metrics/llm_as_judge/pairwise/together_ai/llama4_maverick.json' 2026-05-27T11:54:05,836 adding 'unitxt/catalog/metrics/llm_as_judge/pairwise/together_ai/llama4_scout.json' 2026-05-27T11:54:05,837 adding 'unitxt/catalog/metrics/llm_as_judge/pairwise/vertex_ai/gemini_2_5_flash.json' 2026-05-27T11:54:05,839 adding 'unitxt/catalog/metrics/llm_as_judge/pairwise/vertex_ai/gemmini_2_5_pro.json' 2026-05-27T11:54:05,840 adding 'unitxt/catalog/metrics/llm_as_judge/pairwise/watsonx/granite3_0_8b.json' 2026-05-27T11:54:05,842 adding 'unitxt/catalog/metrics/llm_as_judge/pairwise/watsonx/granite3_2_8b.json' 2026-05-27T11:54:05,843 adding 'unitxt/catalog/metrics/llm_as_judge/pairwise/watsonx/granite3_3_8b.json' 2026-05-27T11:54:05,844 adding 'unitxt/catalog/metrics/llm_as_judge/pairwise/watsonx/llama3_1_405b.json' 2026-05-27T11:54:05,845 adding 'unitxt/catalog/metrics/llm_as_judge/pairwise/watsonx/llama3_1_70b.json' 2026-05-27T11:54:05,846 adding 'unitxt/catalog/metrics/llm_as_judge/pairwise/watsonx/llama3_1_8b.json' 2026-05-27T11:54:05,848 adding 'unitxt/catalog/metrics/llm_as_judge/pairwise/watsonx/llama3_3_70b.json' 2026-05-27T11:54:05,849 adding 'unitxt/catalog/metrics/llm_as_judge/pairwise/watsonx/mixtral8_7b.json' 2026-05-27T11:54:05,850 adding 'unitxt/catalog/metrics/llm_as_judge/pairwise/watsonx/mixtral_large.json' 2026-05-27T11:54:05,852 adding 'unitxt/catalog/metrics/llm_as_judge/pairwise_comparative_rating/llama_3_70b_instruct_generic_engine_template_arena_hard.json' 2026-05-27T11:54:05,853 adding 'unitxt/catalog/metrics/llm_as_judge/pairwise_comparative_rating/llama_3_70b_instruct_generic_engine_template_arena_hard_with_shuffling.json' 2026-05-27T11:54:05,854 adding 'unitxt/catalog/metrics/llm_as_judge/pairwise_comparative_rating/llama_3_70b_instruct_ibm_wml_template_arena_hard.json' 2026-05-27T11:54:05,855 adding 'unitxt/catalog/metrics/llm_as_judge/pairwise_comparative_rating/llama_3_70b_instruct_ibm_wml_template_arena_hard_with_shuffling.json' 2026-05-27T11:54:05,857 adding 'unitxt/catalog/metrics/llm_as_judge/pairwise_comparative_rating/llama_3_8b_instruct_generic_engine_template_arena_hard.json' 2026-05-27T11:54:05,858 adding 'unitxt/catalog/metrics/llm_as_judge/pairwise_comparative_rating/llama_3_8b_instruct_generic_engine_template_arena_hard_with_shuffling.json' 2026-05-27T11:54:05,860 adding 'unitxt/catalog/metrics/llm_as_judge/pairwise_comparative_rating/llama_3_3_70b_instruct/template_arena_hard.json' 2026-05-27T11:54:05,861 adding 'unitxt/catalog/metrics/llm_as_judge/pairwise_comparative_rating/llama_3_70b_instruct/template_arena_hard.json' 2026-05-27T11:54:05,863 adding 'unitxt/catalog/metrics/llm_as_judge/pairwise_comparative_rating/llama_3_8b_instruct/template_arena_hard.json' 2026-05-27T11:54:05,865 adding 'unitxt/catalog/metrics/llm_as_judge/rating/llama_3_1_70b_instruct_cross_provider_template_table2text_single_turn_with_reference.json' 2026-05-27T11:54:05,866 adding 'unitxt/catalog/metrics/llm_as_judge/rating/llama_3_70b_instruct_template_table2text_single_turn_with_reference.json' 2026-05-27T11:54:05,868 adding 'unitxt/catalog/metrics/llm_as_judge/rating/mistral_7b_instruct_v0_2_huggingface_template_mt_bench_single_turn.json' 2026-05-27T11:54:05,870 adding 'unitxt/catalog/metrics/llm_as_judge/rating/llama_3_70b_instruct/generic_single_turn.json' 2026-05-27T11:54:05,871 adding 'unitxt/catalog/metrics/llm_as_judge/rating/llama_3_70b_instruct/generic_single_turn_with_reference.json' 2026-05-27T11:54:05,872 adding 'unitxt/catalog/metrics/llm_as_judge/rating/llama_3_70b_instruct/mt_bench_single_turn.json' 2026-05-27T11:54:05,874 adding 'unitxt/catalog/metrics/llm_as_judge/rating/llama_3_8b_instruct/mt_bench_single_turn.json' 2026-05-27T11:54:05,876 adding 'unitxt/catalog/metrics/llm_as_judge/safety/llama_3_3_70b_instruct_ibm_watsonx_template_harm_rating.json' 2026-05-27T11:54:05,878 adding 'unitxt/catalog/metrics/llm_as_judge/safety/llamaguard.json' 2026-05-27T11:54:05,879 adding 'unitxt/catalog/metrics/multi_turn/accuracy.json' 2026-05-27T11:54:05,880 adding 'unitxt/catalog/metrics/multi_turn/sequential_success_accuracy.json' 2026-05-27T11:54:05,882 adding 'unitxt/catalog/metrics/perplexity/flan_t5_small.json' 2026-05-27T11:54:05,884 adding 'unitxt/catalog/metrics/perplexity_a/flan_t5_small.json' 2026-05-27T11:54:05,885 adding 'unitxt/catalog/metrics/perplexity_chat/flan_t5_small.json' 2026-05-27T11:54:05,887 adding 'unitxt/catalog/metrics/perplexity_nli/t5_nli_mixture.json' 2026-05-27T11:54:05,888 adding 'unitxt/catalog/metrics/perplexity_q/flan_t5_small.json' 2026-05-27T11:54:05,890 adding 'unitxt/catalog/metrics/qa/open/recommended_llm_as_judge.json' 2026-05-27T11:54:05,891 adding 'unitxt/catalog/metrics/qa/open/recommended_local_gpu.json' 2026-05-27T11:54:05,892 adding 'unitxt/catalog/metrics/qa/open/recommended_no_gpu.json' 2026-05-27T11:54:05,894 adding 'unitxt/catalog/metrics/rag/answer_correctness.json' 2026-05-27T11:54:05,895 adding 'unitxt/catalog/metrics/rag/answer_inference.json' 2026-05-27T11:54:05,897 adding 'unitxt/catalog/metrics/rag/answer_reward.json' 2026-05-27T11:54:05,898 adding 'unitxt/catalog/metrics/rag/context_correctness.json' 2026-05-27T11:54:05,899 adding 'unitxt/catalog/metrics/rag/context_perplexity.json' 2026-05-27T11:54:05,900 adding 'unitxt/catalog/metrics/rag/context_relevance.json' 2026-05-27T11:54:05,901 adding 'unitxt/catalog/metrics/rag/faithfulness.json' 2026-05-27T11:54:05,903 adding 'unitxt/catalog/metrics/rag/granite_guardian_answer_relevance.json' 2026-05-27T11:54:05,904 adding 'unitxt/catalog/metrics/rag/granite_guardian_context_relevance.json' 2026-05-27T11:54:05,905 adding 'unitxt/catalog/metrics/rag/granite_guardian_groundedness.json' 2026-05-27T11:54:05,907 adding 'unitxt/catalog/metrics/rag/answer_correctness/bert_score_recall.json' 2026-05-27T11:54:05,908 adding 'unitxt/catalog/metrics/rag/answer_correctness/bert_score_recall_ml.json' 2026-05-27T11:54:05,910 adding 'unitxt/catalog/metrics/rag/answer_correctness/generic_inference_engine_q_a_gt_loose.json' 2026-05-27T11:54:05,911 adding 'unitxt/catalog/metrics/rag/answer_correctness/generic_inference_engine_q_a_gt_loose_numeric.json' 2026-05-27T11:54:05,912 adding 'unitxt/catalog/metrics/rag/answer_correctness/llama_3_3_70b_instruct_wml_q_a_gt_loose.json' 2026-05-27T11:54:05,914 adding 'unitxt/catalog/metrics/rag/answer_correctness/llama_3_3_70b_instruct_wml_q_a_gt_loose_logprobs.json' 2026-05-27T11:54:05,915 adding 'unitxt/catalog/metrics/rag/answer_correctness/llama_3_3_70b_instruct_wml_q_a_gt_loose_numeric.json' 2026-05-27T11:54:05,916 adding 'unitxt/catalog/metrics/rag/answer_correctness/sentence_bert_bge.json' 2026-05-27T11:54:05,918 adding 'unitxt/catalog/metrics/rag/answer_correctness/sentence_bert_mini_lm.json' 2026-05-27T11:54:05,919 adding 'unitxt/catalog/metrics/rag/answer_correctness/token_recall.json' 2026-05-27T11:54:05,921 adding 'unitxt/catalog/metrics/rag/answer_relevance/generic_inference_engine_q_a.json' 2026-05-27T11:54:05,923 adding 'unitxt/catalog/metrics/rag/answer_relevance/generic_inference_engine_q_a_numeric.json' 2026-05-27T11:54:05,924 adding 'unitxt/catalog/metrics/rag/answer_relevance/llama_3_3_70b_instruct_wml_q_a.json' 2026-05-27T11:54:05,925 adding 'unitxt/catalog/metrics/rag/answer_relevance/llama_3_3_70b_instruct_wml_q_a_logprobs.json' 2026-05-27T11:54:05,927 adding 'unitxt/catalog/metrics/rag/answer_relevance/llama_3_3_70b_instruct_wml_q_a_numeric.json' 2026-05-27T11:54:05,928 adding 'unitxt/catalog/metrics/rag/answer_relevance/token_recall.json' 2026-05-27T11:54:05,930 adding 'unitxt/catalog/metrics/rag/context_correctness/map.json' 2026-05-27T11:54:05,931 adding 'unitxt/catalog/metrics/rag/context_correctness/mrr.json' 2026-05-27T11:54:05,932 adding 'unitxt/catalog/metrics/rag/context_correctness/retrieval_at_k.json' 2026-05-27T11:54:05,934 adding 'unitxt/catalog/metrics/rag/context_relevance/generic_inference_engine_q_c_ares.json' 2026-05-27T11:54:05,935 adding 'unitxt/catalog/metrics/rag/context_relevance/generic_inference_engine_q_c_ares_numeric.json' 2026-05-27T11:54:05,936 adding 'unitxt/catalog/metrics/rag/context_relevance/llama_3_3_70b_instruct_wml_q_c_ares.json' 2026-05-27T11:54:05,937 adding 'unitxt/catalog/metrics/rag/context_relevance/llama_3_3_70b_instruct_wml_q_c_ares_logprobs.json' 2026-05-27T11:54:05,938 adding 'unitxt/catalog/metrics/rag/context_relevance/llama_3_3_70b_instruct_wml_q_c_ares_numeric.json' 2026-05-27T11:54:05,939 adding 'unitxt/catalog/metrics/rag/context_relevance/perplexity_flan_t5_small.json' 2026-05-27T11:54:05,941 adding 'unitxt/catalog/metrics/rag/context_relevance/sentence_bert_bge.json' 2026-05-27T11:54:05,942 adding 'unitxt/catalog/metrics/rag/context_relevance/sentence_bert_mini_lm.json' 2026-05-27T11:54:05,943 adding 'unitxt/catalog/metrics/rag/context_relevance/token_precision.json' 2026-05-27T11:54:05,945 adding 'unitxt/catalog/metrics/rag/correctness/llama_index_by_gpt_3_5_turbo.json' 2026-05-27T11:54:05,946 adding 'unitxt/catalog/metrics/rag/correctness/llama_index_by_mock.json' 2026-05-27T11:54:05,948 adding 'unitxt/catalog/metrics/rag/correctness_holistic/generic_inference_engine_q_c_a.json' 2026-05-27T11:54:05,949 adding 'unitxt/catalog/metrics/rag/correctness_holistic/generic_inference_engine_q_c_a_numeric.json' 2026-05-27T11:54:05,950 adding 'unitxt/catalog/metrics/rag/correctness_holistic/llama_3_3_70b_instruct_wml_q_c_a.json' 2026-05-27T11:54:05,952 adding 'unitxt/catalog/metrics/rag/correctness_holistic/llama_3_3_70b_instruct_wml_q_c_a_logprobs.json' 2026-05-27T11:54:05,953 adding 'unitxt/catalog/metrics/rag/correctness_holistic/llama_3_3_70b_instruct_wml_q_c_a_numeric.json' 2026-05-27T11:54:05,955 adding 'unitxt/catalog/metrics/rag/end_to_end/answer_correctness.json' 2026-05-27T11:54:05,956 adding 'unitxt/catalog/metrics/rag/end_to_end/answer_faithfulness.json' 2026-05-27T11:54:05,957 adding 'unitxt/catalog/metrics/rag/end_to_end/answer_reward.json' 2026-05-27T11:54:05,958 adding 'unitxt/catalog/metrics/rag/end_to_end/context_correctness.json' 2026-05-27T11:54:05,960 adding 'unitxt/catalog/metrics/rag/end_to_end/context_relevance.json' 2026-05-27T11:54:05,962 adding 'unitxt/catalog/metrics/rag/end_to_end/answer_correctness/bert_score_recall.json' 2026-05-27T11:54:05,963 adding 'unitxt/catalog/metrics/rag/end_to_end/answer_correctness/bert_score_recall_ml.json' 2026-05-27T11:54:05,964 adding 'unitxt/catalog/metrics/rag/end_to_end/answer_correctness/generic_inference_engine_judge.json' 2026-05-27T11:54:05,965 adding 'unitxt/catalog/metrics/rag/end_to_end/answer_correctness/gpt_4o_azure_judge.json' 2026-05-27T11:54:05,966 adding 'unitxt/catalog/metrics/rag/end_to_end/answer_correctness/gpt_oss_120b_rits_judge.json' 2026-05-27T11:54:05,968 adding 'unitxt/catalog/metrics/rag/end_to_end/answer_correctness/gpt_oss_120b_watsonx_judge.json' 2026-05-27T11:54:05,969 adding 'unitxt/catalog/metrics/rag/end_to_end/answer_correctness/llama_3_3_70b_instruct_rits_judge.json' 2026-05-27T11:54:05,970 adding 'unitxt/catalog/metrics/rag/end_to_end/answer_correctness/llama_3_3_70b_instruct_watsonx_judge.json' 2026-05-27T11:54:05,971 adding 'unitxt/catalog/metrics/rag/end_to_end/answer_correctness/llama_4_maverick_rits_judge.json' 2026-05-27T11:54:05,973 adding 'unitxt/catalog/metrics/rag/end_to_end/answer_correctness/llama_4_maverick_watsonx_judge.json' 2026-05-27T11:54:05,974 adding 'unitxt/catalog/metrics/rag/end_to_end/answer_correctness/mistral_large_instruct_rits_judge.json' 2026-05-27T11:54:05,975 adding 'unitxt/catalog/metrics/rag/end_to_end/answer_correctness/mistral_large_instruct_watsonx_judge.json' 2026-05-27T11:54:05,976 adding 'unitxt/catalog/metrics/rag/end_to_end/answer_correctness/mistral_small_3_1_24b_instruct_2503_wml_judge.json' 2026-05-27T11:54:05,977 adding 'unitxt/catalog/metrics/rag/end_to_end/answer_correctness/sentence_bert_bge.json' 2026-05-27T11:54:05,979 adding 'unitxt/catalog/metrics/rag/end_to_end/answer_correctness/sentence_bert_mini_lm.json' 2026-05-27T11:54:05,980 adding 'unitxt/catalog/metrics/rag/end_to_end/answer_correctness/token_recall.json' 2026-05-27T11:54:05,982 adding 'unitxt/catalog/metrics/rag/end_to_end/answer_relevance/answer_reward.json' 2026-05-27T11:54:05,983 adding 'unitxt/catalog/metrics/rag/end_to_end/answer_relevance/generic_inference_engine_judge.json' 2026-05-27T11:54:05,984 adding 'unitxt/catalog/metrics/rag/end_to_end/answer_relevance/gpt_4o_azure_judge.json' 2026-05-27T11:54:05,985 adding 'unitxt/catalog/metrics/rag/end_to_end/answer_relevance/gpt_oss_120b_rits_judge.json' 2026-05-27T11:54:05,986 adding 'unitxt/catalog/metrics/rag/end_to_end/answer_relevance/gpt_oss_120b_watsonx_judge.json' 2026-05-27T11:54:05,988 adding 'unitxt/catalog/metrics/rag/end_to_end/answer_relevance/llama_3_3_70b_instruct_rits_judge.json' 2026-05-27T11:54:05,989 adding 'unitxt/catalog/metrics/rag/end_to_end/answer_relevance/llama_3_3_70b_instruct_watsonx_judge.json' 2026-05-27T11:54:05,990 adding 'unitxt/catalog/metrics/rag/end_to_end/answer_relevance/llama_4_maverick_rits_judge.json' 2026-05-27T11:54:05,991 adding 'unitxt/catalog/metrics/rag/end_to_end/answer_relevance/llama_4_maverick_watsonx_judge.json' 2026-05-27T11:54:05,993 adding 'unitxt/catalog/metrics/rag/end_to_end/answer_relevance/mistral_large_instruct_rits_judge.json' 2026-05-27T11:54:05,994 adding 'unitxt/catalog/metrics/rag/end_to_end/answer_relevance/mistral_large_instruct_watsonx_judge.json' 2026-05-27T11:54:05,995 adding 'unitxt/catalog/metrics/rag/end_to_end/answer_relevance/mistral_small_3_1_24b_instruct_2503_wml_judge.json' 2026-05-27T11:54:05,996 adding 'unitxt/catalog/metrics/rag/end_to_end/answer_relevance/token_recall.json' 2026-05-27T11:54:05,998 adding 'unitxt/catalog/metrics/rag/end_to_end/context_correctness/map.json' 2026-05-27T11:54:05,999 adding 'unitxt/catalog/metrics/rag/end_to_end/context_correctness/mrr.json' 2026-05-27T11:54:06,001 adding 'unitxt/catalog/metrics/rag/end_to_end/context_correctness/retrieval_at_k.json' 2026-05-27T11:54:06,002 adding 'unitxt/catalog/metrics/rag/end_to_end/context_relevance/generic_inference_engine_judge.json' 2026-05-27T11:54:06,004 adding 'unitxt/catalog/metrics/rag/end_to_end/context_relevance/gpt_4o_azure_judge.json' 2026-05-27T11:54:06,005 adding 'unitxt/catalog/metrics/rag/end_to_end/context_relevance/gpt_oss_120b_rits_judge.json' 2026-05-27T11:54:06,006 adding 'unitxt/catalog/metrics/rag/end_to_end/context_relevance/gpt_oss_120b_watsonx_judge.json' 2026-05-27T11:54:06,007 adding 'unitxt/catalog/metrics/rag/end_to_end/context_relevance/llama_3_3_70b_instruct_rits_judge.json' 2026-05-27T11:54:06,009 adding 'unitxt/catalog/metrics/rag/end_to_end/context_relevance/llama_3_3_70b_instruct_watsonx_judge.json' 2026-05-27T11:54:06,010 adding 'unitxt/catalog/metrics/rag/end_to_end/context_relevance/llama_4_maverick_rits_judge.json' 2026-05-27T11:54:06,011 adding 'unitxt/catalog/metrics/rag/end_to_end/context_relevance/llama_4_maverick_watsonx_judge.json' 2026-05-27T11:54:06,012 adding 'unitxt/catalog/metrics/rag/end_to_end/context_relevance/mistral_large_instruct_rits_judge.json' 2026-05-27T11:54:06,014 adding 'unitxt/catalog/metrics/rag/end_to_end/context_relevance/mistral_large_instruct_watsonx_judge.json' 2026-05-27T11:54:06,015 adding 'unitxt/catalog/metrics/rag/end_to_end/context_relevance/mistral_small_3_1_24b_instruct_2503_wml_judge.json' 2026-05-27T11:54:06,016 adding 'unitxt/catalog/metrics/rag/end_to_end/context_relevance/perplexity_flan_t5_small.json' 2026-05-27T11:54:06,018 adding 'unitxt/catalog/metrics/rag/end_to_end/context_relevance/sentence_bert_bge.json' 2026-05-27T11:54:06,019 adding 'unitxt/catalog/metrics/rag/end_to_end/context_relevance/sentence_bert_mini_lm.json' 2026-05-27T11:54:06,020 adding 'unitxt/catalog/metrics/rag/end_to_end/context_relevance/token_precision.json' 2026-05-27T11:54:06,022 adding 'unitxt/catalog/metrics/rag/end_to_end/faithfulness/bert_score_k_precision.json' 2026-05-27T11:54:06,023 adding 'unitxt/catalog/metrics/rag/end_to_end/faithfulness/bert_score_k_precision_ml.json' 2026-05-27T11:54:06,024 adding 'unitxt/catalog/metrics/rag/end_to_end/faithfulness/generic_inference_engine_judge.json' 2026-05-27T11:54:06,026 adding 'unitxt/catalog/metrics/rag/end_to_end/faithfulness/gpt_4o_azure_judge.json' 2026-05-27T11:54:06,027 adding 'unitxt/catalog/metrics/rag/end_to_end/faithfulness/gpt_oss_120b_rits_judge.json' 2026-05-27T11:54:06,028 adding 'unitxt/catalog/metrics/rag/end_to_end/faithfulness/gpt_oss_120b_watsonx_judge.json' 2026-05-27T11:54:06,029 adding 'unitxt/catalog/metrics/rag/end_to_end/faithfulness/llama_3_3_70b_instruct_rits_judge.json' 2026-05-27T11:54:06,031 adding 'unitxt/catalog/metrics/rag/end_to_end/faithfulness/llama_3_3_70b_instruct_watsonx_judge.json' 2026-05-27T11:54:06,032 adding 'unitxt/catalog/metrics/rag/end_to_end/faithfulness/llama_4_maverick_rits_judge.json' 2026-05-27T11:54:06,033 adding 'unitxt/catalog/metrics/rag/end_to_end/faithfulness/llama_4_maverick_watsonx_judge.json' 2026-05-27T11:54:06,034 adding 'unitxt/catalog/metrics/rag/end_to_end/faithfulness/mistral_large_instruct_rits_judge.json' 2026-05-27T11:54:06,035 adding 'unitxt/catalog/metrics/rag/end_to_end/faithfulness/mistral_large_instruct_watsonx_judge.json' 2026-05-27T11:54:06,037 adding 'unitxt/catalog/metrics/rag/end_to_end/faithfulness/mistral_small_3_1_24b_instruct_2503_wml_judge.json' 2026-05-27T11:54:06,038 adding 'unitxt/catalog/metrics/rag/end_to_end/faithfulness/sentence_bert_bge.json' 2026-05-27T11:54:06,039 adding 'unitxt/catalog/metrics/rag/end_to_end/faithfulness/sentence_bert_mini_lm.json' 2026-05-27T11:54:06,040 adding 'unitxt/catalog/metrics/rag/end_to_end/faithfulness/token_k_precision.json' 2026-05-27T11:54:06,041 adding 'unitxt/catalog/metrics/rag/end_to_end/faithfulness/vectara_hhem_2_1.json' 2026-05-27T11:54:06,044 adding 'unitxt/catalog/metrics/rag/end_to_end/recommended/cpu_only/all.json' 2026-05-27T11:54:06,045 adding 'unitxt/catalog/metrics/rag/end_to_end/recommended/llmaj_azure/all.json' 2026-05-27T11:54:06,047 adding 'unitxt/catalog/metrics/rag/end_to_end/recommended/llmaj_rits/all.json' 2026-05-27T11:54:06,048 adding 'unitxt/catalog/metrics/rag/end_to_end/recommended/llmaj_watsonx/all.json' 2026-05-27T11:54:06,050 adding 'unitxt/catalog/metrics/rag/end_to_end/recommended/small_llm/all.json' 2026-05-27T11:54:06,052 adding 'unitxt/catalog/metrics/rag/external_rag/answer_correctness.json' 2026-05-27T11:54:06,053 adding 'unitxt/catalog/metrics/rag/external_rag/answer_reward.json' 2026-05-27T11:54:06,054 adding 'unitxt/catalog/metrics/rag/external_rag/context_correctness.json' 2026-05-27T11:54:06,056 adding 'unitxt/catalog/metrics/rag/external_rag/context_relevance.json' 2026-05-27T11:54:06,057 adding 'unitxt/catalog/metrics/rag/external_rag/faithfulness.json' 2026-05-27T11:54:06,059 adding 'unitxt/catalog/metrics/rag/external_rag/answer_correctness/bert_score_recall.json' 2026-05-27T11:54:06,060 adding 'unitxt/catalog/metrics/rag/external_rag/answer_correctness/bert_score_recall_ml.json' 2026-05-27T11:54:06,062 adding 'unitxt/catalog/metrics/rag/external_rag/answer_correctness/generic_inference_engine_judge.json' 2026-05-27T11:54:06,063 adding 'unitxt/catalog/metrics/rag/external_rag/answer_correctness/gpt_4o_azure_judge.json' 2026-05-27T11:54:06,064 adding 'unitxt/catalog/metrics/rag/external_rag/answer_correctness/gpt_oss_120b_rits_judge.json' 2026-05-27T11:54:06,065 adding 'unitxt/catalog/metrics/rag/external_rag/answer_correctness/gpt_oss_120b_watsonx_judge.json' 2026-05-27T11:54:06,067 adding 'unitxt/catalog/metrics/rag/external_rag/answer_correctness/llama_3_3_70b_instruct_rits_judge.json' 2026-05-27T11:54:06,068 adding 'unitxt/catalog/metrics/rag/external_rag/answer_correctness/llama_3_3_70b_instruct_watsonx_judge.json' 2026-05-27T11:54:06,069 adding 'unitxt/catalog/metrics/rag/external_rag/answer_correctness/llama_4_maverick_rits_judge.json' 2026-05-27T11:54:06,070 adding 'unitxt/catalog/metrics/rag/external_rag/answer_correctness/llama_4_maverick_watsonx_judge.json' 2026-05-27T11:54:06,071 adding 'unitxt/catalog/metrics/rag/external_rag/answer_correctness/mistral_large_instruct_rits_judge.json' 2026-05-27T11:54:06,072 adding 'unitxt/catalog/metrics/rag/external_rag/answer_correctness/mistral_large_instruct_watsonx_judge.json' 2026-05-27T11:54:06,074 adding 'unitxt/catalog/metrics/rag/external_rag/answer_correctness/mistral_small_3_1_24b_instruct_2503_wml_judge.json' 2026-05-27T11:54:06,075 adding 'unitxt/catalog/metrics/rag/external_rag/answer_correctness/sentence_bert_bge.json' 2026-05-27T11:54:06,076 adding 'unitxt/catalog/metrics/rag/external_rag/answer_correctness/sentence_bert_mini_lm.json' 2026-05-27T11:54:06,077 adding 'unitxt/catalog/metrics/rag/external_rag/answer_correctness/token_recall.json' 2026-05-27T11:54:06,079 adding 'unitxt/catalog/metrics/rag/external_rag/answer_relevance/answer_reward.json' 2026-05-27T11:54:06,080 adding 'unitxt/catalog/metrics/rag/external_rag/answer_relevance/generic_inference_engine_judge.json' 2026-05-27T11:54:06,081 adding 'unitxt/catalog/metrics/rag/external_rag/answer_relevance/gpt_4o_azure_judge.json' 2026-05-27T11:54:06,083 adding 'unitxt/catalog/metrics/rag/external_rag/answer_relevance/gpt_oss_120b_rits_judge.json' 2026-05-27T11:54:06,084 adding 'unitxt/catalog/metrics/rag/external_rag/answer_relevance/gpt_oss_120b_watsonx_judge.json' 2026-05-27T11:54:06,085 adding 'unitxt/catalog/metrics/rag/external_rag/answer_relevance/llama_3_3_70b_instruct_rits_judge.json' 2026-05-27T11:54:06,086 adding 'unitxt/catalog/metrics/rag/external_rag/answer_relevance/llama_3_3_70b_instruct_watsonx_judge.json' 2026-05-27T11:54:06,087 adding 'unitxt/catalog/metrics/rag/external_rag/answer_relevance/llama_4_maverick_rits_judge.json' 2026-05-27T11:54:06,089 adding 'unitxt/catalog/metrics/rag/external_rag/answer_relevance/llama_4_maverick_watsonx_judge.json' 2026-05-27T11:54:06,090 adding 'unitxt/catalog/metrics/rag/external_rag/answer_relevance/mistral_large_instruct_rits_judge.json' 2026-05-27T11:54:06,091 adding 'unitxt/catalog/metrics/rag/external_rag/answer_relevance/mistral_large_instruct_watsonx_judge.json' 2026-05-27T11:54:06,092 adding 'unitxt/catalog/metrics/rag/external_rag/answer_relevance/mistral_small_3_1_24b_instruct_2503_wml_judge.json' 2026-05-27T11:54:06,093 adding 'unitxt/catalog/metrics/rag/external_rag/answer_relevance/token_recall.json' 2026-05-27T11:54:06,095 adding 'unitxt/catalog/metrics/rag/external_rag/context_correctness/map.json' 2026-05-27T11:54:06,097 adding 'unitxt/catalog/metrics/rag/external_rag/context_correctness/mrr.json' 2026-05-27T11:54:06,098 adding 'unitxt/catalog/metrics/rag/external_rag/context_correctness/retrieval_at_k.json' 2026-05-27T11:54:06,100 adding 'unitxt/catalog/metrics/rag/external_rag/context_relevance/generic_inference_engine_judge.json' 2026-05-27T11:54:06,101 adding 'unitxt/catalog/metrics/rag/external_rag/context_relevance/gpt_4o_azure_judge.json' 2026-05-27T11:54:06,102 adding 'unitxt/catalog/metrics/rag/external_rag/context_relevance/gpt_oss_120b_rits_judge.json' 2026-05-27T11:54:06,104 adding 'unitxt/catalog/metrics/rag/external_rag/context_relevance/gpt_oss_120b_watsonx_judge.json' 2026-05-27T11:54:06,105 adding 'unitxt/catalog/metrics/rag/external_rag/context_relevance/llama_3_3_70b_instruct_rits_judge.json' 2026-05-27T11:54:06,106 adding 'unitxt/catalog/metrics/rag/external_rag/context_relevance/llama_3_3_70b_instruct_watsonx_judge.json' 2026-05-27T11:54:06,107 adding 'unitxt/catalog/metrics/rag/external_rag/context_relevance/llama_4_maverick_rits_judge.json' 2026-05-27T11:54:06,109 adding 'unitxt/catalog/metrics/rag/external_rag/context_relevance/llama_4_maverick_watsonx_judge.json' 2026-05-27T11:54:06,110 adding 'unitxt/catalog/metrics/rag/external_rag/context_relevance/mistral_large_instruct_rits_judge.json' 2026-05-27T11:54:06,111 adding 'unitxt/catalog/metrics/rag/external_rag/context_relevance/mistral_large_instruct_watsonx_judge.json' 2026-05-27T11:54:06,113 adding 'unitxt/catalog/metrics/rag/external_rag/context_relevance/mistral_small_3_1_24b_instruct_2503_wml_judge.json' 2026-05-27T11:54:06,114 adding 'unitxt/catalog/metrics/rag/external_rag/context_relevance/perplexity_flan_t5_small.json' 2026-05-27T11:54:06,115 adding 'unitxt/catalog/metrics/rag/external_rag/context_relevance/sentence_bert_bge.json' 2026-05-27T11:54:06,116 adding 'unitxt/catalog/metrics/rag/external_rag/context_relevance/sentence_bert_mini_lm.json' 2026-05-27T11:54:06,117 adding 'unitxt/catalog/metrics/rag/external_rag/context_relevance/token_precision.json' 2026-05-27T11:54:06,119 adding 'unitxt/catalog/metrics/rag/external_rag/faithfulness/bert_score_k_precision.json' 2026-05-27T11:54:06,121 adding 'unitxt/catalog/metrics/rag/external_rag/faithfulness/bert_score_k_precision_ml.json' 2026-05-27T11:54:06,122 adding 'unitxt/catalog/metrics/rag/external_rag/faithfulness/generic_inference_engine_judge.json' 2026-05-27T11:54:06,123 adding 'unitxt/catalog/metrics/rag/external_rag/faithfulness/gpt_4o_azure_judge.json' 2026-05-27T11:54:06,124 adding 'unitxt/catalog/metrics/rag/external_rag/faithfulness/gpt_oss_120b_rits_judge.json' 2026-05-27T11:54:06,125 adding 'unitxt/catalog/metrics/rag/external_rag/faithfulness/gpt_oss_120b_watsonx_judge.json' 2026-05-27T11:54:06,127 adding 'unitxt/catalog/metrics/rag/external_rag/faithfulness/llama_3_3_70b_instruct_rits_judge.json' 2026-05-27T11:54:06,128 adding 'unitxt/catalog/metrics/rag/external_rag/faithfulness/llama_3_3_70b_instruct_watsonx_judge.json' 2026-05-27T11:54:06,129 adding 'unitxt/catalog/metrics/rag/external_rag/faithfulness/llama_4_maverick_rits_judge.json' 2026-05-27T11:54:06,130 adding 'unitxt/catalog/metrics/rag/external_rag/faithfulness/llama_4_maverick_watsonx_judge.json' 2026-05-27T11:54:06,131 adding 'unitxt/catalog/metrics/rag/external_rag/faithfulness/mistral_large_instruct_rits_judge.json' 2026-05-27T11:54:06,133 adding 'unitxt/catalog/metrics/rag/external_rag/faithfulness/mistral_large_instruct_watsonx_judge.json' 2026-05-27T11:54:06,134 adding 'unitxt/catalog/metrics/rag/external_rag/faithfulness/mistral_small_3_1_24b_instruct_2503_wml_judge.json' 2026-05-27T11:54:06,135 adding 'unitxt/catalog/metrics/rag/external_rag/faithfulness/sentence_bert_bge.json' 2026-05-27T11:54:06,136 adding 'unitxt/catalog/metrics/rag/external_rag/faithfulness/sentence_bert_mini_lm.json' 2026-05-27T11:54:06,138 adding 'unitxt/catalog/metrics/rag/external_rag/faithfulness/token_k_precision.json' 2026-05-27T11:54:06,139 adding 'unitxt/catalog/metrics/rag/external_rag/faithfulness/vectara_hhem_2_1.json' 2026-05-27T11:54:06,141 adding 'unitxt/catalog/metrics/rag/external_rag/recommended/cpu_only/all.json' 2026-05-27T11:54:06,143 adding 'unitxt/catalog/metrics/rag/external_rag/recommended/llmaj_azure/all.json' 2026-05-27T11:54:06,145 adding 'unitxt/catalog/metrics/rag/external_rag/recommended/llmaj_rits/all.json' 2026-05-27T11:54:06,146 adding 'unitxt/catalog/metrics/rag/external_rag/recommended/llmaj_watsonx/all.json' 2026-05-27T11:54:06,148 adding 'unitxt/catalog/metrics/rag/external_rag/recommended/small_llm/all.json' 2026-05-27T11:54:06,150 adding 'unitxt/catalog/metrics/rag/faithfulness/bert_score_k_precision.json' 2026-05-27T11:54:06,152 adding 'unitxt/catalog/metrics/rag/faithfulness/bert_score_k_precision_ml.json' 2026-05-27T11:54:06,153 adding 'unitxt/catalog/metrics/rag/faithfulness/generic_inference_engine_c_a.json' 2026-05-27T11:54:06,154 adding 'unitxt/catalog/metrics/rag/faithfulness/generic_inference_engine_c_a_verbal.json' 2026-05-27T11:54:06,155 adding 'unitxt/catalog/metrics/rag/faithfulness/generic_inference_engine_q_c_a.json' 2026-05-27T11:54:06,157 adding 'unitxt/catalog/metrics/rag/faithfulness/generic_inference_engine_q_c_a_verbal.json' 2026-05-27T11:54:06,158 adding 'unitxt/catalog/metrics/rag/faithfulness/llama_3_3_70b_instruct_wml_c_a.json' 2026-05-27T11:54:06,159 adding 'unitxt/catalog/metrics/rag/faithfulness/llama_3_3_70b_instruct_wml_c_a_logprobs.json' 2026-05-27T11:54:06,160 adding 'unitxt/catalog/metrics/rag/faithfulness/llama_3_3_70b_instruct_wml_c_a_verbal.json' 2026-05-27T11:54:06,161 adding 'unitxt/catalog/metrics/rag/faithfulness/llama_3_3_70b_instruct_wml_q_c_a.json' 2026-05-27T11:54:06,162 adding 'unitxt/catalog/metrics/rag/faithfulness/llama_3_3_70b_instruct_wml_q_c_a_logprobs.json' 2026-05-27T11:54:06,163 adding 'unitxt/catalog/metrics/rag/faithfulness/llama_3_3_70b_instruct_wml_q_c_a_verbal.json' 2026-05-27T11:54:06,165 adding 'unitxt/catalog/metrics/rag/faithfulness/llama_index_by_gpt_3_5_turbo.json' 2026-05-27T11:54:06,166 adding 'unitxt/catalog/metrics/rag/faithfulness/llama_index_by_mock.json' 2026-05-27T11:54:06,167 adding 'unitxt/catalog/metrics/rag/faithfulness/sentence_bert_bge.json' 2026-05-27T11:54:06,168 adding 'unitxt/catalog/metrics/rag/faithfulness/sentence_bert_mini_lm.json' 2026-05-27T11:54:06,170 adding 'unitxt/catalog/metrics/rag/faithfulness/token_k_precision.json' 2026-05-27T11:54:06,171 adding 'unitxt/catalog/metrics/rag/faithfulness/vectara_hhem_2_1.json' 2026-05-27T11:54:06,173 adding 'unitxt/catalog/metrics/rag/response_generation/adherence_with_format/llama_3_3_70b_instruct_judge.json' 2026-05-27T11:54:06,175 adding 'unitxt/catalog/metrics/rag/response_generation/answer_completeness/llama_3_3_70b_instruct_judge.json' 2026-05-27T11:54:06,177 adding 'unitxt/catalog/metrics/rag/response_generation/answer_correctness/bert_score_recall.json' 2026-05-27T11:54:06,178 adding 'unitxt/catalog/metrics/rag/response_generation/answer_correctness/bert_score_recall_ml.json' 2026-05-27T11:54:06,180 adding 'unitxt/catalog/metrics/rag/response_generation/answer_correctness/generic_inference_engine_judge.json' 2026-05-27T11:54:06,181 adding 'unitxt/catalog/metrics/rag/response_generation/answer_correctness/gpt_4o_azure_judge.json' 2026-05-27T11:54:06,182 adding 'unitxt/catalog/metrics/rag/response_generation/answer_correctness/gpt_oss_120b_rits_judge.json' 2026-05-27T11:54:06,183 adding 'unitxt/catalog/metrics/rag/response_generation/answer_correctness/gpt_oss_120b_watsonx_judge.json' 2026-05-27T11:54:06,185 adding 'unitxt/catalog/metrics/rag/response_generation/answer_correctness/llama_3_3_70b_instruct_rits_judge.json' 2026-05-27T11:54:06,186 adding 'unitxt/catalog/metrics/rag/response_generation/answer_correctness/llama_3_3_70b_instruct_watsonx_judge.json' 2026-05-27T11:54:06,187 adding 'unitxt/catalog/metrics/rag/response_generation/answer_correctness/llama_4_maverick_rits_judge.json' 2026-05-27T11:54:06,189 adding 'unitxt/catalog/metrics/rag/response_generation/answer_correctness/llama_4_maverick_watsonx_judge.json' 2026-05-27T11:54:06,190 adding 'unitxt/catalog/metrics/rag/response_generation/answer_correctness/mistral_large_instruct_rits_judge.json' 2026-05-27T11:54:06,191 adding 'unitxt/catalog/metrics/rag/response_generation/answer_correctness/mistral_large_instruct_watsonx_judge.json' 2026-05-27T11:54:06,192 adding 'unitxt/catalog/metrics/rag/response_generation/answer_correctness/mistral_small_3_1_24b_instruct_2503_wml_judge.json' 2026-05-27T11:54:06,194 adding 'unitxt/catalog/metrics/rag/response_generation/answer_correctness/sentence_bert_bge.json' 2026-05-27T11:54:06,195 adding 'unitxt/catalog/metrics/rag/response_generation/answer_correctness/sentence_bert_mini_lm.json' 2026-05-27T11:54:06,196 adding 'unitxt/catalog/metrics/rag/response_generation/answer_correctness/token_recall.json' 2026-05-27T11:54:06,198 adding 'unitxt/catalog/metrics/rag/response_generation/answer_relevance/answer_reward.json' 2026-05-27T11:54:06,199 adding 'unitxt/catalog/metrics/rag/response_generation/answer_relevance/generic_inference_engine_judge.json' 2026-05-27T11:54:06,201 adding 'unitxt/catalog/metrics/rag/response_generation/answer_relevance/gpt_4o_azure_judge.json' 2026-05-27T11:54:06,202 adding 'unitxt/catalog/metrics/rag/response_generation/answer_relevance/gpt_oss_120b_rits_judge.json' 2026-05-27T11:54:06,203 adding 'unitxt/catalog/metrics/rag/response_generation/answer_relevance/gpt_oss_120b_watsonx_judge.json' 2026-05-27T11:54:06,204 adding 'unitxt/catalog/metrics/rag/response_generation/answer_relevance/llama_3_3_70b_instruct_rits_judge.json' 2026-05-27T11:54:06,205 adding 'unitxt/catalog/metrics/rag/response_generation/answer_relevance/llama_3_3_70b_instruct_watsonx_judge.json' 2026-05-27T11:54:06,207 adding 'unitxt/catalog/metrics/rag/response_generation/answer_relevance/llama_4_maverick_rits_judge.json' 2026-05-27T11:54:06,208 adding 'unitxt/catalog/metrics/rag/response_generation/answer_relevance/llama_4_maverick_watsonx_judge.json' 2026-05-27T11:54:06,211 adding 'unitxt/catalog/metrics/rag/response_generation/answer_relevance/mistral_large_instruct_rits_judge.json' 2026-05-27T11:54:06,212 adding 'unitxt/catalog/metrics/rag/response_generation/answer_relevance/mistral_large_instruct_watsonx_judge.json' 2026-05-27T11:54:06,214 adding 'unitxt/catalog/metrics/rag/response_generation/answer_relevance/mistral_small_3_1_24b_instruct_2503_wml_judge.json' 2026-05-27T11:54:06,214 adding 'unitxt/catalog/metrics/rag/response_generation/answer_relevance/token_recall.json' 2026-05-27T11:54:06,216 adding 'unitxt/catalog/metrics/rag/response_generation/correctness/token_overlap.json' 2026-05-27T11:54:06,217 adding 'unitxt/catalog/metrics/rag/response_generation/correctness/bert_score/deberta_large_mnli.json' 2026-05-27T11:54:06,219 adding 'unitxt/catalog/metrics/rag/response_generation/correctness/bert_score/deberta_v3_base_mnli_xnli_ml.json' 2026-05-27T11:54:06,220 adding 'unitxt/catalog/metrics/rag/response_generation/faithfullness/token_overlap.json' 2026-05-27T11:54:06,222 adding 'unitxt/catalog/metrics/rag/response_generation/faithfulness/bert_score_k_precision.json' 2026-05-27T11:54:06,224 adding 'unitxt/catalog/metrics/rag/response_generation/faithfulness/bert_score_k_precision_ml.json' 2026-05-27T11:54:06,225 adding 'unitxt/catalog/metrics/rag/response_generation/faithfulness/generic_inference_engine_judge.json' 2026-05-27T11:54:06,226 adding 'unitxt/catalog/metrics/rag/response_generation/faithfulness/gpt_4o_azure_judge.json' 2026-05-27T11:54:06,227 adding 'unitxt/catalog/metrics/rag/response_generation/faithfulness/gpt_oss_120b_rits_judge.json' 2026-05-27T11:54:06,228 adding 'unitxt/catalog/metrics/rag/response_generation/faithfulness/gpt_oss_120b_watsonx_judge.json' 2026-05-27T11:54:06,230 adding 'unitxt/catalog/metrics/rag/response_generation/faithfulness/llama_3_3_70b_instruct_rits_judge.json' 2026-05-27T11:54:06,231 adding 'unitxt/catalog/metrics/rag/response_generation/faithfulness/llama_3_3_70b_instruct_watsonx_judge.json' 2026-05-27T11:54:06,232 adding 'unitxt/catalog/metrics/rag/response_generation/faithfulness/llama_4_maverick_rits_judge.json' 2026-05-27T11:54:06,233 adding 'unitxt/catalog/metrics/rag/response_generation/faithfulness/llama_4_maverick_watsonx_judge.json' 2026-05-27T11:54:06,234 adding 'unitxt/catalog/metrics/rag/response_generation/faithfulness/mistral_large_instruct_rits_judge.json' 2026-05-27T11:54:06,236 adding 'unitxt/catalog/metrics/rag/response_generation/faithfulness/mistral_large_instruct_watsonx_judge.json' 2026-05-27T11:54:06,237 adding 'unitxt/catalog/metrics/rag/response_generation/faithfulness/mistral_small_3_1_24b_instruct_2503_wml_judge.json' 2026-05-27T11:54:06,238 adding 'unitxt/catalog/metrics/rag/response_generation/faithfulness/sentence_bert_bge.json' 2026-05-27T11:54:06,239 adding 'unitxt/catalog/metrics/rag/response_generation/faithfulness/sentence_bert_mini_lm.json' 2026-05-27T11:54:06,240 adding 'unitxt/catalog/metrics/rag/response_generation/faithfulness/token_k_precision.json' 2026-05-27T11:54:06,242 adding 'unitxt/catalog/metrics/rag/response_generation/faithfulness/vectara_hhem_2_1.json' 2026-05-27T11:54:06,244 adding 'unitxt/catalog/metrics/rag/response_generation/recommended/cpu_only/all.json' 2026-05-27T11:54:06,245 adding 'unitxt/catalog/metrics/rag/response_generation/recommended/llmaj_azure/all.json' 2026-05-27T11:54:06,247 adding 'unitxt/catalog/metrics/rag/response_generation/recommended/llmaj_rits/all.json' 2026-05-27T11:54:06,248 adding 'unitxt/catalog/metrics/rag/response_generation/recommended/llmaj_watsonx/all.json' 2026-05-27T11:54:06,250 adding 'unitxt/catalog/metrics/rag/response_generation/recommended/small_llm/all.json' 2026-05-27T11:54:06,251 adding 'unitxt/catalog/metrics/reward/deberta_v3_large_v2.json' 2026-05-27T11:54:06,253 adding 'unitxt/catalog/metrics/robustness/fixed_group_absval_norm_cohens_h_paraphrase_accuracy.json' 2026-05-27T11:54:06,254 adding 'unitxt/catalog/metrics/robustness/fixed_group_absval_norm_cohens_h_paraphrase_string_containment.json' 2026-05-27T11:54:06,255 adding 'unitxt/catalog/metrics/robustness/fixed_group_absval_norm_hedges_g_paraphrase_accuracy.json' 2026-05-27T11:54:06,256 adding 'unitxt/catalog/metrics/robustness/fixed_group_absval_norm_hedges_g_paraphrase_string_containment.json' 2026-05-27T11:54:06,257 adding 'unitxt/catalog/metrics/robustness/fixed_group_mean_accuracy.json' 2026-05-27T11:54:06,258 adding 'unitxt/catalog/metrics/robustness/fixed_group_mean_baseline_accuracy.json' 2026-05-27T11:54:06,259 adding 'unitxt/catalog/metrics/robustness/fixed_group_mean_baseline_string_containment.json' 2026-05-27T11:54:06,261 adding 'unitxt/catalog/metrics/robustness/fixed_group_mean_paraphrase_accuracy.json' 2026-05-27T11:54:06,262 adding 'unitxt/catalog/metrics/robustness/fixed_group_mean_paraphrase_string_containment.json' 2026-05-27T11:54:06,263 adding 'unitxt/catalog/metrics/robustness/fixed_group_mean_string_containment.json' 2026-05-27T11:54:06,264 adding 'unitxt/catalog/metrics/robustness/fixed_group_norm_cohens_h_paraphrase_accuracy.json' 2026-05-27T11:54:06,265 adding 'unitxt/catalog/metrics/robustness/fixed_group_norm_cohens_h_paraphrase_string_containment.json' 2026-05-27T11:54:06,266 adding 'unitxt/catalog/metrics/robustness/fixed_group_norm_hedges_g_paraphrase_accuracy.json' 2026-05-27T11:54:06,267 adding 'unitxt/catalog/metrics/robustness/fixed_group_norm_hedges_g_paraphrase_string_containment.json' 2026-05-27T11:54:06,268 adding 'unitxt/catalog/metrics/robustness/fixed_group_pdr_paraphrase_accuracy.json' 2026-05-27T11:54:06,270 adding 'unitxt/catalog/metrics/robustness/fixed_group_pdr_paraphrase_string_containment.json' 2026-05-27T11:54:06,271 adding 'unitxt/catalog/metrics/robustness/group_mean_accuracy.json' 2026-05-27T11:54:06,272 adding 'unitxt/catalog/metrics/robustness/group_mean_string_containment.json' 2026-05-27T11:54:06,273 adding 'unitxt/catalog/metrics/robustness/group_mean_token_overlap.json' 2026-05-27T11:54:06,274 adding 'unitxt/catalog/metrics/sentence_bert/bge_large_en_1_5.json' 2026-05-27T11:54:06,276 adding 'unitxt/catalog/metrics/sentence_bert/minilm_l12_v2.json' 2026-05-27T11:54:06,277 adding 'unitxt/catalog/metrics/sentence_bert/mpnet_base_v2.json' 2026-05-27T11:54:06,279 adding 'unitxt/catalog/metrics/text2sql/execution_accuracy.json' 2026-05-27T11:54:06,280 adding 'unitxt/catalog/metrics/text2sql/execution_logic_accuracy.json' 2026-05-27T11:54:06,281 adding 'unitxt/catalog/metrics/text2sql/non_execution_accuracy.json' 2026-05-27T11:54:06,283 adding 'unitxt/catalog/metrics/tool_calling/reflection.json' 2026-05-27T11:54:06,284 adding 'unitxt/catalog/metrics/tool_calling/correctness/llama_3_3_70b_instruct_judge.json' 2026-05-27T11:54:06,286 adding 'unitxt/catalog/metrics/tool_calling/key_value/accuracy.json' 2026-05-27T11:54:06,287 adding 'unitxt/catalog/metrics/tool_calling/key_value/token_overlap.json' 2026-05-27T11:54:06,289 adding 'unitxt/catalog/metrics/tool_calling/multi_turn/validity.json' 2026-05-27T11:54:06,291 adding 'unitxt/catalog/metrics/tool_calling/multi_turn/correctness/llama_3_3_70b_instruct_judge.json' 2026-05-27T11:54:06,292 adding 'unitxt/catalog/metrics/tool_calling/reflection/syntactic.json' 2026-05-27T11:54:06,295 adding 'unitxt/catalog/operators/arena_hard_hf_space_processing_steps.json' 2026-05-27T11:54:06,296 adding 'unitxt/catalog/operators/capitalize.json' 2026-05-27T11:54:06,297 adding 'unitxt/catalog/operators/cast_to_float_return_0_5_if_failed.json' 2026-05-27T11:54:06,298 adding 'unitxt/catalog/operators/cast_to_float_return_nan_if_failed.json' 2026-05-27T11:54:06,299 adding 'unitxt/catalog/operators/cast_to_float_return_zero_if_failed.json' 2026-05-27T11:54:06,300 adding 'unitxt/catalog/operators/convert_to_boolean.json' 2026-05-27T11:54:06,301 adding 'unitxt/catalog/operators/extract_arena_hard_numerical_judgment.json' 2026-05-27T11:54:06,302 adding 'unitxt/catalog/operators/extract_from_double_brackets.json' 2026-05-27T11:54:06,303 adding 'unitxt/catalog/operators/extract_harm_rating_judgment.json' 2026-05-27T11:54:06,304 adding 'unitxt/catalog/operators/extract_mt_bench_label_judgment.json' 2026-05-27T11:54:06,305 adding 'unitxt/catalog/operators/extract_mt_bench_rating_judgment.json' 2026-05-27T11:54:06,306 adding 'unitxt/catalog/operators/extract_verbal_judgement.json' 2026-05-27T11:54:06,307 adding 'unitxt/catalog/operators/extract_verbal_judgement_bad_good.json' 2026-05-27T11:54:06,308 adding 'unitxt/catalog/operators/first_character.json' 2026-05-27T11:54:06,309 adding 'unitxt/catalog/operators/fix_json_schema.json' 2026-05-27T11:54:06,310 adding 'unitxt/catalog/operators/fix_whitespace.json' 2026-05-27T11:54:06,311 adding 'unitxt/catalog/operators/get_string_after_colon.json' 2026-05-27T11:54:06,312 adding 'unitxt/catalog/operators/hate_speech_or_not_hate_speech.json' 2026-05-27T11:54:06,313 adding 'unitxt/catalog/operators/literal_eval.json' 2026-05-27T11:54:06,314 adding 'unitxt/catalog/operators/lower_case.json' 2026-05-27T11:54:06,315 adding 'unitxt/catalog/operators/lower_case_till_punc.json' 2026-05-27T11:54:06,316 adding 'unitxt/catalog/operators/match_closest_option.json' 2026-05-27T11:54:06,317 adding 'unitxt/catalog/operators/predictions_yes_1_else_0.json' 2026-05-27T11:54:06,318 adding 'unitxt/catalog/operators/regex_parser.json' 2026-05-27T11:54:06,320 adding 'unitxt/catalog/operators/remove_articles.json' 2026-05-27T11:54:06,321 adding 'unitxt/catalog/operators/remove_none_from_list.json' 2026-05-27T11:54:06,322 adding 'unitxt/catalog/operators/remove_punctuations.json' 2026-05-27T11:54:06,323 adding 'unitxt/catalog/operators/scale_0_10_to_0_1.json' 2026-05-27T11:54:06,324 adding 'unitxt/catalog/operators/stance_to_pro_con.json' 2026-05-27T11:54:06,325 adding 'unitxt/catalog/operators/str_to_float_format.json' 2026-05-27T11:54:06,326 adding 'unitxt/catalog/operators/substring.json' 2026-05-27T11:54:06,327 adding 'unitxt/catalog/operators/take_first_non_empty_line.json' 2026-05-27T11:54:06,329 adding 'unitxt/catalog/operators/take_first_word.json' 2026-05-27T11:54:06,330 adding 'unitxt/catalog/operators/take_last_non_empty_line.json' 2026-05-27T11:54:06,331 adding 'unitxt/catalog/operators/to_yes_or_none.json' 2026-05-27T11:54:06,332 adding 'unitxt/catalog/operators/toxic_or_not_toxic.json' 2026-05-27T11:54:06,333 adding 'unitxt/catalog/operators/upper_case.json' 2026-05-27T11:54:06,334 adding 'unitxt/catalog/operators/yes_no_to_int.json' 2026-05-27T11:54:06,336 adding 'unitxt/catalog/operators/balancers/classification/by_label.json' 2026-05-27T11:54:06,338 adding 'unitxt/catalog/operators/balancers/classification/minimum_one_example_per_class.json' 2026-05-27T11:54:06,339 adding 'unitxt/catalog/operators/balancers/multi_label/zero_vs_many_labels.json' 2026-05-27T11:54:06,341 adding 'unitxt/catalog/operators/balancers/ner/zero_vs_many_entities.json' 2026-05-27T11:54:06,342 adding 'unitxt/catalog/operators/balancers/qa/by_answer.json' 2026-05-27T11:54:06,344 adding 'unitxt/catalog/operators/mt_bench/pairwise_hf_space_processing_steps.json' 2026-05-27T11:54:06,346 adding 'unitxt/catalog/operators/mt_bench/rating_hf_space_processing_steps.json' 2026-05-27T11:54:06,348 adding 'unitxt/catalog/processors/capitalize.json' 2026-05-27T11:54:06,349 adding 'unitxt/catalog/processors/cast_to_float_return_0_5_if_failed.json' 2026-05-27T11:54:06,350 adding 'unitxt/catalog/processors/cast_to_float_return_nan_if_failed.json' 2026-05-27T11:54:06,352 adding 'unitxt/catalog/processors/cast_to_float_return_zero_if_failed.json' 2026-05-27T11:54:06,353 adding 'unitxt/catalog/processors/convert_to_boolean.json' 2026-05-27T11:54:06,354 adding 'unitxt/catalog/processors/dict_of_lists_to_value_key_pairs.json' 2026-05-27T11:54:06,355 adding 'unitxt/catalog/processors/extract_arena_hard_numerical_judgment.json' 2026-05-27T11:54:06,356 adding 'unitxt/catalog/processors/extract_from_double_brackets.json' 2026-05-27T11:54:06,357 adding 'unitxt/catalog/processors/extract_harm_rating_judgment.json' 2026-05-27T11:54:06,358 adding 'unitxt/catalog/processors/extract_mt_bench_label_judgment.json' 2026-05-27T11:54:06,359 adding 'unitxt/catalog/processors/extract_mt_bench_rating_judgment.json' 2026-05-27T11:54:06,361 adding 'unitxt/catalog/processors/extract_verbal_judgement.json' 2026-05-27T11:54:06,362 adding 'unitxt/catalog/processors/extract_verbal_judgement_bad_good.json' 2026-05-27T11:54:06,363 adding 'unitxt/catalog/processors/first_character.json' 2026-05-27T11:54:06,364 adding 'unitxt/catalog/processors/fix_whitespace.json' 2026-05-27T11:54:06,365 adding 'unitxt/catalog/processors/get_string_after_colon.json' 2026-05-27T11:54:06,366 adding 'unitxt/catalog/processors/hate_speech_or_not_hate_speech.json' 2026-05-27T11:54:06,367 adding 'unitxt/catalog/processors/infer_last_token_logprobs_to_yes_no_probs.json' 2026-05-27T11:54:06,369 adding 'unitxt/catalog/processors/infer_logprobs_to_yes_no_probs.json' 2026-05-27T11:54:06,370 adding 'unitxt/catalog/processors/list_to_empty_entity_tuples.json' 2026-05-27T11:54:06,371 adding 'unitxt/catalog/processors/literal_eval.json' 2026-05-27T11:54:06,372 adding 'unitxt/catalog/processors/load_json.json' 2026-05-27T11:54:06,373 adding 'unitxt/catalog/processors/load_json_from_predictions.json' 2026-05-27T11:54:06,374 adding 'unitxt/catalog/processors/load_json_or_empty_tool_call.json' 2026-05-27T11:54:06,375 adding 'unitxt/catalog/processors/load_json_predictions.json' 2026-05-27T11:54:06,377 adding 'unitxt/catalog/processors/lower_case.json' 2026-05-27T11:54:06,378 adding 'unitxt/catalog/processors/lower_case_till_punc.json' 2026-05-27T11:54:06,379 adding 'unitxt/catalog/processors/match_closest_option.json' 2026-05-27T11:54:06,380 adding 'unitxt/catalog/processors/multi_tool_call.json' 2026-05-27T11:54:06,381 adding 'unitxt/catalog/processors/predictions_yes_1_else_0.json' 2026-05-27T11:54:06,382 adding 'unitxt/catalog/processors/regex_parser_from_prediction.json' 2026-05-27T11:54:06,384 adding 'unitxt/catalog/processors/remove_articles.json' 2026-05-27T11:54:06,385 adding 'unitxt/catalog/processors/remove_none_from_list.json' 2026-05-27T11:54:06,386 adding 'unitxt/catalog/processors/remove_punctuations.json' 2026-05-27T11:54:06,387 adding 'unitxt/catalog/processors/safe_unsafe.json' 2026-05-27T11:54:06,388 adding 'unitxt/catalog/processors/scale_0_10_to_0_1.json' 2026-05-27T11:54:06,389 adding 'unitxt/catalog/processors/stance_to_pro_con.json' 2026-05-27T11:54:06,390 adding 'unitxt/catalog/processors/str_to_float_format.json' 2026-05-27T11:54:06,392 adding 'unitxt/catalog/processors/substring.json' 2026-05-27T11:54:06,393 adding 'unitxt/catalog/processors/take_first_non_empty_line.json' 2026-05-27T11:54:06,394 adding 'unitxt/catalog/processors/take_first_word.json' 2026-05-27T11:54:06,395 adding 'unitxt/catalog/processors/take_last_non_empty_line.json' 2026-05-27T11:54:06,396 adding 'unitxt/catalog/processors/to_list_by_comma.json' 2026-05-27T11:54:06,398 adding 'unitxt/catalog/processors/to_list_by_comma_from_references.json' 2026-05-27T11:54:06,399 adding 'unitxt/catalog/processors/to_list_by_comma_space.json' 2026-05-27T11:54:06,400 adding 'unitxt/catalog/processors/to_list_by_hyphen_space.json' 2026-05-27T11:54:06,401 adding 'unitxt/catalog/processors/to_list_by_hyphen_space_from_references.json' 2026-05-27T11:54:06,402 adding 'unitxt/catalog/processors/to_span_label_pairs.json' 2026-05-27T11:54:06,403 adding 'unitxt/catalog/processors/to_span_label_pairs_surface_only.json' 2026-05-27T11:54:06,404 adding 'unitxt/catalog/processors/to_string.json' 2026-05-27T11:54:06,405 adding 'unitxt/catalog/processors/to_string_stripped.json' 2026-05-27T11:54:06,406 adding 'unitxt/catalog/processors/to_yes_or_none.json' 2026-05-27T11:54:06,407 adding 'unitxt/catalog/processors/toxic_or_not_toxic.json' 2026-05-27T11:54:06,409 adding 'unitxt/catalog/processors/upper_case.json' 2026-05-27T11:54:06,410 adding 'unitxt/catalog/processors/yes_no_to_int.json' 2026-05-27T11:54:06,411 adding 'unitxt/catalog/processors/text2sql/get_sql.json' 2026-05-27T11:54:06,414 adding 'unitxt/catalog/recipes/bluebench/bias/safety_bbq_age.json' 2026-05-27T11:54:06,415 adding 'unitxt/catalog/recipes/bluebench/bias/safety_bbq_disability_status.json' 2026-05-27T11:54:06,416 adding 'unitxt/catalog/recipes/bluebench/bias/safety_bbq_gender_identity.json' 2026-05-27T11:54:06,418 adding 'unitxt/catalog/recipes/bluebench/bias/safety_bbq_nationality.json' 2026-05-27T11:54:06,419 adding 'unitxt/catalog/recipes/bluebench/bias/safety_bbq_physical_appearance.json' 2026-05-27T11:54:06,420 adding 'unitxt/catalog/recipes/bluebench/bias/safety_bbq_race_ethnicity.json' 2026-05-27T11:54:06,421 adding 'unitxt/catalog/recipes/bluebench/bias/safety_bbq_race_x_gender.json' 2026-05-27T11:54:06,422 adding 'unitxt/catalog/recipes/bluebench/bias/safety_bbq_race_x_ses.json' 2026-05-27T11:54:06,423 adding 'unitxt/catalog/recipes/bluebench/bias/safety_bbq_religion.json' 2026-05-27T11:54:06,425 adding 'unitxt/catalog/recipes/bluebench/bias/safety_bbq_ses.json' 2026-05-27T11:54:06,426 adding 'unitxt/catalog/recipes/bluebench/bias/safety_bbq_sexual_orientation.json' 2026-05-27T11:54:06,427 adding 'unitxt/catalog/recipes/bluebench/chatbot_abilities/arena_hard_generation_english_gpt_4_0314_reference.json' 2026-05-27T11:54:06,429 adding 'unitxt/catalog/recipes/bluebench/entity_extraction/universal_ner_en_ewt.json' 2026-05-27T11:54:06,431 adding 'unitxt/catalog/recipes/bluebench/knowledge/mmlu_pro_biology.json' 2026-05-27T11:54:06,432 adding 'unitxt/catalog/recipes/bluebench/knowledge/mmlu_pro_business.json' 2026-05-27T11:54:06,433 adding 'unitxt/catalog/recipes/bluebench/knowledge/mmlu_pro_chemistry.json' 2026-05-27T11:54:06,434 adding 'unitxt/catalog/recipes/bluebench/knowledge/mmlu_pro_computer_science.json' 2026-05-27T11:54:06,436 adding 'unitxt/catalog/recipes/bluebench/knowledge/mmlu_pro_economics.json' 2026-05-27T11:54:06,437 adding 'unitxt/catalog/recipes/bluebench/knowledge/mmlu_pro_engineering.json' 2026-05-27T11:54:06,438 adding 'unitxt/catalog/recipes/bluebench/knowledge/mmlu_pro_health.json' 2026-05-27T11:54:06,440 adding 'unitxt/catalog/recipes/bluebench/knowledge/mmlu_pro_history.json' 2026-05-27T11:54:06,441 adding 'unitxt/catalog/recipes/bluebench/knowledge/mmlu_pro_law.json' 2026-05-27T11:54:06,442 adding 'unitxt/catalog/recipes/bluebench/knowledge/mmlu_pro_math.json' 2026-05-27T11:54:06,443 adding 'unitxt/catalog/recipes/bluebench/knowledge/mmlu_pro_other.json' 2026-05-27T11:54:06,444 adding 'unitxt/catalog/recipes/bluebench/knowledge/mmlu_pro_philosophy.json' 2026-05-27T11:54:06,446 adding 'unitxt/catalog/recipes/bluebench/knowledge/mmlu_pro_physics.json' 2026-05-27T11:54:06,447 adding 'unitxt/catalog/recipes/bluebench/knowledge/mmlu_pro_psychology.json' 2026-05-27T11:54:06,449 adding 'unitxt/catalog/recipes/bluebench/legal/legalbench_abercrombie.json' 2026-05-27T11:54:06,450 adding 'unitxt/catalog/recipes/bluebench/legal/legalbench_corporate_lobbying.json' 2026-05-27T11:54:06,451 adding 'unitxt/catalog/recipes/bluebench/legal/legalbench_function_of_decision_section.json' 2026-05-27T11:54:06,452 adding 'unitxt/catalog/recipes/bluebench/legal/legalbench_international_citizenship_questions.json' 2026-05-27T11:54:06,454 adding 'unitxt/catalog/recipes/bluebench/legal/legalbench_proa.json' 2026-05-27T11:54:06,455 adding 'unitxt/catalog/recipes/bluebench/news_classification/20_newsgroups_short.json' 2026-05-27T11:54:06,457 adding 'unitxt/catalog/recipes/bluebench/product_help/cfpb_product_2023.json' 2026-05-27T11:54:06,458 adding 'unitxt/catalog/recipes/bluebench/product_help/cfpb_product_watsonx.json' 2026-05-27T11:54:06,459 adding 'unitxt/catalog/recipes/bluebench/qa_finance/fin_qa.json' 2026-05-27T11:54:06,461 adding 'unitxt/catalog/recipes/bluebench/rag_general/rag_response_generation_clapnq.json' 2026-05-27T11:54:06,463 adding 'unitxt/catalog/recipes/bluebench/reasoning/hellaswag.json' 2026-05-27T11:54:06,464 adding 'unitxt/catalog/recipes/bluebench/reasoning/openbook_qa.json' 2026-05-27T11:54:06,466 adding 'unitxt/catalog/recipes/bluebench/safety/attaq_500.json' 2026-05-27T11:54:06,467 adding 'unitxt/catalog/recipes/bluebench/summarization/billsum_document_filtered_to_6000_chars.json' 2026-05-27T11:54:06,468 adding 'unitxt/catalog/recipes/bluebench/summarization/tldr_document_filtered_to_6000_chars.json' 2026-05-27T11:54:06,470 adding 'unitxt/catalog/recipes/bluebench/translation/mt_flores_101_ara_eng.json' 2026-05-27T11:54:06,472 adding 'unitxt/catalog/recipes/bluebench/translation/mt_flores_101_deu_eng.json' 2026-05-27T11:54:06,473 adding 'unitxt/catalog/recipes/bluebench/translation/mt_flores_101_eng_ara.json' 2026-05-27T11:54:06,474 adding 'unitxt/catalog/recipes/bluebench/translation/mt_flores_101_eng_deu.json' 2026-05-27T11:54:06,475 adding 'unitxt/catalog/recipes/bluebench/translation/mt_flores_101_eng_fra.json' 2026-05-27T11:54:06,476 adding 'unitxt/catalog/recipes/bluebench/translation/mt_flores_101_eng_kor.json' 2026-05-27T11:54:06,478 adding 'unitxt/catalog/recipes/bluebench/translation/mt_flores_101_eng_por.json' 2026-05-27T11:54:06,479 adding 'unitxt/catalog/recipes/bluebench/translation/mt_flores_101_eng_ron.json' 2026-05-27T11:54:06,480 adding 'unitxt/catalog/recipes/bluebench/translation/mt_flores_101_eng_spa.json' 2026-05-27T11:54:06,481 adding 'unitxt/catalog/recipes/bluebench/translation/mt_flores_101_fra_eng.json' 2026-05-27T11:54:06,482 adding 'unitxt/catalog/recipes/bluebench/translation/mt_flores_101_jpn_eng.json' 2026-05-27T11:54:06,484 adding 'unitxt/catalog/recipes/bluebench/translation/mt_flores_101_kor_eng.json' 2026-05-27T11:54:06,485 adding 'unitxt/catalog/recipes/bluebench/translation/mt_flores_101_por_eng.json' 2026-05-27T11:54:06,486 adding 'unitxt/catalog/recipes/bluebench/translation/mt_flores_101_ron_eng.json' 2026-05-27T11:54:06,487 adding 'unitxt/catalog/recipes/bluebench/translation/mt_flores_101_spa_eng.json' 2026-05-27T11:54:06,490 adding 'unitxt/catalog/recipes/torr/fin_qa/concat/insert_empty_rows_augmentation_5_demos.json' 2026-05-27T11:54:06,491 adding 'unitxt/catalog/recipes/torr/fin_qa/concat/no_augmentation_5_demos.json' 2026-05-27T11:54:06,493 adding 'unitxt/catalog/recipes/torr/fin_qa/concat/shuffle_cols_augmentation_5_demos.json' 2026-05-27T11:54:06,494 adding 'unitxt/catalog/recipes/torr/fin_qa/concat/shuffle_rows_augmentation_5_demos.json' 2026-05-27T11:54:06,495 adding 'unitxt/catalog/recipes/torr/fin_qa/concat/transpose_augmentation_5_demos.json' 2026-05-27T11:54:06,497 adding 'unitxt/catalog/recipes/torr/fin_qa/csv/insert_empty_rows_augmentation_5_demos.json' 2026-05-27T11:54:06,498 adding 'unitxt/catalog/recipes/torr/fin_qa/csv/no_augmentation_5_demos.json' 2026-05-27T11:54:06,500 adding 'unitxt/catalog/recipes/torr/fin_qa/csv/shuffle_cols_augmentation_5_demos.json' 2026-05-27T11:54:06,501 adding 'unitxt/catalog/recipes/torr/fin_qa/csv/shuffle_rows_augmentation_5_demos.json' 2026-05-27T11:54:06,502 adding 'unitxt/catalog/recipes/torr/fin_qa/csv/transpose_augmentation_5_demos.json' 2026-05-27T11:54:06,504 adding 'unitxt/catalog/recipes/torr/fin_qa/df/insert_empty_rows_augmentation_5_demos.json' 2026-05-27T11:54:06,505 adding 'unitxt/catalog/recipes/torr/fin_qa/df/no_augmentation_5_demos.json' 2026-05-27T11:54:06,506 adding 'unitxt/catalog/recipes/torr/fin_qa/df/shuffle_cols_augmentation_5_demos.json' 2026-05-27T11:54:06,507 adding 'unitxt/catalog/recipes/torr/fin_qa/df/shuffle_rows_augmentation_5_demos.json' 2026-05-27T11:54:06,508 adding 'unitxt/catalog/recipes/torr/fin_qa/df/transpose_augmentation_5_demos.json' 2026-05-27T11:54:06,510 adding 'unitxt/catalog/recipes/torr/fin_qa/html/insert_empty_rows_augmentation_5_demos.json' 2026-05-27T11:54:06,511 adding 'unitxt/catalog/recipes/torr/fin_qa/html/no_augmentation_5_demos.json' 2026-05-27T11:54:06,512 adding 'unitxt/catalog/recipes/torr/fin_qa/html/shuffle_cols_augmentation_5_demos.json' 2026-05-27T11:54:06,514 adding 'unitxt/catalog/recipes/torr/fin_qa/html/shuffle_rows_augmentation_5_demos.json' 2026-05-27T11:54:06,515 adding 'unitxt/catalog/recipes/torr/fin_qa/html/transpose_augmentation_5_demos.json' 2026-05-27T11:54:06,517 adding 'unitxt/catalog/recipes/torr/fin_qa/indexed_row_major/insert_empty_rows_augmentation_5_demos.json' 2026-05-27T11:54:06,518 adding 'unitxt/catalog/recipes/torr/fin_qa/indexed_row_major/no_augmentation_5_demos.json' 2026-05-27T11:54:06,519 adding 'unitxt/catalog/recipes/torr/fin_qa/indexed_row_major/shuffle_cols_augmentation_5_demos.json' 2026-05-27T11:54:06,521 adding 'unitxt/catalog/recipes/torr/fin_qa/indexed_row_major/shuffle_rows_augmentation_5_demos.json' 2026-05-27T11:54:06,522 adding 'unitxt/catalog/recipes/torr/fin_qa/indexed_row_major/transpose_augmentation_5_demos.json' 2026-05-27T11:54:06,523 adding 'unitxt/catalog/recipes/torr/fin_qa/json/insert_empty_rows_augmentation_5_demos.json' 2026-05-27T11:54:06,525 adding 'unitxt/catalog/recipes/torr/fin_qa/json/no_augmentation_5_demos.json' 2026-05-27T11:54:06,526 adding 'unitxt/catalog/recipes/torr/fin_qa/json/shuffle_cols_augmentation_5_demos.json' 2026-05-27T11:54:06,527 adding 'unitxt/catalog/recipes/torr/fin_qa/json/shuffle_rows_augmentation_5_demos.json' 2026-05-27T11:54:06,528 adding 'unitxt/catalog/recipes/torr/fin_qa/json/transpose_augmentation_5_demos.json' 2026-05-27T11:54:06,530 adding 'unitxt/catalog/recipes/torr/fin_qa/markdown/insert_empty_rows_augmentation_5_demos.json' 2026-05-27T11:54:06,532 adding 'unitxt/catalog/recipes/torr/fin_qa/markdown/no_augmentation_5_demos.json' 2026-05-27T11:54:06,533 adding 'unitxt/catalog/recipes/torr/fin_qa/markdown/shuffle_cols_augmentation_5_demos.json' 2026-05-27T11:54:06,534 adding 'unitxt/catalog/recipes/torr/fin_qa/markdown/shuffle_rows_augmentation_5_demos.json' 2026-05-27T11:54:06,535 adding 'unitxt/catalog/recipes/torr/fin_qa/markdown/transpose_augmentation_5_demos.json' 2026-05-27T11:54:06,538 adding 'unitxt/catalog/recipes/torr/numeric_nlg/concat/insert_empty_rows_augmentation_5_demos.json' 2026-05-27T11:54:06,539 adding 'unitxt/catalog/recipes/torr/numeric_nlg/concat/no_augmentation_5_demos.json' 2026-05-27T11:54:06,540 adding 'unitxt/catalog/recipes/torr/numeric_nlg/concat/shuffle_cols_augmentation_5_demos.json' 2026-05-27T11:54:06,541 adding 'unitxt/catalog/recipes/torr/numeric_nlg/concat/shuffle_rows_augmentation_5_demos.json' 2026-05-27T11:54:06,543 adding 'unitxt/catalog/recipes/torr/numeric_nlg/concat/transpose_augmentation_5_demos.json' 2026-05-27T11:54:06,544 adding 'unitxt/catalog/recipes/torr/numeric_nlg/csv/insert_empty_rows_augmentation_5_demos.json' 2026-05-27T11:54:06,546 adding 'unitxt/catalog/recipes/torr/numeric_nlg/csv/no_augmentation_5_demos.json' 2026-05-27T11:54:06,547 adding 'unitxt/catalog/recipes/torr/numeric_nlg/csv/shuffle_cols_augmentation_5_demos.json' 2026-05-27T11:54:06,548 adding 'unitxt/catalog/recipes/torr/numeric_nlg/csv/shuffle_rows_augmentation_5_demos.json' 2026-05-27T11:54:06,549 adding 'unitxt/catalog/recipes/torr/numeric_nlg/csv/transpose_augmentation_5_demos.json' 2026-05-27T11:54:06,551 adding 'unitxt/catalog/recipes/torr/numeric_nlg/df/insert_empty_rows_augmentation_5_demos.json' 2026-05-27T11:54:06,552 adding 'unitxt/catalog/recipes/torr/numeric_nlg/df/no_augmentation_5_demos.json' 2026-05-27T11:54:06,554 adding 'unitxt/catalog/recipes/torr/numeric_nlg/df/shuffle_cols_augmentation_5_demos.json' 2026-05-27T11:54:06,555 adding 'unitxt/catalog/recipes/torr/numeric_nlg/df/shuffle_rows_augmentation_5_demos.json' 2026-05-27T11:54:06,556 adding 'unitxt/catalog/recipes/torr/numeric_nlg/df/transpose_augmentation_5_demos.json' 2026-05-27T11:54:06,558 adding 'unitxt/catalog/recipes/torr/numeric_nlg/html/insert_empty_rows_augmentation_5_demos.json' 2026-05-27T11:54:06,559 adding 'unitxt/catalog/recipes/torr/numeric_nlg/html/no_augmentation_5_demos.json' 2026-05-27T11:54:06,560 adding 'unitxt/catalog/recipes/torr/numeric_nlg/html/shuffle_cols_augmentation_5_demos.json' 2026-05-27T11:54:06,561 adding 'unitxt/catalog/recipes/torr/numeric_nlg/html/shuffle_rows_augmentation_5_demos.json' 2026-05-27T11:54:06,562 adding 'unitxt/catalog/recipes/torr/numeric_nlg/html/transpose_augmentation_5_demos.json' 2026-05-27T11:54:06,564 adding 'unitxt/catalog/recipes/torr/numeric_nlg/indexed_row_major/insert_empty_rows_augmentation_5_demos.json' 2026-05-27T11:54:06,565 adding 'unitxt/catalog/recipes/torr/numeric_nlg/indexed_row_major/no_augmentation_5_demos.json' 2026-05-27T11:54:06,567 adding 'unitxt/catalog/recipes/torr/numeric_nlg/indexed_row_major/shuffle_cols_augmentation_5_demos.json' 2026-05-27T11:54:06,568 adding 'unitxt/catalog/recipes/torr/numeric_nlg/indexed_row_major/shuffle_rows_augmentation_5_demos.json' 2026-05-27T11:54:06,569 adding 'unitxt/catalog/recipes/torr/numeric_nlg/indexed_row_major/transpose_augmentation_5_demos.json' 2026-05-27T11:54:06,571 adding 'unitxt/catalog/recipes/torr/numeric_nlg/json/insert_empty_rows_augmentation_5_demos.json' 2026-05-27T11:54:06,572 adding 'unitxt/catalog/recipes/torr/numeric_nlg/json/no_augmentation_5_demos.json' 2026-05-27T11:54:06,573 adding 'unitxt/catalog/recipes/torr/numeric_nlg/json/shuffle_cols_augmentation_5_demos.json' 2026-05-27T11:54:06,574 adding 'unitxt/catalog/recipes/torr/numeric_nlg/json/shuffle_rows_augmentation_5_demos.json' 2026-05-27T11:54:06,575 adding 'unitxt/catalog/recipes/torr/numeric_nlg/json/transpose_augmentation_5_demos.json' 2026-05-27T11:54:06,577 adding 'unitxt/catalog/recipes/torr/numeric_nlg/markdown/insert_empty_rows_augmentation_5_demos.json' 2026-05-27T11:54:06,579 adding 'unitxt/catalog/recipes/torr/numeric_nlg/markdown/no_augmentation_5_demos.json' 2026-05-27T11:54:06,580 adding 'unitxt/catalog/recipes/torr/numeric_nlg/markdown/shuffle_cols_augmentation_5_demos.json' 2026-05-27T11:54:06,581 adding 'unitxt/catalog/recipes/torr/numeric_nlg/markdown/shuffle_rows_augmentation_5_demos.json' 2026-05-27T11:54:06,582 adding 'unitxt/catalog/recipes/torr/numeric_nlg/markdown/transpose_augmentation_5_demos.json' 2026-05-27T11:54:06,585 adding 'unitxt/catalog/recipes/torr/qtsumm/concat/insert_empty_rows_augmentation_5_demos.json' 2026-05-27T11:54:06,586 adding 'unitxt/catalog/recipes/torr/qtsumm/concat/no_augmentation_5_demos.json' 2026-05-27T11:54:06,588 adding 'unitxt/catalog/recipes/torr/qtsumm/concat/shuffle_cols_augmentation_5_demos.json' 2026-05-27T11:54:06,589 adding 'unitxt/catalog/recipes/torr/qtsumm/concat/shuffle_rows_augmentation_5_demos.json' 2026-05-27T11:54:06,590 adding 'unitxt/catalog/recipes/torr/qtsumm/concat/transpose_augmentation_5_demos.json' 2026-05-27T11:54:06,592 adding 'unitxt/catalog/recipes/torr/qtsumm/csv/insert_empty_rows_augmentation_5_demos.json' 2026-05-27T11:54:06,593 adding 'unitxt/catalog/recipes/torr/qtsumm/csv/no_augmentation_5_demos.json' 2026-05-27T11:54:06,594 adding 'unitxt/catalog/recipes/torr/qtsumm/csv/shuffle_cols_augmentation_5_demos.json' 2026-05-27T11:54:06,595 adding 'unitxt/catalog/recipes/torr/qtsumm/csv/shuffle_rows_augmentation_5_demos.json' 2026-05-27T11:54:06,597 adding 'unitxt/catalog/recipes/torr/qtsumm/csv/transpose_augmentation_5_demos.json' 2026-05-27T11:54:06,598 adding 'unitxt/catalog/recipes/torr/qtsumm/df/insert_empty_rows_augmentation_5_demos.json' 2026-05-27T11:54:06,600 adding 'unitxt/catalog/recipes/torr/qtsumm/df/no_augmentation_5_demos.json' 2026-05-27T11:54:06,601 adding 'unitxt/catalog/recipes/torr/qtsumm/df/shuffle_cols_augmentation_5_demos.json' 2026-05-27T11:54:06,602 adding 'unitxt/catalog/recipes/torr/qtsumm/df/shuffle_rows_augmentation_5_demos.json' 2026-05-27T11:54:06,603 adding 'unitxt/catalog/recipes/torr/qtsumm/df/transpose_augmentation_5_demos.json' 2026-05-27T11:54:06,605 adding 'unitxt/catalog/recipes/torr/qtsumm/html/insert_empty_rows_augmentation_5_demos.json' 2026-05-27T11:54:06,606 adding 'unitxt/catalog/recipes/torr/qtsumm/html/no_augmentation_5_demos.json' 2026-05-27T11:54:06,607 adding 'unitxt/catalog/recipes/torr/qtsumm/html/shuffle_cols_augmentation_5_demos.json' 2026-05-27T11:54:06,608 adding 'unitxt/catalog/recipes/torr/qtsumm/html/shuffle_rows_augmentation_5_demos.json' 2026-05-27T11:54:06,609 adding 'unitxt/catalog/recipes/torr/qtsumm/html/transpose_augmentation_5_demos.json' 2026-05-27T11:54:06,611 adding 'unitxt/catalog/recipes/torr/qtsumm/indexed_row_major/insert_empty_rows_augmentation_5_demos.json' 2026-05-27T11:54:06,612 adding 'unitxt/catalog/recipes/torr/qtsumm/indexed_row_major/no_augmentation_5_demos.json' 2026-05-27T11:54:06,613 adding 'unitxt/catalog/recipes/torr/qtsumm/indexed_row_major/shuffle_cols_augmentation_5_demos.json' 2026-05-27T11:54:06,615 adding 'unitxt/catalog/recipes/torr/qtsumm/indexed_row_major/shuffle_rows_augmentation_5_demos.json' 2026-05-27T11:54:06,616 adding 'unitxt/catalog/recipes/torr/qtsumm/indexed_row_major/transpose_augmentation_5_demos.json' 2026-05-27T11:54:06,617 adding 'unitxt/catalog/recipes/torr/qtsumm/json/insert_empty_rows_augmentation_5_demos.json' 2026-05-27T11:54:06,618 adding 'unitxt/catalog/recipes/torr/qtsumm/json/no_augmentation_5_demos.json' 2026-05-27T11:54:06,620 adding 'unitxt/catalog/recipes/torr/qtsumm/json/shuffle_cols_augmentation_5_demos.json' 2026-05-27T11:54:06,621 adding 'unitxt/catalog/recipes/torr/qtsumm/json/shuffle_rows_augmentation_5_demos.json' 2026-05-27T11:54:06,622 adding 'unitxt/catalog/recipes/torr/qtsumm/json/transpose_augmentation_5_demos.json' 2026-05-27T11:54:06,624 adding 'unitxt/catalog/recipes/torr/qtsumm/markdown/insert_empty_rows_augmentation_5_demos.json' 2026-05-27T11:54:06,625 adding 'unitxt/catalog/recipes/torr/qtsumm/markdown/no_augmentation_5_demos.json' 2026-05-27T11:54:06,626 adding 'unitxt/catalog/recipes/torr/qtsumm/markdown/shuffle_cols_augmentation_5_demos.json' 2026-05-27T11:54:06,627 adding 'unitxt/catalog/recipes/torr/qtsumm/markdown/shuffle_rows_augmentation_5_demos.json' 2026-05-27T11:54:06,628 adding 'unitxt/catalog/recipes/torr/qtsumm/markdown/transpose_augmentation_5_demos.json' 2026-05-27T11:54:06,631 adding 'unitxt/catalog/recipes/torr/scigen/concat/insert_empty_rows_augmentation_5_demos.json' 2026-05-27T11:54:06,632 adding 'unitxt/catalog/recipes/torr/scigen/concat/no_augmentation_5_demos.json' 2026-05-27T11:54:06,633 adding 'unitxt/catalog/recipes/torr/scigen/concat/shuffle_cols_augmentation_5_demos.json' 2026-05-27T11:54:06,634 adding 'unitxt/catalog/recipes/torr/scigen/concat/shuffle_rows_augmentation_5_demos.json' 2026-05-27T11:54:06,635 adding 'unitxt/catalog/recipes/torr/scigen/concat/transpose_augmentation_5_demos.json' 2026-05-27T11:54:06,637 adding 'unitxt/catalog/recipes/torr/scigen/csv/insert_empty_rows_augmentation_5_demos.json' 2026-05-27T11:54:06,638 adding 'unitxt/catalog/recipes/torr/scigen/csv/no_augmentation_5_demos.json' 2026-05-27T11:54:06,640 adding 'unitxt/catalog/recipes/torr/scigen/csv/shuffle_cols_augmentation_5_demos.json' 2026-05-27T11:54:06,641 adding 'unitxt/catalog/recipes/torr/scigen/csv/shuffle_rows_augmentation_5_demos.json' 2026-05-27T11:54:06,642 adding 'unitxt/catalog/recipes/torr/scigen/csv/transpose_augmentation_5_demos.json' 2026-05-27T11:54:06,644 adding 'unitxt/catalog/recipes/torr/scigen/df/insert_empty_rows_augmentation_5_demos.json' 2026-05-27T11:54:06,645 adding 'unitxt/catalog/recipes/torr/scigen/df/no_augmentation_5_demos.json' 2026-05-27T11:54:06,647 adding 'unitxt/catalog/recipes/torr/scigen/df/shuffle_cols_augmentation_5_demos.json' 2026-05-27T11:54:06,648 adding 'unitxt/catalog/recipes/torr/scigen/df/shuffle_rows_augmentation_5_demos.json' 2026-05-27T11:54:06,649 adding 'unitxt/catalog/recipes/torr/scigen/df/transpose_augmentation_5_demos.json' 2026-05-27T11:54:06,651 adding 'unitxt/catalog/recipes/torr/scigen/html/insert_empty_rows_augmentation_5_demos.json' 2026-05-27T11:54:06,652 adding 'unitxt/catalog/recipes/torr/scigen/html/no_augmentation_5_demos.json' 2026-05-27T11:54:06,653 adding 'unitxt/catalog/recipes/torr/scigen/html/shuffle_cols_augmentation_5_demos.json' 2026-05-27T11:54:06,654 adding 'unitxt/catalog/recipes/torr/scigen/html/shuffle_rows_augmentation_5_demos.json' 2026-05-27T11:54:06,655 adding 'unitxt/catalog/recipes/torr/scigen/html/transpose_augmentation_5_demos.json' 2026-05-27T11:54:06,657 adding 'unitxt/catalog/recipes/torr/scigen/indexed_row_major/insert_empty_rows_augmentation_5_demos.json' 2026-05-27T11:54:06,658 adding 'unitxt/catalog/recipes/torr/scigen/indexed_row_major/no_augmentation_5_demos.json' 2026-05-27T11:54:06,660 adding 'unitxt/catalog/recipes/torr/scigen/indexed_row_major/shuffle_cols_augmentation_5_demos.json' 2026-05-27T11:54:06,661 adding 'unitxt/catalog/recipes/torr/scigen/indexed_row_major/shuffle_rows_augmentation_5_demos.json' 2026-05-27T11:54:06,662 adding 'unitxt/catalog/recipes/torr/scigen/indexed_row_major/transpose_augmentation_5_demos.json' 2026-05-27T11:54:06,664 adding 'unitxt/catalog/recipes/torr/scigen/json/insert_empty_rows_augmentation_5_demos.json' 2026-05-27T11:54:06,665 adding 'unitxt/catalog/recipes/torr/scigen/json/no_augmentation_5_demos.json' 2026-05-27T11:54:06,666 adding 'unitxt/catalog/recipes/torr/scigen/json/shuffle_cols_augmentation_5_demos.json' 2026-05-27T11:54:06,667 adding 'unitxt/catalog/recipes/torr/scigen/json/shuffle_rows_augmentation_5_demos.json' 2026-05-27T11:54:06,668 adding 'unitxt/catalog/recipes/torr/scigen/json/transpose_augmentation_5_demos.json' 2026-05-27T11:54:06,670 adding 'unitxt/catalog/recipes/torr/scigen/markdown/insert_empty_rows_augmentation_5_demos.json' 2026-05-27T11:54:06,671 adding 'unitxt/catalog/recipes/torr/scigen/markdown/no_augmentation_5_demos.json' 2026-05-27T11:54:06,673 adding 'unitxt/catalog/recipes/torr/scigen/markdown/shuffle_cols_augmentation_5_demos.json' 2026-05-27T11:54:06,674 adding 'unitxt/catalog/recipes/torr/scigen/markdown/shuffle_rows_augmentation_5_demos.json' 2026-05-27T11:54:06,675 adding 'unitxt/catalog/recipes/torr/scigen/markdown/transpose_augmentation_5_demos.json' 2026-05-27T11:54:06,678 adding 'unitxt/catalog/recipes/torr/tab_fact/concat/insert_empty_rows_augmentation_5_demos.json' 2026-05-27T11:54:06,679 adding 'unitxt/catalog/recipes/torr/tab_fact/concat/no_augmentation_5_demos.json' 2026-05-27T11:54:06,680 adding 'unitxt/catalog/recipes/torr/tab_fact/concat/shuffle_cols_augmentation_5_demos.json' 2026-05-27T11:54:06,681 adding 'unitxt/catalog/recipes/torr/tab_fact/concat/shuffle_rows_augmentation_5_demos.json' 2026-05-27T11:54:06,682 adding 'unitxt/catalog/recipes/torr/tab_fact/concat/transpose_augmentation_5_demos.json' 2026-05-27T11:54:06,684 adding 'unitxt/catalog/recipes/torr/tab_fact/csv/insert_empty_rows_augmentation_5_demos.json' 2026-05-27T11:54:06,685 adding 'unitxt/catalog/recipes/torr/tab_fact/csv/no_augmentation_5_demos.json' 2026-05-27T11:54:06,687 adding 'unitxt/catalog/recipes/torr/tab_fact/csv/shuffle_cols_augmentation_5_demos.json' 2026-05-27T11:54:06,688 adding 'unitxt/catalog/recipes/torr/tab_fact/csv/shuffle_rows_augmentation_5_demos.json' 2026-05-27T11:54:06,689 adding 'unitxt/catalog/recipes/torr/tab_fact/csv/transpose_augmentation_5_demos.json' 2026-05-27T11:54:06,691 adding 'unitxt/catalog/recipes/torr/tab_fact/df/insert_empty_rows_augmentation_5_demos.json' 2026-05-27T11:54:06,692 adding 'unitxt/catalog/recipes/torr/tab_fact/df/no_augmentation_5_demos.json' 2026-05-27T11:54:06,693 adding 'unitxt/catalog/recipes/torr/tab_fact/df/shuffle_cols_augmentation_5_demos.json' 2026-05-27T11:54:06,694 adding 'unitxt/catalog/recipes/torr/tab_fact/df/shuffle_rows_augmentation_5_demos.json' 2026-05-27T11:54:06,696 adding 'unitxt/catalog/recipes/torr/tab_fact/df/transpose_augmentation_5_demos.json' 2026-05-27T11:54:06,697 adding 'unitxt/catalog/recipes/torr/tab_fact/html/insert_empty_rows_augmentation_5_demos.json' 2026-05-27T11:54:06,699 adding 'unitxt/catalog/recipes/torr/tab_fact/html/no_augmentation_5_demos.json' 2026-05-27T11:54:06,700 adding 'unitxt/catalog/recipes/torr/tab_fact/html/shuffle_cols_augmentation_5_demos.json' 2026-05-27T11:54:06,701 adding 'unitxt/catalog/recipes/torr/tab_fact/html/shuffle_rows_augmentation_5_demos.json' 2026-05-27T11:54:06,702 adding 'unitxt/catalog/recipes/torr/tab_fact/html/transpose_augmentation_5_demos.json' 2026-05-27T11:54:06,704 adding 'unitxt/catalog/recipes/torr/tab_fact/indexed_row_major/insert_empty_rows_augmentation_5_demos.json' 2026-05-27T11:54:06,705 adding 'unitxt/catalog/recipes/torr/tab_fact/indexed_row_major/no_augmentation_5_demos.json' 2026-05-27T11:54:06,706 adding 'unitxt/catalog/recipes/torr/tab_fact/indexed_row_major/shuffle_cols_augmentation_5_demos.json' 2026-05-27T11:54:06,708 adding 'unitxt/catalog/recipes/torr/tab_fact/indexed_row_major/shuffle_rows_augmentation_5_demos.json' 2026-05-27T11:54:06,709 adding 'unitxt/catalog/recipes/torr/tab_fact/indexed_row_major/transpose_augmentation_5_demos.json' 2026-05-27T11:54:06,711 adding 'unitxt/catalog/recipes/torr/tab_fact/json/insert_empty_rows_augmentation_5_demos.json' 2026-05-27T11:54:06,712 adding 'unitxt/catalog/recipes/torr/tab_fact/json/no_augmentation_5_demos.json' 2026-05-27T11:54:06,713 adding 'unitxt/catalog/recipes/torr/tab_fact/json/shuffle_cols_augmentation_5_demos.json' 2026-05-27T11:54:06,714 adding 'unitxt/catalog/recipes/torr/tab_fact/json/shuffle_rows_augmentation_5_demos.json' 2026-05-27T11:54:06,715 adding 'unitxt/catalog/recipes/torr/tab_fact/json/transpose_augmentation_5_demos.json' 2026-05-27T11:54:06,717 adding 'unitxt/catalog/recipes/torr/tab_fact/markdown/insert_empty_rows_augmentation_5_demos.json' 2026-05-27T11:54:06,718 adding 'unitxt/catalog/recipes/torr/tab_fact/markdown/no_augmentation_5_demos.json' 2026-05-27T11:54:06,720 adding 'unitxt/catalog/recipes/torr/tab_fact/markdown/shuffle_cols_augmentation_5_demos.json' 2026-05-27T11:54:06,721 adding 'unitxt/catalog/recipes/torr/tab_fact/markdown/shuffle_rows_augmentation_5_demos.json' 2026-05-27T11:54:06,722 adding 'unitxt/catalog/recipes/torr/tab_fact/markdown/transpose_augmentation_5_demos.json' 2026-05-27T11:54:06,724 adding 'unitxt/catalog/recipes/torr/tablebench_data_analysis/concat/insert_empty_rows_augmentation_5_demos.json' 2026-05-27T11:54:06,726 adding 'unitxt/catalog/recipes/torr/tablebench_data_analysis/concat/no_augmentation_5_demos.json' 2026-05-27T11:54:06,727 adding 'unitxt/catalog/recipes/torr/tablebench_data_analysis/concat/shuffle_cols_augmentation_5_demos.json' 2026-05-27T11:54:06,728 adding 'unitxt/catalog/recipes/torr/tablebench_data_analysis/concat/shuffle_rows_augmentation_5_demos.json' 2026-05-27T11:54:06,729 adding 'unitxt/catalog/recipes/torr/tablebench_data_analysis/concat/transpose_augmentation_5_demos.json' 2026-05-27T11:54:06,731 adding 'unitxt/catalog/recipes/torr/tablebench_data_analysis/csv/insert_empty_rows_augmentation_5_demos.json' 2026-05-27T11:54:06,732 adding 'unitxt/catalog/recipes/torr/tablebench_data_analysis/csv/no_augmentation_5_demos.json' 2026-05-27T11:54:06,734 adding 'unitxt/catalog/recipes/torr/tablebench_data_analysis/csv/shuffle_cols_augmentation_5_demos.json' 2026-05-27T11:54:06,735 adding 'unitxt/catalog/recipes/torr/tablebench_data_analysis/csv/shuffle_rows_augmentation_5_demos.json' 2026-05-27T11:54:06,736 adding 'unitxt/catalog/recipes/torr/tablebench_data_analysis/csv/transpose_augmentation_5_demos.json' 2026-05-27T11:54:06,738 adding 'unitxt/catalog/recipes/torr/tablebench_data_analysis/df/insert_empty_rows_augmentation_5_demos.json' 2026-05-27T11:54:06,739 adding 'unitxt/catalog/recipes/torr/tablebench_data_analysis/df/no_augmentation_5_demos.json' 2026-05-27T11:54:06,740 adding 'unitxt/catalog/recipes/torr/tablebench_data_analysis/df/shuffle_cols_augmentation_5_demos.json' 2026-05-27T11:54:06,741 adding 'unitxt/catalog/recipes/torr/tablebench_data_analysis/df/shuffle_rows_augmentation_5_demos.json' 2026-05-27T11:54:06,742 adding 'unitxt/catalog/recipes/torr/tablebench_data_analysis/df/transpose_augmentation_5_demos.json' 2026-05-27T11:54:06,744 adding 'unitxt/catalog/recipes/torr/tablebench_data_analysis/html/insert_empty_rows_augmentation_5_demos.json' 2026-05-27T11:54:06,746 adding 'unitxt/catalog/recipes/torr/tablebench_data_analysis/html/no_augmentation_5_demos.json' 2026-05-27T11:54:06,747 adding 'unitxt/catalog/recipes/torr/tablebench_data_analysis/html/shuffle_cols_augmentation_5_demos.json' 2026-05-27T11:54:06,748 adding 'unitxt/catalog/recipes/torr/tablebench_data_analysis/html/shuffle_rows_augmentation_5_demos.json' 2026-05-27T11:54:06,749 adding 'unitxt/catalog/recipes/torr/tablebench_data_analysis/html/transpose_augmentation_5_demos.json' 2026-05-27T11:54:06,751 adding 'unitxt/catalog/recipes/torr/tablebench_data_analysis/indexed_row_major/insert_empty_rows_augmentation_5_demos.json' 2026-05-27T11:54:06,752 adding 'unitxt/catalog/recipes/torr/tablebench_data_analysis/indexed_row_major/no_augmentation_5_demos.json' 2026-05-27T11:54:06,753 adding 'unitxt/catalog/recipes/torr/tablebench_data_analysis/indexed_row_major/shuffle_cols_augmentation_5_demos.json' 2026-05-27T11:54:06,754 adding 'unitxt/catalog/recipes/torr/tablebench_data_analysis/indexed_row_major/shuffle_rows_augmentation_5_demos.json' 2026-05-27T11:54:06,756 adding 'unitxt/catalog/recipes/torr/tablebench_data_analysis/indexed_row_major/transpose_augmentation_5_demos.json' 2026-05-27T11:54:06,758 adding 'unitxt/catalog/recipes/torr/tablebench_data_analysis/json/insert_empty_rows_augmentation_5_demos.json' 2026-05-27T11:54:06,759 adding 'unitxt/catalog/recipes/torr/tablebench_data_analysis/json/no_augmentation_5_demos.json' 2026-05-27T11:54:06,760 adding 'unitxt/catalog/recipes/torr/tablebench_data_analysis/json/shuffle_cols_augmentation_5_demos.json' 2026-05-27T11:54:06,761 adding 'unitxt/catalog/recipes/torr/tablebench_data_analysis/json/shuffle_rows_augmentation_5_demos.json' 2026-05-27T11:54:06,762 adding 'unitxt/catalog/recipes/torr/tablebench_data_analysis/json/transpose_augmentation_5_demos.json' 2026-05-27T11:54:06,764 adding 'unitxt/catalog/recipes/torr/tablebench_data_analysis/markdown/insert_empty_rows_augmentation_5_demos.json' 2026-05-27T11:54:06,765 adding 'unitxt/catalog/recipes/torr/tablebench_data_analysis/markdown/no_augmentation_5_demos.json' 2026-05-27T11:54:06,767 adding 'unitxt/catalog/recipes/torr/tablebench_data_analysis/markdown/shuffle_cols_augmentation_5_demos.json' 2026-05-27T11:54:06,768 adding 'unitxt/catalog/recipes/torr/tablebench_data_analysis/markdown/shuffle_rows_augmentation_5_demos.json' 2026-05-27T11:54:06,769 adding 'unitxt/catalog/recipes/torr/tablebench_data_analysis/markdown/transpose_augmentation_5_demos.json' 2026-05-27T11:54:06,772 adding 'unitxt/catalog/recipes/torr/tablebench_fact_checking/concat/insert_empty_rows_augmentation_5_demos.json' 2026-05-27T11:54:06,773 adding 'unitxt/catalog/recipes/torr/tablebench_fact_checking/concat/no_augmentation_5_demos.json' 2026-05-27T11:54:06,774 adding 'unitxt/catalog/recipes/torr/tablebench_fact_checking/concat/shuffle_cols_augmentation_5_demos.json' 2026-05-27T11:54:06,775 adding 'unitxt/catalog/recipes/torr/tablebench_fact_checking/concat/shuffle_rows_augmentation_5_demos.json' 2026-05-27T11:54:06,776 adding 'unitxt/catalog/recipes/torr/tablebench_fact_checking/concat/transpose_augmentation_5_demos.json' 2026-05-27T11:54:06,778 adding 'unitxt/catalog/recipes/torr/tablebench_fact_checking/csv/insert_empty_rows_augmentation_5_demos.json' 2026-05-27T11:54:06,779 adding 'unitxt/catalog/recipes/torr/tablebench_fact_checking/csv/no_augmentation_5_demos.json' 2026-05-27T11:54:06,781 adding 'unitxt/catalog/recipes/torr/tablebench_fact_checking/csv/shuffle_cols_augmentation_5_demos.json' 2026-05-27T11:54:06,782 adding 'unitxt/catalog/recipes/torr/tablebench_fact_checking/csv/shuffle_rows_augmentation_5_demos.json' 2026-05-27T11:54:06,783 adding 'unitxt/catalog/recipes/torr/tablebench_fact_checking/csv/transpose_augmentation_5_demos.json' 2026-05-27T11:54:06,785 adding 'unitxt/catalog/recipes/torr/tablebench_fact_checking/df/insert_empty_rows_augmentation_5_demos.json' 2026-05-27T11:54:06,786 adding 'unitxt/catalog/recipes/torr/tablebench_fact_checking/df/no_augmentation_5_demos.json' 2026-05-27T11:54:06,787 adding 'unitxt/catalog/recipes/torr/tablebench_fact_checking/df/shuffle_cols_augmentation_5_demos.json' 2026-05-27T11:54:06,788 adding 'unitxt/catalog/recipes/torr/tablebench_fact_checking/df/shuffle_rows_augmentation_5_demos.json' 2026-05-27T11:54:06,789 adding 'unitxt/catalog/recipes/torr/tablebench_fact_checking/df/transpose_augmentation_5_demos.json' 2026-05-27T11:54:06,791 adding 'unitxt/catalog/recipes/torr/tablebench_fact_checking/html/insert_empty_rows_augmentation_5_demos.json' 2026-05-27T11:54:06,792 adding 'unitxt/catalog/recipes/torr/tablebench_fact_checking/html/no_augmentation_5_demos.json' 2026-05-27T11:54:06,793 adding 'unitxt/catalog/recipes/torr/tablebench_fact_checking/html/shuffle_cols_augmentation_5_demos.json' 2026-05-27T11:54:06,795 adding 'unitxt/catalog/recipes/torr/tablebench_fact_checking/html/shuffle_rows_augmentation_5_demos.json' 2026-05-27T11:54:06,796 adding 'unitxt/catalog/recipes/torr/tablebench_fact_checking/html/transpose_augmentation_5_demos.json' 2026-05-27T11:54:06,797 adding 'unitxt/catalog/recipes/torr/tablebench_fact_checking/indexed_row_major/insert_empty_rows_augmentation_5_demos.json' 2026-05-27T11:54:06,799 adding 'unitxt/catalog/recipes/torr/tablebench_fact_checking/indexed_row_major/no_augmentation_5_demos.json' 2026-05-27T11:54:06,800 adding 'unitxt/catalog/recipes/torr/tablebench_fact_checking/indexed_row_major/shuffle_cols_augmentation_5_demos.json' 2026-05-27T11:54:06,801 adding 'unitxt/catalog/recipes/torr/tablebench_fact_checking/indexed_row_major/shuffle_rows_augmentation_5_demos.json' 2026-05-27T11:54:06,802 adding 'unitxt/catalog/recipes/torr/tablebench_fact_checking/indexed_row_major/transpose_augmentation_5_demos.json' 2026-05-27T11:54:06,804 adding 'unitxt/catalog/recipes/torr/tablebench_fact_checking/json/insert_empty_rows_augmentation_5_demos.json' 2026-05-27T11:54:06,805 adding 'unitxt/catalog/recipes/torr/tablebench_fact_checking/json/no_augmentation_5_demos.json' 2026-05-27T11:54:06,806 adding 'unitxt/catalog/recipes/torr/tablebench_fact_checking/json/shuffle_cols_augmentation_5_demos.json' 2026-05-27T11:54:06,807 adding 'unitxt/catalog/recipes/torr/tablebench_fact_checking/json/shuffle_rows_augmentation_5_demos.json' 2026-05-27T11:54:06,809 adding 'unitxt/catalog/recipes/torr/tablebench_fact_checking/json/transpose_augmentation_5_demos.json' 2026-05-27T11:54:06,810 adding 'unitxt/catalog/recipes/torr/tablebench_fact_checking/markdown/insert_empty_rows_augmentation_5_demos.json' 2026-05-27T11:54:06,812 adding 'unitxt/catalog/recipes/torr/tablebench_fact_checking/markdown/no_augmentation_5_demos.json' 2026-05-27T11:54:06,813 adding 'unitxt/catalog/recipes/torr/tablebench_fact_checking/markdown/shuffle_cols_augmentation_5_demos.json' 2026-05-27T11:54:06,814 adding 'unitxt/catalog/recipes/torr/tablebench_fact_checking/markdown/shuffle_rows_augmentation_5_demos.json' 2026-05-27T11:54:06,815 adding 'unitxt/catalog/recipes/torr/tablebench_fact_checking/markdown/transpose_augmentation_5_demos.json' 2026-05-27T11:54:06,818 adding 'unitxt/catalog/recipes/torr/tablebench_numerical_reasoning/concat/insert_empty_rows_augmentation_5_demos.json' 2026-05-27T11:54:06,819 adding 'unitxt/catalog/recipes/torr/tablebench_numerical_reasoning/concat/no_augmentation_5_demos.json' 2026-05-27T11:54:06,820 adding 'unitxt/catalog/recipes/torr/tablebench_numerical_reasoning/concat/shuffle_cols_augmentation_5_demos.json' 2026-05-27T11:54:06,821 adding 'unitxt/catalog/recipes/torr/tablebench_numerical_reasoning/concat/shuffle_rows_augmentation_5_demos.json' 2026-05-27T11:54:06,822 adding 'unitxt/catalog/recipes/torr/tablebench_numerical_reasoning/concat/transpose_augmentation_5_demos.json' 2026-05-27T11:54:06,824 adding 'unitxt/catalog/recipes/torr/tablebench_numerical_reasoning/csv/insert_empty_rows_augmentation_5_demos.json' 2026-05-27T11:54:06,825 adding 'unitxt/catalog/recipes/torr/tablebench_numerical_reasoning/csv/no_augmentation_5_demos.json' 2026-05-27T11:54:06,826 adding 'unitxt/catalog/recipes/torr/tablebench_numerical_reasoning/csv/shuffle_cols_augmentation_5_demos.json' 2026-05-27T11:54:06,828 adding 'unitxt/catalog/recipes/torr/tablebench_numerical_reasoning/csv/shuffle_rows_augmentation_5_demos.json' 2026-05-27T11:54:06,829 adding 'unitxt/catalog/recipes/torr/tablebench_numerical_reasoning/csv/transpose_augmentation_5_demos.json' 2026-05-27T11:54:06,831 adding 'unitxt/catalog/recipes/torr/tablebench_numerical_reasoning/df/insert_empty_rows_augmentation_5_demos.json' 2026-05-27T11:54:06,832 adding 'unitxt/catalog/recipes/torr/tablebench_numerical_reasoning/df/no_augmentation_5_demos.json' 2026-05-27T11:54:06,834 adding 'unitxt/catalog/recipes/torr/tablebench_numerical_reasoning/df/shuffle_cols_augmentation_5_demos.json' 2026-05-27T11:54:06,835 adding 'unitxt/catalog/recipes/torr/tablebench_numerical_reasoning/df/shuffle_rows_augmentation_5_demos.json' 2026-05-27T11:54:06,836 adding 'unitxt/catalog/recipes/torr/tablebench_numerical_reasoning/df/transpose_augmentation_5_demos.json' 2026-05-27T11:54:06,838 adding 'unitxt/catalog/recipes/torr/tablebench_numerical_reasoning/html/insert_empty_rows_augmentation_5_demos.json' 2026-05-27T11:54:06,839 adding 'unitxt/catalog/recipes/torr/tablebench_numerical_reasoning/html/no_augmentation_5_demos.json' 2026-05-27T11:54:06,840 adding 'unitxt/catalog/recipes/torr/tablebench_numerical_reasoning/html/shuffle_cols_augmentation_5_demos.json' 2026-05-27T11:54:06,841 adding 'unitxt/catalog/recipes/torr/tablebench_numerical_reasoning/html/shuffle_rows_augmentation_5_demos.json' 2026-05-27T11:54:06,843 adding 'unitxt/catalog/recipes/torr/tablebench_numerical_reasoning/html/transpose_augmentation_5_demos.json' 2026-05-27T11:54:06,844 adding 'unitxt/catalog/recipes/torr/tablebench_numerical_reasoning/indexed_row_major/insert_empty_rows_augmentation_5_demos.json' 2026-05-27T11:54:06,845 adding 'unitxt/catalog/recipes/torr/tablebench_numerical_reasoning/indexed_row_major/no_augmentation_5_demos.json' 2026-05-27T11:54:06,847 adding 'unitxt/catalog/recipes/torr/tablebench_numerical_reasoning/indexed_row_major/shuffle_cols_augmentation_5_demos.json' 2026-05-27T11:54:06,848 adding 'unitxt/catalog/recipes/torr/tablebench_numerical_reasoning/indexed_row_major/shuffle_rows_augmentation_5_demos.json' 2026-05-27T11:54:06,849 adding 'unitxt/catalog/recipes/torr/tablebench_numerical_reasoning/indexed_row_major/transpose_augmentation_5_demos.json' 2026-05-27T11:54:06,851 adding 'unitxt/catalog/recipes/torr/tablebench_numerical_reasoning/json/insert_empty_rows_augmentation_5_demos.json' 2026-05-27T11:54:06,852 adding 'unitxt/catalog/recipes/torr/tablebench_numerical_reasoning/json/no_augmentation_5_demos.json' 2026-05-27T11:54:06,853 adding 'unitxt/catalog/recipes/torr/tablebench_numerical_reasoning/json/shuffle_cols_augmentation_5_demos.json' 2026-05-27T11:54:06,855 adding 'unitxt/catalog/recipes/torr/tablebench_numerical_reasoning/json/shuffle_rows_augmentation_5_demos.json' 2026-05-27T11:54:06,856 adding 'unitxt/catalog/recipes/torr/tablebench_numerical_reasoning/json/transpose_augmentation_5_demos.json' 2026-05-27T11:54:06,858 adding 'unitxt/catalog/recipes/torr/tablebench_numerical_reasoning/markdown/insert_empty_rows_augmentation_5_demos.json' 2026-05-27T11:54:06,859 adding 'unitxt/catalog/recipes/torr/tablebench_numerical_reasoning/markdown/no_augmentation_5_demos.json' 2026-05-27T11:54:06,860 adding 'unitxt/catalog/recipes/torr/tablebench_numerical_reasoning/markdown/shuffle_cols_augmentation_5_demos.json' 2026-05-27T11:54:06,861 adding 'unitxt/catalog/recipes/torr/tablebench_numerical_reasoning/markdown/shuffle_rows_augmentation_5_demos.json' 2026-05-27T11:54:06,862 adding 'unitxt/catalog/recipes/torr/tablebench_numerical_reasoning/markdown/transpose_augmentation_5_demos.json' 2026-05-27T11:54:06,864 adding 'unitxt/catalog/recipes/torr/turl_col_type/concat/insert_empty_rows_augmentation_5_demos.json' 2026-05-27T11:54:06,866 adding 'unitxt/catalog/recipes/torr/turl_col_type/concat/no_augmentation_5_demos.json' 2026-05-27T11:54:06,867 adding 'unitxt/catalog/recipes/torr/turl_col_type/concat/shuffle_cols_augmentation_5_demos.json' 2026-05-27T11:54:06,868 adding 'unitxt/catalog/recipes/torr/turl_col_type/concat/shuffle_rows_augmentation_5_demos.json' 2026-05-27T11:54:06,869 adding 'unitxt/catalog/recipes/torr/turl_col_type/concat/transpose_augmentation_5_demos.json' 2026-05-27T11:54:06,871 adding 'unitxt/catalog/recipes/torr/turl_col_type/csv/insert_empty_rows_augmentation_5_demos.json' 2026-05-27T11:54:06,872 adding 'unitxt/catalog/recipes/torr/turl_col_type/csv/no_augmentation_5_demos.json' 2026-05-27T11:54:06,873 adding 'unitxt/catalog/recipes/torr/turl_col_type/csv/shuffle_cols_augmentation_5_demos.json' 2026-05-27T11:54:06,874 adding 'unitxt/catalog/recipes/torr/turl_col_type/csv/shuffle_rows_augmentation_5_demos.json' 2026-05-27T11:54:06,875 adding 'unitxt/catalog/recipes/torr/turl_col_type/csv/transpose_augmentation_5_demos.json' 2026-05-27T11:54:06,877 adding 'unitxt/catalog/recipes/torr/turl_col_type/df/insert_empty_rows_augmentation_5_demos.json' 2026-05-27T11:54:06,878 adding 'unitxt/catalog/recipes/torr/turl_col_type/df/no_augmentation_5_demos.json' 2026-05-27T11:54:06,879 adding 'unitxt/catalog/recipes/torr/turl_col_type/df/shuffle_cols_augmentation_5_demos.json' 2026-05-27T11:54:06,880 adding 'unitxt/catalog/recipes/torr/turl_col_type/df/shuffle_rows_augmentation_5_demos.json' 2026-05-27T11:54:06,882 adding 'unitxt/catalog/recipes/torr/turl_col_type/df/transpose_augmentation_5_demos.json' 2026-05-27T11:54:06,883 adding 'unitxt/catalog/recipes/torr/turl_col_type/html/insert_empty_rows_augmentation_5_demos.json' 2026-05-27T11:54:06,884 adding 'unitxt/catalog/recipes/torr/turl_col_type/html/no_augmentation_5_demos.json' 2026-05-27T11:54:06,885 adding 'unitxt/catalog/recipes/torr/turl_col_type/html/shuffle_cols_augmentation_5_demos.json' 2026-05-27T11:54:06,887 adding 'unitxt/catalog/recipes/torr/turl_col_type/html/shuffle_rows_augmentation_5_demos.json' 2026-05-27T11:54:06,888 adding 'unitxt/catalog/recipes/torr/turl_col_type/html/transpose_augmentation_5_demos.json' 2026-05-27T11:54:06,890 adding 'unitxt/catalog/recipes/torr/turl_col_type/indexed_row_major/insert_empty_rows_augmentation_5_demos.json' 2026-05-27T11:54:06,891 adding 'unitxt/catalog/recipes/torr/turl_col_type/indexed_row_major/no_augmentation_5_demos.json' 2026-05-27T11:54:06,892 adding 'unitxt/catalog/recipes/torr/turl_col_type/indexed_row_major/shuffle_cols_augmentation_5_demos.json' 2026-05-27T11:54:06,893 adding 'unitxt/catalog/recipes/torr/turl_col_type/indexed_row_major/shuffle_rows_augmentation_5_demos.json' 2026-05-27T11:54:06,894 adding 'unitxt/catalog/recipes/torr/turl_col_type/indexed_row_major/transpose_augmentation_5_demos.json' 2026-05-27T11:54:06,896 adding 'unitxt/catalog/recipes/torr/turl_col_type/json/insert_empty_rows_augmentation_5_demos.json' 2026-05-27T11:54:06,898 adding 'unitxt/catalog/recipes/torr/turl_col_type/json/no_augmentation_5_demos.json' 2026-05-27T11:54:06,899 adding 'unitxt/catalog/recipes/torr/turl_col_type/json/shuffle_cols_augmentation_5_demos.json' 2026-05-27T11:54:06,900 adding 'unitxt/catalog/recipes/torr/turl_col_type/json/shuffle_rows_augmentation_5_demos.json' 2026-05-27T11:54:06,901 adding 'unitxt/catalog/recipes/torr/turl_col_type/json/transpose_augmentation_5_demos.json' 2026-05-27T11:54:06,903 adding 'unitxt/catalog/recipes/torr/turl_col_type/markdown/insert_empty_rows_augmentation_5_demos.json' 2026-05-27T11:54:06,904 adding 'unitxt/catalog/recipes/torr/turl_col_type/markdown/no_augmentation_5_demos.json' 2026-05-27T11:54:06,906 adding 'unitxt/catalog/recipes/torr/turl_col_type/markdown/shuffle_cols_augmentation_5_demos.json' 2026-05-27T11:54:06,907 adding 'unitxt/catalog/recipes/torr/turl_col_type/markdown/shuffle_rows_augmentation_5_demos.json' 2026-05-27T11:54:06,908 adding 'unitxt/catalog/recipes/torr/turl_col_type/markdown/transpose_augmentation_5_demos.json' 2026-05-27T11:54:06,911 adding 'unitxt/catalog/recipes/torr/wikitq/concat/insert_empty_rows_augmentation_1_demos.json' 2026-05-27T11:54:06,912 adding 'unitxt/catalog/recipes/torr/wikitq/concat/no_augmentation_1_demos.json' 2026-05-27T11:54:06,913 adding 'unitxt/catalog/recipes/torr/wikitq/concat/shuffle_cols_augmentation_1_demos.json' 2026-05-27T11:54:06,914 adding 'unitxt/catalog/recipes/torr/wikitq/concat/shuffle_rows_augmentation_1_demos.json' 2026-05-27T11:54:06,915 adding 'unitxt/catalog/recipes/torr/wikitq/concat/transpose_augmentation_1_demos.json' 2026-05-27T11:54:06,917 adding 'unitxt/catalog/recipes/torr/wikitq/csv/insert_empty_rows_augmentation_1_demos.json' 2026-05-27T11:54:06,918 adding 'unitxt/catalog/recipes/torr/wikitq/csv/no_augmentation_1_demos.json' 2026-05-27T11:54:06,919 adding 'unitxt/catalog/recipes/torr/wikitq/csv/shuffle_cols_augmentation_1_demos.json' 2026-05-27T11:54:06,921 adding 'unitxt/catalog/recipes/torr/wikitq/csv/shuffle_rows_augmentation_1_demos.json' 2026-05-27T11:54:06,922 adding 'unitxt/catalog/recipes/torr/wikitq/csv/transpose_augmentation_1_demos.json' 2026-05-27T11:54:06,923 adding 'unitxt/catalog/recipes/torr/wikitq/df/insert_empty_rows_augmentation_1_demos.json' 2026-05-27T11:54:06,924 adding 'unitxt/catalog/recipes/torr/wikitq/df/no_augmentation_1_demos.json' 2026-05-27T11:54:06,926 adding 'unitxt/catalog/recipes/torr/wikitq/df/shuffle_cols_augmentation_1_demos.json' 2026-05-27T11:54:06,927 adding 'unitxt/catalog/recipes/torr/wikitq/df/shuffle_rows_augmentation_1_demos.json' 2026-05-27T11:54:06,928 adding 'unitxt/catalog/recipes/torr/wikitq/df/transpose_augmentation_1_demos.json' 2026-05-27T11:54:06,930 adding 'unitxt/catalog/recipes/torr/wikitq/html/insert_empty_rows_augmentation_1_demos.json' 2026-05-27T11:54:06,931 adding 'unitxt/catalog/recipes/torr/wikitq/html/no_augmentation_1_demos.json' 2026-05-27T11:54:06,932 adding 'unitxt/catalog/recipes/torr/wikitq/html/shuffle_cols_augmentation_1_demos.json' 2026-05-27T11:54:06,933 adding 'unitxt/catalog/recipes/torr/wikitq/html/shuffle_rows_augmentation_1_demos.json' 2026-05-27T11:54:06,934 adding 'unitxt/catalog/recipes/torr/wikitq/html/transpose_augmentation_1_demos.json' 2026-05-27T11:54:06,936 adding 'unitxt/catalog/recipes/torr/wikitq/indexed_row_major/insert_empty_rows_augmentation_1_demos.json' 2026-05-27T11:54:06,937 adding 'unitxt/catalog/recipes/torr/wikitq/indexed_row_major/no_augmentation_1_demos.json' 2026-05-27T11:54:06,939 adding 'unitxt/catalog/recipes/torr/wikitq/indexed_row_major/shuffle_cols_augmentation_1_demos.json' 2026-05-27T11:54:06,940 adding 'unitxt/catalog/recipes/torr/wikitq/indexed_row_major/shuffle_rows_augmentation_1_demos.json' 2026-05-27T11:54:06,941 adding 'unitxt/catalog/recipes/torr/wikitq/indexed_row_major/transpose_augmentation_1_demos.json' 2026-05-27T11:54:06,943 adding 'unitxt/catalog/recipes/torr/wikitq/json/insert_empty_rows_augmentation_1_demos.json' 2026-05-27T11:54:06,944 adding 'unitxt/catalog/recipes/torr/wikitq/json/no_augmentation_1_demos.json' 2026-05-27T11:54:06,945 adding 'unitxt/catalog/recipes/torr/wikitq/json/shuffle_cols_augmentation_1_demos.json' 2026-05-27T11:54:06,947 adding 'unitxt/catalog/recipes/torr/wikitq/json/shuffle_rows_augmentation_1_demos.json' 2026-05-27T11:54:06,948 adding 'unitxt/catalog/recipes/torr/wikitq/json/transpose_augmentation_1_demos.json' 2026-05-27T11:54:06,950 adding 'unitxt/catalog/recipes/torr/wikitq/markdown/insert_empty_rows_augmentation_1_demos.json' 2026-05-27T11:54:06,951 adding 'unitxt/catalog/recipes/torr/wikitq/markdown/no_augmentation_1_demos.json' 2026-05-27T11:54:06,952 adding 'unitxt/catalog/recipes/torr/wikitq/markdown/shuffle_cols_augmentation_1_demos.json' 2026-05-27T11:54:06,953 adding 'unitxt/catalog/recipes/torr/wikitq/markdown/shuffle_rows_augmentation_1_demos.json' 2026-05-27T11:54:06,954 adding 'unitxt/catalog/recipes/torr/wikitq/markdown/transpose_augmentation_1_demos.json' 2026-05-27T11:54:06,956 adding 'unitxt/catalog/serializers/table/concat.json' 2026-05-27T11:54:06,957 adding 'unitxt/catalog/serializers/table/df.json' 2026-05-27T11:54:06,958 adding 'unitxt/catalog/serializers/table/html.json' 2026-05-27T11:54:06,959 adding 'unitxt/catalog/serializers/table/image.json' 2026-05-27T11:54:06,960 adding 'unitxt/catalog/serializers/table/indexed_row_major.json' 2026-05-27T11:54:06,961 adding 'unitxt/catalog/serializers/table/json.json' 2026-05-27T11:54:06,963 adding 'unitxt/catalog/serializers/table/markdown.json' 2026-05-27T11:54:06,964 adding 'unitxt/catalog/serializers/text2sql/schema.json' 2026-05-27T11:54:06,966 adding 'unitxt/catalog/splitters/diverse_labels_sampler.json' 2026-05-27T11:54:06,967 adding 'unitxt/catalog/splitters/large_no_dev.json' 2026-05-27T11:54:06,968 adding 'unitxt/catalog/splitters/large_no_test.json' 2026-05-27T11:54:06,969 adding 'unitxt/catalog/splitters/small_no_dev.json' 2026-05-27T11:54:06,970 adding 'unitxt/catalog/splitters/small_no_test.json' 2026-05-27T11:54:06,971 adding 'unitxt/catalog/splitters/test_only.json' 2026-05-27T11:54:06,973 adding 'unitxt/catalog/system_prompts/boolqa.json' 2026-05-27T11:54:06,974 adding 'unitxt/catalog/system_prompts/empty.json' 2026-05-27T11:54:06,975 adding 'unitxt/catalog/system_prompts/general/be_concise.json' 2026-05-27T11:54:06,977 adding 'unitxt/catalog/system_prompts/model/granite.json' 2026-05-27T11:54:06,978 adding 'unitxt/catalog/system_prompts/models/alpaca.json' 2026-05-27T11:54:06,980 adding 'unitxt/catalog/system_prompts/models/deepseek_coder.json' 2026-05-27T11:54:06,981 adding 'unitxt/catalog/system_prompts/models/japanese_llama.json' 2026-05-27T11:54:06,982 adding 'unitxt/catalog/system_prompts/models/labradorite.json' 2026-05-27T11:54:06,983 adding 'unitxt/catalog/system_prompts/models/llama.json' 2026-05-27T11:54:06,984 adding 'unitxt/catalog/system_prompts/models/llama2.json' 2026-05-27T11:54:06,986 adding 'unitxt/catalog/system_prompts/models/llava_next_llama3_8b.json' 2026-05-27T11:54:06,988 adding 'unitxt/catalog/tasks/generation.json' 2026-05-27T11:54:06,989 adding 'unitxt/catalog/tasks/grammatical_error_correction.json' 2026-05-27T11:54:06,990 adding 'unitxt/catalog/tasks/key_value_extraction.json' 2026-05-27T11:54:06,991 adding 'unitxt/catalog/tasks/language_identification.json' 2026-05-27T11:54:06,993 adding 'unitxt/catalog/tasks/schema_linking.json' 2026-05-27T11:54:06,994 adding 'unitxt/catalog/tasks/text2sql.json' 2026-05-27T11:54:06,995 adding 'unitxt/catalog/tasks/text2sql_logic.json' 2026-05-27T11:54:06,997 adding 'unitxt/catalog/tasks/classification/binary.json' 2026-05-27T11:54:06,998 adding 'unitxt/catalog/tasks/classification/multi_class.json' 2026-05-27T11:54:07,000 adding 'unitxt/catalog/tasks/classification/multi_label.json' 2026-05-27T11:54:07,001 adding 'unitxt/catalog/tasks/classification/binary/zero_or_one.json' 2026-05-27T11:54:07,003 adding 'unitxt/catalog/tasks/classification/multi_class/relation.json' 2026-05-27T11:54:07,004 adding 'unitxt/catalog/tasks/classification/multi_class/topic_classification.json' 2026-05-27T11:54:07,006 adding 'unitxt/catalog/tasks/classification/multi_class/with_classes_descriptions.json' 2026-05-27T11:54:07,007 adding 'unitxt/catalog/tasks/completion/abstractive.json' 2026-05-27T11:54:07,009 adding 'unitxt/catalog/tasks/completion/extractive.json' 2026-05-27T11:54:07,010 adding 'unitxt/catalog/tasks/completion/multiple_choice.json' 2026-05-27T11:54:07,011 adding 'unitxt/catalog/tasks/evaluation/preference.json' 2026-05-27T11:54:07,013 adding 'unitxt/catalog/tasks/generation/from_pair.json' 2026-05-27T11:54:07,015 adding 'unitxt/catalog/tasks/ner/all_entity_types.json' 2026-05-27T11:54:07,016 adding 'unitxt/catalog/tasks/ner/single_entity_type.json' 2026-05-27T11:54:07,017 adding 'unitxt/catalog/tasks/qa/extractive.json' 2026-05-27T11:54:07,018 adding 'unitxt/catalog/tasks/qa/open.json' 2026-05-27T11:54:07,020 adding 'unitxt/catalog/tasks/qa/with_context.json' 2026-05-27T11:54:07,021 adding 'unitxt/catalog/tasks/qa/extractive/multi_turn.json' 2026-05-27T11:54:07,023 adding 'unitxt/catalog/tasks/qa/multiple_choice/open.json' 2026-05-27T11:54:07,024 adding 'unitxt/catalog/tasks/qa/multiple_choice/with_context.json' 2026-05-27T11:54:07,025 adding 'unitxt/catalog/tasks/qa/multiple_choice/with_topic.json' 2026-05-27T11:54:07,027 adding 'unitxt/catalog/tasks/qa/multiple_choice/with_context/with_topic.json' 2026-05-27T11:54:07,029 adding 'unitxt/catalog/tasks/qa/with_context/abstractive.json' 2026-05-27T11:54:07,030 adding 'unitxt/catalog/tasks/qa/with_context/extractive.json' 2026-05-27T11:54:07,031 adding 'unitxt/catalog/tasks/qa/with_context/with_domain.json' 2026-05-27T11:54:07,033 adding 'unitxt/catalog/tasks/qa/with_context/with_type.json' 2026-05-27T11:54:07,035 adding 'unitxt/catalog/tasks/rag/corpora.json' 2026-05-27T11:54:07,036 adding 'unitxt/catalog/tasks/rag/end_to_end.json' 2026-05-27T11:54:07,037 adding 'unitxt/catalog/tasks/rag/response_generation.json' 2026-05-27T11:54:07,040 adding 'unitxt/catalog/tasks/rag_eval/answer_correctness/binary.json' 2026-05-27T11:54:07,041 adding 'unitxt/catalog/tasks/rag_eval/answer_correctness/non_binary.json' 2026-05-27T11:54:07,043 adding 'unitxt/catalog/tasks/rag_eval/answer_relevance/binary.json' 2026-05-27T11:54:07,044 adding 'unitxt/catalog/tasks/rag_eval/answer_relevance/non_binary.json' 2026-05-27T11:54:07,046 adding 'unitxt/catalog/tasks/rag_eval/context_relevance/binary.json' 2026-05-27T11:54:07,047 adding 'unitxt/catalog/tasks/rag_eval/context_relevance/non_binary.json' 2026-05-27T11:54:07,048 adding 'unitxt/catalog/tasks/rag_eval/correctness_holistic/binary.json' 2026-05-27T11:54:07,050 adding 'unitxt/catalog/tasks/rag_eval/correctness_holistic/non_binary.json' 2026-05-27T11:54:07,051 adding 'unitxt/catalog/tasks/rag_eval/faithfulness/binary.json' 2026-05-27T11:54:07,052 adding 'unitxt/catalog/tasks/rag_eval/faithfulness/non_binary.json' 2026-05-27T11:54:07,054 adding 'unitxt/catalog/tasks/regression/single_text.json' 2026-05-27T11:54:07,055 adding 'unitxt/catalog/tasks/regression/two_texts.json' 2026-05-27T11:54:07,057 adding 'unitxt/catalog/tasks/regression/two_texts/similarity.json' 2026-05-27T11:54:07,059 adding 'unitxt/catalog/tasks/response_assessment/pairwise_comparative_rating/single_turn.json' 2026-05-27T11:54:07,061 adding 'unitxt/catalog/tasks/response_assessment/pairwise_comparison/multi_turn.json' 2026-05-27T11:54:07,062 adding 'unitxt/catalog/tasks/response_assessment/pairwise_comparison/multi_turn_with_reference.json' 2026-05-27T11:54:07,063 adding 'unitxt/catalog/tasks/response_assessment/pairwise_comparison/single_turn.json' 2026-05-27T11:54:07,064 adding 'unitxt/catalog/tasks/response_assessment/pairwise_comparison/single_turn_with_reference.json' 2026-05-27T11:54:07,066 adding 'unitxt/catalog/tasks/response_assessment/rating/multi_turn.json' 2026-05-27T11:54:07,067 adding 'unitxt/catalog/tasks/response_assessment/rating/multi_turn_with_reference.json' 2026-05-27T11:54:07,069 adding 'unitxt/catalog/tasks/response_assessment/rating/single_turn.json' 2026-05-27T11:54:07,070 adding 'unitxt/catalog/tasks/response_assessment/rating/single_turn_with_reference.json' 2026-05-27T11:54:07,072 adding 'unitxt/catalog/tasks/rewriting/by_attribute.json' 2026-05-27T11:54:07,073 adding 'unitxt/catalog/tasks/rewriting/paraphrase.json' 2026-05-27T11:54:07,074 adding 'unitxt/catalog/tasks/selection/by_attribute.json' 2026-05-27T11:54:07,076 adding 'unitxt/catalog/tasks/span_labeling/extraction.json' 2026-05-27T11:54:07,078 adding 'unitxt/catalog/tasks/summarization/abstractive.json' 2026-05-27T11:54:07,079 adding 'unitxt/catalog/tasks/targeted_sentiment_extraction/all_sentiment_classes.json' 2026-05-27T11:54:07,081 adding 'unitxt/catalog/tasks/targeted_sentiment_extraction/single_sentiment_class.json' 2026-05-27T11:54:07,082 adding 'unitxt/catalog/tasks/tool_calling/multi_turn.json' 2026-05-27T11:54:07,083 adding 'unitxt/catalog/tasks/tool_calling/supervised.json' 2026-05-27T11:54:07,085 adding 'unitxt/catalog/tasks/translation/directed.json' 2026-05-27T11:54:07,088 adding 'unitxt/catalog/templates/empty.json' 2026-05-27T11:54:07,089 adding 'unitxt/catalog/templates/key_val.json' 2026-05-27T11:54:07,090 adding 'unitxt/catalog/templates/key_val_with_new_lines.json' 2026-05-27T11:54:07,092 adding 'unitxt/catalog/templates/classification/multi_class/all.json' 2026-05-27T11:54:07,093 adding 'unitxt/catalog/templates/classification/multi_class/bluebench.json' 2026-05-27T11:54:07,094 adding 'unitxt/catalog/templates/classification/multi_class/default.json' 2026-05-27T11:54:07,096 adding 'unitxt/catalog/templates/classification/multi_class/empty.json' 2026-05-27T11:54:07,097 adding 'unitxt/catalog/templates/classification/multi_class/instruct_question_select_i_think.json' 2026-05-27T11:54:07,098 adding 'unitxt/catalog/templates/classification/multi_class/instruct_question_selects.json' 2026-05-27T11:54:07,099 adding 'unitxt/catalog/templates/classification/multi_class/instruct_select_question.json' 2026-05-27T11:54:07,100 adding 'unitxt/catalog/templates/classification/multi_class/instruction.json' 2026-05-27T11:54:07,101 adding 'unitxt/catalog/templates/classification/multi_class/title.json' 2026-05-27T11:54:07,103 adding 'unitxt/catalog/templates/classification/multi_class/relation/all.json' 2026-05-27T11:54:07,104 adding 'unitxt/catalog/templates/classification/multi_class/relation/default.json' 2026-05-27T11:54:07,105 adding 'unitxt/catalog/templates/classification/multi_class/relation/simple.json' 2026-05-27T11:54:07,107 adding 'unitxt/catalog/templates/classification/multi_class/relation/truthfulness/all.json' 2026-05-27T11:54:07,108 adding 'unitxt/catalog/templates/classification/multi_class/relation/truthfulness/flan_1.json' 2026-05-27T11:54:07,109 adding 'unitxt/catalog/templates/classification/multi_class/relation/truthfulness/flan_2.json' 2026-05-27T11:54:07,110 adding 'unitxt/catalog/templates/classification/multi_class/relation/truthfulness/flan_3.json' 2026-05-27T11:54:07,112 adding 'unitxt/catalog/templates/classification/multi_class/relation/truthfulness/flan_4.json' 2026-05-27T11:54:07,113 adding 'unitxt/catalog/templates/classification/multi_class/relation/truthfulness/flan_5.json' 2026-05-27T11:54:07,114 adding 'unitxt/catalog/templates/classification/multi_class/relation/truthfulness/flan_6.json' 2026-05-27T11:54:07,115 adding 'unitxt/catalog/templates/classification/multi_class/relation/truthfulness/flan_7.json' 2026-05-27T11:54:07,117 adding 'unitxt/catalog/templates/classification/multi_label/all.json' 2026-05-27T11:54:07,118 adding 'unitxt/catalog/templates/classification/multi_label/default.json' 2026-05-27T11:54:07,120 adding 'unitxt/catalog/templates/classification/multi_label/empty.json' 2026-05-27T11:54:07,121 adding 'unitxt/catalog/templates/classification/multi_label/instruction.json' 2026-05-27T11:54:07,122 adding 'unitxt/catalog/templates/classification/multi_label/title.json' 2026-05-27T11:54:07,124 adding 'unitxt/catalog/templates/completion/abstractive/all.json' 2026-05-27T11:54:07,125 adding 'unitxt/catalog/templates/completion/abstractive/empty.json' 2026-05-27T11:54:07,127 adding 'unitxt/catalog/templates/completion/abstractive/standard.json' 2026-05-27T11:54:07,128 adding 'unitxt/catalog/templates/completion/multiple_choice/all.json' 2026-05-27T11:54:07,129 adding 'unitxt/catalog/templates/completion/multiple_choice/bluebench.json' 2026-05-27T11:54:07,131 adding 'unitxt/catalog/templates/completion/multiple_choice/enumerated.json' 2026-05-27T11:54:07,132 adding 'unitxt/catalog/templates/completion/multiple_choice/simple.json' 2026-05-27T11:54:07,133 adding 'unitxt/catalog/templates/completion/multiple_choice/standard.json' 2026-05-27T11:54:07,134 adding 'unitxt/catalog/templates/completion/multiple_choice/title.json' 2026-05-27T11:54:07,136 adding 'unitxt/catalog/templates/evaluation/preference/all.json' 2026-05-27T11:54:07,137 adding 'unitxt/catalog/templates/evaluation/preference/default.json' 2026-05-27T11:54:07,139 adding 'unitxt/catalog/templates/generation/all.json' 2026-05-27T11:54:07,140 adding 'unitxt/catalog/templates/generation/default.json' 2026-05-27T11:54:07,141 adding 'unitxt/catalog/templates/generation/empty.json' 2026-05-27T11:54:07,142 adding 'unitxt/catalog/templates/generation/from_pair/all.json' 2026-05-27T11:54:07,143 adding 'unitxt/catalog/templates/generation/from_pair/default.json' 2026-05-27T11:54:07,145 adding 'unitxt/catalog/templates/grammatical_error_correction/all.json' 2026-05-27T11:54:07,146 adding 'unitxt/catalog/templates/grammatical_error_correction/simple.json' 2026-05-27T11:54:07,148 adding 'unitxt/catalog/templates/grammatical_error_detection/all.json' 2026-05-27T11:54:07,149 adding 'unitxt/catalog/templates/grammatical_error_detection/yes_no.json' 2026-05-27T11:54:07,150 adding 'unitxt/catalog/templates/key_value_extraction/extract_in_json_format.json' 2026-05-27T11:54:07,152 adding 'unitxt/catalog/templates/language_identification/all.json' 2026-05-27T11:54:07,153 adding 'unitxt/catalog/templates/language_identification/simple.json' 2026-05-27T11:54:07,155 adding 'unitxt/catalog/templates/qa/extractive.json' 2026-05-27T11:54:07,156 adding 'unitxt/catalog/templates/qa/open.json' 2026-05-27T11:54:07,157 adding 'unitxt/catalog/templates/qa/with_context.json' 2026-05-27T11:54:07,160 adding 'unitxt/catalog/templates/qa/llama_vision/multiple_choice/with_context/ai2d.json' 2026-05-27T11:54:07,161 adding 'unitxt/catalog/templates/qa/llama_vision/with_context/chart_qa.json' 2026-05-27T11:54:07,162 adding 'unitxt/catalog/templates/qa/llama_vision/with_context/doc_vqa.json' 2026-05-27T11:54:07,163 adding 'unitxt/catalog/templates/qa/llama_vision/with_context/info_vqa.json' 2026-05-27T11:54:07,166 adding 'unitxt/catalog/templates/qa/multi_turn/with_context/simple.json' 2026-05-27T11:54:07,167 adding 'unitxt/catalog/templates/qa/multiple_choice/helm.json' 2026-05-27T11:54:07,169 adding 'unitxt/catalog/templates/qa/multiple_choice/lm_eval_harness.json' 2026-05-27T11:54:07,170 adding 'unitxt/catalog/templates/qa/multiple_choice/match.json' 2026-05-27T11:54:07,171 adding 'unitxt/catalog/templates/qa/multiple_choice/title.json' 2026-05-27T11:54:07,173 adding 'unitxt/catalog/templates/qa/multiple_choice/open/all.json' 2026-05-27T11:54:07,174 adding 'unitxt/catalog/templates/qa/multiple_choice/open/bluebench.json' 2026-05-27T11:54:07,175 adding 'unitxt/catalog/templates/qa/multiple_choice/open/helm.json' 2026-05-27T11:54:07,176 adding 'unitxt/catalog/templates/qa/multiple_choice/open/lm_eval_harness.json' 2026-05-27T11:54:07,178 adding 'unitxt/catalog/templates/qa/multiple_choice/open/mmlu.json' 2026-05-27T11:54:07,179 adding 'unitxt/catalog/templates/qa/multiple_choice/open/de/all.json' 2026-05-27T11:54:07,180 adding 'unitxt/catalog/templates/qa/multiple_choice/open/de/helm.json' 2026-05-27T11:54:07,182 adding 'unitxt/catalog/templates/qa/multiple_choice/open/de/lm_eval_harness.json' 2026-05-27T11:54:07,183 adding 'unitxt/catalog/templates/qa/multiple_choice/open/de/mmlu.json' 2026-05-27T11:54:07,185 adding 'unitxt/catalog/templates/qa/multiple_choice/open/es/all.json' 2026-05-27T11:54:07,186 adding 'unitxt/catalog/templates/qa/multiple_choice/open/es/helm.json' 2026-05-27T11:54:07,187 adding 'unitxt/catalog/templates/qa/multiple_choice/open/es/lm_eval_harness.json' 2026-05-27T11:54:07,188 adding 'unitxt/catalog/templates/qa/multiple_choice/open/es/mmlu.json' 2026-05-27T11:54:07,190 adding 'unitxt/catalog/templates/qa/multiple_choice/open/fr/all.json' 2026-05-27T11:54:07,191 adding 'unitxt/catalog/templates/qa/multiple_choice/open/fr/helm.json' 2026-05-27T11:54:07,192 adding 'unitxt/catalog/templates/qa/multiple_choice/open/fr/lm_eval_harness.json' 2026-05-27T11:54:07,193 adding 'unitxt/catalog/templates/qa/multiple_choice/open/fr/mmlu.json' 2026-05-27T11:54:07,195 adding 'unitxt/catalog/templates/qa/multiple_choice/open/ja/all.json' 2026-05-27T11:54:07,196 adding 'unitxt/catalog/templates/qa/multiple_choice/open/ja/helm.json' 2026-05-27T11:54:07,197 adding 'unitxt/catalog/templates/qa/multiple_choice/open/ja/lm_eval_harness.json' 2026-05-27T11:54:07,199 adding 'unitxt/catalog/templates/qa/multiple_choice/open/ja/mmlu.json' 2026-05-27T11:54:07,200 adding 'unitxt/catalog/templates/qa/multiple_choice/open/pt/all.json' 2026-05-27T11:54:07,201 adding 'unitxt/catalog/templates/qa/multiple_choice/open/pt/helm.json' 2026-05-27T11:54:07,203 adding 'unitxt/catalog/templates/qa/multiple_choice/open/pt/lm_eval_harness.json' 2026-05-27T11:54:07,204 adding 'unitxt/catalog/templates/qa/multiple_choice/open/pt/mmlu.json' 2026-05-27T11:54:07,206 adding 'unitxt/catalog/templates/qa/multiple_choice/with_context/ai2d.json' 2026-05-27T11:54:07,207 adding 'unitxt/catalog/templates/qa/multiple_choice/with_context/all.json' 2026-05-27T11:54:07,208 adding 'unitxt/catalog/templates/qa/multiple_choice/with_context/bluebench.json' 2026-05-27T11:54:07,209 adding 'unitxt/catalog/templates/qa/multiple_choice/with_context/exact_answer_instruct.json' 2026-05-27T11:54:07,210 adding 'unitxt/catalog/templates/qa/multiple_choice/with_context/lm_eval_harness.json' 2026-05-27T11:54:07,211 adding 'unitxt/catalog/templates/qa/multiple_choice/with_context/lmms_eval.json' 2026-05-27T11:54:07,213 adding 'unitxt/catalog/templates/qa/multiple_choice/with_context/match.json' 2026-05-27T11:54:07,214 adding 'unitxt/catalog/templates/qa/multiple_choice/with_context/title.json' 2026-05-27T11:54:07,215 adding 'unitxt/catalog/templates/qa/multiple_choice/with_context/no_intro/all.json' 2026-05-27T11:54:07,217 adding 'unitxt/catalog/templates/qa/multiple_choice/with_context/no_intro/helm.json' 2026-05-27T11:54:07,218 adding 'unitxt/catalog/templates/qa/multiple_choice/with_context/no_intro/lm_eval_harness.json' 2026-05-27T11:54:07,219 adding 'unitxt/catalog/templates/qa/multiple_choice/with_context/no_intro/mmlu.json' 2026-05-27T11:54:07,221 adding 'unitxt/catalog/templates/qa/multiple_choice/with_context/no_intro/de/all.json' 2026-05-27T11:54:07,222 adding 'unitxt/catalog/templates/qa/multiple_choice/with_context/no_intro/de/helm.json' 2026-05-27T11:54:07,223 adding 'unitxt/catalog/templates/qa/multiple_choice/with_context/no_intro/de/lm_eval_harness.json' 2026-05-27T11:54:07,224 adding 'unitxt/catalog/templates/qa/multiple_choice/with_context/no_intro/de/mmlu.json' 2026-05-27T11:54:07,226 adding 'unitxt/catalog/templates/qa/multiple_choice/with_context/no_intro/es/all.json' 2026-05-27T11:54:07,227 adding 'unitxt/catalog/templates/qa/multiple_choice/with_context/no_intro/es/helm.json' 2026-05-27T11:54:07,229 adding 'unitxt/catalog/templates/qa/multiple_choice/with_context/no_intro/es/lm_eval_harness.json' 2026-05-27T11:54:07,230 adding 'unitxt/catalog/templates/qa/multiple_choice/with_context/no_intro/es/mmlu.json' 2026-05-27T11:54:07,232 adding 'unitxt/catalog/templates/qa/multiple_choice/with_context/no_intro/fr/all.json' 2026-05-27T11:54:07,233 adding 'unitxt/catalog/templates/qa/multiple_choice/with_context/no_intro/fr/helm.json' 2026-05-27T11:54:07,234 adding 'unitxt/catalog/templates/qa/multiple_choice/with_context/no_intro/fr/lm_eval_harness.json' 2026-05-27T11:54:07,235 adding 'unitxt/catalog/templates/qa/multiple_choice/with_context/no_intro/fr/mmlu.json' 2026-05-27T11:54:07,237 adding 'unitxt/catalog/templates/qa/multiple_choice/with_context/no_intro/ja/all.json' 2026-05-27T11:54:07,238 adding 'unitxt/catalog/templates/qa/multiple_choice/with_context/no_intro/ja/helm.json' 2026-05-27T11:54:07,240 adding 'unitxt/catalog/templates/qa/multiple_choice/with_context/no_intro/ja/lm_eval_harness.json' 2026-05-27T11:54:07,241 adding 'unitxt/catalog/templates/qa/multiple_choice/with_context/no_intro/ja/mmlu.json' 2026-05-27T11:54:07,242 adding 'unitxt/catalog/templates/qa/multiple_choice/with_context/no_intro/pt/all.json' 2026-05-27T11:54:07,243 adding 'unitxt/catalog/templates/qa/multiple_choice/with_context/no_intro/pt/helm.json' 2026-05-27T11:54:07,244 adding 'unitxt/catalog/templates/qa/multiple_choice/with_context/no_intro/pt/lm_eval_harness.json' 2026-05-27T11:54:07,245 adding 'unitxt/catalog/templates/qa/multiple_choice/with_context/no_intro/pt/mmlu.json' 2026-05-27T11:54:07,247 adding 'unitxt/catalog/templates/qa/multiple_choice/with_context/with_topic/all.json' 2026-05-27T11:54:07,249 adding 'unitxt/catalog/templates/qa/multiple_choice/with_context/with_topic/fm_eval.json' 2026-05-27T11:54:07,250 adding 'unitxt/catalog/templates/qa/multiple_choice/with_context/with_topic/helm.json' 2026-05-27T11:54:07,251 adding 'unitxt/catalog/templates/qa/multiple_choice/with_context/with_topic/lm_eval_harness.json' 2026-05-27T11:54:07,252 adding 'unitxt/catalog/templates/qa/multiple_choice/with_context/with_topic/match.json' 2026-05-27T11:54:07,253 adding 'unitxt/catalog/templates/qa/multiple_choice/with_context/with_topic/mmlu.json' 2026-05-27T11:54:07,255 adding 'unitxt/catalog/templates/qa/multiple_choice/with_context/with_topic/title.json' 2026-05-27T11:54:07,256 adding 'unitxt/catalog/templates/qa/multiple_choice/with_context/with_topic/de/all.json' 2026-05-27T11:54:07,257 adding 'unitxt/catalog/templates/qa/multiple_choice/with_context/with_topic/de/helm.json' 2026-05-27T11:54:07,259 adding 'unitxt/catalog/templates/qa/multiple_choice/with_context/with_topic/de/lm_eval_harness.json' 2026-05-27T11:54:07,260 adding 'unitxt/catalog/templates/qa/multiple_choice/with_context/with_topic/de/mmlu.json' 2026-05-27T11:54:07,262 adding 'unitxt/catalog/templates/qa/multiple_choice/with_context/with_topic/es/all.json' 2026-05-27T11:54:07,263 adding 'unitxt/catalog/templates/qa/multiple_choice/with_context/with_topic/es/helm.json' 2026-05-27T11:54:07,264 adding 'unitxt/catalog/templates/qa/multiple_choice/with_context/with_topic/es/lm_eval_harness.json' 2026-05-27T11:54:07,265 adding 'unitxt/catalog/templates/qa/multiple_choice/with_context/with_topic/es/mmlu.json' 2026-05-27T11:54:07,267 adding 'unitxt/catalog/templates/qa/multiple_choice/with_context/with_topic/fr/all.json' 2026-05-27T11:54:07,268 adding 'unitxt/catalog/templates/qa/multiple_choice/with_context/with_topic/fr/helm.json' 2026-05-27T11:54:07,269 adding 'unitxt/catalog/templates/qa/multiple_choice/with_context/with_topic/fr/lm_eval_harness.json' 2026-05-27T11:54:07,271 adding 'unitxt/catalog/templates/qa/multiple_choice/with_context/with_topic/fr/mmlu.json' 2026-05-27T11:54:07,272 adding 'unitxt/catalog/templates/qa/multiple_choice/with_context/with_topic/ja/all.json' 2026-05-27T11:54:07,274 adding 'unitxt/catalog/templates/qa/multiple_choice/with_context/with_topic/ja/helm.json' 2026-05-27T11:54:07,275 adding 'unitxt/catalog/templates/qa/multiple_choice/with_context/with_topic/ja/lm_eval_harness.json' 2026-05-27T11:54:07,276 adding 'unitxt/catalog/templates/qa/multiple_choice/with_context/with_topic/ja/mmlu.json' 2026-05-27T11:54:07,278 adding 'unitxt/catalog/templates/qa/multiple_choice/with_context/with_topic/pt/all.json' 2026-05-27T11:54:07,279 adding 'unitxt/catalog/templates/qa/multiple_choice/with_context/with_topic/pt/helm.json' 2026-05-27T11:54:07,280 adding 'unitxt/catalog/templates/qa/multiple_choice/with_context/with_topic/pt/lm_eval_harness.json' 2026-05-27T11:54:07,282 adding 'unitxt/catalog/templates/qa/multiple_choice/with_context/with_topic/pt/mmlu.json' 2026-05-27T11:54:07,283 adding 'unitxt/catalog/templates/qa/multiple_choice/with_topic/all.json' 2026-05-27T11:54:07,285 adding 'unitxt/catalog/templates/qa/multiple_choice/with_topic/bluebench.json' 2026-05-27T11:54:07,286 adding 'unitxt/catalog/templates/qa/multiple_choice/with_topic/fm_eval.json' 2026-05-27T11:54:07,287 adding 'unitxt/catalog/templates/qa/multiple_choice/with_topic/helm.json' 2026-05-27T11:54:07,288 adding 'unitxt/catalog/templates/qa/multiple_choice/with_topic/lm_eval_harness.json' 2026-05-27T11:54:07,289 adding 'unitxt/catalog/templates/qa/multiple_choice/with_topic/match.json' 2026-05-27T11:54:07,290 adding 'unitxt/catalog/templates/qa/multiple_choice/with_topic/mmlu.json' 2026-05-27T11:54:07,291 adding 'unitxt/catalog/templates/qa/multiple_choice/with_topic/title.json' 2026-05-27T11:54:07,293 adding 'unitxt/catalog/templates/qa/multiple_choice/with_topic/de/all.json' 2026-05-27T11:54:07,294 adding 'unitxt/catalog/templates/qa/multiple_choice/with_topic/de/helm.json' 2026-05-27T11:54:07,295 adding 'unitxt/catalog/templates/qa/multiple_choice/with_topic/de/lm_eval_harness.json' 2026-05-27T11:54:07,296 adding 'unitxt/catalog/templates/qa/multiple_choice/with_topic/de/mmlu.json' 2026-05-27T11:54:07,298 adding 'unitxt/catalog/templates/qa/multiple_choice/with_topic/es/all.json' 2026-05-27T11:54:07,299 adding 'unitxt/catalog/templates/qa/multiple_choice/with_topic/es/helm.json' 2026-05-27T11:54:07,300 adding 'unitxt/catalog/templates/qa/multiple_choice/with_topic/es/lm_eval_harness.json' 2026-05-27T11:54:07,302 adding 'unitxt/catalog/templates/qa/multiple_choice/with_topic/es/mmlu.json' 2026-05-27T11:54:07,303 adding 'unitxt/catalog/templates/qa/multiple_choice/with_topic/fr/all.json' 2026-05-27T11:54:07,304 adding 'unitxt/catalog/templates/qa/multiple_choice/with_topic/fr/helm.json' 2026-05-27T11:54:07,306 adding 'unitxt/catalog/templates/qa/multiple_choice/with_topic/fr/lm_eval_harness.json' 2026-05-27T11:54:07,307 adding 'unitxt/catalog/templates/qa/multiple_choice/with_topic/fr/mmlu.json' 2026-05-27T11:54:07,308 adding 'unitxt/catalog/templates/qa/multiple_choice/with_topic/ja/all.json' 2026-05-27T11:54:07,310 adding 'unitxt/catalog/templates/qa/multiple_choice/with_topic/ja/helm.json' 2026-05-27T11:54:07,311 adding 'unitxt/catalog/templates/qa/multiple_choice/with_topic/ja/lm_eval_harness.json' 2026-05-27T11:54:07,312 adding 'unitxt/catalog/templates/qa/multiple_choice/with_topic/ja/mmlu.json' 2026-05-27T11:54:07,314 adding 'unitxt/catalog/templates/qa/multiple_choice/with_topic/pt/all.json' 2026-05-27T11:54:07,315 adding 'unitxt/catalog/templates/qa/multiple_choice/with_topic/pt/helm.json' 2026-05-27T11:54:07,316 adding 'unitxt/catalog/templates/qa/multiple_choice/with_topic/pt/lm_eval_harness.json' 2026-05-27T11:54:07,317 adding 'unitxt/catalog/templates/qa/multiple_choice/with_topic/pt/mmlu.json' 2026-05-27T11:54:07,319 adding 'unitxt/catalog/templates/qa/open/all.json' 2026-05-27T11:54:07,320 adding 'unitxt/catalog/templates/qa/open/empty.json' 2026-05-27T11:54:07,321 adding 'unitxt/catalog/templates/qa/open/simple.json' 2026-05-27T11:54:07,323 adding 'unitxt/catalog/templates/qa/open/simple2.json' 2026-05-27T11:54:07,324 adding 'unitxt/catalog/templates/qa/open/title.json' 2026-05-27T11:54:07,325 adding 'unitxt/catalog/templates/qa/with_context/all.json' 2026-05-27T11:54:07,327 adding 'unitxt/catalog/templates/qa/with_context/chart_qa.json' 2026-05-27T11:54:07,328 adding 'unitxt/catalog/templates/qa/with_context/doc_vqa.json' 2026-05-27T11:54:07,329 adding 'unitxt/catalog/templates/qa/with_context/ffqa.json' 2026-05-27T11:54:07,330 adding 'unitxt/catalog/templates/qa/with_context/info_vqa.json' 2026-05-27T11:54:07,331 adding 'unitxt/catalog/templates/qa/with_context/lmms_eval.json' 2026-05-27T11:54:07,333 adding 'unitxt/catalog/templates/qa/with_context/qtsumm.json' 2026-05-27T11:54:07,334 adding 'unitxt/catalog/templates/qa/with_context/question_first.json' 2026-05-27T11:54:07,335 adding 'unitxt/catalog/templates/qa/with_context/simple.json' 2026-05-27T11:54:07,336 adding 'unitxt/catalog/templates/qa/with_context/simple2.json' 2026-05-27T11:54:07,337 adding 'unitxt/catalog/templates/qa/with_context/title.json' 2026-05-27T11:54:07,339 adding 'unitxt/catalog/templates/qa/with_context/websrc.json' 2026-05-27T11:54:07,340 adding 'unitxt/catalog/templates/qa/with_context/with_type.json' 2026-05-27T11:54:07,342 adding 'unitxt/catalog/templates/rag/end_to_end/json_predictions.json' 2026-05-27T11:54:07,343 adding 'unitxt/catalog/templates/rag/response_generation/answer_based_on_context.json' 2026-05-27T11:54:07,344 adding 'unitxt/catalog/templates/rag/response_generation/answer_based_on_context_inverted.json' 2026-05-27T11:54:07,345 adding 'unitxt/catalog/templates/rag/response_generation/bluebench.json' 2026-05-27T11:54:07,347 adding 'unitxt/catalog/templates/rag/response_generation/please_respond.json' 2026-05-27T11:54:07,348 adding 'unitxt/catalog/templates/rag/response_generation/please_respond_chat.json' 2026-05-27T11:54:07,350 adding 'unitxt/catalog/templates/rag_eval/answer_correctness/all.json' 2026-05-27T11:54:07,351 adding 'unitxt/catalog/templates/rag_eval/answer_correctness/judge_instruct_qa_format.json' 2026-05-27T11:54:07,353 adding 'unitxt/catalog/templates/rag_eval/answer_correctness/judge_instruct_qa_format_logprobs.json' 2026-05-27T11:54:07,354 adding 'unitxt/catalog/templates/rag_eval/answer_correctness/judge_loose_match_no_context.json' 2026-05-27T11:54:07,355 adding 'unitxt/catalog/templates/rag_eval/answer_correctness/judge_loose_match_no_context_logprobs.json' 2026-05-27T11:54:07,357 adding 'unitxt/catalog/templates/rag_eval/answer_correctness/judge_loose_match_no_context_numeric.json' 2026-05-27T11:54:07,358 adding 'unitxt/catalog/templates/rag_eval/answer_correctness/judge_loose_match_no_context_verbal.json' 2026-05-27T11:54:07,359 adding 'unitxt/catalog/templates/rag_eval/answer_correctness/judge_loose_match_no_context_verbal_good_bad.json' 2026-05-27T11:54:07,360 adding 'unitxt/catalog/templates/rag_eval/answer_correctness/judge_simplified_format.json' 2026-05-27T11:54:07,362 adding 'unitxt/catalog/templates/rag_eval/answer_correctness/judge_simplified_format_logprobs.json' 2026-05-27T11:54:07,363 adding 'unitxt/catalog/templates/rag_eval/answer_correctness/judge_simplified_no_context.json' 2026-05-27T11:54:07,364 adding 'unitxt/catalog/templates/rag_eval/answer_correctness/judge_simplified_no_context_logprobs.json' 2026-05-27T11:54:07,366 adding 'unitxt/catalog/templates/rag_eval/answer_correctness/judge_simplified_with_context.json' 2026-05-27T11:54:07,367 adding 'unitxt/catalog/templates/rag_eval/answer_correctness/judge_simplified_with_context_logprobs.json' 2026-05-27T11:54:07,368 adding 'unitxt/catalog/templates/rag_eval/answer_correctness/metric_template.json' 2026-05-27T11:54:07,370 adding 'unitxt/catalog/templates/rag_eval/answer_relevance/all.json' 2026-05-27T11:54:07,371 adding 'unitxt/catalog/templates/rag_eval/answer_relevance/judge_answer_relevance.json' 2026-05-27T11:54:07,372 adding 'unitxt/catalog/templates/rag_eval/answer_relevance/judge_answer_relevance_logprobs.json' 2026-05-27T11:54:07,373 adding 'unitxt/catalog/templates/rag_eval/answer_relevance/judge_answer_relevance_numeric.json' 2026-05-27T11:54:07,375 adding 'unitxt/catalog/templates/rag_eval/answer_relevance/judge_answer_relevance_verbal_good_bad.json' 2026-05-27T11:54:07,376 adding 'unitxt/catalog/templates/rag_eval/answer_relevance/metric_template.json' 2026-05-27T11:54:07,378 adding 'unitxt/catalog/templates/rag_eval/context_relevance/all.json' 2026-05-27T11:54:07,379 adding 'unitxt/catalog/templates/rag_eval/context_relevance/judge_context_relevance.json' 2026-05-27T11:54:07,380 adding 'unitxt/catalog/templates/rag_eval/context_relevance/judge_context_relevance_ares.json' 2026-05-27T11:54:07,381 adding 'unitxt/catalog/templates/rag_eval/context_relevance/judge_context_relevance_ares_logprobs.json' 2026-05-27T11:54:07,383 adding 'unitxt/catalog/templates/rag_eval/context_relevance/judge_context_relevance_ares_numeric.json' 2026-05-27T11:54:07,384 adding 'unitxt/catalog/templates/rag_eval/context_relevance/judge_context_relevance_ares_verbal.json' 2026-05-27T11:54:07,385 adding 'unitxt/catalog/templates/rag_eval/context_relevance/judge_context_relevance_ares_verbal_good_bad.json' 2026-05-27T11:54:07,386 adding 'unitxt/catalog/templates/rag_eval/context_relevance/judge_context_relevance_logprobs.json' 2026-05-27T11:54:07,388 adding 'unitxt/catalog/templates/rag_eval/context_relevance/metric_template.json' 2026-05-27T11:54:07,389 adding 'unitxt/catalog/templates/rag_eval/correctness_holistic/all.json' 2026-05-27T11:54:07,390 adding 'unitxt/catalog/templates/rag_eval/correctness_holistic/judge_correctness_explain_first.json' 2026-05-27T11:54:07,391 adding 'unitxt/catalog/templates/rag_eval/correctness_holistic/judge_correctness_explain_first_logprobs.json' 2026-05-27T11:54:07,393 adding 'unitxt/catalog/templates/rag_eval/correctness_holistic/judge_correctness_simple.json' 2026-05-27T11:54:07,394 adding 'unitxt/catalog/templates/rag_eval/correctness_holistic/judge_correctness_simple_logprobs.json' 2026-05-27T11:54:07,395 adding 'unitxt/catalog/templates/rag_eval/correctness_holistic/judge_correctness_simple_numeric.json' 2026-05-27T11:54:07,396 adding 'unitxt/catalog/templates/rag_eval/correctness_holistic/metric_template.json' 2026-05-27T11:54:07,398 adding 'unitxt/catalog/templates/rag_eval/faithfulness/all.json' 2026-05-27T11:54:07,399 adding 'unitxt/catalog/templates/rag_eval/faithfulness/judge_no_question_full.json' 2026-05-27T11:54:07,401 adding 'unitxt/catalog/templates/rag_eval/faithfulness/judge_no_question_full_logprobs.json' 2026-05-27T11:54:07,402 adding 'unitxt/catalog/templates/rag_eval/faithfulness/judge_no_question_simplified.json' 2026-05-27T11:54:07,403 adding 'unitxt/catalog/templates/rag_eval/faithfulness/judge_no_question_simplified_explain.json' 2026-05-27T11:54:07,404 adding 'unitxt/catalog/templates/rag_eval/faithfulness/judge_no_question_simplified_explain_logprobs.json' 2026-05-27T11:54:07,405 adding 'unitxt/catalog/templates/rag_eval/faithfulness/judge_no_question_simplified_logprobs.json' 2026-05-27T11:54:07,407 adding 'unitxt/catalog/templates/rag_eval/faithfulness/judge_no_question_simplified_numeric.json' 2026-05-27T11:54:07,408 adding 'unitxt/catalog/templates/rag_eval/faithfulness/judge_no_question_simplified_verbal.json' 2026-05-27T11:54:07,409 adding 'unitxt/catalog/templates/rag_eval/faithfulness/judge_no_question_simplified_verbal_good_bad.json' 2026-05-27T11:54:07,410 adding 'unitxt/catalog/templates/rag_eval/faithfulness/judge_with_question_full.json' 2026-05-27T11:54:07,412 adding 'unitxt/catalog/templates/rag_eval/faithfulness/judge_with_question_full_logprobs.json' 2026-05-27T11:54:07,413 adding 'unitxt/catalog/templates/rag_eval/faithfulness/judge_with_question_simplified.json' 2026-05-27T11:54:07,414 adding 'unitxt/catalog/templates/rag_eval/faithfulness/judge_with_question_simplified_logprobs.json' 2026-05-27T11:54:07,415 adding 'unitxt/catalog/templates/rag_eval/faithfulness/judge_with_question_simplified_numeric.json' 2026-05-27T11:54:07,417 adding 'unitxt/catalog/templates/rag_eval/faithfulness/judge_with_question_simplified_verbal.json' 2026-05-27T11:54:07,418 adding 'unitxt/catalog/templates/rag_eval/faithfulness/judge_with_question_simplified_verbal_good_bad.json' 2026-05-27T11:54:07,419 adding 'unitxt/catalog/templates/rag_eval/faithfulness/metric_template.json' 2026-05-27T11:54:07,422 adding 'unitxt/catalog/templates/regression/single_text/all.json' 2026-05-27T11:54:07,423 adding 'unitxt/catalog/templates/regression/single_text/simple.json' 2026-05-27T11:54:07,424 adding 'unitxt/catalog/templates/regression/single_text/title.json' 2026-05-27T11:54:07,426 adding 'unitxt/catalog/templates/regression/two_texts/all.json' 2026-05-27T11:54:07,427 adding 'unitxt/catalog/templates/regression/two_texts/simple.json' 2026-05-27T11:54:07,428 adding 'unitxt/catalog/templates/regression/two_texts/title.json' 2026-05-27T11:54:07,430 adding 'unitxt/catalog/templates/regression/two_texts/similarity/flan.json' 2026-05-27T11:54:07,432 adding 'unitxt/catalog/templates/response_assessment/pairwise_comparative_rating/arena_hard.json' 2026-05-27T11:54:07,434 adding 'unitxt/catalog/templates/response_assessment/pairwise_comparative_rating/arena_hard_with_shuffling.json' 2026-05-27T11:54:07,435 adding 'unitxt/catalog/templates/response_assessment/pairwise_comparative_rating/prometheus_arena_hard.json' 2026-05-27T11:54:07,436 adding 'unitxt/catalog/templates/response_assessment/pairwise_comparative_rating/prometheus_arena_hard_with_shuffling.json' 2026-05-27T11:54:07,438 adding 'unitxt/catalog/templates/response_assessment/pairwise_comparison/mt_bench_multi_turn.json' 2026-05-27T11:54:07,439 adding 'unitxt/catalog/templates/response_assessment/pairwise_comparison/mt_bench_multi_turn_with_reference.json' 2026-05-27T11:54:07,441 adding 'unitxt/catalog/templates/response_assessment/pairwise_comparison/mt_bench_multi_turn_with_reference_with_shuffling.json' 2026-05-27T11:54:07,442 adding 'unitxt/catalog/templates/response_assessment/pairwise_comparison/mt_bench_multi_turn_with_shuffling.json' 2026-05-27T11:54:07,443 adding 'unitxt/catalog/templates/response_assessment/pairwise_comparison/mt_bench_single_turn.json' 2026-05-27T11:54:07,445 adding 'unitxt/catalog/templates/response_assessment/pairwise_comparison/mt_bench_single_turn_with_reference.json' 2026-05-27T11:54:07,446 adding 'unitxt/catalog/templates/response_assessment/pairwise_comparison/mt_bench_single_turn_with_reference_with_shuffling.json' 2026-05-27T11:54:07,447 adding 'unitxt/catalog/templates/response_assessment/pairwise_comparison/mt_bench_single_turn_with_shuffling.json' 2026-05-27T11:54:07,449 adding 'unitxt/catalog/templates/response_assessment/rating/generic_single_turn.json' 2026-05-27T11:54:07,450 adding 'unitxt/catalog/templates/response_assessment/rating/generic_single_turn_with_reference.json' 2026-05-27T11:54:07,452 adding 'unitxt/catalog/templates/response_assessment/rating/mt_bench_multi_turn.json' 2026-05-27T11:54:07,453 adding 'unitxt/catalog/templates/response_assessment/rating/mt_bench_multi_turn_with_reference.json' 2026-05-27T11:54:07,454 adding 'unitxt/catalog/templates/response_assessment/rating/mt_bench_single_turn.json' 2026-05-27T11:54:07,456 adding 'unitxt/catalog/templates/response_assessment/rating/mt_bench_single_turn_with_reference.json' 2026-05-27T11:54:07,457 adding 'unitxt/catalog/templates/response_assessment/rating/table2text_single_turn_with_reference.json' 2026-05-27T11:54:07,459 adding 'unitxt/catalog/templates/rewriting/by_attribute/all.json' 2026-05-27T11:54:07,461 adding 'unitxt/catalog/templates/rewriting/by_attribute/default.json' 2026-05-27T11:54:07,462 adding 'unitxt/catalog/templates/rewriting/paraphrase/all.json' 2026-05-27T11:54:07,463 adding 'unitxt/catalog/templates/rewriting/paraphrase/default.json' 2026-05-27T11:54:07,465 adding 'unitxt/catalog/templates/safety/harm_rating.json' 2026-05-27T11:54:07,467 adding 'unitxt/catalog/templates/safety/llamaguard.json' 2026-05-27T11:54:07,468 adding 'unitxt/catalog/templates/schema_linking/all.json' 2026-05-27T11:54:07,470 adding 'unitxt/catalog/templates/schema_linking/default.json' 2026-05-27T11:54:07,471 adding 'unitxt/catalog/templates/schema_linking/with_hint.json' 2026-05-27T11:54:07,473 adding 'unitxt/catalog/templates/selection/by_attribute/all.json' 2026-05-27T11:54:07,474 adding 'unitxt/catalog/templates/selection/by_attribute/default.json' 2026-05-27T11:54:07,477 adding 'unitxt/catalog/templates/span_labeling/extraction/all.json' 2026-05-27T11:54:07,478 adding 'unitxt/catalog/templates/span_labeling/extraction/carry.json' 2026-05-27T11:54:07,479 adding 'unitxt/catalog/templates/span_labeling/extraction/detailed.json' 2026-05-27T11:54:07,480 adding 'unitxt/catalog/templates/span_labeling/extraction/empty.json' 2026-05-27T11:54:07,482 adding 'unitxt/catalog/templates/span_labeling/extraction/extract.json' 2026-05-27T11:54:07,483 adding 'unitxt/catalog/templates/span_labeling/extraction/having.json' 2026-05-27T11:54:07,484 adding 'unitxt/catalog/templates/span_labeling/extraction/identify.json' 2026-05-27T11:54:07,485 adding 'unitxt/catalog/templates/span_labeling/extraction/title.json' 2026-05-27T11:54:07,487 adding 'unitxt/catalog/templates/summarization/abstractive/all.json' 2026-05-27T11:54:07,489 adding 'unitxt/catalog/templates/summarization/abstractive/bluebench.json' 2026-05-27T11:54:07,490 adding 'unitxt/catalog/templates/summarization/abstractive/casual.json' 2026-05-27T11:54:07,491 adding 'unitxt/catalog/templates/summarization/abstractive/formal.json' 2026-05-27T11:54:07,492 adding 'unitxt/catalog/templates/summarization/abstractive/formal_without_label.json' 2026-05-27T11:54:07,493 adding 'unitxt/catalog/templates/summarization/abstractive/full.json' 2026-05-27T11:54:07,494 adding 'unitxt/catalog/templates/summarization/abstractive/instruct_full.json' 2026-05-27T11:54:07,495 adding 'unitxt/catalog/templates/summarization/abstractive/instruct_one_sentence.json' 2026-05-27T11:54:07,496 adding 'unitxt/catalog/templates/summarization/abstractive/instruct_passive.json' 2026-05-27T11:54:07,498 adding 'unitxt/catalog/templates/summarization/abstractive/instruct_tldr.json' 2026-05-27T11:54:07,499 adding 'unitxt/catalog/templates/summarization/abstractive/instruct_write_succinct.json' 2026-05-27T11:54:07,500 adding 'unitxt/catalog/templates/summarization/abstractive/instructive.json' 2026-05-27T11:54:07,501 adding 'unitxt/catalog/templates/summarization/abstractive/one_sentence.json' 2026-05-27T11:54:07,502 adding 'unitxt/catalog/templates/summarization/abstractive/passive.json' 2026-05-27T11:54:07,504 adding 'unitxt/catalog/templates/summarization/abstractive/professional.json' 2026-05-27T11:54:07,505 adding 'unitxt/catalog/templates/summarization/abstractive/title.json' 2026-05-27T11:54:07,506 adding 'unitxt/catalog/templates/summarization/abstractive/write_succinct.json' 2026-05-27T11:54:07,508 adding 'unitxt/catalog/templates/targeted_sentiment_extraction/all.json' 2026-05-27T11:54:07,509 adding 'unitxt/catalog/templates/targeted_sentiment_extraction/carry_sentiment.json' 2026-05-27T11:54:07,510 adding 'unitxt/catalog/templates/targeted_sentiment_extraction/empty.json' 2026-05-27T11:54:07,511 adding 'unitxt/catalog/templates/targeted_sentiment_extraction/entities_sentiment.json' 2026-05-27T11:54:07,512 adding 'unitxt/catalog/templates/targeted_sentiment_extraction/extract_sentiment.json' 2026-05-27T11:54:07,514 adding 'unitxt/catalog/templates/targeted_sentiment_extraction/having_sentiment.json' 2026-05-27T11:54:07,515 adding 'unitxt/catalog/templates/targeted_sentiment_extraction/as_json/convert_with_explicit_keys.json' 2026-05-27T11:54:07,517 adding 'unitxt/catalog/templates/targeted_sentiment_extraction/as_json/convert_with_implicit_keys.json' 2026-05-27T11:54:07,518 adding 'unitxt/catalog/templates/targeted_sentiment_extraction/as_json/empty.json' 2026-05-27T11:54:07,520 adding 'unitxt/catalog/templates/targeted_sentiment_extraction/negative/all.json' 2026-05-27T11:54:07,521 adding 'unitxt/catalog/templates/targeted_sentiment_extraction/negative/empty.json' 2026-05-27T11:54:07,522 adding 'unitxt/catalog/templates/targeted_sentiment_extraction/negative/having_sentiment.json' 2026-05-27T11:54:07,523 adding 'unitxt/catalog/templates/targeted_sentiment_extraction/negative/sentiment_extracted.json' 2026-05-27T11:54:07,525 adding 'unitxt/catalog/templates/targeted_sentiment_extraction/neutral/all.json' 2026-05-27T11:54:07,526 adding 'unitxt/catalog/templates/targeted_sentiment_extraction/neutral/empty.json' 2026-05-27T11:54:07,528 adding 'unitxt/catalog/templates/targeted_sentiment_extraction/neutral/having_sentiment.json' 2026-05-27T11:54:07,529 adding 'unitxt/catalog/templates/targeted_sentiment_extraction/neutral/sentiment_extracted.json' 2026-05-27T11:54:07,531 adding 'unitxt/catalog/templates/targeted_sentiment_extraction/positive/all.json' 2026-05-27T11:54:07,532 adding 'unitxt/catalog/templates/targeted_sentiment_extraction/positive/empty.json' 2026-05-27T11:54:07,533 adding 'unitxt/catalog/templates/targeted_sentiment_extraction/positive/having_sentiment.json' 2026-05-27T11:54:07,534 adding 'unitxt/catalog/templates/targeted_sentiment_extraction/positive/sentiment_extracted.json' 2026-05-27T11:54:07,536 adding 'unitxt/catalog/templates/text2sql/all.json' 2026-05-27T11:54:07,537 adding 'unitxt/catalog/templates/text2sql/empty.json' 2026-05-27T11:54:07,538 adding 'unitxt/catalog/templates/text2sql/you_are_given.json' 2026-05-27T11:54:07,540 adding 'unitxt/catalog/templates/text2sql/you_are_given_no_system.json' 2026-05-27T11:54:07,541 adding 'unitxt/catalog/templates/text2sql/you_are_given_no_system_with_hint.json' 2026-05-27T11:54:07,542 adding 'unitxt/catalog/templates/text2sql/you_are_given_with_hint.json' 2026-05-27T11:54:07,543 adding 'unitxt/catalog/templates/text2sql/you_are_given_with_hint_answer_sql_prefix_no_inst.json' 2026-05-27T11:54:07,544 adding 'unitxt/catalog/templates/text2sql/you_are_given_with_hint_with_out_sql_prefix.json' 2026-05-27T11:54:07,545 adding 'unitxt/catalog/templates/text2sql/you_are_given_with_hint_with_sql_prefix.json' 2026-05-27T11:54:07,547 adding 'unitxt/catalog/templates/text2sql/you_are_given_with_sql_prefix.json' 2026-05-27T11:54:07,548 adding 'unitxt/catalog/templates/tool_calling/base.json' 2026-05-27T11:54:07,549 adding 'unitxt/catalog/templates/tool_calling/multi_turn.json' 2026-05-27T11:54:07,551 adding 'unitxt/catalog/templates/translation/directed/all.json' 2026-05-27T11:54:07,552 adding 'unitxt/catalog/templates/translation/directed/bluebench.json' 2026-05-27T11:54:07,553 adding 'unitxt/catalog/templates/translation/directed/casual.json' 2026-05-27T11:54:07,555 adding 'unitxt/catalog/templates/translation/directed/formal.json' 2026-05-27T11:54:07,556 adding 'unitxt/catalog/templates/translation/directed/instructional.json' 2026-05-27T11:54:07,557 adding 'unitxt/catalog/templates/translation/directed/playful.json' 2026-05-27T11:54:07,558 adding 'unitxt/catalog/templates/translation/directed/simple.json' 2026-05-27T11:54:07,559 adding 'unitxt/catalog/templates/translation/directed/title.json' 2026-05-27T11:54:07,561 adding 'unitxt/service/__init__.py' 2026-05-27T11:54:07,562 adding 'unitxt/service/metrics/__init__.py' 2026-05-27T11:54:07,564 adding 'unitxt/service/metrics/main.py' 2026-05-27T11:54:07,565 adding 'unitxt/service/metrics/tokens.py' 2026-05-27T11:54:07,567 adding 'unitxt/test_utils/__init__.py' 2026-05-27T11:54:07,568 adding 'unitxt/test_utils/artifact.py' 2026-05-27T11:54:07,570 adding 'unitxt/test_utils/card.py' 2026-05-27T11:54:07,572 adding 'unitxt/test_utils/catalog.py' 2026-05-27T11:54:07,573 adding 'unitxt/test_utils/metrics.py' 2026-05-27T11:54:07,575 adding 'unitxt/test_utils/operators.py' 2026-05-27T11:54:07,576 adding 'unitxt/test_utils/storage.py' 2026-05-27T11:54:07,578 adding 'unitxt/ui/__init__.py' 2026-05-27T11:54:07,590 adding 'unitxt/ui/banner.png' 2026-05-27T11:54:07,592 adding 'unitxt/ui/gradio_utils.py' 2026-05-27T11:54:07,594 adding 'unitxt/ui/load_catalog_data.py' 2026-05-27T11:54:07,596 adding 'unitxt/ui/run.py' 2026-05-27T11:54:07,597 adding 'unitxt/ui/settings.py' 2026-05-27T11:54:07,599 adding 'unitxt/ui/ui_tester.py' 2026-05-27T11:54:07,601 adding 'unitxt/ui/ui_utils.py' 2026-05-27T11:54:07,604 adding 'unitxt-1.26.10.dist-info/licenses/LICENSE' 2026-05-27T11:54:07,607 adding 'unitxt-1.26.10.dist-info/METADATA' 2026-05-27T11:54:07,609 adding 'unitxt-1.26.10.dist-info/WHEEL' 2026-05-27T11:54:07,610 adding 'unitxt-1.26.10.dist-info/entry_points.txt' 2026-05-27T11:54:07,611 adding 'unitxt-1.26.10.dist-info/top_level.txt' 2026-05-27T11:54:07,698 adding 'unitxt-1.26.10.dist-info/RECORD' 2026-05-27T11:54:08,087 removing build/bdist.linux-armv7l/wheel 2026-05-27T11:54:09,628 Building wheel for unitxt (pyproject.toml): finished with status 'done' 2026-05-27T11:54:10,337 Created wheel for unitxt: filename=unitxt-1.26.10-py3-none-any.whl size=32886835 sha256=4907572feafd86d1ae098ef8c989a1b27416cbbe6240b9179a0803af3862c4f9 2026-05-27T11:54:10,338 Stored in directory: /tmp/pip-ephem-wheel-cache-1g49g95g/wheels/65/e6/dd/e231777852ac90888d48eb01c7345f2ea4d592c4ffe3935a4d 2026-05-27T11:54:10,520 Successfully built unitxt 2026-05-27T11:54:11,313 Removed build tracker: '/tmp/pip-build-tracker-rbf86q8p'